Panopto Captioning ASR - machine generated captioning feedback
I'm the IT Administrator for Panopto in Trinity College Dublin, on the emerald isle of Ireland.
Our Student Disability Dept have been in touch seeking to have captioning turned on for asr across all recordings, we are currently in the IT dept doing our due diligence on this topic and looking at all sorts of options, we already have 11,000 recordings and have concerns about turning on asr across the board. We may try doing a pilot with a few depts./recording folders. Nicolas our success a/c mgr has told us that asr improved with new version in March 2020.
What I'd like to know is what universities have turned on asr completely (non paid for service, free asr) on their university and what type of support calls or issues arose?
How did others approach this topic, all ideas and suggestions welcome to give me some more insight?
So far, it doesnt appear to me that many universities have turned on asr across their whole panopto site recordings or maybe they have, have tried panopto slack forum already; not a lot of feedback coming back from other universities, would be interested in anyone who has turned on asr across the board or in phases to hear their experiences
Interesting note below, might be useful to others:
While I'm not an expert on asr accuracy, one 45 min recording I did analysis in some detail recently, with my own simple measuring method of counting the number of sentence sequences and then counting what textual errors were in the sentences, I got a figure of 88% accuracy, mainly the errors were around names. I would suspect that the asr is even more accurate up into the 90%s. There was a whole section of about 20 minutes for the second speaker on the recording where there were pretty much no errors which was impressive, an American accent speaker. Whether the fast talking Irish accent with local dialects will fare aswell no one knows!!!!