Measuring the accuracy of commercial automated speech recognition systems during conversational speech. Broughton, M. In Virtual conversational characters: Applications, methods, and research challenges, Melbourne, Australia. November 29, 2002.
Measuring the accuracy of commercial automated speech recognition systems during conversational speech [pdf]Paper  abstract   bibtex   
This paper presents research investigating recognition accuracy of two commercially available automated speech recognition (ASR) systems during spontaneous or conversational speech. This study is not aimed at finding the better ASR system, but more to use two systems to validate the technique used here to measure recognition accuracy during conversational speech. Evaluations of ASR systems are typically reported where participants dictate into the system from a prepared script. However, during spontaneous speech that will ideally result during interactions with Virtual Conversational Characters (VCC)s, the recognition accuracy of commercial ASRs is rarely advertised. As expected, there is a significant reduction in recognition accuracy during spontaneous speech, due to significant variations in the delivery of spontaneous and prepared speech.
@inproceedings{broughton_measuring_2002,
	Address = {Melbourne, Australia. November 29, 2002},
	Author = {Broughton, Michael},
	Booktitle = {Virtual conversational characters: Applications, methods, and research challenges},
	Date = {2002},
	Date-Modified = {2016-09-23 19:22:33 +0000},
	File = {Attachment:files/1587/Broughton - 2002 - Measuring the accuracy of commercial automated speech recognition systems during conversational speech.pdf:application/pdf},
	Keywords = {assessment, speech recognition, speech technology},
	Title = {Measuring the accuracy of commercial automated speech recognition systems during conversational speech},
	Url = {http://www.vhml.org/workshops/HF2002/papers/broughton/broughton.pdf},
	Abstract = {This paper presents research investigating recognition accuracy of two commercially available automated speech recognition (ASR) systems during spontaneous or conversational speech. This study is not aimed at finding the better ASR system, but more to use two systems to validate the technique used here to measure recognition accuracy during conversational speech. Evaluations of ASR systems are typically reported where participants dictate into the system from a prepared script. However, during spontaneous speech that will ideally result during interactions with Virtual Conversational Characters (VCC)s, the recognition accuracy of commercial ASRs is rarely advertised. As expected, there is a significant reduction in recognition accuracy during spontaneous speech, due to significant variations in the delivery of spontaneous and prepared speech.},
	Bdsk-File-1 = {YnBsaXN0MDDUAQIDBAUGJCVYJHZlcnNpb25YJG9iamVjdHNZJGFyY2hpdmVyVCR0b3ASAAGGoKgHCBMUFRYaIVUkbnVsbNMJCgsMDxJXTlMua2V5c1pOUy5vYmplY3RzViRjbGFzc6INDoACgAOiEBGABIAFgAdccmVsYXRpdmVQYXRoWWFsaWFzRGF0YV8QYC4uLy4uLy4uL0JpYmxpb2dyYWZpYS9QYXBlcnMvQnJvdWdodG9uL01lYXN1cmluZyB0aGUgYWNjdXJhY3kgb2YgY29tbWVyY2lhbCBhdXRvbWF0ZWQgc3BlZWNoLnBkZtIXCxgZV05TLmRhdGFPEQJaAAAAAAJaAAIAAAxNYWNpbnRvc2ggSEQAAAAAAAAAAAAAAAAAAADL9h/OSCsAABCGaA0fTWVhc3VyaW5nIHRoZSBhY2N1IzEwODY2ODBFLnBkZgAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAEIZoDtQJ0woAAAAAAAAAAAADAAQAAAkgAAAAAAAAAAAAAAAAAAAACUJyb3VnaHRvbgAAEAAIAADL9gOuAAAAEQAIAADUCbbqAAAAAQAUEIZoDRCGZY4ABfxHAAX7mAAAwEYAAgBnTWFjaW50b3NoIEhEOlVzZXJzOgBqb2FxdWltX2xsaXN0ZXJyaToAQmlibGlvZ3JhZmlhOgBQYXBlcnM6AEJyb3VnaHRvbjoATWVhc3VyaW5nIHRoZSBhY2N1IzEwODY2ODBFLnBkZgAADgB0ADkATQBlAGEAcwB1AHIAaQBuAGcAIAB0AGgAZQAgAGEAYwBjAHUAcgBhAGMAeQAgAG8AZgAgAGMAbwBtAG0AZQByAGMAaQBhAGwAIABhAHUAdABvAG0AYQB0AGUAZAAgAHMAcABlAGUAYwBoAC4AcABkAGYADwAaAAwATQBhAGMAaQBuAHQAbwBzAGgAIABIAEQAEgBvVXNlcnMvam9hcXVpbV9sbGlzdGVycmkvQmlibGlvZ3JhZmlhL1BhcGVycy9Ccm91Z2h0b24vTWVhc3VyaW5nIHRoZSBhY2N1cmFjeSBvZiBjb21tZXJjaWFsIGF1dG9tYXRlZCBzcGVlY2gucGRmAAATAAEvAAAVAAIAGP//AACABtIbHB0eWiRjbGFzc25hbWVYJGNsYXNzZXNdTlNNdXRhYmxlRGF0YaMdHyBWTlNEYXRhWE5TT2JqZWN00hscIiNcTlNEaWN0aW9uYXJ5oiIgXxAPTlNLZXllZEFyY2hpdmVy0SYnVHJvb3SAAQAIABEAGgAjAC0AMgA3AEAARgBNAFUAYABnAGoAbABuAHEAcwB1AHcAhACOAPEA9gD+A1wDXgNjA24DdwOFA4kDkAOZA54DqwOuA8ADwwPIAAAAAAAAAgEAAAAAAAAAKAAAAAAAAAAAAAAAAAAAA8o=},
	Bdsk-Url-1 = {http://www.vhml.org/workshops/HF2002/papers/broughton/broughton.pdf}}
Downloads: 0