Competitive evaluation of commercially available speech recognizers in multiple languages. Burger, S.; Sloane, Z. A; and Yang, J. In LREC 2006. Proceedings of the 5th International Conference on Language Resources and Evaluation. Genoa, Italy. May 24-26, 2006.
Competitive evaluation of commercially available speech recognizers in multiple languages [pdf]Paper  abstract   bibtex   
Recent improvements in speech recognition technology have resulted in products that can now demonstrate commercial value in a variety of applications. Many vendors are marketing products which combine ASR applications including continuous dictation, command-and-control interfaces, and transcription of recorded speech at an accuracy of 98%. In this study, we measured the accuracy of certain commercially available desktop speech recognition engines in multiple languages. Using word error rate as a benchmark, this work compares recognition accuracy across eight languages and the products of three manufacturers. Results show that two systems performed almost the same while a third system recognized at lower accuracy, although none of the systems reached the claimed accuracy. Read speech was recognized better than spontaneous speech. The systems for US-English, Japanese and Spanish showed higher accuracy than the systems for UK-English, German, French and Chinese.
@inproceedings{burger_competitive_2006,
	Author = {Burger, Susanne and Sloane, Zachary A and Yang, Jie},
	Booktitle = {LREC 2006. Proceedings of the 5th International Conference on Language Resources and Evaluation},
	Date = {2006},
	Date-Modified = {2016-09-23 19:22:33 +0000},
	File = {Attachment:files/1691/Burger, Sloane, Yang - 2006 - Competitive evaluation of commercially available speech recognizers in multiple languages.pdf:application/pdf},
	Keywords = {assessment, speech recognition, speech technology},
	Publisher = {Genoa, Italy. May 24-26, 2006},
	Title = {Competitive evaluation of commercially available speech recognizers in multiple languages},
	Url = {http://pages.cs.brandeis.edu/~marc/misc/proceedings/lrec-2006/pdf/802_pdf.pdf},
	Abstract = {Recent improvements in speech recognition technology have resulted in products that can now demonstrate commercial value in a variety of applications. Many vendors are marketing products which combine ASR applications including continuous dictation, command-and-control interfaces, and transcription of recorded speech at an accuracy of 98\%. In this study, we measured the accuracy of certain commercially available desktop speech recognition engines in multiple languages. Using word error rate as a benchmark, this work compares recognition accuracy across eight languages and the products of three manufacturers. Results show that two systems performed almost the same while a third system recognized at lower accuracy, although none of the systems reached the claimed accuracy. Read speech was recognized better than spontaneous speech. The systems for US-English, Japanese and Spanish showed higher accuracy than the systems for UK-English, German, French and Chinese.},
	Bdsk-File-1 = {YnBsaXN0MDDUAQIDBAUGJCVYJHZlcnNpb25YJG9iamVjdHNZJGFyY2hpdmVyVCR0b3ASAAGGoKgHCBMUFRYaIVUkbnVsbNMJCgsMDxJXTlMua2V5c1pOUy5vYmplY3RzViRjbGFzc6INDoACgAOiEBGABIAFgAdccmVsYXRpdmVQYXRoWWFsaWFzRGF0YV8QXy4uLy4uLy4uL0JpYmxpb2dyYWZpYS9QYXBlcnMvQnVyZ2VyL0NvbXBldGl0aXZlIGV2YWx1YXRpb24gb2YgY29tbWVyY2lhbGx5IGF2YWlsYWJsZSBzcGVlY2gucGRm0hcLGBlXTlMuZGF0YU8RAlQAAAAAAlQAAgAADE1hY2ludG9zaCBIRAAAAAAAAAAAAAAAAAAAAMv2H85IKwAAEIZoPB9Db21wZXRpdGl2ZSBldmFsdWEjMTA4NjY4M0QucGRmAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAQhmg91AnTEgAAAAAAAAAAAAMABAAACSAAAAAAAAAAAAAAAAAAAAAGQnVyZ2VyABAACAAAy/YDrgAAABEACAAA1Am28gAAAAEAFBCGaDwQhmWOAAX8RwAF+5gAAMBGAAIAZE1hY2ludG9zaCBIRDpVc2VyczoAam9hcXVpbV9sbGlzdGVycmk6AEJpYmxpb2dyYWZpYToAUGFwZXJzOgBCdXJnZXI6AENvbXBldGl0aXZlIGV2YWx1YSMxMDg2NjgzRC5wZGYADgB4ADsAQwBvAG0AcABlAHQAaQB0AGkAdgBlACAAZQB2AGEAbAB1AGEAdABpAG8AbgAgAG8AZgAgAGMAbwBtAG0AZQByAGMAaQBhAGwAbAB5ACAAYQB2AGEAaQBsAGEAYgBsAGUAIABzAHAAZQBlAGMAaAAuAHAAZABmAA8AGgAMAE0AYQBjAGkAbgB0AG8AcwBoACAASABEABIAblVzZXJzL2pvYXF1aW1fbGxpc3RlcnJpL0JpYmxpb2dyYWZpYS9QYXBlcnMvQnVyZ2VyL0NvbXBldGl0aXZlIGV2YWx1YXRpb24gb2YgY29tbWVyY2lhbGx5IGF2YWlsYWJsZSBzcGVlY2gucGRmABMAAS8AABUAAgAY//8AAIAG0hscHR5aJGNsYXNzbmFtZVgkY2xhc3Nlc11OU011dGFibGVEYXRhox0fIFZOU0RhdGFYTlNPYmplY3TSGxwiI1xOU0RpY3Rpb25hcnmiIiBfEA9OU0tleWVkQXJjaGl2ZXLRJidUcm9vdIABAAgAEQAaACMALQAyADcAQABGAE0AVQBgAGcAagBsAG4AcQBzAHUAdwCEAI4A8AD1AP0DVQNXA1wDZwNwA34DggOJA5IDlwOkA6cDuQO8A8EAAAAAAAACAQAAAAAAAAAoAAAAAAAAAAAAAAAAAAADww==},
	Bdsk-Url-1 = {http://pages.cs.brandeis.edu/~marc/misc/proceedings/lrec-2006/pdf/802_pdf.pdf}}
Downloads: 0