Frame rate and viseme analysis for multimedia applications. Williams, J., Rutledge, J., Garstecki, D., Katsaggelos, A., Jay, J W., Janet, C R., Dean, C G., & Aggelos, K K. In Proceedings of First Signal Processing Society Workshop on Multimedia Signal Processing, volume 20, pages 13–18, 1997. IEEE.
Frame rate and viseme analysis for multimedia applications [link]Paper  doi  abstract   bibtex   
In the future, multimedia technology will be able to provide video frame rates equal to or better than 30 frames-per-second (FPS). Until that time the hearing impaired community will be using band limited communication systems over un-shielded twisted pair copper wiring. As a result, multimedia communication systems will use a coder/decoder (CODEC) to compress the video and audio signals for transmission. For these systems to be usable by the hearing impaired community, the algorithms within the CODEC have to be designed to account for the perceptual boundaries of the hearing impaired. We investigate the perceptual boundaries of speech reading and multimedia technology, which are the constraints that effect speech reading performance. We analyze and draw conclusions on the relationship between viseme groupings, accuracy of viseme recognition, and presentation rate. These results are critical in the design of multimedia systems for the hearing impaired.
@inproceedings{Jay1998,
abstract = {In the future, multimedia technology will be able to provide video frame rates equal to or better than 30 frames-per-second (FPS). Until that time the hearing impaired community will be using band limited communication systems over un-shielded twisted pair copper wiring. As a result, multimedia communication systems will use a coder/decoder (CODEC) to compress the video and audio signals for transmission. For these systems to be usable by the hearing impaired community, the algorithms within the CODEC have to be designed to account for the perceptual boundaries of the hearing impaired. We investigate the perceptual boundaries of speech reading and multimedia technology, which are the constraints that effect speech reading performance. We analyze and draw conclusions on the relationship between viseme groupings, accuracy of viseme recognition, and presentation rate. These results are critical in the design of multimedia systems for the hearing impaired.},
author = {Williams, J.J. and Rutledge, J.C. and Garstecki, D.C. and Katsaggelos, A.K. and Jay, J Williams and Janet, C Rutledge and Dean, C Garstecki and Aggelos, K Katsaggelos},
booktitle = {Proceedings of First Signal Processing Society Workshop on Multimedia Signal Processing},
doi = {10.1109/MMSP.1997.602606},
isbn = {0-7803-3780-8},
pages = {13--18},
publisher = {IEEE},
title = {{Frame rate and viseme analysis for multimedia applications}},
url = {http://ieeexplore.ieee.org/document/602606/},
volume = {20},
year = {1997}
}

Downloads: 0