Using correlation maps to analyze spoken communication: measuring the coupling between motion and acoustics during speech. Barbosa, A. V. September, 2015. ![Using correlation maps to analyze spoken communication: measuring the coupling between motion and acoustics during speech [link]](https://bibbase.org/img/filetypes/link.svg "link")
Paper abstract bibtex This mini-course presents a methodology for assessing the coupling between different modalities of speech (acoustic, visual) during spoken communication.The techniques presented can be equally applied to both intra- and inter-speaker scenarios. The course focuses on two main points: i) the use of the Flow Analyzer software to measure motion from video and ii)the use of CMA (Correlation Map Analysis) as a means of assessing the time-varying coupling between two domains of interest. We first show how to use Flow Analyzer to extract motion signals from pre-recorded video sequences. We demonstrate the utility of the tool by showing how it allows the experimenter to rely only on ordinary video cameras to measure motion in a completely non-invasive way during speech production experiments. We then show how to use the CMA technique to quantify the time-varying coupling between the visual and acoustic components of speech. In our demonstration, the visual domain will be represented by the motion signals produced by Flow Analyzer, whereas the acoustic domain will be represented by some parameterization of the acoustic waveform, such as the root mean square (RMS) value or Line Spectrum Pair (LSP) coefficients. We finish by discussing possible directions for future development of the tools and techniques presented.
@misc{barbosa_using_2015,
address = {Belo Horizonte, Brazil},
type = {Invited mini-course},
title = {Using correlation maps to analyze spoken communication: measuring the coupling between motion and acoustics during speech},
url = {http://www.letras.ufmg.br/eicefala/},
abstract = {This mini-course presents a methodology for assessing the coupling between different modalities of speech (acoustic, visual) during spoken communication.The techniques presented can be equally applied to both intra- and inter-speaker scenarios. The course focuses on two main points: i) the use of the Flow Analyzer software to measure motion from video and ii)the use of CMA (Correlation Map Analysis) as a means of assessing the time-varying coupling between two domains of interest. We first show how to use Flow Analyzer to extract motion signals from pre-recorded video sequences. We demonstrate the utility of the tool by showing how it allows the experimenter to rely only on ordinary video cameras to measure motion in a completely non-invasive way during speech production experiments. We then show how to use the CMA technique to quantify the time-varying coupling between the visual and acoustic components of speech. In our demonstration, the visual domain will be represented by the motion signals produced by Flow Analyzer, whereas the acoustic domain will be represented by some parameterization of the acoustic waveform, such as the root mean square (RMS) value or Line Spectrum Pair (LSP) coefficients. We finish by discussing possible directions for future development of the tools and techniques presented.},
author = {Barbosa, Adriano Vilela},
month = sep,
year = {2015}
}
Downloads: 0
{"_id":"Tx6ZcrRduSExcKvFs","bibbaseid":"barbosa-usingcorrelationmapstoanalyzespokencommunicationmeasuringthecouplingbetweenmotionandacousticsduringspeech-2015","downloads":0,"creationDate":"2017-09-05T12:47:05.608Z","title":"Using correlation maps to analyze spoken communication: measuring the coupling between motion and acoustics during speech","author_short":["Barbosa, A. V."],"year":2015,"bibtype":"misc","biburl":"https://www.cefala.org/~adriano/pubs/pubs_since_2000.bib","bibdata":{"bibtype":"misc","type":"Invited mini-course","address":"Belo Horizonte, Brazil","title":"Using correlation maps to analyze spoken communication: measuring the coupling between motion and acoustics during speech","url":"http://www.letras.ufmg.br/eicefala/","abstract":"This mini-course presents a methodology for assessing the coupling between different modalities of speech (acoustic, visual) during spoken communication.The techniques presented can be equally applied to both intra- and inter-speaker scenarios. The course focuses on two main points: i) the use of the Flow Analyzer software to measure motion from video and ii)the use of CMA (Correlation Map Analysis) as a means of assessing the time-varying coupling between two domains of interest. We first show how to use Flow Analyzer to extract motion signals from pre-recorded video sequences. We demonstrate the utility of the tool by showing how it allows the experimenter to rely only on ordinary video cameras to measure motion in a completely non-invasive way during speech production experiments. We then show how to use the CMA technique to quantify the time-varying coupling between the visual and acoustic components of speech. In our demonstration, the visual domain will be represented by the motion signals produced by Flow Analyzer, whereas the acoustic domain will be represented by some parameterization of the acoustic waveform, such as the root mean square (RMS) value or Line Spectrum Pair (LSP) coefficients. We finish by discussing possible directions for future development of the tools and techniques presented.","author":[{"propositions":[],"lastnames":["Barbosa"],"firstnames":["Adriano","Vilela"],"suffixes":[]}],"month":"September","year":"2015","bibtex":"@misc{barbosa_using_2015,\n\taddress = {Belo Horizonte, Brazil},\n\ttype = {Invited mini-course},\n\ttitle = {Using correlation maps to analyze spoken communication: measuring the coupling between motion and acoustics during speech},\n\turl = {http://www.letras.ufmg.br/eicefala/},\n\tabstract = {This mini-course presents a methodology for assessing the coupling between different modalities of speech (acoustic, visual) during spoken communication.The techniques presented can be equally applied to both intra- and inter-speaker scenarios. The course focuses on two main points: i) the use of the Flow Analyzer software to measure motion from video and ii)the use of CMA (Correlation Map Analysis) as a means of assessing the time-varying coupling between two domains of interest. We first show how to use Flow Analyzer to extract motion signals from pre-recorded video sequences. We demonstrate the utility of the tool by showing how it allows the experimenter to rely only on ordinary video cameras to measure motion in a completely non-invasive way during speech production experiments. We then show how to use the CMA technique to quantify the time-varying coupling between the visual and acoustic components of speech. In our demonstration, the visual domain will be represented by the motion signals produced by Flow Analyzer, whereas the acoustic domain will be represented by some parameterization of the acoustic waveform, such as the root mean square (RMS) value or Line Spectrum Pair (LSP) coefficients. We finish by discussing possible directions for future development of the tools and techniques presented.},\n\tauthor = {Barbosa, Adriano Vilela},\n\tmonth = sep,\n\tyear = {2015}\n}\n\n","author_short":["Barbosa, A. V."],"key":"barbosa_using_2015","id":"barbosa_using_2015","bibbaseid":"barbosa-usingcorrelationmapstoanalyzespokencommunicationmeasuringthecouplingbetweenmotionandacousticsduringspeech-2015","role":"author","urls":{"Paper":"http://www.letras.ufmg.br/eicefala/"},"metadata":{"authorlinks":{"barbosa, a":"https://www.cefala.org/~adriano/pubs/"}},"downloads":0,"html":""},"search_terms":["using","correlation","maps","analyze","spoken","communication","measuring","coupling","between","motion","acoustics","during","speech","barbosa"],"keywords":[],"authorIDs":["59ae9cc92c2955810d00006c","o7zQCspdt9hdrtRcF"],"dataSources":["DPcvEZCWhouXko6QA"]}