The role of intonation and facial gestures in conveying interrogativity. Borràs, J. M. Ph.D. Thesis, Departament de Traducció i Ciències del Llenguatge, Universitat Pompeu Fabra.
The role of intonation and facial gestures in conveying interrogativity [link]Paper  abstract   bibtex   
This thesis investigates the role that different aspects of audiovisual prosody play in the production and perception of interrogativity. To this end, two types of statements and two types of questions are analyzed: information and contrastive focus statements (IFS, CFS), and information-seeking and counterexpectational questions (ISQ, CEQ). A multimodal approach is thus followed for the study of interrogativity, by means of a variety of production and perception experiments, from games specifically designed to elicit spontaneous productions of specific discourse categories to the analysis of event-related potentials. The first study reveals that pitch range differences are the main intonational cue used by Central Catalan speakers in order to distinguish between IFS and CEQ. The second study shows that such intonational contrasts are encoded automatically in the auditory cortex. Both studies strengthen the argument that pitch range features need to be represented descriptively at the phonological level. The third study shows that facial gestures are the most influential elements that Catalan listeners rely on to decide between CFS and CEQ interpretations, though bimodal integration with acoustic cues is necessary in order for perceptual processing to be accurate and fast. The fourth study reveals that Catalan and Dutch speakers mainly rely on language-specific auditory differences in order to detect IFS and ISQ, but also that the presence of gaze increases the identification of an utterance as a question. Finally, this study demonstrates that a concentration of several response-mobilizing cues in a sentence is positively correlated with the perceivers' ratings of these utterances as interrogatives.
@phdthesis{borras_role_2012,
	Author = {Borràs, Joan Manel},
	Date = {2012},
	Date-Modified = {2016-09-22 20:24:11 +0000},
	Keywords = {Catalan, intonation, multimodality, phonetics, prosody},
	School = {Departament de Traducció i Ciències del Llenguatge, Universitat Pompeu Fabra},
	Title = {The role of intonation and facial gestures in conveying interrogativity},
	Url = {http://hdl.handle.net/10803/97294},
	Abstract = {This thesis investigates the role that different aspects of audiovisual prosody play in the production and perception of interrogativity. To this end, two types of statements and two types of questions are analyzed: information and contrastive focus statements (IFS, CFS), and information-seeking and counterexpectational questions (ISQ, CEQ). A multimodal approach is thus followed for the study of interrogativity, by means of a variety of production and perception experiments, from games specifically designed to elicit spontaneous productions of specific discourse categories to the analysis of event-related potentials. The first study reveals that pitch range differences are the main intonational cue used by Central Catalan speakers in order to distinguish between IFS and CEQ. The second study shows that such intonational contrasts are encoded automatically in the auditory cortex. Both studies strengthen the argument that pitch range features need to be represented descriptively at the phonological level. The third study shows that facial gestures are the most influential elements that Catalan listeners rely on to decide between CFS and CEQ interpretations, though bimodal integration with acoustic cues is necessary in order for perceptual processing to be accurate and fast. The fourth study reveals that Catalan and Dutch speakers mainly rely on language-specific auditory differences in order to detect IFS and ISQ, but also that the presence of gaze increases the identification of an utterance as a question. Finally, this study demonstrates that a concentration of several response-mobilizing cues in a sentence is positively correlated with the perceivers' ratings of these utterances as interrogatives.},
	Bdsk-Url-1 = {http://hdl.handle.net/10803/97294}}
Downloads: 0