Simulating spatial auditory attention in a gaze contingent display: The virtual cocktail party. Allison, R. S. & Vinnikov, M. In European Conference on Visual Perception, ECVP 2015, volume 44(S1), pages 81. Perception, 2015. -1 doi abstract bibtex The ability to make sense of cluttered auditory environments is convincingly demonstrated in the so-called cocktail party effect. This ability of a listener to separate a speech signal of interest from competing speech signals and background noise is greatly improved when they have normal binaural cues to the spatial location of the speaker. However, in most media applications, including virtual reality and telepresence, the audio information is impoverished. We hypothesized that a listener's spatial auditory attention could be simulated based on visual attention. Since interlocutors typically look at their conversational partner, we used gaze as an indicator of current conversational interest. We built a gaze-contingent display that modified the volume of the speakers' voices contingent on the current region of overt attention. We found that a rapid increase in amplification of the attended speaker combined with attenuation but not elimination of competing sounds (partial rather than absolute selection) was most natural and improved source recognition. In conclusion, audio gaze-contingent displays offer potential for simulating rich, natural social and other interactions in virtual environments.
@incollection{Allison:fk2,
abstract = {The ability to make sense of cluttered auditory environments is convincingly demonstrated in the so-called cocktail party effect. This ability of a listener to separate a speech signal of interest from competing speech signals and background noise is greatly improved when they have normal binaural cues to the spatial location of the speaker. However, in most media applications, including virtual reality and telepresence, the audio information is impoverished. We hypothesized that a listener's spatial auditory attention could be simulated based on visual attention. Since interlocutors typically look at their conversational partner, we used gaze as an indicator of current conversational interest. We built a gaze-contingent display that modified the volume of the speakers' voices contingent on the current region of overt attention. We found that a rapid increase in amplification of the attended speaker combined with attenuation but not elimination of competing sounds (partial rather than absolute selection) was most natural and improved source recognition. In conclusion, audio gaze-contingent displays offer potential for simulating rich, natural social and other interactions in virtual environments.},
annote = {The European Conference on Visual Perception (ECVP) will take place between August 23rd and August 27th on the campus of the University of Liverpool.},
author = {Allison, R. S. and Vinnikov, M.},
booktitle = {European Conference on Visual Perception, {ECVP} 2015},
date-added = {2015-06-14 15:20:51 +0000},
date-modified = {2015-11-17 12:52:56 +0000},
doi = {10.1177/0301006615598674},
keywords = {Eye Movements & Tracking},
pages = {81},
publisher = {Perception},
title = {Simulating spatial auditory attention in a gaze contingent display: The virtual cocktail party},
url-1 = {http://dx.doi.org/10.1177/0301006615598674},
volume = {44(S1)},
year = {2015},
url-1 = {https://doi.org/10.1177/0301006615598674}}
Downloads: 0
{"_id":"Lip5qtfdBRqtg4sRg","bibbaseid":"allison-vinnikov-simulatingspatialauditoryattentioninagazecontingentdisplaythevirtualcocktailparty-2015","downloads":0,"creationDate":"2015-10-18T13:12:54.448Z","title":"Simulating spatial auditory attention in a gaze contingent display: The virtual cocktail party","author_short":["Allison, R. S.","Vinnikov, M."],"year":2015,"bibtype":"incollection","biburl":"https://bibbase.org/network/files/ibWG96BS4w7ibooE9","bibdata":{"bibtype":"incollection","type":"incollection","abstract":"The ability to make sense of cluttered auditory environments is convincingly demonstrated in the so-called cocktail party effect. This ability of a listener to separate a speech signal of interest from competing speech signals and background noise is greatly improved when they have normal binaural cues to the spatial location of the speaker. However, in most media applications, including virtual reality and telepresence, the audio information is impoverished. We hypothesized that a listener's spatial auditory attention could be simulated based on visual attention. Since interlocutors typically look at their conversational partner, we used gaze as an indicator of current conversational interest. We built a gaze-contingent display that modified the volume of the speakers' voices contingent on the current region of overt attention. We found that a rapid increase in amplification of the attended speaker combined with attenuation but not elimination of competing sounds (partial rather than absolute selection) was most natural and improved source recognition. In conclusion, audio gaze-contingent displays offer potential for simulating rich, natural social and other interactions in virtual environments.","annote":"The European Conference on Visual Perception (ECVP) will take place between August 23rd and August 27th on the campus of the University of Liverpool.","author":[{"propositions":[],"lastnames":["Allison"],"firstnames":["R.","S."],"suffixes":[]},{"propositions":[],"lastnames":["Vinnikov"],"firstnames":["M."],"suffixes":[]}],"booktitle":"European Conference on Visual Perception, ECVP 2015","date-added":"2015-06-14 15:20:51 +0000","date-modified":"2015-11-17 12:52:56 +0000","doi":"10.1177/0301006615598674","keywords":"Eye Movements & Tracking","pages":"81","publisher":"Perception","title":"Simulating spatial auditory attention in a gaze contingent display: The virtual cocktail party","url-1":"https://doi.org/10.1177/0301006615598674","volume":"44(S1)","year":"2015","bibtex":"@incollection{Allison:fk2,\n\tabstract = {The ability to make sense of cluttered auditory environments is convincingly demonstrated in the so-called cocktail party effect. This ability of a listener to separate a speech signal of interest from competing speech signals and background noise is greatly improved when they have normal binaural cues to the spatial location of the speaker. However, in most media applications, including virtual reality and telepresence, the audio information is impoverished. We hypothesized that a listener's spatial auditory attention could be simulated based on visual attention. Since interlocutors typically look at their conversational partner, we used gaze as an indicator of current conversational interest. We built a gaze-contingent display that modified the volume of the speakers' voices contingent on the current region of overt attention. We found that a rapid increase in amplification of the attended speaker combined with attenuation but not elimination of competing sounds (partial rather than absolute selection) was most natural and improved source recognition. In conclusion, audio gaze-contingent displays offer potential for simulating rich, natural social and other interactions in virtual environments.},\n\tannote = {The European Conference on Visual Perception (ECVP) will take place between August 23rd and August 27th on the campus of the University of Liverpool.},\n\tauthor = {Allison, R. S. and Vinnikov, M.},\n\tbooktitle = {European Conference on Visual Perception, {ECVP} 2015},\n\tdate-added = {2015-06-14 15:20:51 +0000},\n\tdate-modified = {2015-11-17 12:52:56 +0000},\n\tdoi = {10.1177/0301006615598674},\n\tkeywords = {Eye Movements & Tracking},\n\tpages = {81},\n\tpublisher = {Perception},\n\ttitle = {Simulating spatial auditory attention in a gaze contingent display: The virtual cocktail party},\n\turl-1 = {http://dx.doi.org/10.1177/0301006615598674},\n\tvolume = {44(S1)},\n\tyear = {2015},\n\turl-1 = {https://doi.org/10.1177/0301006615598674}}\n\n\n\n","author_short":["Allison, R. S.","Vinnikov, M."],"key":"Allison:fk2","id":"Allison:fk2","bibbaseid":"allison-vinnikov-simulatingspatialauditoryattentioninagazecontingentdisplaythevirtualcocktailparty-2015","role":"author","urls":{"-1":"https://doi.org/10.1177/0301006615598674"},"keyword":["Eye Movements & Tracking"],"metadata":{"authorlinks":{"allison, r":"https://percept.eecs.yorku.ca/bibase%20pubs.shtml"}},"downloads":0},"search_terms":["simulating","spatial","auditory","attention","gaze","contingent","display","virtual","cocktail","party","allison","vinnikov"],"keywords":["eye movements & tracking"],"authorIDs":["vnY8GQ5AKXHNi7dqd"],"dataSources":["kmmXSosvtyJQxBtzs","BPKPSXjrbMGteC59J","MpMK4SvZzj5Fww5vJ","YbBWRH5Fc7xRr8ghk","szZaibkmSiiQBFQG8","DoyrDTpJ7HHCtki3q","JaoxzeTFRfvwgLoCW","XKwRm5Lx8Z9bzSzaP","AELuRZBpnp7nRDaqw"]}