Characterizing Surprise in Humans and Monkeys. Berg, D. J., Boehnke, S. E., Marino, R. A., Baldi, P. F., Munoz, D. P., & Itti, L. In Proc. Vision Science Society Annual Meeting (VSS06), May, 2006. abstract bibtex We investigate the role of visual surprise in guiding eye movements in humans and rhesus monkeys under free viewing conditions, for a variety of natural stimuli. Surprise differs from other models of bottom-up visual attention in that it quantifies how data affects an observer, by measuring the difference between posterior and prior beliefs of the observer. We recorded eye movements from naive observers, 4 humans and 3 monkeys, while they watched 115 video clips (47,903 frames, 27 minutes) resulting in 6,775 saccades for humans and 10,406 for monkeys. Clips ranged in semantic content, including video of natural, non-natural, building-city, indoor, and sporting-outdoor scenes both with and without main actors. A surprise model of bottom-up visual attention then predicted in real-time how surprising every location was in the display. The distribution of surprise at the endpoint (target) locations of human or monkey saccadic eye movements was then compared to the distribution of surprise at random locations using a standard information theoretic technique, Kullback-Leibler distance. Considering all clips together 59 percent and 56 percent of gaze shifts were directed towards locations more surprising than average for humans and monkeys, however, agreement with the model varied greatly across clip type (ranging from 35-77 percent). Humans and monkeys showed a similar pattern of agreement with the model across image type, with a significant difference only in sporting-outdoor clips. This data suggests that under free viewing humans and monkeys are employing similar bottom-up attentional mechanisms.
@inproceedings{ Berg_etal06vss,
author = {D. J. Berg and S. E. Boehnke and R. A. Marino and P. F. Baldi and D. P. Munoz
and L. Itti},
title = {Characterizing Surprise in Humans and Monkeys},
abstract = {We investigate the role of visual surprise in guiding eye
movements in humans and rhesus monkeys under free viewing conditions,
for a variety of natural stimuli. Surprise differs from other models
of bottom-up visual attention in that it quantifies how data affects
an observer, by measuring the difference between posterior and prior
beliefs of the observer. We recorded eye movements from naive
observers, 4 humans and 3 monkeys, while they watched 115 video clips
(47,903 frames, 27 minutes) resulting in 6,775 saccades for humans and
10,406 for monkeys. Clips ranged in semantic content, including video
of natural, non-natural, building-city, indoor, and sporting-outdoor
scenes both with and without main actors. A surprise model of
bottom-up visual attention then predicted in real-time how surprising
every location was in the display. The distribution of surprise at the
endpoint (target) locations of human or monkey saccadic eye movements
was then compared to the distribution of surprise at random locations
using a standard information theoretic technique, Kullback-Leibler
distance. Considering all clips together 59 percent and 56 percent of
gaze shifts were directed towards locations more surprising than
average for humans and monkeys, however, agreement with the model
varied greatly across clip type (ranging from 35-77 percent). Humans
and monkeys showed a similar pattern of agreement with the model
across image type, with a significant difference only in
sporting-outdoor clips. This data suggests that under free viewing
humans and monkeys are employing similar bottom-up attentional
mechanisms.},
booktitle = {Proc. Vision Science Society Annual Meeting (VSS06)},
year = {2006},
month = {May},
type = {mod;su;eye},
review = {abs/conf}
}
Downloads: 0
{"_id":{"_str":"5298a19f9eb585cc260007e7"},"__v":0,"authorIDs":[],"author_short":["Berg, D.<nbsp>J.","Boehnke, S.<nbsp>E.","Marino, R.<nbsp>A.","Baldi, P.<nbsp>F.","Munoz, D.<nbsp>P.","Itti, L."],"bibbaseid":"berg-boehnke-marino-baldi-munoz-itti-characterizingsurpriseinhumansandmonkeys-2006","bibdata":{"html":"<div class=\"bibbase_paper\"> \n\n\n<span class=\"bibbase_paper_titleauthoryear\">\n\t<span class=\"bibbase_paper_title\"><a name=\"Berg_etal06vss\"> </a>Characterizing Surprise in Humans and Monkeys.</span>\n\t<span class=\"bibbase_paper_author\">\nBerg, D. J.; Boehnke, S. E.; Marino, R. A.; Baldi, P. F.; Munoz, D. P.; and Itti, L.</span>\n\t<!-- <span class=\"bibbase_paper_year\">2006</span>. -->\n</span>\n\n\n\nIn\n<i>Proc. Vision Science Society Annual Meeting (VSS06)</i>, May 2006.\n\n\n\n\n\n<br class=\"bibbase_paper_content\"/>\n\n<span class=\"bibbase_paper_content\">\n \n \n \n <a href=\"javascript:showBib('Berg_etal06vss')\"\n class=\"bibbase link\">\n <!-- <img src=\"http://www.bibbase.org/img/filetypes/bib.png\" -->\n\t<!-- alt=\"Characterizing Surprise in Humans and Monkeys [bib]\" -->\n\t<!-- class=\"bibbase_icon\" -->\n\t<!-- style=\"width: 24px; height: 24px; border: 0px; vertical-align: text-top\"><span class=\"bibbase_icon_text\">Bibtex</span> -->\n BibTeX\n <i class=\"fa fa-caret-down\"></i></a>\n \n \n \n <a class=\"bibbase_abstract_link bibbase link\"\n href=\"javascript:showAbstract('Berg_etal06vss')\">\n Abstract\n <i class=\"fa fa-caret-down\"></i></a>\n \n \n \n\n \n \n \n</span>\n\n<div class=\"well well-small bibbase\" id=\"bib_Berg_etal06vss\"\n style=\"display:none\">\n <pre>@inproceedings{ Berg_etal06vss,\n author = {D. J. Berg and S. E. Boehnke and R. A. Marino and P. F. Baldi and D. P. Munoz\nand L. Itti},\n title = {Characterizing Surprise in Humans and Monkeys},\n abstract = {We investigate the role of visual surprise in guiding eye\nmovements in humans and rhesus monkeys under free viewing conditions,\nfor a variety of natural stimuli. Surprise differs from other models\nof bottom-up visual attention in that it quantifies how data affects\nan observer, by measuring the difference between posterior and prior\nbeliefs of the observer. We recorded eye movements from naive\nobservers, 4 humans and 3 monkeys, while they watched 115 video clips\n(47,903 frames, 27 minutes) resulting in 6,775 saccades for humans and\n10,406 for monkeys. Clips ranged in semantic content, including video\nof natural, non-natural, building-city, indoor, and sporting-outdoor\nscenes both with and without main actors. A surprise model of\nbottom-up visual attention then predicted in real-time how surprising\nevery location was in the display. The distribution of surprise at the\nendpoint (target) locations of human or monkey saccadic eye movements\nwas then compared to the distribution of surprise at random locations\nusing a standard information theoretic technique, Kullback-Leibler\ndistance. Considering all clips together 59 percent and 56 percent of\ngaze shifts were directed towards locations more surprising than\naverage for humans and monkeys, however, agreement with the model\nvaried greatly across clip type (ranging from 35-77 percent). Humans\nand monkeys showed a similar pattern of agreement with the model\nacross image type, with a significant difference only in\nsporting-outdoor clips. This data suggests that under free viewing\nhumans and monkeys are employing similar bottom-up attentional\nmechanisms.},\n booktitle = {Proc. Vision Science Society Annual Meeting (VSS06)},\n year = {2006},\n month = {May},\n type = {mod;su;eye},\n review = {abs/conf}\n}</pre>\n</div>\n\n\n<div class=\"well well-small bibbase\" id=\"abstract_Berg_etal06vss\"\n style=\"display:none\">\n We investigate the role of visual surprise in guiding eye movements in humans and rhesus monkeys under free viewing conditions, for a variety of natural stimuli. Surprise differs from other models of bottom-up visual attention in that it quantifies how data affects an observer, by measuring the difference between posterior and prior beliefs of the observer. We recorded eye movements from naive observers, 4 humans and 3 monkeys, while they watched 115 video clips (47,903 frames, 27 minutes) resulting in 6,775 saccades for humans and 10,406 for monkeys. Clips ranged in semantic content, including video of natural, non-natural, building-city, indoor, and sporting-outdoor scenes both with and without main actors. A surprise model of bottom-up visual attention then predicted in real-time how surprising every location was in the display. The distribution of surprise at the endpoint (target) locations of human or monkey saccadic eye movements was then compared to the distribution of surprise at random locations using a standard information theoretic technique, Kullback-Leibler distance. Considering all clips together 59 percent and 56 percent of gaze shifts were directed towards locations more surprising than average for humans and monkeys, however, agreement with the model varied greatly across clip type (ranging from 35-77 percent). Humans and monkeys showed a similar pattern of agreement with the model across image type, with a significant difference only in sporting-outdoor clips. This data suggests that under free viewing humans and monkeys are employing similar bottom-up attentional mechanisms.\n</div>\n\n\n</div>\n","downloads":0,"bibbaseid":"berg-boehnke-marino-baldi-munoz-itti-characterizingsurpriseinhumansandmonkeys-2006","role":"author","year":"2006","type":"mod;su;eye","title":"Characterizing Surprise in Humans and Monkeys","review":"abs/conf","month":"May","key":"Berg_etal06vss","id":"Berg_etal06vss","booktitle":"Proc. Vision Science Society Annual Meeting (VSS06)","bibtype":"inproceedings","bibtex":"@inproceedings{ Berg_etal06vss,\n author = {D. J. Berg and S. E. Boehnke and R. A. Marino and P. F. Baldi and D. P. Munoz\nand L. Itti},\n title = {Characterizing Surprise in Humans and Monkeys},\n abstract = {We investigate the role of visual surprise in guiding eye\nmovements in humans and rhesus monkeys under free viewing conditions,\nfor a variety of natural stimuli. Surprise differs from other models\nof bottom-up visual attention in that it quantifies how data affects\nan observer, by measuring the difference between posterior and prior\nbeliefs of the observer. We recorded eye movements from naive\nobservers, 4 humans and 3 monkeys, while they watched 115 video clips\n(47,903 frames, 27 minutes) resulting in 6,775 saccades for humans and\n10,406 for monkeys. Clips ranged in semantic content, including video\nof natural, non-natural, building-city, indoor, and sporting-outdoor\nscenes both with and without main actors. A surprise model of\nbottom-up visual attention then predicted in real-time how surprising\nevery location was in the display. The distribution of surprise at the\nendpoint (target) locations of human or monkey saccadic eye movements\nwas then compared to the distribution of surprise at random locations\nusing a standard information theoretic technique, Kullback-Leibler\ndistance. Considering all clips together 59 percent and 56 percent of\ngaze shifts were directed towards locations more surprising than\naverage for humans and monkeys, however, agreement with the model\nvaried greatly across clip type (ranging from 35-77 percent). Humans\nand monkeys showed a similar pattern of agreement with the model\nacross image type, with a significant difference only in\nsporting-outdoor clips. This data suggests that under free viewing\nhumans and monkeys are employing similar bottom-up attentional\nmechanisms.},\n booktitle = {Proc. Vision Science Society Annual Meeting (VSS06)},\n year = {2006},\n month = {May},\n type = {mod;su;eye},\n review = {abs/conf}\n}","author_short":["Berg, D.<nbsp>J.","Boehnke, S.<nbsp>E.","Marino, R.<nbsp>A.","Baldi, P.<nbsp>F.","Munoz, D.<nbsp>P.","Itti, L."],"author":["Berg, D. J.","Boehnke, S. E.","Marino, R. A.","Baldi, P. F.","Munoz, D. P.","Itti, L."],"abstract":"We investigate the role of visual surprise in guiding eye movements in humans and rhesus monkeys under free viewing conditions, for a variety of natural stimuli. Surprise differs from other models of bottom-up visual attention in that it quantifies how data affects an observer, by measuring the difference between posterior and prior beliefs of the observer. We recorded eye movements from naive observers, 4 humans and 3 monkeys, while they watched 115 video clips (47,903 frames, 27 minutes) resulting in 6,775 saccades for humans and 10,406 for monkeys. Clips ranged in semantic content, including video of natural, non-natural, building-city, indoor, and sporting-outdoor scenes both with and without main actors. A surprise model of bottom-up visual attention then predicted in real-time how surprising every location was in the display. The distribution of surprise at the endpoint (target) locations of human or monkey saccadic eye movements was then compared to the distribution of surprise at random locations using a standard information theoretic technique, Kullback-Leibler distance. Considering all clips together 59 percent and 56 percent of gaze shifts were directed towards locations more surprising than average for humans and monkeys, however, agreement with the model varied greatly across clip type (ranging from 35-77 percent). Humans and monkeys showed a similar pattern of agreement with the model across image type, with a significant difference only in sporting-outdoor clips. This data suggests that under free viewing humans and monkeys are employing similar bottom-up attentional mechanisms."},"bibtype":"inproceedings","biburl":"http://ilab.usc.edu/publications/src/ilab.bib","downloads":0,"search_terms":["characterizing","surprise","humans","monkeys","berg","boehnke","marino","baldi","munoz","itti"],"title":"Characterizing Surprise in Humans and Monkeys","year":2006,"dataSources":["wedBDxEpNXNCLZ2sZ"]}