Psychophysical Detection Testing with Bayesian Active Learning. Gardner, J. R., Song, X., Weinberger, K. Q., Barbour, D. L., & Cunningham, J. P. In Proceedings of the Thirty-First Conference on Uncertainty in Artificial Intelligence, of UAI'15, pages 286–297, Amsterdam, Netherlands, July, 2015. AUAI Press.
Psychophysical Detection Testing with Bayesian Active Learning [link]Paper  abstract   bibtex   
Psychophysical detection tests are ubiquitous in the study of human sensation and the diagnosis and treatment of virtually all sensory impairments. In many of these settings, the goal is to recover, from a series of binary observations from a human subject, the latent function that describes the discriminability of a sensory stimulus over some relevant domain. The auditory detection test, for example, seeks to understand a subject's likelihood of hearing sounds as a function of frequency and amplitude. Conventional methods for performing these tests involve testing stimuli on a pre-determined grid. This approach not only samples at very uninformative locations, but also fails to learn critical features of a subject's latent discriminability function. Here we advance active learning with Gaussian processes to the setting of psychophysical testing. We develop a model that incorporates strong prior knowledge about the class of stimuli, we derive a sensible method for choosing sample points, and we demonstrate how to evaluate this model efficiently. Finally, we develop a novel likelihood that enables testing of multiple stimuli simultaneously. We evaluate our method in both simulated and real auditory detection tests, demonstrating the merit of our approach.
@inproceedings{gardner_psychophysical_2015,
	address = {Amsterdam, Netherlands},
	series = {{UAI}'15},
	title = {Psychophysical {Detection} {Testing} with {Bayesian} {Active} {Learning}},
	isbn = {978-0-9966431-0-8},
	url = {https://dl.acm.org/doi/abs/10.5555/3020847.3020878},
	abstract = {Psychophysical detection tests are ubiquitous in the study of human sensation and the diagnosis and treatment of virtually all sensory impairments. In many of these settings, the goal is to recover, from a series of binary observations from a human subject, the latent function that describes the discriminability of a sensory stimulus over some relevant domain. The auditory detection test, for example, seeks to understand a subject's likelihood of hearing sounds as a function of frequency and amplitude. Conventional methods for performing these tests involve testing stimuli on a pre-determined grid. This approach not only samples at very uninformative locations, but also fails to learn critical features of a subject's latent discriminability function. Here we advance active learning with Gaussian processes to the setting of psychophysical testing. We develop a model that incorporates strong prior knowledge about the class of stimuli, we derive a sensible method for choosing sample points, and we demonstrate how to evaluate this model efficiently. Finally, we develop a novel likelihood that enables testing of multiple stimuli simultaneously. We evaluate our method in both simulated and real auditory detection tests, demonstrating the merit of our approach.},
	urldate = {2020-11-10},
	booktitle = {Proceedings of the {Thirty}-{First} {Conference} on {Uncertainty} in {Artificial} {Intelligence}},
	publisher = {AUAI Press},
	author = {Gardner, Jacob R. and Song, Xinyu and Weinberger, Kilian Q. and {Barbour, D. L.} and Cunningham, John P.},
	month = jul,
	year = {2015},
	pages = {286--297},
}

Downloads: 0