Context, learning, and extinction. Gershman, S. J., Blei, D. M., & Niv, Y. Psychological Review, 117(1):197–209, 2010. doi abstract bibtex A. Redish et al. (2007) proposed a reinforcement learning model of context-dependent learning and extinction in conditioning experiments, using the idea of “state classification” to categorize new observations into states. In the current article, the authors propose an interpretation of this idea in terms of normative statistical inference. They focus on renewal and latent inhibition, 2 conditioning paradigms in which contextual manipulations have been studied extensively, and show that online Bayesian inference within a model that assumes an unbounded number of latent causes can characterize a diverse set of behavioral results from such manipulations, some of which pose problems for the model of Redish et al. Moreover, in both paradigms, context dependence is absent in younger animals, or if hippocampal lesions are made prior to training. The authors suggest an explanation in terms of a restricted capacity to infer new causes. (PsycINFO Database Record (c) 2016 APA, all rights reserved)
@article{gershman_context_2010,
title = {Context, learning, and extinction},
volume = {117},
issn = {1939-1471(Electronic),0033-295X(Print)},
doi = {10.1037/a0017808},
abstract = {A. Redish et al. (2007) proposed a reinforcement learning model of context-dependent learning and extinction in conditioning experiments, using the idea of “state classification” to categorize new observations into states. In the current article, the authors propose an interpretation of this idea in terms of normative statistical inference. They focus on renewal and latent inhibition, 2 conditioning paradigms in which contextual manipulations have been studied extensively, and show that online Bayesian inference within a model that assumes an unbounded number of latent causes can characterize a diverse set of behavioral results from such manipulations, some of which pose problems for the model of Redish et al. Moreover, in both paradigms, context dependence is absent in younger animals, or if hippocampal lesions are made prior to training. The authors suggest an explanation in terms of a restricted capacity to infer new causes. (PsycINFO Database Record (c) 2016 APA, all rights reserved)},
number = {1},
journal = {Psychological Review},
author = {Gershman, Samuel J. and Blei, David M. and Niv, Yael},
year = {2010},
keywords = {Classical Conditioning, Contextual Associations, Extinction (Learning), Hippocampus, Latent Inhibition, Learning, Models, Reinforcement},
pages = {197--209},
}
Downloads: 0
{"_id":"v3Mr8sgXgx3pGyZdY","bibbaseid":"gershman-blei-niv-contextlearningandextinction-2010","author_short":["Gershman, S. J.","Blei, D. M.","Niv, Y."],"bibdata":{"bibtype":"article","type":"article","title":"Context, learning, and extinction","volume":"117","issn":"1939-1471(Electronic),0033-295X(Print)","doi":"10.1037/a0017808","abstract":"A. Redish et al. (2007) proposed a reinforcement learning model of context-dependent learning and extinction in conditioning experiments, using the idea of “state classification” to categorize new observations into states. In the current article, the authors propose an interpretation of this idea in terms of normative statistical inference. They focus on renewal and latent inhibition, 2 conditioning paradigms in which contextual manipulations have been studied extensively, and show that online Bayesian inference within a model that assumes an unbounded number of latent causes can characterize a diverse set of behavioral results from such manipulations, some of which pose problems for the model of Redish et al. Moreover, in both paradigms, context dependence is absent in younger animals, or if hippocampal lesions are made prior to training. The authors suggest an explanation in terms of a restricted capacity to infer new causes. (PsycINFO Database Record (c) 2016 APA, all rights reserved)","number":"1","journal":"Psychological Review","author":[{"propositions":[],"lastnames":["Gershman"],"firstnames":["Samuel","J."],"suffixes":[]},{"propositions":[],"lastnames":["Blei"],"firstnames":["David","M."],"suffixes":[]},{"propositions":[],"lastnames":["Niv"],"firstnames":["Yael"],"suffixes":[]}],"year":"2010","keywords":"Classical Conditioning, Contextual Associations, Extinction (Learning), Hippocampus, Latent Inhibition, Learning, Models, Reinforcement","pages":"197–209","bibtex":"@article{gershman_context_2010,\n\ttitle = {Context, learning, and extinction},\n\tvolume = {117},\n\tissn = {1939-1471(Electronic),0033-295X(Print)},\n\tdoi = {10.1037/a0017808},\n\tabstract = {A. Redish et al. (2007) proposed a reinforcement learning model of context-dependent learning and extinction in conditioning experiments, using the idea of “state classification” to categorize new observations into states. In the current article, the authors propose an interpretation of this idea in terms of normative statistical inference. They focus on renewal and latent inhibition, 2 conditioning paradigms in which contextual manipulations have been studied extensively, and show that online Bayesian inference within a model that assumes an unbounded number of latent causes can characterize a diverse set of behavioral results from such manipulations, some of which pose problems for the model of Redish et al. Moreover, in both paradigms, context dependence is absent in younger animals, or if hippocampal lesions are made prior to training. The authors suggest an explanation in terms of a restricted capacity to infer new causes. (PsycINFO Database Record (c) 2016 APA, all rights reserved)},\n\tnumber = {1},\n\tjournal = {Psychological Review},\n\tauthor = {Gershman, Samuel J. and Blei, David M. and Niv, Yael},\n\tyear = {2010},\n\tkeywords = {Classical Conditioning, Contextual Associations, Extinction (Learning), Hippocampus, Latent Inhibition, Learning, Models, Reinforcement},\n\tpages = {197--209},\n}\n\n\n\n\n\n\n\n\n\n\n\n","author_short":["Gershman, S. J.","Blei, D. M.","Niv, Y."],"key":"gershman_context_2010","id":"gershman_context_2010","bibbaseid":"gershman-blei-niv-contextlearningandextinction-2010","role":"author","urls":{},"keyword":["Classical Conditioning","Contextual Associations","Extinction (Learning)","Hippocampus","Latent Inhibition","Learning","Models","Reinforcement"],"metadata":{"authorlinks":{}},"downloads":0,"html":""},"bibtype":"article","biburl":"https://bibbase.org/zotero/warren.pettine","dataSources":["zYjFbyFmZWKpRCD4j"],"keywords":["classical conditioning","contextual associations","extinction (learning)","hippocampus","latent inhibition","learning","models","reinforcement"],"search_terms":["context","learning","extinction","gershman","blei","niv"],"title":"Context, learning, and extinction","year":2010}