{"_id":"Cn9rYLWdfKHhHhjDG","bibbaseid":"ortega-braun-dyer-kim-tishby-informationtheoreticboundedrationality-2015","downloads":0,"creationDate":"2017-03-16T18:57:17.674Z","title":"Information-Theoretic Bounded Rationality","author_short":["Ortega, P. A.","Braun, D. A.","Dyer, J.","Kim, K.","Tishby, N."],"year":2015,"bibtype":"article","biburl":"https://www.dropbox.com/s/axqr6ulvl7d7meq/library.bib?dl=1","bibdata":{"bibtype":"article","type":"article","abstract":"Bounded rationality, that is, decision-making and planning under resource limitations, is widely regarded as an important open problem in artificial intelligence, reinforcement learning, computational neuroscience and economics. This paper offers a consolidated presentation of a theory of bounded rationality based on information-theoretic ideas. We provide a conceptual justification for using the free energy functional as the objective function for characterizing bounded-rational decisions. This functional possesses three crucial properties: it controls the size of the solution space; it has Monte Carlo planners that are exact, yet bypass the need for exhaustive search; and it captures model uncertainty arising from lack of evidence or from interacting with other agents having unknown intentions. We discuss the single-step decision-making case, and show how to extend it to sequential decisions using equivalence transformations. This extension yields a very general class of decision problems that encompass classical decision rules (e.g. EXPECTIMAX and MINIMAX) as limit cases, as well as trust- and risk-sensitive planning.","archiveprefix":"arXiv","arxivid":"1512.06789","author":[{"propositions":[],"lastnames":["Ortega"],"firstnames":["Pedro","A."],"suffixes":[]},{"propositions":[],"lastnames":["Braun"],"firstnames":["Daniel","A."],"suffixes":[]},{"propositions":[],"lastnames":["Dyer"],"firstnames":["Justin"],"suffixes":[]},{"propositions":[],"lastnames":["Kim"],"firstnames":["Kee-Eung"],"suffixes":[]},{"propositions":[],"lastnames":["Tishby"],"firstnames":["Naftali"],"suffixes":[]}],"doi":"10.3390/e16084662","eprint":"1512.06789","file":":Users/brekels/Documents/Mendeley Desktop/Information-Theoretic Bounded Rationality - Ortega et al.pdf:pdf","issn":"1099-4300","number":"December 2015","title":"Information-Theoretic Bounded Rationality","url":"http://arxiv.org/abs/1512.06789","year":"2015","bibtex":"@article{Ortega2015,\nabstract = {Bounded rationality, that is, decision-making and planning under resource limitations, is widely regarded as an important open problem in artificial intelligence, reinforcement learning, computational neuroscience and economics. This paper offers a consolidated presentation of a theory of bounded rationality based on information-theoretic ideas. We provide a conceptual justification for using the free energy functional as the objective function for characterizing bounded-rational decisions. This functional possesses three crucial properties: it controls the size of the solution space; it has Monte Carlo planners that are exact, yet bypass the need for exhaustive search; and it captures model uncertainty arising from lack of evidence or from interacting with other agents having unknown intentions. We discuss the single-step decision-making case, and show how to extend it to sequential decisions using equivalence transformations. This extension yields a very general class of decision problems that encompass classical decision rules (e.g. EXPECTIMAX and MINIMAX) as limit cases, as well as trust- and risk-sensitive planning.},\narchivePrefix = {arXiv},\narxivId = {1512.06789},\nauthor = {Ortega, Pedro A. and Braun, Daniel A. and Dyer, Justin and Kim, Kee-Eung and Tishby, Naftali},\ndoi = {10.3390/e16084662},\neprint = {1512.06789},\nfile = {:Users/brekels/Documents/Mendeley Desktop/Information-Theoretic Bounded Rationality - Ortega et al.pdf:pdf},\nissn = {1099-4300},\nnumber = {December 2015},\ntitle = {{Information-Theoretic Bounded Rationality}},\nurl = {http://arxiv.org/abs/1512.06789},\nyear = {2015}\n}\n","author_short":["Ortega, P. A.","Braun, D. A.","Dyer, J.","Kim, K.","Tishby, N."],"key":"Ortega2015","id":"Ortega2015","bibbaseid":"ortega-braun-dyer-kim-tishby-informationtheoreticboundedrationality-2015","role":"author","urls":{"Paper":"http://arxiv.org/abs/1512.06789"},"downloads":0,"html":""},"search_terms":["information","theoretic","bounded","rationality","ortega","braun","dyer","kim","tishby"],"keywords":[],"authorIDs":[],"dataSources":["5NxYfDAcNJEC35W7g"]}