{"_id":"azoD4LNsZHsc27muL","bibbaseid":"creutzig-globerson-tishby-pastfutureinformationbottleneckindynamicalsystems","downloads":0,"creationDate":"2017-03-16T18:57:17.668Z","title":"Past-future information bottleneck in dynamical systems","author_short":["Creutzig, F.","Globerson, A.","Tishby, N."],"year":null,"bibtype":"article","biburl":"https://www.dropbox.com/s/axqr6ulvl7d7meq/library.bib?dl=1","bibdata":{"bibtype":"article","type":"article","abstract":"Biological systems need to process information in real time and must trade off accuracy of presentation and coding costs. Here we operationalize this trade-off and develop an information-theoretic framework that se-lectively extracts information of the input past that is predictive about the output future, obtaining a generalized eigenvalue problem. Thereby, we unravel the input history in terms of structural phase transitions correspond-ing to additional dimensions of a state space. We elucidate the relation to canonical correlation analysis and give a numerical example. Altogether, this work relates information-theoretic optimization to the joint problem of system identification and model reduction.","author":[{"propositions":[],"lastnames":["Creutzig"],"firstnames":["Felix"],"suffixes":[]},{"propositions":[],"lastnames":["Globerson"],"firstnames":["Amir"],"suffixes":[]},{"propositions":[],"lastnames":["Tishby"],"firstnames":["Naftali"],"suffixes":[]}],"doi":"10.1103/PhysRevE.79.041925","file":":Users/brekels/Documents/Mendeley Desktop/Past-future information bottleneck in dynamical systems - Creutzig, Globerson, Tishby.pdf:pdf","title":"Past-future information bottleneck in dynamical systems","bibtex":"@article{Creutzig,\nabstract = {Biological systems need to process information in real time and must trade off accuracy of presentation and coding costs. Here we operationalize this trade-off and develop an information-theoretic framework that se-lectively extracts information of the input past that is predictive about the output future, obtaining a generalized eigenvalue problem. Thereby, we unravel the input history in terms of structural phase transitions correspond-ing to additional dimensions of a state space. We elucidate the relation to canonical correlation analysis and give a numerical example. Altogether, this work relates information-theoretic optimization to the joint problem of system identification and model reduction.},\nauthor = {Creutzig, Felix and Globerson, Amir and Tishby, Naftali},\ndoi = {10.1103/PhysRevE.79.041925},\nfile = {:Users/brekels/Documents/Mendeley Desktop/Past-future information bottleneck in dynamical systems - Creutzig, Globerson, Tishby.pdf:pdf},\ntitle = {{Past-future information bottleneck in dynamical systems}}\n}\n","author_short":["Creutzig, F.","Globerson, A.","Tishby, N."],"key":"Creutzig","id":"Creutzig","bibbaseid":"creutzig-globerson-tishby-pastfutureinformationbottleneckindynamicalsystems","role":"author","urls":{},"downloads":0,"html":""},"search_terms":["past","future","information","bottleneck","dynamical","systems","creutzig","globerson","tishby"],"keywords":[],"authorIDs":[],"dataSources":["5NxYfDAcNJEC35W7g"]}