A biologically plausible learning rule for the Infomax on recurrent neural networks. Hayakawa, T., Kaneko, T., & Aoyagi, T. Frontiers in Computational Neuroscience, 8:143, 2014.
A biologically plausible learning rule for the Infomax on recurrent neural networks [link]Paper  doi  abstract   bibtex   
A fundamental issue in neuroscience is to understand how neuronal circuits in the cerebral cortex play their functional roles through their characteristic firing activity. Several characteristics of spontaneous and sensory-evoked cortical activity have been reproduced by Infomax learning of neural networks in computational studies. There are, however, still few models of the underlying learning mechanisms that allow cortical circuits to maximize information and produce the characteristics of spontaneous and sensory-evoked cortical activity. In the present article, we derive a biologically plausible learning rule for the maximization of information retained through time in dynamics of simple recurrent neural networks. Applying the derived learning rule in a numerical simulation, we reproduce the characteristics of spontaneous and sensory-evoked cortical activity: cell-assembly-like repeats of precise firing sequences, neuronal avalanches, spontaneous replays of learned firing sequences and orientation selectivity observed in the primary visual cortex. We further discuss the similarity between the derived learning rule and the spike timing-dependent plasticity of cortical neurons.
@article{hayakawa_biologically_2014,
	title = {A biologically plausible learning rule for the {Infomax} on recurrent neural networks},
	volume = {8},
	url = {http://journal.frontiersin.org/article/10.3389/fncom.2014.00143/abstract},
	doi = {10.3389/fncom.2014.00143},
	abstract = {A fundamental issue in neuroscience is to understand how neuronal circuits in the cerebral cortex play their functional roles through their characteristic firing activity. Several characteristics of spontaneous and sensory-evoked cortical activity have been reproduced by Infomax learning of neural networks in computational studies. There are, however, still few models of the underlying learning mechanisms that allow cortical circuits to maximize information and produce the characteristics of spontaneous and sensory-evoked cortical activity. In the present article, we derive a biologically plausible learning rule for the maximization of information retained through time in dynamics of simple recurrent neural networks. Applying the derived learning rule in a numerical simulation, we reproduce the characteristics of spontaneous and sensory-evoked cortical activity: cell-assembly-like repeats of precise firing sequences, neuronal avalanches, spontaneous replays of learned firing sequences and orientation selectivity observed in the primary visual cortex. We further discuss the similarity between the derived learning rule and the spike timing-dependent plasticity of cortical neurons.},
	urldate = {2015-03-21TZ},
	journal = {Frontiers in Computational Neuroscience},
	author = {Hayakawa, Takashi and Kaneko, Takeshi and Aoyagi, Toshio},
	year = {2014},
	keywords = {biologically plausible learning rule, information maximization, neuronal avalanche, orientation selectivity, precise firing sequence, recurrent neural network, spike-timing-dependent plasticity},
	pages = {143}
}

Downloads: 0