Signal neutrality, scalar property, and collapsing boundaries as consequences of a learned multi-timescale strategy. Manneschi, L., Gigante, G., Vasilaki, E., & Giudice, P. D. PLOS Computational Biology, 18(8):e1009393, Public Library of Science, August, 2022.
Signal neutrality, scalar property, and collapsing boundaries as consequences of a learned multi-timescale strategy [link]Paper  doi  abstract   bibtex   
We postulate that three fundamental elements underlie a decision making process: perception of time passing, information processing in multiple timescales and reward maximisation. We build a simple reinforcement learning agent upon these principles that we train on a random dot-like task. Our results, similar to the experimental data, demonstrate three emerging signatures. (1) signal neutrality: insensitivity to the signal coherence in the interval preceding the decision. (2) Scalar property: the mean of the response times varies widely for different signal coherences, yet the shape of the distributions stays almost unchanged. (3) Collapsing boundaries: the “effective” decision-making boundary changes over time in a manner reminiscent of the theoretical optimal. Removing the perception of time or the multiple timescales from the model does not preserve the distinguishing signatures. Our results suggest an alternative explanation for signal neutrality. We propose that it is not part of motor planning. It is part of the decision-making process and emerges from information processing on multiple timescales.
@article{manneschi_signal_2022,
	title = {Signal neutrality, scalar property, and collapsing boundaries as consequences of a learned multi-timescale strategy},
	volume = {18},
	issn = {1553-7358},
	url = {https://journals.plos.org/ploscompbiol/article?id=10.1371/journal.pcbi.1009393},
	doi = {10.1371/journal.pcbi.1009393},
	abstract = {We postulate that three fundamental elements underlie a decision making process: perception of time passing, information processing in multiple timescales and reward maximisation. We build a simple reinforcement learning agent upon these principles that we train on a random dot-like task. Our results, similar to the experimental data, demonstrate three emerging signatures. (1) signal neutrality: insensitivity to the signal coherence in the interval preceding the decision. (2) Scalar property: the mean of the response times varies widely for different signal coherences, yet the shape of the distributions stays almost unchanged. (3) Collapsing boundaries: the “effective” decision-making boundary changes over time in a manner reminiscent of the theoretical optimal. Removing the perception of time or the multiple timescales from the model does not preserve the distinguishing signatures. Our results suggest an alternative explanation for signal neutrality. We propose that it is not part of motor planning. It is part of the decision-making process and emerges from information processing on multiple timescales.},
	language = {en},
	number = {8},
	urldate = {2022-08-23},
	journal = {PLOS Computational Biology},
	publisher = {Public Library of Science},
	author = {Manneschi, Luca and Gigante, Guido and Vasilaki, Eleni and Giudice, Paolo Del},
	month = aug,
	year = {2022},
	keywords = {Cognitive science, Decision making, Integrators, Learning, Neurons, Sensory perception, Signal processing, Signal to noise ratio},
	pages = {e1009393},
}

Downloads: 0