Efficient Generalization with Distributionally Robust Learning
Soumyadip Ghosh, Mark Squillante, et al.
NeurIPS 2021
The property of mixed selectivity has been discussed at a computational level and offers a strategy to maximize computational power by adding versatility to the functional role of each neuron. Here, we offer a biologically grounded implementational-level mechanistic explanation for mixed selectivity in neural circuits. We define pure, linear, and nonlinear mixed selectivity and discuss how these response properties can be obtained in simple neural circuits. Neurons that respond to multiple, statistically independent variables display mixed selectivity. If their activity can be expressed as a weighted sum, then they exhibit linear mixed selectivity; otherwise, they exhibit nonlinear mixed selectivity. Neural representations based on diverse nonlinear mixed selectivity are high dimensional; hence, they confer enormous flexibility to a simple downstream readout neural circuit. However, a simple neural circuit cannot possibly encode all possible mixtures of variables simultaneously, as this would require a combinatorially large number of mixed selectivity neurons. Gating mechanisms like oscillations and neuromodulation can solve this problem by dynamically selecting which variables are mixed and transmitted to the readout.
Soumyadip Ghosh, Mark Squillante, et al.
NeurIPS 2021
G. Karunaratne, M. Hersche, et al.
ESSDERC/ESSCIRC 2022
Wanhua Li, Zibin Meng, et al.
NeurIPS 2024
Francesco Fuggitti, Tathagata Chakraborti
AAAI 2023