Litcius/Paper detail

Nonlinear convergence boosts information coding in circuits with parallel outputs

Gabrielle J. Gutierrez, Fred Rieke, Eric Shea‐Brown

2021Proceedings of the National Academy of Sciences13 citationsDOIOpen Access PDF

Abstract

Neural circuits are structured with layers of converging and diverging connectivity and selectivity-inducing nonlinearities at neurons and synapses. These components have the potential to hamper an accurate encoding of the circuit inputs. Past computational studies have optimized the nonlinearities of single neurons, or connection weights in networks, to maximize encoded information, but have not grappled with the simultaneous impact of convergent circuit structure and nonlinear response functions for efficient coding. Our approach is to compare model circuits with different combinations of convergence, divergence, and nonlinear neurons to discover how interactions between these components affect coding efficiency. We find that a convergent circuit with divergent parallel pathways can encode more information with nonlinear subunits than with linear subunits, despite the compressive loss induced by the convergence and the nonlinearities when considered separately.

Topics & Concepts

Electronic circuitConvergence (economics)Computer scienceDivergence (linguistics)Coding (social sciences)Nonlinear systemInformation theoryComputationAlgorithmMathematicsEngineeringEconomicsLinguisticsPhilosophyStatisticsElectrical engineeringQuantum mechanicsPhysicsEconomic growthAdvanced Memory and Neural ComputingNeural Networks and ApplicationsNeural dynamics and brain function
Nonlinear convergence boosts information coding in circuits with parallel outputs | Litcius