Litcius/Paper detail

Waves traveling over a map of visual space can ignite short-term predictions of sensory input

Gabriel Benigno, Roberto C. Budzinski, Zachary W. Davis, John H. Reynolds, Lyle Muller

2023Nature Communications38 citationsDOIOpen Access PDF

Abstract

Recent analyses have found waves of neural activity traveling across entire visual cortical areas in awake animals. These traveling waves modulate the excitability of local networks and perceptual sensitivity. The general computational role of these spatiotemporal patterns in the visual system, however, remains unclear. Here, we hypothesize that traveling waves endow the visual system with the capacity to predict complex and naturalistic inputs. We present a network model whose connections can be rapidly and efficiently trained to predict individual natural movies. After training, a few input frames from a movie trigger complex wave patterns that drive accurate predictions many frames into the future solely from the network's connections. When the recurrent connections that drive waves are randomly shuffled, both traveling waves and the ability to predict are eliminated. These results suggest traveling waves may play an essential computational role in the visual system by embedding continuous spatiotemporal structures over spatial maps.

Topics & Concepts

Traveling wavePerceptionComputer scienceEmbeddingTerm (time)Visual spaceVisual perceptionArtificial intelligenceSensory systemArtificial neural networkPhysicsNeuroscienceBiologyMathematicsQuantum mechanicsMathematical analysisNeural dynamics and brain functionNeural Networks and Reservoir ComputingVisual perception and processing mechanisms
Waves traveling over a map of visual space can ignite short-term predictions of sensory input | Litcius