Litcius/Paper detail

The Anterior Cingulate Cortex Predicts Future States to Mediate Model-Based Action Selection

Thomas Akam, Ines Rodrigues-Vaz, Ivo M. Marcelo, Xiangyu Zhang, Michael Pereira, Rodrigo F. Oliveira, Peter Dayan, Rui M. Costa

2020Neuron187 citationsDOIOpen Access PDF

Abstract

Behavioral control is not unitary. It comprises parallel systems, model based and model free, that respectively generate flexible and habitual behaviors. Model-based decisions use predictions of the specific consequences of actions, but how these are implemented in the brain is poorly understood. We used calcium imaging and optogenetics in a sequential decision task for mice to show that the anterior cingulate cortex (ACC) predicts the state that actions will lead to, not simply whether they are good or bad, and monitors whether outcomes match these predictions. ACC represents the complete state space of the task, with reward signals that depend strongly on the state where reward is obtained but minimally on the preceding choice. Accordingly, ACC is necessary only for updating model-based strategies, not for basic reward-driven action reinforcement. These results reveal that ACC is a critical node in model-based control, with a specific role in predicting future states given chosen actions.

Topics & Concepts

Anterior cingulate cortexAction selectionTask (project management)OptogeneticsNeuroscienceAction (physics)PsychologyReinforcement learningReinforcementCognitive psychologyCingulate cortexSelection (genetic algorithm)Computer scienceControl (management)Artificial intelligenceCognitionSocial psychologyPhysicsCentral nervous systemQuantum mechanicsManagementPerceptionEconomicsNeural dynamics and brain functionReceptor Mechanisms and SignalingNeurotransmitter Receptor Influence on Behavior
The Anterior Cingulate Cortex Predicts Future States to Mediate Model-Based Action Selection | Litcius