Dayan, Peter
Dopamine Modulation in a Basal Ganglio-Cortical Network of Working Memory
Gruber, Aaron J., Dayan, Peter, Gutkin, Boris S., Solla, Sara A.
Dopamine exerts two classes of effect on the sustained neural activity in prefrontal cortex that underlies working memory. Direct release in the cortex increases the contrast of prefrontal neurons, enhancing the robustness of storage. Release of dopamine in the striatum is associated with salient stimuli and makes medium spiny neurons bistable; this modulation of the output of spiny neurons affects prefrontal cortex so as to indirectly gate access to working memory and additionally damp sensitivity to noise. Existing models have treated dopamine in one or other structure, or have addressed basal ganglia gating of working memory exclusive of dopamine effects. In this paper we combine these mechanisms and explore their joint effect. We model a memory-guided saccade task to illustrate how dopamine's actions lead to working memory that is selective for salient input and has increased robustness to distraction.
Plasticity Kernels and Temporal Statistics
Dayan, Peter, Häusser, Michael, London, Michael
Figure l(Dl-Gl)* depict some of the main STDP findings/ of which the best-investigated are shown in figure l(Dl;El), and are variants of based a'standard' STDP rule. Earlier work considered rate-based rather than spike temporal rules, and so we adopt the broader term'time dependent plasticity' or TDP. Note the strong temporal asymmetry in both the standard rules. Although the theoretical studies have provided us with excellent tools for modeling the detailed consequences of different time-dependent rules, and understanding characteristics such as long-run stability and the relationship with non-temporal learning rules such as BCM,6 specifically computational ideas about TDP are rather thinner on the ground. Two main qualitative notions explored in various of the works cited above are that the temporal asymmetries in TDP rules are associated with causality or prediction. However, looking specifically at the standard STDP rules, models interested in prediction *We refer to graphs in this figure by row and column.
Dopamine Modulation in a Basal Ganglio-Cortical Network of Working Memory
Gruber, Aaron J., Dayan, Peter, Gutkin, Boris S., Solla, Sara A.
Dopamine exerts two classes of effect on the sustained neural activity in prefrontal cortex that underlies working memory. Direct release in the cortex increases the contrast of prefrontal neurons, enhancing the robustness ofstorage. Release of dopamine in the striatum is associated with salient stimuli and makes medium spiny neurons bistable; this modulation ofthe output of spiny neurons affects prefrontal cortex so as to indirectly gate access to working memory and additionally damp sensitivity tonoise. Existing models have treated dopamine in one or other structure, or have addressed basal ganglia gating of working memory exclusive ofdopamine effects. In this paper we combine these mechanisms and explore their joint effect. We model a memory-guided saccade task to illustrate how dopamine's actions lead to working memory that is selective forsalient input and has increased robustness to distraction.
Plasticity Kernels and Temporal Statistics
Dayan, Peter, Häusser, Michael, London, Michael
These experimentally-determined rules (usually called spike-time dependent plasticity or STDP rules), which are constantly being refined,18,3o have inspired substantialfurther theoretical work on their modeling and interpretation.2·9,l0,22·28·29·33 Figurel(Dl-Gl)* depict some of the main STDP findings/ of which the best-investigated are shown in figure l(Dl;El), and are variants of a'standard' STDP rule. Earlier work considered rate-based rather than spikebased temporalrules, and so we adopt the broader term'time dependent plasticity' or TDP. Note the strong temporal asymmetry in both the standard rules. Although the theoretical studies have provided us with excellent tools for modeling thedetailed consequences of different time-dependent rules, and understanding characteristicssuch as long-run stability and the relationship with non-temporal learning rules such as BCM,6 specifically computational ideas about TDP are rather thinner on the ground. Two main qualitative notions explored in various of the works cited above are that the temporal asymmetries inTDP rules are associated with causality or prediction. However, looking specifically at the standard STDP rules, models interested in prediction *We refer to graphs in this figure by row and column.
Expected and Unexpected Uncertainty: ACh and NE in the Neocortex
Dayan, Peter, Yu, Angela J.
Inference and adaptation in noisy and changing, rich sensory environments are rife with a variety of specific sorts of variability. Experimental and theoretical studies suggest that these different forms of variability play different behavioral, neural and computational roles, and may be reported by different (notably neuromodulatory) systems. Here, we refine our previous theory of acetylcholine's role in cortical inference in the (oxymoronic) terms of expected uncertainty, and advocate a theory for norepinephrine in terms of unexpected uncertainty. We suggest that norepinephrine reports the radical divergence of bottom-up inputs from prevailing top-down interpretations, to influence inference and plasticity. We illustrate this proposal using an adaptive factor analysis model.
Replay, Repair and Consolidation
Káli, Szabolcs, Dayan, Peter
A standard view of memory consolidation is that episodes are stored temporarily in the hippocampus, and are transferred to the neocortex through replay. Various recent experimental challenges to the idea of transfer, particularly for human memory, are forcing its reevaluation. However, although there is independent neurophysiological evidence for replay, short of transfer, there are few theoretical ideas for what it might be doing. We suggest and demonstrate two important computational roles associated with neocortical indices.
Adaptation and Unsupervised Learning
Dayan, Peter, Sahani, Maneesh, Deback, Gregoire
Adaptation is a ubiquitous neural and psychological phenomenon, with a wealth of instantiations and implications. Although a basic form of plasticity, it has, bar some notable exceptions, attracted computational theory of only one main variety. In this paper, we study adaptation from the perspective of factor analysis, a paradigmatic technique of unsupervised learning. We use factor analysis to reinterpret a standard view of adaptation, and apply our new model to some recent data on adaptation in the domain of face discrimination.
Adaptation and Unsupervised Learning
Dayan, Peter, Sahani, Maneesh, Deback, Gregoire
Adaptation is a ubiquitous neural and psychological phenomenon, with a wealth of instantiations and implications. Although a basic form of plasticity, it has, bar some notable exceptions, attracted computational theory of only one main variety. In this paper, we study adaptation from the perspective of factor analysis, a paradigmatic technique of unsupervised learning.We use factor analysis to reinterpret a standard view of adaptation, and apply our new model to some recent data on adaptation in the domain of face discrimination.
Replay, Repair and Consolidation
Káli, Szabolcs, Dayan, Peter
A standard view of memory consolidation is that episodes are stored temporarily inthe hippocampus, and are transferred to the neocortex through replay. Various recent experimental challenges to the idea of transfer, particularly for human memory, are forcing its reevaluation. However, although there is independent neurophysiological evidence for replay, short of transfer, there are few theoretical ideas for what it might be doing. We suggest and demonstrate two important computational roles associated with neocortical indices.