CNS 256: Decision Making

Required Reading:

• Week 2 (04/09): Dopamine
  
  
  • Schultz, W., P. Dayan, and R. P. Montague. (1997) A neural substrate of prediction and reward. Science 275: 1593–1599.
  
  
  • Fiorillo CD, Tobler PN, Schultz W. (2003) Discrete coding of reward probability and uncertainty by dopamine neurons. Science 299(5614): 1898–1902.
  
  
• Week 3 (04/16): Biased Competition
  
  
  • Cisek, P. (2006). Integrated neural processes for defining potential actions and deciding between them: a computational model. J. Neurosci. 26, 9761–9770.
  
  
  • Cisek, P., and Kalaska, J.F. (2005). Neural correlates of reaching decisions in dorsal premotor cortex: Specification of multiple direction choices and final selection of action. Neuron 45, 801–814.
  
  
• Week 4 (04/23): Effector Choice
  
  
  • Cui H and Andersen RA (2007) Posterior Parietal Cortex Encodes Autonomously Selected Motor Plans. Neuron 56:552–559.
  
  
  • Scherberger H and Andersen RA (2007) Target Selection Signals for Arm Reaching in the Posterior Parietal Cortex. The Journal of Neuroscience 27(8):2001–2012.
  
  


• Week 5 (04/30): Accumulators
  
  
  • Hanks TD, Ditterich J and Shadlen MN (2006) Microstimulation of macaque area LIP affects decision-making in a motion discrimination task. Nature Neurosci. 9:682–689.
  
  
  • Shadlen MN, Newsome WT (2001) Neural basis of a perceptual decision in the parietal cortex (area LIP) of the rhesus monkey. Journal of Neurophysiology 86(4): 1916–1936.
  
  


• Week 6 (05/07): Models
  
  
  • Furman M, Wang XJ (2008) Similarity Effect and Optimal Control of Multiple-Choice Decision Making. Neuron 60(6): 1153–1168.
  
  
  • Hanes DP, Schall JD (1996) Neural control of voluntary movement initiation. Science 274(5286): 427–430.
  
  
• Week 7 (05/14): Action Value
  
  
  • Lau, B. and Glimcher, P.W. (2008). Value representations in the primate striatum during matching behavior. Neuron 58, 451–463.
  
  
  • Samejima, K., Yasumasa, U., Doya, D., and Kimura, M. (2005). Represntation of action-specific reward values in the stiatum. Science 310, 1337–1340.
  
  


• Week 8 (05/21): Lateral Intraparietal Cortex
  
  
  • Dorris MC, Glimcher PW (2004) Activity in posterior parietal cortex is correlated with the relative subjective desirability of action. Neuron 44(2): 365–378.
  
  
  • Sugrue LP, Corrado GS, Newsome WT (2004) Matching behavior and the representation of value in the parietal cortex. Science 304(5678): 1782–1787.
  
  


• Week 9 (05/28): Orbitofrontal Cortex and Amygdala
  
  
  
  • Paton JJ, Belova MA, Morrison SE, (2006) The primate amygdala represents the positive and negative value of visual stimuli during learning. Nature 439(7078): 865–870.
  
  
  • Roesch MR, Olson CR (2004) Neuronal activity related to reward value and motivation in primate frontal cortex. Science 304(5668): 307–310.
  
  


• Week 10 (06/04): Frontal Lobes
  
  
  
  • Barraclough DJ, Conroy ML, Lee D (2004) Prefrontal cortex and decision making in a mixed-strategy game. Nature Neuroscience 7(4): 404–410.
  
  
  • Coe B, Tomihara K, Matsuzawa M, et al. (2002) Visual and anticipatory bias in three cortical eye fields of the monkey during an adaptive decision-making task. Journal of Neuroscience 22(12): 5081–5090.
  
  

Supplementary Reading:

• Balleine BW. (2005). Neural bases of food-seeking: Affect, arousal and reward in corticostriatolimbic circuits. Physiology & Behavior. 86, 717-730.


• Brown, J.W., Hanes, D.P., Schall, J.D., and Stuphorn, V. (2008). Relation of frontal eye field activity to saccade initiation during a countermanding task. Exp. Brain Res. 190, 135-151.


• Monosov IE, Trageser JC, Thompson TG (2008) Measurements of Simultaneously Recorded Spiking Activity and Local Field Potentials Suggest that Spatial Selection Emerges in the Frontal Eye Field, Neuron 57,614-625.


• Musallam, S., Corneil, B.D., Greger, B., Scherberger, H., and Andersen, R.A. (2004). Cognitive control signals for neural prosthetics. Science 305, 258–262.


• Platt, M.L., and Glimcher, P.W. (1999). Neural correlates of decision variables in parietal cortex. Nature 400, 233–238.


• Yin, HH, Knowlton BJ, Balleine BW. (2006). Inactivation of dorsolateral striatum enhances sensitivity to changes in the action-outcome contingency in instrumental conditioning. Behavioral Brain Research 166, 189-196.


• Bayer, H.M. and Glimcher, P.W. (2005) Midbrain Dopamine Neurons Encode a Quantitative Reward Prediction Error Signal. Neuron 47:129–141.


• Bayer H, Lau B, Glimcher P. (2007) Statistics of midbrain dopamine neuron spike trains in the awake primate. Journal of neurophysiology 98(3): 1428–1439.


• Gold JI and Shadlen MN (2000). Representation of a perceptual decision in developing oculomotor commands. Nature 404:390–394


• Kable, J. W., and Glimcher, P. W. (2007). The neural correlates of subjective value during intertemporal choice. Nature Neuroscience 10: 1625–1633.


• JO'Doherty, P Dayan, J Schultz, R Deichmann (2004). Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science.


• Daw ND, O'Doherty JP, Seymour B, Dayan P, Dolan RJ. (2006) Cortical substrates for exploratory decisions in humans. Nature 441:876–879.


• Hampton, AH. O'Doherty J. Decoding the neural substrates of reward-related decision making with functional MRI. PNAS 104(4):1377–1382


• Daw ND, Niv Y, Dayan P (2005). Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nature Neuroscience 8:1704–1711.


• Churchland AK, Kiani R & Shadlen MN. (2008) Decision-making with multiple alternatives. Nature Neuroscience 11, 693–702.

Reviews:

• Gold JI and Shadlen MN (2007) The Neural Basis of Decision Making. Annual Review of Neuroscience 30: 535–574.


• Dayan P, Daw ND. (2008) Decision theory, reinforcement learning, and the brain. Cognitive Affective and Behavioral Neuroscience 8:429–453.