1932
0
  1. Home
  2. A-Z Publications
  3. Annual Review of Neuroscience
  4. Volume 37, 2014
  5. Article

Annual Review of Neuroscience

Volume 37, 2014

Neural Coding of Uncertainty and Probability

Abstract

Organisms must act in the face of sensory, motor, and reward uncertainty stemming from a pandemonium of stochasticity and missing information. In many tasks, organisms can make better decisions if they have at their disposal a representation of the uncertainty associated with task-relevant variables. We formalize this problem using Bayesian decision theory and review recent behavioral and neural evidence that the brain may use knowledge of uncertainty, confidence, and probability.

Keyword(s): Bayesian inference, decision making, perception, population encoding
Loading

Article metrics loading...

/content/journals/10.1146/annurev-neuro-071013-014017
2014-07-08
2024-04-18
Loading full text...

Full text loading...

/deliver/fulltext/neuro/37/1/annurev-neuro-071013-014017.html?itemId=/content/journals/10.1146/annurev-neuro-071013-014017&mimeType=html&fmt=ahah

Literature Cited

  1. Acerbi L, Vijayakumar S, Wolpert DM. 2014. On the origins of suboptimality in human probabilistic inference. PLOS Comp. Biol. In press
  2. Acerbi L, Wolpert DM, Vijayakumar S. 2012. Internal representations of temporal statistics and feedback calibrate motor-sensory interval timing. PLoS Comput. Biol. 8:11e1002771 [Google Scholar]
  3. Ahrens M, Sahani M. 2011. Observers exploit stochastic models of sensory change to help judge the passage of time. Curr. Biol. 21:1–7 [Google Scholar]
  4. Anastasio TJ, Patton PE, Belkacem-Boussaid K. 2000. Using Bayes' rule to model multisensory enhancement in the superior colliculus. Neural Comput. 12:51165–87 [Google Scholar]
  5. Anderson C. 1994. Neurobiological computational systems. Computational Intelligence Imitating Life213–22 New York: IEEE Press [Google Scholar]
  6. Barber MJ, Clark JW, Anderson CH. 2003. Neural representation of probabilistic information. Neural Comput. 15:81843–64 [Google Scholar]
  7. Barlow HB, Levick WR. 1969. Three factors limiting the reliable detection of light by retinal ganglion cells of the cat. J. Physiol. 200:1–24 [Google Scholar]
  8. Barraclough DJ, Conroy ML. et al. 2004. Prefrontal cortex and decision making in a mixed-strategy game. Nat. Neurosci. 7:404–10 [Google Scholar]
  9. Barthelme S, Mamassian P. 2009. Evaluation of objective uncertainty in the visual system. PLoS Comput. Biol. 5:9e1000504 [Google Scholar]
  10. Basso MA, Wurtz RH. 1997. Modulation of neuronal activity by target uncertainty. Nature 389:66–69 [Google Scholar]
  11. Battaglia PW, Hamrick JB, Tenenbaum JB. 2013. Simulation as an engine of physical scene understanding. Proc. Natl. Acad. Sci. USA 110:4518327–32 [Google Scholar]
  12. Battaglia PW, Schrater PR. 2007. Humans trade off viewing time and movement duration to improve visuomotor accuracy in a fast reaching task. J. Neurosci. 27:266984–94 [Google Scholar]
  13. Beck J, Ma WJ, Kiani R, Hanks T, Churchland AK. et al. 2008. Bayesian decision making with probabilistic population codes. Neuron 60:61142–52 [Google Scholar]
  14. Beck JM, Latham PE, Pouget A. 2011. Marginalization in neural circuits with divisive normalization. J. Neurosci. 31:4315310–19 [Google Scholar]
  15. Beck JM, Ma WJ, Pitkow X, Latham PE, Pouget A. 2012. Not noisy, just wrong: the role of suboptimal inference in behavioral variability. Neuron 74:130–39 [Google Scholar]
  16. Behrens TEJ, Woolrich MW, Walton ME, Rushworth MFS. 2007. Learning the value of information in an uncertain world. Nat. Neurosci. 10:91214–21 [Google Scholar]
  17. Bejjanki VR, Clayards M, Knill DC, Aslin RN. 2011. Cue integration in categorical tasks: insights from audio-visual speech perception. PLoS ONE 6:5e19812 [Google Scholar]
  18. Berens P, Ecker AS, Cotton RJ, Ma WJ, Bethge M, Tolias AS. 2012. A fast and simple population code for orientation in primate V1. J. Neurosci. 32:3110618–26 [Google Scholar]
  19. Berkes P, Orban G, Lengyel M, Fiser J. 2011. Spontaneous cortical activity reveals hallmarks of an optimal internal model of the environment. Science 331:601383–87 [Google Scholar]
  20. Braun DA, Mehring C, Wolpert DM. 2010. Structure learning in action. Behav. Brain Res. 206:2157–65 [Google Scholar]
  21. Britten KH, Shadlen MN, Newsome WT, Movshon JA. 1993. Responses of neurons in macaque MT to stochastic motion signals. Vis. Neurosci. 10:61157–69 [Google Scholar]
  22. Chen X, Mihalas S, Niebur E, Stuphorn V. 2013. Mechanisms underlying the influence of saliency on value-based decisions. J. Vis. 13:1218 [Google Scholar]
  23. Churchland AK, Kiani R, Shadlen MN. 2008. Decision-making with multiple alternatives. Nat. Neurosci. 11:6693–702 [Google Scholar]
  24. Cicchini GM, Arrighi R, Cecchetti L, Giusti M, Burr DC. 2012. Optimal encoding of interval timing in expert percussionists. J. Neurosci. 32:31056–60 [Google Scholar]
  25. D'Antona AD, Perry JS, Geisler WS. 2013. Humans make efficient use of natural image statistics when performing spatial interpolation. J. Vis. 13:1411 [Google Scholar]
  26. de Martino B, Fleming SM, Garrett N, Dolan RJ. 2013. Confidence in value-based choice. Nat. Neurosci. 16:105–10 [Google Scholar]
  27. Dean AF. 1981. The variability of discharge of simple cells in the cat striate cortex. Exp. Brain Res. 44:437–40 [Google Scholar]
  28. Deneve S. 2008. Bayesian spiking neurons I: inference. Neural Comput. 20:191–117 [Google Scholar]
  29. DiCarlo JJ, Zoccolan D, Rust NC. 2012. How does the brain solve visual object recognition?. Neuron 73:3415–34 [Google Scholar]
  30. Dorris MC, Glimcher PW. 2004. Activity in posterior parietal cortex is correlated with the relative subjective desirability of action. Neuron 44:2365–78 [Google Scholar]
  31. Faisal A, Selen LPJ, Wolpert DM. 2008. Noise in the nervous system. Nat. Rev. Neurosci. 9:4292–303 [Google Scholar]
  32. Faisal AA, Wolpert DM. 2009. Near optimal combination of sensory and motor uncertainty in time during a naturalistic perception-action task. J. Neurophysiol. 101:41901–12 [Google Scholar]
  33. Feng S, Holmes P, Rorie A, Newsome WT. 2009. Can monkeys choose optimally when faced with noisy stimuli and unequal rewards?. PLoS Comput. Biol. 5:2e1000284 [Google Scholar]
  34. Fetsch CR, Pouget A, DeAngelis GC, Angelaki DE. 2012. Neural correlates of reliability-based cue weighting during multisensory integration. Nat. Neurosci. 15:146–54 [Google Scholar]
  35. Fetsch CR, Turner AH, DeAngelis GC, Angelaki DE. 2009. Dynamic reweighting of visual and vestibular cues during self-motion perception. J. Neurosci. 29:4915601–12 [Google Scholar]
  36. Fiorillo CD, Tobler PN, Schultz W. 2003. Discrete coding of reward probability and uncertainty by dopamine neurons. Science 299:56141898–902 [Google Scholar]
  37. Fischer BJ, Pena JL. 2011. Owl's behavior and neural representation predicted by Bayesian inference. Nat. Neurosci. 14:81061–66 [Google Scholar]
  38. Fiser J, Berkes P, Orbán G, Lengyel M. 2010. Statistically optimal perception and learning: from behavior to neural representations. Trends Cogn. Sci. 14:3119–30 [Google Scholar]
  39. Fleming SM, Dolan RJ. 2012. The neural basis of metacognitive ability. Phil. Trans. R. Soc. B 367:15941338–49 [Google Scholar]
  40. Fleming SM, Maloney LT, Daw ND. 2013. The irrationality of categorical perception. J. Neurosci. 33:4919060–70 [Google Scholar]
  41. Foldiak P. 1993. The ‘ideal homunculus’: statistical inference from neural population responses. Computation and Neural Systems F Eeckman, J Bower 55–60 Norwell, MA: Kluwer Acad. [Google Scholar]
  42. Ganguli D, Simoncelli EP. 2011. Implicit encoding of prior probabilities in optimal neural populations. Advances in Neural Information Processing Systems J Shawe-Taylor, RS Zemel, P Bartlett, F Pereira, KW Weinberger 658–66 Cambridge, MA: MIT Press [Google Scholar]
  43. Gershman SJ, Vul E, Tenenbaum JB. 2012. Multistability and perceptual inference. Neural Comput. 24:1–24 [Google Scholar]
  44. Ghose GM, Maunsell JH. 2002. Attentional modulation in visual cortex depends on task timing. Nature 419:6907616–20 [Google Scholar]
  45. Girshick AR, Landy MS, Simoncelli EP. 2011. Cardinal rules: visual orientation perception reflects knowledge of environmental statistics. Nat. Neurosci. 14:926–32 [Google Scholar]
  46. Glimcher PW, Fehr E, Camerer C, Poldrack RA. 2008. Neuroeconomics: Decision Making and the Brain New York: Academic
  47. Gold JI, Shadlen MN. 2007. The neural basis of decision making. Annu. Rev. Neurosci. 30:535–74 [Google Scholar]
  48. Graf AB, Kohn A, Jazayeri M, Movshon JA. 2011. Decoding the activity of neuronal populations in macaque primary visual cortex. Nat. Neurosci. 14:2239–45 [Google Scholar]
  49. Green DM, Swets JA. 1966. Signal Detection Theory and Psychophysics Los Altos, CA: Wiley
  50. Griffiths TL, Vul E, Sanborn AN. 2012. Bridging levels of analysis for probabilistic models of cognition. Curr. Dir. Psychol. Sci. 21:4263–68 [Google Scholar]
  51. Gu Y, Angelaki DE, DeAngelis GC. 2008. Neural correlates of multisensory cue integration in macaque MSTd. Nat. Neurosci. 11:101201–10 [Google Scholar]
  52. Hausmann L, von Campenhausen M, Endler F, Singheiser M, Wagner H. 2009. Improvements of sound localization abilities by the facial ruff of the barn owl (Tyto alba) as demonstrated by virtual ruff removal. PLoS ONE 4:e7721 [Google Scholar]
  53. Hikosaka O, Bromberg-Martin E, Hong S, Matsumoto M. 2008. New insights on the subcortical representation of reward. Curr. Opin. Neurobiol. 18:2203–8 [Google Scholar]
  54. Hillis JM, Ernst MO, Banks MS, Landy MS. 2002. Combining sensory information: mandatory fusion within, but not between, senses. Science 298:55981627–30 [Google Scholar]
  55. Hospedales T, Vijayakumar S. 2009. Multisensory oddity detection as Bayesian inference. PLoS ONE 4:1e4205 [Google Scholar]
  56. Hoyer PO, Hyvärinen A. 2003. Interpreting Neural Response Variability as Monte Carlo Sampling of the Posterior Cambridge, MA: MIT Press
  57. Hudson TE, Maloney LT, Landy MS. 2007. Movement planning with probabilistic target information. J. Neurophysiol. 98:53034–46 [Google Scholar]
  58. Janssen P, Shadlen MN. 2005. A representation of the hazard rate of elapsed time in macaque area LIP. Nat. Neurosci. 8:2234–41 [Google Scholar]
  59. Jazayeri M. 2008. Probabilistic sensory recoding. Curr. Opin. Neurobiol. 18:4431–37 [Google Scholar]
  60. Jazayeri M, Movshon JA. 2006. Optimal representation of sensory information by neural populations. Nat. Neurosci. 9:5690–96 [Google Scholar]
  61. Jazayeri M, Shadlen MN. 2010. Temporal context calibrates interval timing. Nat. Neurosci. 13:81020–26 [Google Scholar]
  62. Kahneman D, Tversky A. 1979. Prospect theory: an analysis of decision under risk. Econometrica 47:263–91 [Google Scholar]
  63. Kemp C, Tenenbaum JB. 2008. The discovery of structural form. Proc. Natl. Acad. Sci. USA 105:3110687–92 [Google Scholar]
  64. Kepecs A, Uchida N, Zariwala HA, Mainen ZF. 2008. Neural correlates, computation and behavioural impact of decision confidence. Nature 455:227–33 [Google Scholar]
  65. Kersten D, Mamassian P, Yuille A. 2004. Object perception as Bayesian inference. Annu. Rev. Psychol. 55:271–304 [Google Scholar]
  66. Keshvari S, Van den Berg R, Ma WJ. 2012. Probabilistic computation in human perception under variability in encoding precision. PLoS ONE 7:6e40216 [Google Scholar]
  67. Kiani R, Shadlen MN. 2009. Representation of confidence associated with a decision by neurons in the parietal cortex. Science 324:759–64 [Google Scholar]
  68. Komura Y, Nikkuni A, Hirashima N, Uetake T, Miyamoto A. 2013. Responses of pulvinar neurons reflect a subject's confidence in visual categorization. Nat. Neurosci. 16:6749–55 [Google Scholar]
  69. Körding KP, Beierholm U, Ma WJ, Quartz S, Tenenbaum JB, Shams L. 2007. Causal inference in multisensory perception. PLoS ONE 2:9e943 [Google Scholar]
  70. Kording KP, Wolpert DM. 2004. Bayesian integration in sensorimotor learning. Nature 427:6971244–47 [Google Scholar]
  71. Landy MS, Trommershauser J, Daw ND. 2012. Dynamic estimation of task-relevant variance in movement under risk. J. Neurosci. 32:3712702–11 [Google Scholar]
  72. Lau B, Glimcher PW. 2008. Value representations in the primate striatum during matching behavior. Neuron 58:3451–63 [Google Scholar]
  73. Law CT, Gold JI. 2008. Neural correlates of perceptual learning in a sensory-motor, but not a sensory, cortical area. Nat. Neurosci. 11:4505–13 [Google Scholar]
  74. Lee D, Seo H, Jung MW. 2012. Neural basis of reinforcement learning and decision making. Annu. Rev. Neurosci. 35:287–308 [Google Scholar]
  75. Lee TS, Mumford D. 2003. Hierarchical Bayesian inference in the visual cortex. J. Opt. Soc. Am. 20:71434–48 [Google Scholar]
  76. Ma WJ. 2012. Organizing probabilistic models of perception. Trends Cogn. Sci. 16:10511–18 [Google Scholar]
  77. Ma WJ, Beck JM, Latham PE, Pouget A. 2006. Bayesian inference with probabilistic population codes. Nat. Neurosci. 9:111432–38 [Google Scholar]
  78. Ma WJ, Beck JM, Pouget A. 2008. Spiking networks for Bayesian inference and choice. Curr. Opin. Neurobiol. 18:217–22 [Google Scholar]
  79. Ma WJ, Navalpakkam V, Beck JM, van den Berg R, Pouget A. 2011. Behavior and neural basis of near-optimal visual search. Nat. Neurosci. 14:6783–90 [Google Scholar]
  80. Ma WJ, Zhou X, Ross LA, Foxe JJ, Parra LC. 2009. Lip-reading aids word recognition most in moderate noise: a Bayesian explanation using high-dimensional feature space. PLoS ONE 4:3e4638 [Google Scholar]
  81. Magnotti JF, Ma WJ, Beauchamp MS. 2013. Causal inference of asynchronous audiovisual speech. Front. Psychol. 4:798 [Google Scholar]
  82. Maiworm M, König R, Röder B. 2011. Integrative processing of perception and reward in an auditory localization paradigm. Exp. Psychol. 58:3217–26 [Google Scholar]
  83. Maloney LT, Mamassian P. 2009. Bayesian decision theory as a model of human visual perception: testing Bayesian transfer. Vis. Neurosci. 26:1147–55 [Google Scholar]
  84. Mareschal I, Calder AJ, Clifford CWG. 2013. Humans have an expectation that gaze is directed toward them. Curr. Bio. 23:8717–21 [Google Scholar]
  85. Mazyar H, van den Berg R, Seilheimer RL, Ma WJ. 2013. Independence is elusive: set size effects on encoding precision in visual search. J. Vis. 13:5 doi: 10.1167/13.5.8 [Google Scholar]
  86. Middlebrooks PG, Sommer MA. 2012. Neuronal correlates of metacognition in primate frontal cortex. Neuron 75:3517–30 [Google Scholar]
  87. Miyazaki M, Nozaki D, Nakajima Y. 2005. Testing Bayesian models of human coincidence timing. J. Neurophysiol. 94:1395–99 [Google Scholar]
  88. Moreno-Bote R, Knill DC, Pouget A. 2011. Bayesian sampling in visual perception. Proc. Natl. Acad. Sci. USA 108:3012491–96 [Google Scholar]
  89. Morgan ML, DeAngelis GC, Angelaki DE. 2008. Multisensory integration in macaque visual cortex depends on cue reliability. Neuron 59:662–73 [Google Scholar]
  90. Najemnik J, Geisler WS. 2005. Optimal eye movement strategies in visual search. Nature 434:7031387–91 [Google Scholar]
  91. O'Reilly JX, Jbabdi S, Rushworth MFS, Behrens TEJ. 2013. Brain systems for probabilistic and dynamic prediction: computational specificity and integration. PLoS Biol. 11:9e1001662 [Google Scholar]
  92. Orhan AE, Sims CR, Jacobs RA, Knill DC. 2014. The adaptive nature of visual working memory. Curr. Dir. Psychol. Sci. In press
  93. Palmer J. 1990. Attentional limits on the perception and memory of visual information. J. Exp. Psychol. Hum. Percept. Perform. 16:332–50 [Google Scholar]
  94. Paulin MG. 2005. Evolution of the cerebellum as a neuronal machine for Bayesian state estimation. J. Neural Eng. 2:3S219–34 [Google Scholar]
  95. Peirce CS, Jastrow J. 1884. On small differences of sensation. Mem. Natl. Acad. Sci. 3:73–83 [Google Scholar]
  96. Platt ML, Glimcher PW. 1999. Neural correlates of decision variables in parietal cortex. Nature 400:6741233–38 [Google Scholar]
  97. Pouget A, Beck JM, Ma WJ, Latham PE. 2013. Probabilistic brains: knowns and unknowns. Nat. Neurosci. 16:1170–78 [Google Scholar]
  98. Pouget A, Dayan P, Zemel RS. 2003. Inference and computation with population codes. Annu. Rev. Neurosci. 26:381–410 [Google Scholar]
  99. Preuschoff K, Bossaerts P, Quartz SR. 2006. Neural differentiation of expected reward and risk in human subcortical structures. Neuron 51:3381–90 [Google Scholar]
  100. Qamar AT, Cotton RJ, George RG, Beck JM, Prezhdo E. et al. 2013. Trial-to-trial, uncertainty-based adjustment of decision boundaries in visual categorization. Proc. Natl. Acad. Sci. USA 110:5020332–37 [Google Scholar]
  101. Rangel A, Camerer C, Montague PR. 2008. A framework for studying the neurobiology of value-based decision making. Nat. Rev. Neurosci. 9:7545–56 [Google Scholar]
  102. Rao RP. 2004. Bayesian computation in recurrent neural circuits. Neural Comput. 16:11–38 [Google Scholar]
  103. Raphan M, Simoncelli EP. 2011. Least squares estimation without priors or supervision. Neural Comput. 23:2374–420 [Google Scholar]
  104. Rushworth MFS, Behrens TEJ. 2008. Choice, uncertainty and value in prefrontal and cingulate cortex. Nat. Neurosci. 11:4389–97 [Google Scholar]
  105. Sanger T. 1996. Probability density estimation for the interpretation of neural population codes. J. Neurophysiol. 76:42790–93 [Google Scholar]
  106. Schultz W. 2000. Multiple reward signals in the brain. Nat. Rev. Neurosci. 1:3199–207 [Google Scholar]
  107. Seydell A, McCann BC, Trommershäuser J, Knill DC. 2008. Learning stochastic reward distributions in a speeded pointing task. J. Neurosci. 28:174356–67 [Google Scholar]
  108. Shi L, Griffiths TL, Feldman NH, Sanborn AN. 2010. Exemplar models as a mechanism for performing Bayesian inference. Psychon. Bull. Rev. 17:4443–64 [Google Scholar]
  109. Simoncelli EP. 2009. Optimal estimation in sensory systems. The Cognitive Neurosciences 4 M Gazzanig 525–35 Cambridge, MA: MIT Press [Google Scholar]
  110. So NY, Stuphorn V. 2010. Supplementary eye field encodes option and action value for saccades with variable reward. J. Neurophysiol. 104:52634–53 [Google Scholar]
  111. Softky WR, Koch C. 1993. The highly irregular firing of cortical cells is inconsistent with temporal integration of random EPSPs. J. Neurosci. 13:1334–50 [Google Scholar]
  112. Stocker AA, Simoncelli EP. 2006. Noise characteristics and prior expectations in human visual speed perception. Nat. Neurosci. 9:4578–85 [Google Scholar]
  113. Sugrue LP, Corrado GS, Newsome WT. 2004. Matching behavior and the representation of value in the parietal cortex. Science 304:56781782–87 [Google Scholar]
  114. Tassinari H, Hudson TE, Landy MS. 2006. Combining priors and noisy visual cues in a rapid pointing task. J. Neurosci. 26:10154–63 [Google Scholar]
  115. Tenenbaum JB, Griffiths TL. 2001. Generalization, similarity, and Bayesian inference. Behav. Brain Sci. 24:4629–40; discuss. 652–791 [Google Scholar]
  116. Tolhurst D, Movshon J, Dean AF. 1983. The statistical reliability of signals in single neurons in cat and monkey visual cortex. Vis. Res. 23:775–85 [Google Scholar]
  117. Trommershauser J, Kording K, Landy MS. 2011. Sensory Cue Integration. New York: Oxford Univ. Press
  118. Trommershäuser J, Maloney L, Landy MS. 2008. Decision making, movement planning and statistical decision theory. Trends Cogn. Sci. 12:8291–97 [Google Scholar]
  119. Turnham EJ, Braun DA, Wolpert DM. 2011. Inferring visuomotor priors for sensorimotor learning. PLoS Comput. Biol. 7:3e1001112 [Google Scholar]
  120. van den Berg R, Vogel M, Josić K, Ma WJ. 2012. Optimal inference of sameness. Proc. Natl. Acad. Sci. USA 109:83178–83 [Google Scholar]
  121. Vilares I, Howard JD, Fernandes HL, Gottfried JA, Kording KP. 2012. Differential representations of prior and likelihood uncertainty in the human brain. Curr. Biol. 22:181641–48 [Google Scholar]
  122. Vilares I, Kording KP. 2011. Bayesian models: the structure of the world, uncertainty, behavior, and the brain. Ann. NY Acad. Sci. 1224:22–39 [Google Scholar]
  123. Whiteley L, Sahani M. 2008. Implicit knowledge of visual uncertainty guides decisions with asymmetric outcomes. J. Vis. 8:31–15 [Google Scholar]
  124. Whiteley L, Sahani M. 2012. Attention in a Bayesian framework. Front. Hum. Neurosci. 6:100 [Google Scholar]
  125. Yang T, Shadlen MN. 2007. Probabilistic reasoning by neurons. Nature 447:1075–80 [Google Scholar]
/content/journals/10.1146/annurev-neuro-071013-014017
Loading
Neural Coding of Uncertainty and Probability
Annual Review of Neuroscience 37, 205 (2014); https://doi.org/10.1146/annurev-neuro-071013-014017
/content/journals/10.1146/annurev-neuro-071013-014017
/content/journals/10.1146/annurev-neuro-071013-014017
Loading

Data & Media loading...

  • Article Type: Review Article

Most Cited Most Cited RSS feed

This is a required field
Please enter a valid email address
Approval was a Success
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error