Active inference, evidence accumulation, and the urn task

Thomas H B FitzGerald (Lead Author), Philipp Schwartenbeck, Michael Moutoussis, Raymond J Dolan, Karl Friston

Research output: Contribution to journalArticle

40 Citations (Scopus)
36 Downloads (Pure)

Abstract

Deciding how much evidence to accumulate before making a decision is a problem we and other animals often face, but one that is not completely understood. This issue is particularly important because a tendency to sample less information (often known as reflection impulsivity) is a feature in several psychopathologies, such as psychosis. A formal understanding of information sampling may therefore clarify the computational anatomy of psychopathology. In this theoretical letter, we consider evidence accumulation in terms of active (Bayesian) inference using a generic model of Markov decision processes. Here, agents are equipped with beliefs about their own behavior--in this case, that they will make informed decisions. Normative decision making is then modeled using variational Bayes to minimize surprise about choice outcomes. Under this scheme, different facets of belief updating map naturally onto the functional anatomy of the brain (at least at a heuristic level). Of particular interest is the key role played by the expected precision of beliefs about control, which we have previously suggested may be encoded by dopaminergic neurons in the midbrain. We show that manipulating expected precision strongly affects how much information an agent characteristically samples, and thus provides a possible link between impulsivity and dopaminergic dysfunction. Our study therefore represents a step toward understanding evidence accumulation in terms of neurobiologically plausible Bayesian inference and may cast light on why this process is disordered in psychopathology.

Original languageEnglish
Pages (from-to)306-328
Number of pages23
JournalNeural Computation
Volume27
Issue number2
Early online date16 Jan 2015
DOIs
Publication statusPublished - Feb 2015

Keywords

  • Animals
  • Bayes Theorem
  • Brain
  • Choice Behavior
  • Cognition
  • Computer Simulation
  • Decision Making
  • Dopamine
  • Entropy
  • Game Theory
  • Humans
  • Markov Chains
  • Theoretical Models
  • Reaction Time

Cite this