Properties of decision-making tasks govern the tradeoff between model-based and model-free learning

Loading...
Thumbnail Image

Date

2019-08-14

Journal Title

Journal ISSN

Volume Title

Repository Usage Stats

92
views
58
downloads

Citation Stats

Attention Stats

Abstract

<jats:title>Abstract</jats:title><jats:p>When decisions must be made between uncertain options, optimal behavior depends on accurate estimations of the likelihoods of different outcomes. The contextual factors that govern whether these estimations depend on model-free learning (tracking outcomes) vs. model-based learning (learning generative stimulus distributions) are poorly understood. We studied model-free and model-based learning using serial decision-making tasks in which subjects selected a rule and then used it to flexibly act on visual stimuli. A factorial approach defined a family of behavioral models that could integrate model-free and model-based strategies to predict rule selection trial-by-trial. Bayesian model selection demonstrated that the subjects strategies varied depending on lower-level task characteristics such as the identities of the rule options. In certain conditions, subjects integrated learned stimulus distributions and tracked reward rates to guide their behavior. The results thus identify tradeoffs between model-based and model-free decision strategies, and in some cases parallel utilization, depending on task context.</jats:p>

Department

Description

Provenance

Subjects

Citation

Published Version (Please cite this version)

10.1101/730663

Publication Info

Abzug, Zachary, Marc Sommer and Jeffrey Beck (2019). Properties of decision-making tasks govern the tradeoff between model-based and model-free learning. bioRxiv. 10.1101/730663 Retrieved from https://hdl.handle.net/10161/19285.

This is constructed from limited available data and may be imprecise. To cite this article, please review & use the official citation provided by the journal.

Scholars@Duke

Sommer

Marc A. Sommer

Professor of Biomedical Engineering

We study circuits for cognition. Using a combination of neurophysiology and biomedical engineering, we focus on the interaction between brain areas during visual perception, decision-making, and motor planning. Specific projects include the role of frontal cortex in metacognition, the role of cerebellar-frontal circuits in action timing, the neural basis of "good enough" decision-making (satisficing), and the neural mechanisms of transcranial magnetic stimulation (TMS).


Unless otherwise indicated, scholarly articles published by Duke faculty members are made available here with a CC-BY-NC (Creative Commons Attribution Non-Commercial) license, as enabled by the Duke Open Access Policy. If you wish to use the materials in ways not already permitted under CC-BY-NC, please consult the copyright owner. Other materials are made available here through the author’s grant of a non-exclusive license to make their work openly accessible.