Task complexity interacts with state-space uncertainty in the arbitration between model-based and model-free learning.

Clicks: 665
ID: 71310
2019
Article Quality & Performance Metrics
Overall Quality
Not rated
Combines reader engagement with the AI quality analysis. This article has not been analysed, so there is no overall score — reader engagement is measured and shown alongside.
AI Quality Assessment
Not analyzed
Readership in this journal
Steady

Ranked #3 of 485 articles by views in Nature communications

Most read Least read

Bar heights use a square-root scale. Only the 120 most-read articles are drawn; the journal has 485 in total.

Mint this article as an NFT
Not yet minted

Create a permanent, verifiable on-chain record of this article on the Scimatic Network. The NFT is held in your Journament account, and you can withdraw it to your own wallet at any time.

5 SUSD one-off · no wallet required
Sign in to mint
Abstract
It has previously been shown that the relative reliability of model-based and model-free reinforcement-learning (RL) systems plays a role in the allocation of behavioral control between them. However, the role of task complexity in the arbitration between these two strategies remains largely unknown. Here, using a combination of novel task design, computational modelling, and model-based fMRI analysis, we examined the role of task complexity alongside state-space uncertainty in the arbitration process. Participants tended to increase model-based RL control in response to increasing task complexity. However, they resorted to model-free RL when both uncertainty and task complexity were high, suggesting that these two variables interact during the arbitration process. Computational fMRI revealed that task complexity interacts with neural representations of the reliability of the two systems in the inferior prefrontal cortex.
Reference Key
kim2019tasknature Use this key to autocite in the manuscript while using SciMatic Manuscript Manager or Thesis Manager
Authors Kim, Dongjae;Park, Geon Yeong;O Doherty, John P;Lee, Sang Wan;
Journal Nature communications
Year 2019
DOI
10.1038/s41467-019-13632-1
URL
Keywords
Environmental Science artificial intelligence hydrology sustainable development goals process modeling applied computing civil engineering computing methodology evolutionary computation water demand water equity water justice

Citations

No citations found. To add a citation, contact the admin at info@scimatic.org

Comments

No comments yet. Be the first to comment on this article.