Effects of depression on reward-based decision making and variability of action in probabilistic learning

Yoshihiko Kunisato, Yasumasa Okamoto, Kazutaka Ueda, Keiichi Onoda, Go Okada, Shinpei Yoshimura, Shinichi Suzuki, Kazuyuki Samejima, Shigeto Yamawaki

    Research output: Contribution to journalArticle

    28 Citations (Scopus)

    Abstract

    Background and objectives: Depression is characterized by low reward sensitivity in behavioral studies applying signal detection theory. We examined deficits in reward-based decision making in depressed participants during a probabilistic learning task, and used a reinforcement learning model to examine learning parameters during the task. Methods: Thirty-six nonclinical undergraduates completed a probabilistic selection task. Participants were divided into depressed and non-depressed groups based on Center for Epidemiologic Studies-Depression (CES-D) cut scores. We then applied a reinforcement learning model to every participant's behavioral data. Results: Depressed participants showed a reward-based decision making deficit and higher levels of the learning parameter τ, which modulates variability of action selection, as compared to non-depressed participants. Highly variable action selection is more random and characterized by difficulties with selecting a specific course of action. Conclusion: These results suggest that depression is characterized by deficits in reward-based decision making as well as high variability in terms of action selection.

    Original languageEnglish
    Pages (from-to)1088-1094
    Number of pages7
    JournalJournal of Behavior Therapy and Experimental Psychiatry
    Volume43
    Issue number4
    DOIs
    Publication statusPublished - 2012 Dec

    Fingerprint

    Reward
    Decision Making
    Learning
    Depression
    Epidemiologic Studies
    Reinforcement Learning
    Learning Model
    Reinforcement (Psychology)

    Keywords

    • Decision making
    • Depression
    • Probabilistic learning
    • Reinforcement learning
    • Reward sensitivity
    • Variability of action selection

    ASJC Scopus subject areas

    • Psychiatry and Mental health
    • Experimental and Cognitive Psychology
    • Clinical Psychology
    • Arts and Humanities (miscellaneous)

    Cite this

    Effects of depression on reward-based decision making and variability of action in probabilistic learning. / Kunisato, Yoshihiko; Okamoto, Yasumasa; Ueda, Kazutaka; Onoda, Keiichi; Okada, Go; Yoshimura, Shinpei; Suzuki, Shinichi; Samejima, Kazuyuki; Yamawaki, Shigeto.

    In: Journal of Behavior Therapy and Experimental Psychiatry, Vol. 43, No. 4, 12.2012, p. 1088-1094.

    Research output: Contribution to journalArticle

    Kunisato, Yoshihiko ; Okamoto, Yasumasa ; Ueda, Kazutaka ; Onoda, Keiichi ; Okada, Go ; Yoshimura, Shinpei ; Suzuki, Shinichi ; Samejima, Kazuyuki ; Yamawaki, Shigeto. / Effects of depression on reward-based decision making and variability of action in probabilistic learning. In: Journal of Behavior Therapy and Experimental Psychiatry. 2012 ; Vol. 43, No. 4. pp. 1088-1094.
    @article{092f78f633e34a30ad6ac390a982a184,
    title = "Effects of depression on reward-based decision making and variability of action in probabilistic learning",
    abstract = "Background and objectives: Depression is characterized by low reward sensitivity in behavioral studies applying signal detection theory. We examined deficits in reward-based decision making in depressed participants during a probabilistic learning task, and used a reinforcement learning model to examine learning parameters during the task. Methods: Thirty-six nonclinical undergraduates completed a probabilistic selection task. Participants were divided into depressed and non-depressed groups based on Center for Epidemiologic Studies-Depression (CES-D) cut scores. We then applied a reinforcement learning model to every participant's behavioral data. Results: Depressed participants showed a reward-based decision making deficit and higher levels of the learning parameter τ, which modulates variability of action selection, as compared to non-depressed participants. Highly variable action selection is more random and characterized by difficulties with selecting a specific course of action. Conclusion: These results suggest that depression is characterized by deficits in reward-based decision making as well as high variability in terms of action selection.",
    keywords = "Decision making, Depression, Probabilistic learning, Reinforcement learning, Reward sensitivity, Variability of action selection",
    author = "Yoshihiko Kunisato and Yasumasa Okamoto and Kazutaka Ueda and Keiichi Onoda and Go Okada and Shinpei Yoshimura and Shinichi Suzuki and Kazuyuki Samejima and Shigeto Yamawaki",
    year = "2012",
    month = "12",
    doi = "10.1016/j.jbtep.2012.05.007",
    language = "English",
    volume = "43",
    pages = "1088--1094",
    journal = "Journal of Behavior Therapy and Experimental Psychiatry",
    issn = "0005-7916",
    publisher = "Elsevier Limited",
    number = "4",

    }

    TY - JOUR

    T1 - Effects of depression on reward-based decision making and variability of action in probabilistic learning

    AU - Kunisato, Yoshihiko

    AU - Okamoto, Yasumasa

    AU - Ueda, Kazutaka

    AU - Onoda, Keiichi

    AU - Okada, Go

    AU - Yoshimura, Shinpei

    AU - Suzuki, Shinichi

    AU - Samejima, Kazuyuki

    AU - Yamawaki, Shigeto

    PY - 2012/12

    Y1 - 2012/12

    N2 - Background and objectives: Depression is characterized by low reward sensitivity in behavioral studies applying signal detection theory. We examined deficits in reward-based decision making in depressed participants during a probabilistic learning task, and used a reinforcement learning model to examine learning parameters during the task. Methods: Thirty-six nonclinical undergraduates completed a probabilistic selection task. Participants were divided into depressed and non-depressed groups based on Center for Epidemiologic Studies-Depression (CES-D) cut scores. We then applied a reinforcement learning model to every participant's behavioral data. Results: Depressed participants showed a reward-based decision making deficit and higher levels of the learning parameter τ, which modulates variability of action selection, as compared to non-depressed participants. Highly variable action selection is more random and characterized by difficulties with selecting a specific course of action. Conclusion: These results suggest that depression is characterized by deficits in reward-based decision making as well as high variability in terms of action selection.

    AB - Background and objectives: Depression is characterized by low reward sensitivity in behavioral studies applying signal detection theory. We examined deficits in reward-based decision making in depressed participants during a probabilistic learning task, and used a reinforcement learning model to examine learning parameters during the task. Methods: Thirty-six nonclinical undergraduates completed a probabilistic selection task. Participants were divided into depressed and non-depressed groups based on Center for Epidemiologic Studies-Depression (CES-D) cut scores. We then applied a reinforcement learning model to every participant's behavioral data. Results: Depressed participants showed a reward-based decision making deficit and higher levels of the learning parameter τ, which modulates variability of action selection, as compared to non-depressed participants. Highly variable action selection is more random and characterized by difficulties with selecting a specific course of action. Conclusion: These results suggest that depression is characterized by deficits in reward-based decision making as well as high variability in terms of action selection.

    KW - Decision making

    KW - Depression

    KW - Probabilistic learning

    KW - Reinforcement learning

    KW - Reward sensitivity

    KW - Variability of action selection

    UR - http://www.scopus.com/inward/record.url?scp=84862287089&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=84862287089&partnerID=8YFLogxK

    U2 - 10.1016/j.jbtep.2012.05.007

    DO - 10.1016/j.jbtep.2012.05.007

    M3 - Article

    C2 - 22721601

    AN - SCOPUS:84862287089

    VL - 43

    SP - 1088

    EP - 1094

    JO - Journal of Behavior Therapy and Experimental Psychiatry

    JF - Journal of Behavior Therapy and Experimental Psychiatry

    SN - 0005-7916

    IS - 4

    ER -