Human reinforcement learning processes and biases

Computational Characterization and Possible Applications to Behavioral Public Policy

Bibliographic Data

ID6442597
AuthorsStefano Palminteri (0000-0001-5768-6646, Laboratoire de Neurosciences Cognitives, corresponding author)
Year2025
Volume24
Issue2
Pages249-273
Publication date2025-07-20
Peer ReviewedYes
Open AccessYes
TypeARTICLE
VenueMind & Society (JOURNAL)
Journal identifiersISSN: 1593-7879 • E-ISSN: 1860-1839
PublisherSpringer Science+Business Media (PUBLISHER • DE)
DOI10.1007/s11299-025-00329-w
PMID41425665
OpenAlexW4412501530
LanguageEN
Citations received1
References cited103

The reinforcement learning framework provides a computational and behavioral foundation for understanding how agents learn to maximize rewards and minimize punishments through interaction with their environment. This framework has been widely applied across disciplines, including artificial intelligence, animal psychology, and economics. Over the last decade, a growing body of research has shown that human reinforcement learning often deviates from normative standards, exhibiting systematic biases. The first aim of this paper is to propose a conceptual framework and a taxonomy for evaluating computational biases within reinforcement learning. We specifically propose a distinction between praxic biases, characterized by a mismatch between internal representations and selected actions, and epistemic biases, characterized by a mismatch between past experiences and internal representations. Building on this foundation, we characterize and discuss two primary types of epistemic biases: relative valuation and biased update. We describe their behavioral signatures and discuss their potential adaptive roles. Finally, we eleborate on how these findings may shape future developments in both theoretical and applied domains. Notably, despite being widely used in clinical and educational settings, reinforcement-based interventions have been comparatively neglected in the domains of behavioral public policy and decision-making improvement, particularly when compared to more popular approaches such as nudges and boosts. In this review, we offer an explanation for this comparative neglect that we believe rooted in common historical and epistemological misconceptions, and advocate for a greater integration of reinforcement learning into the design of behavioral public policy

Characterization (materials science · Cognitive psychology · Cognitive science · Economics · Epistemology · Nanotechnology · Philosophy of science · Public policy · Reinforcement · Reinforcement learning · Computer Science · Decision-Making and Behavioral Economics · Neural and Behavioral Psychology Studies · Philosophy · Psychology · Social Psychology · Artificial Intelligence

Tools

Open DOIOpen Access