Saltar al contenido principal

ETHNOS_APP

Inicio • Búsqueda • Revistas • Lista 0

Investigating an alternate form of the cognitive reflection test

Datos Bibliográficos

ID23315917
AutoresKeela S Thomson (0000-0003-3066-832X, University of California, Los Angeles), Daniel M Oppenheimer (0000-0002-2363-4220, University of California, Los Angeles)
Año2016
Volumen11
Número1
Páginas99-113
Fecha de publicación2016-01-01
Peer ReviewedSí
Open AccessSí
TipoARTICLE
RevistaJudgment and Decision Making (JOURNAL)
Identificadores de la revistaISSN: 1930-2975 • E-ISSN: 1930-2975
EditorialCambridge University Press (CUP) (PUBLISHER)
DOI10.1017/s1930297500007622
OpenAlexW2302521008
IdiomaEN
Citas recibidas130
Referencias citadas55

Much research in cognitive psychology has focused on the tendency to conserve limited cognitive resources. The CRT is the predominant measure of such miserly information processing, and also predicts a number of frequently studied decision-making traits (such as belief bias and need for cognition). However, many subjects from common subject populations have already been exposed to the questions, which might add considerable noise to data. Moreover, the CRT has been shown to be confounded with numeracy. To increase the pool of available questions and to try to address numeracy confounds, we developed and tested the CRT-2. CRT-2 questions appear to rely less on numeracy than the original CRT but appear to measure closely related constructs in other respects. Crucially, substantially fewer subjects from Amazon’s Mechanical Turk have been previously exposed to CRT-2 questions. Though our primary purpose was investigating the CRT-2, we also found that belief bias questions appear suitable as an additional source of new items. Implications and remaining measurement challenges are discussed.

Cognition · Cognitive bias · Cognitive psychology · Data mining · Literacy · Measure (data warehouse) · Numeracy · Test (biology) · Computer Science · Decision-Making and Behavioral Economics · Memory Processes and Influences · Psychological and Educational Research Studies · Psychology · Social Psychology

  • Fighting Covid-19 misinformation on social media

    Gordon Pennycook, Jonathon Mcphetres et al.•2020

  • Going Viral

    Open Access•Carola Salvi, Paola Iannello et al.•Frontiers in Communication•2021

  • Epistemic Overconfidence in Algorithmic News Selection

    Open Access•Mariken A C G Van Der Velden, Felicia Löecherbach•Media and Communication•2021

  • Clarifying the structure and nature of left-wing authoritarianism

    Thomas H Costello, Shauna M Bowe et al.•Journal of Personality and Social…•2022

  • Neuroethics

    Joshua May•Neuroethics•2023

  • Epistemic rationality

    Open Access•Tomas Ståhl, Jan-Willem Van Prooijen•Personality and Individual…•2018

  • Accuracy prompts are a replicable and generalizable approach for reducing the spread of misinformation

    Open Access•Gordon Pennycook, David Rand•Nature Communications•2022

  • Demographics and Dynamics of Mechanical Turk Workers

    Open Access•Djellel Difallah, Elena Filatova et al.•Proceedings of the Eleventh ACM…•2018

  • The detection of political deepfakes

    Open Access•M Appel, Fabian Prietzel et al.•Journal of Computer-Mediated…•2022

  • Pyramid schemes

    Open Access•Gönül Doğan, Kenan Kalaycı et al.•Journal of Economic Behavior &…•2026

  • Belief in Altruistic Motives Predicts Prosocial Actions and Inferences

    Open Access•Ryan W Carlson, Jamil Zaki•Psychological Reports•2021

  • Training rational thinking

    Open Access•Johanna Grimm, Tobias Richter•Learning and Instruction•2026

  • Development of the Semi-Implicit Self-Report to assess Attitudes Toward Immigration (Sisrati)

    Open Access•David Herrero‐Fernández, Carla Álvarez-Ferradas et al.•International Journal of…•2026

  • Pragmatism, Dual‐Process Theory, and the Study of Reflective Cognition

    Open Access•Gordon Brett•Journal for the Theory of Social…•2026

  • Social psychological skill in a cross-cultural setting

    Open Access•Belal Al Droubi, Husam Aldean Abuhayyeh et al.•Cogent Social Sciences•2020

  • Does Studying Philosophy Make People Better Thinkers

    Open Access•Michael M Prinzing, Michael Vazquez•Journal of the American…•2024

  • Believing and Sharing False News on Social Media

    Wenjie Yan, Zhongdang Pan•Media Psychology•2023

  • Analytic-thinking predicts hoax beliefs and helping behaviors in response to the Covid-19 pandemic

    Matthew L Stanley, Nathaniel Barr et al.•Thinking & Reasoning•2021

  • Predicting individual differences in conflict detection and bias susceptibility during reasoning

    Jakub Šrol, Wim De Neys•Thinking & Reasoning•2021

  • When do non-evidential considerations trump evidence as the consciously preferred foundation for belief? The role of commitment to epistemic rationality

    Tomas Ståhl, Nathan Digby et al.•Thinking & Reasoning•2026

  • Belief in fake news, responsiveness to cognitive conflict, and analytic reasoning engagement

    Michael V Bronstein, Gordon Pennycook et al.•Thinking & Reasoning•2021

  • Elaborative feedback and instruction improve cognitive reflection but do not transfer to related tasks

    Dustin P Calvillo, Jonathan Bratton et al.•Thinking & Reasoning•2023

  • Political belief bias

    Sinem Yilmaz, Tomas Ståhl•Thinking & Reasoning•2025

  • Cognitive reflection, visuospatial ability, and other measures as predictors of Bayesian reasoning

    Gary L Brase•Thinking & Reasoning•2025

  • Who detects and why

    Nikola Erceg, Zvonimir Galić et al.•Thinking & Reasoning•2023

  • Do task instructions affect argument evaluation when accounting for individual differences in reasoning ability and dispositions

    Open Access•Pinja Marin, Annika M Svedholm‐Häkkinen•Thinking & Reasoning•2026

  • Insight problem solving ability predicts reduced susceptibility to fake news, bullshit, and overclaiming

    Carola Salvi, Nathaniel Barr et al.•Thinking & Reasoning•2023

  • Individual differences in epistemically suspect beliefs

    Jakub Šrol•Thinking & Reasoning•2022

  • Association of natural sleep with moral utilitarianism

    Open Access•Bastien Trémolière, Corentin J Gosling•Psychonomic Bulletin & Review•2021

  • How syntax promotes stereotypes

    Open Access•Khiela J Holmes, Sarah H Wu et al.•Psychonomic Bulletin & Review•2026

  • Revising the core knowledge confusions scale

    Open Access•Brenton M Williams, Matthew Browne et al.•Current Psychology•2024

  • Presence or absence of Dunning-Kruger effect

    Open Access•Kezia Iris Christopher, P Padmakumari et al.•Current Psychology•2023

  • Does reflection increase accuracy rather than bias in the assessments of political fake news

    Open Access•Fatih Bayrak, İnci Boyacıoğlu et al.•Current Psychology•2025

  • Validation of the moral foundations questionnaire-2 in the Turkish context

    Open Access•Burak Doğruyol, İlayda Velioglu et al.•Current Psychology•2024

  • Effects of perceptual load on eyewitness memory are moderated by individual differences in cognitive ability

    Ciara M Greene, Ruth Maloney-Derham et al.•Memory•2020

  • Misremembering Brexit

    Ciara M Greene, Robert A Nash et al.•Memory•2021

  • What does the CRT measure? Poor performance may arise from rational processes

    Open Access•N Levy•Philosophical Psychology•2023

  • Individual Differences in Argument Strength Discrimination

    Open Access•Annika M Svedholm‐Häkkinen, Mika Hietanen et al.•Argumentation•2024

  • Strategies to combat misinformation

    Open Access•Gabor Orosz, Ladislas Farago et al.•Computers in Human Behavior•2024

  • Relationships between critical thinking dispositions and evaluation of videos with variation in the level of expertise of the source among middle and high school students

    Open Access•Brivael Hémon, Kévin De Checchi et al.•Computers & Education•2025

  • Emotion may predict susceptibility to fake news but emotion regulation does not seem to help

    Bence Bago, Leah R Rosenzweig et al.•Cognition & Emotion•2022

  • Does reflection reduce the epistemic side‐effect effect? A new challenge to error accounts

    Open Access•Bartosz Maćkiewicz, Katarzyna Kuś et al.•Mind & Language•2026

  • Moral rationalism on the brain

    Open Access•Joshua May•Mind & Language•2023

  • “And the Next Thing You Know . . .”

    Open Access•Rajen A Anderson, Daan Scheepers et al.•Personality and Social Psychology…•2025

  • Who Falls for Misinformation and Why

    Open Access•Tyler J Hubeny, Lea S Nahon et al.•Personality and Social Psychology…•2026

  • Overconfidently Conspiratorial

    Open Access•Gordon Pennycook, Jabin Binnendyk et al.•Personality and Social Psychology…•2026

  • Spirituality of Science

    Open Access•Jesse L Preston, Thomas J Coleman et al.•Personality and Social Psychology…•2025

  • A Comprehensive Analysis of Psychological Determinants of Socio-Demographic Variability in Superstition Endorsement

    Open Access•Avner Caspi, Ido Liviatan et al.•Personality and Social Psychology…•2025

  • On the Disposition to Think Analytically

    Open Access•Christie Newton, Justin R Feeney et al.•Personality and Social Psychology…•2024

  • Beliefs About Covid-19 in Canada, the United Kingdom, and the United States

    Open Access•Gordon Pennycook, Jonathon Mcphetres et al.•Personality and Social Psychology…•2022

  • What drives voter turnout? Experimental insights on collectivism and probability weighting

    Open Access•Marco Faravelli, Benedict Gordon et al.•Theory and Decision•2026

  • The duality of poverty

    Open Access•Felipe González-Arango, J Corredor et al.•Theory and Decision•2022

  • Blinded by worries

    Open Access•Sergiu Burlacu, Austeja Kazemekaityte et al.•Theory and Decision•2022

  • Latent Profile Analysis of Generic Conspiracy Beliefs‐ Differences in Science Acceptance, Analytical and Intuitive Thinking

    Open Access•Peter Karlsson, Torbjörn Josefsson et al.•Scandinavian Journal of Psychology•2026

  • A Short Measure of the Big Five Aspects

    Christopher M Gallagher, Brent A Stevenor et al.•Journal of Personality Assessment•2023

  • From bias to sound intuiting

    Open Access•Esther Boissin, Serge Caparo et al.•Cognition•2021

  • Reasoning strategy vs cognitive capacity as predictors of individual differences in reasoning performance

    Open Access•Valerie A Thompson, Henry Markovits•Cognition•2021

  • Explanations in the wild

    Open Access•Justin Sulik, Jeroen Van Paridon et al.•Cognition•2023

  • The puzzle of wrongless harms

    Open Access•Edward B Royzman, Samuel H Borislow•Cognition•2022

  • On the role of analytic thinking in religious belief change

    Open Access•Michael N Stagnaro, Gordon Pennycook•Cognition•2025

  • Applying process dissociation to self-sacrificial moral dilemmas

    Open Access•David Simpson, Kyle Nash•Cognition•2024

  • Bayesian or biased? Analytic thinking and political belief updating

    Open Access•Ben M Tappin, Henny Herawati et al.•Cognition•2020

  • Thinking more or thinking differently? Using drift-diffusion modeling to illuminate why accuracy prompts decrease misinformation sharing

    Open Access•Hause Lin, Gordon Pennycook et al.•Cognition•2023

  • Untangling Decision Routes in Moral Dilemmas

    Albert Barque-Duran, Emmanuel M Pothos•The American Journal of Psychology•2021

  • Higher math anxious people have a lower need for cognition and are less reflective in their thinking

    Open Access•Erin A Maloney, Fraulein Retanal•Acta Psychologica•2020

  • Does cognitive reflection predict attentional control in visual tasks

    Open Access•Alessia Dorigoni, Jason Rajsic et al.•Acta Psychologica•2022

  • “You're wrong!”

    Open Access•Eva M Janssen, Matthieu Raoelison et al.•Acta Psychologica•2020

  • A Pandemic of Misbelief

    Open Access•Joseph A Vitriol, Jessecae K Marsh•Frontiers in Political Science•2021

  • Motivated numeracy and active reasoning in a Western European sample

    Open Access•Paul Connor, Emily Sullivan et al.•Behavioural Public Policy•2020

  • Cognitive Drivers of Misinformation Belief and Sharing on Social Media

    Open Access•Michael Chan, C Vaccari et al.•Mass Communication & Society•2025

  • Exposure to Higher Rates of False News Erodes Media Trust and Fuels Overconfidence

    Open Access•Sacha Altay, Benjamin Lyons et al.•Mass Communication & Society•2024

  • Addressing racial misinformation at school

    Open Access•Francesca D’errico, Paolo Giovanni Cicirelli et al.•Social Psychology of Education•2023

  • Profiling adolescents' vulnerability to racial misinformation

    Open Access•Francesca D’errico, Giuseppe Corbelli et al.•Journal of Community & Applied…•2024

  • Religious Unbelief in Three Western European Countries

    Michael Lindeman, Marjaana Lindeman et al.•International Journal for the…•2019

  • Priming critical thinking

    Open Access•Lauren Lutzke, Caitlin Drummond Otten et al.•Global Environmental Change•2019

  • Calibration of scientific reasoning ability

    Open Access•Caitlin Drummond Otten, Baruch Fischhoff•Journal of Behavioral Decision…•2022

  • Anxiety‐induced miscalculations, more than differential inhibition of intuition, explain the gender gap in cognitive reflection

    Open Access•Marie Juanchich, Miroslav Sirota et al.•Journal of Behavioral Decision…•2020

  • Assessing the validity of inferences from scores on the cognitive reflection test

    Open Access•Nikki Blacksmith, Yongwei Yang et al.•Journal of Behavioral Decision…•2019

  • Measuring cognitive reflection without maths

    Open Access•Miroslav Sirota, Chris Dewberry et al.•Journal of Behavioral Decision…•2020

  • Numerical cognitive reflection, but not verbal cognitive reflection, moderates the association between trait anxiety and affective decision‐making

    Open Access•Danfeng Li, Jianming Wang et al.•Journal of Behavioral Decision…•2023

  • The relationship of types of intuition to thinking styles, beliefs, and cognitions

    Open Access•Allyson Dennin, Kayla Furman et al.•Journal of Behavioral Decision…•2022

  • Contribution of rationality to vaccine attitudes

    Open Access•Helena Tomljenović, Andreja Bubic et al.•Journal of Behavioral Decision…•2021

  • Croyances et perceptions sociales liées au refus vaccinal en France

    Laurent Cordonier•The Tocqueville Review/La revue…•2024

  • Exploring the relationship between extramural English, self-efficacy, gender, and learning outcomes

    Open Access•Alison Jones Rød, Raees Calafato•Studies In Educational Evaluation•2023

  • Identifying characteristics associated with higher education teachers’ Cognitive Reflection Test performance and their attitudes towards teaching critical thinking

    Open Access•Eva M Janssen, Wietse Meulendijks et al.•Teaching and Teacher Education•2019

  • Slippery slope thinking links religiosity to punishment

    Open Access•Rajen A Anderson, Benjamin C Ruisch et al.•Journal of Experimental Social…•2025

  • Cooperating with the future through natural resources restoration

    Open Access•Chia‐Chen Chang, Nadiah P Kristensen et al.•Sustainability Science•2021

  • Risk preferences in decision-making

    Open Access•Hwan‐Ho Noh, Hwan-Ho Noh et al.•Acta Psychologica•2024

  • Framing digital inauthenticity

    Open Access•Dawn M Sarno, John Solorio et al.•Acta Psychologica•2025

  • Lazy, not biased

    Open Access•Gordon Pennycook, David Rand et al.•Cognition•2018

  • Political Ideology Predicts Perceptions of the Threat of Covid-19 (and Susceptibility to Fake News About It)

    Open Access•Dustin P Calvillo, Bryan J Ross et al.•Social Psychological and…•2020

  • Fighting Covid-19 Misinformation on Social Media

    Open Access•Gordon Pennycook, Jonathon Mcphetres et al.•Psychological Science•2020

  • The role of epistemic trust and epistemic disruption in vaccine hesitancy, conspiracy thinking and the capacity to identify fake news

    Open Access•Michal Tanzer, S S Settineri et al.•PLOS Global Public Health•2024

  • Disentangling the Two Cognitive Outcomes of Corrective Information

    Taeyoung Lee•Mass Communication & Society•2026

  • Who falls for fake news? The roles of bullshit receptivity, overclaiming, familiarity, and analytic thinking

    Open Access•Gordon Pennycook, David G Rand et al.•Journal of Personality•2020

  • Types of Analytic Thinkers

    Open Access•Annika M Svedholm‐Häkkinen•Journal of Personality•2026

  • The transparency pitfall for AI regulation

    Open Access•Reuben Sass•AI & Society•2026

  • (Dis)Belief in God Among Younger and Older Poles

    Open Access•Paweł Łowicki, Julia Tokarz et al.•Journal for the Scientific Study…•2026

  • Systematic review and meta-analysis of educational approaches to reduce cognitive biases among students

    Open Access•Ghassani Swaryandini, Jessica Graham et al.•Nature Human Behaviour•2025

  • Measuring supernatural belief implicitly using the Affect Misattribution Procedure

    Robert M Ro, Jazmin L Brown-Iannuzzi et al.•Religion Brain & Behavior•2020

  • The Efficient Assessment of Need for Cognition

    John T Cacioppo, Richard E Petty et al.•Journal of Personality Assessment•1984

  • Social heuristics shape intuitive cooperation

    Open Access•David Rand, Alexander Peysakhovich et al.•Nature Communications•2014

  • On the practice of dichotomization of quantitative variables.

    Robert C Maccallum, Shaobo Zhang et al.•Psychological Methods•2002

  • Heuristics and biases as measures of critical thinking

    Richard F West, Maggie E Toplak et al.•Journal of Educational Psychology•2008

  • The average laboratory samples a population of 7,300 Amazon Mechanical Turk workers

    Open Access•Neil Stewart, Christoph Ungemach et al.•Judgment and Decision Making•2015

  • Using Nonnaive Participants Can Reduce Effect Sizes

    Open Access•Joan Chandler, Jesse Chandler et al.•Psychological Science•2015

  • Cognitive abilities and superior decision making under risk

    Open Access•Edward T Cokely, Colleen M Kelley•Judgment and Decision Making•2009

  • The Role of Numeracy in Understanding the Benefit of Screening Mammography

    Open Access•Lisa M Schwartz, Steven Woloshin et al.•Annals of Internal Medicine•1997

  • Assessing miserly information processing

    Maggie E Toplak, Richard F West et al.•Thinking & Reasoning•2014

  • Beyond Comprehension

    Open Access•Ellen Peters•Current Directions in Psychological…•2012

  • Why does the Cognitive Reflection Test (sometimes) predict utilitarian moral judgment (and other things)?

    Open Access•Jonathan Baron, E Scott et al.•Journal of Applied Research in…•2015

  • Negative Consequences of Dichotomizing Continuous Predictor Variables

    Open Access•Julie R Irwin, Gary H Mcclelland•Journal of Marketing Research•2003

  • Self-Discipline Outdoes IQ in Predicting Academic Performance of Adolescents

    Open Access•Angela L Duckworth, Martin E P Seligman•Psychological Science•2005

  • Nonnaïveté among Amazon Mechanical Turk workers

    Open Access•Joan Chandler, Jesse Chandler et al.•Behavior Research Methods•2014

  • Numeracy and Decision Making

    Open Access•Ellen Peters, Daniel Västfjäll et al.•Psychological Science•2006

  • Cognitive abilities and behavioral biases

    Open Access•Jörg Oechssler, Andreas Roider et al.•Journal of Economic Behavior &…•2009

  • Misleading Heuristics and Moderated Multiple Regression Models

    Open Access•Julie R Irwin, Gary H Mcclelland•Journal of Marketing Research•2001

  • General Performance on a Numeracy Scale among Highly Educated Samples

    Open Access•Isaac M Lipkus, Isaac Lipkus et al.•Medical Decision Making•2001

  • Reflection and Reasoning in Moral Judgment

    Open Access•Joseph M Paxton, Leo Ungar et al.•Cognitive Science•2012

  • The Cognitive Reflection Test as a predictor of performance on heuristics-and-biases tasks

    Open Access•Maggie E Toplak, Richard F West et al.•Memory & Cognition•2011

  • Individual Differences in Numeracy and Cognitive Reflection, with Implications for Biases and Fallacies in Probability Judgment

    Open Access•Jordana M Liberali, Valerie F Reyna et al.•Journal of Behavioral Decision…•2011

  • Development and Testing of an Abbreviated Numeracy Scale

    Open Access•Joshua A Weller, Nathan F Dieckmann et al.•Journal of Behavioral Decision…•2012

  • The Development and Testing of a New Version of the Cognitive Reflection Test Applying Item Response Theory (IRT)

    Open Access•Caterina Primi, Kinga Morsanyi et al.•Journal of Behavioral Decision…•2015

  • Decision‐making Competence, Executive Functioning, and General Cognitive Abilities

    Open Access•Fabio Del Missier, Timo Mäntylä et al.•Journal of Behavioral Decision…•2011

  • Rational thinking and cognitive sophistication

    Maggie E Toplak, Richard F West et al.•Developmental Psychology•2014

  • Bivariate median splits and spurious statistical significance

    Scott E Maxwell, Harold D Delaney•Psychological Bulletin•1993

  • Evaluating Online Labor Markets for Experimental Research

    Open Access•Adam J Berinsky, Gregory A Huber et al.•Political Analysis•2012

  • Cognitive-experiential self-theory and subjective probability

    Lee A Kirkpatrick, Seymour Epstein•Journal of Personality and Social…•1992

  • Implicit Theories of Intelligence Predict Achievement Across an Adolescent Transition

    Open Access•Lisa Blackwell, Lisa S Blackwell et al.•Child Development•2007

  • How numeracy influences risk comprehension and medical decision making

    Valerie F Reyna, Wendy L Nelson et al.•Psychological Bulletin•2009

  • Tests for comparing elements of a correlation matrix

    James H Steiger•Psychological Bulletin•1980

  • Cognitive Reflection and Decision Making

    Open Access•Shane Frederick•The Journal of Economic…•2005

Obras citantes distintas130
Citas por año14,44
Intervalo de citas2017 - 2026 (10)
Velocidad de citacióncurrent
Altamente citadoSí
Tipos de citaNeutras: 126
Ethnos_APP • Proyecto Open Source • Licencia MIT • Frontend v2.0.0 • Privacidad y Cookies • Documentación de la API: api.ethnos.app/docs • Código de la API: GitHub • DOI: 10.5281/zenodo.17049435 • Código del Frontend: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae