Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

An evaluation of the reliability of probability judgments across response modes and over time

Bibliographic Data

ID12166403
AuthorsKathleen M Whitcomb (University of South Carolina, corresponding author), Dilek Önkal (0000-0003-3544-5934, Bilkent University), Philip G Benson (Rutgers, the State University of New Jersey), P George Benson, Shawn P Curley (0000-0002-1982-5534, University of Minnesota)
Year1993
Volume6
Issue4
Pages283-296
Publication date1993-12-01
Peer ReviewedYes
Open AccessYes
TypeARTICLE
VenueJournal of Behavioral Decision Making (JOURNAL)
Journal identifiersISSN: 0894-3257 • E-ISSN: 1099-0771
PublisherWiley (PUBLISHER • GB)
DOI10.1002/bdm.3960060406
OpenAlexW2024096408
LanguageEN
Citations received3
References cited18

Despite the importance of probability assessment methods in behavioral decision theory and decision analysis, little attention has been directed at evaluating their reliability and validity. In fact, no comprehensive study of reliability has been undertaken. Since reliability is a necessary condition for validity, this oversight is significant. The present study was motivated by that oversight. We investigated the reliability of probability measures derived from three response modes: numerical probabilities, pie diagrams, and odds. Unlike previous studies, the experiment was designed to distinguish systematic deviations in probability judgments, such as those due to experience or practice, from random deviations. It was found that subjects assessed probabilities reliably for all three assessment methods regardless of the reliability measures employed. However, a small but statistically significant decrease over time in the magnitudes of assessed probabilities was observed. This effect was linked to a decrease in subjects overconfidence during the course of the experiment

Econometrics · Logistic regression · Odds · Overconfidence effect · Power (physics · Reliability (semiconductor · Statistics · Behavioral Health and Interventions · Computer Science · Decision-Making and Behavioral Economics · Economic and Environmental Valuation · Mathematics · Psychology · Social Psychology

  • Improved Test–retest Reliability Criteria as Applied to Probability Assessments

    Open Access•Shawn P Curley, James I Golden•Journal of Behavioral Decision…•1996

  • Experimental Tests of Risk Ladders in the Elicitation of Perceived Likelihood

    Open Access•Alexander Persoskie, Julie S Downs•Journal of Behavioral Decision…•2015

  • Decision‐making competence

    Open Access•Andrew M Parker, Baruch Fischhoff•Journal of Behavioral Decision…•2005

  • Estimation of the Reliability of Ratings

    Open Access•Robert L Ebel•Psychometrika•1951

  • Subjective Estimates of Consonant Phoneme Frequencies

    Open Access•John B Carroll, John T Lamendella•Language and Speech•1974

  • Judgmental forecasting

    Open Access•Olaf Helmer•Futures•1988

Unique citing works3
Citations per year0,1
Citation span1996 - 2015 (20)
Citation velocityhistorical
Highly citedNo
Citation typesNeutral: 3

Tools

Open DOISci-Hub
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae