Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

A Bayesian Random Block Item Response Theory Model for Forced-Choice Formats

Bibliographic Data

ID20282909
AuthorsHyeSun Lee (0000-0002-0826-4655, California State University Channel Islands, Camarillo, CA, USA, corresponding author), Weldon Z Smith (California State University Channel Islands, Camarillo, CA, USA)
Year2020
Volume80
Issue3
Pages578-603
Publication date2020-06-01
Peer ReviewedYes
Open AccessYes
TypeARTICLE
VenueEducational and Psychological Measurement (JOURNAL)
Journal identifiersISSN: 0013-1644 • E-ISSN: 1552-3888
PublisherSAGE Publications (PUBLISHER • US)
DOI10.1177/0013164419871659
PMID32425220
OpenAlexW2971330264
LanguageEN
References cited66

Based on the framework of testlet models, the current study suggests the Bayesian random block item response theory (BRB IRT) model to fit forced-choice formats where an item block is composed of three or more items. To account for local dependence among items within a block, the BRB IRT model incorporated a random block effect into the response function and used a Markov Chain Monte Carlo procedure for simultaneous estimation of item and trait parameters. The simulation results demonstrated that the BRB IRT model performed well for the estimation of item and trait parameters and for screening those with relatively low scores on target traits. As found in the literature, the composition of item blocks was crucial for model performance; negatively keyed items were required for item blocks. The empirical application showed the performance of the BRB IRT model was equivalent to that of the Thurstonian IRT model. The potential advantage of the BRB IRT model as a base for more complex measurement models was also demonstrated by incorporating gender as a covariate into the BRB IRT model to explain response probabilities. Recommendations for the adoption of forced-choice formats were provided along with the discussion about using negatively keyed items

Bayesian probability · Block (permutation group theory) · Covariate · Econometrics · Item analysis · Item response theory · Markov chain Monte Carlo · Meta-analysis · Psychometrics · Random effects model · Statistical model · Statistics · Trait · Two-alternative forced choice · Advanced Statistical Modeling Techniques · Cognitive Abilities and Testing · Computer Science · Mathematics · Psychometric Methodologies and Testing

  • Explanatory Item Response Models

    Open Access•Paul De Boeck, Mark Wilson•Explanatory Item Response Models•2004

  • Bayesian Item Response Modeling

    Open Access•Jean-Paul Fox, Jean‐Paul Fox•Bayesian Item Response Modeling•2010

  • A law of comparative judgment.

    L L Thurstone•Psychological Review•1927

  • Rank Analysis of Incomplete Block Designs

    Ralph Allan Bradley, Milton E Terry•Biometrika•1952

  • Local Dependence Indexes for Item Pairs Using Item Response Theory

    Open Access•Wen-Hung Chen, David Thissen•Journal of Educational and…•1997

  • Higher-Order Latent Trait Models for Cognitive Diagnosis

    Open Access•Jimmy de la Torre, Jeffrey A Douglas•Psychometrika•2004

  • Cutoff criteria for fit indexes in covariance structure analysis

    Li‐tze Hu, Peter M Bentler•Structural Equation Modeling: A…•1999

  • Inference from Iterative Simulation Using Multiple Sequences

    Andrew Gelman, Donald B Rubin•Statistical Science•1992

  • On the Statistical and Practical Limitations of Thurstonian IRT Models

    Open Access•Paul-Christian Bürkner, Jennifer Lamb et al.•Educational and Psychological…•2019

  • Comparison of Single-Response Format and Forced-Choice Format Instruments Using Thurstonian Item Response Theory

    Open Access•David Dueber, David M Dueber et al.•Educational and Psychological…•2019

  • Item Response Modeling of Forced-Choice Questionnaires

    Open Access•Anna Brown, Alberto Maydeu-Olivares et al.•Educational and Psychological…•2011

  • Spuriouser and spuriouser

    Open Access•Charles E Johnson, Robert E Wood et al.•Journal of Occupational Psychology•1988

  • The ubiquity of common method variance

    Open Access•Michael D Biderman, Nhung Nguyen et al.•Journal of Research in Personality•2011

  • Modeling Subjective Health Outcomes

    Alberto Maydeu-Olivares, Alberto Maydeu‐olivare et al.•Medical Care•2008

  • Some properties of ipsative, normative, and forced-choice normative measures

    Lou E Hicks•Psychological Bulletin•1970

  • The validity and utility of selection methods in personnel psychology

    Frank L Schmidt, J E Hunter•Psychological Bulletin•1998

Citation velocityhistorical
Highly citedNo

Tools

Open DOISci-HubOpen Access
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae