Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

Assessing Testlet Effect, Impact, Differential Testlet, and Item Functioning Using Cross-Classified Multilevel Measurement Modeling

Bibliographic Data

ID5100783
AuthorsHamdollah Ravand (Vali Asr University of Rafsanjan, corresponding author)
Year2015
Volume5
Issue2
Pages5/2/2158244015585607
Publication date2015-04-01
Peer ReviewedYes
Open AccessYes
TypeARTICLE
VenueSAGE Open (JOURNAL)
Journal identifiersISSN: 2158-2440 • E-ISSN: 2158-2440
PublisherSAGE Publications Inc (PUBLISHER)
DOI10.1177/2158244015585607
OpenAlexW2116053450
LanguageEN
Citations received3
References cited25

The present study used the two-level testlet response model (MMMT-2) to assess impact, differential item functioning (DIF), and differential testlet functioning (DTLF) in a reading comprehension test. The data came from 21,641 applicants into English Masters' programs at Iranian state universities. Testlet effects were estimated, and items and testlets that were functioning differentially for test takers of different genders and majors were identified. Also parameter estimates obtained under MMMT-2 and those obtained under the two-level hierarchical generalized linear model (HGLM-2) were compared. The results indicated that ability estimates obtained under the two models were significantly different at the lower and upper ends of the ability distribution. In addition, it was found that ignoring local item dependence (LID) would result in overestimation of the precision of the ability estimates. As for the difficulty of the items, the estimates obtained under the two models were almost the same, but standard errors were significantly different

Developmental psychology · Differential item functioning · Item response theory · Multilevel model · Psychometrics · Standard error · Statistics · Grit, Self-Efficacy, and Motivation · Mathematics · Psychology · Psychometric Methodologies and Testing

  • Interactions Between Termination Criteria and Ability Estimators in Computerized Adaptive Testing

    Open Access•Xinyu Liu, David J Weiss•Educational and Psychological…•2026

  • Resolving Dimensionality in a Child Assessment Tool

    Open Access•Hope Akaeze, Frank Lawrence et al.•Educational and Psychological…•2023

  • Examination of Testlet Effect in Open-Ended Items

    Open Access•Gülden Kaya Uyanik, Levent Ertuna•SAGE Open•2022

  • Multilevel Analysis

    Joop Hox, Joop J Hox et al.•Multilevel analysis•2010

  • Three Generations of DIF Analyses

    Bruno D Zumbo•Language Assessment Quarterly•2007

  • Effects of Local Item Dependence on the Fit and Equating Performance of the Three-Parameter Logistic Model

    Open Access•Wendy M Yen•Applied Psychological Measurement•1984

  • Scaling Performance Assessments

    Open Access•Wendy M Yen•Journal of Educational Measurement•1993

  • Estimation of Latent Ability Using a Response Pattern of Graded Scores

    Open Access•Fumiko Samejima•Psychometrika•1969

  • Assessing Impact, DIF, and DFF in Accommodated Item Scores

    Open Access•S Natasha Beretvas, Stephanie W Cawthon et al.•Educational and Psychological…•2012

  • Assessment of Differential Item Functioning in Testlet-Based Items Using the Rasch Testlet Model

    Open Access•Wen-Chung Wang, Wen‐chung Wang et al.•Educational and Psychological…•2005

  • Distinguishing Differential Testlet Functioning From Differential Bundle Functioning Using the Multilevel Measurement Model

    Open Access•S Natasha Beretvas, Cindy M Walker•Educational and Psychological…•2012

  • How Reliable are Toefl Scores

    Open Access•Howard Wainer, Robert Lukhele•Educational and Psychological…•1997

  • Assessing the accuracy and consistency of language proficiency classification under competing measurement models

    Open Access•Bo Zhang, Bo Zhang Bo Zhang•Language Testing•2010

  • Examining passage-related local item dependence (LID) and measurement construct using Q3 statistics in an EFL reading comprehension test

    Open Access•Yong-Won Lee, Yong‐Won Lee•Language Testing•2004

Unique citing works3
Citations per year0.75
Citation span2022 - 2026 (5)
Citation velocitycurrent
Highly citedNo
Citation typesNeutral: 3

Tools

Open DOISci-HubOpen Access
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae