A Hierarchical Framework for Modeling Speed and Accuracy on Test Items
Bibliographic Data
| ID | 23326804 |
|---|---|
| Authors | Wim J van der Linden (University of Twente, corresponding author) |
| Year | 2007 |
| Volume | 72 |
| Issue | 3 |
| Pages | 287-308 |
| Publication date | 2007-09-01 |
| Peer Reviewed | Yes |
| Open Access | Yes |
| Type | ARTICLE |
| Venue | Psychometrika (JOURNAL) |
| Journal identifiers | ISSN: 0033-3123 • E-ISSN: 1860-0980 |
| Publisher | Cambridge University Press (CUP) (PUBLISHER) |
| DOI | 10.1007/s11336-006-1478-z |
| OpenAlex | W2154372487 |
| Language | EN |
| Citations received | 58 |
| References cited | 23 |
Current modeling of response times on test items has been strongly influenced by the paradigm of experimental reaction-time research in psychology. For instance, some of the models have a parameter structure that was chosen to represent a speed-accuracy tradeoff, while others equate speed directly with response time. Also, several response-time models seem to be unclear as to the level of parametrization they represent. A hierarchical framework for modeling speed and accuracy on test items is presented as an alternative to these models. The framework allows a “plug-and-play approach” with alternative choices of models for the response and response-time distributions as well as the distributions of their parameters. Bayesian treatment of the framework with Markov chain Monte Carlo (MCMC) computation facilitates the approach. Use of the framework is illustrated for the choice of a normal-ogive response model, a lognormal model for the response times, and multivariate normal models for their parameters with Gibbs sampling from the joint posterior distribution.
Bayesian probability · Data mining · Gibbs sampling · Hierarchical database model · Item response theory · Markov chain Monte Carlo · Monte Carlo method · Parametrization (atmospheric modeling) · Psychometrics · Statistics · Artificial Intelligence · Computer Science · Mathematics · Mental Health Research Topics · Psychometric Methodologies and Testing · Statistical Methods and Bayesian Inference
Modeling the dependence between response and response time
Joint cognitive diagnostic modeling for probabilistic attributes incorporating item responses and response times
Joint-cross-loading multimodal cognitive diagnostic modeling incorporating visual fixation counts
Exploring the Role of Response Time in Item Response Theory
Psychometrics
Measuring Cognitive Function and Cognitive Decline With Response Time Data in the National Social Life, Health, and Aging Project
Exploring the Influence of Response Styles on Continuous Scale Assessments
Assessing the Performance of Strategies for Handling Rapid Guessing Responses in Item Response Theory Equating
A Two-Step Method Based on lz* for Identifying Effortful Respondents
Bayesian Mixed Effects Model and Data Visualization for Understanding Item Response Time and Response Order in Open Online Assessment
Exploring Relationships among Test Takers’ Behaviors and Performance Using Response Process Data
Advancing classification methods in computerized testing
A systematic review of the use of log-based process data in computer-based assessments
A Unified Framework for Jointly modelling Response Times and Item Position Effects in Computer-Based Learning Assessments
A Changepoint Rule for Determining Bicluster Retention Cutoffs in Cheating Detection
Faking in High-Stakes Personality Assessments
Conditional Dependencies Between Response Time and Item Discrimination
Misclassification Produced by Rapid-Guessing Identification Methods and Their Suitability Under Various Conditions
Application of Change Point Analysis of Response Time Data to Detect Test Speededness
Identifying Effortful Individuals With Mixture Modeling Response Accuracy and Response Time Simultaneously to Improve Item Parameter Estimation
Modeling Item Revisit Behavior
A Multiprocess Item Response Model for Not-Reached Items due to Time Limits and Quitting
Beta-Binomial Model for Count Data
Changes in the Speed–Ability Relation Through Different Treatments of Rapid Guessing
A Multilevel Mixture IRT Framework for Modeling Response Times as Predictors or Indicators of Response Engagement in IRT Models
Modeling Responses and Response Times in Tests With the Hierarchical Model and the Three-Parameter Lognormal Distribution
Assessing the Speed–Accuracy Tradeoff in Psychological Testing Using Experimental Manipulations
Assessing Preknowledge Cheating via Innovative Measures
On the Reliability and Validity of a Numerical Reasoning Speed Dimension Derived From Response Times Collected in Computerized Testing
Detecting Examinees With Item Preknowledge in Large-Scale Testing Using Extreme Gradient Boosting (XGBoost)
Detecting Differential Item Functioning Using Response Time
A Mixture Proportional Hazards Model With Random Effects for Response Times in Tests
Detecting Preknowledge Cheating via Innovative Measures
A Polytomous Scoring Approach to Handle Not-Reached Items in Low-Stakes Assessments
Fused SDT/IRT Models for Mixed-Format Exams
Equating Oral Reading Fluency Scores
Using Item Scores and Response Times to Detect Item Compromise in Computerized Adaptive Testing
When Nonresponse Mechanisms Change
Estimating Model-Based Oral Reading Fluency
Identifying Ability and Nonability Groups
Using Biclustering to Detect Cheating in Real Time on Mixed-Format Tests
A comparison of standard residual methods and a mixture hierarchical model for detecting non-effortful responses
The multidimensional log-normal response time model
Item order and speededness
Hidden Markov Item Response Theory Models for Responses and Response Times
Minimum Distance Estimation of Multidimensional Diffusion-Based Item Response Theory Models
A Model-Based Approach to the Disentanglement and Differential Treatment of Engaged and Disengaged Item Omissions
On the Latent Structure of Responses and Response Times from Multidimensional Personality Measurement with Ordinal Rating Scales
Joint Modeling of Ability and Differential Speed Using Responses and Response Times
A Bivariate Generalized Linear Item Response Theory Modeling Framework to the Analysis of Responses and Response Times
Using Process Data to Improve Classification Accuracy of Cognitive Diagnosis Model
The Joint Multivariate Modeling of Multiple Mixed Response Sources
A joint modeling framework of responses and response times to assess learning outcomes
Disentangling Different Aspects of Change in Tests with the D-Diffusion Model
A Generalized Diagnostic Classification Modeling Framework Integrating Differential Speediness
A Mixture Response Time Process Model for Aberrant Behaviors and Item Nonresponses
Using Response Times for Joint Modeling of Response and Omission Behavior
Investigation of Preknowledge Cheating via Joint Hierarchical Modeling Patterns of Response Accuracy and Response Time
| Unique citing works | 58 |
|---|---|
| Citations per year | 4,14 |
| Citation span | 2012 - 2026 (15) |
| Citation velocity | current |
| Highly cited | No |
| Citation types | Neutral: 54 |