Joseph A Rios
Biographic Data
| ID | 5741827 |
|---|---|
| NAME | Joseph A Rios |
| GIVEN NAMES | Joseph A |
| FAMILY NAME | Rios |
| SIGNATURE | RIOS J A |
| AFFILIATIONS | University of Minnesota, Minneapolis, MN, USA |
| ORCID | 0000-0002-1004-9946 |
| VERIFIED | Yes |
| TOTAL WORKS | 9 |
| TOTAL CITATIONS | 15 |
| AUTHOR COUNT | 9 |
| EDITOR COUNT | 0 |
| FIRST PUBLICATION YEAR | 2016 |
| LATEST PUBLICATION YEAR | 2025 |
| H-INDEX | 1 |
Is Effort Moderated Scoring Robust to Multidimensional Rapid Guessing
To mitigate the potential damaging consequences of rapid guessing (RG), a form of noneffortful responding, researchers have proposed a number of scoring approaches. The present simulation study examines the robustness of the most popular of these approaches, the unidimensional effort-moderated (EM) scoring procedure, to multidimensional RG (i.e., RG that is linearly related to examinee ability). Specifically, EM scoring is compared with the Holma…
A Comparison of Response Time Threshold Scoring Procedures in Mitigating Bias From Rapid Guessing Behavior
Rapid guessing (RG) is a form of non-effortful responding that is characterized by short response latencies. This construct-irrelevant behavior has been shown in previous research to bias inferences concerning measurement properties and scores. To mitigate these deleterious effects, a number of response time threshold scoring procedures have been proposed, which recode RG responses (e.g., treat them as incorrect or missing, or impute probable val…
A meta-analysis on the predictive validity of English language proficiency assessments for college admissions
For institutions where English is the primary language of instruction, English assessments for admissions such as the Test of English as a Foreign Language (TOEFL) and International English Language Testing System (IELTS) give admissions decision-makers a sense of a student’s skills in academic English. Despite this explicit purpose, these exams have also been used for the practice of predicting academic success. In this study, we meta-analytical…
Investigating strategies to increase general education teachers' adherence to evidence-based social-emotional behavior practices
Assessing the Accuracy of Parameter Estimates in the Presence of Rapid Guessing Misclassifications
The presence of rapid guessing (RG) presents a challenge to practitioners in obtaining accurate estimates of measurement properties and examinee ability. In response to this concern, researchers have utilized response times as a proxy of RG and have attempted to improve parameter estimation accuracy by filtering RG responses using popular scoring approaches, such as the effort-moderated item response theory (EM-IRT) model. However, such an approa…
Is Differential Noneffortful Responding Associated With Type I Error in Measurement Invariance Testing
Low test-taking effort as a validity threat is common when examinees perceive an assessment context to have minimal personal value. Prior research has shown that in such contexts, subgroups may differ in their effort, which raises two concerns when making subgroup mean comparisons. First, it is unclear how differential effort could influence evaluations of scale property equivalence. Second, if attaining full scalar invariance, the degree to whic…
Parameter Estimation Accuracy of the Effort-Moderated Item Response Theory Model Under Multiple Assumption Violations
As low-stakes testing contexts increase, low test-taking effort may serve as a serious validity threat. One common solution to this problem is to identify noneffortful responses and treat them as missing during parameter estimation via the effort-moderated item response theory (EM-IRT) model. Although this model has been shown to outperform traditional IRT models (e.g., two-parameter logistic [2PL]) in parameter estimation under simulated conditi…
Identifying Critical 21st-Century Skills for Workplace Success
This article extends the literature on 21st-century learning skills needed for workplace success by providing an empirical examination of employers’ direct communication to potential employees via job advertisements. Our descriptive analysis of 142,000 job advertisements provides two contributions. First, this is one of the first studies to empirically rank-order skill demand. In doing so, it is clear that oral and written communication, collabor…
Assessing Intercultural Competence in Higher Education
The modern wave of globalization has created a demand for increased intercultural competence ( ICC ) in college graduates who will soon enter the 21st‐century workforce. Despite the wide attention to the concepts and assessment of ICC , few assessments meet the standards for a next‐generation assessment in areas of construct clarity, innovative item types, response processes, and validity evidence. The objectives of this report are to identify cu…
Identifying Critical 21st-Century Skills for Workplace Success
This article extends the literature on 21st-century learning skills needed for workplace success by providing an empirical examination of employers’ direct communication to potential employees via job advertisements. Our descriptive analysis of 142,000 job advertisements provides two contributions. First, this is one of the first studies to empirically rank-order skill demand. In doing so, it is clear that oral and written communication, collabor…
Assessing Intercultural Competence in Higher Education
The modern wave of globalization has created a demand for increased intercultural competence ( ICC ) in college graduates who will soon enter the 21st‐century workforce. Despite the wide attention to the concepts and assessment of ICC , few assessments meet the standards for a next‐generation assessment in areas of construct clarity, innovative item types, response processes, and validity evidence. The objectives of this report are to identify cu…
Identifying Critical 21st-Century Skills for Workplace Success
This article extends the literature on 21st-century learning skills needed for workplace success by providing an empirical examination of employers’ direct communication to potential employees via job advertisements. Our descriptive analysis of 142,000 job advertisements provides two contributions. First, this is one of the first studies to empirically rank-order skill demand. In doing so, it is clear that oral and written communication, collabor…
Is Differential Noneffortful Responding Associated With Type I Error in Measurement Invariance Testing
Low test-taking effort as a validity threat is common when examinees perceive an assessment context to have minimal personal value. Prior research has shown that in such contexts, subgroups may differ in their effort, which raises two concerns when making subgroup mean comparisons. First, it is unclear how differential effort could influence evaluations of scale property equivalence. Second, if attaining full scalar invariance, the degree to whic…
Parameter Estimation Accuracy of the Effort-Moderated Item Response Theory Model Under Multiple Assumption Violations
As low-stakes testing contexts increase, low test-taking effort may serve as a serious validity threat. One common solution to this problem is to identify noneffortful responses and treat them as missing during parameter estimation via the effort-moderated item response theory (EM-IRT) model. Although this model has been shown to outperform traditional IRT models (e.g., two-parameter logistic [2PL]) in parameter estimation under simulated conditi…
Investigating strategies to increase general education teachers' adherence to evidence-based social-emotional behavior practices
Assessing the Accuracy of Parameter Estimates in the Presence of Rapid Guessing Misclassifications
The presence of rapid guessing (RG) presents a challenge to practitioners in obtaining accurate estimates of measurement properties and examinee ability. In response to this concern, researchers have utilized response times as a proxy of RG and have attempted to improve parameter estimation accuracy by filtering RG responses using popular scoring approaches, such as the effort-moderated item response theory (EM-IRT) model. However, such an approa…
A Comparison of Response Time Threshold Scoring Procedures in Mitigating Bias From Rapid Guessing Behavior
Rapid guessing (RG) is a form of non-effortful responding that is characterized by short response latencies. This construct-irrelevant behavior has been shown in previous research to bias inferences concerning measurement properties and scores. To mitigate these deleterious effects, a number of response time threshold scoring procedures have been proposed, which recode RG responses (e.g., treat them as incorrect or missing, or impute probable val…
A meta-analysis on the predictive validity of English language proficiency assessments for college admissions
For institutions where English is the primary language of instruction, English assessments for admissions such as the Test of English as a Foreign Language (TOEFL) and International English Language Testing System (IELTS) give admissions decision-makers a sense of a student’s skills in academic English. Despite this explicit purpose, these exams have also been used for the practice of predicting academic success. In this study, we meta-analytical…
Is Effort Moderated Scoring Robust to Multidimensional Rapid Guessing
To mitigate the potential damaging consequences of rapid guessing (RG), a form of noneffortful responding, researchers have proposed a number of scoring approaches. The present simulation study examines the robustness of the most popular of these approaches, the unidimensional effort-moderated (EM) scoring procedure, to multidimensional RG (i.e., RG that is linearly related to examinee ability). Specifically, EM scoring is compared with the Holma…
Psychology (7 works) · Mathematics (5 works) · Psychometric Methodologies and Testing (5 works) · Statistics (5 works) · Computer Science (4 works) · Econometrics (4 works) · Item response theory (4 works) · Psychometrics (4 works) · Social Psychology (3 works) · Advanced Statistical Modeling Techniques (2 works)