Benjamin Kelcey
Biographic Data
| ID | 4457381 |
|---|---|
| NAME | Benjamin Kelcey |
| GIVEN NAMES | Benjamin |
| FAMILY NAME | Kelcey |
| SIGNATURE | KELCEY B |
| AFFILIATIONS | University of Cincinnati |
| ORCID | 0000-0002-5083-1406 |
| VERIFIED | Yes |
| TOTAL WORKS | 15 |
| TOTAL CITATIONS | 11 |
| WORKS AS AUTHOR | 15 |
| WORKS AS EDITOR | 0 |
| FIRST PUBLICATION YEAR | 2013 |
| LATEST PUBLICATION YEAR | 2026 |
| H-INDEX | 1 |
Designing an Observation Protocol to Assess Tiered Instruction
Accurately measuring high-leverage practices (e.g., HLP 16: explicit instruction) within multitiered system of support (MTSS) instruction is imperative for assessing the efficacy of teacher efforts designed to improve it, yet intricacies associated with assessing such instruction make it difficult. In response to the need for assessments for this purpose, we modified a researcher-developed observation protocol to measure general and special educa…
Project Coordinate
A practical guide to causal moderation analysis for investigating the role of context, identity, and culture in intervention research
Clarity is Charity in the Advances of Causal Inquiry
This special issue highlights the necessity of rigorous methodologies, transparency, and innovation in social work research. Emphasizing causal inference, the contributions in this volume address replication challenges, design complexities, and data transparency. Key advancements and recommendations we put forth include study preregistration, data sharing, and novel methodologies such as advanced mixed methods considerations, emerging recommendat…
Design and analysis of cluster randomized trials
Hot Versus Cold Debriefing in a Nursing Context
This article has been amended to include factual corrections. An error was identified subsequent to its original publication. This error was acknowledged on page 730, volume 63, issue 11. The online article and its erratum are considered the version of record
Sample Size Planning in the Design of Two-Level Randomized Cost-Effectiveness Trials
This study introduces recent advances in statistical power analysis methods and tools for designing and analyzing randomized cost-effectiveness trials (RCETs) to evaluate the causal effects and costs of social work interventions. The article focuses on two-level designs, where, for example, students are nested within schools, with interventions applied either at the school level (cluster design) or student level (multisite design). We explore thr…
Croon’s Bias-corrected Estimation for Multilevel Structural Equation Models with Latent Interactions
Consideration of moderation effects is important in a range of substantive applications that include nested data and latent variables. A critical limitation in multilevel structural equation models with computationally demanding latent interactions is the poor performance (e.g., convergence failure and biased estimates) of common estimators such as maximum likelihood. To address this issue, we developed extensions to Croon’s bias-corrected estima…
Croon’s Bias-Corrected Estimation for Multilevel Structural Equation Models with Non-Normal Indicators and Model Misspecifications
Multilevel structural equation models (MSEMs) are well suited for educational research because they accommodate complex systems involving latent variables in multilevel settings. Estimation using Croon’s bias-corrected factor score (BCFS) path estimation has recently been extended to MSEMs and demonstrated promise with limited sample sizes. This makes it well suited for planned educational research which often involves sample sizes constrained by…
Identifying and Estimating Causal Moderation for Treated and Targeted Subgroups
Extant literature on moderation effects narrowly focuses on the average moderated treatment effect across the entire sample (AMTE). Missing is the average moderated treatment effect on the treated (AMTT) and other targeted subgroups (AMTS). Much like the average treatment effect on the treated (ATT) for main effects, the AMTS changes the target of inferences from the entire sample to targeted subgroups. Relative to the AMTE, the AMTS is identifie…
Statistical Power for Detecting Moderation in Partially Nested Designs
Analysis of the differential treatment effects across targeted subgroups and contexts is a critical objective in many evaluations because it delineates for whom and under what conditions particular programs, therapies or treatments are effective. Unfortunately, it is unclear how to plan efficient and effective evaluations that include these moderated effects when the design includes partial nesting (i.e., disparate grouping structures across trea…
Croon’s Bias-Corrected Estimation of Latent Interactions
Estimation of structural equation model (SEM) parameters is frequently complicated by the inclusion of latent interactions. A computationally simple sequential estimation approach using corrections for measurement uncertainty has shown promise across several types of SEMs but has yet to be assessed within the context of latent interactions. We develop Croon-based corrections for two-way latent interactions and use simulation studies to provide an…
Academic language and listening comprehension—Two sides of the same coin? An empirical examination of their dimensionality, relations to reading comprehension, and assessment modality
Two widely studied language skills in relation to reading comprehension are listening comprehension skill and academic language proficiency. Although their constituent skills and theoretical accounts of how they are related to reading comprehension share a large overlap, they have been studied in separate lines of work. In this study, we investigated the dimensionality of listening comprehension and academic language proficiency tasks, their rela…
What Can Student Perception Surveys Tell Us About Teaching? Empirically Testing the Underlying Structure of the Tripod Student Perception Survey
We conducted a theory-based analysis of the underlying structure of the Tripod student perception survey instrument using the Measures of Effective Teaching (MET) database ( N = 1,049 middle school math class sections; N = 25,423 students). Multilevel item factor analyses suggested that an alternative bifactor structure best fit the Tripod items, and preliminary evidence suggests that both the general responsivity and the classroom management–spe…
What Would It Take to Change an Inference? Using Rubin’s Causal Model to Interpret the Robustness of Causal Inferences
We contribute to debate about causal inferences in educational research in two ways. First, we quantify how much bias there must be in an estimate to invalidate an inference. Second, we utilize Rubin’s causal model to interpret the bias necessary to invalidate an inference in terms of sample replacement. We apply our analysis to an inference of a positive effect of Open Court Curriculum on reading achievement from a randomized experiment, and an …
What Can Student Perception Surveys Tell Us About Teaching? Empirically Testing the Underlying Structure of the Tripod Student Perception Survey
We conducted a theory-based analysis of the underlying structure of the Tripod student perception survey instrument using the Measures of Effective Teaching (MET) database ( N = 1,049 middle school math class sections; N = 25,423 students). Multilevel item factor analyses suggested that an alternative bifactor structure best fit the Tripod items, and preliminary evidence suggests that both the general responsivity and the classroom management–spe…
Statistical Power for Detecting Moderation in Partially Nested Designs
Analysis of the differential treatment effects across targeted subgroups and contexts is a critical objective in many evaluations because it delineates for whom and under what conditions particular programs, therapies or treatments are effective. Unfortunately, it is unclear how to plan efficient and effective evaluations that include these moderated effects when the design includes partial nesting (i.e., disparate grouping structures across trea…
What Would It Take to Change an Inference? Using Rubin’s Causal Model to Interpret the Robustness of Causal Inferences
We contribute to debate about causal inferences in educational research in two ways. First, we quantify how much bias there must be in an estimate to invalidate an inference. Second, we utilize Rubin’s causal model to interpret the bias necessary to invalidate an inference in terms of sample replacement. We apply our analysis to an inference of a positive effect of Open Court Curriculum on reading achievement from a randomized experiment, and an …
What Can Student Perception Surveys Tell Us About Teaching? Empirically Testing the Underlying Structure of the Tripod Student Perception Survey
We conducted a theory-based analysis of the underlying structure of the Tripod student perception survey instrument using the Measures of Effective Teaching (MET) database ( N = 1,049 middle school math class sections; N = 25,423 students). Multilevel item factor analyses suggested that an alternative bifactor structure best fit the Tripod items, and preliminary evidence suggests that both the general responsivity and the classroom management–spe…
Academic language and listening comprehension—Two sides of the same coin? An empirical examination of their dimensionality, relations to reading comprehension, and assessment modality
Two widely studied language skills in relation to reading comprehension are listening comprehension skill and academic language proficiency. Although their constituent skills and theoretical accounts of how they are related to reading comprehension share a large overlap, they have been studied in separate lines of work. In this study, we investigated the dimensionality of listening comprehension and academic language proficiency tasks, their rela…
Croon’s Bias-Corrected Estimation of Latent Interactions
Estimation of structural equation model (SEM) parameters is frequently complicated by the inclusion of latent interactions. A computationally simple sequential estimation approach using corrections for measurement uncertainty has shown promise across several types of SEMs but has yet to be assessed within the context of latent interactions. We develop Croon-based corrections for two-way latent interactions and use simulation studies to provide an…
Statistical Power for Detecting Moderation in Partially Nested Designs
Analysis of the differential treatment effects across targeted subgroups and contexts is a critical objective in many evaluations because it delineates for whom and under what conditions particular programs, therapies or treatments are effective. Unfortunately, it is unclear how to plan efficient and effective evaluations that include these moderated effects when the design includes partial nesting (i.e., disparate grouping structures across trea…
Croon’s Bias-corrected Estimation for Multilevel Structural Equation Models with Latent Interactions
Consideration of moderation effects is important in a range of substantive applications that include nested data and latent variables. A critical limitation in multilevel structural equation models with computationally demanding latent interactions is the poor performance (e.g., convergence failure and biased estimates) of common estimators such as maximum likelihood. To address this issue, we developed extensions to Croon’s bias-corrected estima…
Croon’s Bias-Corrected Estimation for Multilevel Structural Equation Models with Non-Normal Indicators and Model Misspecifications
Multilevel structural equation models (MSEMs) are well suited for educational research because they accommodate complex systems involving latent variables in multilevel settings. Estimation using Croon’s bias-corrected factor score (BCFS) path estimation has recently been extended to MSEMs and demonstrated promise with limited sample sizes. This makes it well suited for planned educational research which often involves sample sizes constrained by…
Identifying and Estimating Causal Moderation for Treated and Targeted Subgroups
Extant literature on moderation effects narrowly focuses on the average moderated treatment effect across the entire sample (AMTE). Missing is the average moderated treatment effect on the treated (AMTT) and other targeted subgroups (AMTS). Much like the average treatment effect on the treated (ATT) for main effects, the AMTS changes the target of inferences from the entire sample to targeted subgroups. Relative to the AMTE, the AMTS is identifie…
Design and analysis of cluster randomized trials
Hot Versus Cold Debriefing in a Nursing Context
This article has been amended to include factual corrections. An error was identified subsequent to its original publication. This error was acknowledged on page 730, volume 63, issue 11. The online article and its erratum are considered the version of record
Sample Size Planning in the Design of Two-Level Randomized Cost-Effectiveness Trials
This study introduces recent advances in statistical power analysis methods and tools for designing and analyzing randomized cost-effectiveness trials (RCETs) to evaluate the causal effects and costs of social work interventions. The article focuses on two-level designs, where, for example, students are nested within schools, with interventions applied either at the school level (cluster design) or student level (multisite design). We explore thr…
A practical guide to causal moderation analysis for investigating the role of context, identity, and culture in intervention research
Clarity is Charity in the Advances of Causal Inquiry
This special issue highlights the necessity of rigorous methodologies, transparency, and innovation in social work research. Emphasizing causal inference, the contributions in this volume address replication challenges, design complexities, and data transparency. Key advancements and recommendations we put forth include study preregistration, data sharing, and novel methodologies such as advanced mixed methods considerations, emerging recommendat…
Designing an Observation Protocol to Assess Tiered Instruction
Accurately measuring high-leverage practices (e.g., HLP 16: explicit instruction) within multitiered system of support (MTSS) instruction is imperative for assessing the efficacy of teacher efforts designed to improve it, yet intricacies associated with assessing such instruction make it difficult. In response to the need for assessments for this purpose, we modified a researcher-developed observation protocol to measure general and special educa…
Project Coordinate
Psychology (10 works) · Advanced Causal Inference Techniques (8 works) · Mathematics (8 works) · Statistics (8 works) · Computer Science (7 works) · Econometrics (6 works) · Moderation (5 works) · Sample size determination (5 works) · Social Psychology (5 works) · Economics (4 works)