Daniel F Mccaffrey
Biographic Data
| ID | 4229596 |
|---|---|
| NAME | Daniel F Mccaffrey |
| GIVEN NAMES | Daniel F |
| FAMILY NAME | Mccaffrey |
| SIGNATURE | MCCAFFREY D F |
| AFFILIATIONS | RAND Corporation |
| ORCID | 0000-0003-1196-5273 |
| VERIFIED | Yes |
| TOTAL WORKS | 25 |
| TOTAL CITATIONS | 43 |
| AUTHOR COUNT | 25 |
| EDITOR COUNT | 0 |
| FIRST PUBLICATION YEAR | 1995 |
| LATEST PUBLICATION YEAR | 2024 |
| H-INDEX | 3 |
A framework for comparing large-scale survey assessments
Large-scale survey assessments (LSAs) are important tools for measuring educational outcomes and shaping policy decisions. We present a framework for comparing LSAs to facilitate studying the impact of design choice on the precision of results, contrasting India’s National Achievement Survey (NAS), the United States’ National Assessment of Educational Progress (NAEP), and the OECD’s Programme for International Student Assessment (PISA). Our frame…
A Tutorial for Propensity Score Weighting for Moderation Analysis With Categorical Variables
OBJECTIVE: To provide step-by-step guidance and STATA and R code for using propensity score (PS) weighting to estimate moderation effects with categorical variables. RESEARCH DESIGN: Tutorial illustrating the key steps for estimating and testing moderation using observational data. Steps include: (1) examining covariate overlap across treatment groups within levels of the moderator; (2) estimating the PS weights; (3) evaluating whether PS weights…
Trends in Classroom Observation Scores
Observations and ratings of classroom teaching and interactions collected over time are susceptible to trends in both the quality of instruction and rater behavior. These trends have potential implications for inferences about teaching and for study design. We use scores on the Classroom Assessment Scoring System–Secondary (CLASS-S) protocol from 458 middle school teachers over a 2-year period to study changes over time in (a) the average quality…
A tutorial on propensity score estimation for multiple treatments using generalized boosted models
The use of propensity scores to control for pretreatment imbalances on observed variables in non‐randomized or observational studies examining the causal effects of treatments or interventions has become widespread over the past decade. For settings with two conditions of interest such as a treatment and a control, inverse probability of treatment weighted estimation with propensity scores estimated via boosted models has been shown in simulation…
Effect of Observation Mode on Measures of Secondary Mathematics Teaching
Classroom observation of teachers is a significant part of educational measurement; measurements of teacher practice are being used in teacher evaluation systems across the country. This research investigated whether observations made live in the classroom and from video recording of the same lessons yielded similar inferences about teaching. Using scores on the Classroom Assessment Scoring System–Secondary (CLASS-S) from 82 algebra classrooms, w…
An Argument Approach to Observation Protocol Validity
This article develops a validity argument approach for use on observation protocols currently used to assess teacher quality for high-stakes personnel and professional development decisions. After defining the teaching quality domain, we articulate an interpretive argument for observation protocols. To illustrate the types of evidence that might compose a validity argument, we draw on data from a validity study of the Classroom Assessment Scoring…
Teacher Effect Estimates and Decision Rules for Establishing Student-Teacher Linkages
Both research and practice of value-added models (VAM) have been growing in recent years due to the widespread effort to quantify teacher effectiveness. The existing VAM literature has not yet tested the sensitivity of value-added estimates to the rules that define which students contribute to each teacher’s value-added estimate. Student-teacher linkages are often a complex network due to various transfers, students taking multiple courses in the…
Use of Expert Ratings as Sampling Strata for a More Cost-Effective Probability Sample of a Rare Population
We consider situations in which externally observable characteristics allow experts to quickly categorize individual households as likely or unlikely to contain a member of a rare target population. This classification can form the basis of disproportionate stratified sampling such that households classified as "unlikely" are sampled at a lower rate than those classified as "likely," thereby reducing screening costs. Design weights account for th…
Multiple trajectories of physical aggression among adolescent boys and girls
Latent growth mixture modeling was used to identify discrete patterns of physical aggression from Grades 7 to 11 among a sample of 1,877 youth. Four trajectory classes adequately explained the development of physical aggression in both boys and girls: Low/No Aggression; Persistent High Aggression; Desisting Aggression, characterized by decreasing risk throughout adolescence; and Adolescent Aggression, characterized by low early risk that increase…
Student Displacement in Louisiana After the Hurricanes of 2005
Focusing on the Louisiana public school system, this report explores the experiences of students displaced by Hurricanes Katrina and Rita: their movements among schools, the durations of enrollments at each site, and time out of school. It also documents the effects of these movements on the state's public education system during the first academic year following the hurricanes, as reported by 415 school principals in survey responses
Challenges in the Evaluation and Implementation of School-Based Prevention and Intervention Programs on Sensitive Topics
The current emphasis on best practices for school-based health and mental health programs brings with it the demand for evaluation efforts in schools. This article describes the challenges of launching a successful school program and evaluation, with lessons learned from three projects that focus on intimate partner violence. The authors discuss issues related to constraints on the research design in schools, the recruitment of schools and partic…
Does alcohol advertising promote adolescent drinking? Results from a longitudinal assessment
Aims To examine the relationship between exposure to different forms of alcohol advertising and subsequent drinking among US adolescents and assess whether exposure to an alcohol and drug prevention program mitigates any such relationship. Design Regression models with multiple control variables examined the relationship between exposure to alcohol advertising in grade 8 and grade 9 drinking for two groups of South Dakotan adolescents: (1) sevent…
Prevalence of Substance Use Among White and American Indian Young Adolescents in a Northern Plains State
This article documents the prevalence of self-reported substance use among White and American Indian adolescents enrolled in seventh grade (ages 12 through 13) in 1997 in a Northern Plains state. Data were collected by self-administered questionnaire preceding adolescents' participation in a randomized field trial of Project Alert, a seventh and eighth grade substance use prevention curriculum. Rates of lifetime and past-month use of cigarettes a…
Models for Value-Added Modeling of Teacher Effects
The use of complex value-added models that attempt to isolate the contributions of teachers or schools to student development is increasing. Several variations on these models are being applied in the research literature, and policy makers have expressed interest in using these models for evaluating teachers and schools. In this article, we present a general multivariate, longitudinal mixed-model that incorporates the complex grouping structures …
Propensity Score Estimation With Boosted Regression for Evaluating Causal Effects in Observational Studies.
Causal effect modeling with naturalistic rather than experimental data is challenging. In observational studies participants in different treatment conditions may also differ on pretreatment characteristics that influence outcomes. Propensity score methods can theoretically eliminate these confounds for all observed covariates, but accurate estimation of propensity scores is impeded by large numbers of covariates, uncertain functional forms for t…
Measurement of Adolescent Drug Use
There is widespread agreement that estimates of adolescent drug use prevalence from the National Household Survey of Drug Abuse (NHSDA) and Monitoring the Future (MTF) are subject to considerable measurement error. Nevertheless, some have suggested that trends over time in these prevalence estimates probably reflect true trends in drug use, since underreporting may be assumed to be constant over time. A recent National Research Council report cri…
New Inroads in Preventing Adolescent Drug Use
Objectives. We evaluated the revised Project ALERT drug prevention program across a wide variety of Midwestern schools and communities. Methods. Fifty-five South Dakota middle schools were randomly assigned to program or control conditions. Treatment group students received 11 lessons in 7th grade and 3 more in 8th grade. Program effects for 4276 8th-graders were assessed 18 months after baseline. Results. The revised Project ALERT curriculum cur…
Social Context and Adolescent Health Behavior
This paper examines the links between individual adolescent smoking behavior and actual and perceived smoking behavior in the individual's school cohort. We hypothesized that students enrolled in schools with higher smoking prevalence among students in their grade are more likely to smoke subsequently. We also expected perceived school-level prevalence of smoking to have a greater impact than actual prevalence because the former is a more direct …
Using State School Accountability Data to Evaluate Federal Programs
Evaluations of federal programs designed to improve student achievement generally depend on data gathered by the states for school accountability purposes, rather than data specifically designed for program evaluation. In addition, these data are available at the school level but not at the student level. This article first discusses issues related to the quality of school-level data collected as part of state accountability systems, including th…
Use of unpaid and paid home care services among people with HIV infection in the USA
This paper examines utilization of paid and unpaid home health care using data from a nationally representative sample of HIV-positive persons receiving medical care in early 1996 (N = 2,864). Overall, 21.0% used any home care, 12.2% used paid care and 13.6% used unpaid care. Most (70.0%) users of home care received care from only one type of provider. Substantially more hours of unpaid than paid care were used. We also found evidence of a strong…
Health-related quality of life in patients with human immunodeficiency virus infection in the United States
Impact of Psychiatric Conditions on Health-Related Quality of Life in Persons With HIV Infection
OBJECTIVE: Little is known about the impact of comorbid psychiatric symptoms in persons with HIV. This study estimates the burden on health-related quality of life associated with comorbid psychiatric conditions in a nationally representative sample of persons with HIV. METHOD: The authors conducted a multistage sampling of urban and rural areas to produce a national probability sample of persons with HIV receiving medical care in the contiguous …
Variations in the Care of HIV-Infected Adults in the United States
The Care of HIV-Infected Adults in the United States
BACKGROUND AND METHODS: In order to elucidate the medical care of patients with human immunodeficiency virus (HIV) infection in the United States, we randomly sampled HIV-infected adults receiving medical care in the contiguous United States at a facility other than military, prison, or emergency department facility during the first two months of 1996. We interviewed 76 percent of 4042 patients selected from among the patients receiving care from…
Describing Dawn's dominion
Social Context and Adolescent Health Behavior
This paper examines the links between individual adolescent smoking behavior and actual and perceived smoking behavior in the individual's school cohort. We hypothesized that students enrolled in schools with higher smoking prevalence among students in their grade are more likely to smoke subsequently. We also expected perceived school-level prevalence of smoking to have a greater impact than actual prevalence because the former is a more direct …
New Inroads in Preventing Adolescent Drug Use
Objectives. We evaluated the revised Project ALERT drug prevention program across a wide variety of Midwestern schools and communities. Methods. Fifty-five South Dakota middle schools were randomly assigned to program or control conditions. Treatment group students received 11 lessons in 7th grade and 3 more in 8th grade. Program effects for 4276 8th-graders were assessed 18 months after baseline. Results. The revised Project ALERT curriculum cur…
Multiple trajectories of physical aggression among adolescent boys and girls
Latent growth mixture modeling was used to identify discrete patterns of physical aggression from Grades 7 to 11 among a sample of 1,877 youth. Four trajectory classes adequately explained the development of physical aggression in both boys and girls: Low/No Aggression; Persistent High Aggression; Desisting Aggression, characterized by decreasing risk throughout adolescence; and Adolescent Aggression, characterized by low early risk that increase…
Challenges in the Evaluation and Implementation of School-Based Prevention and Intervention Programs on Sensitive Topics
The current emphasis on best practices for school-based health and mental health programs brings with it the demand for evaluation efforts in schools. This article describes the challenges of launching a successful school program and evaluation, with lessons learned from three projects that focus on intimate partner violence. The authors discuss issues related to constraints on the research design in schools, the recruitment of schools and partic…
Describing Dawn's dominion
Teacher Effect Estimates and Decision Rules for Establishing Student-Teacher Linkages
Both research and practice of value-added models (VAM) have been growing in recent years due to the widespread effort to quantify teacher effectiveness. The existing VAM literature has not yet tested the sensitivity of value-added estimates to the rules that define which students contribute to each teacher’s value-added estimate. Student-teacher linkages are often a complex network due to various transfers, students taking multiple courses in the…
Using State School Accountability Data to Evaluate Federal Programs
Evaluations of federal programs designed to improve student achievement generally depend on data gathered by the states for school accountability purposes, rather than data specifically designed for program evaluation. In addition, these data are available at the school level but not at the student level. This article first discusses issues related to the quality of school-level data collected as part of state accountability systems, including th…
Describing Dawn's dominion
The Care of HIV-Infected Adults in the United States
BACKGROUND AND METHODS: In order to elucidate the medical care of patients with human immunodeficiency virus (HIV) infection in the United States, we randomly sampled HIV-infected adults receiving medical care in the contiguous United States at a facility other than military, prison, or emergency department facility during the first two months of 1996. We interviewed 76 percent of 4042 patients selected from among the patients receiving care from…
Variations in the Care of HIV-Infected Adults in the United States
Health-related quality of life in patients with human immunodeficiency virus infection in the United States
Impact of Psychiatric Conditions on Health-Related Quality of Life in Persons With HIV Infection
OBJECTIVE: Little is known about the impact of comorbid psychiatric symptoms in persons with HIV. This study estimates the burden on health-related quality of life associated with comorbid psychiatric conditions in a nationally representative sample of persons with HIV. METHOD: The authors conducted a multistage sampling of urban and rural areas to produce a national probability sample of persons with HIV receiving medical care in the contiguous …
Use of unpaid and paid home care services among people with HIV infection in the USA
This paper examines utilization of paid and unpaid home health care using data from a nationally representative sample of HIV-positive persons receiving medical care in early 1996 (N = 2,864). Overall, 21.0% used any home care, 12.2% used paid care and 13.6% used unpaid care. Most (70.0%) users of home care received care from only one type of provider. Substantially more hours of unpaid than paid care were used. We also found evidence of a strong…
Using State School Accountability Data to Evaluate Federal Programs
Evaluations of federal programs designed to improve student achievement generally depend on data gathered by the states for school accountability purposes, rather than data specifically designed for program evaluation. In addition, these data are available at the school level but not at the student level. This article first discusses issues related to the quality of school-level data collected as part of state accountability systems, including th…
Measurement of Adolescent Drug Use
There is widespread agreement that estimates of adolescent drug use prevalence from the National Household Survey of Drug Abuse (NHSDA) and Monitoring the Future (MTF) are subject to considerable measurement error. Nevertheless, some have suggested that trends over time in these prevalence estimates probably reflect true trends in drug use, since underreporting may be assumed to be constant over time. A recent National Research Council report cri…
New Inroads in Preventing Adolescent Drug Use
Objectives. We evaluated the revised Project ALERT drug prevention program across a wide variety of Midwestern schools and communities. Methods. Fifty-five South Dakota middle schools were randomly assigned to program or control conditions. Treatment group students received 11 lessons in 7th grade and 3 more in 8th grade. Program effects for 4276 8th-graders were assessed 18 months after baseline. Results. The revised Project ALERT curriculum cur…
Social Context and Adolescent Health Behavior
This paper examines the links between individual adolescent smoking behavior and actual and perceived smoking behavior in the individual's school cohort. We hypothesized that students enrolled in schools with higher smoking prevalence among students in their grade are more likely to smoke subsequently. We also expected perceived school-level prevalence of smoking to have a greater impact than actual prevalence because the former is a more direct …
Models for Value-Added Modeling of Teacher Effects
The use of complex value-added models that attempt to isolate the contributions of teachers or schools to student development is increasing. Several variations on these models are being applied in the research literature, and policy makers have expressed interest in using these models for evaluating teachers and schools. In this article, we present a general multivariate, longitudinal mixed-model that incorporates the complex grouping structures …
Propensity Score Estimation With Boosted Regression for Evaluating Causal Effects in Observational Studies.
Causal effect modeling with naturalistic rather than experimental data is challenging. In observational studies participants in different treatment conditions may also differ on pretreatment characteristics that influence outcomes. Propensity score methods can theoretically eliminate these confounds for all observed covariates, but accurate estimation of propensity scores is impeded by large numbers of covariates, uncertain functional forms for t…
Does alcohol advertising promote adolescent drinking? Results from a longitudinal assessment
Aims To examine the relationship between exposure to different forms of alcohol advertising and subsequent drinking among US adolescents and assess whether exposure to an alcohol and drug prevention program mitigates any such relationship. Design Regression models with multiple control variables examined the relationship between exposure to alcohol advertising in grade 8 and grade 9 drinking for two groups of South Dakotan adolescents: (1) sevent…
Prevalence of Substance Use Among White and American Indian Young Adolescents in a Northern Plains State
This article documents the prevalence of self-reported substance use among White and American Indian adolescents enrolled in seventh grade (ages 12 through 13) in 1997 in a Northern Plains state. Data were collected by self-administered questionnaire preceding adolescents' participation in a randomized field trial of Project Alert, a seventh and eighth grade substance use prevention curriculum. Rates of lifetime and past-month use of cigarettes a…
Challenges in the Evaluation and Implementation of School-Based Prevention and Intervention Programs on Sensitive Topics
The current emphasis on best practices for school-based health and mental health programs brings with it the demand for evaluation efforts in schools. This article describes the challenges of launching a successful school program and evaluation, with lessons learned from three projects that focus on intimate partner violence. The authors discuss issues related to constraints on the research design in schools, the recruitment of schools and partic…
Student Displacement in Louisiana After the Hurricanes of 2005
Focusing on the Louisiana public school system, this report explores the experiences of students displaced by Hurricanes Katrina and Rita: their movements among schools, the durations of enrollments at each site, and time out of school. It also documents the effects of these movements on the state's public education system during the first academic year following the hurricanes, as reported by 415 school principals in survey responses
Multiple trajectories of physical aggression among adolescent boys and girls
Latent growth mixture modeling was used to identify discrete patterns of physical aggression from Grades 7 to 11 among a sample of 1,877 youth. Four trajectory classes adequately explained the development of physical aggression in both boys and girls: Low/No Aggression; Persistent High Aggression; Desisting Aggression, characterized by decreasing risk throughout adolescence; and Adolescent Aggression, characterized by low early risk that increase…
Use of Expert Ratings as Sampling Strata for a More Cost-Effective Probability Sample of a Rare Population
We consider situations in which externally observable characteristics allow experts to quickly categorize individual households as likely or unlikely to contain a member of a rare target population. This classification can form the basis of disproportionate stratified sampling such that households classified as "unlikely" are sampled at a lower rate than those classified as "likely," thereby reducing screening costs. Design weights account for th…
An Argument Approach to Observation Protocol Validity
This article develops a validity argument approach for use on observation protocols currently used to assess teacher quality for high-stakes personnel and professional development decisions. After defining the teaching quality domain, we articulate an interpretive argument for observation protocols. To illustrate the types of evidence that might compose a validity argument, we draw on data from a validity study of the Classroom Assessment Scoring…
Teacher Effect Estimates and Decision Rules for Establishing Student-Teacher Linkages
Both research and practice of value-added models (VAM) have been growing in recent years due to the widespread effort to quantify teacher effectiveness. The existing VAM literature has not yet tested the sensitivity of value-added estimates to the rules that define which students contribute to each teacher’s value-added estimate. Student-teacher linkages are often a complex network due to various transfers, students taking multiple courses in the…
A tutorial on propensity score estimation for multiple treatments using generalized boosted models
The use of propensity scores to control for pretreatment imbalances on observed variables in non‐randomized or observational studies examining the causal effects of treatments or interventions has become widespread over the past decade. For settings with two conditions of interest such as a treatment and a control, inverse probability of treatment weighted estimation with propensity scores estimated via boosted models has been shown in simulation…
Effect of Observation Mode on Measures of Secondary Mathematics Teaching
Classroom observation of teachers is a significant part of educational measurement; measurements of teacher practice are being used in teacher evaluation systems across the country. This research investigated whether observations made live in the classroom and from video recording of the same lessons yielded similar inferences about teaching. Using scores on the Classroom Assessment Scoring System–Secondary (CLASS-S) from 82 algebra classrooms, w…
Trends in Classroom Observation Scores
Observations and ratings of classroom teaching and interactions collected over time are susceptible to trends in both the quality of instruction and rater behavior. These trends have potential implications for inferences about teaching and for study design. We use scores on the Classroom Assessment Scoring System–Secondary (CLASS-S) protocol from 458 middle school teachers over a 2-year period to study changes over time in (a) the average quality…
A Tutorial for Propensity Score Weighting for Moderation Analysis With Categorical Variables
OBJECTIVE: To provide step-by-step guidance and STATA and R code for using propensity score (PS) weighting to estimate moderation effects with categorical variables. RESEARCH DESIGN: Tutorial illustrating the key steps for estimating and testing moderation using observational data. Steps include: (1) examining covariate overlap across treatment groups within levels of the moderator; (2) estimating the PS weights; (3) evaluating whether PS weights…
A framework for comparing large-scale survey assessments
Large-scale survey assessments (LSAs) are important tools for measuring educational outcomes and shaping policy decisions. We present a framework for comparing LSAs to facilitate studying the impact of design choice on the precision of results, contrasting India’s National Achievement Survey (NAS), the United States’ National Assessment of Educational Progress (NAEP), and the OECD’s Programme for International Student Assessment (PISA). Our frame…
Medicine (16 works) · Psychology (15 works) · Mathematics (8 works) · School Choice and Performance (8 works) · Statistics (8 works) · Computer Science (7 works) · Environmental health (6 works) · Mathematics education (6 works) · Psychiatry (6 works) · Demography (5 works)