Does Research Design Affect Study Outcomes in Criminal Justice
Bibliographic Data
| ID | 9753241 |
|---|---|
| Authors | David Weisburd (0000-0003-3778-5190, Department of Criminology and Criminal Justice at the University of Maryland and a professor of criminology at the Hebrew University Law School in Jerusalem, corresponding author), CYNTHIA LUM (0000-0002-1919-3987), Cynthia M Lum (Department of Criminology and Criminal Justice at the University of Maryland), Anthony Petrosino (0000-0002-2048-8993, Center for Evaluation, Initiative for Children Program at the American Academy of Arts and Sciences and a research associate at Harvard University) |
| Year | 2001 |
| Volume | 578 |
| Issue | 1 |
| Pages | 50-70 |
| Publication date | 2001-11-01 |
| Peer Reviewed | Yes |
| Open Access | Yes |
| Type | ARTICLE |
| Venue | The Annals of the American Academy of Political and Social Science (JOURNAL) |
| Journal identifiers | ISSN: 0002-7162 • E-ISSN: 1552-3349 |
| Publisher | SAGE Publications (PUBLISHER • US) |
| DOI | 10.1177/0002716201578001004 |
| OpenAlex | W4248503890 |
| Language | EN |
| Citations received | 93 |
| References cited | 26 |
Does the type of research design used in a crime and justice study influence its conclusions? Scholars agree in theory that randomized experimental studies have higher internal validity than do nonrandomized studies. But there is not consensus regarding the costs of using nonrandomized studies in coming to conclusions regarding criminal justice interventions. To examine these issues, the authors look at the relationship between research design and study outcomes in a broad review of research evidence on crime and justice commissioned by the National Institute of Justice. Their findings suggest that design does have a systematic effect on outcomes in criminal justice studies. The weaker a design, indicated by internal validity, the more likely a study is to report a result in favor of treatment and the less likely it is to report a harmful effect of treatment. Even when comparing randomized studies with strong quasi-experimental research designs, systematic and statistically significant differences are observed
Affect (linguistics · Clinical study design · Clinical trial · Criminal justice · Criminology · Economic Justice · Experimental research · External validity · Internal validity · Political science · Psychiatry · Psychological intervention · Randomized controlled trial · Randomized experiment · Research design · Social science · Sociology · AI in cancer detection · Communication · Crime Patterns and Interventions · Criminal Justice and Corrections Analysis · Ethics in Clinical Research · Health Policy Implementation Science · Law · Medicine · Meta-analysis and systematic reviews · Psychology · Social Psychology
Instrumental Variables and the Search for Identification
Partnerships in Policing
The Handbook of Research Synthesis and Meta-Analysis
Effectiveness of school-based programs to reduce bullying
A meta-analytic review of court-mandated batterer intervention programs
Correctional policy for offenders with mental illness
Effectiveness of school‐based programs to reduce bullying perpetration and victimization
The positive effects of cognitive–behavioral programs for offenders
School‐Based Programs to Reduce Bullying and Victimization
The effectiveness of treatment for sexual offenders
The Effect of Youth Diversion Programs on Recidivism
Drawing conclusions about causes from systematic reviews of risk factors
Evaluating the effectiveness of school-bullying prevention programs
Can Policing Disorder Reduce Crime? A Systematic Review and Meta-analysis
Contingency management for treatment of substance use disorders
The Effect of Police Body-Worn Cameras on Use of Force and Citizens’ Complaints Against the Police
Hot spots policing of small geographic areas effects on crime
Hot spots policing and crime reduction
Examining the Effectiveness of School-Bullying Intervention Programs Globally
Does Hot Spots Policing Have Meaningful Impacts on Crime? Findings from An Alternative Approach to Estimating Effect Sizes from Place-Based Program Evaluations
Did Oregon’s tough mandatory sentencing law “measure 11” improve public safety? New evidence about an old debate from a multiple-design, experimental strategy
Questionable Research Practices and Open Science in Quantitative Criminology
The Downstream Effects of Body-worn Cameras
The Process-Based Model of Policing Revisited
Effectiveness of Moral Developmental Interventions for Youth Engaged in Delinquent Behavior
Letting Work What Works—Effectively Preventing Juvenile Delinquency in the Netherlands
Where Should We Intervene, 20 Years Later? Case–Control and Prospective Cohort Designs Provide Similar Answers
Rigorous evaluation research among US police departments
The Diffusion of Computerized Crime Mapping in Policing
What Can Police Do to Reduce Crime, Disorder, and Fear
A Framework for Addressing Violence and Serious Crime
The Effects of Focused Deterrence Strategies on Crime
The Effects of Hot Spots Policing on Crime
Criminogenic Thinking and Personality at Inmates From Romania
The Effectiveness of Correctional Rehabilitation
Evidence‐based juvenile justice programs and practices
The effectiveness of Equip on sociomoral development and recidivism reduction
Towards rational and evidence-based crime policy
An evaluator’s reflections and lessons learned about gang intervention strategies
Design of the “Up2U” domestic abuse perpetrator programme
Evaluating offending behaviour programmes
Diffusing translational criminology
Impact of Swift and Certain Sanctions
Effective Reentry Programs
Focused deterrence can reduce crime
CCTV surveillance for crime prevention
Getting deterrence right
Focused Deterrence Strategies and Crime Control
Promoting Evidence‐Based Practice in Delinquency Prevention at the State Level
Juvenile Transfer and the Specific Deterrence Hypothesis
New Standards for Demonstrating Program Effectiveness
Disorder policing to reduce crime
An Evaluation of Day Reporting Centers for Parolees
Is problem‐oriented policing effective in reducing crime and disorder
And We Wonder Why Criminology Is Sometimes Considered Irrelevant in Real‐World Policy Conversations
Overview of
Overview of
What Works
When "What Works" Never Did
The Impact of Drug Market Pulling Levers Policing on Neighborhood Violence
Testing the reflection assumption
The Need for Experimental Methodology in Intimate Partner Violence
Trends in Methodological Quality in Controlled Trials of Psychological and Social Interventions
Evaluating Federal Social Programs
Presidential address
The Internal and External Validity of the Regression Discontinuity Design
Effects of Child Skills Training in Preventing Antisocial Behavior
Reducing School Bullying
A Half Century of Randomized Experiments on Crime and Justice
Evidence‐based intervention against bullying and cyberbullying
Reassessing the process-based model
The Effects of Hot Spots Policing on Crime
Toward an Evidence-Based Approach to Preventing Crime
Experimental Ethnography
Methodological Quality Standards for Evaluation Research
Those Confounded Moderators in Meta-Analysis
The Use and Usefulness of Criminology, 1751-2005
When can we Conclude that Treatments or Programs “Don’t Work”
Trying to do more Good than Harm in Policy and Practice
Experimental Evidence and Governmental Administration
Effects of Closed-Circuit Television on Crime
What Can Police Do to Reduce Crime, Disorder, and Fear
Parable of Two Agencies, One of Which Randomizes
The internationalisation of cctv surveillance
Measuring the effectiveness of mental health courts
Verdicts or Inventions
The effectiveness of correctional treatment
What works?Evidence-based policy and practice in public services
Meta-Analysis Bias in Location and Selection of Studies
Preventing Crime: What Works, What Doesn't, What's Promising
The efficacy of psychological, educational, and behavioral treatment
What Works
Randomized Experiments on Crime and Justice
The Campbell Collaboration Crime and Justice Group
Statistical methods in psychology journals
What is Evidence-based Education
The Case for Randomized Field Trials in Economic and Policy Research
| Unique citing works | 86 |
|---|---|
| Citations per year | 3,72 |
| Citation span | 2001 - 2026 (26) |
| Citation velocity | current |
| Highly cited | No |
| Citation types | Neutral: 92 |