Discrepancies in Ratings of Behavioral Healthcare Interventions Among Evidence-Based Program Resources Websites
Bibliographic Data
| ID | 13775744 |
|---|---|
| Authors | Miranda J Lee-Easton (0000-0002-6664-2159, Western Michigan University, Kalamazoo, MI, USA, corresponding author), Stephen Magura (0000-0002-6319-5330, Western Michigan University, Kalamazoo, MI, USA) |
| Year | 2023 |
| Volume | 60 |
| Pages | 469580231186836-469580231186836 |
| Publication date | 2023-01-01 |
| Open Access | Yes |
| Type | ARTICLE |
| Venue | INQUIRY The Journal of Health Care Organization Provision and Financing (JOURNAL) |
| Journal identifiers | ISSN: 0046-9580 • E-ISSN: 1945-7243 |
| Publisher | SAGE Publishing (PUBLISHER • US) |
| DOI | 10.1177/00469580231186836 |
| PMID | 37462104 |
| OpenAlex | W4384626089 |
| Language | EN |
| Citations received | 1 |
| References cited | 27 |
Decision makers in the behavioral health disciplines could benefit from tools to assist them in identifying and implementing evidence-based interventions. One tool is an evidence-based program resources website (EBPR). Prior studies documented that when multiple EBPRs rate an intervention, they may disagree. Prior research concerning the reason for such conflicts is sparse. The present study examines how EBPRs rate interventions and the sources of disagreement between EBPRs when rating the same intervention. This study hypothesizes that EBPRs may disagree about intervention ratings because they either use different rating paradigms or they use different studies as evidence of intervention effectiveness (or both). This study identified 15 EBPRs for inclusion. One author (M.J.L.E.) coded the EBPRs for which "tiers of evidence" each EBPR used to classify behavioral health interventions and which criteria they used when rating interventions. The author then computed one Jaccard index of similarity for the criteria shared between each pair of EBPRs that co-rated interventions, and one for the studies used by EBPR rating pairs when rating the same program. The authors used a combination of chi-square, correlation, and binary logistic regression analyses to analyze the data. There was a statistically significant negative correlation between the number of Cochrane Risk of Bias criteria shared between 2 EBPRs and the likelihood of those 2 EBPRs agreeing on an intervention rating ( r = -.12, P ≤ .01). There was no relationship between the number of studies evaluated by 2 EBPRs and the likelihood of those EBPRs agreeing on an intervention rating. The major reason for disagreements between EBPRs when rating the same intervention in this study was due to differences in the rating criteria used by the EBPRs. The studies used by the EBPRs to rate programs does not appear to have an impact
Health care · Political science · Psychiatry · Psychological intervention · Applied Psychology · Clinical Psychology · Health Policy Implementation Science · Health Sciences Research and Education · Primary Care and Health Outcomes · Psychology
Assessment of study quality for systematic reviews
Visitors’ Assessment and Utilization of Evidence-Based Program Resources (EBPR) Websites
How do systematic reviews incorporate risk of bias assessments into the synthesis of evidence? A methodological study
Guest Editor’s Introduction to Special Issue
Evidence-based Decision Making
| Citations per year | 1 |
|---|---|
| Citation span | 2025 - 2025 (1) |
| Highly cited | No |