The Impact of Various Risk Assessment Time Frames on the Performance of Opioid Overdose Forecasting Models

BACKGROUND: An individual's risk for future opioid overdoses is usually assessed using a 12-month "lookback" period. Given the potential urgency of acting rapidly, we compared the performance of alternative predictive models with risk information from the past 3, 6, 9, and 12 months. METHODS: We included 1,014,033 Maryland residents aged 18-80 with at least 1 opioid prescription and no recorded death in 2015. We used 2015 Maryland prescription drug monitoring data to identify risk factors for nonfatal opioid overdoses from hospital discharge records and investigated fatal opioid overdose from medical examiner data in 2016. Prescription drug monitoring program-derived predictors included demographics, payment sources for opioid prescriptions, count of unique opioid prescribers and pharmacies, and quantity and types of opioids and benzodiazepines filled. We estimated a series of logistic regression models that included 3, 6, 9, and 12 months of prescription drug monitoring program data and compared model performance, using bootstrapped C-statistics and associated 95% confidence intervals. RESULTS: For hospital-treated nonfatal overdose, the C-statistic increased from 0.73 for a model including only the fourth quarter to 0.77 for a model with 4 quarters of data. For fatal overdose, the area under the curve increased from 0.80 to 0.83 over the same models. The strongest predictors of overdose were prescription fills for buprenorphine and Medicaid and Medicare as sources of payment. CONCLUSIONS: Models predicting opioid overdose using 1 quarter of data were nearly as accurate as models using all 4 quarters. Models with a single quarter may be more timely and easier to identify persons at risk of an opioid overdose

(+)-Naloxone · Buprenorphine · Drug overdose · Emergency department · Family medicine · Health care · Injury prevention · Logistic regression · Medicaid · Medical examiner · Medical prescription · Opioid · Opioid overdose · Poison control · Prescription drug · Psychiatry · Emergency Medicine · HIV, Drug Use, Sexual Risk · Internal Medicine · Medicine · Opioid Use Disorder Treatment · Pharmacology · Pharmacy · Suicide and Self-Harm Studies

• Bootstrap Methods for Standard Errors, Confidence Intervals, and Other Measures of Statistical Accuracy

  B Efron, R Tibshirani•Statistical Science•1986

  Incluir item

• Increases in Drug and Opioid-Involved Overdose Deaths — United States, 2010–2015

  Open Access•Rose A Rudd, Puja Seth et al.•MMWR. Surveillance Summaries•2016

  Incluir item

• The meaning and use of the area under a receiver operating characteristic (ROC) curve.

  J A Hanley, Barbara J Mcneil•Radiology•1982

  Incluir item

• Evaluating the Impact of Prescription Fill Rates on Risk Stratification Model Performance

  Hsien-Yen Chang, Hsien‐Yen Chang et al.•Medical Care•2017

  Incluir item