Evaluation of a Natural Language Processing Approach to Identify Social Determinants of Health in Electronic Health Records in a Diverse Community Cohort

BACKGROUND: Health care systems in the United States are increasingly interested in measuring and addressing social determinants of health (SDoH). Advances in electronic health record systems and Natural Language Processing (NLP) create a unique opportunity to systematically document patient SDoH from digitized free-text provider notes. METHODS: Patient SDoH status [recorded by Your Current Life Situation (YCLS) Survey] and associated provider notes recorded between March 2017 and June 2020 were extracted (32,261 beneficiaries; 50,722 YCLS surveys; 485,425 provider notes).NLP patterns were generated using a machine learning test statistic (Term Frequency-Inverse Document Frequency). Patterns were developed and assessed in a training, training validation, and final validation dataset (64%, 16%, and 20% of total data, respectively).NLP models analyzed SDoH-specific categories (housing, medical care, and transportation needs) and a combined SDoH metric. Model performance was assessed using sensitivity, specificity, and Cohen κ statistic, assuming the YCLS Survey to be the gold standard. RESULTS: Within the training validation dataset, NLP models showed strong sensitivity and specificity, with moderate agreement with the YCLS Survey (Housing: sensitivity=0.67, specificity=0.89, κ=0.51; Medical care: sensitivity=0.55, specificity=0.73, κ=0.20; Transportation: sensitivity=0.79, specificity=0.87, κ=0.58). Model performance in the training and training validation datasets were comparable.In the final validation dataset, a combined SDoH prediction metric showed sensitivity=0.77, specificity=0.69, κ=0.45. CONCLUSION: This NLP algorithm demonstrated moderate performance in identification of unmet patient social needs. This novel approach may enable improved targeting of interventions, allocation of limited resources and monitoring a health care system's addressing its patients' SDoH needs

Cohort · Cohort study · Health care · Health equity · Health records · Identification (biology) · MEDLINE · Social determinants of health · Chronic Disease Management Strategies · Food Security and Health in Diverse Populations · Health, Environment, Cognitive Aging

• Testing regular expression searches and machine learning models to determine housing instability and low income status from primary care electronic medical record data in Toronto, Ontario

  Open Access•Stephanie Garies, Christopher Meaney et al.•BMC Public Health•2025

  Añadir item

• We Can Do Better — Improving the Health of the American People

  Steven A Schroeder•New England Journal of Medicine•2007

  Añadir item

• Socioeconomic Disparities In Health

  Nancy E Adler, Katherine Newman et al.•Health Affairs•2002

  Añadir item

• Interrater reliability

  Open Access•Marry L McHugh•Biochemia Medica•2012

  Añadir item

• ICD Social Codes

  Jacqueline M Torres, John Lawlor et al.•Medical Care•2017

  Añadir item

• Closing the gap in a generation

  Open Access•Daniel Gama E Colombo•Revista de Direito Sanitário•2010

  Añadir item