Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

Negative Controls

A Tool for Detecting Confounding and Bias in Observational Studies

Bibliographic Data

ID23317204
AuthorsMarc Lipsitch (0000-0003-1504-9213, Center for Disease Dynamics, Economics & Policy, corresponding author), Eric Tchetgen Tchetgen (Center for Disease Dynamics, Economics & Policy), Ted Cohen (0000-0002-8091-7198, Brigham and Women's Hospital)
Year2010
Volume21
Issue3
Pages383-388
Publication date2010-05-01
Peer ReviewedYes
Open AccessNo
TypeARTICLE
VenueEpidemiology (JOURNAL)
Journal identifiersISSN: 1044-3983 • E-ISSN: 1531-5487
PublisherOvid Technologies (Wolters Kluwer Health) (PUBLISHER)
DOI10.1097/ede.0b013e3181d61eeb
PMID20335814
PMCIDPMC3053408
OpenAlexW2009428399
LanguageEN
Citations received61
References cited15

Noncausal associations between exposures and outcomes are a threat to validity of causal inference in observational studies. Many techniques have been developed for study design and analysis to identify and eliminate such errors. Such problems are not expected to compromise experimental studies, where careful standardization of conditions (for laboratory work) and randomization (for population studies) should, if applied properly, eliminate most such noncausal associations. We argue, however, that a routine precaution taken in the design of biologic laboratory experiments--the use of "negative controls"--is designed to detect both suspected and unsuspected sources of spurious causal inference. In epidemiology, analogous negative controls help to identify and resolve confounding as well as other sources of error, including recall bias or analytic flaws. We distinguish 2 types of negative controls (exposure controls and outcome controls), describe examples of each type from the epidemiologic literature, and identify the conditions for the use of such negative controls to detect confounding. We conclude that negative controls should be more commonly employed in observational studies, and that additional work is needed to specify the conditions under which negative controls will be sensitive detectors of other sources of error in observational studies.

Biology · Causal inference · Clinical study design · Clinical trial · Confounding · Econometrics · Inference · Mendelian randomization · Observational study · Pathology · Population · Spurious relationship · Statistics · Type I and type II errors · Advanced Causal Inference Techniques · Artificial Intelligence · Computer Science · Mathematics · Medicine · Statistical Methods and Bayesian Inference

  • Creating nurturing environments

    Open Access•Pragya Bhuwania, Amy Raub et al.•Global Public Health•2026

  • Association between Exposure to Particulate Matter during Pregnancy and Multidimensional Development in School-Age Children

    Open Access•Paolo Girardi, Silvia Lanfranchi et al.•International Journal of…•2021

  • Modelling estimates of age-specific influenza-related hospitalisation and mortality in the United Kingdom

    Open Access•Gonçalo Matias, Robert J Taylor et al.•BMC Public Health•2016

  • Estimating the short-term effect of PM2.5 on the mortality of cardiovascular diseases based on instrumental variables

    Open Access•Guiming Zhu, Le Zhao et al.•BMC Public Health•2024

  • Maternal pre-pregnancy BMI and early childhood adiposity trajectories

    Open Access•Yuan-Der Huang, Hsiu-Chuan Chen et al.•BMC Public Health•2026

  • The Physical Activity and Redesigned Community Spaces (PARCS) Study

    Open Access•Terry T-K Huang, Terry T K Huang et al.•BMC Public Health•2016

  • Tobacco retailer density and its association with birth outcomes in the USA

    C D Baggett, David B Richardson et al.•Tobacco Control•2024

  • The Effect of India's Total Sanitation Campaign on Defecation Behaviors and Child Health in Rural Madhya Pradesh

    Open Access•Patil, Sumeet R Patil et al.•PLoS Medicine•2014

  • Exposure to Greenness and Mortality in a Nationwide Prospective Cohort Study of Women

    Open Access•Peter James, Jaime E Hart et al.•Environmental Health Perspectives•2016

  • BNT162b2 mRNA Covid-19 Vaccine in a Nationwide Mass Vaccination Setting

    Open Access•Noa Dagan, Noam Barda et al.•New England Journal of Medicine•2021

  • Outcome-Wide Longitudinal Designs for Causal Inference

    Tyler J Vanderweele, Maya B Mathur et al.•Statistical Science•2020

  • State of the Science of Structural Stigma and LGBTQ+ Health

    Open Access•Micah R Lattanner, Sarah Mcketta et al.•Annual Review of Public Health•2025

  • Evaluating the KickAsh!-intervention’s effectiveness in preventing smoking among vulnerable Flemish adolescents

    Open Access•Kenji Leta, Emelien Lauwerier et al.•Health Promotion International•2026

  • Pro-tobacco legislative representation and current smoking

    Open Access•Kenichi Sato, Ippei Takahara et al.•Tobacco Control•2026

  • Demolition Activity and Elevated Blood Lead Levels among Children in Detroit, Michigan, 2014–2018

    Open Access•Carla P Bezold, Carla Bezold et al.•International Journal of…•2020

  • Plasticisers chemical mixture, vitamin status, and mortality in US adults

    Open Access•Yu Zhang, Qi Sun et al.•The Lancet Planetary Health•2025

  • Canadian beach cohort study

    Open Access•Ian Young, Binyam Negussie Desta et al.•BMC Public Health•2024

  • The association of herpes zoster and influenza vaccinations with the risk of developing dementia

    Open Access•Artitaya Lophatananon, Matthew Carr et al.•BMC Public Health•2023

  • The effect of adherence to statin therapy on cardiovascular mortality

    Open Access•Maarten J Bijlsma, Stijn Vansteelandt et al.•BMC Public Health•2016

  • Self-Reported Oil Spill Exposure and Pregnancy Complications

    Open Access•Emily W Harville, Arti Shankar et al.•International Journal of…•2017

  • Gateway Effects

    Open Access•Carl Phillips•International Journal of…•2015

  • Time-sensitive testing pressures and Covid-19 outcomes

    Open Access•Alice R Carter, Gemma Clayton et al.•BMC Public Health•2023

  • Interactions between Ambient Air Particles and Greenness on Cause-specific Mortality in Seven Korean Metropolitan Cities, 2008–2016

    Open Access•Sera Kim, Honghyok Kim et al.•International Journal of…•2019

  • Maternal smoking during pregnancy and offspring risk of intellectual disability

    Open Access•Paul Madley‐Dowd, Paul Madley-Dowd et al.•Frontiers in Psychiatry•2024

  • School suspension predicts trichomoniasis five years later in a matched sample

    Open Access•Janet Rosenbaum•BMC Public Health•2020

  • Comparing the effectiveness of different vaccines in individuals with and without autoimmune diseases

    Open Access•Robin Denz, Heike van de Sand et al.•Frontiers in Public Health•2025

  • Using geospatial models to map zero-dose children

    Open Access•Rohan Arambepola, Yangyupei Yang et al.•BMJ Global Health•2021

  • Do greenness and landscape indices for greenspace correlate with suicide ratio

    Open Access•Hsiao‐Yun Lee, Hsiao-Yun Lee et al.•Landscape and Urban Planning•2024

  • Alternative causal inference methods in population health research

    Open Access•Ellicott C Matthay, Erin Hagan et al.•SSM - Population Health•2020

  • What Can Canada Learn From Accountable Care Organizations

    Open Access•Allie Peckham, David Rudoler et al.•International Journal of…•2022

  • The timing of parental unemployment, insurance and children's education

    Open Access•G Mari, Renske Keizer et al.•European Societies•2023

  • Does comprehensive education reduce health inequalities

    Open Access•Frank Popham, Cristina Iannelli•SSM - Population Health•2021

  • Health Insurance Coverage and Unplanned Births in Rotterdam, the Netherlands

    Open Access•Clair A Enthoven, Jeremy A Labrecque et al.•Perspectives on Sexual and…•2025

  • Evaluating the Mediating Role of Recall of Intervention Knowledge in the Relationship Between a Peer-Driven Intervention and HIV Risk Behaviors Among People Who Inject Drugs

    Open Access•Hilary Aroke, Ashley Buchanan et al.•AIDS and Behavior•2022

  • BNT162b2 Covid-19 vaccination uptake, safety, effectiveness, and waning in children and young people aged 5–11 years in Scotland

    Open Access•Igor Rudan, Steven Kerr et al.•Journal of Global Health•2025

  • Restrictive abortion policy climate is associated with increased depression symptoms among women in the United States

    Open Access•Sarah Mcketta, Catherine Gimbrone et al.•SSM - Mental Health•2026

  • Causal Inference Using Antidotal Variables

    Tirthatanmoy Das, Solomon William Polachek•Journal of Business and Economic…•2026

  • State-Level Regulations Regarding the Protection of Sexual Minorities and Birth Outcomes

    Bethany G Everett, Aubrey Limburg et al.•Psychosomatic Medicine•2022

  • Causal Inference with Unobserved Confounding

    Open Access•Wen Wei Loh•Multivariate Behavioral Research•2025

  • The Effect of Changes in Legal Institutions Weakening Teachers’ Unions on Districts’ Spending on Teacher Compensation

    Eunice S Han, Emma García•American Journal of Education•2024

  • Funding for preventative Children’s Services and rates of children becoming looked after

    Open Access•Davara L Bennett, Calum Jr Webb et al.•Children and Youth Services Review•2021

  • Be(ing) prepared

    Open Access•Chris Dibben, Christopher J Playford et al.•Journal of Epidemiology and…•2017

  • Long Covid and financial outcomes

    Open Access•Rebecca Rhead, Jacques Wels et al.•Journal of Epidemiology and…•2024

  • Impact of cuts to local government spending on Sure Start children’s centres on childhood obesity in England

    Open Access•Kate Mason, Alexandros Alexiou et al.•Journal of Epidemiology and…•2021

  • Association between TV viewing and heart disease mortality

    Mark Hamer, Ding et al.•Journal of Epidemiology and…•2020

  • Layoffs and the mental health and safety of remaining workers

    Holly Stewart, Eli Ben-Michael et al.•Journal of Epidemiology and…•2019

  • Scaling Up a Water, Sanitation, and Hygiene Program in Rural Bangladesh

    Jade Benjamin-Chung, Jade Benjamin‐Chung et al.•American Journal of Public Health•2017

  • Impact of Health Aid Investments on Public Opinion of the United States

    Aleksandra Jakubowski, Don Mai et al.•American Journal of Public Health•2019

  • Acute Gastroenteritis and Recreational Water

    Benjamin F Arnold, Timothy J Wade et al.•American Journal of Public Health•2016

  • Fertility History and Biomarkers Using Prospective Data

    Open Access•M Sironi, George Ploubidis et al.•Demography•2020

  • Specificity of association in epidemiology

    Open Access•Troy Blanchard•Synthese•2022

  • Falsification Tests for Instrumental Variable Designs With an Application to Tendency to Operate

    Luke Keele, QINGYUAN ZHAO et al.•Medical Care•2019

  • Utilization of Positive and Negative Controls to Examine Comorbid Associations in Observational Database Studies

    Open Access•Jigar R Desai, Jigar Desai et al.•Medical Care•2017

  • Placebo Tests for Causal Inference

    Open Access•Andrew C Eggers, Guadalupe Tuñón et al.•American Journal of Political…•2024

  • Association between cesarean section and human capital in adulthood

    Open Access•Mayra Pacheco Fernandes, Natália Peixoto Lima et al.•Cadernos de Saude Publica•2021

  • The impact of housing insecurity on mental health, sleep and hypertension

    Open Access•Kate Mason, Alexandros Alexiou et al.•Social Science & Medicine•2024

  • Long-term risk of psychiatric disorder and psychotropic prescription after Sars-CoV-2 infection among UK general population

    Open Access•Yunhe Wang, Bomin Su et al.•Nature Human Behaviour•2024

  • A research agenda for understanding how social inequality is linked to brain structure and function

    Open Access•Mark L Hatzenbuehler, Katie A Mclaughlin et al.•Nature Human Behaviour•2024

  • Vaccination nudges

    Open Access•Carl Bonander, Mats Ekman et al.•Social Science & Medicine•2022

  • Structural stigma and all-cause mortality among sexual minorities

    Open Access•Mark L Hatzenbuehler, Caroline Rutherford et al.•Social Science & Medicine•2020

  • Impact of Unconscious Race Bias Among Anesthesia Providers on Nonverbal Communication During the Preoperative Anesthesia Consult

    Open Access•Salameh S Obeidat, Shauna Rakshe et al.•Journal of Racial and Ethnic…•2025

  • The Environment and Disease

    Open Access•Austin Bradford Hill•Proceedings of the Royal Society…•1965

  • A Structural Approach to Selection Bias

    Miguel A Hernán, Sonia Hernández-Díaz et al.•Epidemiology•2004

Unique citing works61
Citations per year5,08
Citation span2014 - 2026 (13)
Citation velocitycurrent
Highly citedNo
Citation typesNeutral: 59

Tools

Open DOISci-HubOpen Access
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae