Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

Estimation of Regression Coefficients When Some Regressors are not Always Observed

Bibliographic Data

ID23316241
AuthorsJames M Robins (0000-0001-6609-209X, a Harvard School of Public Health , Boston , MA , 02115), Andrea Rotnitzky (0009-0009-7272-6832, a Harvard School of Public Health , Boston , MA , 02115), Lue Ping Zhao (0000-0002-1387-7165, Fred Hutch Cancer Center)
Year1994
Volume89
Issue427
Pages846-866
Publication date1994-09-01
Peer ReviewedYes
Open AccessNo
TypeARTICLE
VenueJournal of the American Statistical Association (JOURNAL)
Journal identifiersISSN: 0162-1459 • E-ISSN: 1537-274X
PublisherInforma UK Limited (PUBLISHER • GB)
DOI10.1080/01621459.1994.10476818
OpenAlexW2039811614
LanguageEN
Citations received142
References cited39

In applied problems it is common to specify a model for the conditional mean of a response given a set of regressors. A subset of the regressors may be missing for some study subjects either by design or happenstance. In this article we propose a new class of semiparametric estimators, based on inverse probability weighted estimating equations, that are consistent for parameter vector α0 of the conditional mean model when the data are missing at random in the sense of Rubin and the missingness probabilities are either known or can be parametrically modeled. We show that the asymptotic variance of the optimal estimator in our class attains the semiparametric variance bound for the model by first showing that our estimation problem is a special case of the general problem of parameter estimation in an arbitrary semiparametric model in which the data are missing at random and the probability of observing complete data is bounded away from 0, and then deriving a representation for the efficient score, the semiparametric variance bound, and the influence function of any regular, asymptotically linear estimator in this more general estimation problem. Because the optimal estimator depends on the unknown probability law generating the data, we propose locally and globally adaptive semiparametric efficient estimators. We compare estimators in our class with previously proposed estimators. We show that each previous estimator is asymptotically equivalent to some, usually inefficient, estimator in our class. This equivalence is a consequence of a proposition stating that every regular asymptotic linear estimator of α0 is asymptotically equivalent to some estimator in our class. We compare various estimators in a small simulation study and offer some practical recommendations.

Asymptotic distribution · Bounded function · Conditional expectation · Consistent estimator · Delta method · Efficient estimator · Estimating equations · Estimator · Minimum-variance unbiased estimator · Missing data · Semiparametric model · Semiparametric regression · Statistics · Advanced Statistical Methods and Models · Applied Mathematics · Mathematics · Statistical Methods and Bayesian Inference · Statistical Methods and Inference

  • The Family Gap in Pay

    Open Access•Ipshita Pal, Jane Waldfogel•RSF The Russell Sage Foundation…•2016

  • Use of Health Services and Unmet Need among Adults of Russian, Somali, and Kurdish Origin in Finland

    Open Access•Katja Çilenti, Shadia Rask et al.•International Journal of…•2021

  • Adjustment for Baseline Covariates to Increase Efficiency in RCTs with Binary Endpoint

    Open Access•Paola Berchialla, Veronica Sciannameo et al.•International Journal of…•2021

  • The prevalence of substance use among Russian, Somali and Kurdish migrants in Finland

    Open Access•Essi Salama, Solja Niemelä et al.•BMC Public Health•2018

  • A Comparison of the Efficacy of Two Interventions to Reduce HIV Risk Behaviors Among Drug Users

    Open Access•Clyde B Mccoy, Victor De Gruttola et al.•AIDS and Behavior•2011

  • Multilevel Calibration Weighting for Survey Data

    Open Access•Eli Ben-Michael, Avi Feller et al.•Political Analysis•2024

  • Prevalence and determinants of smoking in three regions of Saudi Arabia

    Jamal S Jarallah, Khalid Al‐Rubeaan et al.•Tobacco Control•1999

  • Calculating Comparable Statistics From Incomparable Surveys, With an Application to Poverty in India

    Alessandro Tarozzi•Journal of Business and Economic…•2007

  • Basic Methods for Sensitivity Analysis of Biases

    Sander Greenland•International Journal of…•1996

  • The influence of comorbidity and other health measures on dental and medical care use among Medicare beneficiaries 2002

    Open Access•Haiyan Chen, John Moeller et al.•Journal of Public Health Dentistry•2011

  • What Are We Weighting For

    Gary Solon, Steven J Haider et al.•The Journal of Human Resources•2015

  • Bridge to bigpush or backwash? Market integration, reallocation and productivity effects of Jamuna Bridge in Bangladesh

    Open Access•Brian Blankespoor, M Shahe Emran et al.•Journal of Economic Geography•2021

  • Missing data

    Joseph L Schafer, John W Graham et al.•Psychological Methods•2002

  • Missing Data

    Open Access•Roderick J Little, Donald B Rubin•International Encyclopedia of the…•2015

  • Efficient semiparametric estimation of multi-valued treatment effects under ignorability

    Open Access•Matias D Cattaneo•Journal of Econometrics•2010

  • Efficient Semiparametric Estimation of Quantile Treatment Effects

    Open Access•Sergio Firpo•Econometrica•2007

  • Average causal effects from nonrandomized studies

    Joseph L Schafer, Joseph Kang•Psychological Methods•2008

  • Multiple Imputation in Practice

    Nicholas J Horton, Stuart R Lipsitz•The American Statistician•2001

  • Using the outcome for imputation of missing predictor values was preferred

    Open Access•Karel G M Moons, Rogier Donders et al.•Journal of Clinical Epidemiology•2006

  • Estimating Treatment Effects with Causal Forests

    Open Access•Susan Athey, Stefan Wager•Observational Studies•2019

  • Econometric Methods for Program Evaluation

    Alberto Abadie, Matias D Cattaneo•Annual Review of Economics•2018

  • Doubly robust difference-in-differences estimators

    Open Access•Pedro H C Sant’Anna, Jun Zhao et al.•Journal of Econometrics•2020

  • Synthetic Difference-in-Differences

    Dmitry Arkhangelsky, Susan Athey et al.•American Economic Review•2021

  • Weighting Regressions by Propensity Scores

    Open Access•David A Freedman, Richard A Berk•Evaluation Review•2008

  • Multiple imputation

    Open Access•Joseph L Schafer•Statistical Methods in Medical…•1999

  • Doubly Robust Estimation in Missing Data and Causal Inference Models

    Open Access•Heejung Bang, James M Robins•Biometrics•2005

  • Analysis of Semiparametric Regression Models for Repeated Outcomes in the Presence of Missing Data

    James M Robins, Andrea Rotnitzky et al.•Journal of the American…•1995

  • Doubly Robust Estimation of Causal Effects

    Michele Jonsson Funk, Daniel Westreich et al.•American Journal of Epidemiology•2011

  • Maternal Depressive Symptoms and Children's Receipt of Health Care in the First 3 Years of Life

    Cynthia S Minkovitz, Donna M Strobino et al.•PEDIATRICS•2005

  • Labor market returns to an early childhood stimulation intervention in Jamaica

    Open Access•Paul Gertler, James J Heckman et al.•Science•2014

  • Decomposition Methods in Economics

    Nicole M Fortin, Nicole Fortin et al.•Handbook Of Labor Economics•2011

  • Semiparametric Efficiency in Multivariate Regression Models with Missing Data

    James M Robins, Andrea Rotnitzky•Journal of the American…•1995

  • Stratification and weighting via the propensity score in estimation of causal treatment effects

    Open Access•Jared K Lunceford, Jared Lunceford et al.•Statistics in Medicine•2004

  • Covariate Balancing Propensity Score

    Open Access•Katsushi Imai, Kosuke Imai et al.•Journal of the Royal Statistical…•2014

  • Entropy Balancing is Doubly Robust

    Open Access•QINGYUAN ZHAO, Daniel Percival•Journal of Causal Inference•2017

  • The Augmented Synthetic Control Method

    Eli Ben-Michael, Avi Feller et al.•Journal of the American…•2021

  • Demystifying Double Robustness

    Joseph D Y Kang, Joseph L Schafer•Statistical Science•2007

  • A Review of Hot Deck Imputation for Survey Non‐response

    Open Access•Rebecca R Andridge, Roderick J A Little et al.•International Statistical Review•2010

  • Decentralising health management

    Open Access•Yi Wei, Laura Anselmi et al.•Social Science & Medicine•2026

  • The Active Cognitive Training Interventions and the Onset of and Recovery from Suspected Clinical Depression

    Fredric D Wolinsky, Henry W Mahncke et al.•The Journals of Gerontology…•2009

  • Does Cognitive Training Improve Internal Locus of Control Among Older Adults

    Fredric D Wolinsky, Mark W Vander Weg et al.•The Journals of Gerontology…•2009

  • The contribution of travel-related urban zones, cycling and pedestrian networks and green space to commuting physical activity among adults – a cross-sectional population-based study using geographical information systems

    Open Access•Tomi Mäki-Opas, Tomi E Mäki-Opas et al.•BMC Public Health•2016

  • Device-assessed physical activity and sedentary behavior in a community-based cohort of older adults

    Open Access•Dori E Rosenberg, Rod Walker et al.•BMC Public Health•2020

  • Predictors of Adherence in the Women's Health Initiative Calcium and Vitamin D Trial

    Robert L Brunner, R Brunner et al.•Behavioral Medicine•2008

  • Migrants Are Underrepresented in Mental Health and Rehabilitation Services—Survey and Register-Based Findings of Russian, Somali, and Kurdish Origin Adults in Finland

    Open Access•Anu E Castaneda, Katja Çilenti et al.•International Journal of…•2020

  • Childhood school segregation and later life sense of control and physical performance in the African American Health cohort

    Open Access•Fredric D Wolinsky, Elena M Andresen et al.•BMC Public Health•2012

  • The ethnic gap in mobility

    Open Access•Shadia Rask, Päivi Sainio et al.•BMC Public Health•2016

  • Current and historic patterns of chronic disease burden are associated with physical activity and sedentary behavior in older adults

    Open Access•Mikael Anne Greenwood-Hickman, Rod L Walker et al.•BMC Public Health•2025

  • The association between mental health symptoms and mobility limitation among Russian, Somali and Kurdish migrants

    Open Access•Shadia Rask, Anu E Castaneda et al.•BMC Public Health•2015

  • In-person versus remote (mHealth) delivery for a responsive parenting intervention in rural Kenya

    Open Access•Italo Lopez Garcia, Jill Luoto et al.•BMC Public Health•2024

  • Too young for Cannabis? Choice of minimum legal age for legalized non-medical Cannabis in Canada

    Open Access•Hai V Nguyen, Stephen Bornstein et al.•BMC Public Health•2020

  • National and regional perceptions of climate change risk in the United States and the impacts of political orientation

    Open Access•Cara Lawson, Sudarshan Adhikari et al.•International Journal of Disaster…•2026

  • The challenge of making climate adaptation profitable for farmers

    Open Access•Antonio Scognamillo, Nicholas J Sitko et al.•Environment and Development…•2022

  • A Smooth Specification Test for the Propensity Score

    Open Access•Shiyao Huang, Xiaojun Song•Journal of Applied Econometrics•2026

  • Endogeneity and non‐response bias in treatment evaluation – nonparametric identification of causal effects by instruments

    Open Access•Hans Fricke, Markus Frölich et al.•Journal of Applied Econometrics•2020

  • A Joint Test of Unconfoundedness and Common Trends

    Open Access•Martin Huber, Eva‐Maria Oeß•Journal of Applied Econometrics•2026

  • Three-Step Latent Class Analysis with Inverse Propensity Weighting in the Presence of Differential Item Functioning

    Open Access•Felix J Clouth, Steffen Pauw et al.•Structural Equation Modeling: A…•2023

  • Ex-ante and ex-post evaluation of zombie firms arising from the EAS program during the Covid-19 pandemic

    Open Access•Akira Fukuda, Isamu Yamamoto•Japan and the World Economy•2025

  • The pro‐competitive effects of foreign firm entry

    Open Access•Kyung In Hwang•World Economy•2022

  • Estimating Correlations Between Clinical Trial Outcomes Using Generalised Estimating Equations

    Open Access•Yuehao Dai, Andrew W Lo et al.•Oxford Bulletin of Economics and…•2026

  • Effects of sustainable soil fertility management practices on maize income in rural Zambia

    John N Ng’ombe, John N Ng'ombe et al.•Agrekon•2026

  • On the Foundations of the Design-Based Approach

    Open Access•Peter M Aronow, Austin Jang et al.•Political Analysis•2026

  • The mobile money’s poverty-reducing promise

    Open Access•Kimty Seng•World Development Perspectives•2021

  • Estimating and evaluating treatment effect heterogeneity

    Open Access•Li Zheng, Weiwen Yin•Research & Politics•2023

  • Construct validity of the HSCL-25 and SCL-90-Somatization scales among Russian, Somali and Kurdish origin migrants in Finland

    Saija Kuittinen, Regina García Velázquez et al.•International Journal of Culture…•2016

  • Do forest producers benefit from the forest disaster insurance program? Empirical evidence in Fujian Province of China

    Open Access•Yongwu Dai, Hung‐hao Chang et al.•Forest Policy and Economics•2014

  • Occupational feminization, gender, and wages

    Sasiwimon Warunsiri Paweenawat, Lusi Liao•Journal of the Asia Pacific Economy•2023

  • Why they are experiencing long-time commuting

    Open Access•Nixuan Ye, Chao Yang et al.•Journal of Transport Geography•2025

  • Unpacking The Nexus Between Broiler Contract Farming and Its Impact in Ghana

    Open Access•Richard Kwasi Bannor, Yaw Gyekye•European Journal of Development…•2022

  • Labor market sorting and the gender pay gap revisited

    Open Access•Anselm Strittmatter, Conny Wunsch•Journal of Population Economics•2025

  • Bridging the gap

    Open Access•Unai Fischer-Abaigar, Christoph Kern et al.•Government Information Quarterly•2024

  • Does Collaboration Make Any Difference? Linking Collaborative Governance to Environmental Outcomes

    Open Access•Tyler Andrew Scott, Tyler Scott•Journal of Policy Analysis and…•2015

  • Three-Year Measured Weight Change in the African American Health Study

    Open Access•Fredric D Wolinsky, Elena M Andresen et al.•Journal of Aging and Health•2009

  • Structural Change in Rural West Africa

    Arouna Kouandou, Sophie Legras•The Journal of Development Studies•2025

  • Estimating the causal effects of multiple treatments of crop commercialization on multidimensional poverty in observational studies

    Open Access•Anteneh Mulugeta Eyasu, Temesgen Zewotir et al.•Wellbeing Space and Society•2026

  • Perceived neighborhood disorder, racial-ethnic discrimination and leading risk factors for chronic disease among women

    Open Access•Jesse J Plascak, Bernadette C Hohl et al.•SSM - Population Health•2018

  • Disparities in cervical screening participation

    Open Access•Esther E Idehen, Päivikki Koponen et al.•International Journal for Equity…•2018

  • Comparative risk assessment of non-communicable diseases by evacuation scenario– a retrospective study in the 7 years following the Fukushima Daiichi nuclear power plant accident

    Open Access•Shuhei Nomura, Michio Murakami et al.•Global Health Action•2021

  • Dynamic Causal Effects in a Nonlinear World

    Open Access•Michal Kolesár, Mikkel Plagborg-Møller•Journal of Business and Economic…•2025

  • Estimation of Direct and Indirect Quantile Treatment Effects with Double Machine Learning

    Yu-Chin Hsu, Martin Huber et al.•Journal of Business and Economic…•2026

  • Testing Missing at Random Using Instrumental Variables

    Christoph Breunig•Journal of Business and Economic…•2019

  • Estimating Density Ratio of Marginals to Joint

    Open Access•Yukitoshi Matsushita, Taisuke Otsu et al.•Journal of Business and Economic…•2023

  • Imputations for High Missing Rate Data in Covariates Via Semi-supervised Learning Approach

    Wei Lan, Xuerong Chen et al.•Journal of Business and Economic…•2022

  • Efficient Augmented Inverse Probability Weighted Estimation in Missing Data Problems

    Jing Qin, Biao Zhang et al.•Journal of Business and Economic…•2017

  • Selection Bias Adjustment by Functional Transfer Learning via Reproducing Kernel Hilbert Space

    Zhonglei Wang, Xiaojun Mao et al.•Journal of Business and Economic…•2026

  • High-Dimensional Model-Assisted Inference for Local Average Treatment Effects With Instrumental Variables

    Baoluo Sun, Zhiqiang Tan•Journal of Business and Economic…•2022

  • Robust and Efficient Estimation of Potential Outcome Means Under Random Assignment

    Open Access•Akanksha Negi, Jeffrey M Wooldridge•Journal of Business and Economic…•2025

  • Instrument Validity Tests With Causal Forests

    Open Access•Helmut Farbmacher, Raphael Guber et al.•Journal of Business and Economic…•2022

  • Double Machine Learning for Sample Selection Models

    Michela Bia, Martin Huber et al.•Journal of Business and Economic…•2024

  • Regression Analysis with Individual-Specific Patterns of Missing Covariates

    Huazhen Lin, Wei Liu et al.•Journal of Business and Economic…•2021

  • Efficient Estimation of Data Combination Models by the Method of Auxiliary-to-Study Tilting (AST)

    Bryan S Graham, Cristine Campos De Xavier Pinto et al.•Journal of Business and Economic…•2016

  • Optimal Covariate Balancing Conditions in Propensity Score Estimation

    Jianqing Fan, Katsushi Imai et al.•Journal of Business and Economic…•2023

  • From Conditional Quantile Regression to Marginal Quantile Estimation with Applications to Missing Data and Causal Inference

    Huijuan Ma, Jing Qin et al.•Journal of Business and Economic…•2023

  • Missing Endogenous Variables in Conditional Moment Restriction Models

    Open Access•Antonio Cosma, Andreï Victorovitch Kostyrka et al.•Journal of Business and Economic…•2026

  • Semiparametric Estimation of Treatment Effects in Observational Studies with Heterogeneous Partial Interference

    Zhaonan Qu, Ruoxuan Xiong et al.•Journal of Business and Economic…•2026

  • Efficient GMM Estimation with Incomplete Data

    Chris Muris•The Review of Economics and…•2020

  • Genetic Matching for Estimating Causal Effects

    Alexis Diamond, Jasjeet S Sekhon•The Review of Economics and…•2013

  • A Matching Estimator Based on a Bilevel Optimization Problem

    Juan Díaz, Tomás Rau et al.•The Review of Economics and…•2015

  • Evaluating Policies Early in a Pandemic

    Brantly Callaway, Tong Li•The Review of Economics and…•2025

  • New Evidence on the Finite Sample Properties of Propensity Score Reweighting and Matching Estimators

    Matí­as Busso, John Dinardo et al.•The Review of Economics and…•2014

  • Statistical Analysis With Missing Data

    Maureen Lahiff, Roderick J A Little et al.•Journal of the American…•1989

  • Analysis of Semiparametric Regression Models for Repeated Outcomes in the Presence of Missing Data

    James M Robins, Andrea Rotnitzky et al.•Journal of the American…•1995

  • Model-Based Direct Adjustment

    Paul R Rosenbaum•Journal of the American…•1987

  • A Generalization of Sampling Without Replacement from a Finite Universe

    Daniel G Horvitz, Donovan J Thompson•Journal of the American…•1952

  • The Consquences of Adjustment for a Concomitant Variable That Has Been Affected by the Treatment

    Paul R Rosenbaum•Journal of the Royal Statistical…•1984

  • Semiparametric Efficiency in Multivariate Regression Models with Missing Data

    James M Robins, Andrea Rotnitzky•Journal of the American…•1995

  • The Estimation of Choice Probabilities from Choice Based Samples

    Charles F Manski, Steven R Lerman•Econometrica•1977

  • Inference and missing data

    Donald B Rubin•Biometrika•1976

Unique citing works142
Citations per year4,58
Citation span1995 - 2026 (32)
Citation velocitycurrent
Highly citedYes
Citation typesNeutral: 131
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae