What Is Your Estimand? Defining the Target Quantity Connects Statistical Evidence to Theory
Bibliographic Data
| ID | 4522646 |
|---|---|
| Authors | Ian Lundberg (0000-0002-1909-2270, Princeton University), R A Johnson (0000-0003-2475-6622, Dartmouth College), Brandon M Stewart (0000-0002-7657-3089, Princeton University), Brandon Stewart (Princeton University, corresponding author) |
| Year | 2021 |
| Volume | 86 |
| Issue | 3 |
| Pages | 532-565 |
| Publication date | 2021-06-01 |
| Peer Reviewed | Yes |
| Open Access | Yes |
| Type | ARTICLE |
| Venue | American Sociological Review (JOURNAL) |
| Journal identifiers | ISSN: 0003-1224 • E-ISSN: 1939-8271 |
| Publisher | SAGE Publications Inc (PUBLISHER) |
| DOI | 10.1177/00031224211004187 |
| OpenAlex | W3168499785 |
| Language | EN |
| Citations received | 157 |
| References cited | 72 |
We make only one point in this article. Every quantitative study must be able to answer the question: what is your estimand? The estimand is the target quantity-the purpose of the statistical analysis. Much attention is already placed on how to do estimation; a similar degree of care should be given to defining the thing we are estimating. We advocate that authors state the central quantity of each analysis-the theoretical estimand-in precise terms that exist outside of any statistical model. In our framework, researchers do three things: (1) set a theoretical estimand, clearly connecting this quantity to theory; (2) link to an empirical estimand, which is informative about the theoretical estimand under some identification assumptions; and (3) learn from data. Adding precise estimands to research practice expands the space of theoretical questions, clarifies how evidence can speak to those questions, and unlocks new tools for estimation. By grounding all three steps in a precise statement of the target quantity, our framework connects statistical evidence to theory
Epistemology · Operations research · Sociology · Statement (logic · Advanced Causal Inference Techniques · Electoral Systems and Political Participation · Mathematics · Philosophy · Statistical Methods and Bayesian Inference
Teacher Bias, Socioeconomic Inequality, and the Role of Academic Reputations
Assortative Mating, the Division of Labor in Marriage, and Analytic Choices
Why do eligible individuals fail to enrol for social assistance programmes? A systematic narrative review of factors affecting take-up
Statistical Control Requires Causal Justification
That’s a Lot to Process! Pitfalls of Popular Path Models
Explanatory and Causal Methodology in Sociology
Redistricting Reforms Reduce Gerrymandering by Constraining Partisan Actors
Modeling news recommender systems’ conditional effects on selective exposure
Models as Prediction Machines
Quantities of Interest for Interactions and the Pitfalls of Assuming Linear Treatment Effects
Information Diets Are More Diverse in Attention Than in Engagement
Motivation and Personality
Science-related populism
Did Religious Well-Being Benefits Converge or Diverge During the Early Stages of the Covid-19 Pandemic in Germany
We Are Our Memory
Theory and methods of the multiverse
Asking—and answering—causal questions using longitudinal data
Uncertainty in grid data
Good enough? A comparison of different harmonization procedures and their substantive consequences using the example of life satisfaction
The Effects of Occupational Status on Work beyond Pensionable Age
Curriculum standardization, central exams and achievement inequalities in primary education
Polygenic Scores for Plasticity
The Causal Impact of Segregation on a Disparity
Are Occupations “Bundles of Skills”? Identifying Latent Skill Profiles in the Labor Market Using Topic Modeling
Impacts of broadband internet on adolescents’ academic outcomes
(Dis)orderly Bodies
Introduction to structural causal models in science studies
Can equalizing education weaken the link between parental education and cognitive function? Evidence from a non-parametric decomposition analysis
On the robustness of reciprocal associations between personality and religiosity in a German sample
Identification and Sensitivity Analysis for Teacher Bias Designs Based on Administrative Data
Micro–macro analysis of network change
Layers of latency in social networks and their implications for comparative analyses
Formalizing theories of child development
Historical Redlining and Contemporary Racial Disparities in Neighborhood Life Expectancy
Toward New Directions in Human Biology
Health equity through health literacy
Anchor-based minimal important difference values are often sensitive to the distribution of the change score
Control variable selection in applied quantitative sociology
Populist attitudes towards politics and science
Improving the replicability and generalizability of inferences in quantitative communication research
Mom-and-Pop” Landlords and Regulatory Backlash
U.S. Trends in Job Stability by Sex, Race, and Ethnicity from 1996 to 2020
Hunkering Down or Catching Up? No Long-Term Effect of Ethnic Minority Share on Neighborhood Contacts
Does Unprecedented Mass Immigration Fuel Ethnic Discrimination? A Two-Wave Field Experiment in the German Housing Market
Marginal Odds Ratios
Inequality and Total Effect Summary Measures for Nominal and Ordinal Variables
Do Organizational Policies Narrow Gender Inequality? Novel Evidence from Longitudinal Employer–Employee Data
Life-Course Transitions and Political Orientations
Rising Educational Divides in Attitudes
Invalidating Factorial Survey Experiments Using Invalid Comparisons Is Bad Practice
Let Me Just Interrupt You”
What’s in a name? The effect of named entities on topic modelling interpretability
Fear of crime in context
What drives European solidarity? Evidence on identity-based, value-based, and utilitarian explanations
Narrowing inequalities through redistribution. A relational inequality approach to female managers and the gender wage gap
The timing of parental unemployment, insurance and children's education
Reproducibility, replicability, robustness, and generalizability in corpus linguistics
Conceptualizing, Assessing, and Improving the Quality of Digital Behavioral Data
Gütekriterien in der Soziologie
Viele Vorschläge zur Güte
IMF fairness
Using movers to identify close election effects
Upper secondary tracks and student competencies
The effect of transitioning into temporary employment on wages is not negative
Causal Explanation of Cultural Change in Weber’s Footsteps? A Comprehensive Review and Analysis of Current Studies
Digital learning engagement and career transitions across age cohorts
Quantifying theory in politics
Describing and explaining age, period, and cohort trends in Americans’ vocabulary knowledge
Descriptive estimands, causal estimands, and avoiding the jungle of adjusted associations ‘in between’
Modeling and interpretation of personality and individual differences constructs
The Longevity Benefits of Homeownership
Flooding, Sociospatial Risk, and Population Health
The Grandchildren of Immigrants in Western Europe
Socioeconomic Status, Genotype, and the Differential Effects of Parental Separation on Educational Attainment
Points of departure
Do university-educated families lose their edge as education expands? The withering performance and advantage of their children
Neoliberalism in law and society
Causal Inferences from Digital Behavioral Data
A Multidimensional Approach for Measuring Meritocratic Beliefs
The paradox of inequality that isn’t
Assimilation or third-generation disadvantage? Educational and occupational attainment among the grandchildren of immigrants in France
A Machine Learning Approach to Preferential Attachment and Status Advantage in a Hip-Hop Collaboration Network
Covering the long shadow
Revisiting the Mental Health Impact of Covid-19 on Young Adults in the UK
Engaging Populism? The Popularity of European Populist Political Parties on Facebook and Twitter, 2010–2020
Parenthood in Europe
Handle with Care
Directions for improving the policy relevance of inequality research
The Changing Role of Mothers’ Status in Children’s College Completion
Lesekrise? Kulturell kapital og lesepraksiser i småbarnsfamilien
Visualizing Social Theory with Embedded Relational Diagrams
Intersectional Earnings Inequalities in U.S. Public Sector Workplaces and the Great Recession
Socio-emotional Skills and the Socioeconomic Achievement Gap
The Anatomy of Cohort Analysis
Incorporating Machine Learning into Sociological Model-Building
Micro Effects on Macro Structure in Social Networks
Does course-level really matter
The dynamics of housing cost burden among renters in the United States
Identifying culture as cause
Construct validity in cross-cultural, developmental research
Generalized Additive Models
Causal Inference for Statistics, Social, and Biomedical Sciences
Counterfactuals and Causal Inference
Causality
Better Late Than Nothing
Recursive partitioning for heterogeneous causal effects
Instruments, Randomization, and Learning about Development
The Table 2 Fallacy
Estimation and Inference of Heterogeneous Treatment Effects using Random Forests
On the Role of the Propensity Score in Efficient Semiparametric Estimation of Average Treatment Effects
Fixed Effects, Random Effects, and Hybrid Models for Causal Analysis
Measuring the predictability of life outcomes with a scientific mass collaboration
Identification and Estimation of Local Average Treatment Effects
Eddie Murphy and the Dangers of Counterfactual Causal Thinking About Detecting Racial Discrimination
Making It Count
Race and Economic Opportunity in the United States
Causal Effects of Perceived Immutable Characteristics
Stylized Facts in the Social Sciences
Where Is the Schema? Going Beyond the “S” Word in Political Psychology
Understanding and misunderstanding randomized controlled trials
The Family Gap in Pay
Best Practices for Estimating, Interpreting, and Presenting Nonlinear Interaction Effects
Sociological Methodology1
The C-Word
Statistical Models and Shoe Leather
An Empirical Analysis of Racial Differences in Police Use of Force
An Empirical Analysis of Racial Differences in Police Use of Force
An Empirical Analysis of Racial Differences in Police Use of Force
Notes on social measurement
Endogenous Selection Bias
Regression Analysis
Causal Empiricism in Quantitative Research
The causal interpretation of estimated associations in regression models
Compression and Conditional Effects
Race as a Bundle of Sticks
Testing for Interaction in Binary Logit and Probit Models
Implication Analysis
Despair by Association? The Mental Health of Mothers with Children by Recently Incarcerated Fathers
The Paradox of Persistence
Understanding and misunderstanding randomized controlled trials
What Explains Racial/Ethnic Inequality in Job Quality in the Service Sector
Who Benefits Most from College
Permanency and the Educational and Economic Attainment of Former Foster Children in Early Adulthood
The Growing Female Advantage in College Completion
Social and Genetic Pathways in Multigenerational Transmission of Educational Attainment
Sexual Orientation in the Labor Market
Neighborhood Effects in Temporal Perspective
Unpacking the Black Box of Causality
Explaining Causal Findings Without Bias
Administrative Records Mask Racially Biased Policing
Theoretical Foundations and Empirical Evaluations of Partisan Fairness in District-Based Democracies
Demography, Measuring and Modeling Population Processes
Transcending General Linear Reality
Model Uncertainty and Robustness
Interpreting and Understanding Logits, Probits, and Other Nonlinear Probability Models
Machine Learning for Sociology
Replication in Social Science
Logistic Regression
Imprisonment and Labor Market Outcomes
Common Sense and Sociological Explanations
The Mark of a Criminal Record
| Unique citing works | 157 |
|---|---|
| Citations per year | 31,4 |
| Citation span | 2021 - 2026 (6) |
| Citation velocity | current |
| Highly cited | Yes |
| Citation types | Neutral: 154 |