T D Stanley
Biographic Data
| ID | 360466 |
|---|---|
| NAME | T D Stanley |
| GIVEN NAMES | T D |
| FAMILY NAME | Stanley |
| SIGNATURE | STANLEY T D |
| AFFILIATIONS | Hendrix College |
| ORCID | 0000-0002-3205-1983 |
| VERIFIED | Yes |
| TOTAL WORKS | 18 |
| TOTAL CITATIONS | 96 |
| AUTHOR COUNT | 18 |
| EDITOR COUNT | 0 |
| FIRST PUBLICATION YEAR | 1985 |
| LATEST PUBLICATION YEAR | 2025 |
| H-INDEX | 5 |
Quantitative Political Science Research Is Greatly Underpowered
The social sciences face a replicability crisis. A key determinant of replication success is statistical power. We assess the power of political science research by collating over 16,000 hypothesis tests from about 2,000 articles in 46 areas of the discipline. Under generous assumptions, we show that quantitative research in political science is greatly underpowered: the median analysis has about 10% power, and only about 1 in 10 tests have at le…
No evidence for nudging after adjusting for publication bias
Proceedings of the National Academy of Sciences (PNAS), a peer reviewed journal of the National Academy of Sciences (NAS) - an authoritative source of high-impact, original research that broadly spans the biological, physical, and social sciences.
Rewarding good political behavior: US aid, democracy, and human rights
We investigate whether the allocation of US aid is influenced by a recipient's democracy and human rights record. The analysis is done in two ways. First, a comprehensive meta-analysis of 284 estimates from 58 studies. Studies report a wide range of results, but the meta-analysis concludes that both human rights and democracy are clear motives for giving aid, with democracy being relatively more important. Second, a new primary study of the data …
The Wages of Mothers' Labor: AMeta-RegressionAnalysis
ObjectiveTo estimate the motherhood wage penalty and explain its wide variation across the research literature.BackgroundDetermining the size and understanding the cause of the motherhood wage penalty has important policy implications. If there is no practically significant motherhood wage penalty, then many of the popular explanations for the gender wage gap must be reassessed. If there is a significant motherhood penalty, its cause can help dir…
What meta-analyses reveal about the replicability of psychological research
Can recent failures to replicate psychological research be explained by typical magnitudes of statistical power, bias or heterogeneity? A large survey of 12,065 estimated effect sizes from 200 meta-analyses and nearly 8,000 papers is used to assess these key dimensions of replicability. First, our survey finds that psychological research is, on average, afflicted with low statistical power. The median of median power across these 200 areas of res…
Limitations of PET-Peese and Other Meta-Analysis Methods
A novel meta-regression method, precision-effect test and precision-effect estimate with standard errors (PET-PEESE), predicts and explains recent high-profile failures to replicate in psychology. The central purpose of this article is to identify the limitations of PET-PEESE for application to social/personality psychology. Using typical conditions found in social/personality research, our simulations identify three areas of concern. PET-PEESE p…
The Power of Bias in Economics Research
We investigate two critical dimensions of the credibility of empirical economics research: statistical power and bias. We survey 159 empirical economics literatures that draw upon 64,076 estimates of economic parameters reported in more than 6,700 empirical studies. Half of the research areas have nearly 90% of their results under‐powered. The median statistical power is 18%, or less. A simple weighted average of those reported results that are a…
Meta-regression approximations to reduce publication selection bias: T. D. Stanley and H. Doucouliagos
Publication selection bias is a serious challenge to the integrity of all empirical sciences. We derive meta-regression approximations to reduce this bias. Our approach employs Taylor polynomial approximations to the conditional mean of a truncated distribution. A quadratic approximation without a linear term, precision-effect estimate with standard error (PEESE), is shown to have the smallest bias and mean squared error in most cases and to outp…
Meta‐analysis of Economics Research Reporting Guidelines
Meta‐regression analysis (MRA) can provide objective and comprehensive summaries of economics research. Their use has grown rapidly over the last few decades. To improve transparency and to raise the quality of MRA, the meta‐analysis of economics research‐network (MAER‐Net) has created the below reporting guidelines. Future meta‐analyses in economics will be expected to follow these guidelines or give valid reasons why a meta‐analysis must deviat…
Publication Selection Bias in Minimum‐Wage Research? A Meta‐Regression Analysis
Card and Krueger's meta‐analysis of the employment effects of minimum wages challenged existing theory. Unfortunately, their meta‐analysis confused publication selection with the absence of a genuine empirical effect. We apply recently developed meta‐analysis methods to 64 US minimum‐wage studies and corroborate that Card and Krueger's findings were nevertheless correct. The minimum‐wage effects literature is contaminated by publication selection…
Meta‐Regression Methods for Detecting and Estimating Empirical Effects in the Presence of Publication Selection
This study investigates the small‐sample performance of meta‐regression methods for detecting and estimating genuine empirical effects in research literatures tainted by publication selection. Publication selection exists when editors, reviewers or researchers have a preference for statistically significant results. Meta‐regression methods are found to be robust against publication selection. Even if a literature is dominated by large and unknown…
Measurement, generalization, and publication: Sources of error in benefit transfers and their management
Beyond Publication Bias: Beyond Publication Bias
This review considers several meta-regression and graphical methods that can differentiate genuine empirical effect from publication bias. Publication selection exists when editors, reviewers, or researchers have a preference for statistically significant results. Because all areas of empirical research are susceptible to publication selection, any average or tally of significant/insignificant studies is likely to be biased and potentially mislea…
Wheat From Chaff: Meta-Analysis As Quantitative Literature Review
This paper presents and develops a quantitative method of literature reviewing and evaluating empirical research, meta-regression analysis or MRA. Economics is theory-driven. Yet, we must learn empirically if economics is to advance. MRA offers a more objective statistical method to summarize our empirical knowledge and to explain the wide study-to-study variation in economic research. MRA is used to assess the evidence for Ricardian equivalence,…
Silly bubbles and the insensitivity of rationality testing: An experimental illustration
A Meta-Analysis of the Union-Nonunion Wage Gap
The authors use meta-regression analysis, a new method for synthesizing empirical results reported in the economic literature, to corroborate and extend H. Gregg Lewis's landmark 1986 research on the union-nonunion wage gap. Analyzing 152 observations from 114 studies, they investigate how different model specifications, data sets, and variable definitions can affect the estimates of the wage gap. An important finding is that many adjustments for…
Meta‐regression Analysis: A Quantitative Method of Literature Surveys
Pedagogically, literature reviews are instrumental. They summarize the large literature written on a particular topic, give coherence to the complex, often disparate, views expressed about an issue, and serve as a springboard for new ideas. However, literature surveys rarely establish anything approximating unanimous consensus. Ironically, this is just as true for the empirical economic literature. To harmonize this dissonance, we offer a quantit…
Positive Economics and Its Instrumental Defence
The Power of Bias in Economics Research
We investigate two critical dimensions of the credibility of empirical economics research: statistical power and bias. We survey 159 empirical economics literatures that draw upon 64,076 estimates of economic parameters reported in more than 6,700 empirical studies. Half of the research areas have nearly 90% of their results under‐powered. The median statistical power is 18%, or less. A simple weighted average of those reported results that are a…
What meta-analyses reveal about the replicability of psychological research
Can recent failures to replicate psychological research be explained by typical magnitudes of statistical power, bias or heterogeneity? A large survey of 12,065 estimated effect sizes from 200 meta-analyses and nearly 8,000 papers is used to assess these key dimensions of replicability. First, our survey finds that psychological research is, on average, afflicted with low statistical power. The median of median power across these 200 areas of res…
Quantitative Political Science Research Is Greatly Underpowered
The social sciences face a replicability crisis. A key determinant of replication success is statistical power. We assess the power of political science research by collating over 16,000 hypothesis tests from about 2,000 articles in 46 areas of the discipline. Under generous assumptions, we show that quantitative research in political science is greatly underpowered: the median analysis has about 10% power, and only about 1 in 10 tests have at le…
The Wages of Mothers' Labor: AMeta-RegressionAnalysis
ObjectiveTo estimate the motherhood wage penalty and explain its wide variation across the research literature.BackgroundDetermining the size and understanding the cause of the motherhood wage penalty has important policy implications. If there is no practically significant motherhood wage penalty, then many of the popular explanations for the gender wage gap must be reassessed. If there is a significant motherhood penalty, its cause can help dir…
A Meta-Analysis of the Union-Nonunion Wage Gap
The authors use meta-regression analysis, a new method for synthesizing empirical results reported in the economic literature, to corroborate and extend H. Gregg Lewis's landmark 1986 research on the union-nonunion wage gap. Analyzing 152 observations from 114 studies, they investigate how different model specifications, data sets, and variable definitions can affect the estimates of the wage gap. An important finding is that many adjustments for…
Positive Economics and Its Instrumental Defence
Meta‐regression Analysis: A Quantitative Method of Literature Surveys
Pedagogically, literature reviews are instrumental. They summarize the large literature written on a particular topic, give coherence to the complex, often disparate, views expressed about an issue, and serve as a springboard for new ideas. However, literature surveys rarely establish anything approximating unanimous consensus. Ironically, this is just as true for the empirical economic literature. To harmonize this dissonance, we offer a quantit…
A Meta-Analysis of the Union-Nonunion Wage Gap
The authors use meta-regression analysis, a new method for synthesizing empirical results reported in the economic literature, to corroborate and extend H. Gregg Lewis's landmark 1986 research on the union-nonunion wage gap. Analyzing 152 observations from 114 studies, they investigate how different model specifications, data sets, and variable definitions can affect the estimates of the wage gap. An important finding is that many adjustments for…
Silly bubbles and the insensitivity of rationality testing: An experimental illustration
Wheat From Chaff: Meta-Analysis As Quantitative Literature Review
This paper presents and develops a quantitative method of literature reviewing and evaluating empirical research, meta-regression analysis or MRA. Economics is theory-driven. Yet, we must learn empirically if economics is to advance. MRA offers a more objective statistical method to summarize our empirical knowledge and to explain the wide study-to-study variation in economic research. MRA is used to assess the evidence for Ricardian equivalence,…
Beyond Publication Bias: Beyond Publication Bias
This review considers several meta-regression and graphical methods that can differentiate genuine empirical effect from publication bias. Publication selection exists when editors, reviewers, or researchers have a preference for statistically significant results. Because all areas of empirical research are susceptible to publication selection, any average or tally of significant/insignificant studies is likely to be biased and potentially mislea…
Measurement, generalization, and publication: Sources of error in benefit transfers and their management
Meta‐Regression Methods for Detecting and Estimating Empirical Effects in the Presence of Publication Selection
This study investigates the small‐sample performance of meta‐regression methods for detecting and estimating genuine empirical effects in research literatures tainted by publication selection. Publication selection exists when editors, reviewers or researchers have a preference for statistically significant results. Meta‐regression methods are found to be robust against publication selection. Even if a literature is dominated by large and unknown…
Publication Selection Bias in Minimum‐Wage Research? A Meta‐Regression Analysis
Card and Krueger's meta‐analysis of the employment effects of minimum wages challenged existing theory. Unfortunately, their meta‐analysis confused publication selection with the absence of a genuine empirical effect. We apply recently developed meta‐analysis methods to 64 US minimum‐wage studies and corroborate that Card and Krueger's findings were nevertheless correct. The minimum‐wage effects literature is contaminated by publication selection…
Meta‐analysis of Economics Research Reporting Guidelines
Meta‐regression analysis (MRA) can provide objective and comprehensive summaries of economics research. Their use has grown rapidly over the last few decades. To improve transparency and to raise the quality of MRA, the meta‐analysis of economics research‐network (MAER‐Net) has created the below reporting guidelines. Future meta‐analyses in economics will be expected to follow these guidelines or give valid reasons why a meta‐analysis must deviat…
Meta-regression approximations to reduce publication selection bias: T. D. Stanley and H. Doucouliagos
Publication selection bias is a serious challenge to the integrity of all empirical sciences. We derive meta-regression approximations to reduce this bias. Our approach employs Taylor polynomial approximations to the conditional mean of a truncated distribution. A quadratic approximation without a linear term, precision-effect estimate with standard error (PEESE), is shown to have the smallest bias and mean squared error in most cases and to outp…
Limitations of PET-Peese and Other Meta-Analysis Methods
A novel meta-regression method, precision-effect test and precision-effect estimate with standard errors (PET-PEESE), predicts and explains recent high-profile failures to replicate in psychology. The central purpose of this article is to identify the limitations of PET-PEESE for application to social/personality psychology. Using typical conditions found in social/personality research, our simulations identify three areas of concern. PET-PEESE p…
The Power of Bias in Economics Research
We investigate two critical dimensions of the credibility of empirical economics research: statistical power and bias. We survey 159 empirical economics literatures that draw upon 64,076 estimates of economic parameters reported in more than 6,700 empirical studies. Half of the research areas have nearly 90% of their results under‐powered. The median statistical power is 18%, or less. A simple weighted average of those reported results that are a…
What meta-analyses reveal about the replicability of psychological research
Can recent failures to replicate psychological research be explained by typical magnitudes of statistical power, bias or heterogeneity? A large survey of 12,065 estimated effect sizes from 200 meta-analyses and nearly 8,000 papers is used to assess these key dimensions of replicability. First, our survey finds that psychological research is, on average, afflicted with low statistical power. The median of median power across these 200 areas of res…
The Wages of Mothers' Labor: AMeta-RegressionAnalysis
ObjectiveTo estimate the motherhood wage penalty and explain its wide variation across the research literature.BackgroundDetermining the size and understanding the cause of the motherhood wage penalty has important policy implications. If there is no practically significant motherhood wage penalty, then many of the popular explanations for the gender wage gap must be reassessed. If there is a significant motherhood penalty, its cause can help dir…
No evidence for nudging after adjusting for publication bias
Proceedings of the National Academy of Sciences (PNAS), a peer reviewed journal of the National Academy of Sciences (NAS) - an authoritative source of high-impact, original research that broadly spans the biological, physical, and social sciences.
Rewarding good political behavior: US aid, democracy, and human rights
We investigate whether the allocation of US aid is influenced by a recipient's democracy and human rights record. The analysis is done in two ways. First, a comprehensive meta-analysis of 284 estimates from 58 studies. Studies report a wide range of results, but the meta-analysis concludes that both human rights and democracy are clear motives for giving aid, with democracy being relatively more important. Second, a new primary study of the data …
Quantitative Political Science Research Is Greatly Underpowered
The social sciences face a replicability crisis. A key determinant of replication success is statistical power. We assess the power of political science research by collating over 16,000 hypothesis tests from about 2,000 articles in 46 areas of the discipline. Under generous assumptions, we show that quantitative research in political science is greatly underpowered: the median analysis has about 10% power, and only about 1 in 10 tests have at le…
Econometrics (13 works) · Economics (11 works) · Statistics (10 works) · Mathematics (9 works) · Meta-analysis (9 works) · Meta-regression (8 works) · Computer Science (7 works) · Medicine (5 works) · Meta-analysis and systematic reviews (5 works) · Psychology (5 works)