P -hacking and Significance Stars

In mid-2016, all journals of the American Economic Association stopped including significance stars in their regression tables. This policy aimed to reduce the emphasis on statistical significance and shift the focus to the broader economic importance of research findings. This study examines the impact of this change on p-hacking and publication bias. I employ a difference-in-difference design, as well as the battery of tests proposed by Elliott et al. (2022b). I find no statistically significant effect of this policy

Astronomy · Computer security · Hacker · Physics · Stars · Computer Science · Semantic Web and Ontologies · Service-Oriented Architecture and Web Services

• Meta‐Regression Methods for Detecting and Estimating Empirical Effects in the Presence of Publication Selection

  Open Access•T D Stanley•Oxford Bulletin of Economics and…•2008

  Incluir item

• The Difference Between “Significant” and “Not Significant” is not Itself Statistically Significant

  Andrew Gelman, Hal Stern et al.•The American Statistician•2006

  Incluir item

• P -Hacking, Data type and Data-Sharing Policy

  Open Access•Abel Brodeur, Nikolai Cook et al.•The Economic Journal•2024

  Incluir item

• The Power of Bias in Economics Research

  Open Access•John P A Ioannidis, T D Stanley et al.•The Economic Journal•2017

  Incluir item

• The Null Result Penalty

  Open Access•Felix Chopra, Ingar Haaland et al.•The Economic Journal•2023

  Incluir item

• Statistical Significance,p-Values, and the Reporting of Uncertainty

  Open Access•Guido W Imbens•The Journal of Economic…•2021

  Incluir item