From significance testing to estimation and Open Science
How esci can help
Bibliographic Data
| ID | 21337468 |
|---|---|
| Authors | Robert J Calin-Jageman (0000-0002-9837-6529, Department of Psychology Dominican University River Forest IL USA, corresponding author), Geoff Cummings (0000-0003-1716-5277, School of Psychology and Public Health La Trobe University Melbourne Australia, corresponding author) |
| Year | 2024 |
| Volume | 59 |
| Issue | 5 |
| Pages | 672-689 |
| Publication date | 2024-10-01 |
| Open Access | Yes |
| Type | ARTICLE |
| Venue | International Journal of Psychology (JOURNAL) |
| Journal identifiers | ISSN: 0020-7594 • E-ISSN: 1464-066X |
| Publisher | Wiley (PUBLISHER • GB) |
| DOI | 10.1002/ijop.13132 |
| PMID | 38679926 |
| OpenAlex | W4396223835 |
| Language | EN |
| References cited | 32 |
We argue that researchers should test less, estimate more, and adopt Open Science practices. We outline some of the flaws of null hypothesis significance testing and take three approaches to demonstrating the unreliability of the p value. We explain some advantages of estimation and meta‐analysis (“the new statistics”), especially as contributions to Open Science practices, which aim to increase the openness, integrity, and replicability of research. We then describe esci (estimation statistics with confidence intervals): a set of online simulations and an R package for estimation that integrates into jamovi and JASP . This software provides (a) online activities to sharpen understanding of statistical concepts (e.g., “The Dance of the Means”); (b) effects sizes and confidence intervals for a range of study designs, largely by using techniques recently developed by Bonett; (c) publication‐ready visualisations that make uncertainty salient; and (d) the option to conduct strong, fair hypothesis evaluation through specification of an interval null. Although developed specifically to support undergraduate learning through the 2nd edition of our textbook, esci should prove a valuable tool for graduate students and researchers interested in adopting the estimation approach. Further information is at ( https://thenewstatistics.com )
Economics · Estimation · Management · Applied Psychology · Meta-analysis and systematic reviews · Philosophy and History of Science · Psychology · scientometrics and bibliometrics research
Theoretical risks and tabular asterisks
The ASA Statement on p -Values
Replicability, Robustness, and Reproducibility in Psychological Science
Raise standards for preclinical cancer research
Mindfulness practice leads to increases in regional brain gray matter density
Equivalence Testing for Psychological Research
Estimating the reproducibility of psychological science
The New Statistics
Conducting Meta-Analyses in R with the metafor Package
The Brief Implicit Association Test
Criminal Beware
Using anchor-based methods to determine the smallest effect size of interest
Antifragile
Math = male, me = female, therefore math ≠ me
The fallacy of the null-hypothesis significance test
| Highly cited | No |
|---|