Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

An open letter to evolutionary and human sciences; Statistics has moved on and so should we. A proposal for more transparent research, and some notes on p < 0.003

Bibliographic Data

ID21264108
AuthorsL A Courtenay (0000-0002-4810-2001, Centre National de la Recherche Scientifique, corresponding author)
Year2024
Volume2
Issue6
Pages100041
Publication date2024-12-01
Peer ReviewedYes
Open AccessYes
TypeARTICLE
VenueQuaternary Environments and Humans (JOURNAL)
Journal identifiersISSN: 2950-2365 • E-ISSN: 2950-2365
PublisherElsevier BV (PUBLISHER)
DOI10.1016/j.qeh.2024.100041
OpenAlexW4404367076
LanguageEN
Citations received4
References cited36

Statistical reasoning and inference have become integral to how we reach conclusions as scientists. Few papers in evolutionary, biological, and human sciences, are published at present without at least one report of a p -value, or the term “statistically significant”. As a product of this, discoveries and results often hinge on p -values below the infamous threshold of 0.05. This is due to how well ingrained these notions are in many of our higher education systems, and our practices as researchers. Nevertheless, the concept of a p -value, borrowed from statistics, and dating as far back as the late 20th and early 21st century, has undergone an evolution that we may not be completely aware of, if we do not follow or keep ourselves up to date with the most recent advances in statistical research. The present short communication can be framed as an opinion piece that simply aims to call our attention to the fact that statisticians, in recent years, have asked that we completely abandon the notion of “statistically significant ( p < 0.05)”. It is important to point out that none of these observations are new, however certainly merit being re-addressed. Here I attempt to open a dialogue among archaeologists, palaeontologists, palaeoanthropologists, biological anthropologists, evolutionary biologists, and all researchers in related fields, about such statistical research. Finally, I propose a means of moving forward, suggesting we move from a world where p < 0.05 is considered a binary threshold for conclusive results, to a more nuanced practice where different gradients, down to p < 0.003, are interpreted as increasingly suggestive evidence – provided that findings are supported by additional, transparently reported corroborative data. • Recent years have found much debate by statisticians on the use and misuse of p-values. • Archaeologists and Palaeontologists seem to be unaware of such debates. • p < 0.05 and term “statistically significant” are overly used and misleading. • Researchers should be aware of updates from other fields, and update accordingly

Data science · Statistics · Computer Science · Data Analysis with R · Mathematics · Meta-analysis and systematic reviews · Science and Climate Studies

  • Current Key Intersections between Theoretical and Computational Archaeology

    Open Access•Martin Hinz, Jan Kolář et al.•Advances in Archaeological Practice•2025

  • From edge to mark. Investigating the relationship between cut marks and lithic raw materials

    Open Access•Eva Martellotta, Eva Francesca Martellotta et al.•Frontiers in Environmental…•2026

  • Mapping the Symbolic Structure of Palaeolithic Rock Art Using Co-occurrence Network Analysis

    Open Access•I Intxaurbe•Journal of Archaeological Method…•2026

  • Identifying potential palaeolithic artificial memory systems via Spatial statistics

    Open Access•L A Courtenay, Francesco D’errico et al.•Archaeological and Anthropological…•2025

  • Moving to a World Beyond “ p < 0.05”

    Open Access•Ronald L Wasserstein, Ron Wasserstein et al.•The American Statistician•2019

  • The Probable Error of a Mean

    Student Student•Biometrika•1908

  • The ASA Statement on p -Values

    Ronald L Wasserstein, Ron Wasserstein et al.•The American Statistician•2016

  • The natural selection of bad science

    Open Access•P E Smaldino, Richard Mcelreath•Royal Society Open Science•2016

  • The Comparative Archaeology of Complex Societies

    Open Access•Michael E Smith•Comparative Archaeology of…•2011

  • Best practices for selecting samples, analyzing data, and publishing results in isotope archaeology

    Open Access•Petra Vaiglova, Nicole A Lazar et al.•Quaternary International•2023

  • The earth is round (p < .05)

    Jacob Cohen•American Psychologist•1994

  • Computational Reproducibility in Archaeological Research

    Open Access•Ben Marwick•Journal of Archaeological Method…•2016

  • Artefact attribute richness and sample size adequacy

    Open Access•Grant W G Cochrane•Journal of Archaeological Science•2003

  • Archaeofaunal Relative Abundance, Sample Size, and Statistical Methods

    Open Access•Michael Cannon, Michael D Cannon•Journal of Archaeological Science•2001

  • P > .05

    Open Access•Richard J Smith•American Journal of Physical…•2020

  • Taphonomy and sample size estimation in paleoethnobotany

    Open Access•Gyoung-Ah Lee•Journal of Archaeological Science•2011

  • Bayes in biological anthropology

    Open Access•L W Konigsberg, Susan R Frankenberg•American Journal of Physical…•2013

  • The continuing misuse of null hypothesis significance testing in biological anthropology

    Open Access•Richard J Smith•American Journal of Physical…•2018

  • Exploring the reliability of handaxe morphological analyses in 2D

    Open Access•L A Courtenay•Archaeological and Anthropological…•2023

  • The Structure of Scientific Revolutions

    B Barber, Thomas S Kuhn•American Sociological Review•1963

  • Redefine statistical significance

    Open Access•Daniel J Benjamin, James O Berger et al.•Nature Human Behaviour•2017

  • Remove, rather than redefine, statistical significance

    Open Access•Valentin Amrhein, Sander Greenland•Nature Human Behaviour•2017

Unique citing works4
Citations per year4
Citation span2025 - 2026 (2)
Citation velocitycurrent
Highly citedNo
Citation typesNeutral: 4
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae