The continuing misuse of null hypothesis significance testing in biological anthropology
Bibliographic Data
| ID | 8314908 |
|---|---|
| Authors | Richard J Smith (0000-0002-6340-0656, Department of Anthropology Washington University in St. Louis St. Louis MO, 63130, corresponding author) |
| Year | 2018 |
| Volume | 166 |
| Issue | 1 |
| Pages | 236-245 |
| Publication date | 2018-05-01 |
| Open Access | Yes |
| Type | ARTICLE |
| Venue | American Journal of Physical Anthropology (JOURNAL) |
| Journal identifiers | ISSN: 0002-9483 • E-ISSN: 1096-8644 |
| Publisher | Wiley (PUBLISHER • GB) |
| DOI | 10.1002/ajpa.23399 |
| PMID | 29345299 |
| OpenAlex | W2792260926 |
| Language | EN |
| Citations received | 25 |
| References cited | 87 |
There is over 60 years of discussion in the statistical literature concerning the misuse and limitations of null hypothesis significance tests (NHST). Based on the prevalence of NHST in biological anthropology research, it appears that the discipline generally is unaware of these concerns. The p values used in NHST usually are interpreted incorrectly. A p value indicates the probability of the data given the null hypothesis. It should not be interpreted as the probability that the null hypothesis is true or as evidence for or against any specific alternative to the null hypothesis. P values are a function of both the sample size and the effect size, and therefore do not indicate whether the effect observed in the study is important, large, or small. P values have poor replicability in repeated experiments. The distribution of p values is continuous and varies from 0 to 1.0. The use of a cut‐off, generally p ≤ 0.05, to separate significant from nonsignificant results, is an arbitrary dichotomization of continuous variation. In 2016, the American Statistical Association issued a statement of principles regarding the misinterpretation of NHST, the first time it has done so regarding a specific statistical procedure in its 180‐year history. Effect sizes and confidence intervals, which can be calculated for any data used to calculate p values, provide more and better information about tested hypotheses than p values and NHST
Alternative hypothesis · Biological anthropology · Confidence interval · Data mining · Econometrics · Null (SQL) · Null hypothesis · p-value · Sample size determination · Sociology · Statistical hypothesis testing · Statistical power · Statistical significance · Statistics · Anthropology · Computer Science · Explainable Artificial Intelligence (XAI · Mathematics · Meta-analysis and systematic reviews · Psychology · Statistical Methods in Clinical Trials
Fire's impact on threat detection and risk perception among vervet monkeys
Dental microwear texture analysis in bioarchaeology
An open letter to evolutionary and human sciences; Statistics has moved on and so should we. A proposal for more transparent research, and some notes on p < 0.003
Lesions in sheep elbows
Urban and rural survivorship in Pre- and Post-Black Death Denmark
The bottom line
Sample size and representational bias in bioarchaeology
Characterizing variation in late precontact diets using dental microwear texture analysis
When less is more
How can we improve statistical training in archaeological science
Intestinal microbiota composition and efficacy of iron supplementation in Peruvian children
The relationship between mental well‐being and wealth varies by wealth type, place and sex/gender
Interactions with alloparents are associated with the diversity of infant skin and fecal bacterial communities in Chicago, United States
Chimpanzee ranging responses to fruit availability in a high‐elevation environment
An Evaluation of Ancestral Diversity in 19th-Century South Shields
P > .05
Assessing individual and population variability in degenerative joint disease prevalence using generalized linear mixed models
Living with observational data in biological anthropology
Reply to Ruff, Warden, and Karlson
Dental microwear texture analysis of Homo sapiens sapiens
Lack of biological mortality bias in the timing of dental formation in contemporary children
Relative leg-to-arm skeletal strength proportions in orangutans by species and sex
Child and adolescent diet in Late Roman Gaul
Inferences on Sicilian Mesolithic subsistence patterns from cross-sectional geometry and entheseal changes
Biological Anthropology in 2018
The Empire of Chance
Philosophy and the practice of Bayesian statistics
Why Most Discovered True Associations Are Inflated
Null hypothesis significance testing
The Extent and Consequences of P-Hacking in Science
The ASA Statement on p -Values
The Statistical Crisis in Science
The Case Against Statistical Significance Testing
Effect size, confidence interval and statistical significance
Confidence intervals rather than P values
Statistical tests, P values, confidence intervals, and power
Statistical significance testing and cumulative knowledge in psychology
False-Positive Psychology
The New Statistics
Significance Tests Die Hard
The statistical theories of Fisher and of Neyman and Pearson
Alphabet Soup
If Statistical Significance Tests are Broken/Misused, What Practices Should Supplement or Replace Them
Factors of influence and social correlates of parturition in captive Campbell's monkeys
Sex and seasonal differences in diet and nutrient intake in Verreaux's sifakas ( Propithecus verreauxi )
The 5% Solution
In praise of brilliance
In praise of brilliance
Why Summaries of Research on Psychological Theories are Often Uninterpretable
The earth is round (p < .05)
Sexual Dimorphism and Facial Growth Beyond Dental Maturity in Great Apes and Gibbons
Avoiding Model Selection in Bayesian Social Research
Things I have learned (so far)
Inference by Eye
Using photogrammetry and color scoring to assess sexual dimorphism in wild western gorillas ( Gorilla gorilla )
Robusticity and sexual dimorphism in the postcranium of modern hunter‐gatherers from Australia
Growth and ontogeny of sexual size dimorphism in the mandrill ( Mandrillus sphinx )
Seven Deadly Sins of Psychology
The ontogeny of sexual dimorphism in the facial skeleton of the African apes
Mindless statistics
On the probability of making Type I errors
Redefine statistical significance
Remove, rather than redefine, statistical significance
Statistical significance in psychological research
The fallacy of the null-hypothesis significance test
A power primer
Qualitative Methods and Visualizations in the Study of Friendship Networks
Damaging Real Lives through Obstinacy
| Citations per year | 3.13 |
|---|---|
| Citation span | 2018 - 2025 (8) |
| Highly cited | No |