Null hypothesis significance testing
On the survival of a flawed method
Bibliographic Data
| ID | 18935271 |
|---|---|
| Authors | Joachim Krueger (0000-0003-0931-1596), Joachim I Krueger (0000-0001-9607-1695, Brown University, corresponding author) |
| Year | 2001 |
| Volume | 56 |
| Issue | 1 |
| Pages | 16-26 |
| Publication date | 2001-01-01 |
| Peer Reviewed | Yes |
| Open Access | No |
| Type | ARTICLE |
| Venue | American Psychologist (JOURNAL) |
| Journal identifiers | ISSN: 0003-066X • E-ISSN: 1935-990X |
| Publisher | American Psychological Association (APA) (PUBLISHER) |
| DOI | 10.1037/0003-066x.56.1.16 |
| PMID | 11242984 |
| OpenAlex | W2039953234 |
| Language | EN |
| Citations received | 75 |
| References cited | 34 |
Null hypothesis significance testing (NHST) is the researcher's workhorse for making inductive inferences. This method has often been challenged, has occasionally been defended, and has persistently been used through most of the history of scientific psychology. This article reviews both the criticisms of NHST and the arguments brought to its defense. The review shows that the criticisms address the logical validity of inferences arising from NHST, whereas the defenses stress the pragmatic value of these inferences. The author suggests that both critics and apologists implicitly rely on Bayesian assumptions. When these assumptions are made explicit, the primary challenge for NHST--and any system of induction--can be confronted. The challenge is to find a solution to the question of replicability
Alternative hypothesis · Bayesian probability · Cognitive psychology · Econometrics · Epistemology · Null hypothesis · Significance testing · Statistical hypothesis testing · Statistics · Value (mathematics) · Artificial Intelligence · Computer Science · Decision-Making and Behavioral Economics · Mathematics · Paranormal Experiences and Beliefs · Philosophy · Philosophy and History of Science · Psychology
A reconceptualization of significance testing
Perceived crisis and reforms
Using the Coefficient of Confidence to Make the Philosophical Switch From A Posteriori to A Priori Inferential Statistics
Religiousness and Spirituality
Religion and Violence
Church Attendance in the United States
Religion and the New Immigrants
Dis/location
Latina Empowerment, Border Realities, and Faith-Based Organizations
Beyond the Synagogue Walls
Religion and Health
Escaping the Procustean Bed
Historicizing the Secularization Debate
Studying Religion, Making it Sociological
Civil Society and Civil Religion as Mutually Dependent
The Dynamics of Religious Economies
The Ritual Roots of Society and Culture
Religious Social Movements in the Public Sphere
Mapping the Moral Order
Religion and Political Behavior
“Worldly” or “Other Worldly”?
Religion and Spirituality
Demographic Methods for the Sociology of Religion
In Rhetoric and Practice
The Sociology of Religion in Late Modernity
The Evolution of the Sociology of Religion
Social Forms of Religion and Religions in Contemporary Global Society
Religious Socialization
Target Article
Religious Identities and Religious Institutions
Social Projection to Ingroups and Outgroups
A tutorial on a practical Bayesian alternative to null-hypothesis significance testing
Religion, Faith-Based Community Organizing, and the Struggle for Justice
A Journey of the “Straight Way” or the “Roundabout Path”
Graduate and undergraduate quantitative education in psychology in the United States
Elusive Alpha and Beta Control in a Multicausal World
Dynamics in environmental legislation
Why P Values Are Not a Useful Measure of Evidence in Statistical Significance Testing
Alphabet Soup
Thou Shalt Not Bear False Witness Against Null Hypothesis Significance Testing
Cautionary Note on Reporting Eta-Squared Values from Multifactor Anova Designs
Handbook of the Sociology of Religion
Social perception as induction and inference
Conspiracy Beliefs, Rejection of Vaccination, and Support for hydroxychloroquine
Why chance is a good theory
Bayes rules
Are there benefits from NHST
How probable is the null hypothesis
Beyond objectivity and subjectivity
Beyond objectivity and subjectivity
How probable is the null hypothesis
Fisher's fallacy and NHST's flawed logic
To prosper, organizational psychology should … overcome methodological barriers to progress
Empirical evaluation and justification of methodologies in psychological science
Learning research
Possible Solution to Publication Bias Through Bayesian Statistics, Including Proper Null Hypothesis Testing
Beating the odds
Considering Quantitative and Qualitative Issues Together
Linguistic Alternatives to Quantitative Research Strategies Part One
How Linguistic Frames Affect Motivational Profiles and the Roles of Quantitative versus Qualitative Research Strategies
Prototype Modeling vs. Item Response Theory – A Paradigm Shift for Measurement Professionals
Single-Case Time Series With Bayesian Analysis
Bring the Sociologist Back in” To Graduate Statistics. A Response to “The Sociology of Teaching Graduate Statistics”
Null Hypothesis Significance Testing
More is not less
A Test of the Null Hypothesis Significance Testing Procedure Correlation Argument
Social Categorization Moderates Social Projection
Institutional Research Productivity, Use of Theory-Driven Research, and Statistical Application in Counseling Psychology
Replicable quantitative psychological and educational research
Images Are Not the Evidence in Neuroimaging
A Tale of Two Sociologies
Damaging Real Lives through Obstinacy
Unskilled, unaware, or both? The better-than-average heuristic and statistical regression predict errors in estimates of own performance
Population Stratification in the Candidate Gene Study
A Critical Assessment of Null Hypothesis Significance Testing in Quantitative Communication Research
The Significance Test Controversy
The Rise of Scientific Philosophy
Distribution Theory for Glass's Estimator of Effect Size and Related Estimators
The Case Against Statistical Significance Testing
Distribution Theory for Glass's Estimator of Effect size and Related Estimators
Judgment under Uncertainty
Significance Tests Die Hard
In praise of the null hypothesis statistical test
In praise of brilliance
Why Summaries of Research on Psychological Theories are Often Uninterpretable
The earth is round (p < .05)
Things I have learned (so far)
Statistical methods in psychology journals
Effects of race on the elicitation of helping behavior
The test of significance in psychological research
Statistical significance in psychological research
Belief in the law of small numbers
Do studies of statistical power have an effect on the power of studies
When small effects are impressive
| Unique citing works | 75 |
|---|---|
| Citations per year | 3 |
| Citation span | 2001 - 2025 (25) |
| Citation velocity | recent |
| Highly cited | No |
| Citation types | Neutral: 72 |