Inference by eye
Reading the overlap of independent confidence intervals
Bibliographic Data
| ID | 23314567 |
|---|---|
| Authors | Geoff Cummings (0000-0003-1716-5277, La Trobe University, corresponding author), GEOFF CUMMING |
| Year | 2009 |
| Volume | 28 |
| Issue | 2 |
| Pages | 205-220 |
| Publication date | 2009-01-30 |
| Peer Reviewed | Yes |
| Open Access | Yes |
| Type | ARTICLE |
| Venue | Statistics in Medicine (JOURNAL) |
| Journal identifiers | ISSN: 0277-6715 • E-ISSN: 1097-0258 |
| Publisher | Wiley (PUBLISHER • GB) |
| DOI | 10.1002/sim.3471 |
| PMID | 18991332 |
| OpenAlex | W1966165134 |
| Language | EN |
| Citations received | 113 |
| References cited | 34 |
When 95 per cent confidence intervals (CIs) on independent means do not overlap, the two‐tailed p ‐value is less than 0.05 and there is a statistically significant difference between the means. However, p for non‐overlapping 95 per cent CIs is actually considerably smaller than 0.05: If the two CIs just touch, p is about 0.01, and the intervals can overlap by as much as about half the length of one CI arm before p becomes as large as 0.05. Keeping in mind this rule—that overlap of half the length of one arm corresponds approximately to statistical significance at p = 0.05—can be helpful for a quick appreciation of figures that display CIs, especially if precise p ‐values are not reported. The author investigated the robustness of this and similar rules, and found them sufficiently accurate when sample sizes are at least 10, and the two intervals do not differ in width by more than a factor of 2. The author reviewed previous discussions of CI overlap and extended the investigation to p ‐values other than 0.05 and 0.01. He also studied 95 per cent CIs on two proportions, and on two Pearson correlations, and found similar rules apply to overlap of these asymmetric CIs, for a very broad range of cases. Wider use of figures with 95 per cent CIs is desirable, and these rules may assist easy and appropriate understanding of such figures. Copyright © 2008 John Wiley & Sons, Ltd.
Biology · Combinatorics · Confidence interval · Econometrics · Inference · Range (aeronautics) · Robustness (evolution) · Sample size determination · Statistical significance · Statistics · Value (mathematics) · Advanced Statistical Methods and Models · Artificial Intelligence · Computer Science · Mathematics · Reliability and Agreement in Measurement · Statistical Methods in Clinical Trials
Positive rumination can (also) interfere with sleep
Feeling excited or taking a bath
The effects of allowing a second sequential lineup lap on choosing and probative value
The mechanisms of minimization
Dynamic contact effects
The role of identity commitments in depressive symptoms and stressful life events in adolescence and young adulthood
Number sense and mathematics
Changes in disease burden and global inequalities in bladder, kidney and prostate cancers from 1990 to 2019
The frequencies and disparities of adverse childhood experiences in the U.S
Effect Size Estimation and Confidence Intervals
Impacts of the Covid-19 pandemic on rural America
The New Statistics
Beyond Social Investment. Which Concepts and Values for Social Policy-making in Europe?
Mapping At-Risk-of-Poverty Rates, Household Employment, and Social Spending
Who Benefits from Investment Policies? The Case of Family Activation in European Countries
Reconciling Work and Poverty Reduction
Social Redistribution, Poverty, and the Adequacy of Social Protection
Identifying the Skeleton of the Social Investment State
The Redistributive Capacity of Services in the European Union
Just a Glance, or More? Pathways from Counter-Attitudinal Incidental Exposure to Attitude (De)Polarization Through Response Behaviors and Cognitive Elaboration
The Effects of Age Stereotypes on Physical and Mental Health Are Mediated by Self-perceptions of Aging
Economic valuation of the mortality benefits of a regulation on SO2 in 20 European cities
Behavioral health risk factor profiles in general hospital patients
Exploring Counseling Dropout Rates Among International College Students with Disabilities
A Bi-directional Mediation Analysis of Psychological Distress, Happiness, and Life Satisfaction Among Community Dwellers in a Semi-urban Setting
The Declining Trend in Adolescent Drinking
Are all domains created equal? An exploration of stakeholder views on the concept of physical literacy
The Effects of ESL Immersion and Proficiency on Learners’ Pronunciation Development
The Gendered Nature and Malleability of Gamer Stereotypes
Perceived Ease of Access and Age Attenuate the Association Between Marijuana Ad Exposure and Marijuana Use in Adolescents
Gameful interventions for pro-environmental attitude change
Microgesture + Grasp
Do you remember? Rater memory systems and leadership measurement
Predictors of domain-specific and global life satisfaction across the first half of life
Social Support and the Rehabilitation of Alcohol-Impaired Drivers
Using administrative health data to estimate prevalence and mortality rates of alcohol and other substance‐related disorders for surveillance purposes
Agency over social media use can be enhanced through brief abstinence, but only in users with high cognitive reflection tendencies
Videogames and guns in adolescents
Role of perceived social support in the relationship between parent temperament and distress tolerance
The Behavior of Organization in Economic Crisis
Reliable individual differences in researcher performance capacity estimates
Callous‐unemotional traits, cognitive functioning, and externalizing problems in a propensity‐matched sample from the ABCD study
Positive mental health and burnout in first to fourth year medical students
Communicating the Scientific Consensus on Climate Change
Theoretically Suggested Divergent Predictions for Pornography Use, Religiosity, and Permissive Sexual Attitudes
Barriers to Multiculturalism
Changes over Time in Covid-19 Vaccination Inequalities in Eight Large U.S. Cities
Diet in high mediaeval Florence through stable isotope analysis of carbon, nitrogen and sulphur
Judging job applicants by their politics
Overestimating or underestimating communication findings? Comparing self-reported with log mobile data by data donation method
In-Laws’ Perceptions of Topic Avoidance, Goal Inferences, and Relational Outcomes
Protest Coverage Matters
Trust Over Use
A quest for the healthy lifestyle and learning experiences in olive oil tourism
Leader-member exchange and organizational citizenship behaviour
Non-intact families and adolescents’ family satisfaction during the Second Demographic Transition
My online self identifies with you, but my offline self skips you
Understanding diffusion of information systems-based services
Guided by God
Perceptions of Gender Role Discontinuity and Collective Nostalgia for Traditional Gender Relations Shape Men’s Support for Gender Equality
Cross-Cultural Sexism and the Effectiveness of Gender (Non)Traditional Advertising
Nuanced Longitudinal Effects of Domains of Perceived Gender Similarity on Adolescent Peer Victimization
Associations Between Gender Segregation and Gender Identity in College Students
The influence of consumers’ interest in healthy eating, definitions of healthy eating, and personal values on perceived dietary quality
Consumer food sustainability before and during the Covid-19 Crisis
The Contingency of Future vs. Present Orientation and Status Attainment
Grade Retention and School Dropout
Dissociative absorption
Video feedback and the choice of strategies of college-level guitarists during individual practice
Improving the evaluation of an integrated healthcare system using entropy balancing
Participation of Workers of Asian Ancestry in High-Risk Occupations in the United States
Testing Cognitive Models to Characterize Trauma Anniversary Reactions Marked by Stress and Growth
Viral Prevalence in Wild Serval Population is Driven by Season and Sex
Crisis? What crisis? Interpreting student feedback on assessment
Investigating how self‐esteem moderates grandiose narcissism's interpersonal orientation
Individual Versus Household Income and Life Satisfaction
Prioritization of the essentials in the spending patterns of Canadian households experiencing food insecurity
How robust is the evidence of an emerging or increasing female excess in physical morbidity between childhood and adolescence? Results of a systematic literature review and meta-analyses
Tracking and political engagement
Portion size effects vary
A reversal of defaults
The effects of learning-related and peer-related school experiences on adolescent wellbeing
Non-intact Families and Children’s Educational Outcomes
Media framing of Copenhagen tourism
Increased support for collective defence in times of threat
Welfare regimes, population health and health inequalities
Impact of the NHS Health Check on inequalities in cardiovascular disease risk
Are observed associations between a high maternal prepregnancy body mass index and offspring IQ likely to be causal
Life expectancy of different ethnic groups using death records linked to population census data for 4.62 million people in Scotland
Misperceptions in a post-truth world
Attitudes Toward Mental Illness in Adults by Mental Illness–Related Factors and Chronic Disease Status
Spontaneous imagined contact and intergroup relations
The Phoenix pay system and intention to quit the federal public service
An interaction model for the role of self‐evaluations and antagonistic pursuits in subjective well‐being
Autistic adults form first impressions from voices in similar ways to non‐autistic adults
How Does Routine Disclosure of Medical Error Affect Patients' Propensity to Sue and Their Assessment of Provider Quality
Lower social class, better social skills? A registered report testing diverging predictions from the rank and cultural approaches to social class
United States Women and Pornography
Disparities in bone density across contemporary Amazonian forager‐horticulturalists
Leadership in the public sector
An Approximate Distribution of Estimates of Variance Components
The Graphical Presentation of a Collection of Means
Overlapping confidence intervals or standard error intervals
A brief note on overlapping confidence intervals
On Judging the Significance of Differences by Examining the Overlap Between Confidence Intervals
Hate Speech and Academic Freedom in the Academy
Inference by Eye
Publication Manual of the American Psychological Association
| Unique citing works | 113 |
|---|---|
| Citations per year | 7,06 |
| Citation span | 2010 - 2026 (17) |
| Citation velocity | current |
| Highly cited | Yes |
| Citation types | Neutral: 106 |