Size matters
The use and misuse of statistical significance in discrete choice models in the transportation academic literature
Bibliographic Data
| ID | 19338341 |
|---|---|
| Authors | Giancarlos Parady (0000-0002-7581-774X, The University of Tokyo, corresponding author), Kate Axhausen (0000-0003-3331-1318, ETH Zurich) |
| Year | 2024 |
| Volume | 51 |
| Issue | 6 |
| Pages | 2393-2425 |
| Publication date | 2024-12-01 |
| Peer Reviewed | Yes |
| Open Access | Yes |
| Type | ARTICLE |
| Venue | Transportation (JOURNAL) |
| Journal identifiers | ISSN: 0049-4488 • E-ISSN: 1572-9435 |
| Publisher | Springer Science and Business Media LLC (PUBLISHER) |
| DOI | 10.1007/s11116-023-10423-y |
| OpenAlex | W4387119974 |
| Language | EN |
| Citations received | 3 |
| References cited | 106 |
In this paper we review the academic transportation literature published between 2014 and 2018 to evaluate where the field stands regarding the use and misuse of statistical significance in empirical analysis, with a focus on discrete choice models. Our results show that 39% of studies explained model results exclusively based on the sign of the coefficient, 67% of studies did not distinguish statistical significance from economic, policy or scientific significance in their conclusions, and none of the reviewed studies considered the statistical power of the tests. Based on these results we put forth a set of recommendations aimed at shifting the focus away from statistical significance towards proper and comprehensive assessment of effect magnitudes and other policy relevant quantities
Discrete choice · Econometrics · Economics · Empirical research · Field (mathematics) · Focus (optics) · Management science · Set (abstract data type) · Sign (mathematics) · Statistical hypothesis testing · Statistical model · Statistical power · Statistical significance · Statistics · Computer Science · Economic and Environmental Valuation · Mathematics · Transportation Planning and Optimization · Urban Transport and Accessibility
The Persistence of Underpowered Studies in Psychological Research
How Big is a Big Odds Ratio? Interpreting the Magnitudes of Odds Ratios in Epidemiological Studies
Designing efficient stated choice experiments in the presence of reference alternatives
Sample Size Requirements for Discrete-Choice Experiments in Healthcare
Metro service disruptions
Incorporating social interaction into hybrid choice models
Impacts of parental gender and attitudes on children’s school travel mode and parental chauffeuring behavior
Household-level commuting mode choices, car allocation and car ownership level choices of two-worker households
Influence of the weather on mode choice in corridors with time-varying congestion
Exploring the impact of walk–bike infrastructure, safety perception, and built-environment on active transportation mode choice
The role of socio-economic, built environment and psychological factors in parental mode choice for their children in an Iranian setting
Enhanced traffic information dissemination to facilitate toll road utilization
Values, attitudes and travel behavior
Sample size requirements for stated choice experiments
Factors affecting children’s journeys to school
Demand for taxi services
Examining the relationship between active travel, weather, and the built environment
The statistical power of abnormal-social psychological research
A workplace choice model accounting for spatial competition and agglomeration effects
Determinants of travel mode choices of post-secondary students in a large metropolitan area
Catalysts and magnets
The influence of neighborhood environment and household travel interactions on school travel behavior
Using metro smart card data to model location choice of after-work activities
Transit use and the work commute
Activity-travel behaviour of non-workers belonging to different income group households in Bangalore, India
| Unique citing works | 3 |
|---|---|
| Citations per year | 1.5 |
| Citation span | 2024 - 2026 (3) |
| Citation velocity | current |
| Highly cited | No |
| Citation types | Neutral: 2 |