Bring More Data!—A Good Advice? Removing Separation in Logistic Regression by Increasing Sample Size
Bibliographic Data
| ID | 15474381 |
|---|---|
| Authors | Hana Šinkovec (0000-0001-9508-8364, Statistics Austria), Angelika Geroldinger (0000-0002-4659-4911, Statistics Austria), Georg Heinze (0000-0003-1147-8491, Statistics Austria, corresponding author) |
| Year | 2019 |
| Volume | 16 |
| Issue | 23 |
| Pages | 4658-4658 |
| Publication date | 2019-11-22 |
| Open Access | Yes |
| Type | ARTICLE |
| Venue | International Journal of Environmental Research and Public Health (JOURNAL) |
| Journal identifiers | ISSN: 1661-7827 • E-ISSN: 1660-4601 |
| Publisher | Multidisciplinary Digital Publishing Institute (PUBLISHER • CH) |
| DOI | 10.3390/ijerph16234658 |
| PMID | 31766753 |
| OpenAlex | W2981457566 |
| Language | EN |
| Citations received | 1 |
| References cited | 3 |
The parameters of logistic regression models are usually obtained by the method of maximum likelihood (ML). However, in analyses of small data sets or data sets with unbalanced outcomes or exposures, ML parameter estimates may not exist. This situation has been termed 'separation' as the two outcome groups are separated by the values of a covariate or a linear combination of covariates. To overcome the problem of non-existing ML parameter estimates, applying Firth's correction (FC) was proposed. In practice, however, a principal investigator might be advised to 'bring more data' in order to solve a separation issue. We illustrate the problem by means of examples from colorectal cancer screening and ornithology. It is unclear if such an increasing sample size (ISS) strategy that keeps sampling new observations until separation is removed improves estimation compared to applying FC to the original data set. We performed an extensive simulation study where the main focus was to estimate the cost-adjusted relative efficiency of ML combined with ISS compared to FC. FC yielded reasonably small root mean squared errors and proved to be the more efficient estimator. Given our findings, we propose not to adapt the sample size when separation is encountered but to use FC as the default method of analysis whenever the number of observations or outcome events is critically low
Covariate · Data set · Econometrics · Estimator · Filter (signal processing · Firth · Logistic regression · Regression · Sample (material · Sample size determination · Sampling (signal processing · Separation (statistics · Set (abstract data type · Statistics · Computer Science · Hydrology and Drought Analysis · Mathematics · Statistical Methods and Bayesian Inference · Statistical Methods in Epidemiology
| Citations per year | 0.2 |
|---|---|
| Citation span | 2021 - 2021 (1) |
| Highly cited | No |