Optimizing the Classification Performance of Logistic Regression and Fisher'S Discriminant Analyses
Bibliographic Data
| ID | 20283331 |
|---|---|
| Authors | Paul R Yarnold (0000-0002-1648-739X, Northwestern University Medical School and University of Illinois at Chicago), Leah A Hart (University of North Carolina at Chapel Hill), Robert C Soltysik (0000-0002-1342-502X, Northwestern University Medical School) |
| Year | 1994 |
| Volume | 54 |
| Issue | 1 |
| Pages | 73-85 |
| Publication date | 1994-03-01 |
| Peer Reviewed | Yes |
| Open Access | Yes |
| Type | ARTICLE |
| Venue | Educational and Psychological Measurement (JOURNAL) |
| Journal identifiers | ISSN: 0013-1644 • E-ISSN: 1552-3888 |
| Publisher | SAGE Publications (PUBLISHER • US) |
| DOI | 10.1177/0013164494054001007 |
| OpenAlex | W2047383975 |
| Language | EN |
| Citations received | 1 |
| References cited | 19 |
Logistic regression analysis (LRA) and Fisher's discriminant analysis (FDA) are two of the most popular methodologies for solving classification problems involving a dichotomous class variable and two or more attributes. Like other suboptimal classification methodologies, neither LRA nor FDA explicitly maximizes percentage accuracy in classification (PAC) for the training sample (the sample on which the model is based). A heuristic is described that shows early promise of increasing the PAC of suboptimal models. The heuristic involves refining the cutpoint used by the suboptimal model to classify observations. This refinement is accomplished by applying univariate optimal discriminant analysis (UniODA) to the predicted response function values obtained by using the suboptimal model for training data. The UniODA cutpoint, rather than the cutpoint of the suboptimal model, is then employed to classify both training and validity (hold-out) data. UniODA-refinement of LRA models is demonstrated by using 12 examples reflecting a variety of substantive areas, including psychology, education, geriatrics, medicine, biology, marketing, and geology. The mean PAC of UniODA- refined LRA was greater than that for nonrefined LRA in both training and validity analyses. UniODA-refmed LRA yielded greater validity PAC than nonrefined LRA in 6 of the 12 examples and lower validity PAC in only 1 of the 12 examples (exactly consistent results emerged for FDA). Discussion focuses on directions for future research
Discriminant function analysis · Heuristic · Linear discriminant analysis · Logistic regression · Machine learning · Multivariate statistics · Statistics · Univariate · Advanced Statistical Methods and Models · Artificial Intelligence · Computer Science · Face and Expression Recognition · Mathematics · Statistical Methods and Applications
| Unique citing works | 1 |
|---|---|
| Citations per year | 0.03 |
| Citation span | 1996 - 1996 (1) |
| Citation velocity | historical |
| Highly cited | No |
| Citation types | Neutral: 1 |