Selecting a Two-Group Classification Weighting Algorithm
Bibliographic Data
| ID | 19290689 |
|---|---|
| Authors | John D Morris, Carl J Huberty |
| Year | 1987 |
| Volume | 22 |
| Issue | 2 |
| Pages | 211-232 |
| Publication date | 1987-04-01 |
| Open Access | No |
| Type | ARTICLE |
| Venue | Multivariate Behavioral Research (JOURNAL) |
| Journal identifiers | ISSN: 0027-3171 • E-ISSN: 1532-7906 |
| Publisher | Informa UK Limited (PUBLISHER • GB) |
| DOI | 10.1207/s15327906mbr2202_5 |
| PMID | 26782066 |
| OpenAlex | W1984327898 |
| Language | EN |
| References cited | 35 |
The cross-validated classification accuracies of three predictor weighting strategies (least squares, ridge regression, and reduced rank) were compared under varying simulated data conditions for the two-group classification problem. Results were somewhat similar to previous findings with multiple regression when absolute rather than relative cross-validation accuracy was the criterion. The alternate weighting strategies performed better than the usual least squares algorithm in many of the data conditions, but the margin by which they surpassed least squares was in many cases quite small. Also, the alternate algorithms were poorer than least squares in some data configurations, and in some cases, by an appreciable margin. Verification of these simulation findings was obtained by documenting agreement with theory, and with an analytic sample-specific procedure that was used with some "real" data sets. The results of the analyses with real data sets yielded results that were similar to those from the simulation. The routine and uncritical use of biased weighting algorithms in classification as advanced by P. J. DiPillo was not supported
Algorithm · Combinatorics · Data mining · Group (periodic table) · Least-squares function approximation · Machine learning · Margin (machine learning) · Pattern recognition (psychology) · Rank (graph theory) · Regression · Statistics · Total least squares · Weighting · Advanced Statistical Methods and Models · Artificial Intelligence · Computer Science · Mathematics · Statistical Methods and Applications · Statistical Methods and Inference
Ridge Regression
Cross-Validatory Choice and Assessment of Statistical Predictions
A Computer Program to Create a Population with Any Desired Centroid and Covariance Matrix
The Application of Electronic Computers to Factor Analysis
Estimation in Multiple Correlation/Prediction
Comparing Inverse, Polar, and Rectangle-Wedge-Tail Fortran Routines for Pseudo-Random Normal Number Generation
Linear Versus Quadratic Multivariate Classification
An Empirical Investigation Of Step-Down Canonical Correlation With Cross-Validation
Reduced-variance regression
Ridge regression and some alternative weighting techniques
Ridge regression and some alternative weighting techniques
Ridge regression
Weighting predictors in linear models
Issues in the use and interpretation of discriminant analysis
Outliers and influential data points in regression analysis
| Highly cited | No |
|---|