Normalization Ridge Regression in Practice
Bibliographic Data
| ID | 2331490 |
|---|---|
| Authors | Jeffrey W Bulcock (Memorial University of Newfoundland), Wan Fung Lee (Memorial University of Newfoundland) |
| Year | 1983 |
| Volume | 11 |
| Issue | 3 |
| Pages | 259-303 |
| Publication date | 1983-02-01 |
| Peer Reviewed | Yes |
| Open Access | Yes |
| Type | ARTICLE |
| Venue | Sociological Methods & Research (JOURNAL) |
| Journal identifiers | ISSN: 0049-1241 • E-ISSN: 1552-8294 |
| Publisher | SAGE Publications Inc (PUBLISHER) |
| DOI | 10.1177/0049124183011003001 |
| OpenAlex | W2089964769 |
| Language | EN |
| Citations received | 2 |
| References cited | 24 |
Both ordinary least squares (OLS) and two-stage least squares (2SLS) regression methods are sensitive to multicollinearity. The standard statistical solution to the multicollinearity problem is to use one of a family of biased, variance-reduced estimation methods collectively known as ridge regression (RR). In the presence of multicollinearity, RR is usually more efficient than OLS; thus, in theory, two-stage ridge regression (2SRR) should be able to outperform 2SLS. RR, however, is not a problem-free method for reducing variance inflation. It is a stochastic procedure when it should be nonstochastic, and it does not meet the boundary condition. It is argued that the problems of RR stem from the use of the minimum mean square error criterion. An alternative called the variance normalization criterion is proposed that, in theory, copes with the dilemmas of RR while preserving the advantages of RR over OLS. Normalization ridge regression (NR) is used to estimate a nonorthogonal recursive model, and two-stage normalization ridge regression (2SNR) is used to estimate a nonorthogonal, nonrecursive model. Comparisons were made between OLS, RR, and NR estimates and between 2SLS, 2SRR, and 2SNR. On the basis of eight performance indices it was concluded that the NR and 2SNR procedures were efficient variance reduction methods, and hence, useful statistical solutions in the last resort to the multicollinearity problem
Econometrics · Linear regression · Multicollinearity · Normalization (sociology) · Ordinary least squares · Regression · Regression analysis · Statistics · Variance inflation factor · Advanced Statistical Methods and Models · Mathematics · Spectroscopy and Chemometric Analyses · Statistical Methods and Applications
Introduction to structural equation models
Structural Equation Models in the Social Sciences
Ridge Regression
Causal inferences in nonexperimental research
“Human Knowledge—Its Scope and Limits”
Causal Models in the Social Sciences
A Survey of Ridge Regression and Related Techniques for Improvements over Ordinary Least Squares
Multicollinearity in Regression Analysis
Theoretical Concepts and Observables
Ridge regression
The Presidential Address
Optimal Bias in Ridge Regression Approaches To Multicollinearity
Issues in Multiple Regression
| Unique citing works | 2 |
|---|---|
| Citations per year | 0,05 |
| Citation span | 1984 - 1985 (2) |
| Citation velocity | historical |
| Highly cited | No |
| Citation types | Neutral: 2 |