A sparse approach for high-dimensional data with heavy-tailed noise

High-dimensional data have commonly emerged in diverse fields, such as economics, finance, genetics, medicine, machine learning, and so on. In this paper, we consider the sparse quantile regression problem of high-dimensional data with heavy-tailed noise, especially when the number of regressors is much larger than the sample size. We bring the spirit of -norm support vector regression into quantile regression and propose a robust -norm support vector quantile regression for high-dimensional data with heavy-tailed noise. The proposed method achieves robustness against heavy-tailed noise due to its use of the pinball loss function. Furthermore, -norm support vector quantile regression ensures that the most representative variables are selected automatically by using a sparse parameter. We use a simulation study to test the variable selection performance of -norm support vector quantile regression, where the number of explanatory variables greatly exceeds the sample size. The simulation study confirms that -norm support vector quantile regression is not only robust against heavy-tailed noise but also selects representative variables. We further apply the proposed method to solve the variable selection problem of index construction, which also confirms the robustness and sparseness of -norm support vector quantile regression

Econometrics · Feature selection · Linear regression · Quantile · Quantile regression · Regression analysis · Sample size determination · Statistics · Support vector machine · Bayesian Methods and Mixture Models · Computer Science · Gene expression and cancer classification · Mathematics · Statistical Methods and Inference · Artificial Intelligence

• The Adaptive Lasso and Its Oracle Properties

  Hui Zou•Journal of the American…•2006

  Incluir item

• Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties

  Jianqing Fan, Runze Li•Journal of the American…•2001

  Incluir item

• A tutorial on support vector regression

  Open Access•Alex J Smola, Alex Smola et al.•Statistics and Computing•2004

  Incluir item

• Regression Shrinkage and Selection Via the Lasso

  Open Access•Robert Tibshirani•Journal of the Royal Statistical…•1996

  Incluir item

• Regression Quantiles

  Roger Koenker, Gilbert W Bassett et al.•Econometrica•1978

  Incluir item

• Robust Regression Shrinkage and Consistent Variable Selection Through the LAD-Lasso

  Hansheng Wang, Guodong Li et al.•Journal of Business and Economic…•2007

  Incluir item

• Composition effect matters

  Open Access•Qinying He, Lin Xu et al.•Economic Research-Ekonomska…•2020

  Incluir item

• Debt capacity, debt choice, and underinvestment problem

  Open Access•Kalim-Ullah Bhat, Kalimullah Bhat et al.•Economic Research-Ekonomska…•2020

  Incluir item