IDEAS home Printed from https://ideas.repec.org/a/spr/aistmt/v71y2019i2d10.1007_s10463-018-0645-1.html
   My bibliography  Save this article

Penalized expectile regression: an alternative to penalized quantile regression

Author

Listed:
  • Lina Liao

    (University of Georgia)

  • Cheolwoo Park

    (University of Georgia)

  • Hosik Choi

    (Kyonggi University)

Abstract

This paper concerns the study of the entire conditional distribution of a response given predictors in a heterogeneous regression setting. A common approach to address heterogeneous data is quantile regression, which utilizes the minimization of the $$L_1$$ L 1 norm. As an alternative to quantile regression, we consider expectile regression, which relies on the minimization of the asymmetric $$L_2$$ L 2 norm and detects heteroscedasticity effectively. We assume that only a small set of predictors is relevant to the response and develop penalized expectile regression with SCAD and adaptive LASSO penalties. With properly chosen tuning parameters, we show that the proposed estimators display oracle properties. A numerical study using simulated and real examples demonstrates the competitive performance of the proposed penalized expectile regression, and its combined use with penalized quantile regression would be helpful and recommended for practitioners.

Suggested Citation

  • Lina Liao & Cheolwoo Park & Hosik Choi, 2019. "Penalized expectile regression: an alternative to penalized quantile regression," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 71(2), pages 409-438, April.
    • Handle: RePEc:spr:aistmt:v:71:y:2019:i:2:d:10.1007_s10463-018-0645-1
    DOI: 10.1007/s10463-018-0645-1
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10463-018-0645-1
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s10463-018-0645-1?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Zou, Hui, 2006. "The Adaptive Lasso and Its Oracle Properties," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 1418-1429, December.
    2. Kuan, Chung-Ming & Yeh, Jin-Huei & Hsu, Yu-Chin, 2009. "Assessing value at risk with CARE, the Conditional Autoregressive Expectile models," Journal of Econometrics, Elsevier, vol. 150(2), pages 261-270, June.
    3. A. Belloni & V. Chernozhukov & K. Kato, 2015. "Uniform post-selection inference for least absolute deviation regression and other Z-estimation problems," Biometrika, Biometrika Trust, vol. 102(1), pages 77-94.
    4. Kim, Yongdai & Choi, Hosik & Oh, Hee-Seok, 2008. "Smoothly Clipped Absolute Deviation on High Dimensions," Journal of the American Statistical Association, American Statistical Association, vol. 103(484), pages 1665-1673.
    5. Fan J. & Li R., 2001. "Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 1348-1360, December.
    6. Harrison, David Jr. & Rubinfeld, Daniel L., 1978. "Hedonic housing prices and the demand for clean air," Journal of Environmental Economics and Management, Elsevier, vol. 5(1), pages 81-102, March.
    7. Johanna F. Ziegel, 2013. "Coherence and elicitability," Papers 1303.1690, arXiv.org, revised Mar 2014.
    8. Koenker, Roger W & Bassett, Gilbert, Jr, 1978. "Regression Quantiles," Econometrica, Econometric Society, vol. 46(1), pages 33-50, January.
    9. Koenker, Roger & Mizera, Ivan, 2014. "Convex Optimization in R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 60(i05).
    10. Schnabel, Sabine K. & Eilers, Paul H.C., 2009. "Optimal expectile smoothing," Computational Statistics & Data Analysis, Elsevier, vol. 53(12), pages 4168-4177, October.
    11. Aigner, D J & Amemiya, Takeshi & Poirier, Dale J, 1976. "On the Estimation of Production Frontiers: Maximum Likelihood Estimation of the Parameters of a Discontinuous Density Function," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 17(2), pages 377-396, June.
    12. Jones, M. C., 1994. "Expectiles and M-quantiles are quantiles," Statistics & Probability Letters, Elsevier, vol. 20(2), pages 149-153, May.
    13. Fabian Sobotka & Rosalba Radice & Giampiero Marra & Thomas Kneib, 2013. "Estimating the relationship between women's education and fertility in Botswana by using an instrumental variable approach to semiparametric expectile regression," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 62(1), pages 25-45, January.
    14. Newey, Whitney K & Powell, James L, 1987. "Asymmetric Least Squares Estimation and Testing," Econometrica, Econometric Society, vol. 55(4), pages 819-847, July.
    15. Lan Wang & Yichao Wu & Runze Li, 2012. "Quantile Regression for Analyzing Heterogeneity in Ultra-High Dimension," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 107(497), pages 214-222, March.
    16. Cun-Hui Zhang & Stephanie S. Zhang, 2014. "Confidence intervals for low dimensional parameters in high dimensional linear models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 76(1), pages 217-242, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ciuperca, Gabriela, 2021. "Variable selection in high-dimensional linear model with possibly asymmetric errors," Computational Statistics & Data Analysis, Elsevier, vol. 155(C).
    2. Yundong Tu & Siwei Wang, 2023. "Variable Screening and Model Averaging for Expectile Regressions," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 85(3), pages 574-598, June.
    3. Yu, Ping & Song, Xinyuan & Du, Jiang, 2024. "Composite expectile estimation in partial functional linear regression model," Journal of Multivariate Analysis, Elsevier, vol. 203(C).
    4. Li, Xiang & Li, Yu-Ning & Zhang, Li-Xin & Zhao, Jun, 2024. "Inference for high-dimensional linear expectile regression with de-biasing method," Computational Statistics & Data Analysis, Elsevier, vol. 198(C).
    5. Bonaccolto, Giovanni & Caporin, Massimiliano & Maillet, Bertrand B., 2022. "Dynamic large financial networks via conditional expected shortfalls," European Journal of Operational Research, Elsevier, vol. 298(1), pages 322-336.
    6. Gabriela Ciuperca, 2022. "Real-time detection of a change-point in a linear expectile model," Statistical Papers, Springer, vol. 63(4), pages 1323-1367, August.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zhao, Jun & Chen, Yingyu & Zhang, Yi, 2018. "Expectile regression for analyzing heteroscedasticity in high dimension," Statistics & Probability Letters, Elsevier, vol. 137(C), pages 304-311.
    2. Man, Rebeka & Tan, Kean Ming & Wang, Zian & Zhou, Wen-Xin, 2024. "Retire: Robust expectile regression in high dimensions," Journal of Econometrics, Elsevier, vol. 239(2).
    3. Fan, Zengyan & Lian, Heng, 2018. "Quantile regression for additive coefficient models in high dimensions," Journal of Multivariate Analysis, Elsevier, vol. 164(C), pages 54-64.
    4. Zhang, Feipeng & Li, Qunhua, 2017. "A continuous threshold expectile model," Computational Statistics & Data Analysis, Elsevier, vol. 116(C), pages 49-66.
    5. Gao, Suhao & Yu, Zhen, 2023. "Parametric expectile regression and its application for premium calculation," Insurance: Mathematics and Economics, Elsevier, vol. 111(C), pages 242-256.
    6. Kean Ming Tan & Lan Wang & Wen‐Xin Zhou, 2022. "High‐dimensional quantile regression: Convolution smoothing and concave regularization," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 84(1), pages 205-233, February.
    7. Alvaro Mendez-Civieta & M. Carmen Aguilera-Morillo & Rosa E. Lillo, 2021. "Adaptive sparse group LASSO in quantile regression," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 15(3), pages 547-573, September.
    8. Mohammedi, Mustapha & Bouzebda, Salim & Laksaci, Ali, 2021. "The consistency and asymptotic normality of the kernel type expectile regression estimator for functional data," Journal of Multivariate Analysis, Elsevier, vol. 181(C).
    9. Shangyu Xie & Yong Zhou & Alan T. K. Wan, 2014. "A Varying-Coefficient Expectile Model for Estimating Value at Risk," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 32(4), pages 576-592, October.
    10. Otto-Sobotka, Fabian & Salvati, Nicola & Ranalli, Maria Giovanna & Kneib, Thomas, 2019. "Adaptive semiparametric M-quantile regression," Econometrics and Statistics, Elsevier, vol. 11(C), pages 116-129.
    11. Litimein, Ouahiba & Laksaci, Ali & Mechab, Boubaker & Bouzebda, Salim, 2023. "Local linear estimate of the functional expectile regression," Statistics & Probability Letters, Elsevier, vol. 192(C).
    12. Tang, Yanlin & Song, Xinyuan & Wang, Huixia Judy & Zhu, Zhongyi, 2013. "Variable selection in high-dimensional quantile varying coefficient models," Journal of Multivariate Analysis, Elsevier, vol. 122(C), pages 115-132.
    13. Daouia, Abdelaati & Paindaveine, Davy, 2019. "Multivariate Expectiles, Expectile Depth and Multiple-Output Expectile Regression," TSE Working Papers 19-1022, Toulouse School of Economics (TSE), revised Feb 2023.
    14. Lan Wang & Yichao Wu & Runze Li, 2012. "Quantile Regression for Analyzing Heterogeneity in Ultra-High Dimension," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 107(497), pages 214-222, March.
    15. Hamidi, Benjamin & Maillet, Bertrand & Prigent, Jean-Luc, 2014. "A dynamic autoregressive expectile for time-invariant portfolio protection strategies," Journal of Economic Dynamics and Control, Elsevier, vol. 46(C), pages 1-29.
    16. Bellini, Fabio & Klar, Bernhard & Müller, Alfred & Rosazza Gianin, Emanuela, 2014. "Generalized quantiles as risk measures," Insurance: Mathematics and Economics, Elsevier, vol. 54(C), pages 41-48.
    17. Sokbae Lee & Myung Hwan Seo & Youngki Shin, 2016. "The lasso for high dimensional regression with a possible change point," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 78(1), pages 193-210, January.
    18. Abdelaati Daouia & Simone A. Padoan & Gilles Stupfler, 2024. "Extreme expectile estimation for short-tailed data," Post-Print hal-04672516, HAL.
    19. Wang, Bingling & Li, Yingxing & Härdle, Wolfgang Karl, 2022. "K-expectiles clustering," Journal of Multivariate Analysis, Elsevier, vol. 189(C).
    20. Bonaccolto, Giovanni & Caporin, Massimiliano & Maillet, Bertrand B., 2022. "Dynamic large financial networks via conditional expected shortfalls," European Journal of Operational Research, Elsevier, vol. 298(1), pages 322-336.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:aistmt:v:71:y:2019:i:2:d:10.1007_s10463-018-0645-1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.