IDEAS home Printed from https://ideas.repec.org/a/spr/stpapr/v63y2022i1d10.1007_s00362-021-01227-2.html
   My bibliography  Save this article

Robust estimation and shrinkage in ultrahigh dimensional expectile regression with heavy tails and variance heterogeneity

Author

Listed:
  • Jun Zhao

    (Zhejiang University City College)

  • Guan’ao Yan

    (Zhejiang University)

  • Yi Zhang

    (Zhejiang University)

Abstract

High-dimensional data subject to heavy-tailed phenomena and heterogeneity are commonly encountered in various scientific fields and bring new challenges to the classical statistical methods. In this paper, we combine the asymmetric square loss and huber-type robust technique to develop the robust expectile regression for ultrahigh dimensional heavy-tailed heterogeneous data. Different from the classical huber method, we introduce two different tuning parameters on both sides to account for possibly asymmetry and allow them to diverge to reduce bias induced by the robust approximation. In the regularized framework, we adopt the generally folded concave penalty function like the SCAD or MCP penalty for the seek of bias reduction. We investigate the finite sample property of the corresponding estimator and figure out how our method plays its role to trade off the estimation accuracy against the heavy-tailed distribution. Also, based on our theoretical study, we propose an efficient first-order optimization algorithm after locally linear approximation of the non-convex problem. Simulation studies under various distributions and a real data example demonstrate the satisfactory performances of our method in coefficient estimation, model selection and heterogeneity detection.

Suggested Citation

  • Jun Zhao & Guan’ao Yan & Yi Zhang, 2022. "Robust estimation and shrinkage in ultrahigh dimensional expectile regression with heavy tails and variance heterogeneity," Statistical Papers, Springer, vol. 63(1), pages 1-28, February.
  • Handle: RePEc:spr:stpapr:v:63:y:2022:i:1:d:10.1007_s00362-021-01227-2
    DOI: 10.1007/s00362-021-01227-2
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s00362-021-01227-2
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s00362-021-01227-2?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Murray Aitkin, 1987. "Modelling Variance Heterogeneity in Normal Regression Using GLIM," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 36(3), pages 332-339, November.
    2. Kim, Minjo & Lee, Sangyeol, 2016. "Nonlinear expectile regression with application to Value-at-Risk and expected shortfall estimation," Computational Statistics & Data Analysis, Elsevier, vol. 94(C), pages 1-19.
    3. Fan J. & Li R., 2001. "Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 1348-1360, December.
    4. Yao, Qiwei & Tong, Howell, 1996. "Asymmetric least squares regression estimation: a nonparametric approach," LSE Research Online Documents on Economics 19423, London School of Economics and Political Science, LSE Library.
    5. Chaohui Guo & Hu Yang & Jing Lv, 2017. "Robust variable selection in high-dimensional varying coefficient models based on weighted composite quantile regression," Statistical Papers, Springer, vol. 58(4), pages 1009-1033, December.
    6. Aigner, D J & Amemiya, Takeshi & Poirier, Dale J, 1976. "On the Estimation of Production Frontiers: Maximum Likelihood Estimation of the Parameters of a Discontinuous Density Function," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 17(2), pages 377-396, June.
    7. Jianqing Fan & Quefeng Li & Yuyan Wang, 2017. "Estimation of high dimensional mean regression in the absence of symmetry and light tail assumptions," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 79(1), pages 247-265, January.
    8. Johanna F. Ziegel, 2016. "Coherence And Elicitability," Mathematical Finance, Wiley Blackwell, vol. 26(4), pages 901-918, October.
    9. Zhao, Jun & Chen, Yingyu & Zhang, Yi, 2018. "Expectile regression for analyzing heteroscedasticity in high dimension," Statistics & Probability Letters, Elsevier, vol. 137(C), pages 304-311.
    10. Smucler, Ezequiel & Yohai, Victor J., 2017. "Robust and sparse estimators for linear regression models," Computational Statistics & Data Analysis, Elsevier, vol. 111(C), pages 116-130.
    11. Sobotka, Fabian & Kneib, Thomas, 2012. "Geoadditive expectile regression," Computational Statistics & Data Analysis, Elsevier, vol. 56(4), pages 755-767.
    12. Newey, Whitney K & Powell, James L, 1987. "Asymmetric Least Squares Estimation and Testing," Econometrica, Econometric Society, vol. 55(4), pages 819-847, July.
    13. Lan Wang & Yichao Wu & Runze Li, 2012. "Quantile Regression for Analyzing Heterogeneity in Ultra-High Dimension," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 107(497), pages 214-222, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zhao, Jun & Chen, Yingyu & Zhang, Yi, 2018. "Expectile regression for analyzing heteroscedasticity in high dimension," Statistics & Probability Letters, Elsevier, vol. 137(C), pages 304-311.
    2. Man, Rebeka & Tan, Kean Ming & Wang, Zian & Zhou, Wen-Xin, 2024. "Retire: Robust expectile regression in high dimensions," Journal of Econometrics, Elsevier, vol. 239(2).
    3. Zhang, Feipeng & Xu, Yixiong & Fan, Caiyun, 2023. "Nonparametric inference of expectile-based value-at-risk for financial time series with application to risk assessment," International Review of Financial Analysis, Elsevier, vol. 90(C).
    4. Bonaccolto, Giovanni & Caporin, Massimiliano & Maillet, Bertrand B., 2022. "Dynamic large financial networks via conditional expected shortfalls," European Journal of Operational Research, Elsevier, vol. 298(1), pages 322-336.
    5. Zhang, Feipeng & Li, Qunhua, 2017. "A continuous threshold expectile model," Computational Statistics & Data Analysis, Elsevier, vol. 116(C), pages 49-66.
    6. Yundong Tu & Siwei Wang, 2023. "Variable Screening and Model Averaging for Expectile Regressions," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 85(3), pages 574-598, June.
    7. Garcia-Jorcano, Laura & Sanchis-Marco, Lidia, 2022. "Spillover effects between commodity and stock markets: A SDSES approach," Resources Policy, Elsevier, vol. 79(C).
    8. Wang, Bingling & Li, Yingxing & Härdle, Wolfgang Karl, 2022. "K-expectiles clustering," Journal of Multivariate Analysis, Elsevier, vol. 189(C).
    9. Mohammedi, Mustapha & Bouzebda, Salim & Laksaci, Ali, 2021. "The consistency and asymptotic normality of the kernel type expectile regression estimator for functional data," Journal of Multivariate Analysis, Elsevier, vol. 181(C).
    10. Taoufik Bouezmarni & Mohamed Doukali & Abderrahim Taamouti, 2024. "Testing Granger non-causality in expectiles," Econometric Reviews, Taylor & Francis Journals, vol. 43(1), pages 30-51, January.
    11. Lina Liao & Cheolwoo Park & Hosik Choi, 2019. "Penalized expectile regression: an alternative to penalized quantile regression," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 71(2), pages 409-438, April.
    12. Kneib, Thomas & Silbersdorff, Alexander & Säfken, Benjamin, 2023. "Rage Against the Mean – A Review of Distributional Regression Approaches," Econometrics and Statistics, Elsevier, vol. 26(C), pages 99-123.
    13. Collin Philipps, 2022. "Interpreting Expectiles," Working Papers 2022-01, Department of Economics and Geosciences, US Air Force Academy.
    14. Gao, Suhao & Yu, Zhen, 2023. "Parametric expectile regression and its application for premium calculation," Insurance: Mathematics and Economics, Elsevier, vol. 111(C), pages 242-256.
    15. Wang, Yibo & Karunamuni, Rohana J., 2022. "High-dimensional robust regression with Lq-loss functions," Computational Statistics & Data Analysis, Elsevier, vol. 176(C).
    16. Ibrahim M. Almanjahie & Salim Bouzebda & Zoulikha Kaid & Ali Laksaci, 2024. "The local linear functional kNN estimator of the conditional expectile: uniform consistency in number of neighbors," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 87(8), pages 1007-1035, November.
    17. Otto-Sobotka, Fabian & Salvati, Nicola & Ranalli, Maria Giovanna & Kneib, Thomas, 2019. "Adaptive semiparametric M-quantile regression," Econometrics and Statistics, Elsevier, vol. 11(C), pages 116-129.
    18. Umberto Amato & Anestis Antoniadis & Italia De Feis & Irene Gijbels, 2021. "Penalised robust estimators for sparse and high-dimensional linear models," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 30(1), pages 1-48, March.
    19. Daouia, Abdelaati & Girard, Stéphane & Stupfler, Gilles, 2018. "Tail expectile process and risk assessment," TSE Working Papers 18-944, Toulouse School of Economics (TSE).
    20. Daouia, Abdelaati & Girard, Stéphane & Stupfler, Gilles, 2017. "Extreme M-quantiles as risk measures: From L1 to Lp optimization," TSE Working Papers 17-841, Toulouse School of Economics (TSE).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:stpapr:v:63:y:2022:i:1:d:10.1007_s00362-021-01227-2. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.