IDEAS home Printed from https://ideas.repec.org/a/spr/advdac/v15y2021i4d10.1007_s11634-021-00439-6.html
   My bibliography  Save this article

Nonlinear dimension reduction for conditional quantiles

Author

Listed:
  • Eliana Christou

    (University of North Carolina at Charlotte)

  • Annabel Settle

    (University of North Carolina at Charlotte)

  • Andreas Artemiou

    (Cardiff University)

Abstract

In practice, data often display heteroscedasticity, making quantile regression (QR) a more appropriate methodology. Modeling the data, while maintaining a flexible nonparametric fitting, requires smoothing over a high-dimensional space which might not be feasible when the number of the predictor variables is large. This problem makes necessary the use of dimension reduction techniques for conditional quantiles, which focus on extracting linear combinations of the predictor variables without losing any information about the conditional quantile. However, nonlinear features can achieve greater dimension reduction. We, therefore, present the first nonlinear extension of the linear algorithm for estimating the central quantile subspace (CQS) using kernel data. First, we describe the feature CQS within the framework of reproducing kernel Hilbert space, and second, we illustrate its performance through simulation examples and real data applications. Specifically, we emphasize on visualizing various aspects of the data structure using the first two feature extractors, and we highlight the ability to combine the proposed algorithm with classification and regression linear algorithms. The results show that the feature CQS is an effective kernel tool for performing nonlinear dimension reduction for conditional quantiles.

Suggested Citation

  • Eliana Christou & Annabel Settle & Andreas Artemiou, 2021. "Nonlinear dimension reduction for conditional quantiles," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 15(4), pages 937-956, December.
  • Handle: RePEc:spr:advdac:v:15:y:2021:i:4:d:10.1007_s11634-021-00439-6
    DOI: 10.1007/s11634-021-00439-6
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11634-021-00439-6
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11634-021-00439-6?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Guerre, Emmanuel & Sabbah, Camille, 2012. "Uniform Bias Study And Bahadur Representation For Local Polynomial Estimators Of The Conditional Quantile Function," Econometric Theory, Cambridge University Press, vol. 28(1), pages 87-129, February.
    2. Wu, Tracy Z. & Yu, Keming & Yu, Yan, 2010. "Single-index quantile regression," Journal of Multivariate Analysis, Elsevier, vol. 101(7), pages 1607-1621, August.
    3. Harrison, David Jr. & Rubinfeld, Daniel L., 1978. "Hedonic housing prices and the demand for clean air," Journal of Environmental Economics and Management, Elsevier, vol. 5(1), pages 81-102, March.
    4. Koenker, Roger W & Bassett, Gilbert, Jr, 1978. "Regression Quantiles," Econometrica, Econometric Society, vol. 46(1), pages 33-50, January.
    5. Kong, Efang & Xia, Yingcun, 2012. "A Single-Index Quantile Regression Model And Its Estimation," Econometric Theory, Cambridge University Press, vol. 28(4), pages 730-768, August.
    6. Qiang Wu & Feng Liang & Sayan Mukherjee, 2013. "Kernel Sliced Inverse Regression: Regularization and Consistency," Abstract and Applied Analysis, Hindawi, vol. 2013, pages 1-11, July.
    7. Kong, Efang & Linton, Oliver & Xia, Yingcun, 2010. "Uniform Bahadur Representation For Local Polynomial Estimates Of M-Regression And Its Application To The Additive Model," Econometric Theory, Cambridge University Press, vol. 26(5), pages 1529-1564, October.
    8. Gregory Kordas, 2006. "Smoothed binary regression quantiles," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 21(3), pages 387-407, April.
    9. Zhu, Li-Ping & Zhu, Li-Xing & Feng, Zheng-Hui, 2010. "Dimension Reduction in Regressions Through Cumulative Slicing Estimation," Journal of the American Statistical Association, American Statistical Association, vol. 105(492), pages 1455-1466.
    10. Opsomer, Jean D. & Ruppert, D., 1998. "A Fully Automated Bandwidth Selection Method for Fitting Additive Models," Staff General Research Papers Archive 1176, Iowa State University, Department of Economics.
    11. Gregory Kordas, 2006. "Smoothed binary regression quantiles," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 21(3), pages 387-407.
    12. Christou, Eliana & Akritas, Michael G., 2016. "Single index quantile regression for heteroscedastic data," Journal of Multivariate Analysis, Elsevier, vol. 150(C), pages 169-182.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Christou, Eliana & Akritas, Michael G., 2016. "Single index quantile regression for heteroscedastic data," Journal of Multivariate Analysis, Elsevier, vol. 150(C), pages 169-182.
    2. Eliana Christou & Michael G. Akritas, 2019. "Single index quantile regression for censored data," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 28(4), pages 655-678, December.
    3. Zhao, Weihua & Lian, Heng, 2017. "Quantile index coefficient model with variable selection," Journal of Multivariate Analysis, Elsevier, vol. 154(C), pages 40-58.
    4. Zhao, Weihua & Zhou, Yan & Lian, Heng, 2018. "Time-varying quantile single-index model for multivariate responses," Computational Statistics & Data Analysis, Elsevier, vol. 127(C), pages 32-49.
    5. Fan, Yanqin & Liu, Ruixuan, 2016. "A direct approach to inference in nonparametric and semiparametric quantile models," Journal of Econometrics, Elsevier, vol. 191(1), pages 196-216.
    6. Bucher, Axel & El Ghouch, Anouar & Van Keilegom, Ingrid, 2014. "Single-index quantile regression models for censored data," LIDAM Discussion Papers ISBA 2014001, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
    7. Ming-Yueh Huang & Chin-Tsang Chiang, 2017. "Estimation and Inference Procedures for Semiparametric Distribution Models with Varying Linear-Index," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 44(2), pages 396-424, June.
    8. Henry R. Scharf & Xinyi Lu & Perry J. Williams & Mevin B. Hooten, 2022. "Constructing Flexible, Identifiable and Interpretable Statistical Models for Binary Data," International Statistical Review, International Statistical Institute, vol. 90(2), pages 328-345, August.
    9. Yang, Jing & Tian, Guoliang & Lu, Fang & Lu, Xuewen, 2020. "Single-index modal regression via outer product gradients," Computational Statistics & Data Analysis, Elsevier, vol. 144(C).
    10. Belloni, Alexandre & Chernozhukov, Victor & Chetverikov, Denis & Fernández-Val, Iván, 2019. "Conditional quantile processes based on series or many regressors," Journal of Econometrics, Elsevier, vol. 213(1), pages 4-29.
    11. Bousebata, Meryem & Enjolras, Geoffroy & Girard, Stéphane, 2023. "Extreme partial least-squares," Journal of Multivariate Analysis, Elsevier, vol. 194(C).
    12. Jiang, Rong & Zhou, Zhan-Gong & Qian, Wei-Min & Chen, Yong, 2013. "Two step composite quantile regression for single-index models," Computational Statistics & Data Analysis, Elsevier, vol. 64(C), pages 180-191.
    13. Victor Chernozhukov & Iván Fernández-Val & Blaise Melly, 2022. "Fast algorithms for the quantile regression process," Empirical Economics, Springer, vol. 62(1), pages 7-33, January.
    14. Yazhao Lv & Riquan Zhang & Weihua Zhao & Jicai Liu, 2015. "Quantile regression and variable selection of partial linear single-index model," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 67(2), pages 375-409, April.
    15. Wu, Chaojiang & Yu, Yan, 2014. "Partially linear modeling of conditional quantiles using penalized splines," Computational Statistics & Data Analysis, Elsevier, vol. 77(C), pages 170-187.
    16. Kong, Efang & Linton, Oliver & Xia, Yingcun, 2013. "Global Bahadur Representation For Nonparametric Censored Regression Quantiles And Its Applications," Econometric Theory, Cambridge University Press, vol. 29(5), pages 941-968, October.
    17. Eliana Christou, 2020. "Robust dimension reduction using sliced inverse median regression," Statistical Papers, Springer, vol. 61(5), pages 1799-1818, October.
    18. Jiang, Rong & Qian, Wei-Min, 2016. "Quantile regression for single-index-coefficient regression models," Statistics & Probability Letters, Elsevier, vol. 110(C), pages 305-317.
    19. Rui Li & Yuanyuan Zhang, 2021. "Two-stage estimation and simultaneous confidence band in partially nonlinear additive model," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 84(8), pages 1109-1140, November.
    20. Lili Yue & Gaorong Li & Heng Lian, 2019. "Identification and estimation in quantile varying-coefficient models with unknown link function," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 28(4), pages 1251-1275, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:advdac:v:15:y:2021:i:4:d:10.1007_s11634-021-00439-6. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.