IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v192y2024ics0167947323002037.html
   My bibliography  Save this article

Efficient and robust optimal design for quantile regression based on linear programming

Author

Listed:
  • Peng, Cheng
  • Kouri, Drew P.
  • Uryasev, Stan

Abstract

When informing decisions with experimental data, it is often necessary to quantify the distribution tails of uncertain system responses using limited data. To maximize the information content of the data, one is naturally led to use experimental design. However, common design techniques minimize global statistics such as the average estimation or prediction variance. Novel methods for optimal experimental design that target distribution tails are developed. To achieve this, pre-asymptotic estimates of the data uncertainty are produced via an upper bound on a prescribed quantile, computed using quantile regression. Two optimal design problems are formulated: (i) Minimize the variance of the upper bound; and (ii) Minimize the Conditional Value-at-Risk of the upper bound. Additionally, each design problem is augmented with an added cardinality constraint to bound the number of experiments. These optimal design problems are reduced to continuous and mixed-integer linear programming problems. Consequently, the proposed methods are extremely efficient, even when applied to large datasets. The application of the proposed design formulation is demonstrated through a sensor placement problem in direct field acoustic testing.

Suggested Citation

  • Peng, Cheng & Kouri, Drew P. & Uryasev, Stan, 2024. "Efficient and robust optimal design for quantile regression based on linear programming," Computational Statistics & Data Analysis, Elsevier, vol. 192(C).
  • Handle: RePEc:eee:csdana:v:192:y:2024:i:c:s0167947323002037
    DOI: 10.1016/j.csda.2023.107892
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167947323002037
    Download Restriction: Full text for ScienceDirect subscribers only.

    File URL: https://libkey.io/10.1016/j.csda.2023.107892?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Michael Zabarankin & Stan Uryasev, 2014. "Portfolio Safeguard Case Studies," Springer Optimization and Its Applications, in: Statistical Decision Problems, edition 127, chapter 0, pages 133-240, Springer.
    2. Omprakash K. Gupta & A. Ravindran, 1985. "Branch and Bound Experiments in Convex Nonlinear Integer Programming," Management Science, INFORMS, vol. 31(12), pages 1533-1546, December.
    3. Acerbi, Carlo & Tasche, Dirk, 2002. "On the coherence of expected shortfall," Journal of Banking & Finance, Elsevier, vol. 26(7), pages 1487-1503, July.
    4. Matthew Norton & Valentyn Khokhlov & Stan Uryasev, 2021. "Calculating CVaR and bPOE for common probability distributions with application to portfolio optimization and density estimation," Annals of Operations Research, Springer, vol. 299(1), pages 1281-1315, April.
    5. Linglong Kong & Douglas P. Wiens, 2015. "Model-Robust Designs for Quantile Regression," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(509), pages 233-245, March.
    6. Koenker,Roger, 2005. "Quantile Regression," Cambridge Books, Cambridge University Press, number 9780521845731, September.
    7. Haiying Wang & Yanyuan Ma, 2021. "Optimal subsampling for quantile regression in big data," Biometrika, Biometrika Trust, vol. 108(1), pages 99-112.
    8. Harman, Radoslav & Jurík, Tomás, 2008. "Computing c-optimal experimental designs using the simplex method of linear programming," Computational Statistics & Data Analysis, Elsevier, vol. 53(2), pages 247-254, December.
    9. Holger Dette & Matthias Trampisch, 2012. "Optimal Designs for Quantile Regression Models," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 107(499), pages 1140-1151, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hamidi, Benjamin & Maillet, Bertrand & Prigent, Jean-Luc, 2014. "A dynamic autoregressive expectile for time-invariant portfolio protection strategies," Journal of Economic Dynamics and Control, Elsevier, vol. 46(C), pages 1-29.
    2. Leorato, Samantha & Peracchi, Franco & Tanase, Andrei V., 2012. "Asymptotically efficient estimation of the conditional expected shortfall," Computational Statistics & Data Analysis, Elsevier, vol. 56(4), pages 768-784.
    3. Johanna F. Ziegel, 2013. "Coherence and elicitability," Papers 1303.1690, arXiv.org, revised Mar 2014.
    4. Franco Peracchi & Andrei V. Tanase, 2008. "On estimating the conditional expected shortfall," Applied Stochastic Models in Business and Industry, John Wiley & Sons, vol. 24(5), pages 471-493, September.
    5. Francq, Christian & Zakoïan, Jean-Michel, 2015. "Risk-parameter estimation in volatility models," Journal of Econometrics, Elsevier, vol. 184(1), pages 158-173.
    6. Man, Rebeka & Tan, Kean Ming & Wang, Zian & Zhou, Wen-Xin, 2024. "Retire: Robust expectile regression in high dimensions," Journal of Econometrics, Elsevier, vol. 239(2).
    7. So Yeon Chun & Alexander Shapiro & Stan Uryasev, 2012. "Conditional Value-at-Risk and Average Value-at-Risk: Estimation and Asymptotics," Operations Research, INFORMS, vol. 60(4), pages 739-756, August.
    8. Yujing Shao & Lei Wang, 2022. "Optimal subsampling for composite quantile regression model in massive data," Statistical Papers, Springer, vol. 63(4), pages 1139-1161, August.
    9. Linglong Kong & Douglas P. Wiens, 2015. "Model-Robust Designs for Quantile Regression," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(509), pages 233-245, March.
    10. Antonio Rubia Serrano & Lidia Sanchis-Marco, 2015. "Measuring Tail-Risk Cross-Country Exposures in the Banking Industry," Working Papers. Serie AD 2015-01, Instituto Valenciano de Investigaciones Económicas, S.A. (Ivie).
    11. Trindade, A. Alexandre & Uryasev, Stan & Shapiro, Alexander & Zrazhevsky, Grigory, 2007. "Financial prediction with constrained tail risk," Journal of Banking & Finance, Elsevier, vol. 31(11), pages 3524-3538, November.
    12. Winter, Peter, 2007. "Managerial Risk Accounting and Control – A German perspective," MPRA Paper 8185, University Library of Munich, Germany.
    13. Zhao, Zhibiao & Wu, Wei Biao, 2009. "Nonparametric inference of discretely sampled stable Lévy processes," Journal of Econometrics, Elsevier, vol. 153(1), pages 83-92, November.
    14. Alexandre Belloni & Victor Chernozhukov & Kengo Kato, 2019. "Valid Post-Selection Inference in High-Dimensional Approximately Sparse Quantile Regression Models," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 114(526), pages 749-758, April.
    15. Asongu, Simplice A. & Odhiambo, Nicholas M., 2021. "Inequality, finance and renewable energy consumption in Sub-Saharan Africa," Renewable Energy, Elsevier, vol. 165(P1), pages 678-688.
    16. Ichimura, Hidehiko & Todd, Petra E., 2007. "Implementing Nonparametric and Semiparametric Estimators," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 74, Elsevier.
    17. Benjamin Hofner & Andreas Mayr & Nikolay Robinzonov & Matthias Schmid, 2014. "Model-based boosting in R: a hands-on tutorial using the R package mboost," Computational Statistics, Springer, vol. 29(1), pages 3-35, February.
    18. repec:hal:wpspec:info:hdl:2441/5rkqqmvrn4tl22s9mc4b6ga2g is not listed on IDEAS
    19. Xiaohong Chen & Roger Koenker & Zhijie Xiao, 2009. "Copula-based nonlinear quantile autoregression," Econometrics Journal, Royal Economic Society, vol. 12(s1), pages 50-67, January.
    20. Juan Carlos Escanciano & Zaichao Du, 2015. "Backtesting Expected Shortfall: Accounting for Tail Risk," CAEPR Working Papers 2015-001, Center for Applied Economics and Policy Research, Department of Economics, Indiana University Bloomington.
    21. Giovanni Bonaccolto & Massimiliano Caporin & Sandra Paterlini, 2018. "Asset allocation strategies based on penalized quantile regression," Computational Management Science, Springer, vol. 15(1), pages 1-32, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:192:y:2024:i:c:s0167947323002037. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.