IDEAS home Printed from https://ideas.repec.org/p/siu/wpaper/11-2014.html
   My bibliography  Save this paper

Jackknife Model Averaging for Quantile Regressions

Author

Listed:
  • Xun Lu

    (Department of Finance, Hong Kong University of Science and Technology)

  • Liangjun Su

    (School of Economics, Singapore Management University, Singapore, 178903)

Abstract

In this paper we consider the problem of frequentist model averaging for quantile regression (QR) when all the M models under investigation are potentially misspecified and the number of parameters in some or all models is diverging with the sample size n. To allow for the dependence between the error terms and the regressors in the QR models, we propose a jackknife model averaging (JMA) estimator which selects the weights by minimizing a leave-one-out cross-validation criterion function and demonstrate that the jackknife selected weight vector is asymptotically optimal in terms of minimizing the out-of-sample final prediction error among the given set of weight vectors. We conduct Monte Carlo simulations to demonstrate the finite-sample performance of the proposed JMA QR estimator and compare it with other model selection and averaging methods. We find that in terms of out-of-sample forecasting, the JMA QR estimator can achieve significant efficiency gains over the other methods, especially for extreme quantiles. We apply our JMA method to forecast quantiles of excess stock returns and wages.

Suggested Citation

  • Xun Lu & Liangjun Su, 2014. "Jackknife Model Averaging for Quantile Regressions," Working Papers 11-2014, Singapore Management University, School of Economics.
  • Handle: RePEc:siu:wpaper:11-2014
    as

    Download full text from publisher

    File URL: https://mercury.smu.edu.sg/rsrchpubupload/20336/10-2014.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Ivo Welch & Amit Goyal, 2008. "A Comprehensive Look at The Empirical Performance of Equity Premium Prediction," The Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1455-1508, July.
    2. Wayne E. Ferson & Campbell R. Harvey, 1999. "Conditioning Variables and the Cross Section of Stock Returns," Journal of Finance, American Finance Association, vol. 54(4), pages 1325-1360, August.
    3. Michael C. Jensen, 1968. "The Performance Of Mutual Funds In The Period 1945–1964," Journal of Finance, American Finance Association, vol. 23(2), pages 389-416, May.
    4. Ang, Andrew & Kristensen, Dennis, 2012. "Testing conditional factor models," Journal of Financial Economics, Elsevier, vol. 106(1), pages 132-156.
    5. Qi Gao & Jingping Gu & Paula Hernandez-Verme, 2012. "A Semiparametric Time Trend Varying Coefficients Model: With An Application to Evaluate Credit Rationing in U.S. Credit Market," Annals of Economics and Finance, Society for AEF, vol. 13(1), pages 189-210, May.
    6. Hurvich, Clifford M. & Tsai, Chih-Ling, 1990. "Model selection for least absolute deviations regression in small samples," Statistics & Probability Letters, Elsevier, vol. 9(3), pages 259-265, March.
    7. Davidson, James, 1994. "Stochastic Limit Theory: An Introduction for Econometricians," OUP Catalogue, Oxford University Press, number 9780198774037.
    8. Guido Kuersteiner & Ryo Okui, 2010. "Constructing Optimal Instruments by First-Stage Prediction Averaging," Econometrica, Econometric Society, vol. 78(2), pages 697-718, March.
    9. Stefan Nagel & Kenneth J. Singleton, 2011. "Estimation and Evaluation of Conditional Asset Pricing Models," Journal of Finance, American Finance Association, vol. 66(3), pages 873-909, June.
    10. Keith Kuester & Stefan Mittnik & Marc S. Paolella, 2006. "Value-at-Risk Prediction: A Comparison of Alternative Strategies," Journal of Financial Econometrics, Oxford University Press, vol. 4(1), pages 53-89.
    11. Yuan, Zheng & Yang, Yuhong, 2005. "Combining Linear Regression Models: When and How?," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 1202-1214, December.
    12. Hanno N. Lustig & Stijn G. Van Nieuwerburgh, 2005. "Housing Collateral, Consumption Insurance, and Risk Premia: An Empirical Perspective," Journal of Finance, American Finance Association, vol. 60(3), pages 1167-1219, June.
    13. repec:bla:jfinan:v:53:y:1998:i:2:p:549-573 is not listed on IDEAS
    14. Roussanov, Nikolai, 2014. "Composition of wealth, conditioning information, and the cross-section of stock returns," Journal of Financial Economics, Elsevier, vol. 111(2), pages 352-380.
    15. Jianhua Z. Huang & Haipeng Shen, 2004. "Functional Coefficient Regression Models for Non‐linear Time Series: A Polynomial Spline Approach," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 31(4), pages 515-534, December.
    16. Ait-Sahalia, Yacine & Duarte, Jefferson, 2003. "Nonparametric option pricing under shape restrictions," Journal of Econometrics, Elsevier, vol. 116(1-2), pages 9-47.
    17. Dybvig, Philip H & Ross, Stephen A, 1985. "The Analytics of Performance Measurement Using a Security Market Line," Journal of Finance, American Finance Association, vol. 40(2), pages 401-416, June.
    18. Borak, Szymon & Weron, Rafal, 2008. "A semiparametric factor model for electricity forward curve dynamics," MPRA Paper 10421, University Library of Munich, Germany.
    19. Ng, Serena, 2013. "Variable Selection in Predictive Regressions," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 752-789, Elsevier.
    20. Joshua D. Angrist & Jörn-Steffen Pischke, 2009. "Mostly Harmless Econometrics: An Empiricist's Companion," Economics Books, Princeton University Press, edition 1, number 8769.
    21. Hwang, Eunju & Shin, Dong Wan, 2012. "Stationary bootstrap for kernel density estimators under ψ-weak dependence," Computational Statistics & Data Analysis, Elsevier, vol. 56(6), pages 1581-1593.
    22. Koenker,Roger, 2005. "Quantile Regression," Cambridge Books, Cambridge University Press, number 9780521845731.
    23. Hansen, Bruce E., 2008. "Least-squares forecast averaging," Journal of Econometrics, Elsevier, vol. 146(2), pages 342-350, October.
    24. Qingfeng Liu & Ryo Okui, 2013. "Heteroscedasticity‐robust C(p) model averaging," Econometrics Journal, Royal Economic Society, vol. 16(3), pages 463-472, October.
    25. Hansen, Bruce E., 2010. "Averaging estimators for autoregressions with a near unit root," Journal of Econometrics, Elsevier, vol. 158(1), pages 142-155, September.
    26. Andrews, Donald W. K., 1991. "Asymptotic optimality of generalized CL, cross-validation, and generalized cross-validation in regression with heteroskedastic errors," Journal of Econometrics, Elsevier, vol. 47(2-3), pages 359-377, February.
    27. Kapetanios, George & Labhard, Vincent & Price, Simon, 2008. "Forecasting Using Bayesian and Information-Theoretic Model Averaging: An Application to U.K. Inflation," Journal of Business & Economic Statistics, American Statistical Association, vol. 26, pages 33-41, January.
    28. Racine, Jeffrey & Su, Liangjun & Ullah, Aman, 2014. "The Oxford Handbook of Applied Nonparametric and Semiparametric Econometrics and Statistics," OUP Catalogue, Oxford University Press, number 9780199857944.
    29. Sainan Jin & Liangjun Su & Aman Ullah, 2014. "Robustify Financial Time Series Forecasting with Bagging," Econometric Reviews, Taylor & Francis Journals, vol. 33(5-6), pages 575-605, August.
    30. Fan, Yanqin & Ullah, Aman, 1999. "Asymptotic Normality of a Combined Regression Estimator," Journal of Multivariate Analysis, Elsevier, vol. 71(2), pages 191-240, November.
    31. Liu, Chu-An, 2015. "Distribution theory of the least squares averaging estimator," Journal of Econometrics, Elsevier, vol. 186(1), pages 142-159.
    32. Bollerslev, Tim & Engle, Robert F & Wooldridge, Jeffrey M, 1988. "A Capital Asset Pricing Model with Time-Varying Covariances," Journal of Political Economy, University of Chicago Press, vol. 96(1), pages 116-131, February.
    33. Hansen, Bruce E., 2008. "Uniform Convergence Rates For Kernel Estimation With Dependent Data," Econometric Theory, Cambridge University Press, vol. 24(3), pages 726-748, June.
    34. Ferson, Wayne E & Korajczyk, Robert A, 1995. "Do Arbitrage Pricing Models Explain the Predictability of Stock Returns?," The Journal of Business, University of Chicago Press, vol. 68(3), pages 309-349, July.
    35. Bansal, Ravi & Viswanathan, S, 1993. "No Arbitrage and Arbitrage Pricing: A New Approach," Journal of Finance, American Finance Association, vol. 48(4), pages 1231-1262, September.
    36. Ross, Stephen A, 1977. "The Capital Asset Pricing Model (CAPM), Short-Sale Restrictions and Related Issues," Journal of Finance, American Finance Association, vol. 32(1), pages 177-183, March.
    37. Shanken, Jay, 1990. "Intertemporal asset pricing : An Empirical Investigation," Journal of Econometrics, Elsevier, vol. 45(1-2), pages 99-120.
    38. Gao, Jiti, 2007. "Nonlinear time series: semiparametric and nonparametric methods," MPRA Paper 39563, University Library of Munich, Germany, revised 01 Sep 2007.
    39. Koenker, Roger W & Bassett, Gilbert, Jr, 1978. "Regression Quantiles," Econometrica, Econometric Society, vol. 46(1), pages 33-50, January.
    40. John Y. Campbell & Samuel B. Thompson, 2008. "Predicting Excess Stock Returns Out of Sample: Can Anything Beat the Historical Average?," The Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1509-1531, July.
    41. Liangjun Su & Irina Murtazashvili & Aman Ullah, 2013. "Local Linear GMM Estimation of Functional Coefficient IV Models With an Application to Estimating the Rate of Return to Schooling," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 31(2), pages 184-207, April.
    42. Hansen, Bruce E., 2000. "Testing for structural change in conditional models," Journal of Econometrics, Elsevier, vol. 97(1), pages 93-115, July.
    43. Machado, José A.F., 1993. "Robust Model Selection and M-Estimation," Econometric Theory, Cambridge University Press, vol. 9(3), pages 478-493, June.
    44. Su, Liangjun & Ullah, Aman, 2013. "A Nonparametric Goodness-Of-Fit-Based Test For Conditional Heteroskedasticity," Econometric Theory, Cambridge University Press, vol. 29(1), pages 187-212, February.
    45. Zhang, Xinyu & Wan, Alan T.K. & Zou, Guohua, 2013. "Model averaging by jackknife criterion in models with dependent data," Journal of Econometrics, Elsevier, vol. 174(2), pages 82-94.
    46. Dybvig, Philip H & Ross, Stephen A, 1985. "Differential Information and Performance Measurement Using a Security Market Line," Journal of Finance, American Finance Association, vol. 40(2), pages 383-399, June.
    47. Lam, Clifford & Fan, Jianqing, 2008. "Profile-kernel likelihood inference with diverging number of parameters," LSE Research Online Documents on Economics 31548, London School of Economics and Political Science, LSE Library.
    48. Martin Lettau & Sydney Ludvigson, 2001. "Resurrecting the (C)CAPM: A Cross-Sectional Test When Risk Premia Are Time-Varying," Journal of Political Economy, University of Chicago Press, vol. 109(6), pages 1238-1287, December.
    49. Yang Y., 2001. "Adaptive Regression by Mixing," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 574-588, June.
    50. Fama, Eugene F. & French, Kenneth R., 1993. "Common risk factors in the returns on stocks and bonds," Journal of Financial Economics, Elsevier, vol. 33(1), pages 3-56, February.
    51. Koenker, Roger & Bassett, Gilbert, Jr, 1982. "Robust Tests for Heteroscedasticity Based on Regression Quantiles," Econometrica, Econometric Society, vol. 50(1), pages 43-61, January.
    52. Cai, Zongwu & Fan, Jianqing & Yao, Qiwei, 2000. "Functional-coefficient regression models for nonlinear time series," LSE Research Online Documents on Economics 6314, London School of Economics and Political Science, LSE Library.
    53. William F. Sharpe, 1964. "Capital Asset Prices: A Theory Of Market Equilibrium Under Conditions Of Risk," Journal of Finance, American Finance Association, vol. 19(3), pages 425-442, September.
    54. Hansen, Bruce E., 2009. "Averaging Estimators For Regressions With A Possible Structural Break," Econometric Theory, Cambridge University Press, vol. 25(6), pages 1498-1514, December.
    55. Wan, Alan T.K. & Zhang, Xinyu & Zou, Guohua, 2010. "Least squares model averaging by Mallows criterion," Journal of Econometrics, Elsevier, vol. 156(2), pages 277-283, June.
    56. Kevin Q. Wang, 2003. "Asset Pricing with Conditioning Information: A New Test," Journal of Finance, American Finance Association, vol. 58(1), pages 161-196, February.
    57. Claeskens,Gerda & Hjort,Nils Lid, 2008. "Model Selection and Model Averaging," Cambridge Books, Cambridge University Press, number 9780521852258, September.
    58. Cochrane, John H, 1996. "A Cross-Sectional Test of an Investment-Based Asset Pricing Model," Journal of Political Economy, University of Chicago Press, vol. 104(3), pages 572-621, June.
    59. Long, Xiangdong & Su, Liangjun & Ullah, Aman, 2011. "Estimation and Forecasting of Dynamic Conditional Covariance: A Semiparametric Multivariate Model," Journal of Business & Economic Statistics, American Statistical Association, vol. 29(1), pages 109-125.
    60. Joshua Angrist & Victor Chernozhukov & Iván Fernández-Val, 2006. "Quantile Regression under Misspecification, with an Application to the U.S. Wage Structure," Econometrica, Econometric Society, vol. 74(2), pages 539-563, March.
    61. Hansen, Bruce E. & Racine, Jeffrey S., 2012. "Jackknife model averaging," Journal of Econometrics, Elsevier, vol. 167(1), pages 38-46.
    62. Liang, Hua & Zou, Guohua & Wan, Alan T. K. & Zhang, Xinyu, 2011. "Optimal Weight Choice for Frequentist Model Average Estimators," Journal of the American Statistical Association, American Statistical Association, vol. 106(495), pages 1053-1066.
    63. Mishra, Santosh & Su, Liangjun & Ullah, Aman, 2010. "Semiparametric Estimator of Time Series Conditional Variance," Journal of Business & Economic Statistics, American Statistical Association, vol. 28(2), pages 256-274.
    64. Enrique Moral-Benito, 2015. "Model Averaging In Economics: An Overview," Journal of Economic Surveys, Wiley Blackwell, vol. 29(1), pages 46-75, February.
    65. repec:bla:jfinan:v:53:y:1998:i:2:p:499-547 is not listed on IDEAS
    66. Park, Byeong U. & Mammen, Enno & Härdle, Wolfgang & Borak, Szymon, 2009. "Time Series Modelling With Semiparametric Factor Dynamics," Journal of the American Statistical Association, American Statistical Association, vol. 104(485), pages 284-298.
    67. Pötscher, Benedikt M., 2006. "The Distribution of Model Averaging Estimators and an Impossibility Result Regarding Its Estimation," MPRA Paper 73, University Library of Munich, Germany, revised Jul 2006.
    68. Li, Yan & Yang, Liyan, 2011. "Testing conditional factor models: A nonparametric approach," Journal of Empirical Finance, Elsevier, vol. 18(5), pages 972-992.
    69. Elias Masry, 1996. "Multivariate Local Polynomial Regression For Time Series:Uniform Strong Consistency And Rates," Journal of Time Series Analysis, Wiley Blackwell, vol. 17(6), pages 571-599, November.
    70. Tano Santos & Pietro Veronesi, 2006. "Labor Income and Predictable Stock Returns," The Review of Financial Studies, Society for Financial Studies, vol. 19(1), pages 1-44.
    71. Bruce E. Hansen, 2007. "Least Squares Model Averaging," Econometrica, Econometric Society, vol. 75(4), pages 1175-1189, July.
    72. Tong, Howell & Yao, Qiwei, 1998. "Cross-validatory bandwidth selection for regression estimation based on dependent data," LSE Research Online Documents on Economics 6380, London School of Economics and Political Science, LSE Library.
    73. Clifford M. Hurvich & Jeffrey S. Simonoff & Chih‐Ling Tsai, 1998. "Smoothing parameter selection in nonparametric regression using an improved Akaike information criterion," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 60(2), pages 271-293.
    74. Pollard, David, 1991. "Asymptotics for Least Absolute Deviation Regression Estimators," Econometric Theory, Cambridge University Press, vol. 7(2), pages 186-199, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yan Li & Liangjun Su & Yuewu Xu, 2015. "A Combined Approach to the Inference of Conditional Factor Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 33(2), pages 203-220, April.
    2. Sun, Yuying & Hong, Yongmiao & Lee, Tae-Hwy & Wang, Shouyang & Zhang, Xinyu, 2021. "Time-varying model averaging," Journal of Econometrics, Elsevier, vol. 222(2), pages 974-992.
    3. Roussanov, Nikolai, 2014. "Composition of wealth, conditioning information, and the cross-section of stock returns," Journal of Financial Economics, Elsevier, vol. 111(2), pages 352-380.
    4. Aman Ullah & Huansha Wang, 2013. "Parametric and Nonparametric Frequentist Model Selection and Model Averaging," Econometrics, MDPI, vol. 1(2), pages 1-23, September.
    5. Liu, Chu-An, 2015. "Distribution theory of the least squares averaging estimator," Journal of Econometrics, Elsevier, vol. 186(1), pages 142-159.
    6. Zhang, Xinyu & Liu, Chu-An, 2023. "Model averaging prediction by K-fold cross-validation," Journal of Econometrics, Elsevier, vol. 235(1), pages 280-301.
    7. Chu-An Liu & Biing-Shen Kuo & Wen-Jen Tsay, 2017. "Autoregressive Spectral Averaging Estimator," IEAS Working Paper : academic research 17-A013, Institute of Economics, Academia Sinica, Taipei, Taiwan.
    8. Li, Yan & Yang, Liyan, 2011. "Testing conditional factor models: A nonparametric approach," Journal of Empirical Finance, Elsevier, vol. 18(5), pages 972-992.
    9. Boguth, Oliver & Carlson, Murray & Fisher, Adlai & Simutin, Mikhail, 2011. "Conditional risk and performance evaluation: Volatility timing, overconditioning, and new estimates of momentum alphas," Journal of Financial Economics, Elsevier, vol. 102(2), pages 363-389.
    10. Zhang, Xinyu & Wan, Alan T.K. & Zou, Guohua, 2013. "Model averaging by jackknife criterion in models with dependent data," Journal of Econometrics, Elsevier, vol. 174(2), pages 82-94.
    11. Stefano Gubellini, 2014. "Conditioning information and cross-sectional anomalies," Review of Quantitative Finance and Accounting, Springer, vol. 43(3), pages 529-569, October.
    12. Yin, Anwen, 2015. "Forecasting and model averaging with structural breaks," ISU General Staff Papers 201501010800005727, Iowa State University, Department of Economics.
    13. Qingfeng Liu & Ryo Okui & Arihiro Yoshimura, 2016. "Generalized Least Squares Model Averaging," Econometric Reviews, Taylor & Francis Journals, vol. 35(8-10), pages 1692-1752, December.
    14. Aman Ullah & Alan T. K. Wan & Huansha Wang & Xinyu Zhang & Guohua Zou, 2017. "A semiparametric generalized ridge estimator and link with model averaging," Econometric Reviews, Taylor & Francis Journals, vol. 36(1-3), pages 370-384, March.
    15. Liao, Jun & Zou, Guohua, 2020. "Corrected Mallows criterion for model averaging," Computational Statistics & Data Analysis, Elsevier, vol. 144(C).
    16. Yan Gao & Xinyu Zhang & Shouyang Wang & Terence Tai-leung Chong & Guohua Zou, 2019. "Frequentist model averaging for threshold models," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 71(2), pages 275-306, April.
    17. Alena Skolkova, 2023. "Model Averaging with Ridge Regularization," CERGE-EI Working Papers wp758, The Center for Economic Research and Graduate Education - Economics Institute, Prague.
    18. Liu, Chu-An, 2012. "A plug-in averaging estimator for regressions with heteroskedastic errors," MPRA Paper 41414, University Library of Munich, Germany.
    19. Liao, Jun & Zou, Guohua & Gao, Yan & Zhang, Xinyu, 2021. "Model averaging prediction for time series models with a diverging number of parameters," Journal of Econometrics, Elsevier, vol. 223(1), pages 190-221.
    20. Tian Xie, 2019. "Forecast Bitcoin Volatility with Least Squares Model Averaging," Econometrics, MDPI, vol. 7(3), pages 1-20, September.

    More about this item

    Keywords

    Final prediction error; High dimensionality; Model averaging; Model selection; Misspecification; Quantile regression;
    All these keywords.

    JEL classification:

    • C51 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Construction and Estimation
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:siu:wpaper:11-2014. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: QL THor (email available below). General contact details of provider: https://edirc.repec.org/data/sesmusg.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.