IDEAS home Printed from https://ideas.repec.org/a/spr/sankha/v83y2021i2d10.1007_s13171-020-00238-9.html
   My bibliography  Save this article

Optimal Designs for Model Averaging in non-nested Models

Author

Listed:
  • Kira Alhorn

    (Technische Universität Dortmund)

  • Holger Dette

    (Ruhr-Universität Bochum)

  • Kirsten Schorning

    (Technische Universität Dortmund)

Abstract

In this paper we construct optimal designs for frequentist model averaging estimation. We derive the asymptotic distribution of the model averaging estimate with fixed weights in the case where the competing models are non-nested. A Bayesian optimal design minimizes an expectation of the asymptotic mean squared error of the model averaging estimate calculated with respect to a suitable prior distribution. We derive a necessary condition for the optimality of a given design with respect to this new criterion. We demonstrate that Bayesian optimal designs can improve the accuracy of model averaging substantially. Moreover, the derived designs also improve the accuracy of estimation in a model selected by model selection and model averaging estimates with random weights.

Suggested Citation

  • Kira Alhorn & Holger Dette & Kirsten Schorning, 2021. "Optimal Designs for Model Averaging in non-nested Models," Sankhya A: The Indian Journal of Statistics, Springer;Indian Statistical Institute, vol. 83(2), pages 745-778, August.
    • Handle: RePEc:spr:sankha:v:83:y:2021:i:2:d:10.1007_s13171-020-00238-9
    DOI: 10.1007/s13171-020-00238-9
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s13171-020-00238-9
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s13171-020-00238-9?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. J. López‐Fidalgo & C. Tommasi & P. C. Trandafir, 2007. "An optimal experimental design criterion for discriminating between non‐normal models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 69(2), pages 231-242, April.
    2. Yuhong Yang, 2005. "Can the strengths of AIC and BIC be shared? A conflict between model indentification and regression estimation," Biometrika, Biometrika Trust, vol. 92(4), pages 937-950, December.
    3. Tommasi, C. & López-Fidalgo, J., 2010. "Bayesian optimum designs for discriminating between models with any distribution," Computational Statistics & Data Analysis, Elsevier, vol. 54(1), pages 143-150, January.
    4. Wei Qian & Craig A. Rolling & Gang Cheng & Yuhong Yang, 2019. "On the Forecast Combination Puzzle," Econometrics, MDPI, vol. 7(3), pages 1-26, September.
    5. Claeskens, Gerda & Magnus, Jan R. & Vasnev, Andrey L. & Wang, Wendun, 2016. "The forecast combination puzzle: A simple theoretical explanation," International Journal of Forecasting, Elsevier, vol. 32(3), pages 754-762.
    6. James H. Stock & Mark W.Watson, 2003. "Forecasting Output and Inflation: The Role of Asset Prices," Journal of Economic Literature, American Economic Association, vol. 41(3), pages 788-829, September.
    7. Hjort N.L. & Claeskens G., 2003. "Frequentist Model Average Estimators," Journal of the American Statistical Association, American Statistical Association, vol. 98, pages 879-899, January.
    8. Xinyu Zhang & Dalei Yu & Guohua Zou & Hua Liang, 2016. "Optimal Model Averaging Estimation for Generalized Linear Models and Generalized Linear Mixed-Effects Models," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 111(516), pages 1775-1790, October.
    9. Kapetanios, George & Labhard, Vincent & Price, Simon, 2008. "Forecasting Using Bayesian and Information-Theoretic Model Averaging: An Application to U.K. Inflation," Journal of Business & Economic Statistics, American Statistical Association, vol. 26, pages 33-41, January.
    10. Dariusz Uciński & Barbara Bogacka, 2005. "T‐optimum designs for discrimination between two multiresponse dynamic models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(1), pages 3-18, February.
    11. Hong, Han & Preston, Bruce, 2012. "Bayesian averaging, prediction and nonnested model selection," Journal of Econometrics, Elsevier, vol. 167(2), pages 358-369.
    12. Longmei Chen & Alan T. K. Wan & Geoffrey Tso & Xinyu Zhang, 2018. "A model averaging approach for the ordered probit and nested logit models with applications," Journal of Applied Statistics, Taylor & Francis Journals, vol. 45(16), pages 3012-3052, December.
    13. White, Halbert, 1982. "Maximum Likelihood Estimation of Misspecified Models," Econometrica, Econometric Society, vol. 50(1), pages 1-25, January.
    14. Raftery A.E. & Zheng Y., 2003. "Discussion: Performance of Bayesian Model Averaging," Journal of the American Statistical Association, American Statistical Association, vol. 98, pages 931-938, January.
    15. Yang Y., 2001. "Adaptive Regression by Mixing," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 574-588, June.
    16. Claeskens,Gerda & Hjort,Nils Lid, 2008. "Model Selection and Model Averaging," Cambridge Books, Cambridge University Press, number 9780521852258, January.
    17. H. Dette & C. Kiss & M. Bevanda & F. Bretz, 2010. "Optimal designs for the emax, log-linear and exponential models," Biometrika, Biometrika Trust, vol. 97(2), pages 513-518.
    18. Liang, Hua & Zou, Guohua & Wan, Alan T. K. & Zhang, Xinyu, 2011. "Optimal Weight Choice for Frequentist Model Average Estimators," Journal of the American Statistical Association, American Statistical Association, vol. 106(495), pages 1053-1066.
    19. HaiYing Wang & Min Yang & John Stufken, 2019. "Information-Based Optimal Subdata Selection for Big Data Linear Regression," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 114(525), pages 393-405, January.
    20. Jeremy Smith & Kenneth F. Wallis, 2009. "A Simple Explanation of the Forecast Combination Puzzle," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 71(3), pages 331-355, June.
    21. Mark W. Watson & James H. Stock, 2004. "Combination forecasts of output growth in a seven-country data set," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 23(6), pages 405-430.
    22. Bruce E. Hansen, 2007. "Least Squares Model Averaging," Econometrica, Econometric Society, vol. 75(4), pages 1175-1189, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sun, Yuying & Hong, Yongmiao & Wang, Shouyang & Zhang, Xinyu, 2023. "Penalized time-varying model averaging," Journal of Econometrics, Elsevier, vol. 235(2), pages 1355-1377.
    2. Mark F. J. Steel, 2020. "Model Averaging and Its Use in Economics," Journal of Economic Literature, American Economic Association, vol. 58(3), pages 644-719, September.
    3. Yuting Wei & Qihua Wang & Wei Liu, 2021. "Model averaging for linear models with responses missing at random," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 73(3), pages 535-553, June.
    4. Wei Qian & Craig A. Rolling & Gang Cheng & Yuhong Yang, 2019. "On the Forecast Combination Puzzle," Econometrics, MDPI, vol. 7(3), pages 1-26, September.
    5. Qian, Wei & Rolling, Craig A. & Cheng, Gang & Yang, Yuhong, 2022. "Combining forecasts for universally optimal performance," International Journal of Forecasting, Elsevier, vol. 38(1), pages 193-208.
    6. Chen, Yi-Ting & Liu, Chu-An, 2023. "Model averaging for asymptotically optimal combined forecasts," Journal of Econometrics, Elsevier, vol. 235(2), pages 592-607.
    7. Zhang, Xinyu & Wan, Alan T.K. & Zou, Guohua, 2013. "Model averaging by jackknife criterion in models with dependent data," Journal of Econometrics, Elsevier, vol. 174(2), pages 82-94.
    8. Haili Zhang & Guohua Zou, 2020. "Cross-Validation Model Averaging for Generalized Functional Linear Model," Econometrics, MDPI, vol. 8(1), pages 1-35, February.
    9. Lu, Xun & Su, Liangjun, 2015. "Jackknife model averaging for quantile regressions," Journal of Econometrics, Elsevier, vol. 188(1), pages 40-58.
    10. Liu, Chu-An, 2015. "Distribution theory of the least squares averaging estimator," Journal of Econometrics, Elsevier, vol. 186(1), pages 142-159.
    11. Gospodinov, Nikolay & Maasoumi, Esfandiar, 2021. "Generalized aggregation of misspecified models: With an application to asset pricing," Journal of Econometrics, Elsevier, vol. 222(1), pages 451-467.
    12. Wei, Yuting & Wang, Qihua, 2021. "Cross-validation-based model averaging in linear models with response missing at random," Statistics & Probability Letters, Elsevier, vol. 171(C).
    13. Fang, Fang & Li, Jialiang & Xia, Xiaochao, 2022. "Semiparametric model averaging prediction for dichotomous response," Journal of Econometrics, Elsevier, vol. 229(2), pages 219-245.
    14. Zhang, Xinyu & Liu, Chu-An, 2023. "Model averaging prediction by K-fold cross-validation," Journal of Econometrics, Elsevier, vol. 235(1), pages 280-301.
    15. Ruoyao Shi, 2021. "An Averaging Estimator for Two Step M Estimation in Semiparametric Models," Working Papers 202105, University of California at Riverside, Department of Economics.
    16. Antoine Mandel & Amir Sani, 2017. "A Machine Learning Approach to the Forecast Combination Puzzle," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) halshs-01317974, HAL.
    17. Christopher F. Parmeter & Alan T. K. Wan & Xinyu Zhang, 2019. "Model averaging estimators for the stochastic frontier model," Journal of Productivity Analysis, Springer, vol. 51(2), pages 91-103, June.
    18. Shangwei Zhao & Aman Ullah & Xinyu Zhang, 2018. "A Class of Model Averaging Estimators," Working Paper series 18-11, Rimini Centre for Economic Analysis.
    19. Yan Gao & Xinyu Zhang & Shouyang Wang & Terence Tai-leung Chong & Guohua Zou, 2019. "Frequentist model averaging for threshold models," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 71(2), pages 275-306, April.
    20. Chu-An Liu & Biing-Shen Kuo & Wen-Jen Tsay, 2017. "Autoregressive Spectral Averaging Estimator," IEAS Working Paper : academic research 17-A013, Institute of Economics, Academia Sinica, Taipei, Taiwan.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:sankha:v:83:y:2021:i:2:d:10.1007_s13171-020-00238-9. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.