IDEAS home Printed from https://ideas.repec.org/p/tiu/tiucen/3aa66f2e-55c5-4ddb-8acf-710e61072f9a.html
   My bibliography  Save this paper

Bayesian Model Averaging and Weighted Average Least Squares : Equivariance, Stability, and Numerical Issues

Author

Listed:
  • De Luca, G.
  • Magnus, J.R.

    (Tilburg University, Center For Economic Research)

Abstract

In this article, we describe the estimation of linear regression models with uncertainty about the choice of the explanatory variables. We introduce the Stata commands bma and wals, which implement, respectively, the exact Bayesian model-averaging estimator and the weighted-average least-squares estimator developed by Magnus, Powell, and Pru ̈fer (2010, Journal of Econometrics 154: 139–153). Unlike standard pretest estimators that are based on some preliminary diagnostic test, these model-averaging estimators provide a coherent way of making inference on the regression parameters of interest by taking into account the uncertainty due to both the estimation and the model selection steps. Special emphasis is given to several practical issues that users are likely to face in applied work: equivariance to certain transformations of the explanatory variables, stability, accuracy, computing speed, and out-of-memory problems. Performances of our bma and wals commands are illustrated using simulated data and empirical applications from the literature on model-averaging estimation. Copyright 2011 by StataCorp LP.
(This abstract was borrowed from another version of this item.)

Suggested Citation

  • De Luca, G. & Magnus, J.R., 2011. "Bayesian Model Averaging and Weighted Average Least Squares : Equivariance, Stability, and Numerical Issues," Discussion Paper 2011-082, Tilburg University, Center for Economic Research.
    • Handle: RePEc:tiu:tiucen:3aa66f2e-55c5-4ddb-8acf-710e61072f9a
    as

    Download full text from publisher

    File URL: https://pure.uvt.nl/ws/portalfiles/portal/1341117/2011-082.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Winford H. Masanjala & Chris Papageorgiou, 2008. "Rough and lonely road to prosperity: a reexamination of the sources of growth in Africa using Bayesian model averaging," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 23(5), pages 671-682.
    2. Einmahl, J.H.J. & Magnus, J.R. & Kumar, K., 2011. "On the Choice of Prior in Bayesian Model Averaging," Discussion Paper 2011-003, Tilburg University, Center for Economic Research.
    3. Valentino Dardanoni & Giuseppe De Luca & Salvatore Modica & Franco Peracchi, 2012. "A generalized missing-indicator approach to regression with imputed covariates," Stata Journal, StataCorp LP, vol. 12(4), pages 575-604, December.
    4. Carmen Fernandez & Eduardo Ley & Mark F. J. Steel, 2001. "Model uncertainty in cross-country growth regressions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 16(5), pages 563-576.
    5. Magnus, Jan R. & Wan, Alan T.K. & Zhang, Xinyu, 2011. "Weighted average least squares estimation with nonspherical disturbances and an application to the Hong Kong housing market," Computational Statistics & Data Analysis, Elsevier, vol. 55(3), pages 1331-1341, March.
    6. repec:hal:journl:peer-00815561 is not listed on IDEAS
    7. Danilov, D.L. & Magnus, J.R., 2002. "Estimation of the Mean of a Univariate Normal Distribution When the Variance is not Known," Discussion Paper 2002-77, Tilburg University, Center for Economic Research.
    8. Ley, Eduardo & Steel, Mark F.J., 2007. "Jointness in Bayesian variable selection with applications to growth regression," Journal of Macroeconomics, Elsevier, vol. 29(3), pages 476-493, September.
    9. Dardanoni, Valentino & Modica, Salvatore & Peracchi, Franco, 2011. "Regression with imputed covariates: A generalized missing-indicator approach," Journal of Econometrics, Elsevier, vol. 162(2), pages 362-368, June.
    10. Dmitry Danilov, 2005. "Estimation of the mean of a univariate normal distribution when the variance is not known," Econometrics Journal, Royal Economic Society, vol. 8(3), pages 277-291, December.
    11. Magnus, Jan R. & Powell, Owen & Prüfer, Patricia, 2010. "A comparison of two model averaging techniques with an application to growth empirics," Journal of Econometrics, Elsevier, vol. 154(2), pages 139-153, February.
    12. Jan R. Magnus & J. Durbin, 1999. "Estimation of Regression Coefficients of Interest When Other Regression Coefficients Are of No Interest," Econometrica, Econometric Society, vol. 67(3), pages 639-644, May.
    13. Xavier Sala-I-Martin & Gernot Doppelhofer & Ronald I. Miller, 2004. "Determinants of Long-Term Growth: A Bayesian Averaging of Classical Estimates (BACE) Approach," American Economic Review, American Economic Association, vol. 94(4), pages 813-835, September.
    14. Jan R. Magnus, 2002. "Estimation of the mean of a univariate normal distribution with known variance," Econometrics Journal, Royal Economic Society, vol. 5(1), pages 225-236, June.
    15. Danilov, Dmitry & Magnus, J.R.Jan R., 2004. "On the harm that ignoring pretesting can cause," Journal of Econometrics, Elsevier, vol. 122(1), pages 27-46, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Aedın Doris & Donal O’Neill & Olive Sweetman, 2011. "GMM estimation of the covariance structure of longitudinal data on earnings," Stata Journal, StataCorp LP, vol. 11(3), pages 439-459, September.
    2. Judith Anne Clarke, 2017. "Model Averaging OLS and 2SLS: An Application of the WALS Procedure," Econometrics Working Papers 1701, Department of Economics, University of Victoria.
    3. Magnus, Jan R. & Powell, Owen & Prüfer, Patricia, 2010. "A comparison of two model averaging techniques with an application to growth empirics," Journal of Econometrics, Elsevier, vol. 154(2), pages 139-153, February.
    4. Magnus, J.R. & Powell, O.R. & Prüfer, P., 2008. "A Comparison of Two Averaging Techniques with an Application to Growth Empirics," Other publications TiSEM 0392dffa-51e0-4bc9-9644-f, Tilburg University, School of Economics and Management.
    5. Mark F. J. Steel, 2020. "Model Averaging and Its Use in Economics," Journal of Economic Literature, American Economic Association, vol. 58(3), pages 644-719, September.
    6. Giuseppe Luca & Jan R. Magnus & Franco Peracchi, 2023. "Weighted-Average Least Squares (WALS): Confidence and Prediction Intervals," Computational Economics, Springer;Society for Computational Economics, vol. 61(4), pages 1637-1664, April.
    7. Dardanoni, Valentino & De Luca, Giuseppe & Modica, Salvatore & Peracchi, Franco, 2015. "Model averaging estimation of generalized linear models with imputed covariates," Journal of Econometrics, Elsevier, vol. 184(2), pages 452-463.
    8. De Luca, Giuseppe & Magnus, Jan R. & Peracchi, Franco, 2022. "Sampling properties of the Bayesian posterior mean with an application to WALS estimation," Journal of Econometrics, Elsevier, vol. 230(2), pages 299-317.
    9. Jan R. Magnus & Wendun Wang & Xinyu Zhang, 2016. "Weighted-Average Least Squares Prediction," Econometric Reviews, Taylor & Francis Journals, vol. 35(6), pages 1040-1074, June.
    10. Rockey, James & Temple, Jonathan, 2016. "Growth econometrics for agnostics and true believers," European Economic Review, Elsevier, vol. 81(C), pages 86-102.
    11. Valentino Dardanoni & Giuseppe De Luca & Salvatore Modica & Franco Peracchi, 2012. "A generalized missing-indicator approach to regression with imputed covariates," Stata Journal, StataCorp LP, vol. 12(4), pages 575-604, December.
    12. Moral-Benito, Enrique, 2010. "Model averaging in economics," MPRA Paper 26047, University Library of Munich, Germany.
    13. Marcin Błażejowski & Jacek Kwiatkowski & Jakub Gazda, 2019. "Sources of Economic Growth: A Global Perspective," Sustainability, MDPI, vol. 11(1), pages 1-14, January.
    14. Einmahl, J.H.J. & Magnus, J.R. & Kumar, K., 2011. "On the Choice of Prior in Bayesian Model Averaging," Discussion Paper 2011-003, Tilburg University, Center for Economic Research.
    15. Valentino Dardanoni & Giuseppe De Luca & Salvatore Modica & Franco Peracchi, 2013. "Bayesian Model Averaging for Generalized Linear Models with Missing Covariates," EIEF Working Papers Series 1311, Einaudi Institute for Economics and Finance (EIEF), revised May 2013.
    16. Enrique Moral-Benito, 2015. "Model Averaging In Economics: An Overview," Journal of Economic Surveys, Wiley Blackwell, vol. 29(1), pages 46-75, February.
    17. Eicher, Theo S. & Papageorgiou, Chris & Roehn, Oliver, 2007. "Unraveling the fortunes of the fortunate: An Iterative Bayesian Model Averaging (IBMA) approach," Journal of Macroeconomics, Elsevier, vol. 29(3), pages 494-514, September.
    18. Henderson, Daniel J. & Papageorgiou, Chris & Parmeter, Christopher F., 2013. "Who benefits from financial development? New methods, new evidence," European Economic Review, Elsevier, vol. 63(C), pages 47-67.
    19. Karen Poghosyan & Jan R. Magnus, 2012. "WALS Estimation and Forecasting in Factor-based Dynamic Models with an Application to Armenia," International Econometric Review (IER), Econometric Research Association, vol. 4(1), pages 40-58, April.
    20. De Luca, Giuseppe & Magnus, Jan R. & Peracchi, Franco, 2018. "Weighted-average least squares estimation of generalized linear models," Journal of Econometrics, Elsevier, vol. 204(1), pages 1-17.

    More about this item

    Keywords

    Model uncertainty; Model averaging; Bayesian analysis; Exact computation;
    All these keywords.

    JEL classification:

    • C11 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Bayesian Analysis: General
    • C51 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Construction and Estimation
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:tiu:tiucen:3aa66f2e-55c5-4ddb-8acf-710e61072f9a. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Richard Broekman (email available below). General contact details of provider: http://center.uvt.nl .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.