IDEAS home Printed from https://ideas.repec.org/p/imf/imfwpa/2020-044.html
   My bibliography  Save this paper

The More the Merrier? A Machine Learning Algorithm for Optimal Pooling of Panel Data

Author

Listed:
  • Marijn A. Bolhuis
  • Brett Rayner

Abstract

We leverage insights from machine learning to optimize the tradeoff between bias and variance when estimating economic models using pooled datasets. Specifically, we develop a simple algorithm that estimates the similarity of economic structures across countries and selects the optimal pool of countries to maximize out-of-sample prediction accuracy of a model. We apply the new alogrithm by nowcasting output growth with a panel of 102 countries and are able to significantly improve forecast accuracy relative to alternative pools. The algortihm improves nowcast performance for advanced economies, as well as emerging market and developing economies, suggesting that machine learning techniques using pooled data could be an important macro tool for many countries.

Suggested Citation

  • Marijn A. Bolhuis & Brett Rayner, 2020. "The More the Merrier? A Machine Learning Algorithm for Optimal Pooling of Panel Data," IMF Working Papers 2020/044, International Monetary Fund.
    • Handle: RePEc:imf:imfwpa:2020/044
    as

    Download full text from publisher

    File URL: http://www.imf.org/external/pubs/cat/longres.aspx?sk=49045
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Mr. Andrew J Tiffin, 2016. "Seeing in the Dark: A Machine-Learning Approach to Nowcasting in Lebanon," IMF Working Papers 2016/056, International Monetary Fund.
    2. Hoogstrate, Andre J & Palm, Franz C & Pfann, Gerard A, 2000. "Pooling in Dynamic Panel-Data Models: An Application to Forecasting GDP Growth Rates," Journal of Business & Economic Statistics, American Statistical Association, vol. 18(3), pages 274-283, July.
    3. Richardson, Adam & van Florenstein Mulder, Thomas & Vehbi, Tuğrul, 2021. "Nowcasting GDP using machine-learning algorithms: A real-time assessment," International Journal of Forecasting, Elsevier, vol. 37(2), pages 941-948.
    4. Bai, Jushan & Ng, Serena, 2008. "Forecasting economic time series using targeted predictors," Journal of Econometrics, Elsevier, vol. 146(2), pages 304-317, October.
    5. Stock, James H. & Watson, Mark W., 2006. "Forecasting with Many Predictors," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 10, pages 515-554, Elsevier.
    6. Jin-Kyu Jung & Manasa Patnam & Anna Ter-Martirosyan, 2018. "An Algorithmic Crystal Ball: Forecasts-based on Machine Learning," IMF Working Papers 2018/230, International Monetary Fund.
    7. William T. Gavin & Athena T. Theodorou, 2005. "A common model approach to macroeconomics: using panel data to reduce sampling error," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 24(3), pages 203-219.
    8. Richardson, Adam & van Florenstein Mulder, Thomas & Vehbi, Tuğrul, 2021. "Nowcasting GDP using machine-learning algorithms: A real-time assessment," International Journal of Forecasting, Elsevier, vol. 37(2), pages 941-948.
    9. G. Elliott & C. Granger & A. Timmermann (ed.), 2006. "Handbook of Economic Forecasting," Handbook of Economic Forecasting, Elsevier, edition 1, volume 1, number 1.
    10. Aaron Smalter Hall, 2018. "Machine Learning Approaches to Macroeconomic Forecasting," Economic Review, Federal Reserve Bank of Kansas City, issue Q IV, pages 63-81.
    11. Baltagi, Badi H. & Griffin, James M., 1997. "Pooled estimators vs. their heterogeneous counterparts in the context of dynamic demand for gasoline," Journal of Econometrics, Elsevier, vol. 77(2), pages 303-327, April.
    12. Marcelo C. Medeiros & Gabriel F. R. Vasconcelos & Álvaro Veiga & Eduardo Zilberman, 2021. "Forecasting Inflation in a Data-Rich Environment: The Benefits of Machine Learning Methods," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 39(1), pages 98-119, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Marijn A. Bolhuis & Brett Rayner, 2020. "Deus ex Machina? A Framework for Macro Forecasting with Machine Learning," IMF Working Papers 2020/045, International Monetary Fund.
    2. Jaehyun Yoon, 2021. "Forecasting of Real GDP Growth Using Machine Learning Models: Gradient Boosting and Random Forest Approach," Computational Economics, Springer;Society for Computational Economics, vol. 57(1), pages 247-265, January.
    3. Sabyasachi Kar & Amaani Bashir & Mayank Jain, 2021. "New Approaches to Forecasting Growth and Inflation: Big Data and Machine Learning," IEG Working Papers 446, Institute of Economic Growth.
    4. Baltagi, Badi H., 2013. "Panel Data Forecasting," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 995-1024, Elsevier.
    5. Dennis Kant & Andreas Pick & Jasper de Winter, 2022. "Nowcasting GDP using machine learning methods," Working Papers 754, DNB.
    6. Costa, Alexandre Bonnet R. & Ferreira, Pedro Cavalcanti G. & Gaglianone, Wagner P. & Guillén, Osmani Teixeira C. & Issler, João Victor & Lin, Yihao, 2021. "Machine learning and oil price point and density forecasting," Energy Economics, Elsevier, vol. 102(C).
    7. Alexandra Bozhechkova & Urmat Dzhunkeev, 2024. "CLARA and CARLSON: Combination of Ensemble and Neural Network Machine Learning Methods for GDP Forecasting," Russian Journal of Money and Finance, Bank of Russia, vol. 83(3), pages 45-69, September.
    8. Jianhao Lin & Jiacheng Fan & Yifan Zhang & Liangyuan Chen, 2023. "Real‐time macroeconomic projection using narrative central bank communication," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 38(2), pages 202-221, March.
    9. Alexander Jaax & Annabelle Mourougane & Frederic Gonzales, 2024. "Nowcasting services trade for the G7 economies," The World Economy, Wiley Blackwell, vol. 47(4), pages 1336-1386, April.
    10. Juan Tenorio & Wilder Perez, 2024. "Monthly GDP nowcasting with Machine Learning and Unstructured Data," Papers 2402.04165, arXiv.org.
    11. Chen, Qitong & Hong, Yongmiao & Li, Haiqi, 2024. "Time-varying forecast combination for factor-augmented regressions with smooth structural changes," Journal of Econometrics, Elsevier, vol. 240(1).
    12. Kim, Hyun Hak & Swanson, Norman R., 2018. "Mining big data using parsimonious factor, machine learning, variable selection and shrinkage methods," International Journal of Forecasting, Elsevier, vol. 34(2), pages 339-354.
    13. Richard Schnorrenberger & Aishameriane Schmidt & Guilherme Valle Moura, 2024. "Harnessing Machine Learning for Real-Time Inflation Nowcasting," Working Papers 806, DNB.
    14. Huiyu Huang & Tae-Hwy Lee, 2010. "To Combine Forecasts or to Combine Information?," Econometric Reviews, Taylor & Francis Journals, vol. 29(5-6), pages 534-570.
    15. Andrei Dubovik & Adam Elbourne & Bram Hendriks & Mark Kattenberg, 2022. "Forecasting World Trade Using Big Data and Machine Learning Techniques," CPB Discussion Paper 441, CPB Netherlands Bureau for Economic Policy Analysis.
    16. Ofori, Isaac Kwesi, 2021. "Catching The Drivers of Inclusive Growth in Sub-Saharan Africa: An Application of Machine Learning," EconStor Preprints 235482, ZBW - Leibniz Information Centre for Economics.
    17. Issler, João Victor & Lima, Luiz Renato, 2009. "A panel data approach to economic forecasting: The bias-corrected average forecast," Journal of Econometrics, Elsevier, vol. 152(2), pages 153-164, October.
    18. Byron Botha & Geordie Reid & Tim Olds & Daan Steenkamp & Rossouw van Jaarsveld, 2021. "Nowcasting South African GDP using a suite of statistical models," Working Papers 11001, South African Reserve Bank.
    19. Hamdy Ahmad Aly Alhendawy & Mohammed Galal Abdallah Mostafa & Mohamed Ibrahim Elgohari & Ibrahim Abdalla Abdelraouf Mohamed & Nabil Medhat Arafat Mahmoud & Mohamed Ahmed Mohamed Mater, 2023. "Determinants of Renewable Energy Production in Egypt New Approach: Machine Learning Algorithms," International Journal of Energy Economics and Policy, Econjournals, vol. 13(6), pages 679-689, November.
    20. Kim, Hyun Hak & Swanson, Norman R., 2014. "Forecasting financial and macroeconomic variables using data reduction methods: New empirical evidence," Journal of Econometrics, Elsevier, vol. 178(P2), pages 352-367.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:imf:imfwpa:2020/044. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Akshay Modi (email available below). General contact details of provider: https://edirc.repec.org/data/imfffus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.