IDEAS home Printed from https://ideas.repec.org/a/kap/compec/v63y2024i4d10.1007_s10614-023-10369-4.html
   My bibliography  Save this article

Implementing Machine Learning Methods in Estimating the Size of the Non-observed Economy

Author

Listed:
  • Labib Shami

    (Western Galilee College)

  • Teddy Lazebnik

    (University College London)

Abstract

Even though the literature on unregistered economic activity is growing at an increasing rate, we commonly encounter simple ordinary least squares methods and panel regressions, largely ignoring the recent rapid developments in machine learning methods. This study provides a new approach to more accurately estimate the size of the non-observed economy using machine learning methods. Compared to two currency demand-based models used to estimate the size of the non-observed economy, we show that a Random Forest algorithm can more accurately estimate the demand for currency, which is known to provide a fair estimation of the unregistered economic activity. The proposed approach shows superior forecasting capabilities compared to the current state-of-the-art linear regression-based methods dedicated to estimating non-observed economic activity.

Suggested Citation

  • Labib Shami & Teddy Lazebnik, 2024. "Implementing Machine Learning Methods in Estimating the Size of the Non-observed Economy," Computational Economics, Springer;Society for Computational Economics, vol. 63(4), pages 1459-1476, April.
    • Handle: RePEc:kap:compec:v:63:y:2024:i:4:d:10.1007_s10614-023-10369-4
    DOI: 10.1007/s10614-023-10369-4
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10614-023-10369-4
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s10614-023-10369-4?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Feige, Edgar L., 2015. "Reflections on the meaning and measurement of Unobserved Economies: What do we really know about the “Shadow Economy”?," MPRA Paper 68466, University Library of Munich, Germany.
    2. Lars P. Feld & Friedrich Schneider, 2010. "Survey on the Shadow Economy and Undeclared Earnings in OECD Countries," German Economic Review, Verein für Socialpolitik, vol. 11(2), pages 109-149, May.
    3. Ha, Le Thanh & Dung, Hoang Phuong & Thanh, To Trung, 2021. "Economic complexity and shadow economy: A multi-dimensional analysis," Economic Analysis and Policy, Elsevier, vol. 72(C), pages 408-422.
    4. Ricardo P. Masini & Marcelo C. Medeiros & Eduardo F. Mendes, 2023. "Machine learning advances for time series forecasting," Journal of Economic Surveys, Wiley Blackwell, vol. 37(1), pages 76-111, February.
    5. Piotr Dybka & Michał Kowalczuk & Bartosz Olesiński & Andrzej Torój & Marek Rozkrut, 2019. "Currency demand and MIMIC models: towards a structured hybrid method of measuring the shadow economy," International Tax and Public Finance, Springer;International Institute of Public Finance, vol. 26(1), pages 4-40, February.
    6. repec:bla:germec:v:11:y:2010:i::p:109-149 is not listed on IDEAS
    7. Kenneth Rogoff, 2015. "Costs and Benefits to Phasing out Paper Currency," NBER Macroeconomics Annual, University of Chicago Press, vol. 29(1), pages 445-456.
    8. Friedrich Schneider & Andreas Buehn & Claudio Montenegro, 2010. "New Estimates for the Shadow Economies all over the World," International Economic Journal, Taylor & Francis Journals, vol. 24(4), pages 443-461.
    9. Athey, Susan & Imbens, Guido W., 2019. "Machine Learning Methods Economists Should Know About," Research Papers 3776, Stanford University, Graduate School of Business.
    10. Friedrich SCHNEIDER, 2016. "Estimating the Size of the Shadow Economy: Methods, Problems and Open Questions," Turkish Economic Review, KSP Journals, vol. 3(2), pages 256-280, June.
    11. Kerem Cantekin & Ceyhun Elgin, 2017. "Extent And Growth Effects Of Informality In Turkey: Evidence From A Firm-Level Survey," The Singapore Economic Review (SER), World Scientific Publishing Co. Pte. Ltd., vol. 62(05), pages 1017-1037, December.
    12. Dominik H. Enste & Friedrich Schneider, 2000. "Shadow Economies: Size, Causes, and Consequences," Journal of Economic Literature, American Economic Association, vol. 38(1), pages 77-114, March.
    13. Ceyhun Elgin & Oguz Oztunali, 2012. "Shadow Economies around the World: Model Based Estimates," Working Papers 2012/05, Bogazici University, Department of Economics.
    14. Jaehyun Yoon, 2021. "Forecasting of Real GDP Growth Using Machine Learning Models: Gradient Boosting and Random Forest Approach," Computational Economics, Springer;Society for Computational Economics, vol. 57(1), pages 247-265, January.
    15. Weber, Gerhard-Wilhelm & Defterli, Ozlem & Alparslan Gök, SIrma Zeynep & Kropat, Erik, 2011. "Modeling, inference and optimization of regulatory networks based on time series data," European Journal of Operational Research, Elsevier, vol. 211(1), pages 1-14, May.
    16. Friedrich Schneider & Dominik Enste, 1999. "Shadow Economies Around the World - Size, Causes, and Consequences," CESifo Working Paper Series 196, CESifo.
    17. Nosratabadi, Saeed & Mosavi, Amir & Duan, Puhong & Ghamisi, Pedram & Filip, Ferdinand & Band, Shahab S. & Reuter, Uwe & Gama, Joao & Gandomi, Amir H., 2020. "Data science in economics: comprehensive review of advanced machine learning and deep learning methods," MetaArXiv haf2v, Center for Open Science.
    18. Lars P. Feld & Claus Larsen, 2012. "Undeclared Work, Deterrence and Social Norms," Springer Books, Springer, edition 127, number 978-3-540-87401-0, March.
    19. Susan Athey & Guido W. Imbens, 2019. "Machine Learning Methods That Economists Should Know About," Annual Review of Economics, Annual Reviews, vol. 11(1), pages 685-725, August.
    20. Nosratabadi, Saeed & Mosavi, Amir & Duan, Puhong & Ghamisi, Pedram & Filip, Ferdinand & Band, Shahab S. & Reuter, Uwe & Gama, Joao & Gandomi, Amir H., 2020. "Data science in economics: comprehensive review of advanced machine learning and deep learning methods," LawRxiv kczj5, Center for Open Science.
    21. Nosratabadi, Saeed & Mosavi, Amir & Duan, Puhong & Ghamisi, Pedram & Filip, Ferdinand & Band, Shahab S. & Reuter, Uwe & Gama, Joao & Gandomi, Amir H., 2020. "Data science in economics: comprehensive review of advanced machine learning and deep learning methods," SocArXiv 9vdwf, Center for Open Science.
    22. Guerino Ardizzi & Carmelo Petraglia & Massimiliano Piacenza & Gilberto Turati, 2014. "Measuring the Underground Economy with the Currency Demand Approach: A Reinterpretation of the Methodology, With an Application to Italy," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 60(4), pages 747-772, December.
    23. Ceyhun Elgin & Ferda Erturk, 2019. "Informal economies around the world: measures, determinants and consequences," Eurasian Economic Review, Springer;Eurasia Business and Economics Society, vol. 9(2), pages 221-237, June.
    24. Nosratabadi, Saeed & Mosavi, Amir & Duan, Puhong & Ghamisi, Pedram & Filip, Ferdinand & Band, Shahab S. & Reuter, Uwe & Gama, Joao & Gandomi, Amir H., 2020. "Data science in economics: comprehensive review of advanced machine learning and deep learning methods," OSF Preprints yc6e2, Center for Open Science.
    25. Shami, Labib, 2019. "Dynamic monetary equilibrium with a Non-Observed Economy and Shapley and Shubik’s price mechanism," Journal of Macroeconomics, Elsevier, vol. 62(C).
    26. Marcelo C. Medeiros & Gabriel F. R. Vasconcelos & Álvaro Veiga & Eduardo Zilberman, 2021. "Forecasting Inflation in a Data-Rich Environment: The Benefits of Machine Learning Methods," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 39(1), pages 98-119, January.
    27. Nosratabadi, Saeed & Mosavi, Amir & Duan, Puhong & Ghamisi, Pedram & Filip, Ferdinand & Band, Shahab S. & Reuter, Uwe & Gama, Joao & Gandomi, Amir H., 2020. "Data science in economics: comprehensive review of advanced machine learning and deep learning methods," Thesis Commons auyvc, Center for Open Science.
    28. Periklis Gogas & Theophilos Papadimitriou & Emmanouil Sofianos, 2022. "Forecasting unemployment in the euro area with machine learning," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 41(3), pages 551-566, April.
    29. Nosratabadi, Saeed & Mosavi, Amir & Duan, Puhong & Ghamisi, Pedram & Filip, Ferdinand & Band, Shahab S. & Reuter, Uwe & Gama, Joao & Gandomi, Amir H., 2020. "Data science in economics: comprehensive review of advanced machine learning and deep learning methods," EdArXiv 5dwrt, Center for Open Science.
    30. Trevor Breusch, 2005. "Estimating the Underground Economy using MIMIC Models," Econometrics 0507003, University Library of Munich, Germany, revised 15 Dec 2005.
    31. J. Ferwerda & I. Deleanu & B. Unger, 2010. "Revaluating the Tanzi-Model to Estimate the Underground Economy," Working Papers 10-04, Utrecht School of Economics.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Teddy Lazebnik, 2025. "Going a Step Deeper Down the Rabbit Hole: Deep Learning Model to Measure the Size of the Unregistered Economy Activity," Computational Economics, Springer;Society for Computational Economics, vol. 65(3), pages 1759-1774, March.
    2. Teddy Lazebnik & Tzach Fleischer & Amit Yaniv-Rosenfeld, 2023. "Benchmarking Biologically-Inspired Automatic Machine Learning for Economic Tasks," Sustainability, MDPI, vol. 15(14), pages 1-9, July.
    3. Ceyhun Elgin & M. ayhan Köse & Franziska Ohnsorge & Shu Yu, 2021. "Understanding Informality Abstract:," Working Papers 2021/03, Bogazici University, Department of Economics.
    4. Ceyhun Elgin & M. Ayhan Kose & Franziska Ohnsorge & Shu Yu, 2021. "Understanding Informality," Koç University-TUSIAD Economic Research Forum Working Papers 2114, Koc University-TUSIAD Economic Research Forum.
    5. Friedrich Schneider & Mangirdas Morkunas & Erika Quendler, 2023. "An estimation of the informal economy in the agricultural sector in the EU‐15 from 1996 to 2019," Agribusiness, John Wiley & Sons, Ltd., vol. 39(2), pages 406-447, March.
    6. Branimir Jovanovic, 2015. "Kalman Filter Estimation of the Unrecorded Economy in Macedonia," Working Papers 2015-02, National Bank of the Republic of North Macedonia.
    7. Owolabi, Adegboyega O. & Berdiev, Aziz N. & Saunoris, James W., 2022. "Is the shadow economy procyclical or countercyclical over the business cycle? International evidence," The Quarterly Review of Economics and Finance, Elsevier, vol. 84(C), pages 257-270.
    8. Yong-Chao Su & Cheng-Yu Wu & Cheng-Hong Yang & Bo-Sheng Li & Sin-Hua Moi & Yu-Da Lin, 2021. "Machine Learning Data Imputation and Prediction of Foraging Group Size in a Kleptoparasitic Spider," Mathematics, MDPI, vol. 9(4), pages 1-16, February.
    9. Mei-Li Shen & Cheng-Feng Lee & Hsiou-Hsiang Liu & Po-Yin Chang & Cheng-Hong Yang, 2021. "An Effective Hybrid Approach for Forecasting Currency Exchange Rates," Sustainability, MDPI, vol. 13(5), pages 1-29, March.
    10. Urko Aguirre-Larracoechea & Cruz E. Borges, 2021. "Imputation for Repeated Bounded Outcome Data: Statistical and Machine-Learning Approaches," Mathematics, MDPI, vol. 9(17), pages 1-27, August.
    11. Miguel Ángel Echarte Fernández & Sergio Luis Náñez Alonso & Ricardo Reier Forradellas & Javier Jorge-Vázquez, 2022. "From the Great Recession to the COVID-19 Pandemic: The Risk of Expansionary Monetary Policies," Risks, MDPI, vol. 10(2), pages 1-17, January.
    12. K K C Sineth Kannangara & Yanrui Wu, 2023. "Shadow Economy in Sri Lanka: A Review and New Estimates," Economics Discussion / Working Papers 23-04, The University of Western Australia, Department of Economics.
    13. Magdalena Anton (Musat) & Nicoleta Luminita Popescu (Groaznicu) & Oana Camelia Iacob & Sorin Adrian Ciupitu, 2022. "Measurement Of The Underground Economy With The Help Of The Managers Of Economic Entities," Annals - Economy Series, Constantin Brancusi University, Faculty of Economics, vol. 1, pages 254-260, February.
    14. Medda, Tiziana & Palmisano, Flaviana & Sacchi, Agnese, 2022. "Informal we stand? The role of social progress around the world," International Review of Economics & Finance, Elsevier, vol. 78(C), pages 660-675.
    15. Marcus Vinicius Santos & Fernando Morgado-Dias & Thiago C. Silva, 2023. "Oil Sector and Sentiment Analysis—A Review," Energies, MDPI, vol. 16(12), pages 1-29, June.
    16. Ren, Yi-Shuai & Ma, Chao-Qun & Kong, Xiao-Lin & Baltas, Konstantinos & Zureigat, Qasim, 2022. "Past, present, and future of the application of machine learning in cryptocurrency research," Research in International Business and Finance, Elsevier, vol. 63(C).
    17. Friedrich Schneider, 2023. "Do Different Estimation Methods Lead to Implausible Differences in the Size of Nonobserved or Shadow Economies? A Preliminary Answer," Annual Review of Resource Economics, Annual Reviews, vol. 15(1), pages 257-277, October.
    18. Hanyao Gao & Gang Kou & Haiming Liang & Hengjie Zhang & Xiangrui Chao & Cong-Cong Li & Yucheng Dong, 2024. "Machine learning in business and finance: a literature review and research opportunities," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 10(1), pages 1-35, December.
    19. Pablo Duarte, 2017. "The relationship between GDP and the size of the informal economy: empirical evidence for Spain," Empirical Economics, Springer, vol. 52(4), pages 1409-1421, June.
    20. Donal Mac Géidigh & Friedrich Schneider & Matthias Blum, 2016. "Grey Matters: Charting the Development of the Shadow Economy," CESifo Working Paper Series 6234, CESifo.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:compec:v:63:y:2024:i:4:d:10.1007_s10614-023-10369-4. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.