IDEAS home Printed from https://ideas.repec.org/a/kap/compec/v60y2022i4d10.1007_s10614-021-10191-w.html
   My bibliography  Save this article

Towards a Validation Methodology for Macroeconomic Agent-Based Models

Author

Listed:
  • Sebastiaan Tieleman

    (Utrecht University)

Abstract

Agent-based models provide a promising new tool in macroeconomic research. Questions have been raised, however, regarding the validity of such models. A methodology of macroeconomic agent-based model (MABM) validation, that provides a deeper understanding of validation practices, is required. This paper takes steps towards such a methodology by connecting three elements. First, is a foundation of model validation in general. Second is a classification of models dependent on how the model is validated. An important distinction in this classification is the difference between mechanism and target validation. Third, is a framework that revolves around the relationship between the structure of models of complex systems with emergent properties and validation in practice. Important in this framework is to consider MABMs as modelling multiple non-trivial levels. Connecting these three elements provides us with a methodology of the validation of MABMs and allows us to come to the following conclusions regarding MABM validation. First, in MABMs, mechanisms at a lower level are distinct from, but provide input to higher levels of mechanisms. Since mechanisms at different levels are validated in different ways we can come to a specific characterization of MABMs within the model classification framework. Second, because the mechanisms of MABMs are validated in a direct way at the level of the agent, MABMs can be seen as a move towards a more realist approach to modelling compared to DSGE.

Suggested Citation

  • Sebastiaan Tieleman, 2022. "Towards a Validation Methodology for Macroeconomic Agent-Based Models," Computational Economics, Springer;Society for Computational Economics, vol. 60(4), pages 1507-1527, December.
  • Handle: RePEc:kap:compec:v:60:y:2022:i:4:d:10.1007_s10614-021-10191-w
    DOI: 10.1007/s10614-021-10191-w
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10614-021-10191-w
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s10614-021-10191-w?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Lengnick, Matthias, 2013. "Agent-based macroeconomics: A baseline model," Journal of Economic Behavior & Organization, Elsevier, vol. 86(C), pages 102-120.
    2. Giorgio Fagiolo & Andrea Roventini, 2017. "Macroeconomic Policy in DSGE and Agent-Based Models Redux: New Developments and Challenges Ahead," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 20(1), pages 1-1.
    3. Xavier Gabaix, 2011. "The Granular Origins of Aggregate Fluctuations," Econometrica, Econometric Society, vol. 79(3), pages 733-772, May.
    4. Caiani, Alessandro & Godin, Antoine & Caverzasi, Eugenio & Gallegati, Mauro & Kinsella, Stephen & Stiglitz, Joseph E., 2016. "Agent based-stock flow consistent macroeconomics: Towards a benchmark model," Journal of Economic Dynamics and Control, Elsevier, vol. 69(C), pages 375-408.
    5. Corinna Elsenbroich, 2012. "Explanation in Agent-Based Modelling: Functions, Causality or Mechanisms?," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 15(3), pages 1-1.
    6. Guerini, Mattia & Moneta, Alessio, 2017. "A method for agent-based models validation," Journal of Economic Dynamics and Control, Elsevier, vol. 82(C), pages 125-141.
    7. Finn E. Kydland & Edward C. Prescott, 1996. "The Computational Experiment: An Econometric Tool," Journal of Economic Perspectives, American Economic Association, vol. 10(1), pages 69-85, Winter.
    8. Nicholas S. Souleles, 1999. "The Response of Household Consumption to Income Tax Refunds," American Economic Review, American Economic Association, vol. 89(4), pages 947-958, September.
    9. Paul Windrum & Giorgio Fagiolo & Alessio Moneta, 2007. "Empirical Validation of Agent-Based Models: Alternatives and Prospects," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 10(2), pages 1-8.
    10. Delli Gatti,Domenico & Fagiolo,Giorgio & Gallegati,Mauro & Richiardi,Matteo & Russo,Alberto (ed.), 2018. "Agent-Based Models in Economics," Cambridge Books, Cambridge University Press, number 9781108400046, October.
    11. J. Doyne Farmer & Duncan Foley, 2009. "The economy needs agent-based modelling," Nature, Nature, vol. 460(7256), pages 685-686, August.
    12. Brock, W A, 1999. "Scaling in Economics: A Reader's Guide," Industrial and Corporate Change, Oxford University Press and the Associazione ICC, vol. 8(3), pages 409-446, September.
    13. Nils A. Baas & Claus Emmeche, 1997. "On Emergence and Explanation," Working Papers 97-02-008, Santa Fe Institute.
    14. Giorgio Fagiolo & Alessio Moneta & Paul Windrum, 2007. "A Critical Guide to Empirical Validation of Agent-Based Models in Economics: Methodologies, Procedures, and Open Problems," Computational Economics, Springer;Society for Computational Economics, vol. 30(3), pages 195-226, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Giorgio Fagiolo & Mattia Guerini & Francesco Lamperti & Alessio Moneta & Andrea Roventini, 2017. "Validation of Agent-Based Models in Economics and Finance," LEM Papers Series 2017/23, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy.
    2. Andrew G. Haldane & Arthur E. Turrell, 2019. "Drawing on different disciplines: macroeconomic agent-based models," Journal of Evolutionary Economics, Springer, vol. 29(1), pages 39-66, March.
    3. Lamperti, F. & Dosi, G. & Napoletano, M. & Roventini, A. & Sapio, A., 2018. "Faraway, So Close: Coupled Climate and Economic Dynamics in an Agent-based Integrated Assessment Model," Ecological Economics, Elsevier, vol. 150(C), pages 315-339.
    4. Giovanni Dosi & Andrea Roventini, 2019. "More is different ... and complex! the case for agent-based macroeconomics," Journal of Evolutionary Economics, Springer, vol. 29(1), pages 1-37, March.
    5. Barde, Sylvain, 2020. "Macroeconomic simulation comparison with a multivariate extension of the Markov information criterion," Journal of Economic Dynamics and Control, Elsevier, vol. 111(C).
    6. Lamperti, Francesco & Roventini, Andrea & Sani, Amir, 2018. "Agent-based model calibration using machine learning surrogates," Journal of Economic Dynamics and Control, Elsevier, vol. 90(C), pages 366-389.
    7. Guerini, Mattia & Napoletano, Mauro & Roventini, Andrea, 2018. "No man is an Island: The impact of heterogeneity and local interactions on macroeconomic dynamics," Economic Modelling, Elsevier, vol. 68(C), pages 82-95.
    8. Giovanni Dosi & Mauro Napoletano & Andrea Roventini & Joseph E. Stiglitz & Tania Treibich, 2020. "Rational Heuristics? Expectations And Behaviors In Evolving Economies With Heterogeneous Interacting Agents," Economic Inquiry, Western Economic Association International, vol. 58(3), pages 1487-1516, July.
    9. repec:spo:wpmain:info:hdl:2441/46k9rkvut99i7qnn4vqm25t53b is not listed on IDEAS
    10. Francesco Lamperti & Giovanni Dosi & Mauro Napoletano & Andrea Roventini & Alessandro Sapio, 2018. "And then he wasn't a she : Climate change and green transitions in an agent-based integrated assessment model," Working Papers hal-03443464, HAL.
    11. Lamperti, F. & Dosi, G. & Napoletano, M. & Roventini, A. & Sapio, A., 2020. "Climate change and green transitions in an agent-based integrated assessment model," Technological Forecasting and Social Change, Elsevier, vol. 153(C).
    12. Dosi, Giovanni & Roventini, Andrea & Russo, Emanuele, 2019. "Endogenous growth and global divergence in a multi-country agent-based model," Journal of Economic Dynamics and Control, Elsevier, vol. 101(C), pages 101-129.
    13. Vandin, Andrea & Giachini, Daniele & Lamperti, Francesco & Chiaromonte, Francesca, 2022. "Automated and distributed statistical analysis of economic agent-based models," Journal of Economic Dynamics and Control, Elsevier, vol. 143(C).
    14. Otto, C. & Willner, S.N. & Wenz, L. & Frieler, K. & Levermann, A., 2017. "Modeling loss-propagation in the global supply network: The dynamic agent-based model acclimate," Journal of Economic Dynamics and Control, Elsevier, vol. 83(C), pages 232-269.
    15. Lamperti, Francesco & Bosetti, Valentina & Roventini, Andrea & Tavoni, Massimo & Treibich, Tania, 2021. "Three green financial policies to address climate risks," Journal of Financial Stability, Elsevier, vol. 54(C).
    16. Otto, Christian & Willner, Sven Norman & Wenz, Leonie & Frieler, Katja & Levermann, Anders, 2017. "Modeling loss-propagation in the global supply network: The dynamic agent-based model acclimate," OSF Preprints 7yyhd, Center for Open Science.
    17. Rengs, Bernhard & Scholz-Wäckerle, Manuel & van den Bergh, Jeroen, 2020. "Evolutionary macroeconomic assessment of employment and innovation impacts of climate policy packages," Journal of Economic Behavior & Organization, Elsevier, vol. 169(C), pages 332-368.
    18. repec:hal:spmain:info:hdl:2441/46k9rkvut99i7qnn4vqm25t53b is not listed on IDEAS
    19. Lamperti, Francesco, 2018. "An information theoretic criterion for empirical validation of simulation models," Econometrics and Statistics, Elsevier, vol. 5(C), pages 83-106.
    20. Alperen Bektas & Valentino Piana & René Schumann, 2021. "A meso-level empirical validation approach for agent-based computational economic models drawing on micro-data: a use case with a mobility mode-choice model," SN Business & Economics, Springer, vol. 1(6), pages 1-25, June.
    21. Grazzini, Jakob & Richiardi, Matteo G. & Tsionas, Mike, 2017. "Bayesian estimation of agent-based models," Journal of Economic Dynamics and Control, Elsevier, vol. 77(C), pages 26-47.
    22. repec:spo:wpmain:info:hdl:2441/50jd34uldo9jioklc7b0dpu4ej is not listed on IDEAS
    23. Balint, T. & Lamperti, F. & Mandel, A. & Napoletano, M. & Roventini, A. & Sapio, A., 2017. "Complexity and the Economics of Climate Change: A Survey and a Look Forward," Ecological Economics, Elsevier, vol. 138(C), pages 252-265.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:compec:v:60:y:2022:i:4:d:10.1007_s10614-021-10191-w. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.