IDEAS home Printed from https://ideas.repec.org/a/jas/jasssj/2020-133-3.html
   My bibliography  Save this article

Where Does Theory Have It Right? A Comparison of Theory-Driven and Empirical Agent Based Models

Author

Listed:

Abstract

Computational social science has witnessed a shift from pure theoretical to empirical agent-based models (ABMs) grounded in data-driven correlations between behavioral factors defining agents' decisions. There is a strong urge to go beyond theoretical ABMs with behavioral theories setting stylized rules that guide agents' actions, especially when it concerns policy-related simulations. However, it remains unclear to what extent theory-driven ABMs mislead, if at all, a choice of a policy when compared to the outcomes of models with empirical micro-foundations. This is especially relevant for pro-environmental policies that increasingly rely on quantifying cumulative effects of individual behavioral changes, where ABMs are so helpful. We propose a comparison framework to address this methodological dilemma, which quantitatively explores the gap in predictions between theory- and data-driven ABMs. Inspired by the existing theory-driven model, ORVin-T, which studies the individual choice between organic and conventional products, we design a survey to collect data on individual preferences and purchasing decisions. We then use this extensive empirical microdata to build an empirical twin, ORVin-E, replacing the theoretical assumptions and secondary aggregated data used to parametrize agents' decision strategies with our empirical survey data. We compare the models in terms of key outputs, perform sensitivity analysis, and explore three policy scenarios. We observe that the theory-driven model predicts the shifts to organic consumption as accurately as the ABM with empirical micro-foundations at both aggregated and individual scales. There are slight differences (±5%) between the estimations of the two models with regard to different behavioral change scenarios: increasing conventional tax, launching organic social-informational campaigns, and their combination. Our findings highlight the goodness of fit and usefulness of theoretical modeling efforts, at least in the case of incremental behavioral change. It sheds light on the conditions when theory-driven and data-driven models are aligned and on the value of empirical data for studying systemic changes.

Suggested Citation

  • Firouzeh Taghikhah & Tatiana Filatova & Alexey Voinov, 2021. "Where Does Theory Have It Right? A Comparison of Theory-Driven and Empirical Agent Based Models," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 24(2), pages 1-4.
  • Handle: RePEc:jas:jasssj:2020-133-3
    as

    Download full text from publisher

    File URL: https://www.jasss.org/24/2/4/4.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Paolo Zeppini & Koen Frenken, 2018. "Networks, Percolation, and Consumer Demand," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 21(3), pages 1-1.
    2. Paul Windrum & Giorgio Fagiolo & Alessio Moneta, 2007. "Empirical Validation of Agent-Based Models: Alternatives and Prospects," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 10(2), pages 1-8.
    3. Wander Jager, 2017. "Enhancing the Realism of Simulation (EROS): On Implementing and Developing Psychological Theory in Social Simulation," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 20(3), pages 1-14.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. LeBaron Blake & Winker Peter, 2008. "Introduction to the Special Issue on Agent-Based Models for Economic Policy Advice," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 228(2-3), pages 141-148, April.
    2. Arnaud Z. Dragicevic, 2019. "Market Coordination Under Non-Equilibrium Dynamics," Networks and Spatial Economics, Springer, vol. 19(3), pages 697-715, September.
    3. Corrado Monti & Marco Pangallo & Gianmarco De Francisci Morales & Francesco Bonchi, 2022. "On learning agent-based models from data," Papers 2205.05052, arXiv.org, revised Nov 2022.
    4. Lamperti, Francesco & Roventini, Andrea & Sani, Amir, 2018. "Agent-based model calibration using machine learning surrogates," Journal of Economic Dynamics and Control, Elsevier, vol. 90(C), pages 366-389.
    5. Giorgio Fagiolo & Mattia Guerini & Francesco Lamperti & Alessio Moneta & Andrea Roventini, 2017. "Validation of Agent-Based Models in Economics and Finance," LEM Papers Series 2017/23, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy.
    6. Gomes, Sharlene L. & Hermans, Leon M. & Thissen, Wil A.H., 2018. "Extending community operational research to address institutional aspects of societal problems: Experiences from peri-urban Bangladesh," European Journal of Operational Research, Elsevier, vol. 268(3), pages 904-917.
    7. Flaminio Squazzoni, 2010. "The impact of agent-based models in the social sciences after 15 years of incursions," History of Economic Ideas, Fabrizio Serra Editore, Pisa - Roma, vol. 18(2), pages 197-234.
    8. John DiNardo & David S. Lee, 2010. "Program Evaluation and Research Designs," Working Papers 1228, Princeton University, Department of Economics, Industrial Relations Section..
    9. Mattia Guerini & Francesco Lamperti & Mauro Napoletano & Andrea Roventini & Tania Treibich, 2022. "Unconventional monetary policies in an agent-based model with mark-to-market standards," Review of Evolutionary Political Economy, Springer, vol. 3(1), pages 73-107, April.
    10. Hossein Sabzian & Mohammad Ali Shafia & Ali Maleki & Seyeed Mostapha Seyeed Hashemi & Ali Baghaei & Hossein Gharib, 2019. "Theories and Practice of Agent based Modeling: Some practical Implications for Economic Planners," Papers 1901.08932, arXiv.org.
    11. Colasante, Annarita, 2016. "Evolution of Cooperation in Public Good Game," MPRA Paper 72577, University Library of Munich, Germany.
    12. Fontana, Magda, 2010. "Can neoclassical economics handle complexity? The fallacy of the oil spot dynamic," Journal of Economic Behavior & Organization, Elsevier, vol. 76(3), pages 584-596, December.
    13. Sylvain Barde & Sander van der Hoog, 2017. "An empirical validation protocol for large-scale agent-based models," Studies in Economics 1712, School of Economics, University of Kent.
    14. Colasante, Annarita, 2017. "Selection of the distributional rule as an alternative tool to foster cooperation in a Public Good Game," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 468(C), pages 482-492.
    15. Sandrine Jacob Leal & Mauro Napoletano & Andrea Roventini & Giorgio Fagiolo, 2016. "Rock around the clock: An agent-based model of low- and high-frequency trading," Journal of Evolutionary Economics, Springer, vol. 26(1), pages 49-76, March.
    16. Dehua Gao & Flaminio Squazzoni & Xiuquan Deng, 2018. "The role of cognitive artifacts in organizational routine dynamics: an agent-based model," Computational and Mathematical Organization Theory, Springer, vol. 24(4), pages 473-499, December.
    17. Gianluca Pallante & Mattia Guerini & Mauro Napoletano & Andrea Roventini, 2024. "Robust-less-fragile: Tackling Systemic Risk and Financial Contagion in a Macro Agent-Based Model," LEM Papers Series 2024/08, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy.
    18. Bert, Federico E. & Rovere, Santiago L. & Macal, Charles M. & North, Michael J. & Podestá, Guillermo P., 2014. "Lessons from a comprehensive validation of an agent based-model: The experience of the Pampas Model of Argentinean agricultural systems," Ecological Modelling, Elsevier, vol. 273(C), pages 284-298.
    19. Faber, Albert & Valente, Marco & Janssen, Peter, 2010. "Exploring domestic micro-cogeneration in the Netherlands: An agent-based demand model for technology diffusion," Energy Policy, Elsevier, vol. 38(6), pages 2763-2775, June.
    20. Robert Huber & Hang Xiong & Kevin Keller & Robert Finger, 2022. "Bridging behavioural factors and standard bio‐economic modelling in an agent‐based modelling framework," Journal of Agricultural Economics, Wiley Blackwell, vol. 73(1), pages 35-63, February.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:jas:jasssj:2020-133-3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Francesco Renzini (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.