IDEAS home Printed from https://ideas.repec.org/a/jas/jasssj/2020-133-3.html
   My bibliography  Save this article

Where Does Theory Have It Right? A Comparison of Theory-Driven and Empirical Agent Based Models

Author

Listed:

Abstract

Computational social science has witnessed a shift from pure theoretical to empirical agent-based models (ABMs) grounded in data-driven correlations between behavioral factors defining agents' decisions. There is a strong urge to go beyond theoretical ABMs with behavioral theories setting stylized rules that guide agents' actions, especially when it concerns policy-related simulations. However, it remains unclear to what extent theory-driven ABMs mislead, if at all, a choice of a policy when compared to the outcomes of models with empirical micro-foundations. This is especially relevant for pro-environmental policies that increasingly rely on quantifying cumulative effects of individual behavioral changes, where ABMs are so helpful. We propose a comparison framework to address this methodological dilemma, which quantitatively explores the gap in predictions between theory- and data-driven ABMs. Inspired by the existing theory-driven model, ORVin-T, which studies the individual choice between organic and conventional products, we design a survey to collect data on individual preferences and purchasing decisions. We then use this extensive empirical microdata to build an empirical twin, ORVin-E, replacing the theoretical assumptions and secondary aggregated data used to parametrize agents' decision strategies with our empirical survey data. We compare the models in terms of key outputs, perform sensitivity analysis, and explore three policy scenarios. We observe that the theory-driven model predicts the shifts to organic consumption as accurately as the ABM with empirical micro-foundations at both aggregated and individual scales. There are slight differences (±5%) between the estimations of the two models with regard to different behavioral change scenarios: increasing conventional tax, launching organic social-informational campaigns, and their combination. Our findings highlight the goodness of fit and usefulness of theoretical modeling efforts, at least in the case of incremental behavioral change. It sheds light on the conditions when theory-driven and data-driven models are aligned and on the value of empirical data for studying systemic changes.

Suggested Citation

  • Firouzeh Taghikhah & Tatiana Filatova & Alexey Voinov, 2021. "Where Does Theory Have It Right? A Comparison of Theory-Driven and Empirical Agent Based Models," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 24(2), pages 1-4.
  • Handle: RePEc:jas:jasssj:2020-133-3
    as

    Download full text from publisher

    File URL: https://www.jasss.org/24/2/4/4.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Paolo Zeppini & Koen Frenken, 2018. "Networks, Percolation, and Consumer Demand," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 21(3), pages 1-1.
    2. Paul Windrum & Giorgio Fagiolo & Alessio Moneta, 2007. "Empirical Validation of Agent-Based Models: Alternatives and Prospects," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 10(2), pages 1-8.
    3. Wander Jager, 2017. "Enhancing the Realism of Simulation (EROS): On Implementing and Developing Psychological Theory in Social Simulation," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 20(3), pages 1-14.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lamperti, Francesco & Bosetti, Valentina & Roventini, Andrea & Tavoni, Massimo & Treibich, Tania, 2021. "Three green financial policies to address climate risks," Journal of Financial Stability, Elsevier, vol. 54(C).
    2. Francesco Lamperti & Giovanni Dosi & Mauro Napoletano & Andrea Roventini & Alessandro Sapio, 2018. "And then he wasn't a she : Climate change and green transitions in an agent-based integrated assessment model," Working Papers hal-03443464, HAL.
    3. Kukacka, Jiri & Jang, Tae-Seok & Sacht, Stephen, 2018. "On the estimation of behavioral macroeconomic models via simulated maximum likelihood," Economics Working Papers 2018-11, Christian-Albrechts-University of Kiel, Department of Economics.
    4. Juan Manuel Larrosa, 2016. "Agentes computacionales y análisis económico," Revista de Economía Institucional, Universidad Externado de Colombia - Facultad de Economía, vol. 18(34), pages 87-113, January-J.
    5. LeBaron Blake & Winker Peter, 2008. "Introduction to the Special Issue on Agent-Based Models for Economic Policy Advice," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 228(2-3), pages 141-148, April.
    6. Arnaud Z. Dragicevic, 2019. "Market Coordination Under Non-Equilibrium Dynamics," Networks and Spatial Economics, Springer, vol. 19(3), pages 697-715, September.
    7. Corrado Monti & Marco Pangallo & Gianmarco De Francisci Morales & Francesco Bonchi, 2022. "On learning agent-based models from data," Papers 2205.05052, arXiv.org, revised Nov 2022.
    8. Lamperti, Francesco & Roventini, Andrea & Sani, Amir, 2018. "Agent-based model calibration using machine learning surrogates," Journal of Economic Dynamics and Control, Elsevier, vol. 90(C), pages 366-389.
    9. Sandrine Jacob Leal & Mauro Napoletano & Andrea Roventini & Giorgio Fagiolo, 2016. "Rock around the clock: An agent-based model of low- and high-frequency trading," Journal of Evolutionary Economics, Springer, vol. 26(1), pages 49-76, March.
    10. Giorgio Fagiolo & Mattia Guerini & Francesco Lamperti & Alessio Moneta & Andrea Roventini, 2017. "Validation of Agent-Based Models in Economics and Finance," LEM Papers Series 2017/23, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy.
    11. Gianluca Capone & Franco Malerba & Richard R. Nelson & Luigi Orsenigo & Sidney G. Winter, 2019. "History friendly models: retrospective and future perspectives," Eurasian Business Review, Springer;Eurasia Business and Economics Society, vol. 9(1), pages 1-23, March.
    12. Gomes, Sharlene L. & Hermans, Leon M. & Thissen, Wil A.H., 2018. "Extending community operational research to address institutional aspects of societal problems: Experiences from peri-urban Bangladesh," European Journal of Operational Research, Elsevier, vol. 268(3), pages 904-917.
    13. Dosi, Giovanni & Palagi, Elisa & Roventini, Andrea & Russo, Emanuele, 2023. "Do patents really foster innovation in the pharmaceutical sector? Results from an evolutionary, agent-based model," Journal of Economic Behavior & Organization, Elsevier, vol. 212(C), pages 564-589.
    14. Flaminio Squazzoni, 2010. "The impact of agent-based models in the social sciences after 15 years of incursions," History of Economic Ideas, Fabrizio Serra Editore, Pisa - Roma, vol. 18(2), pages 197-234.
    15. John DiNardo & David S. Lee, 2010. "Program Evaluation and Research Designs," Working Papers 1228, Princeton University, Department of Economics, Industrial Relations Section..
    16. Mattia Guerini & Francesco Lamperti & Mauro Napoletano & Andrea Roventini & Tania Treibich, 2022. "Unconventional monetary policies in an agent-based model with mark-to-market standards," Review of Evolutionary Political Economy, Springer, vol. 3(1), pages 73-107, April.
    17. Fatouh, Mahmoud & Markose, Sheri & Giansante, Simone, 2021. "The impact of quantitative easing on UK bank lending: Why banks do not lend to businesses?," Journal of Economic Behavior & Organization, Elsevier, vol. 183(C), pages 928-953.
    18. Hossein Sabzian & Mohammad Ali Shafia & Ali Maleki & Seyeed Mostapha Seyeed Hashemi & Ali Baghaei & Hossein Gharib, 2019. "Theories and Practice of Agent based Modeling: Some practical Implications for Economic Planners," Papers 1901.08932, arXiv.org.
    19. Colasante, Annarita, 2016. "Evolution of Cooperation in Public Good Game," MPRA Paper 72577, University Library of Munich, Germany.
    20. Noeldeke, Beatrice & Winter, Etti & Ntawuhiganayo, Elisée Bahati, 2022. "Representing human decision-making in agent-based simulation models: Agroforestry adoption in rural Rwanda," Ecological Economics, Elsevier, vol. 200(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:jas:jasssj:2020-133-3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Francesco Renzini (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.