IDEAS home Printed from https://ideas.repec.org/a/jas/jasssj/2008-10-2.html
   My bibliography  Save this article

Errors and Artefacts in Agent-Based Modelling

Author

Abstract

The objectives of this paper are to define and classify different types of errors and artefacts that can appear in the process of developing an agent-based model, and to propose activities aimed at avoiding them during the model construction and testing phases. To do this in a structured way, we review the main concepts of the process of developing such a model – establishing a general framework that summarises the process of designing, implementing, and using agent-based models. Within this framework we identify the various stages where different types of errors and artefacts may appear. Finally we propose activities that could be used to detect (and hence eliminate) each type of error or artefact.

Suggested Citation

  • José Manuel Galán & Luis R. Izquierdo & Segismundo S. Izquierdo & José Ignacio Santos & Ricardo del Olmo & Adolfo López-Paredes & Bruce Edmonds, 2009. "Errors and Artefacts in Agent-Based Modelling," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 12(1), pages 1-1.
    • Handle: RePEc:jas:jasssj:2008-10-2
    as

    Download full text from publisher

    File URL: https://www.jasss.org/12/1/1/1.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Keiki Takadama & Yutaka L. Suematsu & Norikazu Sugimoto & Norberto E. Nawa & Katsunori Shimohara, 2003. "Cross-Element Validation in Multiagent-Based Simulation: Switching Learning Mechanisms in Agents," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 6(4), pages 1-6.
    2. Margaret Edwards & Sylvie Huet & François Goreaud & Guillaume Deffuant, 2003. "Comparing an Individual-Based Model of Behaviour Diffusion with Its Mean Field Aggregate Approximation," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 6(4), pages 1-9.
    3. Norman Ehrentreich, 2002. "The Santa Fe Artificial Stock Market Re-Examined - Suggested Corrections," Computational Economics 0209001, University Library of Munich, Germany.
    4. Kleijnen, Jack P. C., 1995. "Verification and validation of simulation models," European Journal of Operational Research, Elsevier, vol. 82(1), pages 145-162, April.
    5. Matteo Richiardi & Roberto Leombruni & Nicole J. Saam & Michele Sonnessa, 2006. "A Common Protocol for Agent-Based Social Simulation," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 9(1), pages 1-15.
    6. Leombruni, Roberto & Richiardi, Matteo, 2005. "Why are economists sceptical about agent-based simulations?," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 355(1), pages 103-109.
    7. Izquierdo, Segismundo S. & Izquierdo, Luis R., 2007. "The impact of quality uncertainty without asymmetric information on market efficiency," Journal of Business Research, Elsevier, vol. 60(8), pages 858-867, August.
    8. Caron-Lormier, Geoffrey & Humphry, Roger W. & Bohan, David A. & Hawes, Cathy & Thorbek, Pernille, 2008. "Asynchronous and synchronous updating in individual-based models," Ecological Modelling, Elsevier, vol. 212(3), pages 522-527.
    9. Axelrod, Robert, 1986. "An Evolutionary Approach to Norms," American Political Science Review, Cambridge University Press, vol. 80(4), pages 1095-1111, December.
    10. Nigel Gilbert & Pietro Terna, 2000. "How to build and use agent-based models in social science," Mind & Society: Cognitive Studies in Economics and Social Sciences, Springer;Fondazione Rosselli, vol. 1(1), pages 57-72, March.
    11. J. Gareth Polhill & Luis R. Izquierdo, 2005. "Lessons Learned from Converting the Artificial Stock Market to Interval Arithmetic," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 8(2), pages 1-2.
    12. José Manuel Galán & Luis R. Izquierdo, 2005. "Appearances Can Be Deceiving: Lessons Learned Re-Implementing Axelrod's 'Evolutionary Approach to Norms'," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 8(3), pages 1-2.
    13. Scott Moss & Bruce Edmonds & Steve Wallis, 1997. "Validation and Verification of Computational Models with Multiple Cognitive Agents," Discussion Papers 97-25, Manchester Metropolitan University, Centre for Policy Modelling.
    14. Bruce Edmonds & David Hales, 2003. "Replication, Replication and Replication: Some Hard Lessons from Model Alignmen," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 6(4), pages 1-11.
    15. LeBaron, Blake & Arthur, W. Brian & Palmer, Richard, 1999. "Time series properties of an artificial stock market," Journal of Economic Dynamics and Control, Elsevier, vol. 23(9-10), pages 1487-1516, September.
    16. Luis R. Izquierdo & J. Gareth Polhill, 2006. "Is Your Model Susceptible to Floating-Point Errors?," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 9(4), pages 1-4.
    17. J. Gareth Polhill & Edoardo Pignotti & Nicholas M. Gotts & Pete Edwards & Alun Preece, 2007. "A Semantic Grid Service for Experimentation with an Agent-Based Model of Land-Use Change," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 10(2), pages 1-2.
    18. Klemm, Konstantin & Eguiluz, Victor M. & Toral, Raul & Miguel, Maxi San, 2005. "Globalization, polarization and cultural drift," Journal of Economic Dynamics and Control, Elsevier, vol. 29(1-2), pages 321-334, January.
    19. Hare, M & Deadman, P, 2004. "Further towards a taxonomy of agent-based simulation models in environmental management," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 64(1), pages 25-40.
    20. Andreas Flache & Rainer Hegselmann, 2001. "Do Irregular Grids Make a Difference? Relaxing the Spatial Regularity Assumption in Cellular Models of Social Dynamics," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 4(4), pages 1-6.
    21. Ehrentreich, Norman, 2006. "Technical trading in the Santa Fe Institute Artificial Stock Market revisited," Journal of Economic Behavior & Organization, Elsevier, vol. 61(4), pages 599-616, December.
    22. J. Gareth Polhill & Luis R. Izquierdo & Nicholas M. Gotts, 2004. "The Ghost in the Model (and Other Effects of Floating Point Arithmetic)," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 8(1), pages 1-5.
    23. Rick L. Riolo & Michael D. Cohen & Robert Axelrod, 2001. "Evolution of cooperation without reciprocity," Nature, Nature, vol. 414(6862), pages 441-443, November.
    24. Segismundo S. Izquierdo & Luis R. Izquierdo & Nicholas M. Gotts, 2008. "Reinforcement Learning Dynamics in Social Dilemmas," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 11(2), pages 1-1.
    25. Uri Wilensky & William Rand, 2007. "Making Models Match: Replicating an Agent-Based Model," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 10(4), pages 1-2.
    26. Sylvie Huet & Margaret Edwards & Guillaume Deffuant, 2007. "Taking into Account the Variations of Neighbourhood Sizes in the Mean-Field Approximation of the Threshold Model on a Random Network," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 10(1), pages 1-10.
    27. Andreas Flache & Michael W. Macy, 2002. "Stochastic Collusion and the Power Law of Learning," Journal of Conflict Resolution, Peace Science Society (International), vol. 46(5), pages 629-653, October.
    28. Jürgen Klüver & Christina Klüver, 2003. "Simulations of Group Dynamics with Different Models," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 6(4), pages 1-8.
    29. W. Brian Arthur & Paul Tayler, "undated". "Asset Pricing Under Endogenous Expectations in an Artificial Stock Market," Computing in Economics and Finance 1997 57, Society for Computational Economics.
    30. Luis R. Izquierdo & Segismundo S. Izquierdo & José Manuel Galán & José Ignacio Santos, 2009. "Techniques to Understand Computer Simulations: Markov Chain Analysis," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 12(1), pages 1-6.
    31. Izquierdo, Luis R. & Izquierdo, Segismundo S. & Gotts, Nicholas M. & Polhill, J. Gary, 2007. "Transient and asymptotic dynamics of reinforcement learning in games," Games and Economic Behavior, Elsevier, vol. 61(2), pages 259-276, November.
    32. George B. Kleindorfer & Liam O'Neill & Ram Ganeshan, 1998. "Validation in Simulation: Various Positions in the Philosophy of Science," Management Science, INFORMS, vol. 44(8), pages 1087-1099, August.
    33. Joshua M. Epstein & Robert L. Axtell, 1996. "Growing Artificial Societies: Social Science from the Bottom Up," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262550253, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jacopo Baggio & Elissaios Papyrakis, 2014. "Agent-Based Simulations of Subjective Well-Being," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 115(2), pages 623-635, January.
    2. Nieddu, Marcello & Bertani, Filippo & Ponta, Linda, 2021. "Sustainability transition and digital trasformation: an agent-based perspective," MPRA Paper 106943, University Library of Munich, Germany.
    3. Rixen, Martin & Weigand, Jürgen, 2014. "Agent-based simulation of policy induced diffusion of smart meters," Technological Forecasting and Social Change, Elsevier, vol. 85(C), pages 153-167.
    4. Juan Manuel Larrosa, 2016. "Agentes computacionales y análisis económico," Revista de Economía Institucional, Universidad Externado de Colombia - Facultad de Economía, vol. 18(34), pages 87-113, January-J.
    5. Flaminio Squazzoni, 2010. "The impact of agent-based models in the social sciences after 15 years of incursions," History of Economic Ideas, Fabrizio Serra Editore, Pisa - Roma, vol. 18(2), pages 197-234.
    6. Nancy Quinceno Cárdenas, 2014. "Modelación basada en agentes en el sistema pensional colombiano. Una aproximación desde el mercado laboral y la dinámica poblacional," Revista CIFE, Universidad Santo Tomás, September.
    7. Paola Tubaro, 2011. "Computational Economics," Chapters, in: John B. Davis & D. Wade Hands (ed.), The Elgar Companion to Recent Economic Methodology, chapter 10, Edward Elgar Publishing.
    8. Sung-youn Kim, 2011. "A Model of Political Judgment: An Agent-Based Simulation of Candidate Evaluation," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 14(2), pages 1-3.
    9. Bernardo Alves Furtado, 2018. "Modeling tax distribution in metropolitan regions with PolicySpace," Papers 1901.02391, arXiv.org.
    10. José M Galán & Maciej M Łatek & Seyed M Mussavi Rizi, 2011. "Axelrod's Metanorm Games on Networks," PLOS ONE, Public Library of Science, vol. 6(5), pages 1-11, May.
    11. J. Gareth Polhill, 2015. "Extracting OWL Ontologies from Agent-Based Models: A Netlogo Extension," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 18(2), pages 1-15.
    12. Marcello Nieddu & Filippo Bertani & Linda Ponta, 2022. "The sustainability transition and the digital transformation: two challenges for agent-based macroeconomic models," Review of Evolutionary Political Economy, Springer, vol. 3(1), pages 193-226, April.
    13. Barroso, Ricardo Vieira & Lima, Joaquim Ignacio Alves Vasconcellos & Lucchetti, Alexandre Henrique & Cajueiro, Daniel Oliveira, 2016. "Interbank network and regulation policies: an analysis through agent-based simulations with adaptive learning," MPRA Paper 73308, University Library of Munich, Germany.
    14. Kolkman, Daan, 2020. "The usefulness of algorithmic models in policy making," SocArXiv hpma8, Center for Open Science.
    15. Sara Lumbreras & Sonja Wogrin & Guillermo Navarro & Ilaria Bertazzi & Maria Pereda, 2019. "A Decentralized Solution for Transmission Expansion Planning: Getting Inspiration from Nature," Energies, MDPI, vol. 12(23), pages 1-17, November.
    16. Georg Holtz & Christian Schnülle & Malcolm Yadack & Jonas Friege & Thorben Jensen & Pablo Thier & Peter Viebahn & Émile J. L. Chappin, 2020. "Using Agent-Based Models to Generate Transformation Knowledge for the German Energiewende—Potentials and Challenges Derived from Four Case Studies," Energies, MDPI, vol. 13(22), pages 1-26, November.
    17. Rubén Fuentes-Fernández & Samer Hassan & Juan Pavón & José M. Galán & Adolfo López-Paredes, 2012. "Metamodels for role-driven agent-based modelling," Computational and Mathematical Organization Theory, Springer, vol. 18(1), pages 91-112, March.
    18. Bernardo Alves Furtado & Gustavo Onofre Andre~ao, 2022. "Machine Learning Simulates Agent-Based Model Towards Policy," Papers 2203.02576, arXiv.org, revised Nov 2022.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Uri Wilensky & William Rand, 2007. "Making Models Match: Replicating an Agent-Based Model," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 10(4), pages 1-2.
    2. J. Gareth Polhill & Dawn C. Parker & Daniel Brown & Volker Grimm, 2008. "Using the ODD Protocol for Describing Three Agent-Based Social Simulation Models of Land-Use Change," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 11(2), pages 1-3.
    3. Luis R. Izquierdo & Segismundo S. Izquierdo & José Manuel Galán & José Ignacio Santos, 2009. "Techniques to Understand Computer Simulations: Markov Chain Analysis," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 12(1), pages 1-6.
    4. Segismundo S. Izquierdo & Luis R. Izquierdo & Nicholas M. Gotts, 2008. "Reinforcement Learning Dynamics in Social Dilemmas," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 11(2), pages 1-1.
    5. Flaminio Squazzoni, 2010. "The impact of agent-based models in the social sciences after 15 years of incursions," History of Economic Ideas, Fabrizio Serra Editore, Pisa - Roma, vol. 18(2), pages 197-234.
    6. Luis R. Izquierdo & J. Gareth Polhill, 2006. "Is Your Model Susceptible to Floating-Point Errors?," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 9(4), pages 1-4.
    7. Juan Manuel Larrosa, 2016. "Agentes computacionales y análisis económico," Revista de Economía Institucional, Universidad Externado de Colombia - Facultad de Economía, vol. 18(34), pages 87-113, January-J.
    8. Chueh-Yung Tsao & Ya-Chi Huang, 2018. "Revisiting the issue of survivability and market efficiency with the Santa Fe Artificial Stock Market," Journal of Economic Interaction and Coordination, Springer;Society for Economic Science with Heterogeneous Interacting Agents, vol. 13(3), pages 537-560, October.
    9. Ya-Chi Huang & Chueh-Yung Tsao, 2018. "Evolutionary Frequency and Forecasting Accuracy: Simulations Based on an Agent-Based Artificial Stock Market," Computational Economics, Springer;Society for Computational Economics, vol. 52(1), pages 79-104, June.
    10. José M Galán & Maciej M Łatek & Seyed M Mussavi Rizi, 2011. "Axelrod's Metanorm Games on Networks," PLOS ONE, Public Library of Science, vol. 6(5), pages 1-11, May.
    11. Andrew W. Bausch, 2014. "Evolving intergroup cooperation," Computational and Mathematical Organization Theory, Springer, vol. 20(4), pages 369-393, December.
    12. Lijian Wei & Xiong Xiong & Wei Zhang & Xue-Zhong He & Yongjie Zhang, 2017. "The effect of genetic algorithm learning with a classifier system in limit order markets," Published Paper Series 2017-3, Finance Discipline Group, UTS Business School, University of Technology, Sydney.
    13. Matthew Oremland & Reinhard Laubenbacher, 2014. "Using difference equations to find optimal tax structures on the SugarScape," Journal of Economic Interaction and Coordination, Springer;Society for Economic Science with Heterogeneous Interacting Agents, vol. 9(2), pages 233-253, October.
    14. J. Gareth Polhill & Bruce Edmonds, 2007. "Open Access for Social Simulation," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 10(3), pages 1-10.
    15. Robert Axtell, 2007. "What economic agents do: How cognition and interaction lead to emergence and complexity," The Review of Austrian Economics, Springer;Society for the Development of Austrian Economics, vol. 20(2), pages 105-122, September.
    16. Mario Paolucci & Francisco Grimaldo, 2014. "Mechanism change in a simulation of peer review: from junk support to elitism," Scientometrics, Springer;Akadémiai Kiadó, vol. 99(3), pages 663-688, June.
    17. Schuster, Stephan, 2012. "Applications in Agent-Based Computational Economics," MPRA Paper 47201, University Library of Munich, Germany.
    18. Dirk Helbing & Anders Johansson, 2010. "Cooperation, Norms, and Revolutions: A Unified Game-Theoretical Approach," PLOS ONE, Public Library of Science, vol. 5(10), pages 1-15, October.
    19. Panchenko, Valentyn & Gerasymchuk, Sergiy & Pavlov, Oleg V., 2013. "Asset price dynamics with heterogeneous beliefs and local network interactions," Journal of Economic Dynamics and Control, Elsevier, vol. 37(12), pages 2623-2642.
    20. Matus Halas, 2018. "Balancing Against Threats In Interactions Determined By Distance And Overall Gains," Advances in Complex Systems (ACS), World Scientific Publishing Co. Pte. Ltd., vol. 21(05), pages 1-22, August.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:jas:jasssj:2008-10-2. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Francesco Renzini (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.