IDEAS home Printed from https://ideas.repec.org/a/jas/jasssj/2003-32-1.html
   My bibliography  Save this article

Replication, Replication and Replication: Some Hard Lessons from Model Alignmen

Author

Abstract

A published simulation model (Riolo et al. 2001) was replicated in two independent implementations so that the results as well as the conceptual design align. This double replication allowed the original to be analysed and critiqued with confidence. In this case, the replication revealed some weaknesses in the original model, which otherwise might not have come to light. This shows that unreplicated simulation models and their results can not be trusted – as with other kinds of experiment, simulations need to be independently replicated.

Suggested Citation

  • Bruce Edmonds & David Hales, 2003. "Replication, Replication and Replication: Some Hard Lessons from Model Alignmen," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 6(4), pages 1-11.
    • Handle: RePEc:jas:jasssj:2003-32-1
    as

    Download full text from publisher

    File URL: http://jasss.soc.surrey.ac.uk/6/4/11.html
    Download Restriction: no
    ---><---

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Happe, K. & Kellermann, K., 2008. "Diese Modelle sind zu komplex! – oder doch nicht?: Experimentelles Design und Metamodellierung als möglicher Weg, das Kommunikationsproblem agentenbasierter Modelle in der Politikanalyse zu lösen," Proceedings “Schriften der Gesellschaft für Wirtschafts- und Sozialwissenschaften des Landbaues e.V.”, German Association of Agricultural Economists (GEWISOLA), vol. 43, March.
    2. Uri Wilensky & William Rand, 2007. "Making Models Match: Replicating an Agent-Based Model," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 10(4), pages 1-2.
    3. Mario Paolucci & Francisco Grimaldo, 2014. "Mechanism change in a simulation of peer review: from junk support to elitism," Scientometrics, Springer;Akadémiai Kiadó, vol. 99(3), pages 663-688, June.
    4. J. Gareth Polhill & Bruce Edmonds, 2007. "Open Access for Social Simulation," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 10(3), pages 1-10.
    5. Ugo Merlone & Michele Sonnessa & Pietro Terna, 2008. "Horizontal and Vertical Multiple Implementations in a Model of Industrial Districts," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 11(2), pages 1-5.
    6. Bruce Edmonds & Emma Norling & David Hales, 2009. "Towards the evolution of social structure," Computational and Mathematical Organization Theory, Springer, vol. 15(2), pages 78-94, June.
    7. Heinrich, Torsten, 2016. "The Narrow and the Broad Approach to Evolutionary Modeling in Economics," MPRA Paper 75797, University Library of Munich, Germany.
    8. Riccardo Boero & Flaminio Squazzoni, 2005. "Does Empirical Embeddedness Matter? Methodological Issues on Agent-Based Models for Analytical Social Science," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 8(4), pages 1-6.
    9. Happe, Kathrin & Kellermann, Konrad, 2007. "DIESE MODELLE SIND ZU KOMPLEX!-ODER DOCH NICHT?: EXPERIMENTELLES DESIGN UND METAMODELLIERUNG ALS MOGLICHER WEG, DAS KOMMUNIKATIONSPROBLEM AGENTENBASIERTER MODELLE IN DER POLITIKANALYSE ZU LOSEN (Germa," 47th Annual Conference, Weihenstephan, Germany, September 26-28, 2007 7613, German Association of Agricultural Economists (GEWISOLA).
    10. Sylvie Geisendorf, 2018. "Evolutionary Climate-Change Modelling: A Multi-Agent Climate-Economic Model," Computational Economics, Springer;Society for Computational Economics, vol. 52(3), pages 921-951, October.
    11. Jannis Beese & M. Kazem Haki & Stephan Aier & Robert Winter, 2019. "Simulation-Based Research in Information Systems," Business & Information Systems Engineering: The International Journal of WIRTSCHAFTSINFORMATIK, Springer;Gesellschaft für Informatik e.V. (GI), vol. 61(4), pages 503-521, August.
    12. José Manuel Galán & Luis R. Izquierdo & Segismundo S. Izquierdo & José Ignacio Santos & Ricardo del Olmo & Adolfo López-Paredes & Bruce Edmonds, 2009. "Errors and Artefacts in Agent-Based Modelling," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 12(1), pages 1-1.
    13. Flaminio Squazzoni, 2010. "The impact of agent-based models in the social sciences after 15 years of incursions," History of Economic Ideas, Fabrizio Serra Editore, Pisa - Roma, vol. 18(2), pages 197-234.
    14. Radax, Wolfgang & Rengs, Bernhard, 2009. "Replication of the Demographic Prisoner’s Dilemma," MPRA Paper 14419, University Library of Munich, Germany.
    15. J. Gareth Polhill & Dawn C. Parker & Daniel Brown & Volker Grimm, 2008. "Using the ODD Protocol for Describing Three Agent-Based Social Simulation Models of Land-Use Change," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 11(2), pages 1-3.
    16. Janssen, Marco A., 2007. "Coordination in irrigation systems: An analysis of the Lansing-Kremer model of Bali," Agricultural Systems, Elsevier, vol. 93(1-3), pages 170-190, March.
    17. Bauermann, Tom & Roos, Michael W. M. & Schaff, Frederik, 2020. "POSA: Policy implementation sensitivity analysis," Ruhr Economic Papers 854, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
    18. Sylvie Geisendorf, 2016. "The impact of personal beliefs on climate change: the “battle of perspectives” revisited," Journal of Evolutionary Economics, Springer, vol. 26(3), pages 551-580, July.
    19. Marco A. Janssen, 2009. "Understanding Artificial Anasazi," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 12(4), pages 1-13.
    20. Juliette Rouchier & Claudio Cioffi-Revilla & J. Gareth Polhill & Keiki Takadama, 2008. "Progress in Model-To-Model Analysis," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 11(2), pages 1-8.
    21. Julian Zappala & Brian Logan, 2010. "Effects of resource availability on consensus decision making in primates," Computational and Mathematical Organization Theory, Springer, vol. 16(4), pages 400-415, December.
    22. Wang, Hsiao-Hsuan & Grant, William E. & Koralewski, Tomasz E. & Brewer, Michael J. & Elliott, Norman C., 2021. "Simulating migration of wind-borne pests: “Deconstructing” representation of the emigration process," Ecological Modelling, Elsevier, vol. 460(C).

    More about this item

    Keywords

    [No keywords];

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:jas:jasssj:2003-32-1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Francesco Renzini (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.