IDEAS home Printed from https://ideas.repec.org/a/jas/jasssj/2014-43-2.html
   My bibliography  Save this article

A New Method to Evaluate Simulation Models: The Calibration Profile (CP) Algorithm

Author

Listed:
  • Romain Reuillon
  • Clara Schmitt
  • Ricardo De Aldama
  • Jean-Baptiste Mouret

Abstract

Models of social systems generally contain free parameters that cannot be evaluated directly from data. A calibration phase is therefore necessary to assess the capacity of the model to produce the expected dynamics. However, despite the high computational cost of this calibration it doesn't produce a global picture of the relationship between the parameter space and the behaviour space of the model. The Calibration Profile (CP) algorithm is an innovative method extending the concept of automated calibration processes. It computes a profile that depicts the effect of each single parameter on the model behaviour, independently from the others. A 2-dimensional graph is thus produced exposing the impact of the parameter under study on the capacity of the model to produce expected dynamics. The first part of this paper is devoted to the formal description of the CP algorithm. In the second part,we apply it to an agent based geographical model (SimpopLocal). The analysis of the results brings to light novel insights on the model.

Suggested Citation

  • Romain Reuillon & Clara Schmitt & Ricardo De Aldama & Jean-Baptiste Mouret, 2015. "A New Method to Evaluate Simulation Models: The Calibration Profile (CP) Algorithm," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 18(1), pages 1-12.
    • Handle: RePEc:jas:jasssj:2014-43-2
    as

    Download full text from publisher

    File URL: https://www.jasss.org/18/1/12/12.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Brian J. L. Berry, 1964. "Cities As Systems Within Systems Of Cities," Papers in Regional Science, Wiley Blackwell, vol. 13(1), pages 147-163, January.
    2. Anne Bretagnolle & Denise Pumain, 2010. "Simulating Urban Networks through Multiscalar Space-Time Dynamics: Europe and the United States, 17th-20th Centuries," Urban Studies, Urban Studies Journal Limited, vol. 47(13), pages 2819-2839, November.
    3. A G Wilson, 1971. "A Family of Spatial Interaction Models, and Associated Developments," Environment and Planning A, , vol. 3(1), pages 1-32, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Antoine Peris & Evert Meijers & Maarten Ham, 2018. "The Evolution of the Systems of Cities Literature Since 1995: Schools of Thought and their Interaction," Networks and Spatial Economics, Springer, vol. 18(3), pages 533-554, September.
    2. Brian J. L. Berry, 1995. "Whither Regional Science?," International Regional Science Review, , vol. 17(3), pages 297-305, July.
    3. Daniel A. Griffith & Manfred M. Fischer, 2016. "Constrained Variants of the Gravity Model and Spatial Dependence: Model Specification and Estimation Issues," Advances in Spatial Science, in: Roberto Patuelli & Giuseppe Arbia (ed.), Spatial Econometric Interaction Modelling, chapter 0, pages 37-66, Springer.
    4. Denise Pumain, 2006. "Villes et systèmes de villes dans l’économie," Revue d'Économie Financière, Programme National Persée, vol. 86(5), pages 29-46.
    5. Mikhail Rogov & Céline Rozenblat, 2018. "Urban Resilience Discourse Analysis: Towards a Multi-Level Approach to Cities," Sustainability, MDPI, vol. 10(12), pages 1-21, November.
    6. M. Centorrino & F. Ofria & D. Farinella, 2010. "Convergence and divergence processes between the Mezzogiorno and the Centre- North ten years after the adoption of the EMU," Rivista economica del Mezzogiorno, Società editrice il Mulino, issue 3, pages 453-486.
    7. Peter Wissoker & Desiree Fields & Rachel Weber & Elvin Wyly, 2014. "Rethinking Real Estate Finance in the Wake of a Boom: A Celebration of the Twentieth Anniversary of the Publication of the Double Issue on Property and Finance in Environment and Planning A," Environment and Planning A, , vol. 46(12), pages 2787-2794, December.
    8. Marcel Ausloos & Herbert Dawid & Ugo Merlone, 2015. "Spatial Interactions in Agent-Based Modeling," Dynamic Modeling and Econometrics in Economics and Finance, in: Pasquale Commendatore & Saime Kayam & Ingrid Kubin (ed.), Complexity and Geographical Economics, edition 127, pages 353-377, Springer.
    9. Xingjian Liu & Ben Derudder & Frank Witlox & Michael Hoyler, 2014. "Cities As Networks within Networks of Cities: The Evolution of the City/Firm-Duality in the World City Network, 2000–2010," Tijdschrift voor Economische en Sociale Geografie, Royal Dutch Geographical Society KNAG, vol. 105(4), pages 465-482, September.
    10. Xu, Gang & Xu, Zhibang & Gu, Yanyan & Lei, Weiqian & Pan, Yupiao & Liu, Jie & Jiao, Limin, 2020. "Scaling laws in intra-urban systems and over time at the district level in Shanghai, China," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 560(C).
    11. Karima Kourtit & Peter Nijkamp, 2013. "The Use of Visual Decision Support Tools in an Interactive Stakeholder Analysis—Old Ports as New Magnets for Creative Urban Development," Sustainability, MDPI, vol. 5(10), pages 1-27, October.
    12. Halás, Marián & Klapka, Pavel & Kladivo, Petr, 2014. "Distance-decay functions for daily travel-to-work flows," Journal of Transport Geography, Elsevier, vol. 35(C), pages 107-119.
    13. Qingsong He & Lingping Huang & Jing Li, 2022. "Rediscovering the Scaling Law of Urban Land from a Multi-Scale Perspective—A Case Study of Wuhan," Land, MDPI, vol. 11(6), pages 1-15, June.
    14. Bade, Franz-Josef & Niebuhr, Annekatrin & Schönert, Matthias, 2000. "Spatial structural change – Evidence and prospects," HWWA Discussion Papers 87, Hamburg Institute of International Economics (HWWA).
    15. Ahmed El-Geneidy & David Levinson, 2011. "Place Rank: Valuing Spatial Interactions," Networks and Spatial Economics, Springer, vol. 11(4), pages 643-659, December.
    16. Nijkamp, Peter & Poot, Jacques, 1987. "Dynamics of generalised spatial interaction models," Regional Science and Urban Economics, Elsevier, vol. 17(3), pages 367-390, August.
    17. M. Hodgson & Soren Jacobsen, 2009. "A hierarchical location-allocation model with travel based on expected referral distances," Annals of Operations Research, Springer, vol. 167(1), pages 271-286, March.
    18. Nancy Ruiz Estupiñán & Carlos Marmolejo Duarte & Moira Tornés Fernández, 2013. "Functional Polycentricity And Its Role In The Emergence Of Structural Places. The Case Of Major Spanish Metropolitan Areas," ERSA conference papers ersa13p634, European Regional Science Association.
    19. Tiller, Kara Carroll & Thill, Jean-Claude, 2017. "Spatial patterns of landside trade impedance in containerized South American exports," Journal of Transport Geography, Elsevier, vol. 58(C), pages 272-285.
    20. Johannes Illenberger & Kai Nagel & Gunnar Flötteröd, 2013. "The Role of Spatial Interaction in Social Networks," Networks and Spatial Economics, Springer, vol. 13(3), pages 255-282, September.

    More about this item

    Keywords

    Calibration Profile; Model Evaluation;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:jas:jasssj:2014-43-2. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Francesco Renzini (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.