IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v254y2016i2p517-531.html
   My bibliography  Save this article

Test-driven simulation modelling: A case study using agent-based maritime search-operation simulation

Author

Listed:
  • Onggo, Bhakti Stephan
  • Karatas, Mumtaz

Abstract

Model verification and validation (V&V) is one of the most important activities in simulation modelling. Model validation is especially challenging for Agent-Based Simulation (ABS). Techniques that can help to improve V&V in simulation modelling are needed. This paper proposes a V&V technique called Test-Driven Simulation Modelling (TDSM) which applies techniques from Test-Driven Development in software engineering to simulation modelling. The main principle in TDSM is that a unit test for a simulation model has to be specified before the simulation model is implemented. Hence, TDSM explicitly embeds V&V in simulation modelling. We use a case study in maritime search operations to demonstrate how TDSM can be used in practice. Maritime search operations (and search operations in general) are one of the classic applications of Operational Research (OR). Hence, we can use analytical models from the vast search theory literature for unit tests in TDSM. The results show that TDSM is a useful technique in the verification and validation of simulation models, especially ABS models. This paper also shows that ABS can offer an alternative modelling approach in the analysis of maritime search operations.

Suggested Citation

  • Onggo, Bhakti Stephan & Karatas, Mumtaz, 2016. "Test-driven simulation modelling: A case study using agent-based maritime search-operation simulation," European Journal of Operational Research, Elsevier, vol. 254(2), pages 517-531.
    • Handle: RePEc:eee:ejores:v:254:y:2016:i:2:p:517-531
    DOI: 10.1016/j.ejor.2016.03.050
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377221716301965
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.ejor.2016.03.050?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. G. Fagiolo & C. Birchenhall & P. Windrum, 2007. "Empirical Validation in Agent-based Models: Introduction to the Special Issue," Computational Economics, Springer;Society for Computational Economics, vol. 30(3), pages 189-194, October.
    2. Paul Windrum & Giorgio Fagiolo & Alessio Moneta, 2007. "Empirical Validation of Agent-Based Models: Alternatives and Prospects," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 10(2), pages 1-8.
    3. Kleijnen, Jack P. C., 1995. "Verification and validation of simulation models," European Journal of Operational Research, Elsevier, vol. 82(1), pages 145-162, April.
    4. A Emre Varol & Murat M Gunal, 2015. "Simulating prevention operations at sea against maritime piracy," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 66(12), pages 2037-2049, December.
    5. Jan C. Thiele & Winfried Kurth & Volker Grimm, 2014. "Facilitating Parameter Estimation and Sensitivity Analysis of Agent-Based Models: A Cookbook Using NetLogo and 'R'," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 17(3), pages 1-11.
    6. R R Hill & R G Carl & L E Champagne, 2006. "Using agent-based simulation to empirically examine search theory using a historical case study," Journal of Simulation, Taylor & Francis Journals, vol. 1(1), pages 29-38, December.
    7. Brian Heath & Raymond Hill & Frank Ciarallo, 2009. "A Survey of Agent-Based Modeling Practices (January 1998 to July 2008)," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 12(4), pages 1-9.
    8. Elio Marchione & Shane D Johnson & Alan Wilson, 2014. "Modelling Maritime Piracy: A Spatial Approach," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 17(2), pages 1-9.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Li, Xingyu & Epureanu, Bogdan I., 2020. "AI-based competition of autonomous vehicle fleets with application to fleet modularity," European Journal of Operational Research, Elsevier, vol. 287(3), pages 856-874.
    2. Utomo, Dhanan Sarwo & Onggo, Bhakti Stephan & Eldridge, Stephen, 2018. "Applications of agent-based modelling and simulation in the agri-food supply chains," European Journal of Operational Research, Elsevier, vol. 269(3), pages 794-805.
    3. Noeldeke, Beatrice & Winter, Etti & Ntawuhiganayo, Elisée Bahati, 2022. "Representing human decision-making in agent-based simulation models: Agroforestry adoption in rural Rwanda," Ecological Economics, Elsevier, vol. 200(C).
    4. Mumtaz Karatas & Nasuh Razi & Murat M. Gunal, 2017. "An ILP and simulation model to optimize search and rescue helicopter operations," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(11), pages 1335-1351, November.
    5. Mumtaz Karatas & Ertan Yakıcı & Abdullah Dasci, 2022. "Solving a bi-objective unmanned aircraft system location-allocation problem," Annals of Operations Research, Springer, vol. 319(2), pages 1631-1654, December.
    6. Troost, Christian & Huber, Robert & Bell, Andrew R. & van Delden, Hedwig & Filatova, Tatiana & Le, Quang Bao & Lippe, Melvin & Niamir, Leila & Polhill, J. Gareth & Sun, Zhanli & Berger, Thomas, 2023. "How to keep it adequate: A protocol for ensuring validity in agent-based simulation," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 159, pages 1-21.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lamperti, Francesco & Roventini, Andrea & Sani, Amir, 2018. "Agent-based model calibration using machine learning surrogates," Journal of Economic Dynamics and Control, Elsevier, vol. 90(C), pages 366-389.
    2. Giorgio Fagiolo & Mattia Guerini & Francesco Lamperti & Alessio Moneta & Andrea Roventini, 2017. "Validation of Agent-Based Models in Economics and Finance," LEM Papers Series 2017/23, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy.
    3. Hossein Sabzian & Mohammad Ali Shafia & Ali Maleki & Seyeed Mostapha Seyeed Hashemi & Ali Baghaei & Hossein Gharib, 2019. "Theories and Practice of Agent based Modeling: Some practical Implications for Economic Planners," Papers 1901.08932, arXiv.org.
    4. Bert, Federico E. & Rovere, Santiago L. & Macal, Charles M. & North, Michael J. & Podestá, Guillermo P., 2014. "Lessons from a comprehensive validation of an agent based-model: The experience of the Pampas Model of Argentinean agricultural systems," Ecological Modelling, Elsevier, vol. 273(C), pages 284-298.
    5. Kathrin Eismann, 2021. "Diffusion and persistence of false rumors in social media networks: implications of searchability on rumor self-correction on Twitter," Journal of Business Economics, Springer, vol. 91(9), pages 1299-1329, November.
    6. Juan Manuel Larrosa, 2016. "Agentes computacionales y análisis económico," Revista de Economía Institucional, Universidad Externado de Colombia - Facultad de Economía, vol. 18(34), pages 87-113, January-J.
    7. Ngo-Hoang, Dai-Long, 2019. "A research paper of Hossein Sabzian (2019), Theories and Practice of Agent based Modeling: Some practical Implications for Economic Planners, ArXiv, 54p," AgriXiv xutyz, Center for Open Science.
    8. Christopher J Lynch & Saikou Y Diallo & Hamdi Kavak & Jose J Padilla, 2020. "A content analysis-based approach to explore simulation verification and identify its current challenges," PLOS ONE, Public Library of Science, vol. 15(5), pages 1-33, May.
    9. LeBaron Blake & Winker Peter, 2008. "Introduction to the Special Issue on Agent-Based Models for Economic Policy Advice," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 228(2-3), pages 141-148, April.
    10. Gomes, Sharlene L. & Hermans, Leon M. & Thissen, Wil A.H., 2018. "Extending community operational research to address institutional aspects of societal problems: Experiences from peri-urban Bangladesh," European Journal of Operational Research, Elsevier, vol. 268(3), pages 904-917.
    11. Flaminio Squazzoni, 2010. "The impact of agent-based models in the social sciences after 15 years of incursions," History of Economic Ideas, Fabrizio Serra Editore, Pisa - Roma, vol. 18(2), pages 197-234.
    12. Colasante, Annarita, 2016. "Evolution of Cooperation in Public Good Game," MPRA Paper 72577, University Library of Munich, Germany.
    13. Fontana, Magda, 2010. "Can neoclassical economics handle complexity? The fallacy of the oil spot dynamic," Journal of Economic Behavior & Organization, Elsevier, vol. 76(3), pages 584-596, December.
    14. Sylvain Barde & Sander van Der Hoog, 2017. "An empirical validation protocol for large-scale agent-based models," SciencePo Working papers Main hal-03458672, HAL.
    15. Colasante, Annarita, 2017. "Selection of the distributional rule as an alternative tool to foster cooperation in a Public Good Game," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 468(C), pages 482-492.
    16. Francesco Lamperti, 2015. "An Information Theoretic Criterion for Empirical Validation of Time Series Models," LEM Papers Series 2015/02, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy.
    17. Robinson, Scott A. & Rai, Varun, 2015. "Determinants of spatio-temporal patterns of energy technology adoption: An agent-based modeling approach," Applied Energy, Elsevier, vol. 151(C), pages 273-284.
    18. Piergiuseppe Morone & Richard Taylor, 2010. "Knowledge Diffusion and Innovation," Books, Edward Elgar Publishing, number 13143.
    19. Scrieciu, S. Şerban & Barker, Terry & Ackerman, Frank, 2013. "Pushing the boundaries of climate economics: critical issues to consider in climate policy analysis," Ecological Economics, Elsevier, vol. 85(C), pages 155-165.
    20. Pascal Seppecher & Isabelle Salle, 2015. "Deleveraging crises and deep recessions: a behavioural approach," Applied Economics, Taylor & Francis Journals, vol. 47(34-35), pages 3771-3790, July.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:254:y:2016:i:2:p:517-531. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.