IDEAS home Printed from https://ideas.repec.org/a/spr/jcsosc/v7y2024i2d10.1007_s42001-024-00302-6.html
   My bibliography  Save this article

MAS-Bench: a benchmarking for parameter calibration of multi-agent crowd simulation

Author

Listed:
  • Shusuke Shigenaka

    (National Institute of Advanced Industrial Science and Technology
    University of Tsukuba)

  • Shunki Takami

    (National Institute of Advanced Industrial Science and Technology)

  • Yuki Tanigaki

    (Osaka Institute of Technology)

  • Shuhei Watanabe

    (Preferred Networks Inc.)

  • Masaki Onishi

    (National Institute of Advanced Industrial Science and Technology)

Abstract

Multi-agent simulation (MAS) has attracted significant attention for the prevention of pedestrian accidents and the spread of infectious diseases caused by overcrowding in recent years. In the MAS paradigm, each pedestrian is represented by a single agent. Control parameters for each agent need to be calibrated based on pedestrian traffic data to reproduce phenomena of interest accurately. Furthermore, observing all pedestrian traffic at large-scale events such as festivals and sports games is difficult. In such cases, parameter optimization is essential so that the appropriate parameters can be determined by solving an error minimization problem between the simulation results and incomplete observed pedestrian traffic data. We propose a benchmark problem, namely MAS-Bench, to discuss the performance of MAS parameter calibration methods uniformly. Numerical experiments demonstrate the baseline performance of four well-known optimization methods on six different error minimization problems that are defined on MAS-Bench. Moreover, we investigate the validity of the error function in the calibration by evaluating the correlation between the calibration and estimation scores. These scores are error functions relating to the available and unavailable observations, respectively.

Suggested Citation

  • Shusuke Shigenaka & Shunki Takami & Yuki Tanigaki & Shuhei Watanabe & Masaki Onishi, 2024. "MAS-Bench: a benchmarking for parameter calibration of multi-agent crowd simulation," Journal of Computational Social Science, Springer, vol. 7(2), pages 2121-2145, October.
    • Handle: RePEc:spr:jcsosc:v:7:y:2024:i:2:d:10.1007_s42001-024-00302-6
    DOI: 10.1007/s42001-024-00302-6
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s42001-024-00302-6
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s42001-024-00302-6?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Ha, Vi & Lykotrafitis, George, 2012. "Agent-based modeling of a multi-room multi-floor building emergency evacuation," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 391(8), pages 2740-2751.
    2. Khamis, Nurulaqilla & Selamat, Hazlina & Ismail, Fatimah Sham & Lutfy, Omar Farouq & Haniff, Mohamad Fadzli & Nordin, Ili Najaa Aimi Mohd, 2020. "Optimized exit door locations for a safer emergency evacuation using crowd evacuation model and artificial bee colony optimization," Chaos, Solitons & Fractals, Elsevier, vol. 131(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ma, Yaping & Zhang, Gangqiang & Huo, Feizhou, 2024. "An evacuation model considering pedestrian fall behavior in an inclined passenger ship," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 643(C).
    2. Xuefeng Zhao & Lingli Huang & Zhe Sun & Xiongtao Fan & Meng Zhang, 2023. "Design Optimization of Building Exit Locations Based on Building Information Model and Ontology," Sustainability, MDPI, vol. 15(17), pages 1-18, August.
    3. Bao, Yu & Huo, Feizhou, 2021. "An agent-based model for staircase evacuation considering agent’s rotational behavior," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 572(C).
    4. Zhang, Yihao & Chai, Zhaojie & Lykotrafitis, George, 2021. "Deep reinforcement learning with a particle dynamics environment applied to emergency evacuation of a room with obstacles," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 571(C).
    5. Wan, Jiahui & Sui, Jie & Yu, Hua, 2014. "Research on evacuation in the subway station in China based on the Combined Social Force Model," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 394(C), pages 33-46.
    6. Johansson, Fredrik & Peterson, Anders & Tapani, Andreas, 2015. "Waiting pedestrians in the social force model," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 419(C), pages 95-107.
    7. Kaifeng Deng & Meng Li & Guanning Wang & Xiangmin Hu & Yan Zhang & Huijie Zheng & Koukou Tian & Tao Chen, 2022. "Experimental Study on Panic during Simulated Fire Evacuation Using Psycho- and Physiological Metrics," IJERPH, MDPI, vol. 19(11), pages 1-18, June.
    8. Li, Wenhang & Gong, Jianhua & Yu, Ping & Shen, Shen & Li, Rong & Duan, Qishen, 2015. "Simulation and analysis of congestion risk during escalator transfers using a modified social force model," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 420(C), pages 28-40.
    9. Maren S. Barth & Katharina Palm & Henrik Andersson & Tobias A. Granberg & Anders N. Gullhav & Andreas Krüger, 2024. "Emergency exit layout planning using optimization and agent-based simulation," Computational Management Science, Springer, vol. 21(1), pages 1-25, June.
    10. Khamis, Nurulaqilla & Selamat, Hazlina & Ismail, Fatimah Sham & Lutfy, Omar Farouq & Haniff, Mohamad Fadzli & Nordin, Ili Najaa Aimi Mohd, 2020. "Optimized exit door locations for a safer emergency evacuation using crowd evacuation model and artificial bee colony optimization," Chaos, Solitons & Fractals, Elsevier, vol. 131(C).
    11. Ma, Yi & Yuen, Richard Kwok Kit & Lee, Eric Wai Ming, 2016. "Effective leadership for crowd evacuation," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 450(C), pages 333-341.
    12. Nan Zhang & Hong Huang & Boni Su & Hui Zhang, 2013. "Population evacuation analysis: considering dynamic population vulnerability distribution and disaster information dissemination," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 69(3), pages 1629-1646, December.
    13. Alessandro D’Amico & Martina Russo & Marco Angelosanti & Gabriele Bernardini & Donatella Vicari & Enrico Quagliarini & Edoardo Currà, 2021. "Built Environment Typologies Prone to Risk: A Cluster Analysis of Open Spaces in Italian Cities," Sustainability, MDPI, vol. 13(16), pages 1-32, August.
    14. Huo, Feizhou & Li, Yufei & Li, Chao & Ma, Yaping, 2022. "An extended model describing pedestrian evacuation considering pedestrian crowding and stampede behavior," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 604(C).
    15. Sticco, I.M. & Frank, G.A. & Dorso, C.O., 2021. "Social Force Model parameter testing and optimization using a high stress real-life situation," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 561(C).
    16. Deng, Fangwei & Wang, Jinghui & Li, Di & Lv, Wei & Fang, Zhiming, 2024. "Development of a three-stage hierarchical model for quick calculating stair evacuation time of high-rise building coupled with simulation analysis," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 640(C).
    17. Li, Shuying & Zhuang, Jun & Shen, Shifei & Wang, Jia, 2017. "Driving-forces model on individual behavior in scenarios considering moving threat agents," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 481(C), pages 127-140.
    18. Zhao, Mingyang & Liang, Ci, 2024. "A novel extended social force model for studying the impact of the heterogeneity of pedestrian physical fitness on emergency evacuation efficiency," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 653(C).
    19. Li, Yufei & Li, Chao & Guo, Chenglin & Huo, Feizhou, 2024. "Dynamic coupling model of FDS and cellular automata considering trampling behavior," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 633(C).
    20. Sun, Jiangtao & Lu, Zhaijun & Zhou, Dan, 2024. "Optimization analysis of evacuation facility parameters in interval tunnels under subway train fire accidents," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 651(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:jcsosc:v:7:y:2024:i:2:d:10.1007_s42001-024-00302-6. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.