IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v234y2023ics0951832023000510.html
   My bibliography  Save this article

A railway accident prevention method based on reinforcement learning – Active preventive strategy by multi-modal data

Author

Listed:
  • Yan, Dongyang
  • Li, Keping
  • Zhu, Qiaozhen
  • Liu, Yanyan

Abstract

Railway systems are entering an era of highly intelligent automation where stability and safety are becoming increasingly important. However, there is still a lack of intelligent and effective ways for railway accident prevention, especially active accident prevention strategies. This paper presents a railway accident prevention method based on the reinforcement learning model and multi-modal data to achieve active railway accident prevention strategies. Three metrics are designed to show the performance of active prevention methods. Based on the three metrics and the data from Federal Railroad Administration, the effectiveness of the proposed method is verified in the case study by introducing two methods as baselines. The results also show that nearly 30% of accidents can be effectively prevented through active preventive measures with the proposed method. Finally, this paper analyzes the influence of personal skills on the proposed model and makes relevant suggestions for improving railway safety based on the analysis of the results.

Suggested Citation

  • Yan, Dongyang & Li, Keping & Zhu, Qiaozhen & Liu, Yanyan, 2023. "A railway accident prevention method based on reinforcement learning – Active preventive strategy by multi-modal data," Reliability Engineering and System Safety, Elsevier, vol. 234(C).
    • Handle: RePEc:eee:reensy:v:234:y:2023:i:c:s0951832023000510
    DOI: 10.1016/j.ress.2023.109136
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832023000510
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.ress.2023.109136?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Mohammadi, Reza & He, Qing, 2022. "A deep reinforcement learning approach for rail renewal and maintenance planning," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    2. Junayed Pasha & Maxim A. Dulebenets & Olumide F. Abioye & Masoud Kavoosi & Ren Moses & John Sobanjo & Eren E. Ozguven, 2020. "A Comprehensive Assessment of the Existing Accident and Hazard Prediction Models for the Highway-Rail Grade Crossings in the State of Florida," Sustainability, MDPI, vol. 12(10), pages 1-27, May.
    3. Gao, Lu & Lu, Pan & Ren, Yihao, 2021. "A deep learning approach for imbalanced crash data in predicting highway-rail grade crossings accidents," Reliability Engineering and System Safety, Elsevier, vol. 216(C).
    4. Liu, Jintao & Schmid, Felix & Li, Keping & Zheng, Wei, 2021. "A knowledge graph-based approach for exploring railway operational accidents," Reliability Engineering and System Safety, Elsevier, vol. 207(C).
    5. Yang, Hongbing & Li, Wenchao & Wang, Bin, 2021. "Joint optimization of preventive maintenance and production scheduling for multi-state production systems based on reinforcement learning," Reliability Engineering and System Safety, Elsevier, vol. 214(C).
    6. Tiancheng Cao & Wenxin Mu & Juanqiong Gou & Liyu Peng, 2020. "A Study of Risk Relevance Reasoning Based on a Context Ontology of Railway Accidents," Risk Analysis, John Wiley & Sons, vol. 40(8), pages 1589-1611, August.
    7. Yang, Ao & Qiu, Qingan & Zhu, Mingren & Cui, Lirong & Chen, Weilin & Chen, Jianhui, 2022. "Condition-based maintenance strategy for redundant systems with arbitrary structures using improved reinforcement learning," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    8. Zhiru Wang & Ran S. Bhamra & Min Wang & Han Xie & Lili Yang, 2020. "Critical Hazards Identification and Prevention of Cascading Escalator Accidents at Metro Rail Transit Stations," IJERPH, MDPI, vol. 17(10), pages 1-20, May.
    9. Zhou, Xiaoyi & Lu, Pan & Zheng, Zijian & Tolliver, Denver & Keramati, Amin, 2020. "Accident Prediction Accuracy Assessment for Highway-Rail Grade Crossings Using Random Forest Algorithm Compared with Decision Tree," Reliability Engineering and System Safety, Elsevier, vol. 200(C).
    10. Ying, Cheng-shuo & Chow, Andy H.F. & Chin, Kwai-Sang, 2020. "An actor-critic deep reinforcement learning approach for metro train scheduling with rolling stock circulation under stochastic demand," Transportation Research Part B: Methodological, Elsevier, vol. 140(C), pages 210-235.
    11. Šemrov, D. & Marsetič, R. & Žura, M. & Todorovski, L. & Srdic, A., 2016. "Reinforcement learning approach for train rescheduling on a single-track railway," Transportation Research Part B: Methodological, Elsevier, vol. 86(C), pages 250-267.
    12. Prashant Singh & Junayed Pasha & Amir Khorram-Manesh & Krzysztof Goniewicz & Abdolreza Roshani & Maxim A. Dulebenets, 2021. "A Holistic Analysis of Train-Vehicle Accidents at Highway-Rail Grade Crossings in Florida," Sustainability, MDPI, vol. 13(16), pages 1-28, August.
    13. Fan, Lin & Su, Huai & Wang, Wei & Zio, Enrico & Zhang, Li & Yang, Zhaoming & Peng, Shiliang & Yu, Weichao & Zuo, Lili & Zhang, Jinjun, 2022. "A systematic method for the optimization of gas supply reliability in natural gas pipeline network based on Bayesian networks and deep reinforcement learning," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    14. Andriotis, C.P. & Papakonstantinou, K.G., 2019. "Managing engineering systems with large state and action spaces through deep reinforcement learning," Reliability Engineering and System Safety, Elsevier, vol. 191(C).
    15. Tian, Yuan & Han, Minghao & Kulkarni, Chetan & Fink, Olga, 2022. "A prescriptive Dirichlet power allocation policy with deep reinforcement learning," Reliability Engineering and System Safety, Elsevier, vol. 224(C).
    16. Scott Deerwester & Susan T. Dumais & George W. Furnas & Thomas K. Landauer & Richard Harshman, 1990. "Indexing by latent semantic analysis," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 41(6), pages 391-407, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Singh, Prashant & Pasha, Junayed & Moses, Ren & Sobanjo, John & Ozguven, Eren E. & Dulebenets, Maxim A., 2022. "Development of exact and heuristic optimization methods for safety improvement projects at level crossings under conflicting objectives," Reliability Engineering and System Safety, Elsevier, vol. 220(C).
    2. Saleh, Ali & Chiachío, Manuel & Salas, Juan Fernández & Kolios, Athanasios, 2023. "Self-adaptive optimized maintenance of offshore wind turbines by intelligent Petri nets," Reliability Engineering and System Safety, Elsevier, vol. 231(C).
    3. Liu, Jintao & Chen, Keyi & Duan, Huayu & Li, Chenling, 2024. "A knowledge graph-based hazard prediction approach for preventing railway operational accidents," Reliability Engineering and System Safety, Elsevier, vol. 247(C).
    4. Lee, Dongkyu & Song, Junho, 2023. "Risk-informed operation and maintenance of complex lifeline systems using parallelized multi-agent deep Q-network," Reliability Engineering and System Safety, Elsevier, vol. 239(C).
    5. Morato, P.G. & Andriotis, C.P. & Papakonstantinou, K.G. & Rigo, P., 2023. "Inference and dynamic decision-making for deteriorating systems with probabilistic dependencies through Bayesian networks and deep reinforcement learning," Reliability Engineering and System Safety, Elsevier, vol. 235(C).
    6. Najafi, Seyedvahid & Lee, Chi-Guhn, 2023. "A deep reinforcement learning approach for repair-based maintenance of multi-unit systems using proportional hazards model," Reliability Engineering and System Safety, Elsevier, vol. 234(C).
    7. Tseremoglou, Iordanis & Santos, Bruno F., 2024. "Condition-Based Maintenance scheduling of an aircraft fleet under partial observability: A Deep Reinforcement Learning approach," Reliability Engineering and System Safety, Elsevier, vol. 241(C).
    8. Wang, Xuekai & D’Ariano, Andrea & Su, Shuai & Tang, Tao, 2023. "Cooperative train control during the power supply shortage in metro system: A multi-agent reinforcement learning approach," Transportation Research Part B: Methodological, Elsevier, vol. 170(C), pages 244-278.
    9. Pinciroli, Luca & Baraldi, Piero & Zio, Enrico, 2023. "Maintenance optimization in industry 4.0," Reliability Engineering and System Safety, Elsevier, vol. 234(C).
    10. Liu, Hengchang & Li, Bo & Yao, Fengming & Hu, Gexi & Xie, Lei, 2024. "Maintenance optimization of multi-unit balanced systems using deep reinforcement learning," Reliability Engineering and System Safety, Elsevier, vol. 244(C).
    11. Liu, Xuan & Meng, Huixing & An, Xu & Xing, Jinduo, 2024. "Integration of functional resonance analysis method and reinforcement learning for updating and optimizing emergency procedures in variable environments," Reliability Engineering and System Safety, Elsevier, vol. 241(C).
    12. Li, Wenqing & Ni, Shaoquan, 2022. "Train timetabling with the general learning environment and multi-agent deep reinforcement learning," Transportation Research Part B: Methodological, Elsevier, vol. 157(C), pages 230-251.
    13. Lee, Juseong & Mitici, Mihaela, 2023. "Deep reinforcement learning for predictive aircraft maintenance using probabilistic Remaining-Useful-Life prognostics," Reliability Engineering and System Safety, Elsevier, vol. 230(C).
    14. Ying, Cheng-shuo & Chow, Andy H.F. & Nguyen, Hoa T.M. & Chin, Kwai-Sang, 2022. "Multi-agent deep reinforcement learning for adaptive coordinated metro service operations with flexible train composition," Transportation Research Part B: Methodological, Elsevier, vol. 161(C), pages 36-59.
    15. Luo, Yi & Zhao, Xiujie & Liu, Bin & He, Shuguang, 2024. "Condition-based maintenance policy for systems under dynamic environment," Reliability Engineering and System Safety, Elsevier, vol. 246(C).
    16. Mohammadi, Reza & He, Qing, 2022. "A deep reinforcement learning approach for rail renewal and maintenance planning," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    17. Zhang, Hengqi & Geng, Hua, 2023. "A methodology to identify and assess high-risk causes for electrical personal accidents based on directed weighted CN," Reliability Engineering and System Safety, Elsevier, vol. 231(C).
    18. Zhou, Yifan & Li, Bangcheng & Lin, Tian Ran, 2022. "Maintenance optimisation of multicomponent systems using hierarchical coordinated reinforcement learning," Reliability Engineering and System Safety, Elsevier, vol. 217(C).
    19. Amini, Mostafa & Bagheri, Ali & Delen, Dursun, 2022. "Discovering injury severity risk factors in automobile crashes: A hybrid explainable AI framework for decision support," Reliability Engineering and System Safety, Elsevier, vol. 226(C).
    20. Lee, Jun S. & Yeo, In-Ho & Bae, Younghoon, 2024. "A stochastic track maintenance scheduling model based on deep reinforcement learning approaches," Reliability Engineering and System Safety, Elsevier, vol. 241(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:234:y:2023:i:c:s0951832023000510. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.