IDEAS home Printed from https://ideas.repec.org/a/gam/jsusta/v14y2022i10p5751-d812160.html
   My bibliography  Save this article

A Robust Adaptive Traffic Signal Control Algorithm Using Q-Learning under Mixed Traffic Flow

Author

Listed:
  • Zibin Wei

    (College of Information and Computer Engineering, Northeast Forestry University, Harbin 150040, China
    These authors contributed equally to this work.)

  • Tao Peng

    (College of Information and Computer Engineering, Northeast Forestry University, Harbin 150040, China
    These authors contributed equally to this work.)

  • Sijia Wei

    (School of Traffic and Transportation, Northeast Forestry University, Harbin 150040, China)

Abstract

The operational and safety performance of intersections is the key to ensuring the efficient operation of urban traffic. With the development of automated driving technologies, the ability of adaptive traffic signal control has been improved according to data detected by connected and automated vehicles (CAVs). In this paper, an adaptive traffic signal control was proposed to optimize the operational and safety performance of the intersection. The proposed algorithm based on Q-learning considers the data detected by loop detectors and CAVs. Furthermore, a comprehensive analysis was conducted to verify the performance of the proposed algorithm. The results show that the average delay and conflict rate have been significantly optimized compared with fixed timing and traffic actuated control. In addition, the performance of the proposed algorithm is good in the test of the irregular intersection. The algorithm provides a new idea for the intelligent management of isolated intersections under the condition of mixed traffic flow. It provides a research basis for the collaborative control of multiple intersections.

Suggested Citation

  • Zibin Wei & Tao Peng & Sijia Wei, 2022. "A Robust Adaptive Traffic Signal Control Algorithm Using Q-Learning under Mixed Traffic Flow," Sustainability, MDPI, vol. 14(10), pages 1-16, May.
    • Handle: RePEc:gam:jsusta:v:14:y:2022:i:10:p:5751-:d:812160
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2071-1050/14/10/5751/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2071-1050/14/10/5751/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Xinqiang Chen & Jinquan Lu & Jiansen Zhao & Zhijian Qu & Yongsheng Yang & Jiangfeng Xian, 2020. "Traffic Flow Prediction at Varied Time Scales via Ensemble Empirical Mode Decomposition and Artificial Neural Network," Sustainability, MDPI, vol. 12(9), pages 1-17, May.
    2. Senlai Zhu & Ke Guo & Yuntao Guo & Huairen Tao & Quan Shi, 2019. "An Adaptive Signal Control Method with Optimal Detector Locations," Sustainability, MDPI, vol. 11(3), pages 1-13, January.
    3. Isaac Oyeyemi Olayode & Lagouge Kwanda Tartibu & Modestus O. Okwu & Alessandro Severino, 2021. "Comparative Traffic Flow Prediction of a Heuristic ANN Model and a Hybrid ANN-PSO Model in the Traffic Flow Modelling of Vehicles at a Four-Way Signalized Road Intersection," Sustainability, MDPI, vol. 13(19), pages 1-28, September.
    4. Tobita, Kazuhiro & Nagatani, Takashi, 2013. "Green-wave control of an unbalanced two-route traffic system with signals," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 392(21), pages 5422-5430.
    5. Mohammed Al-Turki & Nedal T. Ratrout & Syed Masiur Rahman & Imran Reza, 2021. "Impacts of Autonomous Vehicles on Traffic Flow Characteristics under Mixed Traffic Environment: Future Perspectives," Sustainability, MDPI, vol. 13(19), pages 1-22, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hailin Zheng & Qinyou Hu & Chun Yang & Jinhai Chen & Qiang Mei, 2021. "Transmission Path Tracking of Maritime COVID-19 Pandemic via Ship Sailing Pattern Mining," Sustainability, MDPI, vol. 13(3), pages 1-20, January.
    2. Junyan Han & Xiaoyuan Wang & Gang Wang, 2022. "Modeling the Car-Following Behavior with Consideration of Driver, Vehicle, and Environment Factors: A Historical Review," Sustainability, MDPI, vol. 14(13), pages 1-27, July.
    3. Zhai, Linbo & Yang, Yong & Song, Shudian & Ma, Shuyue & Zhu, Xiumin & Yang, Feng, 2021. "Self-supervision Spatiotemporal Part-Whole Convolutional Neural Network for Traffic Prediction," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 579(C).
    4. Yang, Haifei & Zhao, Enze & Zhao, Yi & Li, Yishun, 2024. "Evaluating and enhancing the safety performance of automated longitudinal control at on-ramp merging bottleneck: A simulation study in the framework of Kerner’s three-phase traffic theory," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 639(C).
    5. Qiang Luo & Xiaodong Zang & Xu Cai & Huawei Gong & Jie Yuan & Junheng Yang, 2021. "Vehicle Lane-Changing Safety Pre-Warning Model under the Environment of the Vehicle Networking," Sustainability, MDPI, vol. 13(9), pages 1-16, May.
    6. Yao, Zhihong & Li, Le & Liao, Wenbin & Wang, Yi & Wu, Yunxia, 2024. "Optimal lane management policy for connected automated vehicles in mixed traffic flow," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 637(C).
    7. Xianwang Li & Zhongxiang Huang & Saihu Liu & Jinxin Wu & Yuxiang Zhang, 2023. "Short-Term Subway Passenger Flow Prediction Based on Time Series Adaptive Decomposition and Multi-Model Combination (IVMD-SE-MSSA)," Sustainability, MDPI, vol. 15(10), pages 1-30, May.
    8. Enci Liu & Jie Li & Anni Zheng & Haoran Liu & Tao Jiang, 2022. "Research on the Prediction Model of the Used Car Price in View of the PSO-GRA-BP Neural Network," Sustainability, MDPI, vol. 14(15), pages 1-19, July.
    9. Ramadan Duraku & Diellza Boshnjaku, 2024. "Enhancing Traffic Sustainability: An Analysis of Isolation Intersection Effectiveness through Fixed Time and Logic Control Design Using VisVAP Algorithm," Sustainability, MDPI, vol. 16(7), pages 1-28, April.
    10. Yang Shao & Zhongbin Luo & Huan Wu & Xueyan Han & Binghong Pan & Shangru Liu & Christian G. Claudel, 2020. "Evaluation of Two Improved Schemes at Non-Aligned Intersections Affected by a Work Zone with an Entropy Method," Sustainability, MDPI, vol. 12(14), pages 1-24, July.
    11. Zhaoming Zhou & Jianbo Yuan & Shengmin Zhou & Qiong Long & Jianrong Cai & Lei Zhang, 2023. "Modeling and Analysis of Driving Behaviour for Heterogeneous Traffic Flow Considering Market Penetration under Capacity Constraints," Sustainability, MDPI, vol. 15(4), pages 1-21, February.
    12. Xiancai Jiang & Li Yao & Yao Jin & Runting Wu, 2021. "Signal Control Method for Through and Left-Turn Shared Lane by Setting Left-Turn Waiting Area at Signalized Intersections," Sustainability, MDPI, vol. 13(23), pages 1-17, November.
    13. Tang, Tie-Qiao & Yu, Qiang & Liu, Kai, 2017. "Analysis of the traffic running cost in a two-route system with feedback strategy," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 466(C), pages 1-9.
    14. Lyuchao Liao & Zhiyuan Hu & Chih-Yu Hsu & Jinya Su, 2023. "Fourier Graph Convolution Network for Time Series Prediction," Mathematics, MDPI, vol. 11(7), pages 1-19, March.
    15. Zeng, Jiao-Yan & Ou, Hui & Tang, Tie-Qiao, 2019. "Feedback strategy with delay in a two-route traffic network," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 534(C).
    16. Wei Zhou & Wei Wang & Xuedong Hua & Yi Zhang, 2020. "Real-Time Traffic Flow Forecasting via a Novel Method Combining Periodic-Trend Decomposition," Sustainability, MDPI, vol. 12(15), pages 1-23, July.
    17. Pankaj Gupta & Mukesh Kumar Mehlawat & Faizan Ahemad, 2023. "Selection of renewable energy sources: a novel VIKOR approach in an intuitionistic fuzzy linguistic environment," Environment, Development and Sustainability: A Multidisciplinary Approach to the Theory and Practice of Sustainable Development, Springer, vol. 25(4), pages 3429-3467, April.
    18. Hu, Guojing & Whalin, Robert W. & Kwembe, Tor A. & Lu, Weike, 2023. "Short-term traffic flow prediction based on secondary hybrid decomposition and deep echo state networks," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 632(P1).
    19. Heqing Tan & Muqing Du & Xiaowei Jiang & Zhaoming Chu, 2019. "The Combined Distribution and Assignment Model: A New Solution Algorithm and Its Applications in Travel Demand Forecasting for Modern Urban Transportation," Sustainability, MDPI, vol. 11(7), pages 1-18, April.
    20. Lianzhen Wang & Han Zhang & Lingyun Shi & Qingling He & Huizhi Xu, 2021. "Optimization Model of Regional Traffic Signs for Inducement at Road Works," Sustainability, MDPI, vol. 13(13), pages 1-14, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jsusta:v:14:y:2022:i:10:p:5751-:d:812160. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.