IDEAS home Printed from https://ideas.repec.org/a/eee/phsmap/v635y2024ics0378437124000463.html
   My bibliography  Save this article

Mitigating oscillations of mixed traffic flows at a signalized intersection: A multiagent trajectory optimization approach based on oscillation prediction

Author

Listed:
  • Gao, Caihong
  • Wang, Ziyang
  • Wang, Shupei
  • Li, Ying

Abstract

To mitigate the traffic oscillations generated when traffic flow encounters a red light at a signalized intersection, many studies have used reinforcement learning to control connected and automated vehicles (CAVs) trajectories to avoid oscillations. These methods, which are effective in mitigating oscillations in a pure CAV environment, perform poorly when applied to mixed traffic streams, due to the fact that most of the methods ignore that human vehicles (HVs) in mixed traffic flows stop at red lights and trigger oscillations, resulting in significant “trajectory fluctuation” phenomena in some CAVs, which will lead to poor effectiveness in mitigating oscillations.To address this problem, We propose a method that combines oscillation prediction and multiagent trajectory optimization to mitigate the oscillations generated by HVs. First, we predict the oscillation caused by HVs stopping during a red light, and after that, we use the Newell model to predict the propagation range of the oscillation. According to whether the HV ahead produces oscillation or not, we classify CAVs into two types of agents and design the control scheme separately. The first type of CAVs are immediately adjacent to the oscillation, and we use a jam-absorption driving (JAD) strategy to treat them as absorbing vehicles to absorb the oscillation. While the second type of CAVs are vehicles other than the first type of CAVs, we use the deep reinforcement learning (DRL) method to control them to arrive at the intersection within the predicted green light time. We tested the method in a mixed traffic flow simulation environment. Experimental results show that this method can effectively suppress the phenomenon of “trajectory fluctuations” under different CAV penetration rates, achieving the goal of effectively mitigating oscillations thus significantly improving traffic efficiency and reducing vehicle fuel consumption. Meanwhile, the method also has the advantages of fast convergence during training and high stability during testing compared with traditional reinforcement learning methods.

Suggested Citation

  • Gao, Caihong & Wang, Ziyang & Wang, Shupei & Li, Ying, 2024. "Mitigating oscillations of mixed traffic flows at a signalized intersection: A multiagent trajectory optimization approach based on oscillation prediction," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 635(C).
  • Handle: RePEc:eee:phsmap:v:635:y:2024:i:c:s0378437124000463
    DOI: 10.1016/j.physa.2024.129538
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0378437124000463
    Download Restriction: Full text for ScienceDirect subscribers only. Journal offers the option of making the article available online on Science direct for a fee of $3,000

    File URL: https://libkey.io/10.1016/j.physa.2024.129538?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Tian, Junfang & Zhu, Chenqiang & Chen, Danjue & Jiang, Rui & Wang, Guanying & Gao, Ziyou, 2021. "Car following behavioral stochasticity analysis and modeling: Perspective from wave travel time," Transportation Research Part B: Methodological, Elsevier, vol. 143(C), pages 160-176.
    2. Ma, Jiaqi & Li, Xiaopeng & Zhou, Fang & Hu, Jia & Park, B. Brian, 2017. "Parsimonious shooting heuristic for trajectory design of connected automated traffic part II: Computational issues and optimization," Transportation Research Part B: Methodological, Elsevier, vol. 95(C), pages 421-441.
    3. Qu, Xiaobo & Yu, Yang & Zhou, Mofan & Lin, Chin-Teng & Wang, Xiangyu, 2020. "Jointly dampening traffic oscillations and improving energy consumption with electric, connected and automated vehicles: A reinforcement learning based approach," Applied Energy, Elsevier, vol. 257(C).
    4. Jia, Dongyao & Ngoduy, Dong, 2016. "Enhanced cooperative car-following traffic model with the combination of V2V and V2I communication," Transportation Research Part B: Methodological, Elsevier, vol. 90(C), pages 172-191.
    5. Li, Xiaopeng & Wang, Xin & Ouyang, Yanfeng, 2012. "Prediction and field validation of traffic oscillation propagation under nonlinear car-following laws," Transportation Research Part B: Methodological, Elsevier, vol. 46(3), pages 409-423.
    6. Nishi, Ryosuke & Tomoeda, Akiyasu & Shimura, Kenichiro & Nishinari, Katsuhiro, 2013. "Theory of jam-absorption driving," Transportation Research Part B: Methodological, Elsevier, vol. 50(C), pages 116-129.
    7. Taniguchi, Yohei & Nishi, Ryosuke & Ezaki, Takahiro & Nishinari, Katsuhiro, 2015. "Jam-absorption driving with a car-following model," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 433(C), pages 304-315.
    8. Chen, Xiangdong & Lin, Xi & Li, Meng & He, Fang & Meng, Qiang, 2023. "A nearly throughput-maximum knotted intersection design and control for connected and automated vehicles," Transportation Research Part B: Methodological, Elsevier, vol. 171(C), pages 44-79.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Li, Li & Li, Xiaopeng, 2019. "Parsimonious trajectory design of connected automated traffic," Transportation Research Part B: Methodological, Elsevier, vol. 119(C), pages 1-21.
    2. Zhou, Yang & Zhong, Xinzhi & Chen, Qian & Ahn, Soyoung & Jiang, Jiwan & Jafarsalehi, Ghazaleh, 2023. "Data-driven analysis for disturbance amplification in car-following behavior of automated vehicles," Transportation Research Part B: Methodological, Elsevier, vol. 174(C).
    3. Nishi, Ryosuke, 2020. "Theoretical conditions for restricting secondary jams in jam-absorption driving scenarios," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 542(C).
    4. Zhou, Yang & Ahn, Soyoung & Wang, Meng & Hoogendoorn, Serge, 2020. "Stabilizing mixed vehicular platoons with connected automated vehicles: An H-infinity approach," Transportation Research Part B: Methodological, Elsevier, vol. 132(C), pages 152-170.
    5. Ito, Kotaro & Nishi, Ryosuke, 2023. "Influence of self-disassembly of bridges on collective flow characteristics of swarm robots in a single-lane and periodic system with a gap," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 626(C).
    6. Lou, Haoli & Lyu, Hao & Cheng, Rongjun, 2024. "A time-varying driving style oriented model predictive control for smoothing mixed traffic flow," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 637(C).
    7. Qu, Xiaobo & Yu, Yang & Zhou, Mofan & Lin, Chin-Teng & Wang, Xiangyu, 2020. "Jointly dampening traffic oscillations and improving energy consumption with electric, connected and automated vehicles: A reinforcement learning based approach," Applied Energy, Elsevier, vol. 257(C).
    8. Li, Xiaopeng & Ghiasi, Amir & Xu, Zhigang & Qu, Xiaobo, 2018. "A piecewise trajectory optimization model for connected automated vehicles: Exact optimization algorithm and queue propagation analysis," Transportation Research Part B: Methodological, Elsevier, vol. 118(C), pages 429-456.
    9. Nishi, Ryosuke & Watanabe, Takashi, 2022. "System-size dependence of a jam-absorption driving strategy to remove traffic jam caused by a sag under the presence of traffic instability," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 600(C).
    10. Haizhen Li & Claudio Roncoli & Weiming Zhao & Yongfeng Ju, 2024. "Assessing the Impact of CAV Driving Strategies on Mixed Traffic on the Ring Road and Freeway," Sustainability, MDPI, vol. 16(8), pages 1-23, April.
    11. Xu, Yueru & Zheng, Yuan & Yang, Ying, 2021. "On the movement simulations of electric vehicles: A behavioral model-based approach," Applied Energy, Elsevier, vol. 283(C).
    12. Luo, Ying & Chen, Yanyan & Lu, Kaiming & Chen, Liang & Zhang, Jian, 2024. "Modeling and analysis of heterogeneous traffic flow considering dynamic information flow topology and driving behavioral characteristics," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 637(C).
    13. Zhao, Shuaidong & Zhang, Kuilin, 2020. "A distributionally robust stochastic optimization-based model predictive control with distributionally robust chance constraints for cooperative adaptive cruise control under uncertain traffic conditi," Transportation Research Part B: Methodological, Elsevier, vol. 138(C), pages 144-178.
    14. Xie, Yunkun & Li, Yangyang & Zhao, Zhichao & Dong, Hao & Wang, Shuqian & Liu, Jingping & Guan, Jinhuan & Duan, Xiongbo, 2020. "Microsimulation of electric vehicle energy consumption and driving range," Applied Energy, Elsevier, vol. 267(C).
    15. Sun, Yuqing & Ge, Hongxia & Cheng, Rongjun, 2018. "An extended car-following model under V2V communication environment and its delayed-feedback control," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 508(C), pages 349-358.
    16. Taniguchi, Yohei & Nishi, Ryosuke & Ezaki, Takahiro & Nishinari, Katsuhiro, 2015. "Jam-absorption driving with a car-following model," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 433(C), pages 304-315.
    17. Meng, Dongli & Song, Guohua & Huang, Jianchang & Lu, Hongyu & Wu, Yizheng & Yu, Lei, 2024. "Car-following model considering jerk-constrained acceleration stochastic process for emission estimation," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 639(C).
    18. Daniel Egan & Qilun Zhu & Robert Prucka, 2023. "A Review of Reinforcement Learning-Based Powertrain Controllers: Effects of Agent Selection for Mixed-Continuity Control and Reward Formulation," Energies, MDPI, vol. 16(8), pages 1-31, April.
    19. Zhou, Yang & Ahn, Soyoung, 2019. "Robust local and string stability for a decentralized car following control strategy for connected automated vehicles," Transportation Research Part B: Methodological, Elsevier, vol. 125(C), pages 175-196.
    20. Li, Xiaopeng, 2022. "Trade-off between safety, mobility and stability in automated vehicle following control: An analytical method," Transportation Research Part B: Methodological, Elsevier, vol. 166(C), pages 1-18.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:phsmap:v:635:y:2024:i:c:s0378437124000463. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/physica-a-statistical-mechpplications/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.