IDEAS home Printed from https://ideas.repec.org/a/gam/jsusta/v16y2024i22p10055-d1523619.html
   My bibliography  Save this article

Coordinated Ramp Metering Considering the Dynamics of Mixed-Autonomy Traffic

Author

Listed:
  • Hongxin Yu

    (College of Civil Engineering and Architecture, Balance Architecture Research Center, Zhejiang University, Hangzhou 310058, China)

  • Lihui Zhang

    (College of Civil Engineering and Architecture, Architectural Design and Research Institute, Zhejiang University, Hangzhou 310058, China)

  • Meng Zhang

    (College of Civil Engineering and Architecture, Zhejiang University, Hangzhou 310058, China)

  • Fengyue Jin

    (College of Civil Engineering and Architecture, Zhejiang University, Hangzhou 310058, China)

  • Yibing Wang

    (College of Civil Engineering and Architecture, Zhejiang University, Hangzhou 310058, China)

Abstract

The introduction of connected autonomous vehicles may bring opportunities and challenges to traditional traffic control instruments, like ramp metering. This paper starts by constructing the fundamental diagram for mixed-autonomy traffic based on the car-following behaviors of both connected autonomous vehicles and human-driven vehicles. Then, analyses are performed on the main factors that influence the critical velocity, critical density, and road capacity under mixed-autonomy traffic. Two methods named COE-HERO and TRLCRM are developed to support the implementations of coordinated ramp metering for freeways with mixed-autonomy traffic. The COE-HERO method enhances the HERO method by incorporating a critical occupancy estimation module. Both COE-HERO and TRLCRM consider dynamic traffic flow parameters of mixed-autonomy traffic. The TRLCRM method is a reinforcement learning-based approach with a two-stage training framework, enabling it to adapt to varying mixed-autonomy demand scenarios. Extensive microscopic simulations show that the learning-based TRLCRM method can effectively alleviate bottleneck congestion and is robust to deal with various traffic scenarios. The COE-HERO method performs better than the HERO method, indicating the necessity of critical occupancy estimation in the implementations of coordinated ramp metering.

Suggested Citation

  • Hongxin Yu & Lihui Zhang & Meng Zhang & Fengyue Jin & Yibing Wang, 2024. "Coordinated Ramp Metering Considering the Dynamics of Mixed-Autonomy Traffic," Sustainability, MDPI, vol. 16(22), pages 1-26, November.
  • Handle: RePEc:gam:jsusta:v:16:y:2024:i:22:p:10055-:d:1523619
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2071-1050/16/22/10055/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2071-1050/16/22/10055/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Coifman, Benjamin, 2015. "Empirical flow-density and speed-spacing relationships: Evidence of vehicle length dependency," Transportation Research Part B: Methodological, Elsevier, vol. 78(C), pages 54-65.
    2. Khan, Shah Khalid & Shiwakoti, Nirajan & Stasinopoulos, Peter & Warren, Matthew, 2023. "Cybersecurity regulatory challenges for connected and automated vehicles – State-of-the-art and future directions," Transport Policy, Elsevier, vol. 143(C), pages 58-71.
    3. Sala, Marcel & Soriguera, Francesc, 2021. "Capacity of a freeway lane with platoons of autonomous vehicles mixed with regular traffic," Transportation Research Part B: Methodological, Elsevier, vol. 147(C), pages 116-131.
    4. Yu Lin & Hongfei Jia & Bo Zou & Hongzhi Miao & Ruiyi Wu & Jingjing Tian & Guanfeng Wang, 2021. "Multiobjective Environmentally Sustainable Optimal Design of Dedicated Connected Autonomous Vehicle Lanes," Sustainability, MDPI, vol. 13(6), pages 1-21, March.
    5. Salvatore Trubia & Salvatore Curto & Salvatore Barberi & Alessandro Severino & Fabio Arena & Giovanni Pau, 2021. "Analysis and Evaluation of Ramp Metering: From Historical Evolution to the Application of New Algorithms and Engineering Principles," Sustainability, MDPI, vol. 13(2), pages 1-19, January.
    6. Smaragdis, Emmanouil & Papageorgiou, Markos & Kosmatopoulos, Elias, 2004. "A flow-maximizing adaptive local ramp metering strategy," Transportation Research Part B: Methodological, Elsevier, vol. 38(3), pages 251-270, March.
    7. Volodymyr Mnih & Koray Kavukcuoglu & David Silver & Andrei A. Rusu & Joel Veness & Marc G. Bellemare & Alex Graves & Martin Riedmiller & Andreas K. Fidjeland & Georg Ostrovski & Stig Petersen & Charle, 2015. "Human-level control through deep reinforcement learning," Nature, Nature, vol. 518(7540), pages 529-533, February.
    8. Ye, Lanhang & Yamamoto, Toshiyuki, 2018. "Modeling connected and autonomous vehicles in heterogeneous traffic flow," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 490(C), pages 269-277.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Guan, Hao & Wang, Hua & Meng, Qiang & Mak, Chin Long, 2023. "Markov chain-based traffic analysis on platooning effect among mixed semi- and fully-autonomous vehicles in a freeway lane," Transportation Research Part B: Methodological, Elsevier, vol. 173(C), pages 176-202.
    2. Muhammad Azam & Sitti Asmah Hassan & Othman Che Puan, 2022. "Autonomous Vehicles in Mixed Traffic Conditions—A Bibliometric Analysis," Sustainability, MDPI, vol. 14(17), pages 1-34, August.
    3. Mohammed Al-Turki & Nedal T. Ratrout & Syed Masiur Rahman & Imran Reza, 2021. "Impacts of Autonomous Vehicles on Traffic Flow Characteristics under Mixed Traffic Environment: Future Perspectives," Sustainability, MDPI, vol. 13(19), pages 1-22, October.
    4. Pei, Yulong & Pan, Sheng & Wen, Yuhang, 2024. "Analysis of roadway capacity for heterogeneous traffic flows considering the degree of trust of drivers of HVs in CAVs," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 639(C).
    5. Tulika Saha & Sriparna Saha & Pushpak Bhattacharyya, 2020. "Towards sentiment aided dialogue policy learning for multi-intent conversations using hierarchical reinforcement learning," PLOS ONE, Public Library of Science, vol. 15(7), pages 1-28, July.
    6. Jonghan Park & Seunghwa Jang & Joonho Ko, 2023. "Effects of Exclusive Lanes for Autonomous Vehicles on Urban Expressways under Mixed Traffic of Autonomous and Human-Driven Vehicles," Sustainability, MDPI, vol. 16(1), pages 1-14, December.
    7. Shengnan Li & Hu Yang & Minglun Li & Jianjun Dai & Pu Wang, 2023. "A Highway On-Ramp Control Approach Integrating Percolation Bottleneck Analysis and Vehicle Source Identification," Sustainability, MDPI, vol. 15(16), pages 1-15, August.
    8. Peng, Jiali & Shangguan, Wei & Peng, Cong & Chai, Linguo, 2024. "Uncertainty modeling of connected and automated vehicle penetration rate under mixed traffic environment," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 639(C).
    9. Mahmoud Mahfouz & Angelos Filos & Cyrine Chtourou & Joshua Lockhart & Samuel Assefa & Manuela Veloso & Danilo Mandic & Tucker Balch, 2019. "On the Importance of Opponent Modeling in Auction Markets," Papers 1911.12816, arXiv.org.
    10. Lixiang Zhang & Yan Yan & Yaoguang Hu, 2024. "Deep reinforcement learning for dynamic scheduling of energy-efficient automated guided vehicles," Journal of Intelligent Manufacturing, Springer, vol. 35(8), pages 3875-3888, December.
    11. Imen Azzouz & Wiem Fekih Hassen, 2023. "Optimization of Electric Vehicles Charging Scheduling Based on Deep Reinforcement Learning: A Decentralized Approach," Energies, MDPI, vol. 16(24), pages 1-18, December.
    12. Bai, Lu & Wong, S.C. & Xu, Pengpeng & Chow, Andy H.F. & Lam, William H.K., 2021. "Calibration of stochastic link-based fundamental diagram with explicit consideration of speed heterogeneity," Transportation Research Part B: Methodological, Elsevier, vol. 150(C), pages 524-539.
    13. Seo, Toru & Kawasaki, Yutaka & Kusakabe, Takahiko & Asakura, Yasuo, 2019. "Fundamental diagram estimation by using trajectories of probe vehicles," Transportation Research Part B: Methodological, Elsevier, vol. 122(C), pages 40-56.
    14. Jacob W. Crandall & Mayada Oudah & Tennom & Fatimah Ishowo-Oloko & Sherief Abdallah & Jean-François Bonnefon & Manuel Cebrian & Azim Shariff & Michael A. Goodrich & Iyad Rahwan, 2018. "Cooperating with machines," Nature Communications, Nature, vol. 9(1), pages 1-12, December.
      • Abdallah, Sherief & Bonnefon, Jean-François & Cebrian, Manuel & Crandall, Jacob W. & Ishowo-Oloko, Fatimah & Oudah, Mayada & Rahwan, Iyad & Shariff, Azim & Tennom,, 2017. "Cooperating with Machines," TSE Working Papers 17-806, Toulouse School of Economics (TSE).
      • Abdallah, Sherief & Bonnefon, Jean-François & Cebrian, Manuel & Crandall, Jacob W. & Ishowo-Oloko, Fatimah & Oudah, Mayada & Rahwan, Iyad & Shariff, Azim & Tennom,, 2017. "Cooperating with Machines," IAST Working Papers 17-68, Institute for Advanced Study in Toulouse (IAST).
      • Jacob Crandall & Mayada Oudah & Fatimah Ishowo-Oloko Tennom & Fatimah Ishowo-Oloko & Sherief Abdallah & Jean-François Bonnefon & Manuel Cebrian & Azim Shariff & Michael Goodrich & Iyad Rahwan, 2018. "Cooperating with machines," Post-Print hal-01897802, HAL.
    15. Sun, Alexander Y., 2020. "Optimal carbon storage reservoir management through deep reinforcement learning," Applied Energy, Elsevier, vol. 278(C).
    16. Yassine Chemingui & Adel Gastli & Omar Ellabban, 2020. "Reinforcement Learning-Based School Energy Management System," Energies, MDPI, vol. 13(23), pages 1-21, December.
    17. Woo Jae Byun & Bumkyu Choi & Seongmin Kim & Joohyun Jo, 2023. "Practical Application of Deep Reinforcement Learning to Optimal Trade Execution," FinTech, MDPI, vol. 2(3), pages 1-16, June.
    18. Lu, Yu & Xiang, Yue & Huang, Yuan & Yu, Bin & Weng, Liguo & Liu, Junyong, 2023. "Deep reinforcement learning based optimal scheduling of active distribution system considering distributed generation, energy storage and flexible load," Energy, Elsevier, vol. 271(C).
    19. Yuhong Wang & Lei Chen & Hong Zhou & Xu Zhou & Zongsheng Zheng & Qi Zeng & Li Jiang & Liang Lu, 2021. "Flexible Transmission Network Expansion Planning Based on DQN Algorithm," Energies, MDPI, vol. 14(7), pages 1-21, April.
    20. Huang, Ruchen & He, Hongwen & Gao, Miaojue, 2023. "Training-efficient and cost-optimal energy management for fuel cell hybrid electric bus based on a novel distributed deep reinforcement learning framework," Applied Energy, Elsevier, vol. 346(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jsusta:v:16:y:2024:i:22:p:10055-:d:1523619. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.