IDEAS home Printed from https://ideas.repec.org/a/eee/phsmap/v633y2024ics0378437123009081.html
   My bibliography  Save this article

Learning eco-driving strategies from human driving trajectories

Author

Listed:
  • Shi, Xiaoyu
  • Zhang, Jian
  • Jiang, Xia
  • Chen, Juan
  • Hao, Wei
  • Wang, Bo

Abstract

Eco-driving represents a promising avenue for mitigating energy consumption in road transportation. To enhance the applicability of learning-based eco-driving strategies, this study presents a novel framework that employs offline reinforcement learning in eco-driving control. This framework enables a vehicle agent to acquire eco-driving behavior by leveraging real-world human driving trajectories. Specifically, the human driving trajectories, along with the corresponding traffic signal timing scheme, obtained from empirical data, are utilized to construct a comprehensive Markov Decision Process (MDP) dataset for offline policy training. To accommodate learning from sub-optimal human-driving data, a Conservative Q-learning (CQL) algorithm is deployed. Subsequently, the proposed offline learning method is compared with alternative learning-based, model-based, and rule-based approaches, effectively illustrating the feasibility of offline learning and the efficacy of the CQL algorithm. Notably, the energy consumption is demonstrated to be improved by 67.3% compared to a behavioral car-following model, with only marginal compromise to travel efficiency. Furthermore, a sensitivity analysis is conducted, revealing the generalizability of the offline learning-based method across various simulation configurations and even diverse energy consumption models.

Suggested Citation

  • Shi, Xiaoyu & Zhang, Jian & Jiang, Xia & Chen, Juan & Hao, Wei & Wang, Bo, 2024. "Learning eco-driving strategies from human driving trajectories," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 633(C).
  • Handle: RePEc:eee:phsmap:v:633:y:2024:i:c:s0378437123009081
    DOI: 10.1016/j.physa.2023.129353
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0378437123009081
    Download Restriction: Full text for ScienceDirect subscribers only. Journal offers the option of making the article available online on Science direct for a fee of $3,000

    File URL: https://libkey.io/10.1016/j.physa.2023.129353?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Ma, Jiaqi & Li, Xiaopeng & Zhou, Fang & Hu, Jia & Park, B. Brian, 2017. "Parsimonious shooting heuristic for trajectory design of connected automated traffic part II: Computational issues and optimization," Transportation Research Part B: Methodological, Elsevier, vol. 95(C), pages 421-441.
    2. Zhou, Linjie & Ruan, Tiancheng & Ma, Ke & Dong, Changyin & Wang, Hao, 2021. "Impact of CAV platoon management on traffic flow considering degradation of control mode," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 581(C).
    3. He, Z.C. & Kang, H. & Li, Eric & Zhou, E.L. & Cheng, H.T. & Huang, Y.Y., 2022. "Coordinated control of heterogeneous vehicle platoon stability and energy-saving control strategies," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 606(C).
    4. Akcelik, Rahmi, 1989. "Efficiency and drag in the power-based model of fuel consumption," Transportation Research Part B: Methodological, Elsevier, vol. 23(5), pages 376-385, October.
    5. Tang, Tie-Qiao & Liao, Peng & Ou, Hui & Zhang, Jian, 2018. "A fuel-optimal driving strategy for a single vehicle with CVT," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 505(C), pages 114-123.
    6. Liao, Peng & Tang, Tie-Qiao & Liu, Ronghui & Huang, Hai-Jun, 2021. "An eco-driving strategy for electric vehicle based on the powertrain," Applied Energy, Elsevier, vol. 302(C).
    7. Huang, Yuhan & Ng, Elvin C.Y. & Zhou, John L. & Surawski, Nic C. & Chan, Edward F.C. & Hong, Guang, 2018. "Eco-driving technology for sustainable road transport: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 93(C), pages 596-609.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Liu, Qingling & Xu, Xiaowen, 2024. "A platoon-based eco-driving control mechanism for low-density traffic flow," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 637(C).
    2. Huifu Jiang & Wei Zhou & Chang Liu & Guosheng Zhang & Meng Hu, 2020. "Safe and Ecological Speed Control for Heavy-Duty Vehicles on Long–Steep Downhill and Sharp-Curved Roads," Sustainability, MDPI, vol. 12(17), pages 1-35, August.
    3. Huifu Jiang & Shi An & Jian Wang & Jianxun Cui, 2018. "Eco-Approach and Departure System for Left-Turn Vehicles at a Fixed-Time Signalized Intersection," Sustainability, MDPI, vol. 10(1), pages 1-20, January.
    4. Huifu Jiang & Jia Hu & Byungkyu Brian Park & Meng Wang & Wei Zhou, 2019. "An Extensive Investigation of an Eco-Approach Controller under a Partially Connected and Automated Vehicle Environment," Sustainability, MDPI, vol. 11(22), pages 1-24, November.
    5. Chen Wang & Yulu Dai & Jingxin Xia, 2020. "A CAV Platoon Control Method for Isolated Intersections: Guaranteed Feasible Multi-Objective Approach with Priority," Energies, MDPI, vol. 13(3), pages 1-16, February.
    6. Zheng, Shuai & Liu, Yugang & Fu, Kui & Li, Rongrong & Zhang, You & Yang, Hongtai, 2024. "Optimization of isolated intersection signal timing and trajectory planning under mixed traffic environment: The flexible catalysis of connected and automated vehicles," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 640(C).
    7. Santos, Alberto & Maia, Pedro & Jacob, Rodrigo & Wei, Huang & Callegari, Camila & Oliveira Fiorini, Ana Carolina & Schaeffer, Roberto & Szklo, Alexandre, 2024. "Road conditions and driving patterns on fuel usage: Lessons from an emerging economy," Energy, Elsevier, vol. 295(C).
    8. Yang Wang & Alessandra Boggio-Marzet, 2018. "Evaluation of Eco-Driving Training for Fuel Efficiency and Emissions Reduction According to Road Type," Sustainability, MDPI, vol. 10(11), pages 1-16, October.
    9. Robaina, Margarita & Neves, Ana, 2021. "Complete decomposition analysis of CO2 emissions intensity in the transport sector in Europe," Research in Transportation Economics, Elsevier, vol. 90(C).
    10. Zhou, Yang & Ahn, Soyoung, 2019. "Robust local and string stability for a decentralized car following control strategy for connected automated vehicles," Transportation Research Part B: Methodological, Elsevier, vol. 125(C), pages 175-196.
    11. Pi, Dawei & Xue, Pengyu & Wang, Weihua & Xie, Boyuan & Wang, Hongliang & Wang, Xianhui & Yin, Guodong, 2023. "Automotive platoon energy-saving: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 179(C).
    12. Wojciech Adamski & Krzysztof Brzozowski & Jacek Nowakowski & Tomasz Praszkiewicz & Tomasz Knefel, 2021. "Excess Fuel Consumption Due to Selection of a Lower Than Optimal Gear—Case Study Based on Data Obtained in Real Traffic Conditions," Energies, MDPI, vol. 14(23), pages 1-15, November.
    13. Juan Francisco Coloma & Marta García & Gonzalo Fernández & Andrés Monzón, 2021. "Environmental Effects of Eco-Driving on Courier Delivery," Sustainability, MDPI, vol. 13(3), pages 1-21, January.
    14. Di, Yunran & Zhang, Weihua & Ding, Heng & Zheng, Xiaoyan & Ran, Bin, 2024. "Cooperative control of dynamic CAV dedicated lanes and vehicle active lane changing in expressway bottleneck areas," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 638(C).
    15. Xiao Xiao & Yunlong Zhang & Xiubin Bruce Wang & Shu Yang & Tianyi Chen, 2021. "Hierarchical Longitudinal Control for Connected and Automated Vehicles in Mixed Traffic on a Signalized Arterial," Sustainability, MDPI, vol. 13(16), pages 1-17, August.
    16. Salvo, Orlando de & Vaz de Almeida, Flávio G., 2019. "Influence of technologies on energy efficiency results of official Brazilian tests of vehicle energy consumption," Applied Energy, Elsevier, vol. 241(C), pages 98-112.
    17. Zhang, Hanyu & Du, Lili, 2023. "Platoon-centered control for eco-driving at signalized intersection built upon hybrid MPC system, online learning and distributed optimization part I: Modeling and solution algorithm design," Transportation Research Part B: Methodological, Elsevier, vol. 172(C), pages 174-198.
    18. Alexander García-Mariaca & Eva Llera-Sastresa, 2021. "Review on Carbon Capture in ICE Driven Transport," Energies, MDPI, vol. 14(21), pages 1-30, October.
    19. Federico Orsini & Mariaelena Tagliabue & Giulia De Cet & Massimiliano Gastaldi & Riccardo Rossi, 2021. "Highway Deceleration Lane Safety: Effects of Real-Time Coaching Programs on Driving Behavior," Sustainability, MDPI, vol. 13(16), pages 1-16, August.
    20. Maria Torres-Falcon & Omar Rodríguez-Abreo & Francisco Antonio Castillo-Velásquez & Alejandro Flores-Rangel & Juvenal Rodríguez-Reséndiz & José Manuel Álvarez-Alvarado, 2021. "Novel Mathematical Method to Obtain the Optimum Speed and Fuel Reduction in Heavy Diesel Trucks," Energies, MDPI, vol. 14(23), pages 1-17, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:phsmap:v:633:y:2024:i:c:s0378437123009081. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/physica-a-statistical-mechpplications/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.