IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v365y2024ics0306261924006007.html
   My bibliography  Save this article

Shared learning of powertrain control policies for vehicle fleets

Author

Listed:
  • Kerbel, Lindsey
  • Ayalew, Beshah
  • Ivanco, Andrej

Abstract

Emerging data-driven approaches, such as deep reinforcement learning (DRL), aim at on-the-field learning of powertrain control policies that optimize fuel economy and other performance metrics. Indeed, they have shown great potential in this regard for individual vehicles on specific routes/drive cycles. However, for fleets of vehicles that must service a distribution of routes, DRL approaches struggle with learning stability issues that result in high variances and challenge their practical deployment. In this paper, we present a novel framework for shared learning among a fleet of vehicles through the use of a distilled group policy as the knowledge sharing mechanism for the policy learning computations at each vehicle. We detail the mathematical formulation that makes this possible. Several scenarios are considered to analyze the framework’s functionality, performance, and computational scalability with fleet size. Comparisons of the cumulative performance of fleets using our proposed shared learning approach with a baseline of individual learning agents and another state-of-the-art approach with a centralized learner show clear advantages to our approach. For example, we find a fleet average asymptotic improvement of 8.5% in fuel economy compared to the baseline while also improving on the metrics of acceleration error and shifting frequency for fleets serving a distribution of suburban routes. Furthermore, we include demonstrative results that show how the framework reduces variance within a fleet and also how it helps individual agents adapt better to new routes.

Suggested Citation

  • Kerbel, Lindsey & Ayalew, Beshah & Ivanco, Andrej, 2024. "Shared learning of powertrain control policies for vehicle fleets," Applied Energy, Elsevier, vol. 365(C).
  • Handle: RePEc:eee:appene:v:365:y:2024:i:c:s0306261924006007
    DOI: 10.1016/j.apenergy.2024.123217
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261924006007
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.apenergy.2024.123217?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Yang, Ningkang & Ruan, Shumin & Han, Lijin & Liu, Hui & Guo, Lingxiong & Xiang, Changle, 2023. "Reinforcement learning-based real-time intelligent energy management for hybrid electric vehicles in a model predictive control framework," Energy, Elsevier, vol. 270(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zhang, Hao & Lei, Nuo & Liu, Shang & Fan, Qinhao & Wang, Zhi, 2023. "Data-driven predictive energy consumption minimization strategy for connected plug-in hybrid electric vehicles," Energy, Elsevier, vol. 283(C).
    2. Xu Wang & Ying Huang & Jian Wang, 2023. "Study on Driver-Oriented Energy Management Strategy for Hybrid Heavy-Duty Off-Road Vehicles under Aggressive Transient Operating Condition," Sustainability, MDPI, vol. 15(9), pages 1-25, May.
    3. Zhang, Yagang & Wang, Hui & Wang, Jingchao & Cheng, Xiaodan & Wang, Tong & Zhao, Zheng, 2024. "Ensemble optimization approach based on hybrid mode decomposition and intelligent technology for wind power prediction system," Energy, Elsevier, vol. 292(C).
    4. Yang, Ningkang & Han, Lijin & Bo, Lin & Liu, Baoshuai & Chen, Xiuqi & Liu, Hui & Xiang, Changle, 2023. "Real-time adaptive energy management for off-road hybrid electric vehicles based on decision-time planning," Energy, Elsevier, vol. 282(C).
    5. Lihong Dai & Peng Hu & Tianyou Wang & Guosheng Bian & Haoye Liu, 2024. "Optimal Rule-Interposing Reinforcement Learning-Based Energy Management of Series—Parallel-Connected Hybrid Electric Vehicles," Sustainability, MDPI, vol. 16(16), pages 1-17, August.
    6. Elsisi, Mahmoud & Amer, Mohammed & Dababat, Alya’ & Su, Chun-Lien, 2023. "A comprehensive review of machine learning and IoT solutions for demand side energy management, conservation, and resilient operation," Energy, Elsevier, vol. 281(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:365:y:2024:i:c:s0306261924006007. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.