IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v329y2023ics030626192201488x.html
   My bibliography  Save this article

Deep learning in the development of energy Management strategies of hybrid electric Vehicles: A hybrid modeling approach

Author

Listed:
  • Maroto Estrada, Pedro
  • de Lima, Daniela
  • Bauer, Peter H.
  • Mammetti, Marco
  • Bruno, Joan Carles

Abstract

The Energy Management Strategy (EMS) in an HEV is the key for improving fuel economy and simultaneously reducing pollutant emissions. This paper presents a methodology for developing hybrid models that enable EMS testing as well as the evaluation of fuel consumption, CO2 and pollutant emissions (CO, NOx and THC). In this context, pollutant emissions are hard to quantify with static models such as the well-known map-based approach which is mainly due to the pronounced impact of transient effects. The novelty of this paper primarily comes from the characterization of pollutant emissions through Convolutional Neural Networks (CNN), providing high accuracy for both, instantaneous and cumulative values. The input parameters are classical Internal Combustion Engine (ICE) measurements such as engine speed, air mass flow, torque and exhaust temperature. The proposed CNNs are reduced to a minimum for low complexity and fast computability. These models are developed with experimental data from chassis dyno testing of a conventional turbo-charged gasoline engine vehicle. The pollutant emission models are used in conjunction with physical models of the remaining powertrain allowing for real time simulations of the complete HEV vehicle. The Double Deep-Q learning algorithm is proposed for the EMS and compared to the Dynamic programming (DP) solution.

Suggested Citation

  • Maroto Estrada, Pedro & de Lima, Daniela & Bauer, Peter H. & Mammetti, Marco & Bruno, Joan Carles, 2023. "Deep learning in the development of energy Management strategies of hybrid electric Vehicles: A hybrid modeling approach," Applied Energy, Elsevier, vol. 329(C).
    • Handle: RePEc:eee:appene:v:329:y:2023:i:c:s030626192201488x
    DOI: 10.1016/j.apenergy.2022.120231
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S030626192201488X
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.apenergy.2022.120231?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Tian, He & Li, Shengbo Eben & Wang, Xu & Huang, Yong & Tian, Guangyu, 2018. "Data-driven hierarchical control for online energy management of plug-in hybrid electric city bus," Energy, Elsevier, vol. 142(C), pages 55-67.
    2. Rosero, Fredy & Fonseca, Natalia & López, José-María & Casanova, Jesús, 2020. "Real-world fuel efficiency and emissions from an urban diesel bus engine under transient operating conditions," Applied Energy, Elsevier, vol. 261(C).
    3. Liu, Teng & Wang, Bo & Yang, Chenglang, 2018. "Online Markov Chain-based energy management for a hybrid tracked vehicle with speedy Q-learning," Energy, Elsevier, vol. 160(C), pages 544-555.
    4. Wu, Jingda & He, Hongwen & Peng, Jiankun & Li, Yuecheng & Li, Zhanjiang, 2018. "Continuous reinforcement learning of energy management with deep Q network for a power split hybrid electric bus," Applied Energy, Elsevier, vol. 222(C), pages 799-811.
    5. Gao, Zhiming & Curran, Scott J. & Parks, James E. & Smith, David E. & Wagner, Robert M. & Daw, C. Stuart & Edwards, K. Dean & Thomas, John F., 2015. "Drive cycle simulation of high efficiency combustions on fuel economy and exhaust properties in light-duty vehicles," Applied Energy, Elsevier, vol. 157(C), pages 762-776.
    6. Yslene Kachba & Daiane Maria de Genaro Chiroli & Jônatas T. Belotti & Thiago Antonini Alves & Yara de Souza Tadano & Hugo Siqueira, 2020. "Artificial Neural Networks to Estimate the Influence of Vehicular Emission Variables on Morbidity and Mortality in the Largest Metropolis in South America," Sustainability, MDPI, vol. 12(7), pages 1-15, March.
    7. Enang, Wisdom & Bannister, Chris, 2017. "Modelling and control of hybrid electric vehicles (A comprehensive review)," Renewable and Sustainable Energy Reviews, Elsevier, vol. 74(C), pages 1210-1239.
    8. Giakoumis, E.G. & Alafouzos, A.I., 2010. "Study of diesel engine performance and emissions during a Transient Cycle applying an engine mapping-based methodology," Applied Energy, Elsevier, vol. 87(4), pages 1358-1365, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Angel Recalde & Ricardo Cajo & Washington Velasquez & Manuel S. Alvarez-Alvarado, 2024. "Machine Learning and Optimization in Energy Management Systems for Plug-In Hybrid Electric Vehicles: A Comprehensive Review," Energies, MDPI, vol. 17(13), pages 1-39, June.
    2. Jia, Chunchun & Zhou, Jiaming & He, Hongwen & Li, Jianwei & Wei, Zhongbao & Li, Kunang, 2024. "Health-conscious deep reinforcement learning energy management for fuel cell buses integrating environmental and look-ahead road information," Energy, Elsevier, vol. 290(C).
    3. Alessia Musa & Pier Giuseppe Anselma & Giovanni Belingardi & Daniela Anna Misul, 2023. "Energy Management in Hybrid Electric Vehicles: A Q-Learning Solution for Enhanced Drivability and Energy Efficiency," Energies, MDPI, vol. 17(1), pages 1-20, December.
    4. Benaitier, Alexis & Krainer, Ferdinand & Jakubek, Stefan & Hametner, Christoph, 2023. "Optimal energy management of hybrid electric vehicles considering pollutant emissions during transient operations," Applied Energy, Elsevier, vol. 344(C).
    5. Stefan Tabacu & Dragos Popa, 2023. "Backward-Facing Analysis for the Preliminary Estimation of the Vehicle Fuel Consumption," Sustainability, MDPI, vol. 15(6), pages 1-19, March.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zhuang, Weichao & Li (Eben), Shengbo & Zhang, Xiaowu & Kum, Dongsuk & Song, Ziyou & Yin, Guodong & Ju, Fei, 2020. "A survey of powertrain configuration studies on hybrid electric vehicles," Applied Energy, Elsevier, vol. 262(C).
    2. Liu, Teng & Tan, Wenhao & Tang, Xiaolin & Zhang, Jinwei & Xing, Yang & Cao, Dongpu, 2021. "Driving conditions-driven energy management strategies for hybrid electric vehicles: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 151(C).
    3. Matteo Acquarone & Claudio Maino & Daniela Misul & Ezio Spessa & Antonio Mastropietro & Luca Sorrentino & Enrico Busto, 2023. "Influence of the Reward Function on the Selection of Reinforcement Learning Agents for Hybrid Electric Vehicles Real-Time Control," Energies, MDPI, vol. 16(6), pages 1-22, March.
    4. Daniel Egan & Qilun Zhu & Robert Prucka, 2023. "A Review of Reinforcement Learning-Based Powertrain Controllers: Effects of Agent Selection for Mixed-Continuity Control and Reward Formulation," Energies, MDPI, vol. 16(8), pages 1-31, April.
    5. Mera, Zamir & Varella, Roberto & Baptista, Patrícia & Duarte, Gonçalo & Rosero, Fredy, 2022. "Including engine data for energy and pollutants assessment into the vehicle specific power methodology," Applied Energy, Elsevier, vol. 311(C).
    6. Chen, Zheng & Gu, Hongji & Shen, Shiquan & Shen, Jiangwei, 2022. "Energy management strategy for power-split plug-in hybrid electric vehicle based on MPC and double Q-learning," Energy, Elsevier, vol. 245(C).
    7. Dong, Peng & Zhao, Junwei & Liu, Xuewu & Wu, Jian & Xu, Xiangyang & Liu, Yanfang & Wang, Shuhan & Guo, Wei, 2022. "Practical application of energy management strategy for hybrid electric vehicles based on intelligent and connected technologies: Development stages, challenges, and future trends," Renewable and Sustainable Energy Reviews, Elsevier, vol. 170(C).
    8. Ramya Kuppusamy & Srete Nikolovski & Yuvaraja Teekaraman, 2023. "Review of Machine Learning Techniques for Power Quality Performance Evaluation in Grid-Connected Systems," Sustainability, MDPI, vol. 15(20), pages 1-29, October.
    9. Zhang, Hao & Fan, Qinhao & Liu, Shang & Li, Shengbo Eben & Huang, Jin & Wang, Zhi, 2021. "Hierarchical energy management strategy for plug-in hybrid electric powertrain integrated with dual-mode combustion engine," Applied Energy, Elsevier, vol. 304(C).
    10. Yang, Ningkang & Han, Lijin & Xiang, Changle & Liu, Hui & Li, Xunmin, 2021. "An indirect reinforcement learning based real-time energy management strategy via high-order Markov Chain model for a hybrid electric vehicle," Energy, Elsevier, vol. 236(C).
    11. Xiao, Boyi & Yang, Weiwei & Wu, Jiamin & Walker, Paul D. & Zhang, Nong, 2022. "Energy management strategy via maximum entropy reinforcement learning for an extended range logistics vehicle," Energy, Elsevier, vol. 253(C).
    12. Vázquez-Canteli, José R. & Nagy, Zoltán, 2019. "Reinforcement learning for demand response: A review of algorithms and modeling techniques," Applied Energy, Elsevier, vol. 235(C), pages 1072-1089.
    13. Rosero, Fredy & Fonseca, Natalia & López, José-María & Casanova, Jesús, 2020. "Real-world fuel efficiency and emissions from an urban diesel bus engine under transient operating conditions," Applied Energy, Elsevier, vol. 261(C).
    14. Nyong-Bassey, Bassey Etim & Giaouris, Damian & Patsios, Charalampos & Papadopoulou, Simira & Papadopoulos, Athanasios I. & Walker, Sara & Voutetakis, Spyros & Seferlis, Panos & Gadoue, Shady, 2020. "Reinforcement learning based adaptive power pinch analysis for energy management of stand-alone hybrid energy storage systems considering uncertainty," Energy, Elsevier, vol. 193(C).
    15. Sofia Dahlgren & Jonas Ammenberg, 2021. "Sustainability Assessment of Public Transport, Part II—Applying a Multi-Criteria Assessment Method to Compare Different Bus Technologies," Sustainability, MDPI, vol. 13(3), pages 1-30, January.
    16. Du, Guodong & Zou, Yuan & Zhang, Xudong & Kong, Zehui & Wu, Jinlong & He, Dingbo, 2019. "Intelligent energy management for hybrid electric tracked vehicles using online reinforcement learning," Applied Energy, Elsevier, vol. 251(C), pages 1-1.
    17. Sun, Xiaojun & Yao, Chong & Song, Enzhe & Yang, Qidong & Yang, Xuchang, 2022. "Optimal control of transient processes in marine hybrid propulsion systems: Modeling, optimization and performance enhancement," Applied Energy, Elsevier, vol. 321(C).
    18. Lian, Renzong & Peng, Jiankun & Wu, Yuankai & Tan, Huachun & Zhang, Hailong, 2020. "Rule-interposing deep reinforcement learning based energy management strategy for power-split hybrid electric vehicle," Energy, Elsevier, vol. 197(C).
    19. Li, Wei & Lu, Can, 2019. "The multiple effectiveness of state natural gas consumption constraint policies for achieving sustainable development targets in China," Applied Energy, Elsevier, vol. 235(C), pages 685-698.
    20. Christian Montaleza & Paul Arévalo & Jimmy Gallegos & Francisco Jurado, 2024. "Enhancing Energy Management Strategies for Extended-Range Electric Vehicles through Deep Q-Learning and Continuous State Representation," Energies, MDPI, vol. 17(2), pages 1-21, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:329:y:2023:i:c:s030626192201488x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.