IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v280y2023ics0360544223015128.html
   My bibliography  Save this article

An efficient intelligent energy management strategy based on deep reinforcement learning for hybrid electric flying car

Author

Listed:
  • Yang, Chao
  • Lu, Zhexi
  • Wang, Weida
  • Wang, Muyao
  • Zhao, Jing

Abstract

Hybrid electric flying cars hold clear potential to support high mobility and environmentally friendly transportation. For hybrid electric flying cars, overall performance and efficiency highly depend on the coordination of the electrical and fuel systems under ground and air dual-mode. However, the huge differences in the scale and fluctuation characteristics of energy demand between ground driving and air flight modes make the efficient control of energy flow more complex. Thus, designing a power coordinated control strategy for hybrid electric flying cars is a challenging technical problem. This paper proposed a deep reinforcement learning-based energy management strategy (EMS) for a series hybrid electric flying car. A mathematical model of the series hybrid electric flying car driven by the distributed hybrid electric propulsion system (HEPS) which mainly consists of battery packs, twin turboshaft engine and generator sets (TGSs), 16 rotor-motors, and 4 wheel-motors is established. Subsequently, a Double Deep Q Network (DDQN)-based EMS considering ground and air dual driving mode is proposed. A simplified method for the number of control variables is designed to improve exploration efficiency and accelerate the convergence speed. In addition, the frequent engine on/off problem is also taken into account. Finally, DDQN-based and dynamic programming (DP)-based EMSs are applied to investigate the power flow distribution for two completely different hypothetical driving scenarios, namely search and rescue (SAR) scenarios and urban air mobility (UAM) scenarios. The results demonstrate the effectiveness of the DDQN-based EMS and its capacity of reducing the computation time.

Suggested Citation

  • Yang, Chao & Lu, Zhexi & Wang, Weida & Wang, Muyao & Zhao, Jing, 2023. "An efficient intelligent energy management strategy based on deep reinforcement learning for hybrid electric flying car," Energy, Elsevier, vol. 280(C).
    • Handle: RePEc:eee:energy:v:280:y:2023:i:c:s0360544223015128
    DOI: 10.1016/j.energy.2023.128118
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544223015128
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.energy.2023.128118?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Zhang, Jinning & Roumeliotis, Ioannis & Zolotas, Argyrios, 2022. "Model-based fully coupled propulsion-aerodynamics optimization for hybrid electric aircraft energy management strategy," Energy, Elsevier, vol. 245(C).
    2. Zou, Yuan & Liu, Teng & Liu, Dexing & Sun, Fengchun, 2016. "Reinforcement learning-based real-time energy management for a hybrid tracked vehicle," Applied Energy, Elsevier, vol. 171(C), pages 372-382.
    3. Akshat Kasliwal & Noah J. Furbush & James H. Gawron & James R. McBride & Timothy J. Wallington & Robert D. De Kleine & Hyung Chul Kim & Gregory A. Keoleian, 2019. "Role of flying cars in sustainable mobility," Nature Communications, Nature, vol. 10(1), pages 1-9, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Liu, Ming & Hao, Han & Sun, Xin & Qu, Xiaobo & Wang, Kai & Qian, Yuping & Hao, Xu & Xun, Dengye & Geng, Jingxuan & Dou, Hao & Deng, Yunfeng & Du, Shilong & Liu, Zongwei & Zhao, Fuquan, 2024. "Exploring the key technologies needed for the commercialization of electric flying cars: A levelized cost and profitability analysis," Energy, Elsevier, vol. 303(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Cohen, Adam & Shaheen, Susan, 2021. "Urban Air Mobility: Opportunities and Obstacles," Institute of Transportation Studies, Research Reports, Working Papers, Proceedings qt0r23p1gm, Institute of Transportation Studies, UC Berkeley.
    2. Wang, Weida & Chen, Yincong & Yang, Chao & Li, Ying & Xu, Bin & Xiang, Changle, 2022. "An enhanced hypotrochoid spiral optimization algorithm based intertwined optimal sizing and control strategy of a hybrid electric air-ground vehicle," Energy, Elsevier, vol. 257(C).
    3. Anvari-Moghaddam, Amjad & Rahimi-Kian, Ashkan & Mirian, Maryam S. & Guerrero, Josep M., 2017. "A multi-agent based energy management solution for integrated buildings and microgrid system," Applied Energy, Elsevier, vol. 203(C), pages 41-56.
    4. Du, Guodong & Zou, Yuan & Zhang, Xudong & Kong, Zehui & Wu, Jinlong & He, Dingbo, 2019. "Intelligent energy management for hybrid electric tracked vehicles using online reinforcement learning," Applied Energy, Elsevier, vol. 251(C), pages 1-1.
    5. Du, Guodong & Zou, Yuan & Zhang, Xudong & Liu, Teng & Wu, Jinlong & He, Dingbo, 2020. "Deep reinforcement learning based energy management for a hybrid electric vehicle," Energy, Elsevier, vol. 201(C).
    6. Lian, Renzong & Peng, Jiankun & Wu, Yuankai & Tan, Huachun & Zhang, Hailong, 2020. "Rule-interposing deep reinforcement learning based energy management strategy for power-split hybrid electric vehicle," Energy, Elsevier, vol. 197(C).
    7. Daniel Egan & Qilun Zhu & Robert Prucka, 2023. "A Review of Reinforcement Learning-Based Powertrain Controllers: Effects of Agent Selection for Mixed-Continuity Control and Reward Formulation," Energies, MDPI, vol. 16(8), pages 1-31, April.
    8. Wang, Mingkai & Xiaoyang, Guotai & He, Ruichen & Zhang, Shuguang & Ma, Jintao, 2023. "Bi-layer sizing and design optimization method of propulsion system for electric vertical takeoff and landing aircraft," Energy, Elsevier, vol. 283(C).
    9. Christian Montaleza & Paul Arévalo & Jimmy Gallegos & Francisco Jurado, 2024. "Enhancing Energy Management Strategies for Extended-Range Electric Vehicles through Deep Q-Learning and Continuous State Representation," Energies, MDPI, vol. 17(2), pages 1-21, January.
    10. Chen, Yifan & Yang, Liuquan & Yang, Chao & Wang, Weida & Zha, Mingjun & Gao, Pu & Liu, Hui, 2024. "Real-time analytical solution to energy management for hybrid electric vehicles using intelligent driving cycle recognition," Energy, Elsevier, vol. 307(C).
    11. Wang, Bin & Wang, Chaohui & Wang, Zhiyu & Ni, Siliang & Yang, Yixin & Tian, Pengyu, 2023. "Adaptive state of energy evaluation for supercapacitor in emergency power system of more-electric aircraft," Energy, Elsevier, vol. 263(PA).
    12. Wang, Chun & Yang, Ruixin & Yu, Quanqing, 2019. "Wavelet transform based energy management strategies for plug-in hybrid electric vehicles considering temperature uncertainty," Applied Energy, Elsevier, vol. 256(C).
    13. Aygun, Hakan, 2024. "Effects of air to fuel ratio on parameters of combustor used for gas turbine engines: Applications of turbojet, turbofan, turboprop and turboshaft," Energy, Elsevier, vol. 305(C).
    14. Zeng, Ziling & Wang, Tingsong & Qu, Xiaobo, 2024. "En-route charge scheduling for an electric bus network: Stochasticity and real-world practice," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 185(C).
    15. Shi, Wenzhuo & Huangfu, Yigeng & Xu, Liangcai & Pang, Shengzhao, 2022. "Online energy management strategy considering fuel cell fault for multi-stack fuel cell hybrid vehicle based on multi-agent reinforcement learning," Applied Energy, Elsevier, vol. 328(C).
    16. Liu, Weirong & Yao, Pengfei & Wu, Yue & Duan, Lijun & Li, Heng & Peng, Jun, 2025. "Imitation reinforcement learning energy management for electric vehicles with hybrid energy storage system," Applied Energy, Elsevier, vol. 378(PA).
    17. Zhou, Jianhao & Xue, Yuan & Xu, Da & Li, Chaoxiong & Zhao, Wanzhong, 2022. "Self-learning energy management strategy for hybrid electric vehicle via curiosity-inspired asynchronous deep reinforcement learning," Energy, Elsevier, vol. 242(C).
    18. Bo, Lin & Han, Lijin & Xiang, Changle & Liu, Hui & Ma, Tian, 2022. "A Q-learning fuzzy inference system based online energy management strategy for off-road hybrid electric vehicles," Energy, Elsevier, vol. 252(C).
    19. Yao, Yongming & Wang, Jie & Zhou, Zhicong & Li, Hang & Liu, Huiying & Li, Tianyu, 2023. "Grey Markov prediction-based hierarchical model predictive control energy management for fuel cell/battery hybrid unmanned aerial vehicles," Energy, Elsevier, vol. 262(PA).
    20. Leng, Jun-xue & Shen, Yang & Huang, Wei & An, Kai & Zhou, Can-can & Wang, Zhen-guo, 2024. "Multi-fidelity data mining-based design optimization framework for scramjet-based aircraft," Energy, Elsevier, vol. 311(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:280:y:2023:i:c:s0360544223015128. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.