IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v280y2023ics0360544223015128.html
   My bibliography  Save this article

An efficient intelligent energy management strategy based on deep reinforcement learning for hybrid electric flying car

Author

Listed:
  • Yang, Chao
  • Lu, Zhexi
  • Wang, Weida
  • Wang, Muyao
  • Zhao, Jing

Abstract

Hybrid electric flying cars hold clear potential to support high mobility and environmentally friendly transportation. For hybrid electric flying cars, overall performance and efficiency highly depend on the coordination of the electrical and fuel systems under ground and air dual-mode. However, the huge differences in the scale and fluctuation characteristics of energy demand between ground driving and air flight modes make the efficient control of energy flow more complex. Thus, designing a power coordinated control strategy for hybrid electric flying cars is a challenging technical problem. This paper proposed a deep reinforcement learning-based energy management strategy (EMS) for a series hybrid electric flying car. A mathematical model of the series hybrid electric flying car driven by the distributed hybrid electric propulsion system (HEPS) which mainly consists of battery packs, twin turboshaft engine and generator sets (TGSs), 16 rotor-motors, and 4 wheel-motors is established. Subsequently, a Double Deep Q Network (DDQN)-based EMS considering ground and air dual driving mode is proposed. A simplified method for the number of control variables is designed to improve exploration efficiency and accelerate the convergence speed. In addition, the frequent engine on/off problem is also taken into account. Finally, DDQN-based and dynamic programming (DP)-based EMSs are applied to investigate the power flow distribution for two completely different hypothetical driving scenarios, namely search and rescue (SAR) scenarios and urban air mobility (UAM) scenarios. The results demonstrate the effectiveness of the DDQN-based EMS and its capacity of reducing the computation time.

Suggested Citation

  • Yang, Chao & Lu, Zhexi & Wang, Weida & Wang, Muyao & Zhao, Jing, 2023. "An efficient intelligent energy management strategy based on deep reinforcement learning for hybrid electric flying car," Energy, Elsevier, vol. 280(C).
    • Handle: RePEc:eee:energy:v:280:y:2023:i:c:s0360544223015128
    DOI: 10.1016/j.energy.2023.128118
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544223015128
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.energy.2023.128118?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Zhang, Jinning & Roumeliotis, Ioannis & Zolotas, Argyrios, 2022. "Model-based fully coupled propulsion-aerodynamics optimization for hybrid electric aircraft energy management strategy," Energy, Elsevier, vol. 245(C).
    2. Zou, Yuan & Liu, Teng & Liu, Dexing & Sun, Fengchun, 2016. "Reinforcement learning-based real-time energy management for a hybrid tracked vehicle," Applied Energy, Elsevier, vol. 171(C), pages 372-382.
    3. Akshat Kasliwal & Noah J. Furbush & James H. Gawron & James R. McBride & Timothy J. Wallington & Robert D. De Kleine & Hyung Chul Kim & Gregory A. Keoleian, 2019. "Role of flying cars in sustainable mobility," Nature Communications, Nature, vol. 10(1), pages 1-9, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Liu, Ming & Hao, Han & Sun, Xin & Qu, Xiaobo & Wang, Kai & Qian, Yuping & Hao, Xu & Xun, Dengye & Geng, Jingxuan & Dou, Hao & Deng, Yunfeng & Du, Shilong & Liu, Zongwei & Zhao, Fuquan, 2024. "Exploring the key technologies needed for the commercialization of electric flying cars: A levelized cost and profitability analysis," Energy, Elsevier, vol. 303(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Pons-Prats, Jordi & Živojinović, Tanja & Kuljanin, Jovana, 2022. "On the understanding of the current status of urban air mobility development and its future prospects: Commuting in a flying vehicle as a new paradigm," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 166(C).
    2. Cohen, Adam & Shaheen, Susan, 2021. "Urban Air Mobility: Opportunities and Obstacles," Institute of Transportation Studies, Research Reports, Working Papers, Proceedings qt0r23p1gm, Institute of Transportation Studies, UC Berkeley.
    3. Yang, Ningkang & Han, Lijin & Xiang, Changle & Liu, Hui & Li, Xunmin, 2021. "An indirect reinforcement learning based real-time energy management strategy via high-order Markov Chain model for a hybrid electric vehicle," Energy, Elsevier, vol. 236(C).
    4. Wang, Weida & Chen, Yincong & Yang, Chao & Li, Ying & Xu, Bin & Xiang, Changle, 2022. "An enhanced hypotrochoid spiral optimization algorithm based intertwined optimal sizing and control strategy of a hybrid electric air-ground vehicle," Energy, Elsevier, vol. 257(C).
    5. Anvari-Moghaddam, Amjad & Rahimi-Kian, Ashkan & Mirian, Maryam S. & Guerrero, Josep M., 2017. "A multi-agent based energy management solution for integrated buildings and microgrid system," Applied Energy, Elsevier, vol. 203(C), pages 41-56.
    6. Du, Guodong & Zou, Yuan & Zhang, Xudong & Kong, Zehui & Wu, Jinlong & He, Dingbo, 2019. "Intelligent energy management for hybrid electric tracked vehicles using online reinforcement learning," Applied Energy, Elsevier, vol. 251(C), pages 1-1.
    7. Ali, Busyairah Syd & Saji, Sam & Su, Moon Ting, 2022. "An assessment of frameworks for heterogeneous aircraft operations in low-altitude airspace," International Journal of Critical Infrastructure Protection, Elsevier, vol. 37(C).
    8. Du, Guodong & Zou, Yuan & Zhang, Xudong & Liu, Teng & Wu, Jinlong & He, Dingbo, 2020. "Deep reinforcement learning based energy management for a hybrid electric vehicle," Energy, Elsevier, vol. 201(C).
    9. Lian, Renzong & Peng, Jiankun & Wu, Yuankai & Tan, Huachun & Zhang, Hailong, 2020. "Rule-interposing deep reinforcement learning based energy management strategy for power-split hybrid electric vehicle," Energy, Elsevier, vol. 197(C).
    10. Raoul Rothfeld & Mengying Fu & Miloš Balać & Constantinos Antoniou, 2021. "Potential Urban Air Mobility Travel Time Savings: An Exploratory Analysis of Munich, Paris, and San Francisco," Sustainability, MDPI, vol. 13(4), pages 1-20, February.
    11. Daniel Egan & Qilun Zhu & Robert Prucka, 2023. "A Review of Reinforcement Learning-Based Powertrain Controllers: Effects of Agent Selection for Mixed-Continuity Control and Reward Formulation," Energies, MDPI, vol. 16(8), pages 1-31, April.
    12. Lee, Changju & Bae, Bumjoon & Lee, Yu Lim & Pak, Tae-Young, 2023. "Societal acceptance of urban air mobility based on the technology adoption framework," Technological Forecasting and Social Change, Elsevier, vol. 196(C).
    13. Wang, Mingkai & Xiaoyang, Guotai & He, Ruichen & Zhang, Shuguang & Ma, Jintao, 2023. "Bi-layer sizing and design optimization method of propulsion system for electric vertical takeoff and landing aircraft," Energy, Elsevier, vol. 283(C).
    14. Christian Montaleza & Paul Arévalo & Jimmy Gallegos & Francisco Jurado, 2024. "Enhancing Energy Management Strategies for Extended-Range Electric Vehicles through Deep Q-Learning and Continuous State Representation," Energies, MDPI, vol. 17(2), pages 1-21, January.
    15. Wu, Yuankai & Tan, Huachun & Peng, Jiankun & Zhang, Hailong & He, Hongwen, 2019. "Deep reinforcement learning of energy management with continuous control strategy and traffic information for a series-parallel plug-in hybrid electric bus," Applied Energy, Elsevier, vol. 247(C), pages 454-466.
    16. Li, Guidan & Yang, Zhe & Li, Bin & Bi, Huakun, 2019. "Power allocation smoothing strategy for hybrid energy storage system based on Markov decision process," Applied Energy, Elsevier, vol. 241(C), pages 152-163.
    17. Chen, Yifan & Yang, Liuquan & Yang, Chao & Wang, Weida & Zha, Mingjun & Gao, Pu & Liu, Hui, 2024. "Real-time analytical solution to energy management for hybrid electric vehicles using intelligent driving cycle recognition," Energy, Elsevier, vol. 307(C).
    18. Wang, Bin & Wang, Chaohui & Wang, Zhiyu & Ni, Siliang & Yang, Yixin & Tian, Pengyu, 2023. "Adaptive state of energy evaluation for supercapacitor in emergency power system of more-electric aircraft," Energy, Elsevier, vol. 263(PA).
    19. Wang, Chun & Yang, Ruixin & Yu, Quanqing, 2019. "Wavelet transform based energy management strategies for plug-in hybrid electric vehicles considering temperature uncertainty," Applied Energy, Elsevier, vol. 256(C).
    20. Wu, Changcheng & Ruan, Jiageng & Cui, Hanghang & Zhang, Bin & Li, Tongyang & Zhang, Kaixuan, 2023. "The application of machine learning based energy management strategy in multi-mode plug-in hybrid electric vehicle, part I: Twin Delayed Deep Deterministic Policy Gradient algorithm design for hybrid ," Energy, Elsevier, vol. 262(PB).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:280:y:2023:i:c:s0360544223015128. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.