IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v280y2023ics0360544223015128.html
   My bibliography  Save this article

An efficient intelligent energy management strategy based on deep reinforcement learning for hybrid electric flying car

Author

Listed:
  • Yang, Chao
  • Lu, Zhexi
  • Wang, Weida
  • Wang, Muyao
  • Zhao, Jing

Abstract

Hybrid electric flying cars hold clear potential to support high mobility and environmentally friendly transportation. For hybrid electric flying cars, overall performance and efficiency highly depend on the coordination of the electrical and fuel systems under ground and air dual-mode. However, the huge differences in the scale and fluctuation characteristics of energy demand between ground driving and air flight modes make the efficient control of energy flow more complex. Thus, designing a power coordinated control strategy for hybrid electric flying cars is a challenging technical problem. This paper proposed a deep reinforcement learning-based energy management strategy (EMS) for a series hybrid electric flying car. A mathematical model of the series hybrid electric flying car driven by the distributed hybrid electric propulsion system (HEPS) which mainly consists of battery packs, twin turboshaft engine and generator sets (TGSs), 16 rotor-motors, and 4 wheel-motors is established. Subsequently, a Double Deep Q Network (DDQN)-based EMS considering ground and air dual driving mode is proposed. A simplified method for the number of control variables is designed to improve exploration efficiency and accelerate the convergence speed. In addition, the frequent engine on/off problem is also taken into account. Finally, DDQN-based and dynamic programming (DP)-based EMSs are applied to investigate the power flow distribution for two completely different hypothetical driving scenarios, namely search and rescue (SAR) scenarios and urban air mobility (UAM) scenarios. The results demonstrate the effectiveness of the DDQN-based EMS and its capacity of reducing the computation time.

Suggested Citation

  • Yang, Chao & Lu, Zhexi & Wang, Weida & Wang, Muyao & Zhao, Jing, 2023. "An efficient intelligent energy management strategy based on deep reinforcement learning for hybrid electric flying car," Energy, Elsevier, vol. 280(C).
    • Handle: RePEc:eee:energy:v:280:y:2023:i:c:s0360544223015128
    DOI: 10.1016/j.energy.2023.128118
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544223015128
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.energy.2023.128118?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Zhang, Jinning & Roumeliotis, Ioannis & Zolotas, Argyrios, 2022. "Model-based fully coupled propulsion-aerodynamics optimization for hybrid electric aircraft energy management strategy," Energy, Elsevier, vol. 245(C).
    2. Akshat Kasliwal & Noah J. Furbush & James H. Gawron & James R. McBride & Timothy J. Wallington & Robert D. De Kleine & Hyung Chul Kim & Gregory A. Keoleian, 2019. "Role of flying cars in sustainable mobility," Nature Communications, Nature, vol. 10(1), pages 1-9, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Liu, Ming & Hao, Han & Sun, Xin & Qu, Xiaobo & Wang, Kai & Qian, Yuping & Hao, Xu & Xun, Dengye & Geng, Jingxuan & Dou, Hao & Deng, Yunfeng & Du, Shilong & Liu, Zongwei & Zhao, Fuquan, 2024. "Exploring the key technologies needed for the commercialization of electric flying cars: A levelized cost and profitability analysis," Energy, Elsevier, vol. 303(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Pons-Prats, Jordi & Živojinović, Tanja & Kuljanin, Jovana, 2022. "On the understanding of the current status of urban air mobility development and its future prospects: Commuting in a flying vehicle as a new paradigm," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 166(C).
    2. Cohen, Adam & Shaheen, Susan, 2021. "Urban Air Mobility: Opportunities and Obstacles," Institute of Transportation Studies, Research Reports, Working Papers, Proceedings qt0r23p1gm, Institute of Transportation Studies, UC Berkeley.
    3. Wang, Weida & Chen, Yincong & Yang, Chao & Li, Ying & Xu, Bin & Xiang, Changle, 2022. "An enhanced hypotrochoid spiral optimization algorithm based intertwined optimal sizing and control strategy of a hybrid electric air-ground vehicle," Energy, Elsevier, vol. 257(C).
    4. Ali, Busyairah Syd & Saji, Sam & Su, Moon Ting, 2022. "An assessment of frameworks for heterogeneous aircraft operations in low-altitude airspace," International Journal of Critical Infrastructure Protection, Elsevier, vol. 37(C).
    5. Raoul Rothfeld & Mengying Fu & Miloš Balać & Constantinos Antoniou, 2021. "Potential Urban Air Mobility Travel Time Savings: An Exploratory Analysis of Munich, Paris, and San Francisco," Sustainability, MDPI, vol. 13(4), pages 1-20, February.
    6. Lee, Changju & Bae, Bumjoon & Lee, Yu Lim & Pak, Tae-Young, 2023. "Societal acceptance of urban air mobility based on the technology adoption framework," Technological Forecasting and Social Change, Elsevier, vol. 196(C).
    7. Wang, Mingkai & Xiaoyang, Guotai & He, Ruichen & Zhang, Shuguang & Ma, Jintao, 2023. "Bi-layer sizing and design optimization method of propulsion system for electric vertical takeoff and landing aircraft," Energy, Elsevier, vol. 283(C).
    8. Wang, Bin & Wang, Chaohui & Wang, Zhiyu & Ni, Siliang & Yang, Yixin & Tian, Pengyu, 2023. "Adaptive state of energy evaluation for supercapacitor in emergency power system of more-electric aircraft," Energy, Elsevier, vol. 263(PA).
    9. Zeng, Ziling & Wang, Tingsong & Qu, Xiaobo, 2024. "En-route charge scheduling for an electric bus network: Stochasticity and real-world practice," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 185(C).
    10. Zheng, Fengying & Chen, Yuang & Zhang, Jingyang & Cheng, Fengna & Zhang, Jingzhou, 2023. "A two-stage energy management for integrated thermal/energy optimization of aircraft airborne system based on Stackelberg game," Energy, Elsevier, vol. 269(C).
    11. Jiadi Zhang & Ilya Kolmanovsky & Mohammad Reza Amini, 2021. "Stochastic Drift Counteraction Optimal Control of a Fuel Cell-Powered Small Unmanned Aerial Vehicle," Energies, MDPI, vol. 14(5), pages 1-21, February.
    12. Zhang, Jinning & Roumeliotis, Ioannis & Zhang, Xin & Zolotas, Argyrios, 2023. "Techno-economic-environmental evaluation of aircraft propulsion electrification: Surrogate-based multi-mission optimal design approach," Renewable and Sustainable Energy Reviews, Elsevier, vol. 175(C).
    13. Lyu, Chenghao & Zhang, Yuchen & Bai, Yilin & Yang, Kun & Song, Zhengxiang & Ma, Yuhang & Meng, Jinhao, 2024. "Inner-outer layer co-optimization of sizing and energy management for renewable energy microgrid with storage," Applied Energy, Elsevier, vol. 363(C).
    14. Husemann, Michael & Kirste, Ansgar & Stumpf, Eike, 2024. "Analysis of cost-efficient urban air mobility systems: Optimization of operational and configurational fleet decisions," European Journal of Operational Research, Elsevier, vol. 317(3), pages 678-695.
    15. Kitthamkesorn, Songyot & Chen, Anthony, 2024. "Maximum capture problem for urban air mobility network design," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 187(C).
    16. Mulrow, John & Derrible, Sybil & Samaras, Constantine, 2019. "Sociotechnical convex hulls and the evolution of transportation activity: A method and application to US travel survey data," Technological Forecasting and Social Change, Elsevier, vol. 149(C).
    17. Annitsa Koumoutsidi & Ioanna Pagoni & Amalia Polydoropoulou, 2022. "A New Mobility Era: Stakeholders’ Insights regarding Urban Air Mobility," Sustainability, MDPI, vol. 14(5), pages 1-18, March.
    18. Bulusu, Vishwanath & Sengupta, Raja, 2020. "Urban Air Mobility: Viability of Hub-Door and Door-Door Movement by Air," Institute of Transportation Studies, Research Reports, Working Papers, Proceedings qt6wq6x800, Institute of Transportation Studies, UC Berkeley.
    19. Laura C. Aguilar Esteva & Akshat Kasliwal & Michael S. Kinzler & Hyung Chul Kim & Gregory A. Keoleian, 2021. "Circular economy framework for automobiles: Closing energy and material loops," Journal of Industrial Ecology, Yale University, vol. 25(4), pages 877-889, August.
    20. Adam, Cohen & Susan, Shaheen, 2021. "Urban Air Mobility: Opportunities and Obstacles," Institute of Transportation Studies, Research Reports, Working Papers, Proceedings qt3mg6z1wf, Institute of Transportation Studies, UC Berkeley.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:280:y:2023:i:c:s0360544223015128. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.