IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v295y2024ics0360544224007400.html
   My bibliography  Save this article

HP3O algorithm-based all electric ship energy management strategy integrating demand-side adjustment

Author

Listed:
  • Song, Tiewei
  • Fu, Lijun
  • Zhong, Linlin
  • Fan, Yaxiang
  • Shang, Qianyi

Abstract

To tackle the energy management challenge that integrates power generation scheduling and demand-side adjustment for all-electric ship in uncertain marine environment, a hybrid penalized proximal policy optimization algorithm (HP3O)-based energy management strategy is proposed. First, demand-side adjustment, which involves adjusting the power of the ship's electric propulsion motors and flexible service loads, is integrated into the energy management problem. Second, HP3O algorithm is employed to obtain both continuous and discrete variables simultaneously. It utilizes a continuous actor network to obtain continuous variables, such as the generator's power and ship cruising speed, while employing a discrete actor network to determine discrete variables, i.e., the on/off status of the generators. Third, to handle complex constraints reasonably, the energy management problem is formulated as a constrained Markov decision process (CMDP), and an action mask mechanism is also integrated into the energy management framework to make agent's actions more reliable. The simulation results of an all-electric cruise ship validate the effectiveness and superiority of the proposed strategy in achieving near-optimal scheduling while satisfying operation constraints. Furthermore, a case study on a hybrid diesel-electric ferry confirms its generalization performance.

Suggested Citation

  • Song, Tiewei & Fu, Lijun & Zhong, Linlin & Fan, Yaxiang & Shang, Qianyi, 2024. "HP3O algorithm-based all electric ship energy management strategy integrating demand-side adjustment," Energy, Elsevier, vol. 295(C).
  • Handle: RePEc:eee:energy:v:295:y:2024:i:c:s0360544224007400
    DOI: 10.1016/j.energy.2024.130968
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544224007400
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.energy.2024.130968?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. de Mars, Patrick & O’Sullivan, Aidan, 2021. "Applying reinforcement learning and tree search to the unit commitment problem," Applied Energy, Elsevier, vol. 302(C).
    2. Wu, Peng & Partridge, Julius & Bucknall, Richard, 2020. "Cost-effective reinforcement learning energy management for plug-in hybrid fuel cell and battery ships," Applied Energy, Elsevier, vol. 275(C).
    3. Yupeng Yuan & Tianding Zhang & Boyang Shen & Xinping Yan & Teng Long, 2018. "A Fuzzy Logic Energy Management Strategy for a Photovoltaic/Diesel/Battery Hybrid Ship Based on Experimental Database," Energies, MDPI, vol. 11(9), pages 1-15, August.
    4. Fan, Feilong & Aditya, Venkataraman & Xu, Yan & Cheong, Benjamin & Gupta, Amit K., 2022. "Robustly coordinated operation of a ship microgird with hybrid propulsion systems and hydrogen fuel cells," Applied Energy, Elsevier, vol. 312(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Xie, Peilin & Tan, Sen & Bazmohammadi, Najmeh & Guerrero, Josep. M. & Vasquez, Juan. C. & Alcala, Jose Matas & Carreño, Jorge El Mariachet, 2022. "A distributed real-time power management scheme for shipboard zonal multi-microgrid system," Applied Energy, Elsevier, vol. 317(C).
    2. Taofeek Afolabi & Hooman Farzaneh, 2023. "Optimal Design and Operation of an Off-Grid Hybrid Renewable Energy System in Nigeria’s Rural Residential Area, Using Fuzzy Logic and Optimization Techniques," Sustainability, MDPI, vol. 15(4), pages 1-33, February.
    3. Liu, Hanyou & Fan, Ailong & Li, Yongping & Bucknall, Richard & Chen, Li, 2024. "Hierarchical distributed MPC method for hybrid energy management: A case study of ship with variable operating conditions," Renewable and Sustainable Energy Reviews, Elsevier, vol. 189(PA).
    4. Awol Seid Ebrie & Chunhyun Paik & Yongjoo Chung & Young Jin Kim, 2023. "Environment-Friendly Power Scheduling Based on Deep Contextual Reinforcement Learning," Energies, MDPI, vol. 16(16), pages 1-12, August.
    5. Daniel Egan & Qilun Zhu & Robert Prucka, 2023. "A Review of Reinforcement Learning-Based Powertrain Controllers: Effects of Agent Selection for Mixed-Continuity Control and Reward Formulation," Energies, MDPI, vol. 16(8), pages 1-31, April.
    6. He Yin & Hai Lan & Ying-Yi Hong & Zhuangwei Wang & Peng Cheng & Dan Li & Dong Guo, 2023. "A Comprehensive Review of Shipboard Power Systems with New Energy Sources," Energies, MDPI, vol. 16(5), pages 1-44, February.
    7. Park, Chybyung & Jeong, Byongug & Zhou, Peilin, 2022. "Lifecycle energy solution of the electric propulsion ship with Live-Life cycle assessment for clean maritime economy," Applied Energy, Elsevier, vol. 328(C).
    8. Maja Perčić & Nikola Vladimir & Marija Koričan, 2021. "Electrification of Inland Waterway Ships Considering Power System Lifetime Emissions and Costs," Energies, MDPI, vol. 14(21), pages 1-25, October.
    9. Elkholy, M.H. & Metwally, Hamid & Farahat, M.A. & Senjyu, Tomonobu & Elsayed Lotfy, Mohammed, 2022. "Smart centralized energy management system for autonomous microgrid using FPGA," Applied Energy, Elsevier, vol. 317(C).
    10. Zhao, Shihao & Li, Kang & Yang, Zhile & Xu, Xinzhi & Zhang, Ning, 2022. "A new power system active rescheduling method considering the dispatchable plug-in electric vehicles and intermittent renewable energies," Applied Energy, Elsevier, vol. 314(C).
    11. Yang, Zirong & Jiao, Kui & Wu, Kangcheng & Shi, Weilong & Jiang, Shangfeng & Zhang, Longhai & Du, Qing, 2021. "Numerical investigations of assisted heating cold start strategies for proton exchange membrane fuel cell systems," Energy, Elsevier, vol. 222(C).
    12. Yang Liu & Qiuyu Lu & Zhenfan Yu & Yue Chen & Yinguo Yang, 2024. "Reinforcement Learning-Enhanced Adaptive Scheduling of Battery Energy Storage Systems in Energy Markets," Energies, MDPI, vol. 17(21), pages 1-17, October.
    13. Mustapha Habib & Elmar Bollin & Qian Wang, 2023. "Battery Energy Management System Using Edge-Driven Fuzzy Logic," Energies, MDPI, vol. 16(8), pages 1-18, April.
    14. Yuan, Yupeng & Wang, Jixiang & Yan, Xinping & Shen, Boyang & Long, Teng, 2020. "A review of multi-energy hybrid power system for ships," Renewable and Sustainable Energy Reviews, Elsevier, vol. 132(C).
    15. Touzani, Samir & Prakash, Anand Krishnan & Wang, Zhe & Agarwal, Shreya & Pritoni, Marco & Kiran, Mariam & Brown, Richard & Granderson, Jessica, 2021. "Controlling distributed energy resources via deep reinforcement learning for load flexibility and energy efficiency," Applied Energy, Elsevier, vol. 304(C).
    16. Chen, Chunyu & Cui, Mingjian & Fang, Xin & Ren, Bixing & Chen, Yang, 2020. "Load altering attack-tolerant defense strategy for load frequency control system," Applied Energy, Elsevier, vol. 280(C).
    17. O’Malley, Cormac & de Mars, Patrick & Badesa, Luis & Strbac, Goran, 2023. "Reinforcement learning and mixed-integer programming for power plant scheduling in low carbon systems: Comparison and hybridisation," Applied Energy, Elsevier, vol. 349(C).
    18. Macias, A. & Kandidayeni, M. & Boulon, L. & Trovão, J.P., 2021. "Fuel cell-supercapacitor topologies benchmark for a three-wheel electric vehicle powertrain," Energy, Elsevier, vol. 224(C).
    19. Wang, Zhuang & Chen, Li & Wang, Bin & Huang, Lianzhong & Wang, Kai & Ma, Ranqi, 2023. "Integrated optimization of speed schedule and energy management for a hybrid electric cruise ship considering environmental factors," Energy, Elsevier, vol. 282(C).
    20. Haugen, Mari & Blaisdell-Pijuan, Paris L. & Botterud, Audun & Levin, Todd & Zhou, Zhi & Belsnes, Michael & Korpås, Magnus & Somani, Abhishek, 2024. "Power market models for the clean energy transition: State of the art and future research needs," Applied Energy, Elsevier, vol. 357(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:295:y:2024:i:c:s0360544224007400. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.