IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v17y2024i9p2056-d1383379.html
   My bibliography  Save this article

Integrating an Ensemble Reward System into an Off-Policy Reinforcement Learning Algorithm for the Economic Dispatch of Small Modular Reactor-Based Energy Systems

Author

Listed:
  • Athanasios Ioannis Arvanitidis

    (Department of Electrical and Computer Engineering, University of Texas at San Antonio, San Antonio, TX 78249, USA)

  • Miltiadis Alamaniotis

    (Department of Electrical and Computer Engineering, University of Texas at San Antonio, San Antonio, TX 78249, USA)

Abstract

Nuclear Integrated Energy Systems (NIES) have emerged as a comprehensive solution for navigating the changing energy landscape. They combine nuclear power plants with renewable energy sources, storage systems, and smart grid technologies to optimize energy production, distribution, and consumption across sectors, improving efficiency, reliability, and sustainability while addressing challenges associated with variability. The integration of Small Modular Reactors (SMRs) in NIES offers significant benefits over traditional nuclear facilities, although transferring involves overcoming legal and operational barriers, particularly in economic dispatch. This study proposes a novel off-policy Reinforcement Learning (RL) approach with an ensemble reward system to optimize economic dispatch for nuclear-powered generation companies equipped with an SMR, demonstrating superior accuracy and efficiency when compared to conventional methods and emphasizing RL’s potential to improve NIES profitability and sustainability. Finally, the research attempts to demonstrate the viability of implementing the proposed integrated RL approach in spot energy markets to maximize profits for nuclear-driven generation companies, establishing NIES’ profitability over competitors that rely on fossil fuel-based generation units to meet baseload requirements.

Suggested Citation

  • Athanasios Ioannis Arvanitidis & Miltiadis Alamaniotis, 2024. "Integrating an Ensemble Reward System into an Off-Policy Reinforcement Learning Algorithm for the Economic Dispatch of Small Modular Reactor-Based Energy Systems," Energies, MDPI, vol. 17(9), pages 1-21, April.
    • Handle: RePEc:gam:jeners:v:17:y:2024:i:9:p:2056-:d:1383379
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/17/9/2056/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/1996-1073/17/9/2056/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Frick, Konor & Wendt, Daniel & Talbot, Paul & Rabiti, Cristian & Boardman, Richard, 2022. "Technoeconomic assessment of hydrogen cogeneration via high temperature steam electrolysis with a light-water reactor," Applied Energy, Elsevier, vol. 306(PB).
    2. Rowinski, Marcin Karol & White, Timothy John & Zhao, Jiyun, 2015. "Small and Medium sized Reactors (SMR): A review of technology," Renewable and Sustainable Energy Reviews, Elsevier, vol. 44(C), pages 643-656.
    3. Epiney, A. & Rabiti, C. & Talbot, P. & Alfonsi, A., 2020. "Economic analysis of a nuclear hybrid energy system in a stochastic environment including wind turbines in an electricity grid," Applied Energy, Elsevier, vol. 260(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yi, Zonggen & Luo, Yusheng & Westover, Tyler & Katikaneni, Sravya & Ponkiya, Binaka & Sah, Suba & Mahmud, Sadab & Raker, David & Javaid, Ahmad & Heben, Michael J. & Khanna, Raghav, 2022. "Deep reinforcement learning based optimization for a tightly coupled nuclear renewable integrated energy system," Applied Energy, Elsevier, vol. 328(C).
    2. Haoyu Wang & Roberto Ponciroli & Andrea Alfonsi & Paul W. Talbot & Thomas W. Elmer & Aaron S. Epiney & Richard B. Vilim, 2024. "Feasible Actuator Range Modifier (FARM), a Tool Aiding the Solution of Unit Dispatch Problems for Advanced Energy Systems," Energies, MDPI, vol. 17(12), pages 1-36, June.
    3. Zhe Dong & Miao Liu & Di Jiang & Xiaojin Huang & Yajun Zhang & Zuoyi Zhang, 2018. "Automatic Generation Control of Nuclear Heating Reactor Power Plants," Energies, MDPI, vol. 11(10), pages 1-18, October.
    4. Hui, Jiuwu & Lee, Yi-Kuen & Yuan, Jingqi, 2023. "Load following control of a PWR with load-dependent parameters and perturbations via fixed-time fractional-order sliding mode and disturbance observer techniques," Renewable and Sustainable Energy Reviews, Elsevier, vol. 184(C).
    5. Hajizadeh, Abdollah & Mohamadi-Baghmolaei, Mohamad & Cata Saady, Noori M. & Zendehboudi, Sohrab, 2022. "Hydrogen production from biomass through integration of anaerobic digestion and biogas dry reforming," Applied Energy, Elsevier, vol. 309(C).
    6. Mignacca, B. & Locatelli, G., 2020. "Economics and finance of Small Modular Reactors: A systematic review and research agenda," Renewable and Sustainable Energy Reviews, Elsevier, vol. 118(C).
    7. Wang, Qiang & Li, Rongrong & He, Gang, 2018. "Research status of nuclear power: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 90(C), pages 90-96.
    8. Alanne, Kari & Cao, Sunliang, 2019. "An overview of the concept and technology of ubiquitous energy," Applied Energy, Elsevier, vol. 238(C), pages 284-302.
    9. Jia Zhou & Hany Abdel-Khalik & Paul Talbot & Cristian Rabiti, 2021. "A Hybrid Energy System Workflow for Energy Portfolio Optimization," Energies, MDPI, vol. 14(15), pages 1-28, July.
    10. Carless, Travis S. & Talabi, Sola M. & Fischbeck, Paul S., 2019. "Risk and regulatory considerations for small modular reactor emergency planning zones based on passive decontamination potential," Energy, Elsevier, vol. 167(C), pages 740-756.
    11. Alonso, Gustavo & Bilbao, Sama & Valle, Edmundo del, 2016. "Economic competitiveness of small modular reactors versus coal and combined cycle plants," Energy, Elsevier, vol. 116(P1), pages 867-879.
    12. Gao, Sichen & Huang, Guohe & Zhang, Xiaoyue & Han, Dengcheng, 2022. "Small modular reactors enable the transition to a low-carbon power system across Canada," Renewable and Sustainable Energy Reviews, Elsevier, vol. 169(C).
    13. Slavin, Brittney & Wang, Ruiqi & Roy, Dibyendu & Ling-Chin, Janie & Roskilly, Anthony Paul, 2024. "Techno-economic analysis of direct air carbon capture and hydrogen production integrated with a small modular reactor," Applied Energy, Elsevier, vol. 356(C).
    14. Zhe Dong, 2016. "Model-Free Coordinated Control for MHTGR-Based Nuclear Steam Supply Systems," Energies, MDPI, vol. 9(1), pages 1-14, January.
    15. Gong, Yu & Liu, Pan & Liu, Yini & Huang, Kangdi, 2021. "Robust operation interval of a large-scale hydro-photovoltaic power system to cope with emergencies," Applied Energy, Elsevier, vol. 290(C).
    16. Bang, You-Ma & Cho, Chong Pyo & Jung, Yongjin & Park, Seong-Ryong & Kim, Joeng-Geun & Park, Sungwook, 2023. "Thermal and flow characteristics of a cylindrical superheated steam generator with helical fins," Energy, Elsevier, vol. 267(C).
    17. Jiang, Di & Dong, Zhe, 2020. "Dynamic matrix control for thermal power of multi-modular high temperature gas-cooled reactor plants," Energy, Elsevier, vol. 198(C).
    18. Liu, Guangxu & Huang, Yanping & Wang, Junfeng & Liu, Ruilong, 2020. "A review on the thermal-hydraulic performance and optimization of printed circuit heat exchangers for supercritical CO2 in advanced nuclear power systems," Renewable and Sustainable Energy Reviews, Elsevier, vol. 133(C).
    19. Dong, Zhe & Zhang, Zuoyi & Dong, Yujie & Huang, Xiaojin, 2018. "Multi-layer perception based model predictive control for the thermal power of nuclear superheated-steam supply systems," Energy, Elsevier, vol. 151(C), pages 116-125.
    20. Dong, Zhe & Pan, Yifei & Zhang, Zuoyi & Dong, Yujie & Huang, Xiaojin, 2018. "Dynamical modeling and simulation of the six-modular high temperature gas-cooled reactor plant HTR-PM600," Energy, Elsevier, vol. 155(C), pages 971-991.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:17:y:2024:i:9:p:2056-:d:1383379. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.