IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v14y2021i17p5334-d623536.html
   My bibliography  Save this article

Q-Learning Neural Controller for Steam Generator Station in Micro Cogeneration Systems

Author

Listed:
  • Krzysztof Lalik

    (Faculty of Mechanical Engineering and Robotics, AGH University of Science and Technology, Al. Mickiewicza 30, 30-059 Krakow, Poland
    These authors contributed equally to this work.)

  • Mateusz Kozek

    (Faculty of Mechanical Engineering and Robotics, AGH University of Science and Technology, Al. Mickiewicza 30, 30-059 Krakow, Poland
    These authors contributed equally to this work.)

  • Szymon Podlasek

    (Faculty of Energy and Fuels, AGH University of Science and Technology, Al. Mickiewicza 30, 30-059 Krakow, Poland
    These authors contributed equally to this work.)

  • Rafał Figaj

    (Faculty of Energy and Fuels, AGH University of Science and Technology, Al. Mickiewicza 30, 30-059 Krakow, Poland)

  • Paweł Gut

    (Faculty of Mechanical Engineering and Robotics, AGH University of Science and Technology, Al. Mickiewicza 30, 30-059 Krakow, Poland)

Abstract

This article presents the results of the optimization of steam generator control systems powered by mixtures of liquid fuels containing biofuels. The numerical model was based on the results of experimental research of steam generator operation in an open system. The numerical model is used to build control algorithms that improve performance, increase efficiency, reduce fuel consumption and increase safety in the full range of operation of the steam generator and the cogeneration system of which it is a component. In this research, the following parameters were monitored: temperature and pressure of the circulating medium, exhaust gas temperature, oxygen content in exhaust gas, percentage control of oil burner power. Two methods of controlling the steam generator were proposed: the classic one, using the PID regulator, and the advanced one, using artificial neural networks. The work shows how the model is adapted to the real system and the impact of the control algorithms on the efficiency of the combustion process. The example is considered for the implementation of advanced control systems in micro-, small- and medium-power cogeneration and trigeneration systems in order to improve their final efficiency and increase the profitability of implementation.

Suggested Citation

  • Krzysztof Lalik & Mateusz Kozek & Szymon Podlasek & Rafał Figaj & Paweł Gut, 2021. "Q-Learning Neural Controller for Steam Generator Station in Micro Cogeneration Systems," Energies, MDPI, vol. 14(17), pages 1-13, August.
    • Handle: RePEc:gam:jeners:v:14:y:2021:i:17:p:5334-:d:623536
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/14/17/5334/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/1996-1073/14/17/5334/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Homod, Raad Z. & Gaeid, Khalaf S. & Dawood, Suroor M. & Hatami, Alireza & Sahari, Khairul S., 2020. "Evaluation of energy-saving potential for optimal time response of HVAC control system in smart buildings," Applied Energy, Elsevier, vol. 271(C).
    2. Sornek, Krzysztof & Filipowicz, Mariusz & Żołądek, Maciej & Kot, Radosław & Mikrut, Małgorzata, 2019. "Comparative analysis of selected thermoelectric generators operating with wood-fired stove," Energy, Elsevier, vol. 166(C), pages 1303-1313.
    3. Bianco, Vincenzo & Szubel, Mateusz & Matras, Beata & Filipowicz, Mariusz & Papis, Karolina & Podlasek, Szymon, 2021. "CFD analysis and design optimization of an air manifold for a biomass boiler," Renewable Energy, Elsevier, vol. 163(C), pages 2018-2028.
    4. Menon, Ramanunni P. & Paolone, Mario & Maréchal, François, 2013. "Study of optimal design of polygeneration systems in optimal control strategies," Energy, Elsevier, vol. 55(C), pages 134-141.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Podlasek, Szymon & Jankowski, Marcin & Bałazy, Patryk & Lalik, Krzysztof & Figaj, Rafał, 2024. "Application of ANN control algorithm for optimizing performance of a hybrid ORC power plant," Energy, Elsevier, vol. 306(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lee, Minjung & Ham, Jeonggyun & Lee, Jeong-Won & Cho, Honghyun, 2023. "Analysis of thermal comfort, energy consumption, and CO2 reduction of indoor space according to the type of local heating under winter rest conditions," Energy, Elsevier, vol. 268(C).
    2. Chetty, Raju & Nagase, Kazuo & Aihara, Makoto & Jood, Priyanka & Takazawa, Hiroyuki & Ohta, Michihiro & Yamamoto, Atsushi, 2020. "Mechanically durable thermoelectric power generation module made of Ni-based alloy as a reference for reliable testing," Applied Energy, Elsevier, vol. 260(C).
    3. Usón, Sergio & Royo, Javier & Canalís, Paula, 2023. "Integration of thermoelectric generators in a biomass boiler: Experimental tests and study of ash deposition effect," Renewable Energy, Elsevier, vol. 214(C), pages 395-406.
    4. Krzysztof Sornek, 2020. "Prototypical Biomass-Fired Micro-Cogeneration Systems—Energy and Ecological Analysis," Energies, MDPI, vol. 13(15), pages 1-16, July.
    5. Bracco, Stefano & Delfino, Federico & Pampararo, Fabio & Robba, Michela & Rossi, Mansueto, 2014. "A mathematical model for the optimal operation of the University of Genoa Smart Polygeneration Microgrid: Evaluation of technical, economic and environmental performance indicators," Energy, Elsevier, vol. 64(C), pages 912-922.
    6. Li, Guoneng & Fan, Yiqi & Li, Qiangsheng & Zheng, Youqu & Zhao, Dan & Wang, Shifeng & Dong, Sijie & Guo, Wenwen & Tang, Yuanjun, 2025. "A review on micro combustion powered thermoelectric generator: History, state-of-the-art and challenges to commercialization," Renewable and Sustainable Energy Reviews, Elsevier, vol. 207(C).
    7. Calise, Francesco & de Notaristefani di Vastogirardi, Giulio & Dentice d'Accadia, Massimo & Vicidomini, Maria, 2018. "Simulation of polygeneration systems," Energy, Elsevier, vol. 163(C), pages 290-337.
    8. Halhoul Merabet, Ghezlane & Essaaidi, Mohamed & Ben Haddou, Mohamed & Qolomany, Basheer & Qadir, Junaid & Anan, Muhammad & Al-Fuqaha, Ala & Abid, Mohamed Riduan & Benhaddou, Driss, 2021. "Intelligent building control systems for thermal comfort and energy-efficiency: A systematic review of artificial intelligence-assisted techniques," Renewable and Sustainable Energy Reviews, Elsevier, vol. 144(C).
    9. Wang, Haichao & Abdollahi, Elnaz & Lahdelma, Risto & Jiao, Wenling & Zhou, Zhigang, 2015. "Modelling and optimization of the smart hybrid renewable energy for communities (SHREC)," Renewable Energy, Elsevier, vol. 84(C), pages 114-123.
    10. Mirko M. Stojiljković & Mladen M. Stojiljković & Bratislav D. Blagojević, 2014. "Multi-Objective Combinatorial Optimization of Trigeneration Plants Based on Metaheuristics," Energies, MDPI, vol. 7(12), pages 1-28, December.
    11. Mallikarjun, Sreekanth & Lewis, Herbert F., 2014. "Energy technology allocation for distributed energy resources: A strategic technology-policy framework," Energy, Elsevier, vol. 72(C), pages 783-799.
    12. Li, Guoneng & Zheng, Youqu & Hu, Jiangen & Guo, Wenwen, 2019. "Experiments and a simplified theoretical model for a water-cooled, stove-powered thermoelectric generator," Energy, Elsevier, vol. 185(C), pages 437-448.
    13. Homod, Raad Z. & Munahi, Basil Sh. & Mohammed, Hayder Ibrahim & Albadr, Musatafa Abbas Abbood & Abderrahmane, AISSA & Mahdi, Jasim M. & Ben Hamida, Mohamed Bechir & Alhasnawi, Bilal Naji & Albahri, A., 2024. "Deep clustering of reinforcement learning based on the bang-bang principle to optimize the energy in multi-boiler for intelligent buildings," Applied Energy, Elsevier, vol. 356(C).
    14. Stojiljković, Mirko M. & Ignjatović, Marko G. & Vučković, Goran D., 2015. "Greenhouse gases emission assessment in residential sector through buildings simulations and operation optimization," Energy, Elsevier, vol. 92(P3), pages 420-434.
    15. V. S. K. V. Harish & Arun Kumar & Tabish Alam & Paolo Blecich, 2021. "Assessment of State-Space Building Energy System Models in Terms of Stability and Controllability," Sustainability, MDPI, vol. 13(21), pages 1-26, October.
    16. Kiaee, Mehrdad & Tousi, A.M., 2021. "Vector-based deterioration index for gas turbine gas-path prognostics modeling framework," Energy, Elsevier, vol. 216(C).
    17. Alexandre Correia & Luís Miguel Ferreira & Paulo Coimbra & Pedro Moura & Aníbal T. de Almeida, 2022. "Smart Thermostats for a Campus Microgrid: Demand Control and Improving Air Quality," Energies, MDPI, vol. 15(4), pages 1-21, February.
    18. Homod, Raad Z. & Mohammed, Hayder Ibrahim & Abderrahmane, Aissa & Alawi, Omer A. & Khalaf, Osamah Ibrahim & Mahdi, Jasim M. & Guedri, Kamel & Dhaidan, Nabeel S. & Albahri, A.S. & Sadeq, Abdellatif M. , 2023. "Deep clustering of Lagrangian trajectory for multi-task learning to energy saving in intelligent buildings using cooperative multi-agent," Applied Energy, Elsevier, vol. 351(C).
    19. Giuseppe Anastasi & Carlo Bartoli & Paolo Conti & Emanuele Crisostomi & Alessandro Franco & Sergio Saponara & Daniele Testi & Dimitri Thomopulos & Carlo Vallati, 2021. "Optimized Energy and Air Quality Management of Shared Smart Buildings in the COVID-19 Scenario," Energies, MDPI, vol. 14(8), pages 1-17, April.
    20. Zarifi, Soudmand & Mirhosseini Moghaddam, Maziar, 2020. "Utilizing finned tube economizer for extending the thermal power rate of TEG CHP system," Energy, Elsevier, vol. 202(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:14:y:2021:i:17:p:5334-:d:623536. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.