IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v307y2022ics0306261921014896.html
   My bibliography  Save this article

Real-time heliostat field aiming strategy optimization based on reinforcement learning

Author

Listed:
  • Zeng, Zhichen
  • Ni, Dong
  • Xiao, Gang

Abstract

The heliostat field aiming strategy optimization is a crucial topic in solar power tower (SPT) plants. The optimal aiming strategy attempts to maximize the thermal power output while preserving certain operational limits. While existing methods could produce high-optimality results, they cannot be applied to real-time optimization for ultra large scale problems due to high computational complexity. In this work, an effective and scalable optimization method is proposed to achieve real-time optimization for ultra large scale problems, enabling efficient and robust SPT plant operations under varying solar conditions (i.e., cloud shadowing variations). The real-time optimization problem is reformulated as a reinforcement learning problem, capturing the learning from the intrinsic sequential decision-making process, to minimize unnecessary repetitions of computations. A Crescent Dunes-like SPT plant is studied, with the allowable flux density as the optimization constraint, and the results show that the proposed method provides better or comparable performance compared to heuristic optimization methods with an order of magnitude less computation time.

Suggested Citation

  • Zeng, Zhichen & Ni, Dong & Xiao, Gang, 2022. "Real-time heliostat field aiming strategy optimization based on reinforcement learning," Applied Energy, Elsevier, vol. 307(C).
  • Handle: RePEc:eee:appene:v:307:y:2022:i:c:s0306261921014896
    DOI: 10.1016/j.apenergy.2021.118224
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261921014896
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.apenergy.2021.118224?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Siva Reddy, V. & Kaushik, S.C. & Ranjan, K.R. & Tyagi, S.K., 2013. "State-of-the-art of solar thermal power plants—A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 27(C), pages 258-273.
    2. Zheng, Zhang-Jing & Li, Ming-Jia & He, Ya-Ling, 2017. "Thermal analysis of solar central receiver tube with porous inserts and non-uniform heat flux," Applied Energy, Elsevier, vol. 185(P2), pages 1152-1161.
    3. Wang, P. & Liu, D.Y. & Xu, C., 2013. "Numerical study of heat transfer enhancement in the receiver tube of direct steam generation with parabolic trough by inserting metal foams," Applied Energy, Elsevier, vol. 102(C), pages 449-460.
    4. Rodríguez-Sánchez, M.R. & Leray, C. & Toutant, A. & Ferriere, A. & Olalde, G., 2019. "Development of a new method to estimate the incident solar flux on central receivers from deteriorated heliostats," Renewable Energy, Elsevier, vol. 130(C), pages 182-190.
    5. Li, Ming-Jia & Song, Chen-Xi & Tao, Wen-Quan, 2016. "A hybrid model for explaining the short-term dynamics of energy efficiency of China’s thermal power plants," Applied Energy, Elsevier, vol. 169(C), pages 738-747.
    6. Wang, Kun & He, Ya-Ling & Xue, Xiao-Dai & Du, Bao-Cun, 2017. "Multi-objective optimization of the aiming strategy for the solar power tower with a cavity receiver by using the non-dominated sorting genetic algorithm," Applied Energy, Elsevier, vol. 205(C), pages 399-416.
    7. Conroy, Tim & Collins, Maurice N. & Fisher, James & Grimes, Ronan, 2018. "Thermal and mechanical analysis of a sodium-cooled solar receiver operating under a novel heliostat aiming point strategy," Applied Energy, Elsevier, vol. 230(C), pages 590-614.
    8. Li, Ming-Jia & Tao, Wen-Quan, 2017. "Review of methodologies and polices for evaluation of energy efficiency in high energy-consuming industry," Applied Energy, Elsevier, vol. 187(C), pages 203-215.
    9. Qiu, Yu & Li, Ming-Jia & Wang, Kun & Liu, Zhan-Bin & Xue, Xiao-Dai, 2017. "Aiming strategy optimization for uniform flux distribution in the receiver of a linear Fresnel solar reflector using a multi-objective genetic algorithm," Applied Energy, Elsevier, vol. 205(C), pages 1394-1407.
    10. Yu, Qiang & Wang, Zhifeng & Xu, Ershu, 2014. "Analysis and improvement of solar flux distribution inside a cavity receiver based on multi-focal points of heliostat field," Applied Energy, Elsevier, vol. 136(C), pages 417-430.
    11. Wang, Kun & He, Ya-Ling & Zhu, Han-Hui, 2017. "Integration between supercritical CO2 Brayton cycles and molten salt solar power towers: A review and a comprehensive comparison of different cycle layouts," Applied Energy, Elsevier, vol. 195(C), pages 819-836.
    12. Gouveia, Luis & Leitner, Markus & Ruthmair, Mario, 2017. "Extended formulations and branch-and-cut algorithms for the Black-and-White Traveling Salesman Problem," European Journal of Operational Research, Elsevier, vol. 262(3), pages 908-928.
    13. Kuhnke, Sascha & Richter, Pascal & Kepp, Fynn & Cumpston, Jeff & Koster, Arie M.C.A. & Büsing, Christina, 2020. "Robust optimal aiming strategies in central receiver systems," Renewable Energy, Elsevier, vol. 152(C), pages 198-207.
    14. Sánchez-González, Alberto & Santana, Domingo, 2015. "Solar flux distribution on central receivers: A projection method from analytic function," Renewable Energy, Elsevier, vol. 74(C), pages 576-587.
    15. Speetzen, N. & Richter, P., 2021. "Dynamic aiming strategy for central receiver systems," Renewable Energy, Elsevier, vol. 180(C), pages 55-67.
    16. Ashley, Thomas & Carrizosa, Emilio & Fernández-Cara, Enrique, 2017. "Optimisation of aiming strategies in Solar Power Tower plants," Energy, Elsevier, vol. 137(C), pages 285-291.
    17. Avila-Marin, Antonio L. & Fernandez-Reche, Jesus & Tellez, Felix M., 2013. "Evaluation of the potential of central receiver solar power plants: Configuration, optimization and trends," Applied Energy, Elsevier, vol. 112(C), pages 274-288.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Yerudkar, Aditi N. & Kumar, Durgesh & Dalvi, Vishwanath H. & Panse, Sudhir V. & Gaval, Vivek R. & Joshi, Jyeshtharaj B., 2024. "Economically feasible solutions in concentrating solar power technology specifically for heliostats – A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 189(PA).
    2. Wang, Shuang & Asselineau, Charles-Alexis & Fontalvo, Armando & Wang, Ye & Logie, William & Pye, John & Coventry, Joe, 2023. "Co-optimisation of the heliostat field and receiver for concentrated solar power plants," Applied Energy, Elsevier, vol. 348(C).
    3. Ruidi Zhu & Dong Ni, 2023. "A Model Predictive Control Approach for Heliostat Field Power Regulatory Aiming Strategy under Varying Cloud Shadowing Conditions," Energies, MDPI, vol. 16(7), pages 1-19, March.
    4. Yi’an Wang & Zhe Wu & Dong Ni, 2024. "Large-Scale Optimization among Photovoltaic and Concentrated Solar Power Systems: A State-of-the-Art Review and Algorithm Analysis," Energies, MDPI, vol. 17(17), pages 1-38, August.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wang, Kun & He, Ya-Ling & Xue, Xiao-Dai & Du, Bao-Cun, 2017. "Multi-objective optimization of the aiming strategy for the solar power tower with a cavity receiver by using the non-dominated sorting genetic algorithm," Applied Energy, Elsevier, vol. 205(C), pages 399-416.
    2. Wang, Kun & Li, Ming-Jia & Guo, Jia-Qi & Li, Peiwen & Liu, Zhan-Bin, 2018. "A systematic comparison of different S-CO2 Brayton cycle layouts based on multi-objective optimization for applications in solar power tower plants," Applied Energy, Elsevier, vol. 212(C), pages 109-121.
    3. Qiu, Yu & Li, Ming-Jia & Wang, Kun & Liu, Zhan-Bin & Xue, Xiao-Dai, 2017. "Aiming strategy optimization for uniform flux distribution in the receiver of a linear Fresnel solar reflector using a multi-objective genetic algorithm," Applied Energy, Elsevier, vol. 205(C), pages 1394-1407.
    4. Xu, Yang & Li, Ming-Jia & Zheng, Zhang-Jing & Xue, Xiao-Dai, 2018. "Melting performance enhancement of phase change material by a limited amount of metal foam: Configurational optimization and economic assessment," Applied Energy, Elsevier, vol. 212(C), pages 868-880.
    5. Conroy, Tim & Collins, Maurice N. & Grimes, Ronan, 2020. "A review of steady-state thermal and mechanical modelling on tubular solar receivers," Renewable and Sustainable Energy Reviews, Elsevier, vol. 119(C).
    6. Wang, Wen-Qi & Qiu, Yu & Li, Ming-Jia & He, Ya-Ling & Cheng, Ze-Dong, 2020. "Coupled optical and thermal performance of a fin-like molten salt receiver for the next-generation solar power tower," Applied Energy, Elsevier, vol. 272(C).
    7. Sánchez-González, Alberto & Rodríguez-Sánchez, María Reyes & Santana, Domingo, 2018. "Aiming factor to flatten the flux distribution on cylindrical receivers," Energy, Elsevier, vol. 153(C), pages 113-125.
    8. García, Jesús & Barraza, Rodrigo & Soo Too, Yen Chean & Vásquez-Padilla, Ricardo & Acosta, David & Estay, Danilo & Valdivia, Patricio, 2022. "Transient simulation of a control strategy for solar receivers based on mass flow valves adjustments and heliostats aiming," Renewable Energy, Elsevier, vol. 185(C), pages 1221-1244.
    9. Ruidi Zhu & Dong Ni, 2023. "A Model Predictive Control Approach for Heliostat Field Power Regulatory Aiming Strategy under Varying Cloud Shadowing Conditions," Energies, MDPI, vol. 16(7), pages 1-19, March.
    10. Zhu, Han-Hui & Wang, Kun & He, Ya-Ling, 2017. "Thermodynamic analysis and comparison for different direct-heated supercritical CO2 Brayton cycles integrated into a solar thermal power tower system," Energy, Elsevier, vol. 140(P1), pages 144-157.
    11. Wang, Kun & He, Ya-Ling & Qiu, Yu & Zhang, Yuwen, 2016. "A novel integrated simulation approach couples MCRT and Gebhart methods to simulate solar radiation transfer in a solar power tower system with a cavity receiver," Renewable Energy, Elsevier, vol. 89(C), pages 93-107.
    12. Guo, Jia-Qi & Li, Ming-Jia & Xu, Jin-Liang & Yan, Jun-Jie & Wang, Kun, 2019. "Thermodynamic performance analysis of different supercritical Brayton cycles using CO2-based binary mixtures in the molten salt solar power tower systems," Energy, Elsevier, vol. 173(C), pages 785-798.
    13. Huang, Weidong & Yu, Liang & Hu, Peng, 2019. "An analytical solution for the solar flux density produced by a round focusing heliostat," Renewable Energy, Elsevier, vol. 134(C), pages 306-320.
    14. Wang, Kun & He, Ya-Ling & Zhu, Han-Hui, 2017. "Integration between supercritical CO2 Brayton cycles and molten salt solar power towers: A review and a comprehensive comparison of different cycle layouts," Applied Energy, Elsevier, vol. 195(C), pages 819-836.
    15. Conroy, Tim & Collins, Maurice N. & Fisher, James & Grimes, Ronan, 2018. "Thermal and mechanical analysis of a sodium-cooled solar receiver operating under a novel heliostat aiming point strategy," Applied Energy, Elsevier, vol. 230(C), pages 590-614.
    16. Ma, Teng & Li, Ming-Jia & Xu, Jin-Liang & Cao, Feng, 2019. "Thermodynamic analysis and performance prediction on dynamic response characteristic of PCHE in 1000 MW S-CO2 coal fired power plant," Energy, Elsevier, vol. 175(C), pages 123-138.
    17. Du, Shen & Tong, Zi-Xiang & Zhang, Hong-Hu & He, Ya-Ling, 2019. "Tomography-based determination of Nusselt number correlation for the porous volumetric solar receiver with different geometrical parameters," Renewable Energy, Elsevier, vol. 135(C), pages 711-718.
    18. Huang, Weidong & Sun, Lulening, 2016. "Solar flux density calculation for a heliostat with an elliptical Gaussian distribution source," Applied Energy, Elsevier, vol. 182(C), pages 434-441.
    19. Liang, Hongbo & Zhu, Chunguang & Fan, Man & You, Shijun & Zhang, Huan & Xia, Junbao, 2018. "Study on the thermal performance of a novel cavity receiver for parabolic trough solar collectors," Applied Energy, Elsevier, vol. 222(C), pages 790-798.
    20. Qiu, Yu & He, Ya-Ling & Li, Peiwen & Du, Bao-Cun, 2017. "A comprehensive model for analysis of real-time optical performance of a solar power tower with a multi-tube cavity receiver," Applied Energy, Elsevier, vol. 185(P1), pages 589-603.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:307:y:2022:i:c:s0306261921014896. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.