IDEAS home Printed from https://ideas.repec.org/a/gam/jagris/v13y2023i1p141-d1026075.html
   My bibliography  Save this article

Energy-Saving Control Algorithm of Venlo Greenhouse Skylight and Wet Curtain Fan Based on Reinforcement Learning with Soft Action Mask

Author

Listed:
  • Lihan Chen

    (College of Electronics and Information Engineering, Tongji University, Cao’an Road, No. 4800, Shanghai 201804, China)

  • Lihong Xu

    (College of Electronics and Information Engineering, Tongji University, Cao’an Road, No. 4800, Shanghai 201804, China)

  • Ruihua Wei

    (College of Electronics and Information Engineering, Tongji University, Cao’an Road, No. 4800, Shanghai 201804, China)

Abstract

Due to the complex coupling of greenhouse environments, a number of challenges have been encountered in the research of automatic control in Venlo greenhouses. Most algorithms are only concerned with accuracy, yet energy-saving control is of great importance for improving economic benefits. Reinforcement learning, as an unsupervised machine learning method with a framework similar to that of feedback control, is a powerful tool for autonomous decision making in complex environments. However, the loss of benefits and increased time cost in the exploration process make it difficult to apply it to practical scenarios. This work proposes an energy-saving control algorithm for Venlo greenhouse skylights and wet curtain fan based on Reinforcement Learning with Soft Action Mask (SAM), which establishes a trainable SAM network with artificial rules to achieve sub-optimal policy initiation, safe exploration, and efficient optimization. Experiments in a simulated Venlo greenhouse model show that the approach, which is a feasible solution encoding human knowledge to improve the reinforcement learning process, can start with a safe, sub-optimal level and effectively and efficiently achieve reductions in the energy consumption, providing a suitable environment for crops and preventing frequent operation of the facility during the control process.

Suggested Citation

  • Lihan Chen & Lihong Xu & Ruihua Wei, 2023. "Energy-Saving Control Algorithm of Venlo Greenhouse Skylight and Wet Curtain Fan Based on Reinforcement Learning with Soft Action Mask," Agriculture, MDPI, vol. 13(1), pages 1-16, January.
  • Handle: RePEc:gam:jagris:v:13:y:2023:i:1:p:141-:d:1026075
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2077-0472/13/1/141/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2077-0472/13/1/141/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Van Beveren, P.J.M. & Bontsema, J. & Van Straten, G. & Van Henten, E.J., 2015. "Minimal heating and cooling in a modern rose greenhouse," Applied Energy, Elsevier, vol. 137(C), pages 97-109.
    2. Angeliki Kavga & Vassilis Kappatos, 2013. "Estimation of the Temperatures in an Experimental Infrared Heated Greenhouse Using Neural Network Models," International Journal of Agricultural and Environmental Information Systems (IJAEIS), IGI Global, vol. 4(2), pages 14-22, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Barkat Rabbi & Zhong-Hua Chen & Subbu Sethuvenkatraman, 2019. "Protected Cropping in Warm Climates: A Review of Humidity Control and Cooling Methods," Energies, MDPI, vol. 12(14), pages 1-24, July.
    2. Elham Bolandnazar & Hassan Sadrnia & Abbas Rohani & Francesco Marinello & Morteza Taki, 2023. "Application of Artificial Intelligence for Modeling the Internal Environment Condition of Polyethylene Greenhouses," Agriculture, MDPI, vol. 13(8), pages 1-16, August.
    3. Zhang, Guanshan & Ding, Xiaoming & Li, Tianhua & Pu, Wenyang & Lou, Wei & Hou, Jialin, 2020. "Dynamic energy balance model of a glass greenhouse: An experimental validation and solar energy analysis," Energy, Elsevier, vol. 198(C).
    4. van Beveren, P.J.M. & Bontsema, J. & van Straten, G. & van Henten, E.J., 2015. "Optimal control of greenhouse climate using minimal energy and grower defined bounds," Applied Energy, Elsevier, vol. 159(C), pages 509-519.
    5. Katzin, David & van Henten, Eldert J. & van Mourik, Simon, 2022. "Process-based greenhouse climate models: Genealogy, current status, and future directions," Agricultural Systems, Elsevier, vol. 198(C).
    6. Achour, Yasmine & Ouammi, Ahmed & Zejli, Driss, 2021. "Technological progresses in modern sustainable greenhouses cultivation as the path towards precision agriculture," Renewable and Sustainable Energy Reviews, Elsevier, vol. 147(C).
    7. Xue-Bo Jin & Wei-Zhen Zheng & Jian-Lei Kong & Xiao-Yi Wang & Min Zuo & Qing-Chuan Zhang & Seng Lin, 2021. "Deep-Learning Temporal Predictor via Bidirectional Self-Attentive Encoder–Decoder Framework for IOT-Based Environmental Sensing in Intelligent Greenhouse," Agriculture, MDPI, vol. 11(8), pages 1-25, August.
    8. Cuce, Erdem & Harjunowibowo, Dewanto & Cuce, Pinar Mert, 2016. "Renewable and sustainable energy saving strategies for greenhouse systems: A comprehensive review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 64(C), pages 34-59.
    9. Golzar, Farzin & Heeren, Niko & Hellweg, Stefanie & Roshandel, Ramin, 2018. "A novel integrated framework to evaluate greenhouse energy demand and crop yield production," Renewable and Sustainable Energy Reviews, Elsevier, vol. 96(C), pages 487-501.
    10. Tahery, Danial & Roshandel, Ramin & Avami, Akram, 2021. "An integrated dynamic model for evaluating the influence of ground to air heat transfer system on heating, cooling and CO2 supply in Greenhouses: Considering crop transpiration," Renewable Energy, Elsevier, vol. 173(C), pages 42-56.
    11. Lin, Dong & Zhang, Lijun & Xia, Xiaohua, 2021. "Model predictive control of a Venlo-type greenhouse system considering electrical energy, water and carbon dioxide consumption," Applied Energy, Elsevier, vol. 298(C).
    12. Blaud, Pierre Clement & Haurant, Pierrick & Chevrel, Philippe & Claveau, Fabien & Mouraud, Anthony, 2023. "Multi-flow optimization of a greenhouse system: A hierarchical control approach," Applied Energy, Elsevier, vol. 351(C).
    13. Hassanien, Reda Hassanien Emam & Li, Ming & Dong Lin, Wei, 2016. "Advanced applications of solar energy in agricultural greenhouses," Renewable and Sustainable Energy Reviews, Elsevier, vol. 54(C), pages 989-1001.
    14. Iddio, E. & Wang, L. & Thomas, Y. & McMorrow, G. & Denzer, A., 2020. "Energy efficient operation and modeling for greenhouses: A literature review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 117(C).
    15. Katzin, David & Marcelis, Leo F.M. & van Mourik, Simon, 2021. "Energy savings in greenhouses by transition from high-pressure sodium to LED lighting," Applied Energy, Elsevier, vol. 281(C).
    16. Costantino, Andrea & Comba, Lorenzo & Sicardi, Giacomo & Bariani, Mauro & Fabrizio, Enrico, 2021. "Energy performance and climate control in mechanically ventilated greenhouses: A dynamic modelling-based assessment and investigation," Applied Energy, Elsevier, vol. 288(C).
    17. Engler, Nicholas & Krarti, Moncef, 2021. "Review of energy efficiency in controlled environment agriculture," Renewable and Sustainable Energy Reviews, Elsevier, vol. 141(C).
    18. Sun, Weituo & Wei, Xiaoming & Zhou, Baochang & Lu, Chungui & Guo, Wenzhong, 2022. "Greenhouse heating by energy transfer between greenhouses: System design and implementation," Applied Energy, Elsevier, vol. 325(C).
    19. Mahmood, Farhat & Govindan, Rajesh & Bermak, Amine & Yang, David & Al-Ansari, Tareq, 2023. "Data-driven robust model predictive control for greenhouse temperature control and energy utilisation assessment," Applied Energy, Elsevier, vol. 343(C).
    20. Giuseppina Nicolosi & Roberto Volpe & Antonio Messineo, 2017. "An Innovative Adaptive Control System to Regulate Microclimatic Conditions in a Greenhouse," Energies, MDPI, vol. 10(5), pages 1-17, May.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jagris:v:13:y:2023:i:1:p:141-:d:1026075. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.