IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v10y2017i10p1587-d114699.html
   My bibliography  Save this article

Validation of Calibrated Energy Models: Common Errors

Author

Listed:
  • Germán Ramos Ruiz

    (School of Architecture, University of Navarra, 31009 Pamplona, Spain)

  • Carlos Fernández Bandera

    (School of Architecture, University of Navarra, 31009 Pamplona, Spain)

Abstract

Nowadays, there is growing interest in all the smart technologies that provide us with information and knowledge about the human environment. In the energy field, thanks to the amount of data received from smart meters and devices and the progress made in both energy software and computers, the quality of energy models is gradually improving and, hence, also the suitability of Energy Conservation Measures (ECMs). For this reason, the measurement of the accuracy of building energy models is an important task, because once the model is validated through a calibration procedure, it can be used, for example, to apply and study different strategies to reduce its energy consumption in maintaining human comfort. There are several agencies that have developed guidelines and methodologies to establish a measure of the accuracy of these models, and the most widely recognized are: ASHRAE Guideline 14-2014, the International Performance Measurement and Verification Protocol (IPMVP) and the Federal Energy Management Program (FEMP). This article intends to shed light on these validation measurements (uncertainty indices) by focusing on the typical mistakes made, as these errors could produce a false belief that the models used are calibrated.

Suggested Citation

  • Germán Ramos Ruiz & Carlos Fernández Bandera, 2017. "Validation of Calibrated Energy Models: Common Errors," Energies, MDPI, vol. 10(10), pages 1-19, October.
    • Handle: RePEc:gam:jeners:v:10:y:2017:i:10:p:1587-:d:114699
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/10/10/1587/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/1996-1073/10/10/1587/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Chaudhary, Gaurav & New, Joshua & Sanyal, Jibonananda & Im, Piljae & O’Neill, Zheng & Garg, Vishal, 2016. "Evaluation of “Autotune” calibration against manual calibration of building energy models," Applied Energy, Elsevier, vol. 182(C), pages 115-134.
    2. Furlan, Claudia & de Oliveira, Amauri Pereira & Soares, Jacyra & Codato, Georgia & Escobedo, João Francisco, 2012. "The role of clouds in improving the regression model for hourly values of diffuse solar radiation," Applied Energy, Elsevier, vol. 92(C), pages 240-254.
    3. Ana Ogando & Natalia Cid & Marta Fernández, 2017. "Energy Modelling and Automated Calibrations of Ancient Building Simulations: A Case Study of a School in the Northwest of Spain," Energies, MDPI, vol. 10(6), pages 1-17, June.
    4. Jin Woo Moon & Kyungjae Kim & Hyunsuk Min, 2015. "ANN-Based Prediction and Optimization of Cooling System in Hotel Rooms," Energies, MDPI, vol. 8(10), pages 1-21, September.
    5. Li, Nan & Yang, Zheng & Becerik-Gerber, Burcin & Tang, Chao & Chen, Nanlin, 2015. "Why is the reliability of building simulation limited as a tool for evaluating energy conservation measures?," Applied Energy, Elsevier, vol. 159(C), pages 196-205.
    6. El Mghouchi, Y. & Ajzoul, T. & Taoukil, D. & El Bouardi, A., 2016. "The most suitable prediction model of the solar intensity, on horizontal plane, at various weather conditions in a specified location in Morocco," Renewable and Sustainable Energy Reviews, Elsevier, vol. 54(C), pages 84-98.
    7. Zeroual, A. & Ankrim, M. & Wilkinson, A.J., 1996. "The diffuse-global correlation: Its application to estimating solar radiation on tilted surfaces in Marrakesh, Morocco," Renewable Energy, Elsevier, vol. 7(1), pages 1-13.
    8. Muneer, T. & Younes, S., 2006. "The all-sky meteorological radiation model: proposed improvements," Applied Energy, Elsevier, vol. 83(5), pages 436-450, May.
    9. Chan, A.L.S., 2016. "Generation of typical meteorological years using genetic algorithm for different energy systems," Renewable Energy, Elsevier, vol. 90(C), pages 1-13.
    10. Cristina Brunelli & Francesco Castellani & Alberto Garinei & Lorenzo Biondi & Marcello Marconi, 2016. "A Procedure to Perform Multi-Objective Optimization for Sustainable Design of Buildings," Energies, MDPI, vol. 9(11), pages 1-15, November.
    11. Besharat, Fariba & Dehghan, Ali A. & Faghih, Ahmad R., 2013. "Empirical models for estimating global solar radiation: A review and case study," Renewable and Sustainable Energy Reviews, Elsevier, vol. 21(C), pages 798-821.
    12. Diane Palmer & Ian Cole & Tom Betts & Ralph Gottschalg, 2017. "Interpolating and Estimating Horizontal Diffuse Solar Irradiation to Provide UK-Wide Coverage: Selection of the Best Performing Models," Energies, MDPI, vol. 10(2), pages 1-23, February.
    13. Almorox, J. & Hontoria, C. & Benito, M., 2011. "Models for obtaining daily global solar radiation with measured air temperature data in Madrid (Spain)," Applied Energy, Elsevier, vol. 88(5), pages 1703-1709, May.
    14. Abdel-Salam, M.S. & El-Dib, A.F. & Eissa, M.A., 1991. "Prediction of ground-level solar radiation in Egypt," Renewable Energy, Elsevier, vol. 1(2), pages 269-276.
    15. Monfet, Danielle & Zmeureanu, Radu, 2012. "Ongoing commissioning of water-cooled electric chillers using benchmarking models," Applied Energy, Elsevier, vol. 92(C), pages 99-108.
    16. Global Energy Assessment Writing Team,, 2012. "Global Energy Assessment," Cambridge Books, Cambridge University Press, number 9781107005198.
    17. Ramos Ruiz, Germán & Fernández Bandera, Carlos, 2017. "Analysis of uncertainty indices used for building envelope calibration," Applied Energy, Elsevier, vol. 185(P1), pages 82-94.
    18. Badescu, Viorel & Gueymard, Christian A. & Cheval, Sorin & Oprea, Cristian & Baciu, Madalina & Dumitrescu, Alexandru & Iacobescu, Flavius & Milos, Ioan & Rada, Costel, 2012. "Computing global and diffuse solar hourly irradiation on clear sky. Review and testing of 54 models," Renewable and Sustainable Energy Reviews, Elsevier, vol. 16(3), pages 1636-1656.
    19. Ascione, Fabrizio & Ceroni, Francesca & De Masi, Rosa Francesca & de’ Rossi, Filippo & Pecce, Maria Rosaria, 2017. "Historical buildings: Multidisciplinary approach to structural/energy diagnosis and performance assessment," Applied Energy, Elsevier, vol. 185(P2), pages 1517-1528.
    20. Wang, Lunche & Gong, Wei & Hu, Bo & Lin, Aiwen & Li, Hui & Zou, Ling, 2015. "Modeling and analysis of the spatiotemporal variations of photosynthetically active radiation in China during 1961–2012," Renewable and Sustainable Energy Reviews, Elsevier, vol. 49(C), pages 1019-1032.
    21. Despotovic, Milan & Nedic, Vladimir & Despotovic, Danijela & Cvetanovic, Slobodan, 2015. "Review and statistical analysis of different global solar radiation sunshine models," Renewable and Sustainable Energy Reviews, Elsevier, vol. 52(C), pages 1869-1880.
    22. El Mghouchi, Y. & Ajzoul, T. & El Bouardi, A., 2016. "Prediction of daily solar radiation intensity by day of the year in twenty-four cities of Morocco," Renewable and Sustainable Energy Reviews, Elsevier, vol. 53(C), pages 823-831.
    23. Ramos Ruiz, Germán & Fernández Bandera, Carlos & Gómez-Acebo Temes, Tomás & Sánchez-Ostiz Gutierrez, Ana, 2016. "Genetic algorithm for building envelope calibration," Applied Energy, Elsevier, vol. 168(C), pages 691-705.
    24. Global Energy Assessment Writing Team,, 2012. "Global Energy Assessment," Cambridge Books, Cambridge University Press, number 9780521182935.
    25. Escobedo, João F. & Gomes, Eduardo N. & Oliveira, Amauri P. & Soares, Jacyra, 2009. "Modeling hourly and daily fractions of UV, PAR and NIR to global solar radiation under various sky conditions at Botucatu, Brazil," Applied Energy, Elsevier, vol. 86(3), pages 299-309, March.
    26. Liu, Xiaoying & Xu, Yinlong & Zhong, Xiuli & Zhang, Wenying & Porter, John Roy & Liu, Wenli, 2012. "Assessing models for parameters of the Ångström–Prescott formula in China," Applied Energy, Elsevier, vol. 96(C), pages 327-338.
    27. Pisello, Anna Laura & Asdrubali, Francesco, 2014. "Human-based energy retrofits in residential buildings: A cost-effective alternative to traditional physical strategies," Applied Energy, Elsevier, vol. 133(C), pages 224-235.
    28. Chan, A.L.S. & Chow, T.T., 2013. "Evaluation of Overall Thermal Transfer Value (OTTV) for commercial buildings constructed with green roof," Applied Energy, Elsevier, vol. 107(C), pages 10-24.
    29. Li, Danny H.W. & Chau, T.C. & Wan, Kevin K.W., 2014. "A review of the CIE general sky classification approaches," Renewable and Sustainable Energy Reviews, Elsevier, vol. 31(C), pages 563-574.
    30. Wan Mohd Nazi, Wan Iman & Royapoor, Mohammad & Wang, Yaodong & Roskilly, Anthony Paul, 2017. "Office building cooling load reduction using thermal analysis method – A case study," Applied Energy, Elsevier, vol. 185(P2), pages 1574-1584.
    31. Hu, Bo & Liu, Hui & Wang, Yuesi, 2016. "Investigation of the variability of photosynthetically active radiation in the Tibetan Plateau, China," Renewable and Sustainable Energy Reviews, Elsevier, vol. 55(C), pages 240-248.
    32. Yang, Zheng & Becerik-Gerber, Burcin, 2015. "A model calibration framework for simultaneous multi-level building energy simulation," Applied Energy, Elsevier, vol. 149(C), pages 415-431.
    33. Khalil, Samy A. & Shaffie, A.M., 2013. "A comparative study of total, direct and diffuse solar irradiance by using different models on horizontal and inclined surfaces for Cairo, Egypt," Renewable and Sustainable Energy Reviews, Elsevier, vol. 27(C), pages 853-863.
    34. Mustafaraj, Giorgio & Marini, Dashamir & Costa, Andrea & Keane, Marcus, 2014. "Model calibration for building energy efficiency simulation," Applied Energy, Elsevier, vol. 130(C), pages 72-85.
    35. Ascione, Fabrizio & Böttcher, Olaf & Kaltenbrunner, Robert & Vanoli, Giuseppe Peter, 2017. "Methodology of the cost-optimality for improving the indoor thermal environment during the warm season. Presentation of the method and application to a new multi-storey building in Berlin," Applied Energy, Elsevier, vol. 185(P2), pages 1529-1541.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jamil, Basharat & Akhtar, Naiem, 2017. "Comparison of empirical models to estimate monthly mean diffuse solar radiation from measured data: Case study for humid-subtropical climatic region of India," Renewable and Sustainable Energy Reviews, Elsevier, vol. 77(C), pages 1326-1342.
    2. Pedro Paulo Fernandes da Silva & Alberto Hernandez Neto & Ildo Luis Sauer, 2021. "Evaluation of Model Calibration Method for Simulation Performance of a Public Hospital in Brazil," Energies, MDPI, vol. 14(13), pages 1-20, June.
    3. Hassan, Gasser E. & Youssef, M. Elsayed & Mohamed, Zahraa E. & Ali, Mohamed A. & Hanafy, Ahmed A., 2016. "New Temperature-based Models for Predicting Global Solar Radiation," Applied Energy, Elsevier, vol. 179(C), pages 437-450.
    4. Carlos Fernández Bandera & Germán Ramos Ruiz, 2017. "Towards a New Generation of Building Envelope Calibration," Energies, MDPI, vol. 10(12), pages 1-19, December.
    5. Zhang, Jianyuan & Zhao, Li & Deng, Shuai & Xu, Weicong & Zhang, Ying, 2017. "A critical review of the models used to estimate solar radiation," Renewable and Sustainable Energy Reviews, Elsevier, vol. 70(C), pages 314-329.
    6. Vicente Gutiérrez González & Lissette Álvarez Colmenares & Jesús Fernando López Fidalgo & Germán Ramos Ruiz & Carlos Fernández Bandera, 2019. "Uncertainy’s Indices Assessment for Calibrated Energy Models," Energies, MDPI, vol. 12(11), pages 1-18, May.
    7. Wang, Lunche & Gong, Wei & Ma, Yingying & Hu, Bo & Wang, Wenling & Zhang, Miao, 2013. "Analysis of ultraviolet radiation in Central China from observation and estimation," Energy, Elsevier, vol. 59(C), pages 764-774.
    8. Glasgo, Brock & Hendrickson, Chris & Azevedo, Inês Lima, 2017. "Assessing the value of information in residential building simulation: Comparing simulated and actual building loads at the circuit level," Applied Energy, Elsevier, vol. 203(C), pages 348-363.
    9. Jeong, Kwangbok & Hong, Taehoon & Kim, Jimin & Cho, Kyuman, 2019. "Development of a multi-objective optimization model for determining the optimal CO2 emissions reduction strategies for a multi-family housing complex," Renewable and Sustainable Energy Reviews, Elsevier, vol. 110(C), pages 118-131.
    10. Jahani, Babak & Dinpashoh, Y. & Raisi Nafchi, Atefeh, 2017. "Evaluation and development of empirical models for estimating daily solar radiation," Renewable and Sustainable Energy Reviews, Elsevier, vol. 73(C), pages 878-891.
    11. Fan, Junliang & Chen, Baiquan & Wu, Lifeng & Zhang, Fucang & Lu, Xianghui & Xiang, Youzhen, 2018. "Evaluation and development of temperature-based empirical models for estimating daily global solar radiation in humid regions," Energy, Elsevier, vol. 144(C), pages 903-914.
    12. Qiu, Rangjian & Li, Longan & Wu, Lifeng & Agathokleous, Evgenios & Liu, Chunwei & Zhang, Baozhong & Luo, Yufeng & Sun, Shanlei, 2022. "Modeling daily global solar radiation using only temperature data: Past, development, and future," Renewable and Sustainable Energy Reviews, Elsevier, vol. 163(C).
    13. Wang, Lunche & Gong, Wei & Li, Chen & Lin, Aiwen & Hu, Bo & Ma, Yingying, 2013. "Measurement and estimation of photosynthetically active radiation from 1961 to 2011 in Central China," Applied Energy, Elsevier, vol. 111(C), pages 1010-1017.
    14. Glasgo, Brock & Khan, Nyla & Azevedo, Inês Lima, 2020. "Simulating a residential building stock to support regional efficiency policy," Applied Energy, Elsevier, vol. 261(C).
    15. Ahn, Jonghoon & Cho, Soolyeon, 2017. "Anti-logic or common sense that can hinder machine’s energy performance: Energy and comfort control models based on artificial intelligence responding to abnormal indoor environments," Applied Energy, Elsevier, vol. 204(C), pages 117-130.
    16. Chen, Ji-Long & He, Lei & Yang, Hong & Ma, Maohua & Chen, Qiao & Wu, Sheng-Jun & Xiao, Zuo-lin, 2019. "Empirical models for estimating monthly global solar radiation: A most comprehensive review and comparative case study in China," Renewable and Sustainable Energy Reviews, Elsevier, vol. 108(C), pages 91-111.
    17. Wang, Lunche & Kisi, Ozgur & Zounemat-Kermani, Mohammad & Salazar, Germán Ariel & Zhu, Zhongmin & Gong, Wei, 2016. "Solar radiation prediction using different techniques: model evaluation and comparison," Renewable and Sustainable Energy Reviews, Elsevier, vol. 61(C), pages 384-397.
    18. Paulescu, M. & Stefu, N. & Calinoiu, D. & Paulescu, E. & Pop, N. & Boata, R. & Mares, O., 2016. "Ångström–Prescott equation: Physical basis, empirical models and sensitivity analysis," Renewable and Sustainable Energy Reviews, Elsevier, vol. 62(C), pages 495-506.
    19. Si Chen & Daniel Friedrich & Zhibin Yu & James Yu, 2019. "District Heating Network Demand Prediction Using a Physics-Based Energy Model with a Bayesian Approach for Parameter Calibration," Energies, MDPI, vol. 12(18), pages 1-19, September.
    20. Jamil, Basharat & Akhtar, Naiem, 2017. "Estimation of diffuse solar radiation in humid-subtropical climatic region of India: Comparison of diffuse fraction and diffusion coefficient models," Energy, Elsevier, vol. 131(C), pages 149-164.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:10:y:2017:i:10:p:1587-:d:114699. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.