IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v16y2023i2p966-d1036404.html
   My bibliography  Save this article

Forecasting Energy Consumption of a Public Building Using Transformer and Support Vector Regression

Author

Listed:
  • Junhui Huang

    (Department of Civil Engineering, School of Engineering, University of Birmingham, Birmingham B15 2TT, UK)

  • Sakdirat Kaewunruen

    (Department of Civil Engineering, School of Engineering, University of Birmingham, Birmingham B15 2TT, UK)

Abstract

Most of the Artificial Intelligence (AI) models currently used in energy forecasting are traditional and deterministic. Recently, a novel deep learning paradigm, called ‘transformer’, has been developed, which adopts the mechanism of self-attention. Transformers are designed to better process and predict sequential data sets (i.e., historical time records) as well as to track any relationship in the sequential data. So far, a few transformer-based applications have been established, but no industry-scale application exists to build energy forecasts. Accordingly, this study is the world’s first to establish a transformer-based model to estimate the energy consumption of a real-scale university library and benchmark with a baseline model (Support Vector Regression) SVR. With a large dataset from 1 September 2017 to 13 November 2021 with 30 min granularity, the results using four historical electricity readings to estimate one future reading demonstrate that the SVR (an R 2 of 0.92) presents superior performance than the transformer-based model (an R 2 of 0.82). Across the sensitivity analysis, the SVR model is more sensitive to the input close to the output. These findings provide new insights into the research area of energy forecasting in either a specific building or a building cluster in a city. The influences of the number of inputs and outputs related to the transformer-based model will be investigated in the future.

Suggested Citation

  • Junhui Huang & Sakdirat Kaewunruen, 2023. "Forecasting Energy Consumption of a Public Building Using Transformer and Support Vector Regression," Energies, MDPI, vol. 16(2), pages 1-15, January.
    • Handle: RePEc:gam:jeners:v:16:y:2023:i:2:p:966-:d:1036404
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/16/2/966/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/1996-1073/16/2/966/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Xiang, Xiwang & Ma, Minda & Ma, Xin & Chen, Liming & Cai, Weiguang & Feng, Wei & Ma, Zhili, 2022. "Historical decarbonization of global commercial building operations in the 21st century," Applied Energy, Elsevier, vol. 322(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Hanif, M.F. & Mi, J., 2024. "Harnessing AI for solar energy: Emergence of transformer models," Applied Energy, Elsevier, vol. 369(C).
    2. Dalia Mohammed Talat Ebrahim Ali & Violeta Motuzienė & Rasa Džiugaitė-Tumėnienė, 2024. "AI-Driven Innovations in Building Energy Management Systems: A Review of Potential Applications and Energy Savings," Energies, MDPI, vol. 17(17), pages 1-35, August.
    3. Mustafa Saglam & Catalina Spataru & Omer Ali Karaman, 2023. "Forecasting Electricity Demand in Turkey Using Optimization and Machine Learning Algorithms," Energies, MDPI, vol. 16(11), pages 1-23, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jiang, Hong-Dian & Pradhan, Basanta K. & Dong, Kangyin & Yu, Yan-Yan & Liang, Qiao-Mei, 2024. "An economy-wide impacts of multiple mitigation pathways toward carbon neutrality in China: A CGE-based analysis," Energy Economics, Elsevier, vol. 129(C).
    2. Luigi Maffei & Antonio Ciervo & Achille Perrotta & Massimiliano Masullo & Antonio Rosato, 2023. "Innovative Energy-Efficient Prefabricated Movable Buildings for Smart/Co-Working: Performance Assessment upon Varying Building Configurations," Sustainability, MDPI, vol. 15(12), pages 1-37, June.
    3. João Mello & Cristina de Lorenzo & Fco. Alberto Campos & José Villar, 2023. "Pricing and Simulating Energy Transactions in Energy Communities," Energies, MDPI, vol. 16(4), pages 1-22, February.
    4. Zou, Chenchen & Ma, Minda & Zhou, Nan & Feng, Wei & You, Kairui & Zhang, Shufan, 2023. "Toward carbon free by 2060: A decarbonization roadmap of operational residential buildings in China," Energy, Elsevier, vol. 277(C).
    5. Zhao, Congyu & Dong, Kangyin & Jiang, Hong-Dian & Wang, Kun & Dong, Xiucheng, 2023. "How does energy poverty eradication realize the path to carbon unlocking? The case of China," Energy Economics, Elsevier, vol. 121(C).
    6. Ren, Xiaohang & Xia, Xixia & Taghizadeh-Hesary, Farhad, 2023. "Uncertainty of uncertainty and corporate green innovation—Evidence from China," Economic Analysis and Policy, Elsevier, vol. 78(C), pages 634-647.
    7. Han, Yongming & Cao, Lian & Guo, Qing & Geng, Zhiqiang & Yang, Weiyang & Fan, Jinzhen & Liu, Min, 2024. "Economy and carbon dioxide emissions effects of energy structures in China: Evidence based on a novel AHP-SBMDEA model," Energy, Elsevier, vol. 290(C).
    8. Liu, Yang & Dong, Kangyin & Jiang, Qingzhe, 2023. "Assessing energy vulnerability and its impact on carbon emissions: A global case," Energy Economics, Elsevier, vol. 119(C).
    9. Mohammad Fazle Rabbi & József Popp & Domicián Máté & Sándor Kovács, 2022. "Energy Security and Energy Transition to Achieve Carbon Neutrality," Energies, MDPI, vol. 15(21), pages 1-18, October.
    10. Zhao, Shujie & Song, Qingbin & Zhao, Dongfeng & Wang, Yongqiang, 2023. "Identifying the spatiotemporal carbon footprint of the petroleum refining industry and its mitigation potential in China," Energy, Elsevier, vol. 284(C).
    11. Abdul Hayy Haziq Mohamad & Muhamad Rias K. V. Zainuddin & Rossazana Ab-Rahim, 2023. "Does Renewable Energy Transition in the USA and China Overcome Environmental Degradation?," International Journal of Energy Economics and Policy, Econjournals, vol. 13(6), pages 234-243, November.
    12. Liu, Yang & Dong, Xiucheng & Dong, Kangyin, 2023. "Pathway to prosperity? The impact of low-carbon energy transition on China's common prosperity," Energy Economics, Elsevier, vol. 124(C).
    13. Abdul Mateen Khan & Muhammad Abubakar Tariq & Sardar Kashif Ur Rehman & Talha Saeed & Fahad K. Alqahtani & Mohamed Sherif, 2024. "BIM Integration with XAI Using LIME and MOO for Automated Green Building Energy Performance Analysis," Energies, MDPI, vol. 17(13), pages 1-36, July.
    14. Du, Ruiqing & Liu, Chun-Ho & Li, Xian-Xiang & Lin, Chuan-Yao, 2023. "Effect of local climate zone (LCZ) and building category (BC) classification on the simulation of urban climate and air-conditioning load in Hong Kong," Energy, Elsevier, vol. 271(C).
    15. Liu Yang & Bingyang Han & Zhili Ma & Ting Wang & Yingchao Lin, 2022. "Analysis of the Urban Land Use Efficiency in the New-Type Urbanization Process of China’s Yangtze River Economic Belt," IJERPH, MDPI, vol. 19(13), pages 1-22, July.
    16. Hessam Taherian & Robert W. Peters, 2023. "Advanced Active and Passive Methods in Residential Energy Efficiency," Energies, MDPI, vol. 16(9), pages 1-19, May.
    17. Maksym Koltunov & Simon Pezzutto & Adriano Bisello & Georg Lettner & Albert Hiesl & Wilfried van Sark & Atse Louwen & Eric Wilczynski, 2023. "Mapping of Energy Communities in Europe: Status Quo and Review of Existing Classifications," Sustainability, MDPI, vol. 15(10), pages 1-25, May.
    18. Movahed, Paria & Taheri, Saman & Razban, Ali, 2023. "A bi-level data-driven framework for fault-detection and diagnosis of HVAC systems," Applied Energy, Elsevier, vol. 339(C).
    19. Yuan, Hong & Ma, Minda & Zhou, Nan & Xie, Hui & Ma, Zhili & Xiang, Xiwang & Ma, Xin, 2024. "Battery electric vehicle charging in China: Energy demand and emissions trends in the 2020s," Applied Energy, Elsevier, vol. 365(C).
    20. Junwei Gao & Lingying Pan, 2022. "A System Dynamic Analysis of Urban Development Paths under Carbon Peaking and Carbon Neutrality Targets: A Case Study of Shanghai," Sustainability, MDPI, vol. 14(22), pages 1-27, November.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:16:y:2023:i:2:p:966-:d:1036404. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.