IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v18y2025i6p1432-d1611714.html
   My bibliography  Save this article

A Hybrid ARIMA-LSTM-XGBoost Model with Linear Regression Stacking for Transformer Oil Temperature Prediction

Author

Listed:
  • Xuemin Huang

    (China Southern Power Grid Extra-High Voltage Transmission Company, Guangzhou Bureau, Guangzhou 510663, China)

  • Xiaoliang Zhuang

    (China Southern Power Grid Extra-High Voltage Transmission Company, Guangzhou Bureau, Guangzhou 510663, China)

  • Fangyuan Tian

    (China Southern Power Grid Extra-High Voltage Transmission Company, Guangzhou Bureau, Guangzhou 510663, China)

  • Zheng Niu

    (China Southern Power Grid Extra-High Voltage Transmission Company, Guangzhou Bureau, Guangzhou 510663, China)

  • Yujie Chen

    (School of Electrical and Information Engineering, Hunan University, Changsha 410082, China)

  • Qian Zhou

    (School of Electrical and Information Engineering, Hunan University, Changsha 410082, China)

  • Chao Yuan

    (School of Electrical and Information Engineering, Hunan University, Changsha 410082, China)

Abstract

Transformers are essential for voltage regulation and power distribution in electrical systems, and monitoring their top-oil temperature is crucial for detecting potential faults. High oil temperatures are directly linked to insulation degradation, a primary cause of transformer failures. Therefore, accurate oil temperature prediction is important for proactive maintenance and preventing failures. This paper proposes a hybrid time series forecasting model combining ARIMA, LSTM, and XGBoost to predict transformer oil temperature. ARIMA captures linear components of the data, while LSTM models complex nonlinear dependencies. XGBoost is used to predict the overall oil temperature by learning from the complete dataset, effectively handling complex patterns. The predictions of these three models are combined through a linear-regression stacking approach, improving accuracy and simplifying the model structure. This hybrid method outperforms traditional models, offering superior performance in predicting transformer oil temperature, which enhances fault detection and transformer reliability. Experimental results demonstrate the hybrid model’s superiority: In 5000-data-point prediction, it achieves an MSE = 0.9908 and MAPE = 1.9824%, outperforming standalone XGBoost (MSE = 3.2001) by 69.03% in error reduction and ARIMA-LSTM (MSE = 1.1268) by 12.08%, while surpassing naïve methods 1–2 (MSE = 1.7370–1.6716) by 42.94–40.74%. For 500-data-point scenarios, the hybrid model (MSE = 1.9174) maintains 22.40–35.53% lower errors than XGBoost (2.4710) and ARIMA-LSTM (3.6481) and outperforms naïve methods 1–2 (2.8611–2.9741) by 32.97–35.53%. These results validate the approach’s effectiveness across data scales. The proposed method contributes to more effective predictive maintenance and improved safety, ensuring the long-term performance of transformer equipment.

Suggested Citation

  • Xuemin Huang & Xiaoliang Zhuang & Fangyuan Tian & Zheng Niu & Yujie Chen & Qian Zhou & Chao Yuan, 2025. "A Hybrid ARIMA-LSTM-XGBoost Model with Linear Regression Stacking for Transformer Oil Temperature Prediction," Energies, MDPI, vol. 18(6), pages 1-22, March.
  • Handle: RePEc:gam:jeners:v:18:y:2025:i:6:p:1432-:d:1611714
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/18/6/1432/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/1996-1073/18/6/1432/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Meysam Beheshti Asl & Issouf Fofana & Fethi Meghnefi, 2024. "Review of Various Sensor Technologies in Monitoring the Condition of Power Transformers," Energies, MDPI, vol. 17(14), pages 1-40, July.
    2. Smyl, Slawek, 2020. "A hybrid method of exponential smoothing and recurrent neural networks for time series forecasting," International Journal of Forecasting, Elsevier, vol. 36(1), pages 75-85.
    3. Zhengping Liang & Yan Fang & Hao Cheng & Yongbin Sun & Bo Li & Kai Li & Wenxuan Zhao & Zhongxu Sun & Yiyi Zhang, 2024. "Innovative Transformer Life Assessment Considering Moisture and Oil Circulation," Energies, MDPI, vol. 17(2), pages 1-21, January.
    4. Mizuho Nishio & Mitsuo Nishizawa & Osamu Sugiyama & Ryosuke Kojima & Masahiro Yakami & Tomohiro Kuroda & Kaori Togashi, 2018. "Computer-aided diagnosis of lung nodule using gradient tree boosting and Bayesian optimization," PLOS ONE, Public Library of Science, vol. 13(4), pages 1-13, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hewamalage, Hansika & Bergmeir, Christoph & Bandara, Kasun, 2021. "Recurrent Neural Networks for Time Series Forecasting: Current status and future directions," International Journal of Forecasting, Elsevier, vol. 37(1), pages 388-427.
    2. Spiliotis, Evangelos & Makridakis, Spyros & Kaltsounis, Anastasios & Assimakopoulos, Vassilios, 2021. "Product sales probabilistic forecasting: An empirical evaluation using the M5 competition data," International Journal of Production Economics, Elsevier, vol. 240(C).
    3. Feng, Zhanyu & Zhang, Jian & Jiang, Han & Yao, Xuejian & Qian, Yu & Zhang, Haiyan, 2024. "Energy consumption prediction strategy for electric vehicle based on LSTM-transformer framework," Energy, Elsevier, vol. 302(C).
    4. Oreshkin, Boris N. & Dudek, Grzegorz & Pełka, Paweł & Turkina, Ekaterina, 2021. "N-BEATS neural network for mid-term electricity load forecasting," Applied Energy, Elsevier, vol. 293(C).
    5. Bojer, Casper Solheim & Meldgaard, Jens Peder, 2021. "Kaggle forecasting competitions: An overlooked learning opportunity," International Journal of Forecasting, Elsevier, vol. 37(2), pages 587-603.
    6. Meysam Beheshti Asl & Issouf Fofana & Fethi Meghnefi & Youssouf Brahami & Joao Pedro Da Costa Souza, 2025. "A Comprehensive Review of Transformer Winding Diagnostics: Integrating Frequency Response Analysis with Machine Learning Approaches," Energies, MDPI, vol. 18(5), pages 1-38, March.
    7. Winita Sulandari & Yudho Yudhanto & Sri Subanti & Crisma Devika Setiawan & Riskhia Hapsari & Paulo Canas Rodrigues, 2023. "Comparing the Simple to Complex Automatic Methods with the Ensemble Approach in Forecasting Electrical Time Series Data," Energies, MDPI, vol. 16(22), pages 1-16, November.
    8. Nghia Chu & Binh Dao & Nga Pham & Huy Nguyen & Hien Tran, 2022. "Predicting Mutual Funds' Performance using Deep Learning and Ensemble Techniques," Papers 2209.09649, arXiv.org, revised Jul 2023.
    9. You-Shyang Chen & Arun Kumar Sangaiah & Yu-Pei Lin, 2024. "Hyperautomation on fuzzy data dredging on four advanced industrial forecasting models to support sustainable business management," Annals of Operations Research, Springer, vol. 342(1), pages 215-264, November.
    10. Hector F. Calvo-Pardo & Tullio Mancini & Jose Olmo, 2020. "Neural Network Models for Empirical Finance," JRFM, MDPI, vol. 13(11), pages 1-22, October.
    11. Dag Tjøstheim & Martin Jullum & Anders Løland, 2023. "Some recent trends in embeddings of time series and dynamic networks," Journal of Time Series Analysis, Wiley Blackwell, vol. 44(5-6), pages 686-709, September.
    12. Md. Iftekharul Alam Efat & Petr Hajek & Mohammad Zoynul Abedin & Rahat Uddin Azad & Md. Al Jaber & Shuvra Aditya & Mohammad Kabir Hassan, 2024. "Deep-learning model using hybrid adaptive trend estimated series for modelling and forecasting sales," Annals of Operations Research, Springer, vol. 339(1), pages 297-328, August.
    13. Paolo Libenzio Brignoli & Alessandro Varacca & Cornelis Gardebroek & Paolo Sckokai, 2024. "Machine learning to predict grains futures prices," Agricultural Economics, International Association of Agricultural Economists, vol. 55(3), pages 479-497, May.
    14. Makridakis, Spyros & Spiliotis, Evangelos & Assimakopoulos, Vassilios & Chen, Zhi & Gaba, Anil & Tsetlin, Ilia & Winkler, Robert L., 2022. "The M5 uncertainty competition: Results, findings and conclusions," International Journal of Forecasting, Elsevier, vol. 38(4), pages 1365-1385.
    15. Ruben Loaiza‐Maya & Gael M. Martin & David T. Frazier, 2021. "Focused Bayesian prediction," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 36(5), pages 517-543, August.
    16. Bojer, Casper Solheim, 2022. "Understanding machine learning-based forecasting methods: A decomposition framework and research opportunities," International Journal of Forecasting, Elsevier, vol. 38(4), pages 1555-1561.
    17. Stefenon, Stefano Frizzo & Seman, Laio Oriel & Aquino, Luiza Scapinello & Coelho, Leandro dos Santos, 2023. "Wavelet-Seq2Seq-LSTM with attention for time series forecasting of level of dams in hydroelectric power plants," Energy, Elsevier, vol. 274(C).
    18. Wellens, Arnoud P. & Boute, Robert N. & Udenio, Maximiliano, 2024. "Simplifying tree-based methods for retail sales forecasting with explanatory variables," European Journal of Operational Research, Elsevier, vol. 314(2), pages 523-539.
    19. Makridakis, Spyros & Spiliotis, Evangelos & Assimakopoulos, Vassilios, 2020. "The M4 Competition: 100,000 time series and 61 forecasting methods," International Journal of Forecasting, Elsevier, vol. 36(1), pages 54-74.
    20. Wookjae Heo & Eunchan Kim, 2025. "Smoothing the Subjective Financial Risk Tolerance: Volatility and Market Implications," Mathematics, MDPI, vol. 13(4), pages 1-34, February.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:18:y:2025:i:6:p:1432-:d:1611714. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.