IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v299y2024ics0360544224011873.html
   My bibliography  Save this article

Transfer learning-based hybrid deep learning method for gas-bearing distribution prediction with insufficient training samples and uncertainty analysis

Author

Listed:
  • Yang, Jiuqiang
  • Lin, Niantian
  • Zhang, Kai
  • Fu, Chao
  • Zhang, Chong

Abstract

The availability of sample data, required for seismicity-based reservoir prediction using deep learning (DL), is often limited by well availability. To alleviate this problem, this study proposes a hybrid DL method combining unsupervised learning, transfer learning (TL), and intelligent optimization algorithms to predict gas-bearing distributions. First, three unsupervised learning methods were used to optimize multicomponent seismic attribute data during preprocessing and improve the sample data quality. Subsequently, a convolutional neural network (CNN) model was pre-trained using synthetic data, and the adaptive mutation particle swarm optimization (AMPSO) algorithm was used to optimize the hyperparameters of the CNN model during training to obtain the AMPSO-CNN model. Finally, the partial convolutional layer parameters of the pre-trained network were transferred, and the remaining parameters were adjusted using real data samples to obtain the TL-AMPSO-CNN model. The trained model was used for gas-bearing distribution prediction, and its stability was assessed using uncertainty analysis. The results confirmed that the hybrid DL model performed efficiently in gas-bearing prediction compared to other individual models. Thus, for datasets with insufficient training samples, the proposed scheme can be applied as a feasible alternative to predict gas-bearing distribution.

Suggested Citation

  • Yang, Jiuqiang & Lin, Niantian & Zhang, Kai & Fu, Chao & Zhang, Chong, 2024. "Transfer learning-based hybrid deep learning method for gas-bearing distribution prediction with insufficient training samples and uncertainty analysis," Energy, Elsevier, vol. 299(C).
  • Handle: RePEc:eee:energy:v:299:y:2024:i:c:s0360544224011873
    DOI: 10.1016/j.energy.2024.131414
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544224011873
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.energy.2024.131414?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Vo Thanh, Hung & Sheini Dashtgoli, Danial & Zhang, Hemeng & Min, Baehyun, 2023. "Machine-learning-based prediction of oil recovery factor for experimental CO2-Foam chemical EOR: Implications for carbon utilization projects," Energy, Elsevier, vol. 278(PA).
    2. Hu, Yusha & Li, Jigeng & Hong, Mengna & Ren, Jingzheng & Lin, Ruojue & Liu, Yue & Liu, Mengru & Man, Yi, 2019. "Short term electric load forecasting model and its verification for process industrial enterprises based on hybrid GA-PSO-BPNN algorithm—A case study of papermaking process," Energy, Elsevier, vol. 170(C), pages 1215-1227.
    3. Qu, Baolin & Zhu, Hongqing & Tian, Rui & Hu, Lintao & Wang, Jingxin & Liao, Qi & Gao, Rongxiang & Wang, Haoran, 2023. "Investigation of the impact of pyrite content on the terahertz dielectric response of coals and rapid recognition with kernel-SVM," Energy, Elsevier, vol. 285(C).
    4. Wang, Jun & Cao, Junxing & Fu, Jingcheng & Xu, Hanqing, 2022. "Missing well logs prediction using deep learning integrated neural network with the self-attention mechanism," Energy, Elsevier, vol. 261(PB).
    5. Zha, Wenshu & Liu, Yuping & Wan, Yujin & Luo, Ruilan & Li, Daolun & Yang, Shan & Xu, Yanmei, 2022. "Forecasting monthly gas field production based on the CNN-LSTM model," Energy, Elsevier, vol. 260(C).
    6. Wang, Sen & Qin, Chaoxu & Feng, Qihong & Javadpour, Farzam & Rui, Zhenhua, 2021. "A framework for predicting the production performance of unconventional resources using deep learning," Applied Energy, Elsevier, vol. 295(C).
    7. Wang, Jun & Cao, Junxing & Yuan, Shan & Cheng, Ming, 2021. "Short-term forecasting of natural gas prices by using a novel hybrid method based on a combination of the CEEMDAN-SE-and the PSO-ALS-optimized GRU network," Energy, Elsevier, vol. 233(C).
    8. Marugán, Alberto Pliego & Márquez, Fausto Pedro García & Perez, Jesus María Pinar & Ruiz-Hernández, Diego, 2018. "A survey of artificial neural network in wind energy systems," Applied Energy, Elsevier, vol. 228(C), pages 1822-1836.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zhang, Yagang & Pan, Zhiya & Wang, Hui & Wang, Jingchao & Zhao, Zheng & Wang, Fei, 2023. "Achieving wind power and photovoltaic power prediction: An intelligent prediction system based on a deep learning approach," Energy, Elsevier, vol. 283(C).
    2. Shi, Changfeng & Zhi, Jiaqi & Yao, Xiao & Zhang, Hong & Yu, Yue & Zeng, Qingshun & Li, Luji & Zhang, Yuxi, 2023. "How can China achieve the 2030 carbon peak goal—a crossover analysis based on low-carbon economics and deep learning," Energy, Elsevier, vol. 269(C).
    3. Faramarz Saghi & Mustafa Jahangoshai Rezaee, 2023. "Integrating Wavelet Decomposition and Fuzzy Transformation for Improving the Accuracy of Forecasting Crude Oil Price," Computational Economics, Springer;Society for Computational Economics, vol. 61(2), pages 559-591, February.
    4. Dimitrios Mouchtaris & Emmanouil Sofianos & Periklis Gogas & Theophilos Papadimitriou, 2021. "Forecasting Natural Gas Spot Prices with Machine Learning," Energies, MDPI, vol. 14(18), pages 1-13, September.
    5. Oleksandr Castello & Marina Resta, 2023. "A Machine-Learning-Based Approach for Natural Gas Futures Curve Modeling," Energies, MDPI, vol. 16(12), pages 1-22, June.
    6. Yu, Ruyang & Zhang, Kai & Ramasubramanian, Brindha & Jiang, Shu & Ramakrishna, Seeram & Tang, Yuhang, 2024. "Ensemble learning for predicting average thermal extraction load of a hydrothermal geothermal field: A case study in Guanzhong Basin, China," Energy, Elsevier, vol. 296(C).
    7. Qin Lu & Jingwen Liao & Kechi Chen & Yanhui Liang & Yu Lin, 2024. "Predicting Natural Gas Prices Based on a Novel Hybrid Model with Variational Mode Decomposition," Computational Economics, Springer;Society for Computational Economics, vol. 63(2), pages 639-678, February.
    8. Stefenon, Stefano Frizzo & Seman, Laio Oriel & Aquino, Luiza Scapinello & Coelho, Leandro dos Santos, 2023. "Wavelet-Seq2Seq-LSTM with attention for time series forecasting of level of dams in hydroelectric power plants," Energy, Elsevier, vol. 274(C).
    9. Aniket Vatsa & Ananda Shankar Hati & Vadim Bolshev & Alexander Vinogradov & Vladimir Panchenko & Prasun Chakrabarti, 2023. "Deep Learning-Based Transformer Moisture Diagnostics Using Long Short-Term Memory Networks," Energies, MDPI, vol. 16(5), pages 1-14, March.
    10. Akhter, Muhammad Naveed & Mekhilef, Saad & Mokhlis, Hazlie & Ali, Raza & Usama, Muhammad & Muhammad, Munir Azam & Khairuddin, Anis Salwa Mohd, 2022. "A hybrid deep learning method for an hour ahead power output forecasting of three different photovoltaic systems," Applied Energy, Elsevier, vol. 307(C).
    11. Moreno, Sinvaldo Rodrigues & Seman, Laio Oriel & Stefenon, Stefano Frizzo & Coelho, Leandro dos Santos & Mariani, Viviana Cocco, 2024. "Enhancing wind speed forecasting through synergy of machine learning, singular spectral analysis, and variational mode decomposition," Energy, Elsevier, vol. 292(C).
    12. Shichao Huang & Jing Zhang & Yu He & Xiaofan Fu & Luqin Fan & Gang Yao & Yongjun Wen, 2022. "Short-Term Load Forecasting Based on the CEEMDAN-Sample Entropy-BPNN-Transformer," Energies, MDPI, vol. 15(10), pages 1-14, May.
    13. Wang, Sen & Qin, Chaoxu & Feng, Qihong & Javadpour, Farzam & Rui, Zhenhua, 2021. "A framework for predicting the production performance of unconventional resources using deep learning," Applied Energy, Elsevier, vol. 295(C).
    14. Hu, Yusha & Man, Yi, 2022. "Two-stage energy scheduling optimization model for complex industrial process and its industrial verification," Renewable Energy, Elsevier, vol. 193(C), pages 879-894.
    15. Rosato, Antonello & Panella, Massimo & Andreotti, Amedeo & Mohammed, Osama A. & Araneo, Rodolfo, 2021. "Two-stage dynamic management in energy communities using a decision system based on elastic net regularization," Applied Energy, Elsevier, vol. 291(C).
    16. Qihong Feng & Kuankuan Wu & Jiyuan Zhang & Sen Wang & Xianmin Zhang & Daiyu Zhou & An Zhao, 2022. "Optimization of Well Control during Gas Flooding Using the Deep-LSTM-Based Proxy Model: A Case Study in the Baoshaceng Reservoir, Tarim, China," Energies, MDPI, vol. 15(7), pages 1-14, March.
    17. Karla Schröder & Gonzalo Farias & Sebastián Dormido-Canto & Ernesto Fabregas, 2024. "Comparative Analysis of Deep Learning Methods for Fault Avoidance and Predicting Demand in Electrical Distribution," Energies, MDPI, vol. 17(11), pages 1-13, June.
    18. Niu, Wente & Lu, Jialiang & Sun, Yuping & Zhang, Xiaowei & Li, Qiaojing & Cao, Xu & Liang, Pingping & Zhan, Hongming, 2024. "Techno-economic integration evaluation in shale gas development based on ensemble learning," Applied Energy, Elsevier, vol. 357(C).
    19. Fuquan Song & Heying Ding & Yongzheng Wang & Shiming Zhang & Jinbiao Yu, 2023. "A Well Production Prediction Method of Tight Reservoirs Based on a Hybrid Neural Network," Energies, MDPI, vol. 16(6), pages 1-22, March.
    20. Zhang, Dongxue & Wang, Shuai & Liang, Yuqiu & Du, Zhiyuan, 2023. "A novel combined model for probabilistic load forecasting based on deep learning and improved optimizer," Energy, Elsevier, vol. 264(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:299:y:2024:i:c:s0360544224011873. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.