IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v261y2022ipbs0360544222021557.html
   My bibliography  Save this article

Missing well logs prediction using deep learning integrated neural network with the self-attention mechanism

Author

Listed:
  • Wang, Jun
  • Cao, Junxing
  • Fu, Jingcheng
  • Xu, Hanqing

Abstract

Well logs are employed for analyzing lithology, determining formation parameters, and evaluating oil and gas reservoirs. However, in practice, well logs are often incomplete or distorted. Due to the complexity of underground structures and media heterogeneity, obtaining accurate results by using existing prediction methods is challenging. Thus, a reliable missing well logs prediction method must be developed. In this study, to estimate the missing well logs, we developed a deep learning model that combines the convolutional neural network (CNN) and bidirectional gated recurrent unit (BGRU) network with the self-attention mechanism. The proposed model comprises two modules. One module uses a CNN to extract the local morphological features of logging data, and the other one uses a BGRU to mine the variation trend and context information of logging data with depth from the output features of the CNN module. Next, the self-attention mechanism enables the network to allocate weights to highlight relevant information, thus improving the prediction accuracy. The application results on actual field data in two different areas demonstrate that the proposed model yields accurate and reliable prediction results and has feasibility and practicability.

Suggested Citation

  • Wang, Jun & Cao, Junxing & Fu, Jingcheng & Xu, Hanqing, 2022. "Missing well logs prediction using deep learning integrated neural network with the self-attention mechanism," Energy, Elsevier, vol. 261(PB).
  • Handle: RePEc:eee:energy:v:261:y:2022:i:pb:s0360544222021557
    DOI: 10.1016/j.energy.2022.125270
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544222021557
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.energy.2022.125270?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Zhi Geng & Yanfei Wang, 2020. "Author Correction: Automated design of a convolutional neural network with multi-scale filters for cost-efficient seismic data classification," Nature Communications, Nature, vol. 11(1), pages 1-1, December.
    2. Zang, Haixiang & Xu, Ruiqi & Cheng, Lilin & Ding, Tao & Liu, Ling & Wei, Zhinong & Sun, Guoqiang, 2021. "Residential load forecasting based on LSTM fusing self-attention mechanism with pooling," Energy, Elsevier, vol. 229(C).
    3. Mulashani, Alvin K. & Shen, Chuanbo & Nkurlu, Baraka M. & Mkono, Christopher N. & Kawamala, Martin, 2022. "Enhanced group method of data handling (GMDH) for permeability prediction based on the modified Levenberg Marquardt technique from well log data," Energy, Elsevier, vol. 239(PA).
    4. Zhi Geng & Yanfei Wang, 2020. "Automated design of a convolutional neural network with multi-scale filters for cost-efficient seismic data classification," Nature Communications, Nature, vol. 11(1), pages 1-11, December.
    5. Chen, Sai & Song, Yan & Ding, Yueting & Zhang, Ming & Nie, Rui, 2021. "Using long short-term memory model to study risk assessment and prediction of China’s oil import from the perspective of resilience theory," Energy, Elsevier, vol. 215(PB).
    6. Fan, Dongyan & Sun, Hai & Yao, Jun & Zhang, Kai & Yan, Xia & Sun, Zhixue, 2021. "Well production forecasting based on ARIMA-LSTM model considering manual operations," Energy, Elsevier, vol. 220(C).
    7. Peng Yao & Huaqiang Wu & Bin Gao & Jianshi Tang & Qingtian Zhang & Wenqiang Zhang & J. Joshua Yang & He Qian, 2020. "Fully hardware-implemented memristor convolutional neural network," Nature, Nature, vol. 577(7792), pages 641-646, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Yang, Jiuqiang & Lin, Niantian & Zhang, Kai & Fu, Chao & Zhang, Chong, 2024. "Transfer learning-based hybrid deep learning method for gas-bearing distribution prediction with insufficient training samples and uncertainty analysis," Energy, Elsevier, vol. 299(C).
    2. Qu, Fengtao & Liao, Hualin & Liu, Jiansheng & Wu, Tianyu & Shi, Fang & Xu, Yuqiang, 2024. "A novel well log data imputation methods with CGAN and swarm intelligence optimization," Energy, Elsevier, vol. 293(C).
    3. Wang, Jianguo & Han, Lincheng & Zhang, Xiuyu & Wang, Yingzhou & Zhang, Shude, 2023. "Electrical load forecasting based on variable T-distribution and dual attention mechanism," Energy, Elsevier, vol. 283(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Pan, Shaowei & Yang, Bo & Wang, Shukai & Guo, Zhi & Wang, Lin & Liu, Jinhua & Wu, Siyu, 2023. "Oil well production prediction based on CNN-LSTM model with self-attention mechanism," Energy, Elsevier, vol. 284(C).
    2. Yanfei Wang & Yaxin Ning & Yibo Wang, 2020. "Fractional Time Derivative Seismic Wave Equation Modeling for Natural Gas Hydrate," Energies, MDPI, vol. 13(22), pages 1-24, November.
    3. Kandpal, Bakul & Pareek, Parikshit & Verma, Ashu, 2022. "A robust day-ahead scheduling strategy for EV charging stations in unbalanced distribution grid," Energy, Elsevier, vol. 249(C).
    4. Wang, Delu & Gan, Jun & Mao, Jinqi & Chen, Fan & Yu, Lan, 2023. "Forecasting power demand in China with a CNN-LSTM model including multimodal information," Energy, Elsevier, vol. 263(PE).
    5. Djohan Bonnet & Tifenn Hirtzlin & Atreya Majumdar & Thomas Dalgaty & Eduardo Esmanhotto & Valentina Meli & Niccolo Castellani & Simon Martin & Jean-François Nodin & Guillaume Bourgeois & Jean-Michel P, 2023. "Bringing uncertainty quantification to the extreme-edge with memristor-based Bayesian neural networks," Nature Communications, Nature, vol. 14(1), pages 1-13, December.
    6. Xiangpeng Liang & Yanan Zhong & Jianshi Tang & Zhengwu Liu & Peng Yao & Keyang Sun & Qingtian Zhang & Bin Gao & Hadi Heidari & He Qian & Huaqiang Wu, 2022. "Rotating neurons for all-analog implementation of cyclic reservoir computing," Nature Communications, Nature, vol. 13(1), pages 1-11, December.
    7. Mkono, Christopher N. & Chuanbo, Shen & Mulashani, Alvin K. & Mwakipunda, Grant Charles, 2023. "Deep learning integrated approach for hydrocarbon source rock evaluation and geochemical indicators prediction in the Jurassic - Paleogene of the Mandawa basin, SE Tanzania," Energy, Elsevier, vol. 284(C).
    8. Ling, Jihong & Zhang, Bingyang & Dai, Na & Xing, Jincheng, 2023. "Coupling input feature construction methods and machine learning algorithms for hourly secondary supply temperature prediction," Energy, Elsevier, vol. 278(C).
    9. Yu, Fei & Kong, Xinxin & Yao, Wei & Zhang, Jin & Cai, Shuo & Lin, Hairong & Jin, Jie, 2024. "Dynamics analysis, synchronization and FPGA implementation of multiscroll Hopfield neural networks with non-polynomial memristor," Chaos, Solitons & Fractals, Elsevier, vol. 179(C).
    10. Alsuwian, Turki & Kousar, Farhana & Rasheed, Umbreen & Imran, Muhammad & Hussain, Fayyaz & Arif Khalil, R.M. & Algadi, Hassan & Batool, Najaf & Khera, Ejaz Ahmad & Kiran, Saira & Ashiq, Muhammad Naeem, 2021. "First principles investigation of physically conductive bridge filament formation of aluminum doped perovskite materials for neuromorphic memristive applications," Chaos, Solitons & Fractals, Elsevier, vol. 150(C).
    11. Zhu, Jizhong & Dong, Hanjiang & Zheng, Weiye & Li, Shenglin & Huang, Yanting & Xi, Lei, 2022. "Review and prospect of data-driven techniques for load forecasting in integrated energy systems," Applied Energy, Elsevier, vol. 321(C).
    12. Ruibin Mao & Bo Wen & Arman Kazemi & Yahui Zhao & Ann Franchesca Laguna & Rui Lin & Ngai Wong & Michael Niemier & X. Sharon Hu & Xia Sheng & Catherine E. Graves & John Paul Strachan & Can Li, 2022. "Experimentally validated memristive memory augmented neural network with efficient hashing and similarity search," Nature Communications, Nature, vol. 13(1), pages 1-13, December.
    13. Lu, Shixiang & Xu, Qifa & Jiang, Cuixia & Liu, Yezheng & Kusiak, Andrew, 2022. "Probabilistic load forecasting with a non-crossing sparse-group Lasso-quantile regression deep neural network," Energy, Elsevier, vol. 242(C).
    14. Chen, Sai & Ding, Yueting & Song, Yan & Zhang, Ming & Nie, Rui, 2023. "Study on China's energy system resilience under the scenarios of long-term shortage of imported oil," Energy, Elsevier, vol. 270(C).
    15. Wei, Nan & Yin, Chuang & Yin, Lihua & Tan, Jingyi & Liu, Jinyuan & Wang, Shouxi & Qiao, Weibiao & Zeng, Fanhua, 2024. "Short-term load forecasting based on WM algorithm and transfer learning model," Applied Energy, Elsevier, vol. 353(PA).
    16. Usman, Muhammad & Jahanger, Atif & Makhdum, Muhammad Sohail Amjad & Balsalobre-Lorente, Daniel & Bashir, Adnan, 2022. "How do financial development, energy consumption, natural resources, and globalization affect Arctic countries' economic growth and environmental quality? An advanced panel data simulation," Energy, Elsevier, vol. 241(C).
    17. Bin Gao & Ying Zhou & Qingtian Zhang & Shuanglin Zhang & Peng Yao & Yue Xi & Qi Liu & Meiran Zhao & Wenqiang Zhang & Zhengwu Liu & Xinyi Li & Jianshi Tang & He Qian & Huaqiang Wu, 2022. "Memristor-based analogue computing for brain-inspired sound localization with in situ training," Nature Communications, Nature, vol. 13(1), pages 1-8, December.
    18. Jiajie Tang & Jie Zhao & Hongliang Zou & Gaoyuan Ma & Jun Wu & Xu Jiang & Huaixun Zhang, 2021. "Bus Load Forecasting Method of Power System Based on VMD and Bi-LSTM," Sustainability, MDPI, vol. 13(19), pages 1-20, September.
    19. Gonçalves, Rui & Ribeiro, Vitor Miguel & Pereira, Fernando Lobo, 2023. "Variable Split Convolutional Attention: A novel Deep Learning model applied to the household electric power consumption," Energy, Elsevier, vol. 274(C).
    20. Anna Samnioti & Vassilis Gaganis, 2023. "Applications of Machine Learning in Subsurface Reservoir Simulation—A Review—Part II," Energies, MDPI, vol. 16(18), pages 1-53, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:261:y:2022:i:pb:s0360544222021557. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.