IDEAS home Printed from https://ideas.repec.org/a/gam/jftint/v15y2023i6p199-d1160086.html
   My bibliography  Save this article

Deep Neural Networks for Spatial-Temporal Cyber-Physical Systems: A Survey

Author

Listed:
  • Abubakar Ahmad Musa

    (Department of Computer and Information Sciences, Towson University, Towson, MD 21252, USA)

  • Adamu Hussaini

    (Department of Computer and Information Sciences, Towson University, Towson, MD 21252, USA)

  • Weixian Liao

    (Department of Computer and Information Sciences, Towson University, Towson, MD 21252, USA)

  • Fan Liang

    (Department of Computer Science, Sam Houston State University, Huntsville, TX 77340, USA)

  • Wei Yu

    (Department of Computer and Information Sciences, Towson University, Towson, MD 21252, USA)

Abstract

Cyber-physical systems (CPS) refer to systems that integrate communication, control, and computational elements into physical processes to facilitate the control of physical systems and effective monitoring. The systems are designed to interact with the physical world, monitor and control the physical processes while in operation, and generate data. Deep Neural Networks (DNN) comprise multiple layers of interconnected neurons that process input data to produce predictions. Spatial-temporal data represents the physical world and its evolution over time and space. The generated spatial-temporal data is used to make decisions and control the behavior of CPS. This paper systematically reviews the applications of DNNs, namely convolutional, recurrent, and graphs, in handling spatial-temporal data in CPS. An extensive literature survey is conducted to determine the areas in which DNNs have successfully captured spatial-temporal data in CPS and the emerging areas that require attention. The research proposes a three-dimensional framework that considers: CPS (transportation, manufacturing, and others), Target (spatial-temporal data processing, anomaly detection, predictive maintenance, resource allocation, real-time decisions, and multi-modal data fusion), and DNN schemes (CNNs, RNNs, and GNNs). Finally, research areas that need further investigation are identified, such as performance and security. Addressing data quality, strict performance assurance, reliability, safety, and security resilience challenges are the areas that are required for further research.

Suggested Citation

  • Abubakar Ahmad Musa & Adamu Hussaini & Weixian Liao & Fan Liang & Wei Yu, 2023. "Deep Neural Networks for Spatial-Temporal Cyber-Physical Systems: A Survey," Future Internet, MDPI, vol. 15(6), pages 1-24, May.
    • Handle: RePEc:gam:jftint:v:15:y:2023:i:6:p:199-:d:1160086
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1999-5903/15/6/199/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/1999-5903/15/6/199/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Kim, Tae-Young & Cho, Sung-Bae, 2019. "Predicting residential energy consumption using CNN-LSTM neural networks," Energy, Elsevier, vol. 182(C), pages 72-81.
    2. Matthew Kupilik & Frank Witmer, 2018. "Spatio-temporal violent event prediction using Gaussian process regression," Journal of Computational Social Science, Springer, vol. 1(2), pages 437-451, September.
    3. Li, Tianfu & Zhao, Zhibin & Sun, Chuang & Yan, Ruqiang & Chen, Xuefeng, 2021. "Hierarchical attention graph convolutional network to fuse multi-sensor signals for remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 215(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lan, Puzhe & Han, Dong & Xu, Xiaoyuan & Yan, Zheng & Ren, Xijun & Xia, Shiwei, 2022. "Data-driven state estimation of integrated electric-gas energy system," Energy, Elsevier, vol. 252(C).
    2. Ijaz Ul Haq & Amin Ullah & Samee Ullah Khan & Noman Khan & Mi Young Lee & Seungmin Rho & Sung Wook Baik, 2021. "Sequential Learning-Based Energy Consumption Prediction Model for Residential and Commercial Sectors," Mathematics, MDPI, vol. 9(6), pages 1-17, March.
    3. Lu, Yakai & Tian, Zhe & Zhou, Ruoyu & Liu, Wenjing, 2021. "A general transfer learning-based framework for thermal load prediction in regional energy system," Energy, Elsevier, vol. 217(C).
    4. Sun, Hongchang & Niu, Yanlei & Li, Chengdong & Zhou, Changgeng & Zhai, Wenwen & Chen, Zhe & Wu, Hao & Niu, Lanqiang, 2022. "Energy consumption optimization of building air conditioning system via combining the parallel temporal convolutional neural network and adaptive opposition-learning chimp algorithm," Energy, Elsevier, vol. 259(C).
    5. Luo, X.J. & Oyedele, Lukumon O. & Ajayi, Anuoluwapo O. & Akinade, Olugbenga O. & Owolabi, Hakeem A. & Ahmed, Ashraf, 2020. "Feature extraction and genetic algorithm enhanced adaptive deep neural network for energy consumption prediction in buildings," Renewable and Sustainable Energy Reviews, Elsevier, vol. 131(C).
    6. Namrye Son, 2021. "Comparison of the Deep Learning Performance for Short-Term Power Load Forecasting," Sustainability, MDPI, vol. 13(22), pages 1-25, November.
    7. Chang, Yuanhong & Li, Fudong & Chen, Jinglong & Liu, Yulang & Li, Zipeng, 2022. "Efficient temporal flow Transformer accompanied with multi-head probsparse self-attention mechanism for remaining useful life prognostics," Reliability Engineering and System Safety, Elsevier, vol. 226(C).
    8. Zizhen Cheng & Li Wang & Yumeng Yang, 2023. "A Hybrid Feature Pyramid CNN-LSTM Model with Seasonal Inflection Month Correction for Medium- and Long-Term Power Load Forecasting," Energies, MDPI, vol. 16(7), pages 1-18, March.
    9. Hyunsoo Kim & Jiseok Jeong & Changwan Kim, 2022. "Daily Peak-Electricity-Demand Forecasting Based on Residual Long Short-Term Network," Mathematics, MDPI, vol. 10(23), pages 1-17, November.
    10. Khan, Zulfiqar Ahmad & Khan, Shabbir Ahmad & Hussain, Tanveer & Baik, Sung Wook, 2024. "DSPM: Dual sequence prediction model for efficient energy management in micro-grid," Applied Energy, Elsevier, vol. 356(C).
    11. Guillaume Guerard & Hugo Pousseur & Ihab Taleb, 2021. "Isolated Areas Consumption Short-Term Forecasting Method," Energies, MDPI, vol. 14(23), pages 1-23, November.
    12. Lu, Renzhi & Bai, Ruichang & Ding, Yuemin & Wei, Min & Jiang, Junhui & Sun, Mingyang & Xiao, Feng & Zhang, Hai-Tao, 2021. "A hybrid deep learning-based online energy management scheme for industrial microgrid," Applied Energy, Elsevier, vol. 304(C).
    13. Byung-Ki Jeon & Eui-Jong Kim, 2021. "LSTM-Based Model Predictive Control for Optimal Temperature Set-Point Planning," Sustainability, MDPI, vol. 13(2), pages 1-14, January.
    14. Li, Ao & Xiao, Fu & Zhang, Chong & Fan, Cheng, 2021. "Attention-based interpretable neural network for building cooling load prediction," Applied Energy, Elsevier, vol. 299(C).
    15. Gu, Xinyu & See, K.W. & Li, Penghua & Shan, Kangheng & Wang, Yunpeng & Zhao, Liang & Lim, Kai Chin & Zhang, Neng, 2023. "A novel state-of-health estimation for the lithium-ion battery using a convolutional neural network and transformer model," Energy, Elsevier, vol. 262(PB).
    16. Mario Tovar & Miguel Robles & Felipe Rashid, 2020. "PV Power Prediction, Using CNN-LSTM Hybrid Neural Network Model. Case of Study: Temixco-Morelos, México," Energies, MDPI, vol. 13(24), pages 1-15, December.
    17. Lyu, Dongzhen & Niu, Guangxing & Liu, Enhui & Zhang, Bin & Chen, Gang & Yang, Tao & Zio, Enrico, 2022. "Time space modelling for fault diagnosis and prognosis with uncertainty management: A general theoretical formulation," Reliability Engineering and System Safety, Elsevier, vol. 226(C).
    18. Rob Shipman & Rebecca Roberts & Julie Waldron & Chris Rimmer & Lucelia Rodrigues & Mark Gillott, 2021. "Online Machine Learning of Available Capacity for Vehicle-to-Grid Services during the Coronavirus Pandemic," Energies, MDPI, vol. 14(21), pages 1-16, November.
    19. Niu, Zhibin & Wu, Junqi & Liu, Xiufeng & Huang, Lizhen & Nielsen, Per Sieverts, 2021. "Understanding energy demand behaviors through spatio-temporal smart meter data analysis," Energy, Elsevier, vol. 226(C).
    20. Chongchong Xu & Zhicheng Liao & Chaojie Li & Xiaojun Zhou & Renyou Xie, 2022. "Review on Interpretable Machine Learning in Smart Grid," Energies, MDPI, vol. 15(12), pages 1-31, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jftint:v:15:y:2023:i:6:p:199-:d:1160086. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.