IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v195y2020ics0951832019304752.html
   My bibliography  Save this article

A machine learning approach to circumventing the curse of dimensionality in discontinuous time series machine data

Author

Listed:
  • Aremu, Oluseun Omotola
  • Hyland-Wood, David
  • McAree, Peter Ross

Abstract

The growing interest in artificial intelligence has led to current data-driven predictive maintenance (PdM) relying on machine learning (ML) algorithms. Although ML algorithms are useful for data-intensive analysis, research shows that their performance and reliability are reduced when high-dimensional data is used for training and testing. Raw machine data can be high-dimensional due to multi-sensor measurements and discontinuous due to the wide ranges of parameter variations during continuous sensor measurements. While standard dimension reduction methods such as principal component analysis are often applied to circumvent high-dimensionality, they are often unreliable when the data is discontinuous. This paper presents a ML-based dimension reduction framework to circumvent the challenges of high-dimensional discontinuous machine data. This framework minimizes discontinuity by clustering observations based on the dataset’s modality. The modality is identified using a kernel density estimation parameterized using a heat diffusion solution to the approximate mean integrated squared error. Then, low-dimension representations of each cluster are learned using Laplacian eigenmaps embedding. Finally, the original time sequence of observations across the low-dimensional clusters is used to re-index the observations into a continuous low-dimension feature set. We demonstrate the framework’s utility on common ML-based PdM analysis using the Commercial Modular Aero-Propulsion System Simulation dataset.

Suggested Citation

  • Aremu, Oluseun Omotola & Hyland-Wood, David & McAree, Peter Ross, 2020. "A machine learning approach to circumventing the curse of dimensionality in discontinuous time series machine data," Reliability Engineering and System Safety, Elsevier, vol. 195(C).
  • Handle: RePEc:eee:reensy:v:195:y:2020:i:c:s0951832019304752
    DOI: 10.1016/j.ress.2019.106706
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832019304752
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ress.2019.106706?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. An, Dawn & Choi, Joo-Ho & Kim, Nam Ho, 2013. "Prognostics 101: A tutorial for particle filter-based prognostics algorithm using Matlab," Reliability Engineering and System Safety, Elsevier, vol. 115(C), pages 161-169.
    2. Li, Xiang & Ding, Qian & Sun, Jian-Qiao, 2018. "Remaining useful life estimation in prognostics using deep convolution neural networks," Reliability Engineering and System Safety, Elsevier, vol. 172(C), pages 1-11.
    3. Listou Ellefsen, André & Bjørlykhaug, Emil & Æsøy, Vilmar & Ushakov, Sergey & Zhang, Houxiang, 2019. "Remaining useful life predictions for turbofan engine degradation using semi-supervised deep architecture," Reliability Engineering and System Safety, Elsevier, vol. 183(C), pages 240-251.
    4. Li, Xiang & Zhang, Wei & Ding, Qian, 2019. "Deep learning-based remaining useful life estimation of bearings using multi-scale feature extraction," Reliability Engineering and System Safety, Elsevier, vol. 182(C), pages 208-218.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Cao, Bohan & Yin, Qishuai & Guo, Yingying & Yang, Jin & Zhang, Laibin & Wang, Zhenquan & Tyagi, Mayank & Sun, Ting & Zhou, Xu, 2023. "Field data analysis and risk assessment of shallow gas hazards based on neural networks during industrial deep-water drilling," Reliability Engineering and System Safety, Elsevier, vol. 232(C).
    2. Braga, Joaquim A.P. & Andrade, António R., 2021. "Multivariate statistical aggregation and dimensionality reduction techniques to improve monitoring and maintenance in railways: The wheelset component," Reliability Engineering and System Safety, Elsevier, vol. 216(C).
    3. Zhang, Xinwei & Feng, Yong & Chen, Jinglong & Liu, Zijun & Wang, Jun & Huang, Hong, 2024. "Knowledge distillation-optimized two-stage anomaly detection for liquid rocket engine with missing multimodal data," Reliability Engineering and System Safety, Elsevier, vol. 241(C).
    4. Simsekler, Mecit Can Emre & Rodrigues, Clarence & Qazi, Abroon & Ellahham, Samer & Ozonoff, Al, 2021. "A comparative study of patient and staff safety evaluation using tree-based machine learning algorithms," Reliability Engineering and System Safety, Elsevier, vol. 208(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Li, Xingyu & Krivtsov, Vasiliy & Arora, Karunesh, 2022. "Attention-based deep survival model for time series data," Reliability Engineering and System Safety, Elsevier, vol. 217(C).
    2. de Pater, Ingeborg & Reijns, Arthur & Mitici, Mihaela, 2022. "Alarm-based predictive maintenance scheduling for aircraft engines with imperfect Remaining Useful Life prognostics," Reliability Engineering and System Safety, Elsevier, vol. 221(C).
    3. Zio, Enrico, 2022. "Prognostics and Health Management (PHM): Where are we and where do we (need to) go in theory and practice," Reliability Engineering and System Safety, Elsevier, vol. 218(PA).
    4. Tang, Ting & Yuan, Huimei, 2022. "A hybrid approach based on decomposition algorithm and neural network for remaining useful life prediction of lithium-ion battery," Reliability Engineering and System Safety, Elsevier, vol. 217(C).
    5. Xu, Zhaoyi & Saleh, Joseph Homer, 2021. "Machine learning for reliability engineering and safety applications: Review of current status and future opportunities," Reliability Engineering and System Safety, Elsevier, vol. 211(C).
    6. Azar, Kamyar & Hajiakhondi-Meybodi, Zohreh & Naderkhani, Farnoosh, 2022. "Semi-supervised clustering-based method for fault diagnosis and prognosis: A case study," Reliability Engineering and System Safety, Elsevier, vol. 222(C).
    7. Arias Chao, Manuel & Kulkarni, Chetan & Goebel, Kai & Fink, Olga, 2022. "Fusing physics-based and deep learning models for prognostics," Reliability Engineering and System Safety, Elsevier, vol. 217(C).
    8. Lin, Yan-Hui & Chang, Liang & Guan, Lu-Xin, 2024. "Enhanced stochastic recurrent hybrid model for RUL Predictions via Semi-supervised learning," Reliability Engineering and System Safety, Elsevier, vol. 248(C).
    9. Li, Yuanfu & Chen, Yao & Hu, Zhenchao & Zhang, Huisheng, 2023. "Remaining useful life prediction of aero-engine enabled by fusing knowledge and deep learning models," Reliability Engineering and System Safety, Elsevier, vol. 229(C).
    10. Costa, Nahuel & Sánchez, Luciano, 2022. "Variational encoding approach for interpretable assessment of remaining useful life estimation," Reliability Engineering and System Safety, Elsevier, vol. 222(C).
    11. Feiyue Deng & Yan Bi & Yongqiang Liu & Shaopu Yang, 2021. "Deep-Learning-Based Remaining Useful Life Prediction Based on a Multi-Scale Dilated Convolution Network," Mathematics, MDPI, vol. 9(23), pages 1-17, November.
    12. Fan, Linchuan & Chai, Yi & Chen, Xiaolong, 2022. "Trend attention fully convolutional network for remaining useful life estimation," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    13. Zhang, Wei & Li, Xiang & Ma, Hui & Luo, Zhong & Li, Xu, 2021. "Transfer learning using deep representation regularization in remaining useful life prediction across operating conditions," Reliability Engineering and System Safety, Elsevier, vol. 211(C).
    14. Wang, Yuan & Lei, Yaguo & Li, Naipeng & Yan, Tao & Si, Xiaosheng, 2023. "Deep multisource parallel bilinear-fusion network for remaining useful life prediction of machinery," Reliability Engineering and System Safety, Elsevier, vol. 231(C).
    15. Dehghan Shoorkand, Hassan & Nourelfath, Mustapha & Hajji, Adnène, 2024. "A hybrid CNN-LSTM model for joint optimization of production and imperfect predictive maintenance planning," Reliability Engineering and System Safety, Elsevier, vol. 241(C).
    16. He, Yuxuan & Su, Huai & Zio, Enrico & Peng, Shiliang & Fan, Lin & Yang, Zhaoming & Yang, Zhe & Zhang, Jinjun, 2023. "A systematic method of remaining useful life estimation based on physics-informed graph neural networks with multisensor data," Reliability Engineering and System Safety, Elsevier, vol. 237(C).
    17. Jiao, Ruihua & Peng, Kaixiang & Dong, Jie & Zhang, Chuanfang, 2020. "Fault monitoring and remaining useful life prediction framework for multiple fault modes in prognostics," Reliability Engineering and System Safety, Elsevier, vol. 203(C).
    18. Zhu, Qixiang & Zhou, Zheng & Li, Yasong & Yan, Ruqiang, 2024. "Contrastive BiLSTM-enabled Health Representation Learning for Remaining Useful Life Prediction," Reliability Engineering and System Safety, Elsevier, vol. 249(C).
    19. Yu, Wennian & Kim, II Yong & Mechefske, Chris, 2020. "An improved similarity-based prognostic algorithm for RUL estimation using an RNN autoencoder scheme," Reliability Engineering and System Safety, Elsevier, vol. 199(C).
    20. da Costa, Paulo Roberto de Oliveira & Akçay, Alp & Zhang, Yingqian & Kaymak, Uzay, 2020. "Remaining useful lifetime prediction via deep domain adaptation," Reliability Engineering and System Safety, Elsevier, vol. 195(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:195:y:2020:i:c:s0951832019304752. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.