IDEAS home Printed from https://ideas.repec.org/a/spr/joinma/v34y2023i4d10.1007_s10845-021-01897-7.html
   My bibliography  Save this article

SPRBF-ABLS: a novel attention-based broad learning systems with sparse polynomial-based radial basis function neural networks

Author

Listed:
  • Jing Wang

    (Guangdong polytechnic Normal University)

  • Shubin Lyu

    (Guangdong polytechnic Normal University)

  • C. L. Philip Chen

    (University of Macau
    South China University of Technology)

  • Huimin Zhao

    (Guangdong polytechnic Normal University)

  • Zhengchun Lin

    (Guangdong polytechnic Normal University)

  • Pingsheng Quan

    (Guangdong polytechnic Normal University)

Abstract

Broad learning system (BLS) is a fast and efficient learning model. However, BLS has limited representation capacity in the feature mapping layer. Additionally, BLS lacks local mapping capability. To address these problems, a cascaded neural network framework based on a sparse polynomial-based RBF neural network and an attention-based broad learning system (SPRBF-ABLS) is proposed. We first propose a sparse polynomial weight-based RBF neural network (SPRBF) for feature mapping. Then an attention mechanism for BLS is proposed to enhance the representation capacity of BLS. The proposed model is evaluated on regression, classification, and face recognition datasets. In regression and classification experiments, the nonlinear approximation capability of the proposed model outperforms other BLS models. In face recognition experiments, the proposed model can improve the representation capacity, especially the robustness against noisy images. The experiments demonstrate the effectiveness and robustness of the proposed model.

Suggested Citation

  • Jing Wang & Shubin Lyu & C. L. Philip Chen & Huimin Zhao & Zhengchun Lin & Pingsheng Quan, 2023. "SPRBF-ABLS: a novel attention-based broad learning systems with sparse polynomial-based radial basis function neural networks," Journal of Intelligent Manufacturing, Springer, vol. 34(4), pages 1779-1794, April.
    • Handle: RePEc:spr:joinma:v:34:y:2023:i:4:d:10.1007_s10845-021-01897-7
    DOI: 10.1007/s10845-021-01897-7
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10845-021-01897-7
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s10845-021-01897-7?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Yu Mo & Qianhui Wu & Xiu Li & Biqing Huang, 2021. "Remaining useful life estimation via transformer encoder enhanced by a gated convolutional unit," Journal of Intelligent Manufacturing, Springer, vol. 32(7), pages 1997-2006, October.
    2. Dechen Yao & Hengchang Liu & Jianwei Yang & Jiao Zhang, 2021. "Implementation of a novel algorithm of wheelset and axle box concurrent fault identification based on an efficient neural network with the attention mechanism," Journal of Intelligent Manufacturing, Springer, vol. 32(3), pages 729-743, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lin, Yan-Hui & Chang, Liang & Guan, Lu-Xin, 2024. "Enhanced stochastic recurrent hybrid model for RUL Predictions via Semi-supervised learning," Reliability Engineering and System Safety, Elsevier, vol. 248(C).
    2. Li, Yuanfu & Chen, Yao & Hu, Zhenchao & Zhang, Huisheng, 2023. "Remaining useful life prediction of aero-engine enabled by fusing knowledge and deep learning models," Reliability Engineering and System Safety, Elsevier, vol. 229(C).
    3. Zhang, Jiusi & Li, Xiang & Tian, Jilun & Luo, Hao & Yin, Shen, 2023. "An integrated multi-head dual sparse self-attention network for remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 233(C).
    4. Kamei, Sayaka & Taghipour, Sharareh, 2023. "A comparison study of centralized and decentralized federated learning approaches utilizing the transformer architecture for estimating remaining useful life," Reliability Engineering and System Safety, Elsevier, vol. 233(C).
    5. Zhuang, Jichao & Jia, Minping & Ding, Yifei & Ding, Peng, 2021. "Temporal convolution-based transferable cross-domain adaptation approach for remaining useful life estimation under variable failure behaviors," Reliability Engineering and System Safety, Elsevier, vol. 216(C).
    6. Xu, Dan & Xiao, Xiaoqi & Liu, Jie & Sui, Shaobo, 2023. "Spatio-temporal degradation modeling and remaining useful life prediction under multiple operating conditions based on attention mechanism and deep learning," Reliability Engineering and System Safety, Elsevier, vol. 229(C).
    7. Hasan Tercan & Tobias Meisen, 2022. "Machine learning and deep learning based predictive quality in manufacturing: a systematic review," Journal of Intelligent Manufacturing, Springer, vol. 33(7), pages 1879-1905, October.
    8. Yang, Zaoli & Shang, Wen-Long & Zhang, Haoran & Garg, Harish & Han, Chunjia, 2022. "Assessing the green distribution transformer manufacturing process using a cloud-based q-rung orthopair fuzzy multi-criteria framework," Applied Energy, Elsevier, vol. 311(C).
    9. Qiwu Zhu & Qingyu Xiong & Zhengyi Yang & Yang Yu, 2023. "A novel feature-fusion-based end-to-end approach for remaining useful life prediction," Journal of Intelligent Manufacturing, Springer, vol. 34(8), pages 3495-3505, December.
    10. Wenyu Qu & Guici Chen & Tingting Zhang, 2022. "An Adaptive Noise Reduction Approach for Remaining Useful Life Prediction of Lithium-Ion Batteries," Energies, MDPI, vol. 15(19), pages 1-18, October.
    11. Pengcheng Xia & Yixiang Huang & Chengjin Qin & Chengliang Liu, 2024. "Towards prognostic generalization: a domain conditional invariance and specificity disentanglement network for remaining useful life prediction," Journal of Intelligent Manufacturing, Springer, vol. 35(7), pages 3459-3477, October.
    12. Shi, Jiayu & Zhong, Jingshu & Zhang, Yuxuan & Xiao, Bin & Xiao, Lei & Zheng, Yu, 2024. "A dual attention LSTM lightweight model based on exponential smoothing for remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 243(C).
    13. Han Cheng & Xianguang Kong & Qibin Wang & Hongbo Ma & Shengkang Yang & Gaige Chen, 2023. "Deep transfer learning based on dynamic domain adaptation for remaining useful life prediction under different working conditions," Journal of Intelligent Manufacturing, Springer, vol. 34(2), pages 587-613, February.
    14. Zhang, Yuru & Su, Chun & Wu, Jiajun & Liu, Hao & Xie, Mingjiang, 2024. "Trend-augmented and temporal-featured Transformer network with multi-sensor signals for remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 241(C).
    15. Chen, Dingliang & Cai, Wei & Yu, Hangjun & Wu, Fei & Qin, Yi, 2023. "A novel transfer gear life prediction method by the cross-condition health indicator and nested hierarchical binary-valued network," Reliability Engineering and System Safety, Elsevier, vol. 237(C).
    16. Shaojie Ai & Jia Song & Guobiao Cai, 2022. "Sequence-to-Sequence Remaining Useful Life Prediction of the Highly Maneuverable Unmanned Aerial Vehicle: A Multilevel Fusion Transformer Network Solution," Mathematics, MDPI, vol. 10(10), pages 1-23, May.
    17. Chen, Chong & Liu, Ying & Sun, Xianfang & Cairano-Gilfedder, Carla Di & Titmus, Scott, 2021. "An integrated deep learning-based approach for automobile maintenance prediction with GIS data," Reliability Engineering and System Safety, Elsevier, vol. 216(C).
    18. Zhang, Zhiyao & Chen, Xiaohui & Zio, Enrico & Li, Longxiao, 2023. "Multi-task learning boosted predictions of the remaining useful life of aero-engines under scenarios of working-condition shift," Reliability Engineering and System Safety, Elsevier, vol. 237(C).
    19. Chen, Xi & Wang, Hui & Lu, Siliang & Xu, Jiawen & Yan, Ruqiang, 2023. "Remaining useful life prediction of turbofan engine using global health degradation representation in federated learning," Reliability Engineering and System Safety, Elsevier, vol. 239(C).
    20. Li, Yuan & Li, Jingwei & Wang, Huanjie & Liu, Chengbao & Tan, Jie, 2024. "Knowledge enhanced ensemble method for remaining useful life prediction under variable working conditions," Reliability Engineering and System Safety, Elsevier, vol. 242(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:joinma:v:34:y:2023:i:4:d:10.1007_s10845-021-01897-7. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.