IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v12y2024i18p2923-d1481966.html
   My bibliography  Save this article

Multi-Output Bayesian Support Vector Regression Considering Dependent Outputs

Author

Listed:
  • Yanlin Wang

    (College of Systems Engineering, National University of Defense Technology, Changsha 410073, China)

  • Zhijun Cheng

    (College of Systems Engineering, National University of Defense Technology, Changsha 410073, China)

  • Zichen Wang

    (College of Systems Engineering, National University of Defense Technology, Changsha 410073, China)

Abstract

Multi-output regression aims to utilize the correlation between outputs to achieve information transfer between dependent outputs, thus improving the accuracy of predictive models. Although the Bayesian support vector machine (BSVR) can provide both the mean and the predicted variance distribution of the data to be labeled, which has a large potential application value, its standard form is unable to handle multiple outputs at the same time. To solve this problem, this paper proposes a multi-output Bayesian support vector machine model (MBSVR), which uses a covariance matrix to describe the relationship between outputs and outputs and outputs and inputs simultaneously by introducing a semiparametric latent factor model (SLFM) in BSVR, realizing knowledge transfer between outputs and improving the accuracy of the model. MBSVR integrates and optimizes the parameters in BSVR and those in SLFM through Bayesian derivation to effectively deal with the multi-output problem on the basis of inheriting the advantages of BSVR. The effectiveness of the method is verified using two function cases and four high-dimensional real-world data with multi-output.

Suggested Citation

  • Yanlin Wang & Zhijun Cheng & Zichen Wang, 2024. "Multi-Output Bayesian Support Vector Regression Considering Dependent Outputs," Mathematics, MDPI, vol. 12(18), pages 1-20, September.
    • Handle: RePEc:gam:jmathe:v:12:y:2024:i:18:p:2923-:d:1481966
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/12/18/2923/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2227-7390/12/18/2923/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Roy, Atin & Chakraborty, Subrata, 2023. "Support vector machine in structural reliability analysis: A review," Reliability Engineering and System Safety, Elsevier, vol. 233(C).
    2. Cheng, Kai & Lu, Zhenzhou, 2021. "Adaptive Bayesian support vector regression model for structural reliability analysis," Reliability Engineering and System Safety, Elsevier, vol. 206(C).
    3. Badih Ghattas & Diane Manzon, 2023. "Machine Learning Alternatives to Response Surface Models," Mathematics, MDPI, vol. 11(15), pages 1-27, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Li, Guosheng & Ma, Shuaichao & Zhang, Dequan & Yang, Leping & Zhang, Weihua & Wu, Zeping, 2024. "An efficient sequential anisotropic RBF reliability analysis method with fast cross-validation and parallelizability," Reliability Engineering and System Safety, Elsevier, vol. 241(C).
    2. Li, Chen & Wen, Jiong-Ran & Wan, Jing & Taylan, Osman & Fei, Cheng-Wei, 2024. "Adaptive directed support vector machine method for the reliability evaluation of aeroengine structure," Reliability Engineering and System Safety, Elsevier, vol. 246(C).
    3. Yu, Shui & Ren, Yuyao & Wu, Xiao & Guo, Peng & Li, Yun, 2024. "Dynamic pruning-based Bayesian support vector regression for reliability analysis," Reliability Engineering and System Safety, Elsevier, vol. 244(C).
    4. Chunyan, Ling & Jingzhe, Lei & Way, Kuo, 2022. "Bayesian support vector machine for optimal reliability design of modular systems," Reliability Engineering and System Safety, Elsevier, vol. 228(C).
    5. Dang, Chao & Wei, Pengfei & Faes, Matthias G.R. & Valdebenito, Marcos A. & Beer, Michael, 2022. "Parallel adaptive Bayesian quadrature for rare event estimation," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    6. Chen, Jun-Yu & Feng, Yun-Wen & Teng, Da & Lu, Cheng & Fei, Cheng-Wei, 2022. "Support vector machine-based similarity selection method for structural transient reliability analysis," Reliability Engineering and System Safety, Elsevier, vol. 223(C).
    7. Luo, Changqi & Zhu, Shun-Peng & Keshtegar, Behrooz & Niu, Xiaopeng & Taylan, Osman, 2023. "An enhanced uniform simulation approach coupled with SVR for efficient structural reliability analysis," Reliability Engineering and System Safety, Elsevier, vol. 237(C).
    8. Bakeer, Tammam, 2023. "General partial safety factor theory for the assessment of the reliability of nonlinear structural systems," Reliability Engineering and System Safety, Elsevier, vol. 234(C).
    9. Zhou, Tong & Peng, Yongbo, 2022. "Ensemble of metamodels-assisted probability density evolution method for structural reliability analysis," Reliability Engineering and System Safety, Elsevier, vol. 228(C).
    10. Haoyuan, Shen & Yizhong, Ma & Chenglong, Lin & Jian, Zhou & Lijun, Liu, 2023. "Hierarchical Bayesian support vector regression with model parameter calibration for reliability modeling and prediction," Reliability Engineering and System Safety, Elsevier, vol. 229(C).
    11. Jiaan Zhang & Wenxin Liu & Zhenzhen Wang & Ruiqing Fan, 2024. "Electric Vehicle Power Consumption Modelling Method Based on Improved Ant Colony Optimization-Support Vector Regression," Energies, MDPI, vol. 17(17), pages 1-17, August.
    12. Wang, Lei & Liu, Yaru & Li, Min, 2022. "Time-dependent reliability-based optimization for structural-topological configuration design under convex-bounded uncertain modeling," Reliability Engineering and System Safety, Elsevier, vol. 221(C).
    13. Chen, Xuyong & Xu, Zhifeng & Wu, Yushun & Wu, Qiaoyun, 2023. "Heuristic algorithms for reliability estimation based on breadth-first search of a grid tree," Reliability Engineering and System Safety, Elsevier, vol. 232(C).
    14. Mathpati, Yogesh Chandrakant & More, Kalpesh Sanjay & Tripura, Tapas & Nayek, Rajdip & Chakraborty, Souvik, 2023. "MAntRA: A framework for model agnostic reliability analysis," Reliability Engineering and System Safety, Elsevier, vol. 235(C).
    15. Zaher Salah & Hamza Abu Owida & Esraa Abu Elsoud & Esraa Alhenawi & Suhaila Abuowaida & Nawaf Alshdaifat, 2024. "An Effective Ensemble Approach for Preventing and Detecting Phishing Attacks in Textual Form," Future Internet, MDPI, vol. 16(11), pages 1-24, November.
    16. Zhao, Enyong & Wang, Qihan & Alamdari, Mehrisadat Makki & Gao, Wei, 2023. "Advanced virtual model assisted most probable point capturing method for engineering structures," Reliability Engineering and System Safety, Elsevier, vol. 239(C).
    17. Mehmet Kayakuş & Fatma Yiğit Açikgöz & Mirela Nicoleta Dinca & Onder Kabas, 2024. "Sustainable Brand Reputation: Evaluation of iPhone Customer Reviews with Machine Learning and Sentiment Analysis," Sustainability, MDPI, vol. 16(14), pages 1-17, July.
    18. Yu, Shui & Wu, Xiao & Zhao, Dongyu & Li, Yun, 2024. "A two-level surrogate framework for demand-objective time-variant reliability-based design optimization," Reliability Engineering and System Safety, Elsevier, vol. 244(C).
    19. Xu, Kunliang & Niu, Hongli, 2023. "Denoising or distortion: Does decomposition-reconstruction modeling paradigm provide a reliable prediction for crude oil price time series?," Energy Economics, Elsevier, vol. 128(C).
    20. Roy, Atin & Chakraborty, Subrata, 2023. "Support vector machine in structural reliability analysis: A review," Reliability Engineering and System Safety, Elsevier, vol. 233(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:12:y:2024:i:18:p:2923-:d:1481966. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.