IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2405.04539.html
   My bibliography  Save this paper

Some variation of COBRA in sequential learning setup

Author

Listed:
  • Aryan Bhambu
  • Arabin Kumar Dey

Abstract

This research paper introduces innovative approaches for multivariate time series forecasting based on different variations of the combined regression strategy. We use specific data preprocessing techniques which makes a radical change in the behaviour of prediction. We compare the performance of the model based on two types of hyper-parameter tuning Bayesian optimisation (BO) and Usual Grid search. Our proposed methodologies outperform all state-of-the-art comparative models. We illustrate the methodologies through eight time series datasets from three categories: cryptocurrency, stock index, and short-term load forecasting.

Suggested Citation

  • Aryan Bhambu & Arabin Kumar Dey, 2024. "Some variation of COBRA in sequential learning setup," Papers 2405.04539, arXiv.org.
    • Handle: RePEc:arx:papers:2405.04539
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2405.04539
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Yang, Yuhong, 2000. "Combining Different Procedures for Adaptive Regression," Journal of Multivariate Analysis, Elsevier, vol. 74(1), pages 135-161, July.
    2. Abbasimehr, Hossein & Paki, Reza, 2021. "Prediction of COVID-19 confirmed cases combining deep learning methods and Bayesian optimization," Chaos, Solitons & Fractals, Elsevier, vol. 142(C).
    3. Biau, Gérard & Fischer, Aurélie & Guedj, Benjamin & Malley, James D., 2016. "COBRA: A combined regression strategy," Journal of Multivariate Analysis, Elsevier, vol. 146(C), pages 18-28.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mojirsheibani, Majid & Kong, Jiajie, 2016. "An asymptotically optimal kernel combined classifier," Statistics & Probability Letters, Elsevier, vol. 119(C), pages 91-100.
    2. Zhao, Xinxing & Li, Kainan & Ang, Candice Ke En & Cheong, Kang Hao, 2023. "A deep learning based hybrid architecture for weekly dengue incidences forecasting," Chaos, Solitons & Fractals, Elsevier, vol. 168(C).
    3. Michele Costola & Bertrand Maillet & Zhining Yuan & Xiang Zhang, 2024. "Mean–variance efficient large portfolios: a simple machine learning heuristic technique based on the two-fund separation theorem," Annals of Operations Research, Springer, vol. 334(1), pages 133-155, March.
    4. Chu-An Liu & Biing-Shen Kuo & Wen-Jen Tsay, 2017. "Autoregressive Spectral Averaging Estimator," IEAS Working Paper : academic research 17-A013, Institute of Economics, Academia Sinica, Taipei, Taiwan.
    5. Yong-Ju Jang & Min-Seung Kim & Chan-Ho Lee & Ji-Hye Choi & Jeong-Hee Lee & Sun-Hong Lee & Tae-Eung Sung, 2022. "A Novel Approach on Deep Learning—Based Decision Support System Applying Multiple Output LSTM-Autoencoder: Focusing on Identifying Variations by PHSMs’ Effect over COVID-19 Pandemic," IJERPH, MDPI, vol. 19(11), pages 1-22, June.
    6. Khan, Junaid Iqbal & Ullah, Farman & Lee, Sungchang, 2022. "Attention based parameter estimation and states forecasting of COVID-19 pandemic using modified SIQRD Model," Chaos, Solitons & Fractals, Elsevier, vol. 165(P2).
    7. Ruoyao Shi & Zhipeng Liao, 2018. "An Averaging GMM Estimator Robust to Misspecification," Working Papers 201803, University of California at Riverside, Department of Economics.
    8. Victoria Zinde-Walsh, 2008. "Consequences of lack of smoothness in nonparametric estimation (in Russian)," Quantile, Quantile, issue 4, pages 57-69, March.
    9. Li, Xin & Wu, Dongya & Li, Chong & Wang, Jinhua & Yao, Jen-Chih, 2020. "Sparse recovery via nonconvex regularized M-estimators over ℓq-balls," Computational Statistics & Data Analysis, Elsevier, vol. 152(C).
    10. Liu, Chu-An, 2015. "Distribution theory of the least squares averaging estimator," Journal of Econometrics, Elsevier, vol. 186(1), pages 142-159.
    11. Giovanni Bonaccolto & Sandra Paterlini, 2020. "Developing new portfolio strategies by aggregation," Annals of Operations Research, Springer, vol. 292(2), pages 933-971, September.
    12. Shou-Yung Yin & Chu-An Liu & Chang-Ching Lin, 2021. "Focused Information Criterion and Model Averaging for Large Panels With a Multifactor Error Structure," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 39(1), pages 54-68, January.
    13. Shruti Sharma & Yogesh Kumar Gupta & Abhinava K. Mishra, 2023. "Analysis and Prediction of COVID-19 Multivariate Data Using Deep Ensemble Learning Methods," IJERPH, MDPI, vol. 20(11), pages 1-23, May.
    14. Tsay, Wen-Jen, 2021. "Estimating cartel damages with model averaging approaches," International Review of Law and Economics, Elsevier, vol. 68(C).
    15. Zhang, Xinyu & Liu, Chu-An, 2023. "Model averaging prediction by K-fold cross-validation," Journal of Econometrics, Elsevier, vol. 235(1), pages 280-301.
    16. Xue-Bo Jin & Wei-Zhen Zheng & Jian-Lei Kong & Xiao-Yi Wang & Yu-Ting Bai & Ting-Li Su & Seng Lin, 2021. "Deep-Learning Forecasting Method for Electric Power Load via Attention-Based Encoder-Decoder with Bayesian Optimization," Energies, MDPI, vol. 14(6), pages 1-18, March.
    17. Miaomiao Wang & Xinyu Zhang & Alan T. K. Wan & Kang You & Guohua Zou, 2023. "Jackknife model averaging for high‐dimensional quantile regression," Biometrics, The International Biometric Society, vol. 79(1), pages 178-189, March.
    18. Pötscher, Benedikt M., 2006. "The Distribution of Model Averaging Estimators and an Impossibility Result Regarding Its Estimation," MPRA Paper 73, University Library of Munich, Germany, revised Jul 2006.
    19. Ali, Furqan & Ullah, Farman & Khan, Junaid Iqbal & Khan, Jebran & Sardar, Abdul Wasay & Lee, Sungchang, 2023. "COVID-19 spread control policies based early dynamics forecasting using deep learning algorithm," Chaos, Solitons & Fractals, Elsevier, vol. 167(C).
    20. Narayanaswamy Balakrishnan & Majid Mojirsheibani, 2015. "A simple method for combining estimates to improve the overall error rates in classification," Computational Statistics, Springer, vol. 30(4), pages 1033-1049, December.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2405.04539. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.