IDEAS home Printed from https://ideas.repec.org/a/wsi/jikmxx/v23y2024i04ns021964922450045x.html
   My bibliography  Save this article

A Theoretical Study of the Representational Power of Weighted Randomised Univariate Regression Tree Ensembles

Author

Listed:
  • Amir Ahmad

    (College of Information Technology, United Arab Emirates University, Al Ain, United Arab Emirates)

  • Sami M. Halawani

    (��IT Department, Faculty of Information Technology, King Abdulaziz University, Jeddah, Saudi Arabia)

  • Ajay Kumar

    (��Computer Science and Engineering Department, Thapar Institute of Engineering and Technology, Patiala, India)

  • Arshad Hashmi

    (�Department of Information Systems, Faculty of Computing and Information Technology in Rabigh (FCITR), King Abdulaziz University, Jeddah, Saudi Arabia)

  • Mutasem Jarrah

    (��IT Department, Faculty of Information Technology, King Abdulaziz University, Jeddah, Saudi Arabia)

  • Abdul Rafey Ahmad

    (�Department of Computer Science and Engineering-Cyber Security, Indian Institute of Information Technology, Kottayam, India)

  • Zia Abbas

    (��Center for VLSI and Embedded Systems Technology (CVEST), International Institute of Information Technology, Hyderabad (IIIT-H), Gachibowli, Hyderabad 500032, India)

Abstract

Univariate regression trees have representation problems for non-orthogonal regression functions. Ensembles of univariate regression trees have better representational power. In some cases, weighted ensembles have shown better performance than unweighted ensembles. In this paper, we study the properties of ensembles of regression trees by using regression classification models. We propose a theoretical framework to study the representational power of infinite-sized weighted ensembles, consisting of randomised finite-sized regression trees. We show for some datasets that the weighted ensembles may have better representational power than unweighted ensembles, but the performance is highly dependent on the weighting scheme and the properties of datasets. Our model cannot be used for all the datasets. However, for some datasets, we can accurately predict the experimental results of ensembles of regression trees.

Suggested Citation

  • Amir Ahmad & Sami M. Halawani & Ajay Kumar & Arshad Hashmi & Mutasem Jarrah & Abdul Rafey Ahmad & Zia Abbas, 2024. "A Theoretical Study of the Representational Power of Weighted Randomised Univariate Regression Tree Ensembles," Journal of Information & Knowledge Management (JIKM), World Scientific Publishing Co. Pte. Ltd., vol. 23(04), pages 1-26, August.
    • Handle: RePEc:wsi:jikmxx:v:23:y:2024:i:04:n:s021964922450045x
    DOI: 10.1142/S021964922450045X
    as

    Download full text from publisher

    File URL: http://www.worldscientific.com/doi/abs/10.1142/S021964922450045X
    Download Restriction: Access to full text is restricted to subscribers
    File URL: https://libkey.io/10.1142/S021964922450045X?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wsi:jikmxx:v:23:y:2024:i:04:n:s021964922450045x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Tai Tone Lim (email available below). General contact details of provider: http://www.worldscinet.com/jikm/jikm.shtml .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.