IDEAS home Printed from https://ideas.repec.org/p/osf/osfxxx/ny6we.html
   My bibliography  Save this paper

Mixed-Effects Frequency-Adjusted Borders Ordinal Forest: A Tree Ensemble Method for Ordinal Prediction with Hierarchical Data

Author

Listed:
  • Buczak, Philip

Abstract

Predicting ordinal responses such as school grades or rating scale data is a common task in the social and life sciences. Currently, two major streams of methodology exist for ordinal prediction: parametric models such as the proportional odds model and machine learning (ML) methods such as random forest (RF) adapted to ordinal prediction. While methods from the latter stream have displayed high predictive performance, particularly for data characterized by non-linear effects, most of these methods do not support hierarchical data. As such data structures frequently occur in the social and life sciences, e.g., students nested in classes or individual measurements nested within the same person, accounting for hierarchical data is of importance for prediction in these fields. A recently proposed ML method for ordinal prediction displaying promising results for non-hierarchical data is Frequency-Adjusted Borders Ordinal Forest (fabOF). Building on an iterative expectation-maximization-type estimation procedure, I extend fabOF to hierarchical data settings in this work by proposing Mixed-Effects Frequency-Adjusted Borders Ordinal Forest (mixfabOF). Through simulation and a real data example on math achievement, I will demonstrate that mixfabOF can improve upon fabOF and other RF-based ordinal prediction methods for (non-)hierarchical data in the presence of random effects.

Suggested Citation

  • Buczak, Philip, 2024. "Mixed-Effects Frequency-Adjusted Borders Ordinal Forest: A Tree Ensemble Method for Ordinal Prediction with Hierarchical Data," OSF Preprints ny6we, Center for Open Science.
  • Handle: RePEc:osf:osfxxx:ny6we
    DOI: 10.31219/osf.io/ny6we
    as

    Download full text from publisher

    File URL: https://osf.io/download/66fe72f4726a97a5cda205c2/
    Download Restriction: no

    File URL: https://libkey.io/10.31219/osf.io/ny6we?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Archer, Kellie J., 2010. "rpartOrdinal: An R Package for Deriving a Classification Tree for Predicting an Ordinal Response," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 34(i07).
    2. Luca Fontana & Chiara Masci & Francesca Ieva & Anna Maria Paganoni, 2021. "Performing Learning Analytics via Generalised Mixed-Effects Trees," Data, MDPI, vol. 6(7), pages 1-31, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Fellinghauer, Bernd & Bühlmann, Peter & Ryffel, Martin & von Rhein, Michael & Reinhardt, Jan D., 2013. "Stable graphical model estimation with Random Forests for discrete, continuous, and mixed variables," Computational Statistics & Data Analysis, Elsevier, vol. 64(C), pages 132-152.
    2. Angela Maria D’Uggento & Alfonso Piscitelli & Nunziata Ribecco & Germana Scepi, 2023. "Perceived climate change risk and global green activism among young people," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 32(4), pages 1167-1195, October.
    3. Gerhard Tutz, 2022. "Ordinal Trees and Random Forests: Score-Free Recursive Partitioning and Improved Ensembles," Journal of Classification, Springer;The Classification Society, vol. 39(2), pages 241-263, July.
    4. Espitia-Escuer, Manuel A. & García-Cebrián, Lucía Isabel, 2012. "Diversificación en la configuración de los equipos de la primera división española de fútbol/Diversification in the Team Configuration of the Spanish Football First Division," Estudios de Economia Aplicada, Estudios de Economia Aplicada, vol. 30, pages 527-544, Agosto.
    5. Buczak, Philip & Horn, Daniel & Pauly, Markus, 2024. "Old but Gold or New and Shiny? Comparing Tree Ensembles for Ordinal Prediction with a Classic Parametric Approach," OSF Preprints v7bcf, Center for Open Science.
    6. Adolfo Morrone & Alfonso Piscitelli & Antonio D’Ambrosio, 2019. "How Disadvantages Shape Life Satisfaction: An Alternative Methodological Approach," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 141(1), pages 477-502, January.
    7. Buczak, Philip, 2024. "fabOF: A Novel Tree Ensemble Method for Ordinal Prediction," OSF Preprints h8t4p, Center for Open Science.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:osf:osfxxx:ny6we. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: OSF (email available below). General contact details of provider: https://osf.io/preprints/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.