IDEAS home Printed from https://ideas.repec.org/a/inm/orisre/v35y2024i4p1634-1656.html
   My bibliography  Save this article

Longitudinal Impact of Preference Biases on Recommender Systems’ Performance

Author

Listed:
  • Meizi Zhou

    (Boston University, Boston, Massachusetts 02215)

  • Jingjing Zhang

    (Indiana University, Bloomington, Indiana 47405)

  • Gediminas Adomavicius

    (University of Minnesota, Minneapolis, Minnesota 55455)

Abstract

Research studies have shown that recommender systems’ predictions that are observed by users can cause biases in users’ postconsumption preference ratings. This can happen as part of the standard, normal system use, where biases are typically caused by the system’s inherent prediction errors (i.e., because of the less-than-perfect accuracy of recommendation methods). Because users’ preference ratings are typically fed back to the system as training data for future predictions, this process is likely to influence the performance of the system in the long run. We use a simulation approach to study the longitudinal impact of preference biases (and their magnitude) on the dynamics of recommender systems’ performance. Our simulation results show that preference biases significantly impair the system’s prediction performance (i.e., prediction accuracy) as well as users’ consumption outcomes (i.e., consumption relevance and diversity) over time. The impact is nonlinear to the size of the bias, that is, large bias causes disproportionately large negative effects. Also, items that are less popular and less distinctive (in terms of their content) are affected more by preference biases. Furthermore, given the impact of preference bias on the recommender systems’ performance, we explore the problem of debiasing user-submitted ratings. We empirically demonstrate that relying solely on historical rating data is unlikely to be effective in debiasing. We also propose and evaluate two debiasing approaches that take into account additional relevant information that can be collected by recommendation platforms. Our findings provide important implications for the design of recommender systems.

Suggested Citation

  • Meizi Zhou & Jingjing Zhang & Gediminas Adomavicius, 2024. "Longitudinal Impact of Preference Biases on Recommender Systems’ Performance," Information Systems Research, INFORMS, vol. 35(4), pages 1634-1656, December.
  • Handle: RePEc:inm:orisre:v:35:y:2024:i:4:p:1634-1656
    DOI: 10.1287/isre.2021.0133
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/isre.2021.0133
    Download Restriction: no

    File URL: https://libkey.io/10.1287/isre.2021.0133?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:orisre:v:35:y:2024:i:4:p:1634-1656. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.