IDEAS home Printed from https://ideas.repec.org/p/dpr/wpaper/1194.html
   My bibliography  Save this paper

Beware the Performance of an Algorithm Before Relying on it: Evidence from a Stock Price Forecasting Experiment

Author

Listed:
  • Tiffany Tsz Kwan Tse
  • Nobuyuki Hanaki
  • Bolin Mao

Abstract

We experimentally investigated the relationship between participants’ reliance on algorithms, their familiarity with the task, and the performance level of the algorithm. We found that when participants were given the freedom to submit any number as their final forecast after observing the one produced by the algorithm (a condition found to mitigate algorithm aversion), the average degree of reliance on high and low performing algorithms did not significantly differ when there was no practice stage. Participants relied less on the algorithm when there was practice stage, regardless of its performance level. The reliance on the low performing algorithm was positive even when participants could infer that they outperformed the algorithm. Indeed, participants would have done better without relying on the low performing algorithm at all. Our results suggest that, at least in some domains, excessive reliance on algorithms, rather than algorithm aversion, should be a concern.
(This abstract was borrowed from another version of this item.)

Suggested Citation

  • Tiffany Tsz Kwan Tse & Nobuyuki Hanaki & Bolin Mao, 2022. "Beware the Performance of an Algorithm Before Relying on it: Evidence from a Stock Price Forecasting Experiment," ISER Discussion Paper 1194, Institute of Social and Economic Research, The University of Osaka.
    • Handle: RePEc:dpr:wpaper:1194
    as

    Download full text from publisher

    File URL: https://www.iser.osaka-u.ac.jp/static/resources/docs/dp/2022/DP1194.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Charles N. Noussair & Stefan T. Trautmann & Gijs van de Kuilen, 2014. "Higher Order Risk Attitudes, Demographics, and Financial Decisions," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 81(1), pages 325-355.
    2. Takehito Masuda & Eungik Lee, 2019. "Higher order risk attitudes and prevention under different timings of loss," Experimental Economics, Springer;Economic Science Association, vol. 22(1), pages 197-215, March.
    3. Takehito Masuda & Eungik Lee, 2019. "Higher order risk attitudes and prevention under different timings of loss," Experimental Economics, Springer;Economic Science Association, vol. 22(1), pages 197-215, March.
    4. Nobuyuki Hanaki & Keigo Inukai & Takehito Masuda & Yuta Shimodaira, 2021. "Participants’ Characteristics at ISER-Lab in 2020," ISER Discussion Paper 1141, Institute of Social and Economic Research, The University of Osaka.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Alexia GAUDEUL & Caterina GIANNETTI, 2023. "Trade-offs in the design of financial algorithms," Discussion Papers 2023/288, Dipartimento di Economia e Management (DEM), University of Pisa, Pisa, Italy.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nobuyuki Hanaki & Keigo Inukai & Takehito Masuda & Yuta Shimodaira, 2021. "Participants’ Characteristics at ISER-Lab in 2020," ISER Discussion Paper 1141, Institute of Social and Economic Research, The University of Osaka.
    2. Thomas Mayrhofer & Hendrik Schmitz, 2020. "Prudence and prevention - Empirical evidence," Working Papers CIE 134, Paderborn University, CIE Center for International Economics.
    3. Nobuyuki Hanaki & Keigo Inukai & Takehito Masuda & Yuta Shimodaira, 2022. "Comparing behavior between a large sample of smart students and a representative sample of Japanese adults," ISER Discussion Paper 1160, Institute of Social and Economic Research, The University of Osaka.
    4. Trautmann, Stefan T. & Kuilen, Gijs van de, 2018. "Higher order risk attitudes: A review of experimental evidence," European Economic Review, Elsevier, vol. 103(C), pages 108-124.
    5. Richard Peter, 2024. "The economics of self-protection," The Geneva Risk and Insurance Review, Palgrave Macmillan;International Association for the Study of Insurance Economics (The Geneva Association), vol. 49(1), pages 6-35, March.
    6. Timo R. Lambregts & Paul Bruggen & Han Bleichrodt, 2021. "Insurance decisions under nonperformance risk and ambiguity," Journal of Risk and Uncertainty, Springer, vol. 63(3), pages 229-253, December.
    7. repec:dpr:wpaper:1229 is not listed on IDEAS
    8. Shigehiro Serizawa & Natsumi Shimada & Tiffany Tsz Kwan Tse, 2024. "Toward an Understanding of Dominated Bidding in a Vickrey Auction Experiment," ISER Discussion Paper 1229r, Institute of Social and Economic Research, The University of Osaka.
    9. Min Cui & Jizhou Zhang & Xianli Xia, 2022. "The Relationship between Child Rearing Burden and Farmers’ Adoption of Climate Adaptive Technology: Taking Water-Saving Irrigation Technology as an Example," Agriculture, MDPI, vol. 12(6), pages 1-22, June.
    10. Han Bleichrodt, 2022. "The prevention puzzle," The Geneva Risk and Insurance Review, Palgrave Macmillan;International Association for the Study of Insurance Economics (The Geneva Association), vol. 47(2), pages 277-297, September.
    11. Richard Peter, 2021. "Who should exert more effort? Risk aversion, downside risk aversion and optimal prevention," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 71(4), pages 1259-1281, June.
    12. Breaban, Adriana & van de Kuilen, Gijs & Noussair, Charles, 2016. "Prudence, Personality, Cognitive Ability and Emotional State," Other publications TiSEM 9a01a5ab-e03d-49eb-9cd7-4, Tilburg University, School of Economics and Management.
    13. Durmaz, Tunç, 2016. "Precautionary Storage in Electricity Markets," Discussion Papers 2016/5, Norwegian School of Economics, Department of Business and Management Science.
    14. Armantier, Olivier & Treich, Nicolas, 2013. "Eliciting beliefs: Proper scoring rules, incentives, stakes and hedging," European Economic Review, Elsevier, vol. 62(C), pages 17-40.
    15. Embrey, Matthew & Hyndman, Kyle & Riedl, Arno, 2021. "Bargaining with a residual claimant: An experimental study," Games and Economic Behavior, Elsevier, vol. 126(C), pages 335-354.
    16. Füllbrunn, Sascha & Luhan, Wolfgang J., 2015. "Am I my Peer's Keeper? Social Responsibility in Financial Decision Making," Ruhr Economic Papers 551, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
    17. Attema, Arthur E. & l’Haridon, Olivier & van de Kuilen, Gijs, 2019. "Measuring multivariate risk preferences in the health domain," Journal of Health Economics, Elsevier, vol. 64(C), pages 15-24.
    18. Zeeshan Ahmed & Shahid Rasool & Qasim Saleem & Mubashir Ali Khan & Shamsa Kanwal, 2022. "Mediating Role of Risk Perception Between Behavioral Biases and Investor’s Investment Decisions," SAGE Open, , vol. 12(2), pages 21582440221, May.
    19. Attema, Arthur E. & L'Haridon, Olivier & van de Kuilen, Gijs, 2023. "Decomposing social risk preferences for health and wealth," Journal of Health Economics, Elsevier, vol. 90(C).
    20. Gola, Carlo & Ilari, Antonio, 2015. "Financial innovation oversight: a policy framework," Journal of Financial Perspectives, EY Global FS Institute, vol. 3(1), pages 59-100.
    21. Ferdinand M. Vieider & Mathieu Lefebvre & Ranoua Bouchouicha & Thorsten Chmura & Rustamdjan Hakimov & Michal Krawczyk & Peter Martinsson, 2015. "Common Components Of Risk And Uncertainty Attitudes Across Contexts And Domains: Evidence From 30 Countries," Journal of the European Economic Association, European Economic Association, vol. 13(3), pages 421-452, June.

    More about this item

    JEL classification:

    • C90 - Mathematical and Quantitative Methods - - Design of Experiments - - - General
    • G1 - Financial Economics - - General Financial Markets
    • G4 - Financial Economics - - Behavioral Finance
    • G17 - Financial Economics - - General Financial Markets - - - Financial Forecasting and Simulation

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:dpr:wpaper:1194. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Librarian (email available below). General contact details of provider: https://edirc.repec.org/data/isosujp.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.