Detecting and Mitigating Shortcut Learning Bias in Machine Learning: A Pathway to More Generalizable ML-based (IS) Research
Author
Abstract
Suggested Citation
Download full text from publisher
References listed on IDEAS
- Julian Senoner & Bernhard Kratzwald & Milan Kuzmanovic & Torbjørn H. Netland & Stefan Feuerriegel, 2023. "Addressing distributional shifts in operations management: The case of order fulfillment in customized production," Production and Operations Management, Production and Operations Management Society, vol. 32(10), pages 3022-3042, October.
- Patrick Riley, 2019. "Three pitfalls to avoid in machine learning," Nature, Nature, vol. 572(7767), pages 27-29, August.
- Mai, Feng & Tian, Shaonan & Lee, Chihoon & Ma, Ling, 2019. "Deep learning models for bankruptcy prediction using textual disclosures," European Journal of Operational Research, Elsevier, vol. 274(2), pages 743-758.
- Richard Van Noorden & Jeffrey M. Perkel, 2023. "AI and science: what 1,600 researchers think," Nature, Nature, vol. 621(7980), pages 672-675, September.
- Hanna Meyer & Edzer Pebesma, 2022. "Machine learning-based global maps of ecological variables and the challenge of assessing them," Nature Communications, Nature, vol. 13(1), pages 1-4, December.
- Mochen Yang & Gediminas Adomavicius & Gordon Burtch & Yuqing Rena, 2018. "Mind the Gap: Accounting for Measurement Error and Misclassification in Variables Generated via Data Mining," Information Systems Research, INFORMS, vol. 29(1), pages 4-24, March.
Most related items
These are the items that most often cite the same works as this one and are cited by the same works as this one.- Zhou, Fanyin & Fu, Lijun & Li, Zhiyong & Xu, Jiawei, 2022. "The recurrence of financial distress: A survival analysis," International Journal of Forecasting, Elsevier, vol. 38(3), pages 1100-1115.
- Yi Yang & Kunpeng Zhang & Yangyang Fan, 2023. "sDTM: A Supervised Bayesian Deep Topic Model for Text Analytics," Information Systems Research, INFORMS, vol. 34(1), pages 137-156, March.
- Rafael Becerra-Vicario & David Alaminos & Eva Aranda & Manuel A. Fernández-Gámez, 2020. "Deep Recurrent Convolutional Neural Network for Bankruptcy Prediction: A Case of the Restaurant Industry," Sustainability, MDPI, vol. 12(12), pages 1-15, June.
- Evangelos Katsamakas & Oleg V. Pavlov & Ryan Saklad, 2024. "Artificial intelligence and the transformation of higher education institutions," Papers 2402.08143, arXiv.org.
- Zhao, Shuping & Xu, Kai & Wang, Zhao & Liang, Changyong & Lu, Wenxing & Chen, Bo, 2022. "Financial distress prediction by combining sentiment tone features," Economic Modelling, Elsevier, vol. 106(C).
- Saima Javed & Yu Rong & Babar Nawaz Abbasi, 2024. "Convergence analysis of artificial intelligence research capacity: Are the less developed catching up with the developed ones?," Journal of International Development, John Wiley & Sons, Ltd., vol. 36(4), pages 2172-2192, May.
- Suyuan Luo & Tsan-Ming Choi, 2024. "Great partners: how deep learning and blockchain help improve business operations together," Annals of Operations Research, Springer, vol. 339(1), pages 53-78, August.
- Christopher Gerling & Stefan Lessmann, 2023. "Multimodal Document Analytics for Banking Process Automation," Papers 2307.11845, arXiv.org, revised Nov 2023.
- Jiang, Cuiqing & Zhou, Yiru & Chen, Bo, 2023. "Mining semantic features in patent text for financial distress prediction," Technological Forecasting and Social Change, Elsevier, vol. 190(C).
- Milan Miric & Nan Jia & Kenneth G. Huang, 2023. "Using supervised machine learning for large‐scale classification in management research: The case for identifying artificial intelligence patents," Strategic Management Journal, Wiley Blackwell, vol. 44(2), pages 491-519, February.
- Huang, Shirley Hsueh-Li & Hu, Guo-Hsin & Hsu, Ming-Fu, 2025. "Identifying contextual content-based risk drivers for advanced risk management strategies," Research in International Business and Finance, Elsevier, vol. 73(PB).
- Das, Ronnie & Ahmed, Wasim & Sharma, Kshitij & Hardey, Mariann & Dwivedi, Yogesh K. & Zhang, Ziqi & Apostolidis, Chrysostomos & Filieri, Raffaele, 2024. "Towards the development of an explainable e-commerce fake review index: An attribute analytics approach," European Journal of Operational Research, Elsevier, vol. 317(2), pages 382-400.
- Sigrist, Fabio & Leuenberger, Nicola, 2023. "Machine learning for corporate default risk: Multi-period prediction, frailty correlation, loan portfolios, and tail probabilities," European Journal of Operational Research, Elsevier, vol. 305(3), pages 1390-1406.
- Tania L. Maxwell & Mark D. Spalding & Daniel A. Friess & Nicholas J. Murray & Kerrylee Rogers & Andre S. Rovai & Lindsey S. Smart & Lukas Weilguny & Maria Fernanda Adame & Janine B. Adams & William E., 2024. "Soil carbon in the world’s tidal marshes," Nature Communications, Nature, vol. 15(1), pages 1-16, December.
- Ion-Danut LIXANDRU, 2024. "The Use of Artificial Intelligence for Qualitative Data Analysis: ChatGPT," Informatica Economica, Academy of Economic Studies - Bucharest, Romania, vol. 28(1), pages 57-67.
- Rogelio A. Mancisidor & Kjersti Aas, 2022. "Multimodal Generative Models for Bankruptcy Prediction Using Textual Data," Papers 2211.08405, arXiv.org, revised Feb 2024.
- Mahsa Tavakoli & Rohitash Chandra & Fengrui Tian & Cristi'an Bravo, 2023. "Multi-Modal Deep Learning for Credit Rating Prediction Using Text and Numerical Data Streams," Papers 2304.10740, arXiv.org, revised Nov 2024.
- Azadi, Majid & Yousefi, Saeed & Farzipoor Saen, Reza & Shabanpour, Hadi & Jabeen, Fauzia, 2023. "Forecasting sustainability of healthcare supply chains using deep learning and network data envelopment analysis," Journal of Business Research, Elsevier, vol. 154(C).
- Nazemi, Abdolreza & Rezazadeh, Hani & Fabozzi, Frank J. & Höchstötter, Markus, 2022. "Deep learning for modeling the collection rate for third-party buyers," International Journal of Forecasting, Elsevier, vol. 38(1), pages 240-252.
- Henri Arno & Klaas Mulier & Joke Baeck & Thomas Demeester, 2022. "Next-Year Bankruptcy Prediction from Textual Data: Benchmark and Baselines," Papers 2208.11334, arXiv.org.
More about this item
Keywords
Machine Learning; ML-Based Research; Shortcut Learning; Reproducibility; Generalizability;All these keywords.
JEL classification:
- C8 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs
NEP fields
This paper has been announced in the following NEP Reports:- NEP-CMP-2025-02-24 (Computational Economics)
Statistics
Access and download statisticsCorrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pdn:dispap:129. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: WP-WiWi-Info (email available below). General contact details of provider: https://edirc.repec.org/data/fwpadde.html .
Please note that corrections may take a couple of weeks to filter through the various RePEc services.