IDEAS home Printed from https://ideas.repec.org/a/bla/jinfst/v74y2023i6p685-700.html
   My bibliography  Save this article

Making sense of the black‐boxes: Toward interpretable text classification using deep learning models

Author

Listed:
  • Jie Tao
  • Lina Zhou
  • Kevin Hickey

Abstract

Text classification is a common task in data science. Despite the superior performances of deep learning based models in various text classification tasks, their black‐box nature poses significant challenges for wide adoption. The knowledge‐to‐action framework emphasizes several principles concerning the application and use of knowledge, such as ease‐of‐use, customization, and feedback. With the guidance of the above principles and the properties of interpretable machine learning, we identify the design requirements for and propose an interpretable deep learning (IDeL) based framework for text classification models. IDeL comprises three main components: feature penetration, instance aggregation, and feature perturbation. We evaluate our implementation of the framework with two distinct case studies: fake news detection and social question categorization. The experiment results provide evidence for the efficacy of IDeL components in enhancing the interpretability of text classification models. Moreover, the findings are generalizable across binary and multi‐label, multi‐class classification problems. The proposed IDeL framework introduce a unique iField perspective for building trusted models in data science by improving the transparency and access to advanced black‐box models.

Suggested Citation

  • Jie Tao & Lina Zhou & Kevin Hickey, 2023. "Making sense of the black‐boxes: Toward interpretable text classification using deep learning models," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 74(6), pages 685-700, June.
  • Handle: RePEc:bla:jinfst:v:74:y:2023:i:6:p:685-700
    DOI: 10.1002/asi.24642
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/asi.24642
    Download Restriction: no

    File URL: https://libkey.io/10.1002/asi.24642?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Arun Rai, 2020. "Explainable AI: from black box to glass box," Journal of the Academy of Marketing Science, Springer, vol. 48(1), pages 137-141, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jianbo Zhao & Huailiang Liu & Shanzhuang Zhang & Yanwei Qi & Haiping Dong & Xiaojin Zhang & Weili Zhang, 2023. "Advancements in Rumor Detection Research Based on Bibliometrics and S-curve Technology Evolution Theory," SAGE Open, , vol. 13(4), pages 21582440231, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chen, Changdong, 2024. "How consumers respond to service failures caused by algorithmic mistakes: The role of algorithmic interpretability," Journal of Business Research, Elsevier, vol. 176(C).
    2. Robertson, Jeandri & Ferreira, Caitlin & Botha, Elsamari & Oosthuizen, Kim, 2024. "Game changers: A generative AI prompt protocol to enhance human-AI knowledge co-construction," Business Horizons, Elsevier, vol. 67(5), pages 499-510.
    3. Leah Warfield Smith & Randall Lee Rose & Alex R. Zablah & Heath McCullough & Mohammad “Mike” Saljoughian, 2023. "Examining post-purchase consumer responses to product automation," Journal of the Academy of Marketing Science, Springer, vol. 51(3), pages 530-550, May.
    4. Jan Ole Krugmann & Jochen Hartmann, 2024. "Sentiment Analysis in the Age of Generative AI," Customer Needs and Solutions, Springer;Institute for Sustainable Innovation and Growth (iSIG), vol. 11(1), pages 1-19, December.
    5. Nan Zhang & Heng Xu, 2024. "Fairness of Ratemaking for Catastrophe Insurance: Lessons from Machine Learning," Information Systems Research, INFORMS, vol. 35(2), pages 469-488, June.
    6. Ekaterina Jussupow & Kai Spohrer & Armin Heinzl & Joshua Gawlitza, 2021. "Augmenting Medical Diagnosis Decisions? An Investigation into Physicians’ Decision-Making Process with Artificial Intelligence," Information Systems Research, INFORMS, vol. 32(3), pages 713-735, September.
    7. Henner Gimpel & Vanessa Graf-Seyfried & Robert Laubacher & Oliver Meindl, 2023. "Towards Artificial Intelligence Augmenting Facilitation: AI Affordances in Macro-Task Crowdsourcing," Group Decision and Negotiation, Springer, vol. 32(1), pages 75-124, February.
    8. Araz Zirar, 2023. "Can artificial intelligence’s limitations drive innovative work behaviour?," Review of Managerial Science, Springer, vol. 17(6), pages 2005-2034, August.
    9. Sobrie, Léon & Verschelde, Marijn & Roets, Bart, 2024. "Explainable real-time predictive analytics on employee workload in digital railway control rooms," European Journal of Operational Research, Elsevier, vol. 317(2), pages 437-448.
    10. Trocin, Cristina & Hovland, Ingrid Våge & Mikalef, Patrick & Dremel, Christian, 2021. "How Artificial Intelligence affords digital innovation: A cross-case analysis of Scandinavian companies," Technological Forecasting and Social Change, Elsevier, vol. 173(C).
    11. Mari, Alex & Mandelli, Andreina & Algesheimer, René, 2024. "Empathic voice assistants: Enhancing consumer responses in voice commerce," Journal of Business Research, Elsevier, vol. 175(C).
    12. Guha, Abhijit & Grewal, Dhruv & Kopalle, Praveen K. & Haenlein, Michael & Schneider, Matthew J. & Jung, Hyunseok & Moustafa, Rida & Hegde, Dinesh R. & Hawkins, Gary, 2021. "How artificial intelligence will affect the future of retailing," Journal of Retailing, Elsevier, vol. 97(1), pages 28-41.
    13. Volkmar, Gioia & Fischer, Peter M. & Reinecke, Sven, 2022. "Artificial Intelligence and Machine Learning: Exploring drivers, barriers, and future developments in marketing management," Journal of Business Research, Elsevier, vol. 149(C), pages 599-614.
    14. Vinay Singh & Brijesh Nanavati & Arpan Kumar Kar & Agam Gupta, 2023. "How to Maximize Clicks for Display Advertisement in Digital Marketing? A Reinforcement Learning Approach," Information Systems Frontiers, Springer, vol. 25(4), pages 1621-1638, August.
    15. Ben Allen & Morgan Lane & Elizabeth Anderson Steeves & Hollie Raynor, 2022. "Using Explainable Artificial Intelligence to Discover Interactions in an Ecological Model for Obesity," IJERPH, MDPI, vol. 19(15), pages 1-13, August.
    16. Manjunath Padigar & Ljubomir Pupovac & Ashish Sinha & Rajendra Srivastava, 2022. "The effect of marketing department power on investor responses to announcements of AI-embedded new product innovations," Journal of the Academy of Marketing Science, Springer, vol. 50(6), pages 1277-1298, November.
    17. Priporas, Constantinos Vasilios & Vellore Nagarajan, Durga & Kamenidou, Irene (Eirini), 2023. "A technology-people-integrated toolkit for retail care management during a crisis," Journal of Retailing and Consumer Services, Elsevier, vol. 73(C).
    18. Kim, Doha & Song, Yeosol & Kim, Songyie & Lee, Sewang & Wu, Yanqin & Shin, Jungwoo & Lee, Daeho, 2023. "How should the results of artificial intelligence be explained to users? - Research on consumer preferences in user-centered explainable artificial intelligence," Technological Forecasting and Social Change, Elsevier, vol. 188(C).
    19. Isabelle Aimé & Fabienne Berger-Remy & Marie-Eve Laporte, 2022. "The brand, the persona and the algorithm: How datafication is reconfiguring marketing work☆," Post-Print halshs-03651599, HAL.
    20. Alex Mari & Andreina Mandelli & René Algesheimer, 2023. "Shopping with Voice Assistants: How Empathy Affects Individual and Family Decision-Making Outcomes," Working Papers 399, University of Zurich, Department of Business Administration (IBW).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:jinfst:v:74:y:2023:i:6:p:685-700. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.asis.org .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.