IDEAS home Printed from https://ideas.repec.org/a/aza/aoe000/y2024v3i2p111-120.html
   My bibliography  Save this article

You are the auditor: A ChatGPT-based multiple choice exam

Author

Listed:
  • Dell, Scott

    (Francis Marion University, USA)

  • Akpan, Mfon

    (Methodist University, USA)

Abstract

This case study examines the use of ChatGPT, a chatbot that utilises generative artificial intelligence (GenAI) technology, to amplify the efficacy of multiple-choice examinations in a financial accounting course. The primary objective is to introduce students to the advantages and limitations of GenAI tools such as ChatGPT while simultaneously fostering the development of critical thinking skills in their application. By demonstrating the tool’s ability to give both correct and incorrect responses, students will deepen their understanding of its appropriate use and develop a professional scepticism towards AI-generated responses, which can ‘hallucinate’ and yield incorrect answers to AI prompts. Furthermore, this study seeks to explore the role of AI-supported tests in fostering students’ problem-solving abilities and analytical acumen. The research examines student performance by giving exam questions, an AI-generated response and additional alternative answers in a multiple-choice format. On average, ChatGPT 3.5 responds with correct answers to accounting questions about 50 per cent of the time. To succeed in such examinations, students must evaluate if the ChatGPT answer is correct or if another of the given answers is more accurate. The case study also highlights the advantages and challenges of incorporating AI into accounting pedagogy, addressing concerns about the assimilation of this advanced technology.

Suggested Citation

  • Dell, Scott & Akpan, Mfon, 2024. "You are the auditor: A ChatGPT-based multiple choice exam," Advances in Online Education: A Peer-Reviewed Journal, Henry Stewart Publications, vol. 3(2), pages 111-120, December.
    • Handle: RePEc:aza:aoe000:y:2024:v:3:i:2:p:111-120
    as

    Download full text from publisher

    File URL: https://hstalks.com/article/8902/download/
    Download Restriction: Requires a paid subscription for full access.
    File URL: https://hstalks.com/article/8902/
    Download Restriction: Requires a paid subscription for full access.
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    More about this item

    Keywords

    generative artificial intelligence; ChatGPT; AI-assisted learning; financial accounting; multiple-choice examination; critical thinking;
    All these keywords.

    JEL classification:

    • I2 - Health, Education, and Welfare - - Education
    • A2 - General Economics and Teaching - - Economic Education and Teaching of Economics

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:aza:aoe000:y:2024:v:3:i:2:p:111-120. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Henry Stewart Talks (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.