IDEAS home Printed from https://ideas.repec.org/a/adx/jessjr/v5y2024i3p230-240.html
   My bibliography  Save this article

Assessing the Effectiveness of Chat GPT in English Language and Literature: An Experimental Investigation into AI-Generated Research Content

Author

Listed:
  • Bushra Munawar
  • Hina Rafique
  • Nida Mushtaq Khan

Abstract

ChatGPT is an artificial intelligence model, highly proficient in English language and literature. This research explored the functionality of ChatGPT in producing research-oriented texts of the English language and literature in higher education institutions. It consisted of careful analysis of the quality, coherence, and relevance of ChatGPT- produced- content in terms of its capability to develop research topics, abstracts, research methodologies and theoretical- framework -based data analysis, and conclusions. Furthermore, the study focused on its role in academic context by drawing upon a comprehensive analysis of the strengths and limitations of ChatGPT in the research domain. Hence, the analysis consisted of scrutinizing the data for completeness, accuracy, and relevance of the content produced by ChatGPT administrating the CRAAP Test as the designed measure of performance of ChatGPT. Results showed a high proficiency of ChatGPT in originating research ideas and data explication but limiting response in composition of comprehensive abstract writing, research methodologies and principle design, especially when implementing practical implementation of overall research components. Furthermore, the study proposed that researchers should approach AI technology with a critical mindset. Contextually, the incorporation of human linguistic and literary expertise is recommended in utilization of ChatGPT in research studies and academic term papers. These measures will help maintain the quality and integrity of research and academic studies.

Suggested Citation

  • Bushra Munawar & Hina Rafique & Nida Mushtaq Khan, 2024. "Assessing the Effectiveness of Chat GPT in English Language and Literature: An Experimental Investigation into AI-Generated Research Content," Journal of Education and Social Studies, Science Impact Publishers, vol. 5(3), pages 230-240.
    • Handle: RePEc:adx:jessjr:v:5:y:2024:i:3:p:230-240
    as

    Download full text from publisher

    File URL: https://www.scienceimpactpub.com/journals/index.php/jess/article/view/950/566
    Download Restriction: no
    ---><---

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:adx:jessjr:v:5:y:2024:i:3:p:230-240. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Dr. Shahbaz Ahmad (email available below). General contact details of provider: https://www.scienceimpactpub.com/journals/index.php .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.