IDEAS home Printed from https://ideas.repec.org/a/gam/jftint/v15y2023i2p44-d1044518.html
   My bibliography  Save this article

Attention-Enriched Mini-BERT Fake News Analyzer Using the Arabic Language

Author

Listed:
  • Husam M. Alawadh

    (Department of English Language and Translation, College of Languages and Translation, King Saud University, Riyadh 11451, Saudi Arabia)

  • Amerah Alabrah

    (Department of Information Systems, College of Computer and Information Sciences, King Saud University, Riyadh 11451, Saudi Arabia)

  • Talha Meraj

    (Department of Computer Science, COMSATS University Islamabad—Wah Campus, Wah Cantt 47040, Pakistan)

  • Hafiz Tayyab Rauf

    (Centre for Smart Systems, AI and Cybersecurity, Staffordshire University, Stoke-on-Trent ST4 2DE, UK)

Abstract

Internet use resulted in people becoming more reliant on social media. Social media have become the main source of fake news or rumors. They spread uncertainty in each sector of the real world, whether in politics, sports, or celebrities’ lives—all are affected by the uncontrolled behavior of social media platforms. Intelligent methods used to control this fake news in various languages have already been much discussed and frequently proposed by researchers. However, Arabic grammar and language are a far more complex and crucial language to learn. Therefore, work on Arabic fake-news-based datasets and related studies is much needed to control the spread of fake news on social media and other Internet media. The current study uses a recently published dataset of Arabic fake news annotated by experts. Further, Arabic-language-based embeddings are given to machine learning (ML) classifiers, and the Arabic-language-based trained minibidirectional encoder representations from transformers (BERT) is used to obtain the sentiments of Arabic grammar and feed a deep learning (DL) classifier. The holdout validation schemes are applied to both ML classifiers and mini-BERT-based deep neural classifiers. The results show a consistent improvement in the performance of mini-BERT-based classifiers, which outperformed ML classifiers, by increasing the training data. A comparison with previous Arabic fake news detection studies is shown where results of the current study show greater improvement.

Suggested Citation

  • Husam M. Alawadh & Amerah Alabrah & Talha Meraj & Hafiz Tayyab Rauf, 2023. "Attention-Enriched Mini-BERT Fake News Analyzer Using the Arabic Language," Future Internet, MDPI, vol. 15(2), pages 1-14, January.
    • Handle: RePEc:gam:jftint:v:15:y:2023:i:2:p:44-:d:1044518
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1999-5903/15/2/44/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/1999-5903/15/2/44/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Amerah Alabrah & Husam M. Alawadh & Ofonime Dominic Okon & Talha Meraj & Hafiz Tayyab Rauf, 2022. "Gulf Countries’ Citizens’ Acceptance of COVID-19 Vaccines—A Machine Learning Approach," Mathematics, MDPI, vol. 10(3), pages 1-20, January.
    2. Cristina M. Pulido & Laura Ruiz-Eugenio & Gisela Redondo-Sama & Beatriz Villarejo-Carballido, 2020. "A New Application of Social Impact in Social Media for Overcoming Fake News in Health," IJERPH, MDPI, vol. 17(7), pages 1-15, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chih-Hsing Liu & Quoc Phong La & Yen-Ling Ng & Rullyana Puspitaningrum Mamengko, 2023. "Discovering the Sustainable Innovation Service Process of Organizational Environment, Information Sharing and Satisfaction: The Moderating Roles of Pressure," Sustainability, MDPI, vol. 15(14), pages 1-26, July.
    2. Gisela Redondo-Sama & Teresa Morlà-Folch & Ana Burgués & Jelen Amador & Sveva Magaraggia, 2021. "Create Solidarity Networks: Dialogs in Reddit to Overcome Depression and Suicidal Ideation among Males," IJERPH, MDPI, vol. 18(22), pages 1-15, November.
    3. Mohamed Ali Hammami & Maher Guerchi & Okba Selmi & Faten Sehli & Hatem Ghouili & Oana Ancuța Stângaciu & Marius Alin Marinău & Ovidiu Galeru & Dan Iulian Alexe, 2023. "Effect of Verbal Encouragement on Physical Fitness, Technical Skill and Physiological Response during Small-Sided Soccer Games," Sustainability, MDPI, vol. 15(4), pages 1-12, February.
    4. Beniamino Schiavone & Andrea Vitale & Mena Gallo & Gianlucasalvatore Russo & Domenico Ponticelli & Mario Borrelli, 2021. "Overview of Facebook Use by Hospitals in Italy: A Nationwide Survey during the COVID-19 Emergency," IJERPH, MDPI, vol. 18(14), pages 1-17, July.
    5. Hedviga Tkacová & Roman Králik & Miroslav Tvrdoň & Zita Jenisová & José García Martin, 2022. "Credibility and Involvement of Social Media in Education—Recommendations for Mitigating the Negative Effects of the Pandemic among High School Students," IJERPH, MDPI, vol. 19(5), pages 1-22, February.
    6. Raúl Ruiz-Callado & Diana Jareño-Ruiz & María Elena Fabregat-Cabrera & María Manuela Penalva-Lorca, 2023. "Ageing and Loneliness in Times of Pandemic: A Scoping Review," IJERPH, MDPI, vol. 20(7), pages 1-13, March.
    7. Moacir Marocolo & Anderson Meireles & Hiago Leandro Rodrigues de Souza & Gustavo Ribeiro Mota & Dustin Jay Oranchuk & Rhaí André Arriel & Laura Hora Rios Leite, 2021. "Is Social Media Spreading Misinformation on Exercise and Health in Brazil?," IJERPH, MDPI, vol. 18(22), pages 1-10, November.
    8. Rosa Valls-Carol & Garazi Álvarez-Guerrero & Garazi López de Aguileta & Álvaro Alonso & Marta Soler-Gallart, 2021. "Citizen Debates in Social Networks about Didactic Resources for Mathematics," IJERPH, MDPI, vol. 18(21), pages 1-11, November.
    9. Ines Kožuh & Peter Čakš, 2021. "Explaining News Trust in Social Media News during the COVID-19 Pandemic—The Role of a Need for Cognition and News Engagement," IJERPH, MDPI, vol. 18(24), pages 1-12, December.
    10. Daniel Muñoz-Sastre & Luis Rodrigo-Martín & Isabel Rodrigo-Martín, 2021. "The Role of Twitter in the WHO’s Fight against the Infodemic," IJERPH, MDPI, vol. 18(22), pages 1-13, November.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jftint:v:15:y:2023:i:2:p:44-:d:1044518. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.