IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v12y2023i1p53-d1306273.html
   My bibliography  Save this article

A Comparative Sentiment Analysis of Airline Customer Reviews Using Bidirectional Encoder Representations from Transformers (BERT) and Its Variants

Author

Listed:
  • Zehong Li

    (Department of Cognitive Science, University of California San Diego, La Jolla, CA 92122, USA)

  • Chuyang Yang

    (School of Technology and Professional Services Management, Eastern Michigan University, Ypsilanti, MI 48197, USA)

  • Chenyu Huang

    (Aviation Institute, University of Nebraska Omaha, Omaha, NE 68182, USA)

Abstract

The applications of artificial intelligence (AI) and natural language processing (NLP) have significantly empowered the safety and operational efficiency within the aviation sector for safer and more efficient operations. Airlines derive informed decisions to enhance operational efficiency and strategic planning through extensive contextual analysis of customer reviews and feedback from social media, such as Twitter and Facebook. However, this form of analytical endeavor is labor-intensive and time-consuming. Extensive studies have investigated NLP algorithms for sentiment analysis based on textual customer feedback, thereby underscoring the necessity for an in-depth investigation of transformer architecture-based NLP models. In this study, we conducted an exploration of the large language model BERT and three of its derivatives using an airline sentiment tweet dataset for downstream tasks. We further honed this fine-tuning by adjusting the hyperparameters, thus improving the model’s consistency and precision of outcomes. With RoBERTa distinctly emerging as the most precise and overall effective model in both the binary (96.97%) and tri-class (86.89%) sentiment classification tasks and persisting in outperforming others in the balanced dataset for tri-class sentiment classification, our results validate the BERT models’ application in analyzing airline industry customer sentiment. In addition, this study identifies the scope for improvement in future studies, such as investigating more systematic and balanced datasets, applying other large language models, and using novel fine-tuning approaches. Our study serves as a pivotal benchmark for future exploration in customer sentiment analysis, with implications that extend from the airline industry to broader transportation sectors, where customer feedback plays a crucial role.

Suggested Citation

  • Zehong Li & Chuyang Yang & Chenyu Huang, 2023. "A Comparative Sentiment Analysis of Airline Customer Reviews Using Bidirectional Encoder Representations from Transformers (BERT) and Its Variants," Mathematics, MDPI, vol. 12(1), pages 1-19, December.
    • Handle: RePEc:gam:jmathe:v:12:y:2023:i:1:p:53-:d:1306273
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/12/1/53/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2227-7390/12/1/53/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Park, Eunil, 2019. "The role of satisfaction on customer reuse to airline services: An application of Big Data approaches," Journal of Retailing and Consumer Services, Elsevier, vol. 47(C), pages 370-374.
    2. Nicole Kalemba & Fernando Campa-Planas, 2018. "The quality effect on the profitability of US airline companies," Tourism Economics, , vol. 24(3), pages 251-269, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yunho Ji & Won Seok Lee & Joonho Moon, 2023. "Café Food Safety and Its Impacts on Intention to Reuse and Switch Cafés during the COVID-19 Pandemic: The Case of Starbucks," IJERPH, MDPI, vol. 20(3), pages 1-11, February.
    2. Munoz, Claudia & Laniado, Henry, 2021. "Airline choice model for international round-trip flights: The role of travelers’ satisfaction and personality traits," Research in Transportation Economics, Elsevier, vol. 90(C).
    3. Lee, Won Seok & Tang, Ruohan & Moon, Joonho & Song, Myungkeun, 2022. "The structural relationship between a low-cost carrier’s service experience, corporate social responsibility, brand love, and reuse intention: The case of Southwest Airlines," Journal of Air Transport Management, Elsevier, vol. 102(C).
    4. Heesup Han & Taeyeon Eom & Hyunah Chung & Soyeun Lee & Hyungseo Bobby Ryu & Wansoo Kim, 2019. "Passenger Repurchase Behaviours in the Green Cruise Line Context: Exploring the Role of Quality, Image, and Physical Environment," Sustainability, MDPI, vol. 11(7), pages 1-15, April.
    5. Youssef, Mayada Abd El-Aziz & Eid, Riyad & Agag, Gomaa, 2022. "Cross-national differences in big data analytics adoption in the retail industry," Journal of Retailing and Consumer Services, Elsevier, vol. 64(C).
    6. Ladislav Pilař & Lucie Kvasničková Stanislavská & Jana Pitrová & Igor Krejčí & Ivana Tichá & Martina Chalupová, 2019. "Twitter Analysis of Global Communication in the Field of Sustainability," Sustainability, MDPI, vol. 11(24), pages 1-16, December.
    7. Antwi, Collins Opoku & Fan, Chong-jun & Nataliia, Ihnatushchenko & Aboagye, Michael Osei & Xu, Hangyu & Azamela, John Coffie, 2020. "Do airport staff helpfulness and communication generate behavioral loyalty in transfer passengers? A conditional mediation analysis," Journal of Retailing and Consumer Services, Elsevier, vol. 54(C).
    8. Hyeongjin Ahn & Eunil Park, 2022. "For sustainable development in the transportation sector: Determinants of acceptance of sustainable transportation using the innovation diffusion theory and technology acceptance model," Sustainable Development, John Wiley & Sons, Ltd., vol. 30(5), pages 1169-1183, October.
    9. Dimitrios Drosos & Grigorios L. Kyriakopoulos & Garyfallos Arabatzis & Nikolaos Tsotsolas, 2020. "Evaluating Customer Satisfaction in Energy Markets Using a Multicriteria Method: The Case of Electricity Market in Greece," Sustainability, MDPI, vol. 12(9), pages 1-19, May.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:12:y:2023:i:1:p:53-:d:1306273. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.