Enhancing Natural Language Processing Using Walrus Optimizer With Self-Attention Deep Learning Model In Applied Linguistics

Sentiment analysis (SA) is the popular natural language processing (NLP) problem utilized for analyzing texts, including uploaded reviews and user posts on e-commerce portals, forums, and social media platforms, regarding their opinions about the event or person, product, and service. The SA task comprises analyzing text to determine whether the sentiment expressed is negative, positive, or neutral, aiming for precise subjective data analysis. The deep learning (DL) technique enables various architectures to model SA tasks and has surpassed other machine learning (ML) techniques as the first method to perform SA tasks. Recent advancements in the DL model depart from the growing dominance of transformer language algorithms and convolutional neural network (CNN) and recurrent neural network (RNN) models. Utilizing pre-trained transformer language models to transfer knowledge to downstream tasks has emerged as a cutting-edge model in NLP. Therefore, the study designs a fractal walrus optimizer with self-attention DL-based SA in applied linguistics (WOSADL-SAAL) method. The WOSADL-SAAL method aims to recognize and classify the presence of sentiments in social media content. In the WOSADL-SAAL technique, data preprocessing is initially performed to transform the input dataset into a meaningful format. In addition, the WOSADL-SAAL technique uses the bag of words (BoW) model for extracting features. The self-attention bidirectional long short-term memory (SA-BiLSTM) network is applied to classify sentiment. The walrus optimizer (WO) model performs the hyperparameter tuning model to boost the detection outcomes of the SA-BiLSTM network. The performance evaluation of the WOSADL-SAAL method takes place under the benchmark SA dataset. The experimental analysis of the WOSADL-SAAL method exhibited a superior accuracy value of 99.07% and 99.24% under TUSA and IMDB datasets over existing approaches.