International Journal of Modern Education and Computer Science (IJMECS)
IJMECS Vol. 17, No. 1, 8 Feb. 2025
Cover page and Table of Contents: PDF (size: 989KB)
Deep Learning CNN–LSTM Hybrid Approach for Arabic Sentiment Analysis Using Word Embedding Models
PDF (989KB), PP.72-90
Views: 0 Downloads: 0
Author(s)
Youssra Zahidi
1,*
Yassine Al-Amrani
1
Yacine El Younoussi
2
Index Terms
Deep Learning, Arabic Sentiment Analysis, FastText, Convolutional Neural Networks, Long Short-Term Memory
Abstract
In recent years, the widespread use of social networks has empowered online users to freely share their opinions on diverse aspects of life. Sentiment Analysis (SA) has consequently emerged as a pivotal domain within Natural Language Processing (NLP), serving a crucial role in discerning sentiment orientations and extracting valuable insights from public viewpoints. Analyzing sentiment in Arabic poses distinctive challenges due to its varied dialects, as well as its intricate morphological and syntactic structures. Deep Learning (DL) models, particularly Long Short-Term Memory (LSTM) networks and Convolutional Neural Networks (CNNs), have exhibited remarkable proficiency in Sentiment Analysis. LSTM networks excel in capturing sequential data patterns, while CNNs offer inherent advantages in feature selection, yielding superior performance compared to conventional machine learning (ML) algorithms. In our study, we propose an ensemble approach that integrates CNN and LSTM techniques to classify and forecast sentiment in tweets. We evaluate the effectiveness of this hybrid model against individual LSTM and CNN methodologies employing the FastText word embedding model. Experimental findings illustrate that our LSTM-CNN hybrid approach, leveraging the FastText word embedding model, significantly improves text classification accuracy.
Cite This Paper
Youssra Zahidi, Yassine Al-Amrani, Yacine El Younoussi, "Deep Learning CNN–LSTM Hybrid Approach for Arabic Sentiment Analysis Using Word Embedding Models", International Journal of Modern Education and Computer Science(IJMECS), Vol.17, No.1, pp. 72-90, 2025. DOI:10.5815/ijmecs.2025.01.06
Reference
[1]Zahidi, Y., El Younoussi, Y., Al-Amrani, Y.: An Overview of Word Embedding Models Evaluation for Arabic Sentiment Analysis. Lecture Notes in Networks and Systems. 489 LNNS, 411–427 (2022). https://doi.org/10.1007/978-3-031-07969-6_31
[2]Zahidi, Y., El Younoussi, Y., Al-Amrani, Y.: Arabic Sentiment Analysis based on Neural Network Models: Overview and Comparison. 77–80 (2022). https://doi.org/10.5220/0010728700003101
[3]Zahidi, Y., Al-Amrani, Y., Younoussi, Y. El: Improving Arabic Sentiment Analysis Using LSTM Based on Word Embedding Models. https://doi.org/10.1142/S2196888823500069. (2023). https://doi.org/10.1142/S2196888823500069
[4]Abu Kwaik, K., Saad, M., Chatzikyriakidis, S., Dobnik, S.: LSTM-CNN Deep Learning Model for Sentiment Analysis of Dialectal Arabic. Communications in Computer and Information Science. 1108, 108–121 (2019). https://doi.org/10.1007/978-3-030-32959-4_8/COVER
[5]Elsamadony, O., Keshk, A., Abdelatey, A.: Sentiment Analysis for Arabic Language Using Word Embedding. 17th International Computer Engineering Conference, ICENCO 2021. 51–56 (2021). https://doi.org/10.1109/ICENCO49852.2021.9698960
[6]Ombabi, A.H., Ouarda, W., Alimi, A.M.: Deep learning CNN–LSTM framework for Arabic sentiment analysis using textual information shared in social networks. Soc Netw Anal Min. 10, 1–13 (2020). https://doi.org/10.1007/s13278-020-00668-1
[7]Khan, L., Amjad, A., Afaq, K.M., Chang, H.T.: Deep Sentiment Analysis Using CNN-LSTM Architecture of English and Roman Urdu Text Shared in Social Media. Applied Sciences (Switzerland). 12, 2694 (2022). https://doi.org/10.3390/app12052694
[8]Alayba, A.M., Palade, V.: Leveraging Arabic sentiment classification using an enhanced CNN-LSTM approach and effective Arabic text preparation. Journal of King Saud University - Computer and Information Sciences. (2021). https://doi.org/10.1016/j.jksuci.2021.12.004
[9]Habbat, N., Anoun, H., Hassouni, L.: A Novel Hybrid Network for Arabic Sentiment Analysis using fine-tuned AraBERT model. 13, 801–813 (2021). https://doi.org/10.15676/ijeei.2021.13.4.3
[10]Saleh, H., Mostafa, S., Gabralla, L.A., O. Aseeri, A., El-Sappagh, S.: Enhanced Arabic Sentiment Analysis Using a Novel Stacking Ensemble of Hybrid and Deep Learning Models. Applied Sciences 2022, Vol. 12, Page 8967. 12, 8967 (2022). https://doi.org/10.3390/APP12188967
[11]Alayba, A.M., Palade, V., England, M., Iqbal, R.: A combined CNN and LSTM model for Arabic sentiment analysis. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). 11015 LNCS, 179–191 (2018). https://doi.org/10.1007/978-3-319-99740-7_12/FIGURES/5
[12]Basiri, M.E., Nemati, S., Abdar, M., Cambria, E., Acharya, U.R.: ABCDM: An Attention-based Bidirectional CNN-RNN Deep Model for sentiment analysis. Future Generation Computer Systems. 115, 279–294 (2021). https://doi.org/10.1016/J.FUTURE.2020.08.005
[13]Elouardighi, A., Maghfour, M., Hammia, H.: Collecting and processing arabic facebook comments for sentiment analysis. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). 10563 LNCS, 262–274 (2017). https://doi.org/10.1007/978-3-319-66854-3_20/COVER
[14]Bird, S., Loper, E.: NLTK: The Natural Language Toolkit. In: Proceedings of the ACL Interactive Poster and Demonstration Sessions. pp. 214–217. Association for Computational Linguistics, Spain (2004)
[15]Alghamdi, N., Assiri, F.: A comparison of fasttext implementations using arabic text classification. In: Advances in Intelligent Systems and Computing. pp. 306–311. Springer Verlag (2020)