International Journal of Modern Education and Computer Science (IJMECS)
IJMECS Vol. 15, No. 5, 8 Oct. 2023
Cover page and Table of Contents: PDF (size: 573KB)
Enhancing Emotion Detection with Adversarial Transfer Learning in Text Classification
Full Text (PDF, 573KB), PP.28-41
Views: 0 Downloads: 0
Author(s)
Ashritha R Murthy
1,*
Anil Kumar K. M.
1
Abdulbasit A. Darem
2
Index Terms
Emotion detection, Natural Language Processing, Adversarial transfer learning, Text analysis, Convolutional neural networks, Deep learning
Abstract
Emotion detection in text-based content, such as opinions, comments, and textual interactions, holds pivotal significance in enabling computers to comprehend human emotions. This symbiotic understanding between machines and human languages, powered by technological advancements like Natural Language Processing and artificial intelligence, has revolutionized the dynamics of human-computer interaction. The complexity of emotion detection, although challenging, has surged in importance across diverse domains, encompassing customer service, healthcare, and surveillance of social media interactions. Within the realm of text analysis, the quest for accurate emotion detection necessitates a profound exploration of cutting-edge methodologies. This pursuit is further intensified by the imperative to fortify models against adversarial attacks, a pressing concern in deep learning-based approaches. To address this critical challenge, this paper introduces a pioneering technique—adversarial transfer learning—specifically tailored for emotion classification in text analysis. By infusing adversarial training into the model architecture, the proposed approach emerges a solution that not only mitigates the vulnerabilities of existing methods but also fortifies the model against adversarial intrusions. In realizing the potential of the proposed approach, a diverse array of datasets is harnessed for comprehensive training. The empirical results vividly demonstrate the efficacy of this approach, showcasing its superior performance when compared to state-of-the-art methodologies. Notably, the suggested approach yields in advancements in classification accuracy. In particular, the deployment of the Adversarial transfer learning methodology has increased in accuracy of 17.35%. This study, therefore, encapsulates a dual achievement: the introduction of an innovative approach that leverages adversarial transfer learning for emotion classification, and the subsequent empirical validation of its unparalleled efficiency. The implications reverberate across multiple sectors, extending the horizons of accurate emotion detection and laying a foundation for the next stride in human-computer interaction and emotion analysis.
Cite This Paper
Ashritha R Murthy, Anil Kumar K M, Abdulbasit A. Darem, "Enhancing Emotion Detection with Adversarial Transfer Learning in Text Classification", International Journal of Modern Education and Computer Science(IJMECS), Vol.15, No.5, pp. 28-41, 2023. DOI:10.5815/ijmecs.2023.05.03
Reference
[1]Tyng, C. M., Amin, H. U., Saad, M. N., & Malik, A. S. (2017). The influences of emotion on learning and memory. Frontiers in psychology, 8, 1454.
[2]Paul Ekman, Wallace Friesen (1980) Facial Signs of Emotional Expressions Journal of personality and social psychology, Vol 39, No. 6, 1125-1134.
[3]Kopelman, Shirli, Ashleigh Shelby Rosette, and Leigh Thompson. "The three faces of Eve: Strategic displays of positive, negative, and neutral emotions in negotiations." Organizational Behavior and Human Decision Processes 99.1 (2006): 81-101
[4]Gross, James J., et al. "Emotion and aging: Experience, expression, and control." Psychology and aging 12.4 (1997): 590.
[5]Gunes H, Pantic M (2010) Automatic, dimensional and continuous emotion recognition. Int J Synth Emot (IJSE) 1(1):68–99.
[6]Nandwani, P., & Verma, R. (2021). A review on sentiment analysis and emotion detection from text. Social Network Analysis and Mining, 11(1), 1-19.
[7]Alswaidan, N., & Menai, M. E. B. (2020). A survey of state-of-the-art approaches for emotion recognition in text. Knowledge and Information Systems, 62(8), 2937-2987.
[8]Jamal, N., Xianqiao, C., Hussain Abro, J., & Tukhtakhunov, D. (2020, December). Sentimental analysis based on hybrid approach of latent dirichlet allocation and machine learning for large-scale of imbalanced twitter data. In 2020 3rd International Conference on Algorithms, Computing and Artificial Intelligence (pp. 1-7).
[9]Wen, S., & Wan, X. (2014, June). Emotion classification in microblog texts using class sequential rules. In Proceedings of the AAAI Conference on Artificial Intelligence (Vol. 28, No. 1).
[10]Kusal, S., Patil, S., Choudrie, J., Kotecha, K., Vora, D., & Pappas, I. (2022). A Review on Text-Based Emotion Detection--Techniques, Applications, Datasets, and Future Directions. arXiv preprint arXiv:2205.03235.
[11]Lan, M., Tan, C. L., Su, J., & Lu, Y. (2008). Supervised and traditional term weighting methods for automatic text categorization. IEEE transactions on pattern analysis and machine intelligence, 31(4), 721-735.
[12]Alsmadi, I., Ahmad, K., Nazzal, M., Alam, F., Al-Fuqaha, A., Khreishah, A., & Algosaibi, A. (2021). Adversarial attacks and defenses for social network text processing applications: Techniques, challenges and future research directions. arXiv preprint arXiv:2110.13980.
[13]Sander, D., Grandjean, D., & Scherer, K. R. (2005). A systems approach to appraisal mechanisms in emotion. Neural networks, 18(4), 317-352.
[14]Lench, H. C., Flores, S. A., & Bench, S. W. (2011). Discrete emotions predict changes in cognition, judgment, experience, behavior, and physiology: a meta-analysis of experimental emotion elicitations. Psychological bulletin, 137(5), 834.
[15]Paul Ekman, Wallace Friesen (1980) Facial Signs of Emotional Expressions Journal of personality and social psychology, Vol 39, No. 6, 1125-1134.
[16]Plutchik R. A general psychoevolutionary theory of emotion. Amsterdam, Netherlands: Elsevier; 1980 (pp. 3–33).
[17]Warriner, A. B., Kuperman, V., & Brysbaert, M. (2013). Norms of valence, arousal, and dominance for 13,915 English lemmas. Behavior research methods, 45, 1191-1207.
[18]Russell JA. A circumplex model of affect. J PersSoc Psychol. 1980;39(6):1161
[19]Plutchik R. A general psychoevolutionary theory of emotion. Amsterdam, Netherlands: Elsevier; 1980 (pp. 3–33).
[20]Acheampong, F. A., Wenyu, C., & Nunoo‐Mensah, H. (2020). Text‐based emotion detection: Advances, challenges, and opportunities. Engineering Reports, 2(7), e12189.
[21]Algoe, S. B., & Haidt, J. (2009). Witnessing excellence in action: The ‘other-praising’emotions of elevation, gratitude, and admiration. The journal of positive psychology, 4(2), 105-127.
[22]Huan, H., Guo, Z., Cai, T., & He, Z. (2022). A text classification method based on a convolutional and bidirectional long short-term memory model. Connection Science, 34(1), 2108-2124.
[23]Basiri, M. E., Nemati, S., Abdar, M., Cambria, E., & Acharya, U. R. (2021). ABCDM: An attention-based bidirectional CNN-RNN deep model for sentiment analysis. Future Generation Computer Systems, 115, 279-294.
[24]Le, A. C. (2018, November). Integrating grammatical features into cnn model for emotion classification. In 2018 5th NAFOSTED Conference on Information and Computer Science (NICS) (pp. 243-249). IEEE.
[25]Pradhan, T., Kumar, P., & Pal, S. (2021). CLAVER: an integrated framework of convolutional layer, bidirectional LSTM with attention mechanism based scholarly venue recommendation. Information Sciences, 559, 212-235.
[26]Liang, S., Zhu, B., Zhang, Y., Cheng, S., & Jin, J. (2020, December). A Double Channel CNN-LSTM Model for Text Classification. In 2020 IEEE 22nd International Conference on High Performance Computing and Communications; IEEE 18th International Conference on Smart City; IEEE 6th International Conference on Data Science and Systems (HPCC/SmartCity/DSS) (pp. 1316-1321). IEEE.
[27]Ghosal, D., Majumder, N., Poria, S., Chhaya, N., & Gelbukh, A. (2019). Dialoguegcn: A graph convolutional neural network for emotion recognition in conversation. arXiv preprint arXiv:1908.11540.
[28]Trueman, T. E., & Cambria, E. (2021). A convolutional stacked bidirectional LSTM with a multiplicative attention mechanism for aspect category and sentiment detection. Cognitive Computation, 13, 1423-1432.
[29]Cahyani, D. E., Wibawa, A. P., Prasetya, D. D., Gumilar, L., Akhbar, F., & Triyulinar, E. R. (2022, September). Emotion Detection in Text Using Convolutional Neural Network. In 2022 International Conference on Electrical and Information Technology (IEIT) (pp. 372-376). IEEE.
[30]Alsmadi, I., Ahmad, K., Nazzal, M., Alam, F., Al-Fuqaha, A., Khreishah, A., & Algosaibi, A. (2021). Adversarial attacks and defenses for social network text processing applications: Techniques, challenges and future research directions. arXiv preprint arXiv:2110.13980.
[31]Hajek, P., Barushka, A., & Munk, M. (2020). Fake consumer review detection using deep neural networks integrating word embeddings and emotion mining. Neural Computing and Applications, 32, 17259-17274.
[32]Alsmadi, I., Aljaafari, N., Nazzal, M., Alhamed, S., Sawalmeh, A. H., Vizcarra, C. P., ... & Al-Humam, A. (2022). Adversarial machine learning in text processing: A literature survey. IEEE Access, 10, 17043-17077.
[33]Han, J., Zhang, Z., Cummins, N., & Schuller, B. (2019). Adversarial training in affective computing and sentiment analysis: Recent advances and perspectives. IEEE Computational Intelligence Magazine, 14(2), 68-81.
[34]Olah, J., Baruah, S., Bose, D., & Narayanan, S. (2021). Cross domain emotion recognition using few-shot knowledge transfer. arXiv preprint arXiv:2110.05021.
[35]Sailunaz, K., & Alhajj, R. (2019). Emotion and sentiment analysis from Twitter text. Journal of Computational Science, 36, 101003.
[36]Acheampong, F. A., Nunoo-Mensah, H., & Chen, W. (2021). Transformer models for text-based emotion detection: a review of BERT-based approaches. Artificial Intelligence Review, 1-41.
[37]Jamal. N., Xianqiao, C. & Aldabbas, H.(2019). Deep learning-based sentimental analysis for large-scale imbalance twitter data. Future Internet, 11(9), 190.
[38]Yao, L., Mao, C., & Luo, Y. (2019, July). Graph convolutional networks for text classification. In Proceedings of the AAAI conference on artificial intelligence (Vol. 33, No. 01, pp. 7370-7377).
[39]Alm, C. O., Roth, D., & Sproat, R. (2005, October). Emotions from the text: machine learning for text-based emotion prediction. In Proceedings of human language technology conference and conference on empirical methods in natural language processing (pp. 579-586).
[40]Bhuvaneshwari, P., Rao, A. N., Robinson, Y. H., & Thippeswamy, M. N. (2022). Sentiment analysis for user reviews using Bi-LSTM self-attention-based CNN model. Multimedia Tools and Applications, 81(9), 12405-12419.
[41]Huan, H., Guo, Z., Cai, T., & He, Z. (2022). A text classification method based on a convolutional and bidirectional long short-term memory model. Connection Science, 34(1), 2108-2124
[42]Hajek, P., Barushka, A., & Munk, M. (2020). Fake consumer review detection using deep neural networks integrating word embeddings and emotion mining. Neural Computing and Applications, 32(23), 17259-17274
[43]Tammina, S., & Annareddy, S. (2020, January). Sentiment analysis on customer reviews using convolutional neural network. In 2020 International Conference on Computer Communication and Informatics (ICCCI) (pp. 1-6). IEEE.