Optimal Trained Bi-Long Short Term Memory for Aspect Based Sentiment Analysis with Weighted Aspect Extraction
DOI:
https://doi.org/10.13052/jwe1540-9589.2176Keywords:
Aspect-based Sentiment Analysis, Stanford Dependency Passer, Association Rule Mining, Optimized Bi-LSTM, OptimizationAbstract
Sentiment analysis based on aspects seeks to anticipate the polarities of sentiment in specified targets related to the text data. Several studies have shown a strong interest in using an attention network to represent the target as well as context on generating an efficient representation of features used for tasks while sentiment classification. Still, the attention score computation of the target using an average vector for context is unequal. While the interaction mechanism is simplistic, it needs to be overhauled. Therefore, this paper intends to introduce a novel aspect-based sentiment analysis with three phases: (i) Preprocessing, (ii) Aspect Sentiment Extraction, (iii) Classification. Initially, the input data is given to the preprocessing phase, in which the tokenization, lemmatization, and stop word removal are performed. From the preprocessed data, the weighted implicit and weighted explicit extraction is determined in the Aspect Sentiment Extraction. Moreover, the weighted implicit aspect extraction is done by Stanford Dependency Passer (SDP) method, and the weighted explicit extraction is done through proposed Association Rule Mining (ARM). Subsequently, the extracted features are provided to the classification phase in which the Optimized Bi-LSTM is utilized. For making the classification more accurate and precise, it is planned to tune the weights of Bi-LSTM optimally. For this purpose, an Opposition Learning Cat and Mouse-Based Optimization (OLCMBO) Algorithm will be introduced in this work. In the end, the outcomes of the presented approach are calculated to the extant approaches with respect to different measures like F1-measure, specificity, Negative Predictive Value (NPV), accuracy, False Negative Rate (FNR), sensitivity, precision, False Positive Rate(FPR), and Matthew’s correlation coefficient, respectively.
Downloads
References
Feiyang Ren, Liangming Feng, Sheng Cheng, “DNet: A lightweight and efficient model for aspect based sentiment analysis”, Expert Systems with Applications 19 March 2020 Volume 151 (Cover date: 1 August 2020) Article 113393.
Reinald Kim, Amplayo Seanie, Lee Min Song, “Incorporating product description to sentiment topic models for improved aspect-based sentiment analysis”, Information Sciences 1 May 2018 Volumes 454–455 (Cover date: July 2018) Pages 200–215.
C. R. Aydin and T. Güngör, “Combination of Recursive and Recurrent Neural Networks for Aspect-Based Sentiment Analysis Using Inter-Aspect Relations,” in IEEE Access, vol. 8, pp. 77820–77832, 2020, doi: 10.1109/ACCESS.2020.2990306.
Z. Kastrati, A. S. Imran and A. Kurti, “Weakly Supervised Framework for Aspect-Based Sentiment Analysis on Students’ Reviews of MOOCs,” in IEEE Access, vol. 8, pp. 106799–106810, 2020, doi: 10.1109/ACCESS.2020.3000739.
B. Zhang, X. Li, X. Xu, K.-C. Leung, Z. Chen and Y. Ye, “Knowledge Guided Capsule Attention Network for Aspect-Based Sentiment Analysis,” IEEE/ACM Transactions on Audio, Speech, and Language Processing, vol. 28, pp. 2538–2551, 2020, doi: 10.1109/TASLP.2020.3017093.
S. Ali, G. Wang and S. Riaz, “Aspect Based Sentiment Analysis of Ridesharing Platform Reviews for Kansei Engineering,” IEEE Access, vol. 8, pp. 173186–173196, 2020, doi: 10.1109/ACCESS.2020.3025823.
M. Shams, N. Khoshavi and A. Baraani-Dastjerdi, “LISA: Language-Independent Method for Aspect-Based Sentiment Analysis,” IEEE Access, vol. 8, pp. 31034–31044, 2020, doi: 10.1109/ACCESS.2020.2973587.
Alamanda, M.S. Aspect-based sentiment analysis search engine for social media data. CSIT 8, 193–197 (2020). https://doi.org/10.1007/s40012-020-00295-3
Karagoz, P., Kama, B., Ozturk, M. et al. A framework for aspect based sentiment analysis on turkish informal texts. J Intell Inf Syst 53, 431–451 (2019). https://doi.org/10.1007/s10844-019-00565-w
A. Ishaq, S. Asghar and S. A. Gillani, “Aspect-Based Sentiment Analysis Using a Hybridized Approach Based on CNN and GA,” IEEE Access, vol. 8, pp. 135499–135512, 2020, doi: 10.1109/ACCESS.2020.3011802.
Z. Jia, X. Bai and S. Pang, “Hierarchical Gated Deep Memory Network With Position-Aware for Aspect-Based Sentiment Analysis,” IEEE Access, vol. 8, pp. 136340–136347, 2020, doi: 10.1109/ACCESS.2020.3011318.
N. Li, C. -Y. Chow and J. -D. Zhang, “SEML: A Semi-Supervised Multi-Task Learning Framework for Aspect-Based Sentiment Analysis,” IEEE Access, vol. 8, pp. 189287–189297, 2020, doi: 10.1109/ACCESS.2020.3031665.
Devi Sri Nandhini, M., Pradeep, G. A Hybrid Co-occurrence and Ranking-based Approach for Detection of Implicit Aspects in Aspect-Based Sentiment Analysis. SN COMPUT. SCI. 1, 128 (2020). https://doi.org/10.1007/s42979-020-00138-7
Al-Smadi, M., Talafha, B., Al-Ayyoub, M. et al. Using long short-term memory deep neural networks for aspect-based sentiment analysis of Arabic reviews. Int. J. Mach. Learn. & Cyber. 10, 2163–2175 (2019). https://doi.org/10.1007/s13042-018-0799-4
Ikram, M.T., Afzal, M.T. Aspect based citation sentiment analysis using linguistic patterns for better comprehension of scientific knowledge. Scientometrics 119, 73–95 (2019). https://doi.org/10.1007/s11192-019-03028-9
J. Zhou, S. Jin and X. Huang, “ADeCNN: An Improved Model for Aspect-Level Sentiment Analysis Based on Deformable CNN and Attention,” IEEE Access, vol. 8, pp. 132970–132979, 2020, doi: 10.1109/ACCESS.2020.3010802.
S. M. Al-Ghuribi, S. A. Mohd Noah and S. Tiun, “Unsupervised Semantic Approach of Aspect-Based Sentiment Analysis for Large-Scale User Reviews,” IEEE Access, vol. 8, pp. 218592–218613, 2020, doi: 10.1109/ACCESS.2020.3042312.
H. Liu, I. Chatterjee, M. Zhou, X. S. Lu and A. Abusorrah, “Aspect-Based Sentiment Analysis: A Survey of Deep Learning Methods,” IEEE Transactions on Computational Social Systems, vol. 7, no. 6, pp. 1358–1375, Dec. 2020, doi: 10.1109/TCSS.2020.3033302.
W. Meng, Y. Wei, P. Liu, Z. Zhu and H. Yin, “Aspect Based Sentiment Analysis With Feature Enhanced Attention CNN-BiLSTM,” IEEE Access, vol. 7, pp. 167240–167249, 2019, doi: 10.1109/ACCESS.2019.2952888.
K. Xu, H. Zhao and T. Liu, “Aspect-Specific Heterogeneous Graph Convolutional Network for Aspect-Based Sentiment Classification,” IEEE Access, vol. 8, pp. 139346–139355, 2020, doi: 10.1109/ACCESS.2020.3012637.
S. Rida-E-Fatima et al., “A Multi-Layer Dual Attention Deep Learning Model With Refined Word Embeddings for Aspect-Based Sentiment Analysis,” IEEE Access, vol. 7, pp. 114795–114807, 2019, doi: 10.1109/ACCESS.2019.2927281.
Liu, N., Shen, B., Zhang, Z. et al. Attention-based Sentiment Reasoner for aspect-based sentiment analysis. Hum. Cent. Comput. Inf. Sci. 9, 35 (2019). https://doi.org/10.1186/s13673-019-0196-3
Donatas Meškelë, Flavius Frasincar, “ALDONAr: A hybrid solution for sentence-level aspect-based sentiment analysis using a lexicalized domain ontology and a regularized neural attention model”, Information Processing & Management 31 January 2020 Volume 57, Issue 3 (Cover date: May 2020) Article 102211.
Ning Liu, Bo Shen, “ReMemNN: A novel memory neural network for powerful interaction in aspect-based sentiment analysis”, Neurocomputing8 February 2020 Volume 395 (Cover date: 28 June 2020) Pages 66–77.
Lisa Zhuang, Kim Schouten, Flavius Frasincar, “SOBA: Semi-automated Ontology Builder for Aspect-based sentiment analysis”, Journal of Web Semantics 11 December 2019 Volume 60 (Cover date: January 2020) Article 100544.
Kai Shuang, Qianqian Yang, Mengyu Gu, “Feature distillation network for aspect-based sentiment analysis”, Information Fusion 16 March 2020 Volume 61 (Cover date: September 2020) Pages 13–23.
Sixing Wu, Yuanfan Xu, Xing Li, “Aspect-based sentiment analysis via fusing multiple sources of textual knowledge”, Knowledge-Based Systems 25 July 2019 Volume 183 (Cover date: 1 November 2019) Article 104868.
Ning Liu, Bo Shen, “Aspect-based sentiment analysis with gated alternate neural network”, Knowledge-Based Systems 2 September 2019 Volume 188 (Cover date: 5 January 2020) Article 105010.
Chao Yang, Hefeng Zhang, Keqin Li, “Aspect-based sentiment analysis with alternating coattention networks”, Information Processing & Management 21 January 2019 Volume 56, Issue 3 (Cover date: May 2019) Pages 463–478.
Xingwei Tan, Yi Cai, Qing Li, “Improving aspect-based sentiment analysis via aligning aspect embedding”, Neurocomputing 12 December 2019 Volume 383 (Cover date: 28 March 2020) Pages 336–347.
A F Hidayatullah and M R Ma’arif, “Pre-processing Tasks in Indonesian Twitter Messages”, Journal of Physics: Conference Series, 2017.
Skorkovská, Lucie. Application of Lemmatization and Summarization Methods in Topic Identification Module for Large Scale Language Modeling Data Filtering. 7499. 10.1007/978-3-642-32790-2_23, 2012.
Zainuddin, N., Selamat, A., Ibrahim, R. Hybrid sentiment classification on twitter aspect-based sentiment analysis. Appl Intell 48, 1218–1232 (2018). https://doi.org/10.1007/s10489-017-1098-6
Rahman, Md, Watanobe, Yutaka, Nakamura, Keita. (2021). A Bidirectional LSTM Language Model for Code Evaluation and Repair. Symmetry. 13. 247. 10.3390/sym13020247.
Dehghani, Mohammad, Štìpán Hubálovskı, and Pavel Trojovskı. 2021. “Cat and Mouse Based Optimizer: A New Nature-Inspired Optimization Algorithm” Sensors 21, no. 15: 5214. https://doi.org/10.3390/s21155214.
Chakraborty, F., Roy, P.K., Nandi, D. Oppositional elephant herding optimization with dynamic Cauchy mutation for multilevel image thresholding. Evol. Intel. 12, 445–467 (2019). https://doi.org/10.1007/s12065-019-00238-1
Fouad, Ahmed. (2015). Social Spider Optimization Algorithm. 10.13140/RG.2.1.4314.5361.
Seyyed Hamid Samareh Moosavi, Vahid Khatibi Bardsiri, “Poor and rich optimization algorithm: A new human-based and multi populations algorithm”, Engineering Applications of Artificial Intelligence, Volume 86, (Cover date: November 2019), Pages 165–181, 26 September 2019.
Sharma, Harish, Garima Hazrati, and Jagdish Chand Bansal. “Spider monkey optimization algorithm.” Evolutionary and swarm intelligence algorithms. Springer, Cham, 2019. 43–59.
Yadav, Rohan Kumar, et al. “Positionless aspect based sentiment analysis using attention mechanism.” Knowledge-Based Systems 226 (2021): 107136.
https://www.kaggle.com/datafiniti/consumer-reviews-of-amazon-products.
Haoran Yan, Yi Qin, Haizhou Chen, “Long-term gear life prediction based on ordered neurons LSTM neural networks”, Measurement 11 July 2020 Volume 165 (Cover date: 1 December 2020) Article 108205.
Ling-Jing Kao, Chih Chou Chiu, “Application of integrated recurrent neural network with multivariate adaptive regression splines on SPC-EPC process”, Journal of Manufacturing Systems, vol. 57, pp. 109–118, 2020.
Shile Zhang, Mohamed Abdel-Aty, Ou Zheng, “Modeling pedestrians’ near-accident events at signalized intersections using gated recurrent unit (GRU)”, Accident Analysis & Prevention 28 October 2020 Volume 148 (Cover date: December 2020) Article 105844.
H.Z. Wang, G.B. Wang, G.Q. Li, J.C. Peng, and Y.T. Liu, “ Deep belief network based deterministic and probabilistic wind speed forecasting approach”, Applied Energy, vol. 182, pp. 80–93, 2016.
Krishnan, Hema, M. Sudheep Elayidom, and T. Santhanakrishnan. “Weighted holoentropy-based features with optimised deep belief network for automatic sentiment analysis: reviewing product tweets.” Journal of Experimental & Theoretical Artificial Intelligence (2021): 1–29.
