Fine-grained Sentiment-enhanced Collaborative Filtering-based Hybrid Recommender System
DOI:
https://doi.org/10.13052/jwe1540-9589.2273Keywords:
E-learning adaptation, recommender system, fine-grained sentiment analysis, collaborative filtering, natural language processingAbstract
Developing online educational platforms necessitates the incorporation of new intelligent procedures in order to improve long-term student experience. Presently, e-learning recommender systems rely on deep learning methods to recommend appropriate e-learning materials to the students based on their learner profiles. Fine-grained sentiment analysis (FSA) can be leveraged to enrich the recommender system. User-posted reviews and rating data are vital in accurately directing the student to the appropriate e-learning resources based on posted comments by comparable learners. In this work, a new e-learning recommendation system is proposed based on individualization and FSA. A hybrid framework is provided by integrating alternating least square (ALS) based collaborative filtering (CF) with FSA to generate an effective e-content recommendation named HCFSAR. ALS attempts to capture the learner’s latent factors based on their selections of interest to build the learner profile. Three FSA models based on attention mechanisms and bidirectional long short-term memory (bi-LSTM) are suggested and used to train twelve models in order to predict new ratings from learner-posted book reviews based on the extracted learner profile. HCFSAR used multiplication word embeddings for stronger corpus representation that were trained on a dataset generated for an educational context and showed a better accuracy of 93.39% for the best model entitled MHAM based ABHR-2 with multiplication (MHAAM), which performed better than other models. A tailored dataset that has been created by scraping reviews of different e-learning resources is leveraged to train different proposed models and validate against public datasets.
Downloads
References
Ahmed, Z., and Wang, J. (2023). A fine-grained deep learning model using embedded-CNN with BiLSTM for exploiting product sentiments. Alexandria Engineering Journal, 65, 731–747. DOI: https://doi.org/10.1016/j.aej.2022.10.037.
Alatrash R, Ezaldeen H, Misra R, Priyadarshini R, 2021. Sentiment Analysis Using Deep Learning for Recommendation in E-Learning Domain. InProgress in Advanced Computing and Intelligent Engineeringpp. 123–133. Springer, Singapore. https://doi.org/10.1007/978-981-33-4299-6_10.
Alatrash R., Ezaldeen H., 2021. rawaa123/Dataset GitHub Retrieved from https://github.com/rawaa123/Dataset/.
Alencar, M., and Netto, J, 2020. Measuring student emotions in an online learning environment. In Proceedings of the 12th International Conference on Agents and Artificial Intelligence (Vol. 10, p. 0008956505630569).
Aljunid, M. F., and Manjaiah, D. H. (2019). Movie recommender system based on collaborative filtering using apache spark. In Data Management, Analytics and Innovation: Proceedings of ICDMAI 2018, Volume 2 (pp. 283–295). Springer Singapore.
Anwar, T., Uma, V., and Srivastava, G. (2021) Rec-cfsvd++: Implementing recommendation system using collaborative filtering and singular value decomposition (svd)++. International Journal of Information Technology & Decision Making, 20(04), 1075–1093.
Anwar, T., Uma, V., and Srivastava, G. (2021) Rec-cfsvd++: Implementing recommendation system using collaborative filtering and singular value decomposition (svd)++. International Journal of Information Technology & Decision Making, 20(04), 1075–1093
Awan MJ, Khan RA, Nobanee H, Yasin A, Anwar SM, Naseem U, Singh VP, 2021 Jan. A Recommendation engine for predicting movie ratings using a big data approach. Electronics.;10(10):1215. https://doi.org/10.3390/electronics10101215.
Bahdanau D, Cho K, Bengio Y, 2014 Sep 1. Neural machine translation by jointly learning to align and translate. arXiv preprint arXiv:1409.0473.
Bhanuse R, Mal S, 2021 Mar 25. A Systematic Review: Deep Learning based E-Learning Recommendation System. In2021 International Conference on Artificial Intelligence and Smart Systems (ICAIS) pp. 190–197. IEEE.
Bobadilla, J. E. S. U. S., Serradilla, F., and Hernando, A, 2009. Collaborative filtering adapted to recommender systems of e-learning. Knowledge-Based Systems, 22(4), 261–265.
Bourkoukou, O., and El Bachari, E, 2018. Toward a hybrid recommender system for e-learning personnalization based on data mining techniques. JOIV: International Journal on Informatics Visualization, 2(4), 271–278.
Bourkoukou, O., and El Bachari, E, 2018. Toward a hybrid recommender system for e-learning personnalization based on data mining techniques. JOIV: International Journal on Informatics Visualization, 2(4), 271–278,.
Bu, J., Ren, L., Zheng, S., Yang, Y., Wang, J., Zhang, F., and Wu, W, 2021. ASAP: A Chinese Review Dataset Towards Aspect Category Sentiment Analysis and Rating Prediction. arXiv preprint arXiv:2103.06605.
Burke R, 2007. Hybrid Web Recommender Systems. In: Brusilovsky P., Kobsa A., Nejdl W. (eds) The Adaptive Web. Lecture Notes in Computer Science, vol 4321. Springer, Berlin, Heidelberg,. https://doi.org/10.1007/978-3-540-72079-9_12.
Cai, H., Xia, R., and Yu, J, (2021, August). Aspect-Category-Opinion-Sentiment Quadruple Extraction with Implicit Aspects and Opinions. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) (pp. 340–350).
Cambria, E., Li, Y., Xing, F. Z., Poria, S., and Kwok, K, (2020, October). SenticNet 6: Ensemble application of symbolic and subsymbolic AI for sentiment analysis. In Proceedings of the 29th ACM international conference on information & knowledge management (pp. 105–114).
Cheng J, Dong L, Lapata M, 2016 Jan 25. Long short-term memory-networks for machine reading. arXiv preprint arXiv:1601.06733.
Cordonnier JB, Loukas A, Jaggi M, 2020 Jun 29. Multi-head attention: Collaborate instead of concatenate. arXiv preprint arXiv:2006.16362.
Das, N., and Sagnika, S, 2020. A Subjectivity Detection-Based Approach to Sentiment Analysis. In Machine Learning and Information Processing (pp. 149–160). Springer, Singapore.
Dessí, D., Dragoni, M., Fenu, G., Marras, M., and Recupero, D. R, 2020. Deep learning adaptation with word embeddings for sentiment analysis on online course reviews. In Deep Learning-Based Approaches for Sentiment Analysis (pp. 57–83). Springer, Singapore. https://doi.org/10.1007/978-981-15-1216-2_3.
Ekstrand, M. D., Riedl, J. T., and Konstan, J. A. (2011). Collaborative filtering recommender systems. Foundations and Trends®
in Human–Computer Interaction, 4(2), 81–173.
El Mekki, A., El Mahdaouy, A., Berrada, I., and Khoumsi, A, (2021, June). Domain Adaptation for Arabic Cross-Domain and Cross-Dialect Sentiment Analysis from Contextualized Word Embedding. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (pp. 2824–2837).
Ezaldeen H, Misra R, Bisoy SK, Alatrash R, Priyadarshini R, 2022. A hybrid E-learning recommendation integrating adaptive profiling and sentiment analysis. Journal of Web Semantics. 1;72:100700. https://doi.org/10.1016/j.websem.2021.100700.
Ezaldeen, H., Misra, R., Alatrash, R, 2019. and Priyadarshini, R, “Machine Learning Based Improved Recommendation Model for E-learning,” International Conference on Intelligent Computing and Remote Sensing (ICICRS), 2019, pp. 1–6, doi: 10.1109/ICICRS46726.2019.9555866.
Ezaldeen, H., Misra, R., Alatrash, R, 2020. and Priyadarshini, R., semantically enhanced machine learning approach to recommend e-learning content. International Journal of Electronic Business. 15(4):389–413. doi: 10.1504/IJEB.2020.111095.
Fu, Y., Liao, J., Li, Y., Wang, S., Li, D., and Li, X. (2021). Multiple perspective attention based on double BiLSTM for aspect and sentiment pair extract. Neurocomputing, 438, 302–311. https://doi.org/10.1016/j.neucom.2021.01.079.
Garg, R., Singhal, M., Singh, P., Nagrath, P. (2023). Sentiment Analysis of Reviews Using Bi-LSTM Using a Fine-Grained Approach. In: Khanna, A., Gupta, D., Kansal, V., Fortino, G., Hassanien, A.E. (eds) Proceedings of Third Doctoral Symposium on Computational Intelligence. Lecture Notes in Networks and Systems, vol 479. Springer, Singapore. https://doi.org/10.1007/978-981-19-3148-2_71.
Gong, C., Yu, J., and Xia, R, (2020, November). Unified Feature and Instance Based Domain Adaptation for End-to-End Aspect-based Sentiment Analysis. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) (pp. 7035–7045).
Guner L., Coyne E., Smit J, March, 2019. Sentiment analysis for Amazon.com reviews. https://www.researchgate.net/publication/332622380.
Hameed, M. A., Al Jadaan, O., and Ramachandram, S. (2012). Collaborative filtering based recommendation system: A survey. International Journal on Computer Science and Engineering, 4(5), 859.
Jeevamol, J., and Renumol, V. G, 2021. An ontology-based hybrid e-learning content recommender system for alleviating the cold-start problem. Education and Information Technologies, 1-30.
Ke, P., Ji, H., Liu, S., Zhu, X., and Huang, M, 2019. SentiLARE: Sentiment-aware language representation learning with linguistic knowledge,. arXiv preprint arXiv:1911.02493.
Kim, Y. (2014). Convolutional neural networks for sentence classification. arXiv:1408.5882.
Kingma, D. P., and Ba, J. (2014). Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980.
Klašnja-Milićević, A., Ivanović, M., Vesin, B., and Budimac, Z, 2018. Enhancing e-learning systems with personalized recommendation based on collaborative tagging techniques. Applied Intelligence, 48(6), 1519–1535.
Koffi, D. D. A. S. L., Ouattara, N., Mambe, D. M., Oumtanaga, S., and ADJE, A., 2021. Courses Recommendation Algorithm Based On Performance Prediction In E-Learning. IJCSNS, 21(2), 148.
Kudori DS, 2021 Jun. Event Recommendation System using Hybrid Method Based on Mobile Device. Journal of Information Technology and Computer Science. 15;6(1):107–16. https://doi.org/10.25126/jitecs.202161221.
Kumar, A., Seth, S., Gupta, S., and Maini, S, 2021. Sentic computing for aspect-based opinion summarization using multi-head attention with feature pooled pointer generator network. Cognitive Computation, 1–19.
Kumar, R., Pannu, H. S., and Malhi, A. K. (2020). Aspect-based sentiment analysis using deep networks and stochastic optimization. Neural Computing and Applications, 32(8), 3221–3235. https://doi.org/10.1007/s00521-019-04105-z.
Li J, Tu Z, Yang B, Lyu MR, Zhang T, 2018 Oct 24. Multi-head attention with disagreement regularization. arXiv preprint arXiv:1810.10183.
Lin, Y., Fu, Y., Li, Y., Cai, G., and Zhou, A. (2021). Aspect-based sentiment analysis for online reviews with hybrid attention networks. World Wide Web, 24(4), 1215–1233. https://doi.org/10.1007/s11280-021-00898-z.
Liu, X. (2019). A collaborative filtering recommendation algorithm based on the influence sets of e-learning group’s behavior. Cluster Computing 22, no. 2, 2823–2833. https://doi.org/10.1007/s10586-017-1560-6.
López, M., Valdivia, A., Martínez-Cámara, E., Luzón, M. V., and Herrera, F, 2019. E2SAM: Evolutionary ensemble of sentiment analysis methods for domain adaptation. Information Sciences, 480, 273–286.
Madani, Y., Ezzikouri, H., Erritali, M., and Hssina, B, 2020. Finding optimal pedagogical content in an adaptive e-learning platform using a new recommendation approach and reinforcement learning. Journal of Ambient Intelligence and Humanized Computing, 11(10), 3921–3936.
Mikolov, T., Chen, K., Corrado, G., and Dean, J, 2013a. estimation of word representations in vector space. Efficient. arXiv preprint arXiv: 1301.3781.
Mikolov, T., Chen, K., Corrado, G., and Dean, J. (2013a). Efficient estimation of word representations in vector space. arXiv:1301.3781.
Mikolov, T., I., Chen, K., Corrado, G. S., and Dean, J, 2013b. Distributed representations of words and phrases and their compositionality. In Advances in neural information processing systems (pp. 3111–3119).
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., and Dean, J. (2013b). Distributed representations of words and phrases and their compositionality. arXiv:1310.4546.
Mondal, B., Patra, O., Mishra, S., and Patra, P, (2020, March). A course recommendation system based on grades. In 2020 international conference on computer science, engineering and applications (ICCSEA) (pp. 1–5). IEEE.
Mostafa MM, 2018. Mining and mapping halal food consumers: A geo-located Twitter opinion polarity analysis. Journal of food products marketing. Oct 3;24(7):858–79. doi: 10.1080/10454446.2017.1418695.
Mounika A, Saraswathi S, 2021. Design of Book Recommendation System Using Sentiment Analysis. InEvolutionary Computing and Mobile Sustainable Networks (pp. 95–101). Springer, Singapore.
Ni P, Li Y, Chang V, 2020 Jul. Recommendation and Sentiment Analysis Based on Consumer Review and Rating. International Journal of Business Intelligence Research (IJBIR). 1;11(2):11–27. DOI: 10.4018/ IJBIR.2020070102
P. Bojanowski, E. Grave, A. Joulin, T. Mikolov, 2017. Enriching word vectors with subword information. Transactions of the Association for Computational Linguistics, 5, 135–146. https://doi.org/10.1162/tacl_a_00051.
Pasquier, C., da Costa Pereira, C., and Tettamanzi, A. G, (2020, August). Extending a fuzzy polarity propagation method for multi-domain sentiment analysis with word embedding and pos tagging. In ECAI 2020: 24th European Conference on Artificial Intelligence, August 29–September 8, Santiago de Compostela, Spain (Vol. 325, pp. 2140–2147). IOS Press.
Pennington, J., Socher, R., and Manning, C. D. (2014, October). Glove: Global vectors for word representation. In Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP) (pp. 1532–1543).
Priyati, A., Laksito, A.D. and Sismoro, H., 2022, August. The Comparison Study of Matrix Factorization on Collaborative Filtering Recommender System. In 2022 5th International Conference on Information and Communications Technology (ICOIACT) (pp. 177–182). IEEE.
Qamar, A. M., and Alassaf, M, 2020. Improving Sentiment Analysis of Arabic Tweets by One-Way ANOVA. Journal of King Saud University-Computer and Information Sciences. https://doi.org/10.1016/j.jksuci.2020.10.023.
Shu, J., Shen, X., Liu, H., Yi, B., Zhang, Z, 2018. A content-based recommendation algorithm for learning resources. Multimedia Systems, 24(2), 163–173,. https://doi.org/10.1007/s00530-017-0539-8.
Sindhu, C., Sasmal, B., Gupta, R., and Prathipa, J, 2021. Subjectivity detection for sentiment analysis on Twitter data. In Artificial Intelligence Techniques for Advanced Computing Applications (pp. 467–476). Springer, Singapore.
Socher, R., Perelygin, A., Wu, J., Chuang, J., Manning, C. D., Ng, A. Y., and Potts, C. (2013, October). Recursive deep models for semantic compositionality over a sentiment treebank. In Proceedings of the 2013 conference on empirical methods in natural language processing (pp. 1631–1642).
Susanto, Y., Cambria, E., Ng, B. C., and Hussain, A, 2021. Ten Years of Sentic Computing. Cognitive Computation, 1–19.
Tarus, J. K., Niu, Z., and Kalui, D, 2018. A hybrid recommender system for e-learning based on context awareness and sequential pattern mining. Soft Computing, 22(8), 2449–2461.
Tiwari, D., and Nagpal, B, (2021, March). Ensemble Sentiment Model: Bagging with Linear Discriminant Analysis (BLDA). In 2021 8th International Conference on Computing for Sustainable Global Development (INDIACom) (pp. 474–480). IEEE.
Turnip, R., Nurjanah, D., and Kusumo, D. S., 2017, November. Hybrid recommender system for learning material using content-based filtering and collaborative filtering with good learners’ rating. In 2017 IEEE Conference on e-Learning, e-Management and e-Services (IC3e) (pp. 61–66). IEEE.
Vaishali, F., Archana, G., Monika, G., Vidya, G., and Sanap, M, 2016. E-learning recommendation system using fuzzy logic and ontology. Int. J. Adv. Res. Comput. Eng. Technol.(Ijarcet), 5(1), 165.
Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser £, Polosukhin I, 2017. Attention is all you need. Advances in neural information processing systems.
Wan, S., and Niu, Z, 2019. A hybrid e-learning recommendation approach based on learners’ influence propagation. IEEE Transactions on Knowledge and Data Engineering, 32(5), 827–840.
Xie, J., Chen, B., Gu, X., Liang, F., and Xu, X. (2019). Self-attention-based BiLSTM model for short text fine-grained sentiment classification. IEEE Access, 7, 180558–180570. doi: 10.1109/ACCESS.2019.2957510.
Xu, G., Meng, Y., Qiu, X., Yu, Z., and Wu, X. (2019). Sentiment analysis of comment texts based on BiLSTM. Ieee Access, 7, 51522-51532. doi: 10.1109/ACCESS.2019.2909919.
Yu HF, Hsieh CJ, Si S, Dhillon I, 2012 Dec 10. Scalable coordinate descent approaches to parallel matrix factorization for recommender systems. In2012 IEEE 12th international conference on data mining (pp. 765–774). IEEE.
Zapata, A., Menéndez, V. H., Prieto, M. E., and Romero, C, 2015. Evaluation and selection of group recommendation strategies for collaborative searching of learning objects. International Journal of Human-Computer Studies, 76, 22–39.
Zhang, Q., Lu, J., and Zhang, G, 2021. Recommender Systems in E-learning. Journal of Smart Environments and Green Computing, 1, 76–89. https://doi.org/10.20517/jsegc.2020.06.
Ziegler, C. N., McNee, S. M., Konstan, J. A., and Lausen, G. (2005, May). Improving recommendation lists through topic diversification. In Proceedings of the 14th international conference on World Wide Web (pp. 22–32). DOI: https://doi.org/10.1145/1060745.1060754.
