Joint Representation of Entities and Relations via Graph Attention Networks for Explainable Recommendations
DOI:
https://doi.org/10.13052/jwe1540-9589.2243Keywords:
Recommender systems, Knowledge graphs, graph attention networks, graph embedding, Machine Learning, graph representation learningAbstract
The latest advances in Graph Neural Networks (GNNs), have provided important new ideas for solving the Knowledge Graph (KG) representation problem for recommendation purposes. Although GNNs have an effective graph representation capability, the nonlinear transformations over the layers cause a loss of semantic information and make the generated embeddings hard to explain. In this paper, we investigate the potential of large KGs to perform interpretable recommendation using Graph Attention Networks (GATs). Our goal is to fully exploit the semantic information and preserve inherent knowledge ported in relations by jointly learning low-dimensional embeddings for nodes (i.e., entities) and edges (i.e., properties). Specifically, we feed the original data with additional knowledge from the Linked Open Data (LOD) cloud, and apply GATs to generate a vector representation for each node on the graph. Experiments conducted on three real-world datasets for the top-K recommendation task demonstrate the state-of-the-art performance of the system proposed. In addition to improving predictive performance in terms of precision, recall, and diversity, our approach fully exploits the rich structured information provided by KGs to offer explanation for recommendations.
Downloads
References
A. Bordes, N. Usunier, A. Garcia-Duran, J. Weston, O. Yakhnenko, ‘Translating embeddings for modeling multi-relational data’, Proc. of the 26th
Conference on Neural Information Processing Systems (NIPS), pp. 2787–2795, Lake Tahoe, Nevada, USA, ACM, 2013.
A. Bouguettaya, H. Zarzour, A. M. Taberkit, A. Kechida, ‘A review on early wildfire detection from unmanned aerial vehicles using deep learning-based computer vision algorithms’, Signal Processing, 190, https://doi.org/10.1016/j.sigpro.2021.108309, 2022.
A. Haghighat, A. Sharma, ‘A computer vision-based deep learning model to detect wrong-way driving using pan–tilt–zoom traffic cameras’, Computer-Aided Civil and Infrastructure Engineering, 38(1), https://doi.org/10.1111/mice.12819, 2023.
B. Y. Lin, X. Chen, J. Chen, Ren, X, ‘KagNet: knowledge-aware graph networks for commonsense reasoning’, Proc. of the the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pp. 2829–2839, Hong Kong, China. ACL, 2019.
C. Diamantini, A. Mircoli, D. Potena, E. Storti, ‘Process-aware IIOT knowledge graph: a semantic model for industrial IOT integration and analytics’, Future Generation Computer Systems, 139, 224–238, https://doi.org/10.1016/j.future.2022.10.003, 2023.
C. Zhu, Y. Xu, X. Ren, B. Y. Lin, M. Jiang, W. Yu, ‘Knowledge-augmented methods for natural language processing’, Proc. of the 16th
ACM International Conference on Web Search and Data Mining, pp. 1228–1231, https://doi.org/10.1145/3539597.3572720, 2023.
D. Boughareb, A. Khobizi, R. Boughareb, N. Farah, H. Seridi, ‘A graph-based tag recommendation for just abstracted scientific articles tagging’, International Journal of Cooperative Information Systems, 29(3), doi: 10.1142/S0218843020500045, 2020.
F. Bettina, L. Thomas, ‘Semantic Search on the Web’, Semantic web, 1(1,2), 89–96, 2010.
F. Liu, Z. Cheng, L. Zhu, Z. Gao, L. Nie, ‘Interest-aware message-passing GCN for recommendation’, Proc. of the Web Conference (WWW), pp. 1296–1305. Ljubljana, Slovenia, ACM, https://doi.org/10.1145/3442381.3449986, 2021.
F. Ramezani, S. Parvez, J. P. Fix, ‘Automatic detection of multilayer hexagonal boron nitride in optical images using deep learning-based computer vision’, Scientific Reports, 13, https://doi.org/10.1038/s41598-023-28664-3, 2023.
H. Arabi, V. Balakrishnan, N. L. Mohd Shuib, ‘A context-aware personalized hybrid book recommender system’, Journal of Web Engineering, 19(3-4), 405–428. https://doi.org/10.13052/jwe1540-9589.19343, 2020.
H. Dong, T. Li, J. Leng, L. Kong, G. Bai, ‘GCN: GPU-based cube CNN framework for hyperspectral image classification’, Proc. of the 46th
International Conference on Parallel Processing (ICPP), pp. 41–49, Bristol, UK, IEEE, doi: 10.1109/ICPP.2017.13, 2017.
J. Wu, H. Chen, F. Orlandi, Y. H. Lee, D. O’Sullivan, S. Dev, ‘Automated Climate Analyses Using Knowledge Graph’, IEEE USNC-URSI Radio Science Meeting (Joint with AP-S Symposium), Singapore, 2021, pp. 106–107, doi: 10.23919/USNC-URSI51813.2021.9703620, 2021.
J. Zhang, X. Shi, S. Zhao, I. King, ‘STAR-GCN: stacked and reconstructed graph convolutional networks for recommender systems’, Proc. of the 28th
International Joint Conference on Artificial Intelligence (IJCAI), pp. 4264–4270, Macao, China, 2019.
K. Lei, M. Qin, B. Bai, G. Zhang, M. Yang, ‘GCN-GAN: A non-linear temporal link prediction model for weighted dynamic networks’, In INFOCOM 2019 - IEEE Conference on Computer Communications, pp. 388–396, Paris, France, IEEE, https://doi.org/10.48550/arxiv.1901.09165, 2019.
K. Marino, R. Salakhutdinov, A. Gupta, ‘The more you know: Using knowledge graphs for image classification’. In 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 20–28. Honolulu, HI, USA, 2017.
K. Tu, P. Cui, D. Wang, Z. Zhang, J. Zhou, Y. Qi, W. Zhu, ‘Conditional graph attention networks for distilling and refining knowledge graphs in recommendation’, Proc. of the 30th
ACM International Conference on Information & Knowledge Management, pp. 1834–1843, https://doi.org/10.1145/3459637.3482331, 2021.
L. Asprino, E. Daga, A. Gangemi, P. Mulholland, ‘Knowledge graph construction with a façade: a unified method to access heterogeneous data sources on the web’, ACM Transactions on Internet Technology, 23(1), 1–31, https://doi.org/10.1145/3555312, 2023
L. Wu, Q. Zhang, Chen, K. Guo, D. Wang, ‘Deep Learning Techniques for Community Detection in Social Networks’, IEEE Access, 8, 96016-96026, doi: 10.1109/ACCESS.2020.2996001, 2020.
L. Xia, Y. Liang, J. Leng, P. Zheng, ‘Maintenance planning recommendation of complex industrial equipment based on knowledge graph and graph neural network’, Reliability Engineering & System Safety, 232, https://doi.org/10.1016/j.ress.2022.109068, 2023.
M. Paneque, M. Roldán-García, J. García-Nieto, ‘e-LION: data integration semantic model to enhance predictive analytics in e-Learning’, Expert Systems with Applications, 213(Part A), https://doi.org/10.1016/j.eswa.2022.118892, 2023.
M. R. Islam, S. Liu, X. Wang, ‘Deep learning for misinformation detection on online social networks: a survey and new perspectives’, Social Network Analysis and Mining, 10(82), https://doi.org/10.1007/s13278-020-00696-x, 2020.
N. Zhao, Z. Long, J. Wang, Z. Zhao, ‘AGRE: A knowledge graph recommendation algorithm based on multiple paths embeddings RNN encoder’, Knowledge-Based Systems, 259, doi: 10.1016/j.knosys.2022.110078, 2023.
P. Cudré-Mauroux, ‘Leveraging knowledge graphs for big data integration: the XI pipeline’, Journal of Semantic Web, 11(1), 13–17, doi: 10.3233/SW-190371, 2020.
P. Pham, L. T. T. Nguyen, N. T. Nguyen, R. Kozma, B. Vo, ‘A hierarchical fused fuzzy deep neural network with heterogeneous network embedding for recommendation,’ Information Sciences, 620, 105–124, https://doi.org/10.1016/j.ins.2022.11.085, 2023.
P. Schneider, T. Schopf, J. Vladika, M. Galkin, E. Simperl, F. Matthes, ‘A Decade of Knowledge Graphs in Natural Language Processing: A Survey’, Proc. of the 2nd
Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 12th International Joint Conference on Natural Language Processing, pp. 601–614, Online only, ACL, 2022.
P. Veličković, G. Cucurull, A. Casanova, A. Romero, P. Lio, Y. Bengio, ‘Graph attention networks’, In 6th International Conference on Learning Representations (ICLR 2018), Vancouver, BC, Canada, 2018.
Q. Dai, X. Wu, L. Fan, Q. Li, H. Liu, X. Zhang, D. Wang, G. Lin K. Yang, ‘Personalized knowledge-aware recommendation with collaborative and attentive graph convolutional networks’, Pattern Recognition, 128(C), https://doi.org/10.1016/j.patcog.2022.108628, 2022.
Q. Guo, F. Zhuang, C. Qin, H. Zhu, X. Xie, H. Xiong, Q. He, ‘A survey on knowledge graph-based recommender systems’, IEEE Transactions on Knowledge and Data Engineering, 34(8), 3549–3568, doi: 10.1109/TKDE.2020.3028705, 2022.
R. Boughareb, H. Seridi and S. Beldjoudi, ‘Explainable recommendation based on weighted knowledge graphs and graph convolutional networks’, Journal of Information and Knowledge Management, 22(3), doi: 10.1142/S0219649222500988, 2023.
R. De Donato, M. Garofalo, D. Malandrino, M. A. Pellegrino, A. Petta, ‘Education meets knowledge graphs for the knowledge management’, In: Kubincová, Z., Lancia, L., Popescu, E., Nakayama, M., Scarano, V., Gil, A. (eds) Methodologies and Intelligent Systems for Technology Enhanced Learning, 10th
International Conference, Workshops (MIS4TEL 2020). Advances in Intelligent Systems and Computing, 1236, Springer, https://doi.org/10.1007/978-3-030-52287-2_28, 2021.
R. Shimizu, M. Matsutani, M. Goto, ‘An explainable recommendation framework based on an improved knowledge graph attention network with massive volumes of side information’, Knowledge-Based Systems, 239, https://doi.org/10.1016/j.knosys.2021.107970, 2022.
R. Wang, B. Li, S. Hu, W. Du, M. Zhang, ‘Knowledge graph embedding via graph attenuated attention networks’, IEEE Access, 8, 5212-5224, 2020.
S. Deng, L. Huang, G. Xu, X. Wu, Z. Wu, ‘On deep learning for trust-aware recommendations in social networks’, IEEE Transactions on Neural Networks and Learning Systems, 28(5), pp. 1164–1177, doi: 10.1109/TNNLS.2016.2514368, 2017.
S. G. Tesfagergish, R. Damaševičius, J. Kapočiūtė-Dzikienė, ‘Deep learning-based sentiment classification of social network texts in amharic language’, In: Zdravkova, K., Basnarkov, L. (eds) ICT Innovations 2022, Reshaping the Future Towards a New Normal, Communications in Computer and Information Science, 1740, Springer, https://doi.org/10.1007/978-3-031-22792-9_6, 2022.
S. Oramas, V.C. Ostuni, T. Di Noia, X. Serra, E. Di Sciascio, ‘Sound and music recommendation with knowledge graphs,’ ACM Transactions on Intelligent Systems and Technology, 8(2), 1–21, doi: 10.1145/2926718, 2017.
T. B. Mudiyanselage, X. Lei, N. Senanayake, Y. Zhang, Y. Pan, ‘Predicting CircRNA disease associations using novel node classification and link prediction models on Graph Convolutional Networks’, Methods Journal, 198, 32–44, https://doi.org/10.1016/j.ymeth.2021.10.008, 2022.
T. N. Kipf, M. Welling, ‘Semi-supervised classification with graph convolutional networks’, Proc. of the 5th
International Conference on Learning Representations (ICLR), pp. 2873–2879, Toulon, France, 2017.
V. Ryen, A. Soylu, D. Roman, ‘Building semantic knowledge graphs from (Semi-) structured data: A review’, Future Internet, 14(5), https://doi.org/10.3390/fi14050129, 2022.
W. Chen, W. Xiong, X. Yan, W. Wang, ‘Variational knowledge graph reasoning’, Proc. of the 57th
Annual Meeting of the Association for Computational Linguistics (ACL 2019), pp. 4185–4194, https://doi.org/10.48550/arXiv.1803.06581, 2019.
X. Wang, K. Liu, D. Wang, L. W. Fu, X. Xie, ‘Multi-level recommendation reasoning over knowledge graphs with reinforcement learning’, Proc. of the ACM Web Conference 2022, pp. 2098–2108, https://doi.org/10.1145/3485447.3512083, 2022.
X. Wang, X. He, Y. Cao, M. Liu, T. S. Chua, ‘KGAT: knowledge graph attention network for recommendation’, Proc. of the 25th
ACM SIGKDD International Conference on Knowledge Discovery & Data Mining (KDD), pp. 950–958, Anchorage, USA, ACM, https://doi.org/10.1145/3292500.3330989, 2019.
X. Zeng, X. Tu, Y. Liu, X. Fu, Y. Su, ‘Toward better drug discovery with knowledge graph’, Current Opinion in Structural Biology, 72, 114–126, https://doi.org/10.1016/j.sbi.2021.09.003, 2022.
Y. Jiang, X. Gao, W. Su, J. Li, ‘Systematic knowledge management of construction safety standards based on knowledge graphs: a case study in China’, International Journal of Environmental Research and Public Health, 18(20), https://doi.org/10.3390/ijerph182010692, 2021.
Y. Jin, W. Ji, Y. Shi, ‘Meta-path guided graph attention network for explainable herb recommendation’, Health Information Science Systems, 11(5), https://doi.org/10.1007/s13755-022-00207-6, 2023.
