Fine-Grained User Location Prediction using Meta-Path Context with Attention Mechanism
DOI:
https://doi.org/10.13052/jwe1540-9589.2032Keywords:
Geo-Social Network (GSN), Attention Mechanism, Meta-path Contexts Learning, Location-based Social Networks (LBSNs), Pairwise Learning, User Location PredictionAbstract
The prevalence of Location-Based Social Networks (LBSNs) significantly improves the location-aware capability of services by providing Geo-tagged information. Relied on a great number of user check-in data in the location-based social networks, their essential mobility modes are able to be comprehensively studied, which is basic for forecasting the next venue where a specific user is going to visit considering his relevant historical check-in data. Since there exist different kinds of nodes and interactions between nodes, these information could be look upon as a network that is made up of heterogeneous information. In this network a few of different semantic meta paths could be obtained. Enlightened from the competitive advantage of embedding method relied upon meta-path contexts in the heterogeneous information network, we study a joint deep learning scheme exploring different meta-path context information to forecast fine-grained location. In order to capture different semantics in a user-location interaction, we adopt a simple but high-efficient attention method to learn the meta-path importance or weights. In the terms of model optimization, considering we have only positive sample data and there exists intrinsically latent feedback in check-in information, herein a pairwise learning method is utilized for maximizing the margin between visited and invisible venues. Experiment in different data-sets validate the competitive performance of the suggested approach under different assessment criterion.
Downloads
References
Qasim Ali Arain, Hina Memon, Imran Memon, Muhammad Hammad Memon, Riaz Ahmed Shaikh, and Farman Ali Mangi. Intelligent travel information platform based on location base services to predict user travel behavior from user-generated gps traces. International Journal of Computers and Applications, 39(3):155–168, 2017.
Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. Neural machine translation by jointly learning to align and translate. In 3rd International Conference on Learning Representations, ICLR 2015, 2015.
Jiuxin Cao, Shuai Xu, Xuelin Zhu, Renjun Lv, and Bo Liu. Efficient fine-grained location prediction based on user mobility pattern in lbsns. In 5th International Conference on Advanced Cloud and Big Data, pages 238–243. IEEE, 2017.
Jiuxin Cao, Shuai Xu, Xuelin Zhu, Renjun Lv, and Bo Liu. Effective fine-grained location prediction based on user check-in pattern in lbsns. Journal of Network and Computer Applications, 108:64–75, 2018.
Yuxiao Dong, Nitesh V. Chawla, and Ananthram Swami. metapath2vec: Scalable representation learning for heterogeneous networks. In 23rd ACM SIGKDD international conference on knowledge discovery and data mining, pages 135–144. ACM, 2017.
Shanshan Feng, Xutao Li, Yifeng Zeng, Gao Cong, Yeow Meng Chee, and Quan Yuan. Personalized ranking metric embedding for next new poi recommendation. In Twenty-Fourth International Joint Conference on Artificial Intelligence, pages 2069–2075, 2015.
Tao-yang Fu, Wang-Chien Lee, and Zhen Lei. Hin2vec: Explore meta-paths in heterogeneous information networks for representation learning. In 26th ACM International on Conference on Information and Knowledge Management, pages 1797–1806. ACM, 2017.
Xiangnan He, Lizi Liao, Hanwang Zhang, Liqiang Nie, Xia Hu, and Tat-Seng Chua. Neural collaborative filtering. In 26th International Conference on World Wide Web, pages 173–182. International World Wide Web Conferences Steering Committee, 2017.
Binbin Hu, Chuan Shi, Wayne Xin Zhao, and Philip S. Yu. Leveraging meta-path based context for top-n recommendation with a neural co-attention model. In 4th ACM SIGKDD international conference on knowledge discovery and data mining, pages 1531–1540. ACM, 2018.
Yun Jiang, Wei He, Lizhen Cui, and Qian Yang. User location prediction in mobile crowdsourcing services. In International Conference on Service-Oriented Computing, pages 515–523. Springer, 2018.
Yoon Kim. Convolutional neural networks for sentence classification. In Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 1746–1751, 2014.
Y. Lecun, L. Bottou, Y. Bengio, and P. Haffner. Gradient-based learning applied to document recognition. Proceedings of the IEEE, 86(11):2278–2324, 1998.
Defu Lian, Cong Zhao, Xing Xie, Guangzhong Sun, Enhong Chen, and Yong Rui. Geomf: Joint geographical modeling and matrix factorization for point-of-interest recommendation. In Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD ’14, pages 831–840, New York, NY, USA, 2014. ACM.
Yan Long, Pengpeng Zhao, Victor S. Sheng, Guanfeng Liu, Jiajie Xu, Jian Wu, and Zhiming Cui. Social personalized ranking embedding for next poi recommendation. In International Conference on Web Information Systems Engineering, pages 91–105. Springer, 2017.
Chen Ma, Yingxue Zhang, Qinglong Wang, and Xue Liu. Point-of-interest recommendation: Exploiting self-attentive autoencoders with neighbor-aware influence. In 27th ACM International Conference on Information and Knowledge Management, pages 697–706. ACM, 2018.
Jarana Manotumruksa, Craig Macdonald, and Iadh Ounis. Modelling user preferences using word embeddings for context-aware venue recommendation. CoRR, abs/1606.07828:1–4, 2016.
Jarana Manotumruksa, Craig Macdonald, and Iadh Ounis. Regularising factorised models for venue recommendation using friends and their comments. In 25th ACM International on Conference on Information and Knowledge Management, pages 1981–1984. ACM, 2016.
Xiangwu Meng, Ruichang Li, Yujie Zhang, and Weiyu Ji. Survey on mobile recommender systems based on user trajectory data. Ruan Jian Xue Bao/Journal of Software (in Chinese), 29(10):3111–3133, 2018.
Steffen Rendle, Christoph Freudenthaler, Zeno Gantner, and Lars Schmidt-Thieme. Bpr: Bayesian personalized ranking from implicit feedback. In Proceedings of the 24th International Conference on Uncertainty in Artificial Intelligence, pages 452–461, 2009.
Jiang S., Qian X., Mei T., and Fu Y. Personalized travel sequence recommendation on multi-source big social media. IEEE Transactions on Big Data, 2(1):43–56, 2016.
Chuan Shi, Binbin Hu, Wayne Xin Zhao, and S. Yu Philip. Heterogeneous information network embedding for recommendation. IEEE Transactions on Knowledge and Data Engineering, 31(2):357–370, 2019.
Yizhou Sun, Jiawei Han, Xifeng Yan, Philip S. Yu, and Tianyi Wu. Pathsim: Meta path-based top-k similarity search in heterogeneous information networks. PVLDB, 4:992–1003, 2011.
Zhixiao Wang, Wenyao Yan, Wendong Wang, Ang Gao, Lei Yu, Shaobo Yang, and GaoYang Nie. Exploiting meta-path with attention mechanism for fine-grained user location prediction in LBSNs. Journal of Physics: Conference Series, 1284:012031, aug 2019.
Min Xie, Hongzhi Yin, Hao Wang, Fanjiang Xu, Weitong Chen, and Sen Wang. Learning graph-based poi embedding for location-based recommendation. In 25th ACM International on Conference on Information and Knowledge Management, pages 15–24. ACM, 2016.
Min Xie, Hongzhi Yin, Fanjiang Xu, Hao Wang, and Xiaofang Zhou. Graph-based metric embedding for next poi recommendation. In International Conference on Web Information Systems Engineering, pages 207–222. Springer, 2016.
Shuai Xu, Jiuxin Cao, Phil Legg, Bo Liu, and Shancang Li. Venue2vec: An efficient embedding model for fine-grained user location prediction in geo-social networks. IEEE Systems Journal, pages 1–12, 2019.
Shuai Xu, Jiuxin Cao, Xuelin Zhu, Yi Dong, and Bo Liu. Community discovery based on social relations and temporal-spatial topics in lbsns. In the Pacific-Asia Conference on Knowledge Discovery and Data Mining, pages 206–217. Springer, 2018.
Shuai Xu, Xiaoming Fu, Jiuxin Cao, Bo Liu, and Zhixiao Wang. Survey on user location prediction based on geo-social networking data. World Wide Web, 23(3):1621–1664, 2020.
Jihang Ye, Zhe Zhu, and Hong Cheng. What’s your next move: User activity prediction in location-based social networks. In International Conference on Data Mining, pages 171–179. SIAM, 2013.
Hongzhi Yin, Zhiting Hu, Xiaofang Zhou, Hao Wang, Kai Zheng, Quoc Viet Hung Nguyen, and Shazia Sadiq. Discovering interpretable geo-social communities for user behavior prediction. In 2016 IEEE 32nd International Conference on Data Engineering (ICDE), pages 942–953. IEEE, 2016.
Shenglin Zhao, Tong Zhao, Haiqin Yang, Michael R. Lyu, and Irwin King. Stellar: spatial-temporal latent ranking for successive point-of-interest recommendation. In 13th AAAI conference on artificial intelligence, pages 315–321, 2016.
Yu Zhu, Hao Li, Yikang Liao, Beidou Wang, Ziyu Guan, Haifeng Liu, and Deng Cai. What to do next: Modeling user behaviors by time-lstm. In IJCAI, pages 3602–3608, 2017.
