Recommendations with residual connections and negative sampling based on knowledge graphs

Yuanyuan Liu, Zhaoqian Zhong, Chao Che, Yongjun Zhu

Research output: Contribution to journalArticlepeer-review

Abstract

A knowledge graph (KG) contains a large amount of well-structured external triple information that can effectively solve the problems of poor interpretability in collaborative filtering. Recently, recommendation system (RS) models relying on graph neural networks (GNNs) have been widely developed, but the increase of GNN layers inevitably leads to over-smoothing problems. Meanwhile, most of the current KG-based negative sampling strategies randomly collect negative samples from unobserved data to train RS models. However, these strategies are insufficient to generate negative samples reflecting genuine user demands. To overcome these obstacles, we design a model called Knowledge Graph Residual Negative Sampling Recommendation (KGRNS), which utilizes residual connections and pooling operation to alleviate the over-smoothing problem, and generate high-quality negative samples by negative sampling. Specifically, we devise residual connections on each output layer of the GNN and then utilize sum pooling operation to mitigate the effects of the over-smoothing problem on the model. In addition, to generate high-quality negative samples, we create a gated strategy to mix the knowledge of both positive and negative samples to generate synthetic negative samples and then select the virtual negative sample that is closest to the positive ones through a theoretically backed hard negative sample select strategy. We conducted broad experiments on three datasets. The experimental results showed that KGRNS performed considerable enhancements over state-of-the-art methods. Ablation studies validated the effectiveness of each part of the KGRNS.

Original languageEnglish
Article number110049
JournalKnowledge-Based Systems
Volume258
DOIs
Publication statusPublished - 2022 Dec 22

Bibliographical note

Funding Information:
This work was supported by the National Natural Science Foundation of China (No. 62076045 , 62172074 , 61772110 ), the High-Level Talent Innovation Support Program (Young Science and Technology Star) of Dalian (No. 2021RQ066 ), Subject of Liaoning Provincial Department of Education ( LZ2019002 ), Program of Introducing Talents of Discipline to Universities (Plan 111), China (No. B20070 ) and Key Program of Liaoning Traditional Chinese Medicine Administration ( LNZYXZK201910 ).

Publisher Copyright:
© 2022 Elsevier B.V.

All Science Journal Classification (ASJC) codes

  • Software
  • Management Information Systems
  • Information Systems and Management
  • Artificial Intelligence

Fingerprint

Dive into the research topics of 'Recommendations with residual connections and negative sampling based on knowledge graphs'. Together they form a unique fingerprint.

Cite this