Hierarchical Reinforcement Learning for Conversational Recommendation With Knowledge Graph Reasoning and Heterogeneous Questions

Yao Chun Yang, Chiao Ting Chen, Tzu Yu Lu, Szu Hao Huang

Research output: Contribution to journalArticlepeer-review

1 Scopus citations

Abstract

User interaction history with items is used to infer user preferences in conventional recommendation systems. Among these, conversational recommendation systems (CRSs), which provide effective recommendations based on a framework combining recommendations and conversations with users, have been proposed. However, existing CRS model still have some shortcomings, such as the lack of using dialogue records for recommendations. In this research, a method was proposed to solve multiround conversational recommendations with heterogeneous questions. The model included a hierarchical reinforcement learning framework and introduced methods of effectively incorporating user feedback for online recommender updates. Experiments were conducted on several datasets to verify model effectiveness; the model outperformed the current state-of-the-art method. Finally, the architecture was more realistic than other conversational recommendation scenarios and provided richer explanations.

Original languageEnglish
Pages (from-to)1-14
Number of pages14
JournalIEEE Transactions on Services Computing
DOIs
StateAccepted/In press - 2023

Keywords

  • Cognition
  • Conversational recommendation system (CRS)
  • knowledge graph reasoning
  • Knowledge graphs
  • Oral communication
  • Recommender systems
  • Reinforcement learning
  • reinforcement learning (RL)
  • Task analysis
  • Training

Fingerprint

Dive into the research topics of 'Hierarchical Reinforcement Learning for Conversational Recommendation With Knowledge Graph Reasoning and Heterogeneous Questions'. Together they form a unique fingerprint.

Cite this