Learning-Based Content Caching and User Clustering: A Deep Deterministic Policy Gradient Approach

Kun Lin Chan, Feng-Tsun Chien

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

1 Scopus citations

Abstract

The joint design of content caching and user clustering (JCC) in cache-enabled heterogeneous networks is challenging, due to various unknown, possibly time-varying, system parameters which potentially give rise to various design tradeoffs in practice. This paper presents the first study that investigates the problem of JCC using the deep deterministic policy gradient (DDPG)-based reinforcement learning, with the purpose of balancing both the energy efficiency (EE) and content hit probability (CHP), while satisfying the cluster size constraint (CSC). We propose a new learning structure, termed multiDDPG (MDDPG), that demonstrates better EE performance while providing a comparable CHP to the caching scheme with known content popularity.

Original languageEnglish
Title of host publication2020 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2020 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages5055-5059
Number of pages5
ISBN (Electronic)9781509066315
DOIs
StatePublished - May 2020
Event2020 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2020 - Barcelona, Spain
Duration: 4 May 20208 May 2020

Publication series

NameICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings
Volume2020-May
ISSN (Print)1520-6149

Conference

Conference2020 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2020
Country/TerritorySpain
CityBarcelona
Period4/05/208/05/20

Keywords

  • content caching
  • deep learning
  • Reinforcement learning
  • small cell network
  • user clustering

Fingerprint

Dive into the research topics of 'Learning-Based Content Caching and User Clustering: A Deep Deterministic Policy Gradient Approach'. Together they form a unique fingerprint.

Cite this