Pricing-Based Deep Reinforcement Learning for Live Video Streaming with Joint User Association and Resource Management in Mobile Edge Computing

Po Yu Chou, Wei Yu Chen, Chih Yu Wang*, Ren Hung Hwang, Wen Tsuen Chen

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

3 Scopus citations

Abstract

Mobile Edge Computing (MEC) is a promising technique in the 5G Era to improve the Quality of Experience (QoE) for online video streaming due to its ability to reduce the backhaul transmission by caching certain content. However, it still takes effort to address the user association and video quality selection problem under the limited resource of MEC to fully support the low-latency demand for live video streaming. We found the optimization problem to be a non-linear integer programming, which is impossible to obtain a globally optimal solution under polynomial time. In this paper, we formulate the problem and derive the closed-form solution in the form of Lagrangian multipliers; the searching of the optimal variables is formulated as a Multi-Arm Bandit (MAB) and we propose a Deep Deterministic Policy Gradient (DDPG) based algorithm exploiting the supply-demand interpretation of the Lagrange dual problem. Simulation results show that our proposed approach achieves significant QoE improvement, especially in the low wireless resource and high user number scenario compared to other baselines.

Original languageEnglish
Pages (from-to)4310-4324
Number of pages15
JournalIEEE Transactions on Wireless Communications
Volume21
Issue number6
DOIs
StatePublished - 1 Jun 2022

Keywords

  • deep deterministic policy gradient (DDPG)
  • dual pricing approach
  • live video streaming
  • Mobile edge computing (MEC)
  • scalable video coding (SVC)

Fingerprint

Dive into the research topics of 'Pricing-Based Deep Reinforcement Learning for Live Video Streaming with Joint User Association and Resource Management in Mobile Edge Computing'. Together they form a unique fingerprint.

Cite this