Optimum splitting computing for DNN training through next generation smart networks: a multi-tier deep reinforcement learning approach

Shao Yu Lien, Cheng Hao Yeh, Der Jiunn Deng*

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

Deep neural networks (DNNs) involving massive neural nodes grouped into different neural layers have been a promising innovation for function approximation and inference, which have been widely applied to various vertical applications such as image recognition. However, the computing burdens to train a DNN model with a limited latency may not be affordable for the user equipment (UE), which consequently motivates the concept of splitting the computations of DNN layers to not only the edge server but also the cloud platform. Despite the availability of more computing resources, computing tasks with such split computing also suffer packet transmission unreliability, latency, and significant energy consumption. A practical scheme to optimally split the computations of DNN layers to the UE, edge, and cloud is thus urgently desired. To solve this optimization, we propose a multi-tier deep reinforcement learning (DRL) scheme for the UE and edge to distributively determine the splitting points to minimize the overall training latency while meeting the constraints of overall energy consumption and image recognition accuracy. The performance evaluation results show the outstanding performance of the proposed design as compared with state-of-the-art schemes, to fully justify the practicability in the next-generation smart networks.

Original languageEnglish
Pages (from-to)1737-1751
Number of pages15
JournalWireless Networks
Volume30
Issue number3
DOIs
StatePublished - Apr 2024

Keywords

  • Deep neural networks (DNNs)
  • Deep reinforcement learning (DRL)
  • Sixth generation (6 G) Networks
  • Split computing

Fingerprint

Dive into the research topics of 'Optimum splitting computing for DNN training through next generation smart networks: a multi-tier deep reinforcement learning approach'. Together they form a unique fingerprint.

Cite this