Computation and Communication Aware task graph Scheduling on multi-GPU systems

Yun Ting Wang, Jia Ying Lee, Bo-Cheng Lai

研究成果: Conference contribution同行評審

摘要

GPUs have emerged as popular throughput computing platforms due to the massively parallel computing capability and low cost. To attain further performance enhancement beyond single GPU, there is a growing interest in exploiting systems with multiple GPUs. Attaining superior performance in a multi-GPU system involves three main design challenges, namely load balance, memory utilization, and data transfer. Imbalanced loading across a system could cause idling of GPUs while poor data reuse would trigger excessive memory accesses. The inefficient data transfer between a host and a device becomes a considerable performance overhead during high throughput computing. This paper aims at addressing the above design issues by proposing a Computation and Communication Aware task graph Scheduling (CCAS) for multi-GPU systems. The proposed scheduling approach (CCAS) adopts an effective heuristic algorithm that considers both data reuse and load balance in a multi-GPU system. The data transfer overhead is hidden by extensively overlapping computation and data communication. The experimental results of the proposed CCAS have demonstrated an average of 22.15% performance enhancement when compared with a previous work.

原文English
主出版物標題2015 IEEE International Conference on Digital Signal Processing, DSP 2015
發行者Institute of Electrical and Electronics Engineers Inc.
頁面115-119
頁數5
ISBN(電子)9781479980581, 9781479980581
DOIs
出版狀態Published - 9 9月 2015
事件IEEE International Conference on Digital Signal Processing, DSP 2015 - Singapore, 新加坡
持續時間: 21 7月 201524 7月 2015

出版系列

名字International Conference on Digital Signal Processing, DSP
2015-September

Conference

ConferenceIEEE International Conference on Digital Signal Processing, DSP 2015
國家/地區新加坡
城市Singapore
期間21/07/1524/07/15

指紋

深入研究「Computation and Communication Aware task graph Scheduling on multi-GPU systems」主題。共同形成了獨特的指紋。

引用此