COLAB: Collaborative and Efficient Processing of Replicated Cache Requests in GPU

Bo Wun Cheng, En Ming Huang, Chen Hao Chao, Wei Fang Sun, Tsung Tai Yeh, Chun Yi Lee

研究成果: Conference contribution同行評審

摘要

In this work, we aim to capture replicated cache requests between Stream Multiprocessors (SMs) within an SM cluster to alleviate the Network-on-Chip (NoC) congestion problem of modern GPUs. To achieve this objective, we incorporate a per-cluster Cache line Ownership Lookup tABle (COLAB) that keeps track of which SM within a cluster holds a copy of a specific cache line. With the assistance of COLAB, SMs can collaboratively and efficiently process replicated cache requests within SM clusters by redirecting them according to the ownership information stored in COLAB. By servicing replicated cache requests within SM clusters that would otherwise consume precious NoC bandwidth, the heavy pressure on the NoC interconnection can be eased. Our experimental results demonstrate that the adoption of COLAB can indeed alleviate the excessive NoC pressure caused by replicated cache requests, and improve the overall system throughput of the baseline GPU while incurring minimal overhead. On average, COLAB can reduce 38% of the NoC traffic and improve instructions per cycle (IPC) by 43%.

原文English
主出版物標題ASP-DAC 2023 - 28th Asia and South Pacific Design Automation Conference, Proceedings
發行者Institute of Electrical and Electronics Engineers Inc.
頁面314-319
頁數6
ISBN(電子)9781450397834
DOIs
出版狀態Published - 16 1月 2023
事件28th Asia and South Pacific Design Automation Conference, ASP-DAC 2023 - Tokyo, Japan
持續時間: 16 1月 202319 1月 2023

出版系列

名字Proceedings of the Asia and South Pacific Design Automation Conference, ASP-DAC

Conference

Conference28th Asia and South Pacific Design Automation Conference, ASP-DAC 2023
國家/地區Japan
城市Tokyo
期間16/01/2319/01/23

指紋

深入研究「COLAB: Collaborative and Efficient Processing of Replicated Cache Requests in GPU」主題。共同形成了獨特的指紋。

引用此