GRONA: A Framework for Gather-and-Reduce On Near-Memory Accelerators

Aman Sinha*, Pei Yi Liu, Yuhao Fang, Jhih Yong Mai, Bo Cheng Lai

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Gather-and-reduce (GnR) is a collective operation widely used in Big-data analytic workloads. Memory-bound fine-grained data-accesses from massive lookup-tables during Gather, followed by compute-bound arithmetic and logical processing during Reduce, are suitable for low-latency computations on emerging Near-DRAM Processing (NDP) architectures. While NDP on general Dual Inline Memory Modules (DIMMs) offer simple integration and find commercial adoption, cross-level data-sharing over standard buses remains a bottleneck. Maintaining standard functionality of the DIMM require careful schemes for scheduling, coordination and memory management in order to achieve the potential throughput. We propose GRONA (Gather-and-Reduce On Near-Memory Accelerators), a framework for intra-DIMM throughput-oriented reprogrammable Gather-and-Reduce. GRONA adopts a multilevel reprogrammable PE platform equipped with small caches to support all GnR applications. GRONA framework achieves effective decoupling of bank-group and rank-level data accesses and GnR execution, and displayed up-to 2.9x performance gains for applications such as FM-Index query and SparseLengthSums compared to NDP state-of-the-arts.

Original languageEnglish
Title of host publicationProceedings - 2023 16th IEEE International Symposium on Embedded Multicore/Many-Core Systems-on-Chip, MCSoC 2023
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages225-232
Number of pages8
ISBN (Electronic)9798350393613
DOIs
StatePublished - 2023
Event16th IEEE International Symposium on Embedded Multicore/Many-Core Systems-on-Chip, MCSoC 2023 - Singapore, Singapore
Duration: 18 Dec 202321 Dec 2023

Publication series

NameProceedings - 2023 16th IEEE International Symposium on Embedded Multicore/Many-Core Systems-on-Chip, MCSoC 2023

Conference

Conference16th IEEE International Symposium on Embedded Multicore/Many-Core Systems-on-Chip, MCSoC 2023
Country/TerritorySingapore
CitySingapore
Period18/12/2321/12/23

Keywords

  • Big data analytics
  • FM-Index
  • Gather-and-Reduce
  • Near-DRAM Processing
  • Processing-In-Memory
  • Recommendation systems
  • SIMD
  • SparseLengthSums

Fingerprint

Dive into the research topics of 'GRONA: A Framework for Gather-and-Reduce On Near-Memory Accelerators'. Together they form a unique fingerprint.

Cite this