Configurable Multi-Precision Floating-Point Multiplier Architecture Design for Computation in Deep Learning

Pei Hsuan Kuo*, Yu Hsiang Huang, Juinn Dar Huang

*此作品的通信作者

研究成果: Conference contribution同行評審

1 引文 斯高帕斯(Scopus)

摘要

The increasing AI applications demands efficient computing capabilities to support a huge amount of calculations. Among the related arithmetic operations, multiplication is an indispensable part in most of deep learning applications. To support computing in different precisions demanded by various applications, it is essential for a multiplier architecture to meet the multi-precision demand while still achieving high utilization of the multiplication array and power efficiency. In this paper, a configurable multi-precision FP multiplier architecture with minimized redundant bits is presented. It can execute 16× FP8 operations, or 8× brain-floating-point (BF16) operations, or 4× half-precision (FP16) operations, or 1× single-precision (FP32) operation every cycle while maintaining a 100% multiplication hardware utilization ratio. Moreover, the computing results can also be represented in higher precision formats for succeeding high-precision computations. The proposed design has been implemented using the TSMC 40nm process with 1GHz clock frequency and consumes only 16.78mW on average. Compared to existing multi-precision FP multiplier architectures, the proposed design achieves the highest hardware utilization ratio with only 4.9K logic gates in the multiplication array. It also achieves high energy efficiencies of 1212.1, 509.6, 207.3, and 42.6 GFLOPS/W at FP8, BF16, FP16 and FP32 modes, respectively.

原文English
主出版物標題AICAS 2023 - IEEE International Conference on Artificial Intelligence Circuits and Systems, Proceeding
發行者Institute of Electrical and Electronics Engineers Inc.
ISBN(電子)9798350332674
DOIs
出版狀態Published - 2023
事件5th IEEE International Conference on Artificial Intelligence Circuits and Systems, AICAS 2023 - Hangzhou, China
持續時間: 11 6月 202313 6月 2023

出版系列

名字AICAS 2023 - IEEE International Conference on Artificial Intelligence Circuits and Systems, Proceeding

Conference

Conference5th IEEE International Conference on Artificial Intelligence Circuits and Systems, AICAS 2023
國家/地區China
城市Hangzhou
期間11/06/2313/06/23

指紋

深入研究「Configurable Multi-Precision Floating-Point Multiplier Architecture Design for Computation in Deep Learning」主題。共同形成了獨特的指紋。

引用此