Hybrid Binary-Stochastic Computing-based ANN Design with Binary-in-Series-out ReLU

Kun Chih Jimmy Chen, Cheng Ting Chen

研究成果: Conference contribution同行評審

1 引文 斯高帕斯(Scopus)

摘要

Because of the remarkable performance on the problem of classification and recognition, Artificial Neural Networks (ANNs) have received much attention in recent years. However, due to the massive parameters and complicated interconnections between each neuron, ANN hardware architectures suffer from considerable area overhead and power consumption, which becomes the design challenge nowadays. To mitigate the design problem, the Stochastic Computing (SC)-based computing method has been proposed to use stochastic bit-stream for each kind of arithmetic operation in recent years. Besides, many SC-based ANN designs were proposed and showed their efficiency to save the computing power and area of the hardware. However, the conventional SC-based ANNs (SC-ANNs) suffer from low computing accuracy due to the applied stochastic bit-stream. To further improve the computing accuracy of the SC-ANN, we propose to replace the SC-based multiply-accumulator (MAC) with the parallel counter (PC) in this work. In addition, we further propose a binary-input-series-output (BISO) ReLU function to transfer the binary to the corresponding stochastic bit-stream efficiently. Compared with the conventional SC-ANN approach, the proposed SC-ANN design with PC-based MAC and BISO ReLU can improve computing accuracy by 86.6%. In addition, the proposed approach can reduce 95.3% area cost and 90% power consumption over than non-SC-ANN design, which achieves higher hardware efficiency.

原文English
主出版物標題Proceeding - IEEE International Conference on Artificial Intelligence Circuits and Systems, AICAS 2022
發行者Institute of Electrical and Electronics Engineers Inc.
頁面162-165
頁數4
ISBN(電子)9781665409964
DOIs
出版狀態Published - 2022
事件4th IEEE International Conference on Artificial Intelligence Circuits and Systems, AICAS 2022 - Incheon, 韓國
持續時間: 13 6月 202215 6月 2022

出版系列

名字Proceeding - IEEE International Conference on Artificial Intelligence Circuits and Systems, AICAS 2022

Conference

Conference4th IEEE International Conference on Artificial Intelligence Circuits and Systems, AICAS 2022
國家/地區韓國
城市Incheon
期間13/06/2215/06/22

指紋

深入研究「Hybrid Binary-Stochastic Computing-based ANN Design with Binary-in-Series-out ReLU」主題。共同形成了獨特的指紋。

引用此