TY - GEN
T1 - VSA
T2 - 53rd IEEE International Symposium on Circuits and Systems, ISCAS 2021
AU - Lien, Hong Han
AU - Hsu, Chung Wei
AU - Chang, Tian Sheuan
N1 - Publisher Copyright:
© 2021 IEEE
PY - 2021/5/22
Y1 - 2021/5/22
N2 - Spiking neural networks (SNNs) that enable low-power design on edge devices have recently attracted significant research. However, the temporal characteristic of SNNs causes high latency, high bandwidth and high energy consumption for the hardware. In this work, we propose a binary weight spiking model with IF-based Batch Normalization for small time steps and low hardware cost when direct training with input encoding layer and spatio-temporal back propagation (STBP). In addition, we propose a vectorwise hardware accelerator that is reconfigurable for different models, inference time steps and even supports the encoding layer to receive multi-bit input. The required memory bandwidth is further reduced by two-layer fusion mechanism. The implementation result shows competitive accuracy on the MNIST and CIFAR-10 datasets with only 8 time steps, and achieves power efficiency of 25.9 TOPS/W.
AB - Spiking neural networks (SNNs) that enable low-power design on edge devices have recently attracted significant research. However, the temporal characteristic of SNNs causes high latency, high bandwidth and high energy consumption for the hardware. In this work, we propose a binary weight spiking model with IF-based Batch Normalization for small time steps and low hardware cost when direct training with input encoding layer and spatio-temporal back propagation (STBP). In addition, we propose a vectorwise hardware accelerator that is reconfigurable for different models, inference time steps and even supports the encoding layer to receive multi-bit input. The required memory bandwidth is further reduced by two-layer fusion mechanism. The implementation result shows competitive accuracy on the MNIST and CIFAR-10 datasets with only 8 time steps, and achieves power efficiency of 25.9 TOPS/W.
KW - Deep learning accelerators
KW - Spiking neural network
UR - http://www.scopus.com/inward/record.url?scp=85109046006&partnerID=8YFLogxK
U2 - 10.1109/ISCAS51556.2021.9401181
DO - 10.1109/ISCAS51556.2021.9401181
M3 - Conference contribution
AN - SCOPUS:85109046006
T3 - Proceedings - IEEE International Symposium on Circuits and Systems
BT - 2021 IEEE International Symposium on Circuits and Systems, ISCAS 2021 - Proceedings
PB - Institute of Electrical and Electronics Engineers Inc.
Y2 - 22 May 2021 through 28 May 2021
ER -