TY - GEN
T1 - Optimization of GPU Memory Usage for Training Deep Neural Networks
AU - Hung, Che Lun
AU - Hsin, Chine fu
AU - Wang, Hsiao Hsi
AU - Tang, Chuan Yi
N1 - Publisher Copyright:
© 2019, Springer Nature Switzerland AG.
PY - 2019
Y1 - 2019
N2 - Recently, Deep Neural Networks have been successfully utilized in many domains; especially in computer vision. Many famous convolutional neural networks, such as VGG, ResNet, Inception, and so forth, are used for image classification, object detection, and so forth. The architecture of these state-of-the-art neural networks has become deeper and complicated than ever. In this paper, we propose a method to solve the problem of large memory requirement in the process of training a model. The experimental result shows that the proposed algorithm is able to reduce the GPU memory significantly.
AB - Recently, Deep Neural Networks have been successfully utilized in many domains; especially in computer vision. Many famous convolutional neural networks, such as VGG, ResNet, Inception, and so forth, are used for image classification, object detection, and so forth. The architecture of these state-of-the-art neural networks has become deeper and complicated than ever. In this paper, we propose a method to solve the problem of large memory requirement in the process of training a model. The experimental result shows that the proposed algorithm is able to reduce the GPU memory significantly.
KW - Convolutional Neural Networks
KW - Deep Neural Network
KW - GPU
UR - http://www.scopus.com/inward/record.url?scp=85076846430&partnerID=8YFLogxK
U2 - 10.1007/978-3-030-30143-9_23
DO - 10.1007/978-3-030-30143-9_23
M3 - Conference contribution
AN - SCOPUS:85076846430
SN - 9783030301422
T3 - Communications in Computer and Information Science
SP - 289
EP - 293
BT - Pervasive Systems, Algorithms and Networks - 16th International Symposium, I-SPAN 2019, Proceedings
A2 - Esposito, Christian
A2 - Hong, Jiman
A2 - Choo, Kim-Kwang Raymond
PB - Springer
T2 - 16th International Symposium on Pervasive Systems, Algorithms and Networks, I-SPAN 2019
Y2 - 16 September 2019 through 20 September 2019
ER -