TY - GEN
T1 - Enabling Inference Inside Software Switches
AU - Lu, Yung Sheng
AU - Lin, Ching-Ju
PY - 2019/9
Y1 - 2019/9
N2 - Software Defined Networking (SDN) has been emerged to solve the problem of traditional network architectures. The ability of programmable switches renders us an opportunity to have computational tasks done in the switches. With this nice property, in this work, we investigate the potential of enabling machine learning inside a network. To this end, we propose a new architecture, Intra-Network Inference (INI), which equips each switch with a recently released component, called neural compute stick (NCS), to enable intra-switch neural network inference. Unlike conventional SDN architectures, which relay backend servers to enable inference, our INI performs inference locally at switches and, thereby, reduces the data forwarding overhead and inference latency.
AB - Software Defined Networking (SDN) has been emerged to solve the problem of traditional network architectures. The ability of programmable switches renders us an opportunity to have computational tasks done in the switches. With this nice property, in this work, we investigate the potential of enabling machine learning inside a network. To this end, we propose a new architecture, Intra-Network Inference (INI), which equips each switch with a recently released component, called neural compute stick (NCS), to enable intra-switch neural network inference. Unlike conventional SDN architectures, which relay backend servers to enable inference, our INI performs inference locally at switches and, thereby, reduces the data forwarding overhead and inference latency.
KW - Neural Networks
KW - P4
KW - SDN
UR - http://www.scopus.com/inward/record.url?scp=85075270928&partnerID=8YFLogxK
U2 - 10.23919/APNOMS.2019.8893042
DO - 10.23919/APNOMS.2019.8893042
M3 - Conference contribution
AN - SCOPUS:85075270928
T3 - 2019 20th Asia-Pacific Network Operations and Management Symposium: Management in a Cyber-Physical World, APNOMS 2019
BT - 2019 20th Asia-Pacific Network Operations and Management Symposium
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 20th Asia-Pacific Network Operations and Management Symposium, APNOMS 2019
Y2 - 18 September 2019 through 20 September 2019
ER -