TY - GEN
T1 - X-IO
T2 - 9th IEEE International Conference on Network Softwarization, NetSoft 2023
AU - Qi, Shixiong
AU - Tsai, Han Sing
AU - Liu, Yu Sheng
AU - Ramakrishnan, K. K.
AU - Chen, Jyh Cheng
N1 - Publisher Copyright:
© 2023 IEEE.
PY - 2023
Y1 - 2023
N2 - Cloud-native microservice applications use different communication paradigms to network microservices, including both synchronous and asynchronous I/O for exchanging data. Existing solutions depend on kernel-based networking, incurring significant overheads. The interdependence between microservices for these applications involves considerable communication, including contention between multiple concurrent flows or user sessions. In this paper, we design X-IO, a high-performance unified I/O interface that is built on top of shared memory processing with lock-free producer/consumer rings, eliminating kernel networking overheads and contention. X-IO offers a feature-rich interface. X-IO's zero-copy interface supports building provides truly zero-copy data transfers between microservices, achieving high performance. X-IO also provides a POSIX-like socket interface using HTTP/REST API to achieve seamless porting of microservices to X-IO, without any change to the application code. X-IO supports concurrent connections for microservices that require distinct user sessions operating in parallel. Our preliminary experimental results show that X-IO's zero-copy interfaces achieve 2.8x-4.1x performance improvement compared to kernel-based interfaces. Its socket interfaces outperform kernel TCP sockets and achieve performance close to UNIX-domain sockets. The HTTP/REST APIs in X-IO perform 1.4 x-2.3 x better than kernel-based alternatives with concurrent connections.
AB - Cloud-native microservice applications use different communication paradigms to network microservices, including both synchronous and asynchronous I/O for exchanging data. Existing solutions depend on kernel-based networking, incurring significant overheads. The interdependence between microservices for these applications involves considerable communication, including contention between multiple concurrent flows or user sessions. In this paper, we design X-IO, a high-performance unified I/O interface that is built on top of shared memory processing with lock-free producer/consumer rings, eliminating kernel networking overheads and contention. X-IO offers a feature-rich interface. X-IO's zero-copy interface supports building provides truly zero-copy data transfers between microservices, achieving high performance. X-IO also provides a POSIX-like socket interface using HTTP/REST API to achieve seamless porting of microservices to X-IO, without any change to the application code. X-IO supports concurrent connections for microservices that require distinct user sessions operating in parallel. Our preliminary experimental results show that X-IO's zero-copy interfaces achieve 2.8x-4.1x performance improvement compared to kernel-based interfaces. Its socket interfaces outperform kernel TCP sockets and achieve performance close to UNIX-domain sockets. The HTTP/REST APIs in X-IO perform 1.4 x-2.3 x better than kernel-based alternatives with concurrent connections.
KW - communication in service function chains
KW - DPDK
KW - shared memory
KW - unified I/O interface
UR - http://www.scopus.com/inward/record.url?scp=85166474657&partnerID=8YFLogxK
U2 - 10.1109/NetSoft57336.2023.10175428
DO - 10.1109/NetSoft57336.2023.10175428
M3 - Conference contribution
AN - SCOPUS:85166474657
T3 - 2023 IEEE 9th International Conference on Network Softwarization: Boosting Future Networks through Advanced Softwarization, NetSoft 2023 - Proceedings
SP - 107
EP - 115
BT - 2023 IEEE 9th International Conference on Network Softwarization
A2 - Bernardos, Carlos J.
A2 - Martini, Barbara
A2 - Rojas, Elisa
A2 - Verdi, Fabio Luciano
A2 - Zhu, Zuqing
A2 - Oki, Eiji
A2 - Parzyjegla, Helge
PB - Institute of Electrical and Electronics Engineers Inc.
Y2 - 19 June 2023 through 23 June 2023
ER -