X-IO: A High-performance Unified I/O Interface using Lock-free Shared Memory Processing

Shixiong Qi*, Han Sing Tsai, Yu Sheng Liu, K. K. Ramakrishnan, Jyh Cheng Chen

*此作品的通信作者

研究成果: Conference contribution同行評審

2 引文 斯高帕斯(Scopus)

摘要

Cloud-native microservice applications use different communication paradigms to network microservices, including both synchronous and asynchronous I/O for exchanging data. Existing solutions depend on kernel-based networking, incurring significant overheads. The interdependence between microservices for these applications involves considerable communication, including contention between multiple concurrent flows or user sessions. In this paper, we design X-IO, a high-performance unified I/O interface that is built on top of shared memory processing with lock-free producer/consumer rings, eliminating kernel networking overheads and contention. X-IO offers a feature-rich interface. X-IO's zero-copy interface supports building provides truly zero-copy data transfers between microservices, achieving high performance. X-IO also provides a POSIX-like socket interface using HTTP/REST API to achieve seamless porting of microservices to X-IO, without any change to the application code. X-IO supports concurrent connections for microservices that require distinct user sessions operating in parallel. Our preliminary experimental results show that X-IO's zero-copy interfaces achieve 2.8x-4.1x performance improvement compared to kernel-based interfaces. Its socket interfaces outperform kernel TCP sockets and achieve performance close to UNIX-domain sockets. The HTTP/REST APIs in X-IO perform 1.4 x-2.3 x better than kernel-based alternatives with concurrent connections.

原文English
主出版物標題2023 IEEE 9th International Conference on Network Softwarization
主出版物子標題Boosting Future Networks through Advanced Softwarization, NetSoft 2023 - Proceedings
編輯Carlos J. Bernardos, Barbara Martini, Elisa Rojas, Fabio Luciano Verdi, Zuqing Zhu, Eiji Oki, Helge Parzyjegla
發行者Institute of Electrical and Electronics Engineers Inc.
頁面107-115
頁數9
ISBN(電子)9798350399806
DOIs
出版狀態Published - 2023
事件9th IEEE International Conference on Network Softwarization, NetSoft 2023 - Madrid, Spain
持續時間: 19 6月 202323 6月 2023

出版系列

名字2023 IEEE 9th International Conference on Network Softwarization: Boosting Future Networks through Advanced Softwarization, NetSoft 2023 - Proceedings

Conference

Conference9th IEEE International Conference on Network Softwarization, NetSoft 2023
國家/地區Spain
城市Madrid
期間19/06/2323/06/23

指紋

深入研究「X-IO: A High-performance Unified I/O Interface using Lock-free Shared Memory Processing」主題。共同形成了獨特的指紋。

引用此