X-IO: A High-performance Unified I/O Interface using Lock-free Shared Memory Processing

Shixiong Qi*, Han Sing Tsai, Yu Sheng Liu, K. K. Ramakrishnan, Jyh Cheng Chen

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Cloud-native microservice applications use different communication paradigms to network microservices, including both synchronous and asynchronous I/O for exchanging data. Existing solutions depend on kernel-based networking, incurring significant overheads. The interdependence between microservices for these applications involves considerable communication, including contention between multiple concurrent flows or user sessions. In this paper, we design X-IO, a high-performance unified I/O interface that is built on top of shared memory processing with lock-free producer/consumer rings, eliminating kernel networking overheads and contention. X-IO offers a feature-rich interface. X-IO's zero-copy interface supports building provides truly zero-copy data transfers between microservices, achieving high performance. X-IO also provides a POSIX-like socket interface using HTTP/REST API to achieve seamless porting of microservices to X-IO, without any change to the application code. X-IO supports concurrent connections for microservices that require distinct user sessions operating in parallel. Our preliminary experimental results show that X-IO's zero-copy interfaces achieve 2.8x-4.1x performance improvement compared to kernel-based interfaces. Its socket interfaces outperform kernel TCP sockets and achieve performance close to UNIX-domain sockets. The HTTP/REST APIs in X-IO perform 1.4 x-2.3 x better than kernel-based alternatives with concurrent connections.

Original languageEnglish
Title of host publication2023 IEEE 9th International Conference on Network Softwarization
Subtitle of host publicationBoosting Future Networks through Advanced Softwarization, NetSoft 2023 - Proceedings
EditorsCarlos J. Bernardos, Barbara Martini, Elisa Rojas, Fabio Luciano Verdi, Zuqing Zhu, Eiji Oki, Helge Parzyjegla
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages107-115
Number of pages9
ISBN (Electronic)9798350399806
DOIs
StatePublished - 2023
Event9th IEEE International Conference on Network Softwarization, NetSoft 2023 - Madrid, Spain
Duration: 19 Jun 202323 Jun 2023

Publication series

Name2023 IEEE 9th International Conference on Network Softwarization: Boosting Future Networks through Advanced Softwarization, NetSoft 2023 - Proceedings

Conference

Conference9th IEEE International Conference on Network Softwarization, NetSoft 2023
Country/TerritorySpain
CityMadrid
Period19/06/2323/06/23

Keywords

  • communication in service function chains
  • DPDK
  • shared memory
  • unified I/O interface

Fingerprint

Dive into the research topics of 'X-IO: A High-performance Unified I/O Interface using Lock-free Shared Memory Processing'. Together they form a unique fingerprint.

Cite this