File placement mechanisms for improving write throughputs of cloud storage services based on Ceph and HDFS

Chun Feng Wu, Tse Chuan Hsu, Hongji Yang, Yeh Ching Chung

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

4 Scopus citations

Abstract

Cloud storage services are pervasive nowadays. Many cloud storage services use distributed file systems as their backend storage systems. Some research results on file-size distribution of file systems show that file systems contain lots of small files. Therefore, this paper proposed a hybrid distributed file system based on Ceph and HDFS that can deliver satisfactory write throughputs for a cloud storage system with 80-90% small files and 10-20% large files. The experimental results show that the file allocation mechanism without RAM disk caching can improve the write throughputs of Ceph and HDFS by approximately 10% to 50%. While the one with RAM disk caching can have up to 200% write throughputs improvement.

Original languageEnglish
Title of host publicationProceedings of the 2017 IEEE International Conference on Applied System Innovation
Subtitle of host publicationApplied System Innovation for Modern Technology, ICASI 2017
EditorsTeen-Hang Meen, Artde Donald Kin-Tak Lam, Stephen D. Prior
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1725-1728
Number of pages4
ISBN (Electronic)9781509048977
DOIs
StatePublished - 21 Jul 2017
Event2017 IEEE International Conference on Applied System Innovation, ICASI 2017 - Sapporo, Japan
Duration: 13 May 201717 May 2017

Publication series

NameProceedings of the 2017 IEEE International Conference on Applied System Innovation: Applied System Innovation for Modern Technology, ICASI 2017

Conference

Conference2017 IEEE International Conference on Applied System Innovation, ICASI 2017
Country/TerritoryJapan
CitySapporo
Period13/05/1717/05/17

Keywords

  • Ceph
  • Cloud Storage
  • HDFS
  • Hybrid Distributed File System

Fingerprint

Dive into the research topics of 'File placement mechanisms for improving write throughputs of cloud storage services based on Ceph and HDFS'. Together they form a unique fingerprint.

Cite this