TY - JOUR
T1 - Design and implementation of a MPI-based parallel file system
AU - Tsai, Yung Yu
AU - Hsieh, Te Ching
AU - Lee, Guo Hua
AU - Chang, Ming Feng
PY - 1999/1
Y1 - 1999/1
N2 - This paper presents the design of an MPI (Message Passing Interface)-based parallel file system, MPFS. MPI-IO is an extension of MPI which supports flexible logical file partition and physical file organization as well as a rich set of file access functions. MPFS enables users to specify both logical file partitions among user processes and physical file data layouts across data servers. The present implementation includes full support of file data distribution, asynchronous I/O, shared file pointers, collective I/O operations, and limited support of data layout hints. Moreover, MPFS achieves portability through a user library that conforms to a generic UNIX interface. However, MPFS does not support the FORTRAN interface, error handling or profiling in the MPI-IO specification. MPFS has been implemented on a workstation cluster connected by Fast Ethernet. The performance measurements of MPFS show that the message passing overhead is minimal, and that the performance is limited by the bandwidth of Fast Ethernet.
AB - This paper presents the design of an MPI (Message Passing Interface)-based parallel file system, MPFS. MPI-IO is an extension of MPI which supports flexible logical file partition and physical file organization as well as a rich set of file access functions. MPFS enables users to specify both logical file partitions among user processes and physical file data layouts across data servers. The present implementation includes full support of file data distribution, asynchronous I/O, shared file pointers, collective I/O operations, and limited support of data layout hints. Moreover, MPFS achieves portability through a user library that conforms to a generic UNIX interface. However, MPFS does not support the FORTRAN interface, error handling or profiling in the MPI-IO specification. MPFS has been implemented on a workstation cluster connected by Fast Ethernet. The performance measurements of MPFS show that the message passing overhead is minimal, and that the performance is limited by the bandwidth of Fast Ethernet.
UR - http://www.scopus.com/inward/record.url?scp=0032648485&partnerID=8YFLogxK
M3 - Article
AN - SCOPUS:0032648485
SN - 0255-6588
VL - 23
SP - 50
EP - 59
JO - Proceedings of the National Science Council, Republic of China, Part A: Physical Science and Engineering
JF - Proceedings of the National Science Council, Republic of China, Part A: Physical Science and Engineering
IS - 1
ER -