SFFS低延迟的面向小文件的分布式文件系统.PDF

王鲁俊，龙 翔，吴兴博，等.SFFS ：低延迟的面向小文件的分布式文件系统[J].计算机科学与探索，2014 ，8（4）：438-445. ISSN 1673-9418 CODEN JKYTA8 E-mail: fcst@vip. 163.com Journal of Frontiers of Computer Science and Technology 1673-9418/2014/08(04)-0438-08 Tel: +86-10 doi: 10.3778/j.issn. 1673-9418.1311014 SFFS ：低延迟的面向小文件的分布式文件系统 + 王鲁俊，龙 翔，吴兴博，王 雷 北京航空航天大学 计算机学院，北京 100191 SFFS: Low-Latency Small-File-Oriented Distributed File System WANG Lujun, LONG Xiang, WU Xingbo, WANG Lei+ School of Computer Science and Engineering, Beihang University, Beijing 100191, China + Corresponding author: E-mail: wanglei@ WANG Lujun, LONG Xiang, WU Xingbo, et al. SFFS: low-latency small-file-oriented distributed file system. Journal of Frontiers of Computer Science and Technology, 2014, 8(4) ：438-445. Abstract: SNS (social networking services) and E-commerce services developed rapidly. Such services need store numerous small files like pictures, music files and macro blog texts. Traditional distributed storage systems, such as HDFS (Hadoop distributed file system), are designed for large files, which will have problems such as too much over- head with metadata and high latency when dealing with large number of small files. This paper analyzes the architec- ture and read-write flow of TFS (Taobao file system), and finds that TFS has to build several network connections when writing or reading a small file, which increases the read-write latency. Aiming at the challenge of storing numerous small files and the problems of TFS, this paper proposes SFFS (small-file file system), a low-latency high availability small-file-oriented distributed storage