论文部分内容阅读
为提高现代煤炭企业海量数据存储的效率,设计了一种基于HDFS(Hadoop Distributed File System)的煤炭企业云存储平台。该平台在分布式文件存储系统中增加小文件处理模块,可实现小文件的判断以及合并处理,并将其应用于云存储技术,以提高煤炭企业海量数据的处理效率。介绍了云存储平台文件系统HDFS的架构功能以及小文件模块的实现方案,并在此基础上重点阐述了云存储平台的基本配置和系统设计。
In order to improve the efficiency of mass data storage in modern coal enterprises, a cloud storage platform based on HDFS (Hadoop Distributed File System) is designed. The platform adds a small file processing module in the distributed file storage system, which can realize the judgment and combination processing of small files and apply it to the cloud storage technology to improve the processing efficiency of the massive data of coal enterprises. This paper introduces the architecture of cloud storage platform file system HDFS and the implementation of small file module. Based on this, the basic configuration and system design of cloud storage platform are introduced.