大数据平台的基础能力和性能测试.pdfVIP

TOPIC 专题 37 大数据平台的基础能力和性能测试 1,2 1,2 姜春宇 ，魏凯 1. 中国信息通信研究院移动互联网与大数据部，北京 100191 2. 数据中心联盟大数据发展促进委员会，北京 100045 摘要 目前整个大数据技术还处于以开源方式为主导、多种技术并存的阶段。开源技术催生了大量的商业发行 版大数据平台软件，大数据企业级市场竞争加剧，如何测试和评估这些大数据平台软件成为新的研究主 题。简要地介绍了大数据技术发展的背景以及大数据技术标准的需求，综述了国际大数据平台标准化和 评测的现状，详细介绍了数据中心联盟在大数据平台技术标准化和测评方面的实践，最后总结了当前工 作的问题，并展望了下一步大数据技术和评测的发展方向。 关键词 大数据；大数据技术标准化；大数据产品评测；数据；负载 doi: 10.11959/j.issn.2096-0271.2017040 Basic capability and performance test of big data platform JIANG Chunyu, WEI Kai 1. Department of Mobile Internet and Big Data, China Academy of Information and Communications Technology, Beijing 100191, China 2. Council for the Promotion of Big Data Development, Beijing 100045, China Abstract The whole big data technology is now leaded by open source society which results in coexist of many competing technologies. Open sources also help to cultivate a great number of big data commercial software. The enterprise market is now crowded by various providers. How to evaluate these softwares becomes a new research topic. At the beginning, the development of big data system was briefly reviewed. Then the requirement of big data technology standardization was illustrated. After reviewing the progress of international big data technology standardization, the standardization and test practices in big data products under the organization of Data Center Alliance was introduced. Finally, the drawbacks of current practices were discussed, and the future direction of standardization and test for big data products was summarized. Key words big data, big data technology standardization, big data products evaluation, data, workload 2