Towards a Cost-Efficient MapReduce: Mitigating Power Peaks for Hadoop Clusters

来源 :Tsinghua Science and Technology | 被引量 : 0次 | 上传用户:rrttwytpic
下载到本地 , 更方便阅读
声明 : 本文档内容版权归属内容提供方 , 如果您对本文有版权争议 , 可与客服联系进行内容授权或下架
论文部分内容阅读
Distributed data processing system is becoming one of the most important components for data-intensive computational tasks in the enterprise software infrastructure.Deploying and operating such systems require large amount of costs,including hardware costs to build clusters and energy costs to run clusters.To make these systems sustainable and scalable,power management has been an important research problem.In this paper,we take Hadoop as an example to illustrate the power peak problem which causes power inefficiency and provides in-depth analysis to explain issues with existing system designs.We propose a novel power capping module in the Hadoop scheduler to mitigate power peaks.Extensive simulation studies show that our proposed solution can effectively smooth the power consumption curve and mitigate temporary power peaks for Hadoop clusters. Distributed data processing system is becoming one of the most important components for data-intensive computational tasks in the enterprise software infrastructure. Deployment and operating such systems require large amount of costs, including hardware costs to build clusters and energy costs to run clusters.To make these systems sustainable and scalable, power management has been an important research problem. In this paper, we take Hadoop as an example to illustrate the power peak problem which causes power inefficiency and provides in-depth analysis to explain issues with existing system designs .We propose a novel power capping module in the Hadoop scheduler to mitigate power peaks.Extensive simulation studies show that that proposed solution can be smooth the power consumption curve and mitigate temporary power peaks for Hadoop clusters.
其他文献
“学党章党规、学系列讲话,做合格党员”是党中央深化党内教育、全面从严治党的做出的重要部署,也是继“三严三实”教育、“群众路线”教育后的党内教育实践活动,把“两学一
数学是一门系统、逻辑性较强的学科,而幼儿年龄比较小,抽象思维能力差。在数学活动中,比如,数的认知方面要让幼儿清楚地理解数概念,而数字对于幼儿来说,相对是抽象、枯燥的,所以需要
期刊
多动手,多操作,提升同学们的操作水平和综合能力;在单调的练习中加入具有趣味性的“调味剂”,设计新颖独特的在课堂练习,毛体的“沁园春·雪”,曲线优美的抛物线,妙趣横生的美图秀秀
自媒体时代下历史虚无主义的网络传播,对高校大学生思想政治教育产生了不可预估的负面影响.因此,在网络时代,我们必须坚持马克思主义唯物史观,着力增强“三力”,做到“三个转
新媒体背景下大学生思想政治教育具有隐匿性、即时性、可接受性等新特点,也对思想政治教育工作产生了巨大的挑战.在新媒体背景下,思想政治教育工作者要坚守育人本位,强化文化
一般来说,传统的教学方法容易使学生感觉到枯燥无味。所以,教师要想充分利用课堂45分钟,只有提高历史课堂教学效率,激活课堂,使学生能主动学习,形成生动活泼的学习氛围。在长期的教
1978年,十一届三中全会的召开,开启了改革开放历史新时期。改革开放使国家的经济实力和国民生活水平发生了前所未有的变化,也使哲学社会科学研究呈现出繁荣发展的大好局面。3
为探究吕家坨井田地质构造格局,根据钻孔勘探资料,采用分形理论和趋势面分析方法,研究了井田7
通过对大连市中学生消费现状的调查,分析了大连市中学生消费结构的新变化、消费行为的新特征和消费存在的突出问题,提出理性消费、加强理财和艰苦朴素教育、优化学校周边消费环
延安时期,为了肃清党内存在的非无产阶级思想,从思想上保证党的团结统一,中国共产党将思想建设放在突出位置,在思想建设过程中注重提升党员的党性修养、加强干部教育、联系实