CRL: Efficient Concurrent Regeneration Codes with Local Reconstruction in Geo-Distributed Storage Sy

来源 :计算机科学技术学报(英文版) | 被引量 : 0次 | 上传用户:seasports
下载到本地 , 更方便阅读
声明 : 本文档内容版权归属内容提供方 , 如果您对本文有版权争议 , 可与客服联系进行内容授权或下架
论文部分内容阅读
As a typical erasure coding choice,Reed-Solomon (RS) codes have such high repair cost that there is a penalty for high reliability and storage efficiency,thereby they are not suitable in geo-distributed storage systems.We present a novel family of concurrent regeneration codes with local reconstruction (CRL) in this paper.The CRL codes enjoy three benefits.Firstly,they are able to minimize the network bandwidth for node repair.Secondly,they can reduce the number of accessed nodes by calculating parities from a subset of data chunks and using an implied parity chunk.Thirdly,they are faster than existing erasure codes for reconstruction in geo-distributed storage systems.In addition,we demonstrate how the CRL codes overcome the limitations of the Reed-Solomon codes.We also illustrate analytically that they are excellent in the trade-off between chunk locality and minimum distance.Furthermore,we present theoretical analysis including latency analysis and reliability analysis for the CRL codes.By using quantity comparisons,we prove that CRL(6,2,2) is only 0.657x of Azure LRC(6,2,2),where there are six data chunks,two global parities,and two local parities,and CRL(10,4,2) is only 0.656x of HDFS-Xorbas(10,4,2),where there are 10 data chunks,four local parities,and two global parities respectively,in terms of data reconstruction times.Our experimental results show the performance of CRL by conducting performance evaluations in both two kinds of environments:1) it is at least 57.25% and 66.85% more than its competitors in terms of encoding and decoding throughputs in memory,and 2) it has at least 1.46x and 1.21x higher encoding and decoding throughputs than its competitors in JBOD (Just a Bunch Of Disks).We also illustrate that CRL is 28.79% and 30.19% more than LRC on encoding and decoding throughputs in a geo-distributed environment.
其他文献
Stream processing applications continuously process large amounts of online streaming data in real time or near real time.They have strict latency constraints.H
长春市宽城区按照中央提出的“生产发展、生活宽裕、乡风文明、村容整洁、管理民主”的社会主义新农村建设的总体要求,结合全区实施的“改造大铁北、建设新宽城,打造长春北部
硬膜下积液一般发生在一侧或双侧额颞骨内板下方[1] 。而大脑镰旁硬膜下积液 (subduralfluidaccumulationbesidecerebralfalx ,SFACF)较少见 ,本文通过 15例SFACF的CT征象分析 ,探讨其影像特点。1 材料与方法1.1 选 Subdural effus
陈家店村是农安县集中力量打造的新农村建设样板村.该村位于合隆镇西北3公里,幅员面积1030公顷,现有耕地792公顷,林地面积60公顷,水域面积5公顷.全村963户,人口3560人.根据新
目的:研究胶质瘤中蛋白激酶P13K、AKT2 mRNA表达与NDRG2 mRNA表达的相关性,寻找与NDRG2相互作用的上下游分子.方法:用实时定量PCR技术检测29例脑胶质瘤及相应瘤旁组织中P13K
吴江市金家坝镇水产养殖大户顾四金同志于1996年开始养殖特种水产品,2001年开始试养南美白对虾,通过刻苦钻研养殖技术,探索出一套高产高效的养殖模式和管理经验。2002年养殖
九台市红光村地处龙嘉镇东北部,全村幅员面积3平方公里,有3个自然屯,406个农户,总人口1167人,劳动力786人.有耕地270公顷,全部为水田,依靠饮马河流域自流灌溉.主导产业为绿色
股骨头缺血性坏死(简称ANFH),是发病率和致残率极高的骨缺血性坏死性疾病,可累及单侧或双侧髋关节.病变主要导致关节软骨破坏,股骨头塌陷,最终导致髋关节功能障碍甚至功能丧
白城市是吉林省杂粮主产区之一,特别是绿豆和燕麦生产发展较快,种植面积不断扩大,生产上应用的新品种较多,产品质量较好,在国内外市场上有较强的竞争力,具有广阔的发展前景.