System-Enforced Deterministic Streaming for E?cient Pipeline Parallelism

来源 :计算机科学技术学报(英文版) | 被引量 : 0次 | 上传用户:ZY5158598
下载到本地 , 更方便阅读
声明 : 本文档内容版权归属内容提供方 , 如果您对本文有版权争议 , 可与客服联系进行内容授权或下架
论文部分内容阅读
Pipeline parallelism is a popular parallel programming pattern for emerging applications. However, program-ming pipelines directly on conventional multithreaded shared memory is di?cult and error-prone. We present DStream, a C library that provides high-level abstractions of deterministic threads and streams for simply representing pipeline stage work-ers and their communications. The deterministic stream is established atop our proposed single-producer/multi-consumer (SPMC) virtual memory, which integrates synchronization with the virtual memory model to enforce determinism on shared memory accesses. We investigate various strategies on how to e?ciently implement DStream atop the SPMC memory, so that an infinite sequence of data items can be asynchronously published (fixed) and asynchronously consumed in order among adjacent stage workers. We have successfully transformed two representative pipeline applications – ferret and dedup using DStream, and conclude conversion rules. An empirical evaluation shows that the converted ferret performed on par with its Pthreads and TBB counterparts in term of running time, while the converted dedup is close to 2.56X, 7.05X faster than the Pthreads counterpart and 1.06X, 3.9X faster than the TBB counterpart on 16 and 32 CPUs, respectively.
其他文献
“资源节约型、环境友好型”两型社会建设是生态文明建设的组成部分,也是全面建成小康社会的重要目标。郴州两型社会建设,是以郴资桂两型社会建设示范带为切入点,突出项目建设、
随着我国人口的不断增多和社会老龄化的不断发展,各地政府和企业更加重视离退休同志的管理工作。全面细致地做好退休职工的服务管理工作,不仅为离退休同志的生活提供了保障,促进
作为电建企业的战略管理手段,绩效管理不仅是重要的人事管理手段,也对电建企业日常经营发展有着很大的促进作用。如何调动电建企业员工的积极性,创造性与主动性,构建适合电建企业
作为企业的事务中心和参谋本部,办公室承担着多种职能,办公室工作人员责任重大,任务繁杂,要真正起到承上启下,衔接各方的作用,就需要具备较高的职业素养。而秘书工作更是内容广、服
随着国家电网“三集五大”改革的不断深入,我国电费收缴也发生了很大的变化,由传统的用电后交费方式开始转变为预存电费方式,这标志着我国电力市场越来越完善。但是由于受到一些
电力设施作为供电企业电力系统运行的,还是用电、供电、输电以及发电必不可少的物质基础,损坏任何一个部分都将会导致电力供应和使用出现中断,对国民经济的稳定有序发展以及社会
实践证明,通过营配信息的实现,能够使营销业务系统数据和生产业务系统数据完成共享。本文笔者在分析营配信息融合的业务需求及数据源规则的基础上,进一步对营配信息融合的实现方
Many machine learning and data mining (MLDM) problems like recommendation, topic modeling, and medical diagnosis can be modeled as computing on bipartite graphs
Determinism is very useful to multithreaded programs in debugging, testing, etc. Many deterministic ap-proaches have been proposed, such as deterministic multit
随着经济的快速发展,我国的电力企业得到了快速的发展,而用户对供电质量和供电服务的要求也越来越高。为提高电力企业的市场竞争力,电力企业必须加强电力营销的精细化管理,确保电