Quality assessment of crowdsourced test cases

来源 :中国科学:信息科学(英文版) | 被引量 : 0次 | 上传用户:xffys3
下载到本地 , 更方便阅读
声明 : 本文档内容版权归属内容提供方 , 如果您对本文有版权争议 , 可与客服联系进行内容授权或下架
论文部分内容阅读
Various software-engineering problems have been solved by crowdsourcing.In many projects,the software outsourcing process is streamlined on cloud-based platforms.Among software engineering tasks,test-case development is particularly suitable for crowdsourcing,because a large number of test cases can be generated at little monetary cost.However,the numerous test cases harvested from crowdsourcing can be high-or low-quality.Owing to the large volume,distinguishing the high-quality tests by traditional techniques is computationally expensive.Therefore,crowdsourced testing would benefit from an efficient mechanism distinguishes the qualities of the test cases.This paper introduces an automated approach-TCQA-to evaluate the quality of test cases based on the onsite coding history.Quality assessment by TCQA proceeds through three steps: (1) modeling the code history as a time series,(2) extracting the multiple relevant features from the time series,and (3) building a model that classifies the test cases based on their qualities.Step (3) is accomplished by feature-based machine-learning techniques.By leveraging the onsite coding history,TCQA can assess the test-case quality without performing expensive source-code analysis or executing the test cases.Using the data of nine test-development tasks involving more than 400 participants,we evaluated TCQA from multiple perspectives.The TCQA approach assessed the quality of the test cases with higher precision,faster speed,and lower overhead than conventional test-case qualityassessment techniques.Moreover,TCQA provided yield real-time insights on test-case quality before the assessment was finished.
其他文献
论文以中外城市建设史为例,介绍了探究式方法在中国城市规划理论教学领域的应用,提高学生学习兴趣,开拓学生视野,增强学生团队合作精神方面发挥着积极有效的作用,但同时由于原有
2005年1月13日,国务院新闻办公室召开新闻发布会,就2004年12月17日国务院讨论通过的《国家高速公路网规划》,邀请交通部部长张春贤和国家发改委副主任张晓强,向中外50多家媒
随着年龄的增长,由于衰老带来的病理、生理变化,特别是步入中老年后,身体时有不适。某些严重危害人们健康的慢性疾病,常因发病隐晦,症状不典型,不易被人们所重视。因此,往往
由于当前我国城市设计本科教育中存在着定位模糊和专业隔阂的问题,城市设计教学很难有传达出其作为连接城市规划与建筑学、景观建筑学的桥梁学科作用的渠道和空间,进而使得毕
会议
本文从给城市规划专业的学生讲授建筑物理出发,分析目前教与学情况,提出改进方法,期望进一步提高建筑物理课程的教学质量.城市规划专业整个课程体系中,建筑物理课程正在从小
全球在1992~1997年期间计划建设51条光纤海缆线路网美国KMI(凯斯勒市场信息研究中心)统计,全球在1992~1997期间计划建设的光纤海缆线路网多达51条,其中15条位于东南亚,9条在大西洋,8条在北欧,太平洋和地中海各有7条
目前,国内高校城市规划专业教学的国际化进程加速,大力推行相关理论课程的双语教学模式成为其有效措施之一.本文以城市地理学为例,从教学特色、教学目标与内容、教材与讲义建
本文探讨了在国际化教育中城市规划全英语课程体系建设的重要议题.文章首先概述了城市规划国际化教育的趋势与背景,并进一步分析了城市规划全英语课程体系建设的困难与挑战.
软雕塑是以软质材料为主,根据一定创作目的的需要而创作出的浮雕或圆雕式艺术品。其创作媒材主要有毛、麻、丝、缎、棉、皮、木等纤维类材料。由于这些材料大都是自然之子,又
In this study,we evaluate the effect on ion-trap quantum computers (QCs) from the quantum nature of the driving field,and propose a theoretical limit for ion-tr