Collusion-Proof Result Inference in Crowdsourcing

来源 :计算机科学技术学报(英文版) | 被引量 : 0次 | 上传用户:dvluxiang
下载到本地 , 更方便阅读
声明 : 本文档内容版权归属内容提供方 , 如果您对本文有版权争议 , 可与客服联系进行内容授权或下架
论文部分内容阅读
In traditional crowdsourcing,workers are expected to provide independent answers to tasks so as to ensure the diversity of answers.However,recent studies show that the crowd is not a collection of independent workers,but instead that workers communicate and collaborate with each other.To pursue more rewards with little effort,some workers may collude to provide repeated answers,which will damage the quality of the aggregated results.Nonetheless,there are few efforts considering the negative impact of collusion on result inference in crowdsourcing.In this paper,we are specially conced with the Collusion-Proof result inference problem for general crowdsourcing tasks in public platforms.To that end,we design a metric,the worker performance change rate,to identify the colluded answers by computing the difference of the mean worker performance before and after removing the repeated answers.Then we incorporate the collusion detection result into existing result inference methods to guarantee the quality of the aggregated results even with the occurrence of collusion behaviors.With real-world and synthetic datasets,we conducted an extensive set of evaluations of our approach.The experimental results demonstrate the superiority of our approach in comparison with the state-of-the-art methods.
其他文献
介绍了2003年国家林业局颁发的《森林资源规划设计调查主要技术规定》中两种总体蓄积差值的比较标准,从理论上阐述该标准没有科学依据,并以实测数据说明此标准带来的不良后果
目的 探讨脑内神经节胶质瘤的影像学诊断价值 ,以提高对本瘤的认识。方法 回顾性分析 4例经手术及病理证实的神经节胶质瘤的临床和影像学资料。其中 2男 2女 ,年龄 14~ 47岁
今年吉林省榆树市农机深松整地任务是220万亩,截至目前,全市已经完成深松整地作业面积105万亩,完成总任务的48%.为确保全面完成任务,针对玉米晚熟品种种植面积大,个别地块遭遇
1 病史摘要男 ,46岁。无明显原因出现头晕 ,发作时伴视物不清、旋转18d ,近来出现恶心、呕吐 ,呈喷射状 12d入院。既往无肿瘤病史。查体 :体温、血压、脉搏、呼吸正常 ,意识
随着对晚期非小细胞肺癌( Non-small cell lung cancer ,NSCLC)发病机制及其生物学行为研究的不断深入,针对本病相关靶点的分子靶向治疗已成为一种重要的手段。近年来在部分NSCLC
目的 了解中耳正常结构在CT仿真内镜下的影像学特征。明确传导性耳聋的听小骨及听骨链的形态学改变。方法 HispeedCT/I进行颞骨薄层螺旋扫描 ,层厚 1mm ,螺距 1,电压 14 0k
影响云冷杉混交林天然更新效果的因素有很多,哪种因素起的作用大,仅用定性分析难以做出判断。本文采用灰色系统理论中的关联分析法,对影响云冷杉针阔混交林天然更新的因素进
自今年8月17日以来,吉林省通化市农委按照市政府办公室《关于印发通化市百日安全生产活动实施方案的通知》(通市政办明电[2012]66号)文件要求,坚持“安全第一、预防为主、综
用3 2 P示踪原子法通过水培试验研究了酸性条件下铝对 1年生杉木的根和叶磷吸收和代谢的影响。结果表明 ,在pH =3时 ,用酸铝处理根和叶后 ,根中3 2 P 无机磷增加到对照的 1 9
配方施肥是以土壤测试和肥料田间试验为基础,根据作物需肥规律、土壤供肥性能和肥料效应,在合理施用有机肥的基础上,提出的氮磷钾肥适宜用量和配比及相应的施肥技术。麦盖提