论文部分内容阅读
在大规模考试中,评分人差异是威胁测试信度和效度的重要因素。大量研究发现,即使评分人通过了严格的培训,评分人差异仍然存在。本文试图探讨决策风格对评分人差异的影响。评分人决策风格档案包括四种不同类型数据的分析结果:1)13位CET-4作文评分人给50篇CET-4实考作文的分数;2)他们对所给分数的把握度;3)他们对其中五篇作文的有声思维;4)他们对一般决策风格量表(GDMSI)的回答。结果显示,不同评分人的决策风格存在个体差异,而且评分质量较高的评分人没有特定的主要决策风格。本研究的意义在于揭示了决策风格对于解释评分人差异的重要作用。
In large-scale exams, scoring differences are important factors that threaten test reliability and validity. Numerous studies have found that even if the graders passed rigorous training, differences in scoring people still exist. This article attempts to explore the impact of decision-making style on the difference between scorers. The scorer’s decision-making profile includes the results of four different types of data analysis: 1) scores of 13 CET-4 essayists giving 50 CET-4 actual essay compositions; 2) their level of confidence in the scores given; 3) Their vocal thinking on five of the five essays; 4) Their responses to the General Decision Style Scale (GDMSI). The results show that there are individual differences in the decision-making styles of different graders, and graders with higher grading do not have specific major decision-making styles. The significance of this study lies in revealing the important role of decision-making style in explaining the difference between scorers.