فهرست نشریات علمی دسترسی آزاد ایران

This study centered around the notion of rater training with the help of eye-tracking systems. A novice rater participated in a rater training program which was informed by tracking the rater’s eye movements. Immediately after rating a sample of essay in each session, the rater was provided with eye-tracking feedback in the form of a heat-map produced based on his eye movements. The heat map was discussed to help the rater understand his behavior during the rating and to pinpoint which rubric descriptors and essay parts the rater noticed more while rating. The findings revealed that in the early sessions, the rater was influenced by the primacy effect; that is, he was mostly focusing on the two first criteria (content and organization). Furthermore, initially, he had struggles deciding on a band score and dedicated considerable attention to the scores rather than descriptors. However, after sessions of training the rater appeared to modify his behavior and tried to focus on all criteria and the equivalent descriptors. The findings can assist rater trainers in organizing rating programs more effectively by employing eye-tracking systems to scrutinize raters’ behavior.