This study examines how variations in speaker order increase the potential for rater error in the performance based course. Seventy-six undergraduate raters were randomly assigned to one of eight treatment groups and asked to grade eight-week training course. Speaker order and presentation quality varied across groups and an ANOVA was used to examine significant differences across rater assessments, feedback quality and rater gender. Significant main effects were identified in each of the eight treatment groups suggesting that speaker order influenced rater scoring.



To view the content in your browser, please download Adobe Reader or, alternately,
you may Download the file to your hard drive.

NOTE: The latest versions of Adobe Reader do not support viewing PDF files within Firefox on Mac OS and if you are using a modern (Intel) Mac, there is no official plugin for viewing PDF files within the browser window.