This study considers the fragmented analysis of errors in the rating of open-ended responses; it develops a methodology for a more unified analysis; the methodology is applied to analyze rater effects; imaging technology is used to minimize rater effects; and then conclusions are drawn and recommendations are made based on these analyses.