Exhibit ES.5. Mean ratings of technical quality, relevance, and usefulness, by center type and by year |
---|
Technical quality | Relevance | Usefulness | |||||||
---|---|---|---|---|---|---|---|---|---|
2006–07 | 2007–08 | 2008–09 | 2006–07 | 2007–08 | 2008–09 | 2006–07 | 2007–08 | 2008–09 | |
All Centers (N=21) |
3.34 | 3.51 | 3.57 | 3.94 | 4.08 | 4.15 | 3.69 | 3.95 | 3.96 |
All RCCs (N=16) |
3.21 | 3.41 | 3.52 | 3.99 | 4.18 | 4.15 | 3.71 | 3.99 | 3.94 |
All CCs (N=5) |
3.73 | 3.86 | 3.72 | 3.78 | 3.96 | 4.17 | 3.65 | 3.84 | 4.01 |
Difference of RCC and CC means | -0.52† | -0.45† | -0.20† | 0.21† | 0.22† | -0.02 | 0.06 | 0.15† | -0.07 |
Pooled standard deviation (all Centers) | 0.41 | 0.41 | 0.37 | 0.34 | 0.22 | 0.24 | 0.34 | 0.23 | 0.27 |
Ratio of difference in means to pooled standard deviation | -1.28 | -1.09 | -0.55 | 0.62 | 1 | -0.08 | 0.18 | 0.64 | -0.26 |
NOTE: All ratings were on a 5-point scale, with 5 as the high value. The "technical
quality" rating is the mean of the ratings for the three quality dimensions. A notation
of † indicates that the difference in the mean ratings between the CCs and RCCs
within that year is at least one-half of one pooled standard deviation in the rating. EXHIBIT READS: In 2006–07 among the 21 Centers, the mean technical quality rating was 3.34. SOURCE: Expert panel ratings of sampled projects for technical quality and surveys of project participants for relevance and usefulness. Responses weighted so that each panelist or participant contributed equally to project ratings; each project contributed equally to Center ratings; and each Center contributed equally to cross-Center ratings. |