|
|
Improvement index
The WWC computes an improvement index for each individual finding. In addition, within each outcome domain, the WWC computes an average improvement index for each study and an average improvement index across studies (see Technical Details of WWC-Conducted Computations). The improvement index represents the difference between the percentile rank of the average student in the intervention condition versus the percentile rank of the average student in the comparison condition. Unlike the rating of effectiveness, the improvement index is based entirely on the size of the effect, regardless of the statistical significance of the effect, the study design, or the analyses. The improvement index can take on values between -50 and +50, with positive numbers denoting results favorable to the intervention group.
The average improvement index for alphabetics is +18 percentile points across the two studies, with a range of +2 to +44 percentile points across findings. The average improvement index for fluency is +9 percentile points across the two studies, with a range of +1 to +20 percentile points across findings. The average improvement index for comprehension is +20 percentile points across the two studies, with a range of +1 to +37 percentile points across findings.
Summary
The WWC reviewed two studies on Kaplan SpellRead. Both studies met WWC evidence standards. Based on these two studies, the WWC found positive effects in alphabetics and potentially positive effects in fluency and comprehension. The evidence presented in this report may change as new research emerges.
|Institute of Education Sciences