|
|
Improvement index
The WWC computes an improvement index for each individual finding. In addition, within each outcome domain, the WWC computes an average improvement index for each study and an average improvement index across studies (see Technical Details of WWC-Conducted Computations). The improvement index represents the difference between the percentile rank of the average student in the intervention condition versus the percentile rank of the average student in the comparison condition. Unlike the rating of effectiveness, the improvement index is based entirely on the size of the effect, regardless of the statistical significance of the effect, the study design, or the analyses. The improvement index can take on values between -50 and +50, with positive numbers denoting results favorable to the intervention group.
The average improvement index for alphabetics is +11 percentile points across the two studies, with a range of -8 to +27 percentile points across findings. The improvement index for comprehension is -25 for the one outcome studied.
Summary
The WWC reviewed seven studies on Voyager Universal Literacy System®. Two of these studies met WWC evidence standards with reservations; the remaining studies did not meet WWC evidence screens. Based on these two studies, the WWC found potentially positive effects on alphabetics and potentially negative effects on comprehension. Evidence presented in this report may change as new research emerges.
|Institute of Education Sciences