|
|
Improvement index
The WWC computes an improvement index for each
individual finding. In addition, within each outcome domain,
the WWC computes an average improvement index for
each study and an average improvement index across
studies (see Technical Details of WWC-Conducted Computations).
The improvement index represents the difference
between the percentile rank of the average student in the
intervention condition versus the percentile rank of the average
student in the comparison condition. Unlike the rating
of effectiveness, the improvement index is based entirely
on the size of the effect, regardless of the statistical significance
of the effect, the study design, or the analyses. The
improvement index can take on values between –50 and +50,
with positive numbers denoting results favorable to
the intervention group.
The average improvement index for alphabetics is +25 percentile points across the four studies, with a range of 0 to +49 percentile points across findings.
The average improvement index for reading fluency is +15 percentile points across two studies, with a range of +3 to +33 percentile points across findings.
Summary
The WWC reviewed 28 studies on Earobics®. Two of these studies meet WWC evidence standards; two studies meet WWC evidence standards with reservations; the remaining 24 studies either do not meet WWC evidence standards or do not meet eligibility screens. Based on the four studies, the WWC found positive effects for alphabetics and potentially positive effects for reading fluency. The conclusions presented in this report may change as new research emerges.
|Institute of Education Sciences