Skip Navigation

What Works Clearinghouse


Effectiveness


Findings

The WWC review of interventions for beginning reading addresses student outcomes in four domains: alphabetics, fluency, comprehension, and general reading achievement. 4 The Sivin-Kachala & Bialo (2005) study addressed outcomes in the fluency and comprehension domains. 5 The findings below present the authors' and the WWC-calculated estimates of the size and statistical significance of the effects of Fluency Formula™ on students' performance.

Fluency. The Sivin-Kachala & Bialo (2005) study findings for fluency are based on the performance of Fluency Formula™ students and comparison students on the Edformation Oral Fluency Assessment (OFA). The WWC found no statistically significant difference between the groups, however, the effect was positive and substantively important according to WWC criteria (that is, an effect size of at least . 25). 6

Comprehension. The Sivin-Kachala & Bialo (2005) study findings for comprehension are based on the performance of Fluency Formula™ students and comparison students on the Woodcock-Johnson III Tests of Achievement: Passage Comprehension subtest. The WWC did not find a statistically significant difference between the groups. However, the effect was negative and substantively important (that is, an effect size of at least –. 25). 7

Rating of effectiveness

The WWC rates the effects of an intervention in a given outcome domain as positive, potentially positive, mixed, no discernible effects, potentially negative, or negative. The rating of effectiveness takes into account four factors: the quality of the research design, the statistical significance of the findings,8 the size of the difference between participants in the intervention and the comparison conditions, and the consistency in findings across studies (see the WWC Intervention Rating Scheme).

4 For definitions of the domains, see the Beginning Reading Protocol.
5 The study also examined data in the alphabetics domain, but complete data were not available in the study report or from the study authors.
6 The study only reported intervention effects by high- and low-ability student groups, based on the OFA pretest score. These results are shown in Appendix A4.The overall effects presented here were computed by the WWC. The study authors reported both raw and normal curve equivalent (NCE) scores. The WWC used the raw score results.
7 The study reported intervention effects on comprehension by each district in the study and for low-ability students. The overall effects presented here were computed by the WWC. The results for low-ability students are shown in Appendix A4.
8 The level of statistical significance was reported by the study authors or, where necessary, calculated by the WWC to correct for clustering within classrooms or schools and for multiple comparisons. For an explanation, see the WWC Tutorial on Mismatch. See the Technical Details of WWC-Conducted Computations for the formulas the WWC used to calculate the statistical significance. In the case of Fluency Formula™, corrections for clustering were needed.

PO Box 2393
Princeton, NJ 08543-2393
Phone: 1-866-503-6114