Setting
The study took place in eight schools in seven districts in seven states: Alabama, Florida, Michigan, Mississippi, North Carolina, South Carolina, and two schools in Texas. The middle school sample analyzed here comprises three schools in Michigan, Mississippi, and North Carolina.
Study sample
The initial study sample included 3,309 students in grades 2–8 during the 2003/04 school year from 133 classrooms in nine schools, representing eight school districts in eight states. In the initial study sample 1% of the students were Asian, 28% African-American, 38% Hispanic, 0% Native American, 24% White, and 8% not specified. This review focuses on the middle school sample, which initially included 1,823 grade 6–8 students (1,010 treatment and 813 control) in 73 classrooms (41 treatment and 32 control). Demographic data on the middle school students could not be culled from the original study. Middle school classrooms dropped from the analysis include: 7 special
education or enrichment treatment classrooms taught by teachers who had access to, but did not receive training in, Accelerated Math; 4 classrooms (2 treatment, 2 control) taught by two teachers who, according to the authors, arbitrarily chose which students to treat; and 22 classrooms (11 treatment, 11 controls) in a large, urban middle school district that, according to the authors, was unable to devote sufficient time and resources to Accelerated Math. The results here are drawn from the test-takers in the 40 middle school classrooms (21 treatment, 19 control) included in the analysis—792 students took the STAR Math test (418 treatment, 374 control) and 851 took the Terra
Nova test (454 treatment, 397 control). Postattrition treatment and control groups were equivalent on pretests at baseline. Because these samples reflect attrition rates greater than 20%, the WWC rated this study as meeting evidence standards with reservations.
Intervention Group
Students were taught by teachers using the Accelerated Math program during the 2003/04 school year. Accelerated Math is a progress-monitoring software program that teachers can use with their existing math curriculum. The program tracks students’ daily activities, provides immediate feedback to students and teachers, alerts teachers to students struggling with certain assignments, and monitors student achievement. Teachers assigned to the treatment group were asked to use Accelerated Math with their present math curriculum. In practice, the program was not implemented for approximately 40% of grade 2–8 students in the initial treatment group; the authors did not report the percentage of grade 6–8 students in the treatment group of the analysis sample that did not participate in Accelerated Math.
Comparison Group
Students in the control group were taught using existing math curricula, without Accelerated Math. The existing curricula included: Scott Foresman Middle School Math, Consumer Math, Everyday Math, Transition Math (Prentice Hall), and Chicago Math in Michigan; Glencoe in Mississippi; and Glencoe, McGraw-Hill, and the state curriculum in North Carolina. Control students had the same teachers as the intervention group students.
Outcome descriptions
Participating students were pretested in October 2003 and posttested in May 2004 using two nationally normed, standardized tests (STAR Math and Terra Nova) for math achievement. Students in the treatment and control groups were compared using a linear regression analysis in which posttest scores were regressed on pretest scores and on dummy variables related to main effects for experimental condition and school.
Support for implementation
Teachers in the intervention group were trained to use Accelerated Math. During the school year, teachers using Accelerated Math received three to five visits from a Renaissance Learning math consultant, who guided teachers on how to improve their use of the program. Teachers also had unlimited access to technical support.