Skip Navigation
Print Evaluations

Impact Evaluation of Supplemental Literacy Interventions in Freshman Academies

Contract Information

Current Status:

This study has been completed.

Duration:

September 2004 – September 2010

Cost:

$6,498,159

Contract Number:

ED-01-CO-0111/0001

Contractor(s):

MDRC
American Institutes for Research

Reports

The Smaller Learning Communities (SLC) Program (funded at $88 million in Fiscal Year 2009), authorized in 2000 by the Elementary and Secondary Education Act, awarded discretionary grants to school districts to support the implementation of SLCs and activities to improve student academic achievement in large public high schools. Because, according to the National Assessment of Educational Progress, over 70 percent of students nationally arrive in high school with reading skills that are below proficient, in 2005 the U.S. Department of Education's Office of Elementary and Secondary Education awarded SLC grants to 10 districts and 34 of their high schools for a demonstration and rigorous evaluation of supplemental literacy interventions for striving 9th grade readers.

This evaluation tested two supplemental, year-long literacy programs for 9th graders identified as two years or more behind grade level in reading. These "Enhanced Reading Opportunity" (ERO) programs were selected by a national panel of experts from among those submitted by 17 curriculum developers in a competition conducted under the demonstration.

  • What were the short-term impacts of these interventions on 9th grade students' reading skills and behaviors?
  • What were the longer-term impacts on academic outcomes in the 10th and 11th grades, such as achievement on high-stakes state assessments, performance in academic courses, and progress toward graduation?

Within each of the 10 districts, participating high schools were randomly assigned so that a total of 17 implemented each of the two Enhanced Reading Opportunity (ERO) interventions—Reading Apprenticeship [WestEd] and Xtreme Reading [University of Kansas]—within their freshman SLCs. At each high school, two cohorts of eligible, entering ninth-grade students were randomly assigned to participate in either the supplemental literacy program or an elective of their choosing during the year. Across the two cohorts, approximately 5,000 students (about 2,500 9th graders in 2005–06 and in 2006–07) were involved in the study. The analysis relied on evaluator-administered surveys and literacy assessments conducted both before and at the end of the 9th grade program, as well as school records data.

A report, titled The Enhanced Reading Opportunities Study Final Report, was released in July 2010.

  • Together, the ERO programs improved students' reading comprehension skills during the 9th grade, corresponding to an improvement from the 23rd to the 25th percentile. However, 77 percent of students assigned to the ERO class were still reading 2 or more years behind grade level at the end of the year.
  • During the 9th grade, the ERO program also had a positive impact on students' academic performance in core subject areas, including their grades and credit accumulation. Students in the ERO group scored higher on their states' English/Language Arts and mathematics assessment than did those in the non-ERO group.
  • The ERO program effects on academic performance did not continue beyond the program year.
  • When analyzed separately, the Reading Apprenticeship program significantly improved students' reading comprehension during the 9th grade year while the Xtreme Reading program did not have a statistically significant impact on reading comprehension. Impacts on other outcomes were similar for the two programs.