Skip to main content

Breadcrumb

Home arrow_forward_ios Evaluations arrow_forward_ios Impact Evaluation of Supplemental L ...
Home arrow_forward_ios ... arrow_forward_ios Impact Evaluation of Supplemental L ...
Evaluations
Contract Closed

Impact Evaluation of Supplemental Literacy Interventions in Freshman Academies

NCEE
Program: Elementary and Secondary Education Act
Award amount: $6,498,159
Awardee:
MDRC, American Institutes for Research (AIR)
Year: 2004
Duration: 6 years (09/01/2004 - 09/01/2010)
Project type:
Impact
Contract number: ED-01-CO-0111/0001

Background

The Smaller Learning Communities (SLC) Program (funded at $88 million in Fiscal Year 2009), authorized in 2000 by the Elementary and Secondary Education Act, awarded discretionary grants to school districts to support the implementation of SLCs and activities to improve student academic achievement in large public high schools. Because, according to the National Assessment of Educational Progress, over 70 percent of students nationally arrive in high school with reading skills that are below proficient, in 2005 the U.S. Department of Education's Office of Elementary and Secondary Education awarded SLC grants to 10 districts and 34 of their high schools for a demonstration and rigorous evaluation of supplemental literacy interventions for striving 9th grade readers.

This evaluation tested two supplemental, year-long literacy programs for 9th graders identified as two years or more behind grade level in reading. These "Enhanced Reading Opportunity" (ERO) programs were selected by a national panel of experts from among those submitted by 17 curriculum developers in a competition conducted under the demonstration.

Project Activities

Research question

  • What were the short-term impacts of these interventions on 9th grade students' reading skills and behaviors?
  • What were the longer-term impacts on academic outcomes in the 10th and 11th grades, such as achievement on high-stakes state assessments, performance in academic courses, and progress toward graduation?

Structured Abstract

Design

Within each of the 10 districts, participating high schools were randomly assigned so that a total of 17 implemented each of the two Enhanced Reading Opportunity (ERO) interventions—Reading Apprenticeship [WestEd] and Xtreme Reading [University of Kansas]—within their freshman SLCs. At each high school, two cohorts of eligible, entering ninth-grade students were randomly assigned to participate in either the supplemental literacy program or an elective of their choosing during the year. Across the two cohorts, approximately 5,000 students (about 2,500 9th graders in 2005–06 and in 2006–07) were involved in the study. The analysis relied on evaluator-administered surveys and literacy assessments conducted both before and at the end of the 9th grade program, as well as school records data.

Key findings

  • Together, the ERO programs improved students' reading comprehension skills during the 9th grade, corresponding to an improvement from the 23rd to the 25th percentile. However, 77 percent of students assigned to the ERO class were still reading 2 or more years behind grade level at the end of the year.
  • During the 9th grade, the ERO program also had a positive impact on students' academic performance in core subject areas, including their grades and credit accumulation. Students in the ERO group scored higher on their states' English/Language Arts and mathematics assessment than did those in the non-ERO group.
  • The ERO program effects on academic performance did not continue beyond the program year.
  • When analyzed separately, the Reading Apprenticeship program significantly improved students' reading comprehension during the 9th grade year while the Xtreme Reading program did not have a statistically significant impact on reading comprehension. Impacts on other outcomes were similar for the two programs.

People and institutions involved

IES program contact(s)

Marsha Silverberg

Economist
NCEE

Products and publications

A report, titled The Enhanced Reading Opportunities Study Final Report, was released in July 2010.

Questions about this project?

To answer additional questions about this project or provide feedback, please contact the program officer.

 

Tags

Reading

Share

Icon to link to Facebook social media siteIcon to link to X social media siteIcon to link to LinkedIn social media siteIcon to copy link value

Questions about this project?

To answer additional questions about this project or provide feedback, please contact the program officer.

 

You may also like

Zoomed in IES logo
Data file

U.S. Program for the International Assessment of A...

Publication number: NCES 2025224
Read More
Zoomed in IES logo
Statistical Analysis Report

2024 NAEP Reading Assessment: Results at Grades 4 ...

Author(s): National Center for Education Statistics (NCES)
Publication number: NCES 2024218
Read More
Zoomed in IES logo
Statistics in Brief

NAEP Reading 2024 State and District Snapshot Repo...

Author(s): National Center for Education Statistics (NCES)
Publication number: NCES 2024220
Read More
icon-dot-govicon-https icon-quote