Skip to main content

Breadcrumb

Home arrow_forward_ios Evaluations arrow_forward_ios Impact Evaluation of Academic Instr ...
Home arrow_forward_ios ... arrow_forward_ios Impact Evaluation of Academic Instr ...
Evaluations
Contract Closed

Impact Evaluation of Academic Instruction For After-School Programs

NCEE
Program: Elementary and Secondary Education Act
Award amount: $15,900,000
Awardee:
MDRC, Public/Private Ventures, Bloom Associates, Survey Research Management
Duration: 5 years 11 months (10/01/2003 - 09/01/2009)
Contract number: ED-01-CO-0060/0004

Background

The 21st Century Community Learning Centers Program, established in 1999, is a state-administered grant program to provide opportunities for academic enrichment to meet state and local student academic achievement standards in core academic subjects, such as reading and mathematics. This program is authorized as part of Title IV of the Elementary and Secondary Education Act and was funded at $1 billion in Fiscal Year 2008. The funding is targeted towards high-poverty schools, with priority given to schools in need of improvement.

Building off of a 2005 national evaluation of the 21st Century Community Learning Centers Program in which grantees were found to offer predominantly homework help that did not produce academic impacts, this study evaluated the impact of two structured and intensive academic programs. The two programs were Harcourt's Mathletics and Success for All's Adventure Island. Both programs were designed for the after-school setting, and so a study of these programs could provide valuable information to inform the 21st Century Community Learning Centers Program more broadly.

Project Activities

Research question

  • What was the effectiveness of offering one year of the academic program (reading or math)? Did program implementation and the one-year impact improve in a second year of operation?
  • What was the effectiveness of offering two years of the academic program (reading or math)?
  • What was the association between receiving the academic program (reading or math) for two consecutive years and math achievement?

Structured Abstract

Design

The evaluation consisted of two parallel studies at the elementary school level (25 programs for each study, one testing the math program—Harcourt Math—and one testing the reading program—Success for All). The evaluation initially included 1,000 students who were randomly assigned to receive treatment and 1,000 to receive the typical support (e.g., general help in a variety of subjects). A subset of the sites continued the program for a second year in which students were randomly assigned a second time to receive one year of treatment in the first year of program operation; to receive one year of treatment in the second year of program operation; to two years of services; and to zero years of the academic program.

Key findings

  • There was a positive impact on math achievement for students offered one year of the math program. Two years of the math program resulted in no difference between those offered and those not offered the math program.
  • There was no impact on reading comprehension achievement for students offered one year of the reading program. Two years of the reading program resulted in less gains in reading achievement for those offered relative to those not offered the reading program.

People and institutions involved

IES program contact(s)

Elizabeth Warner

Products and publications

The final report, titled The Evaluation of Enhanced Academic Instruction in After-School Programs: Final Report, was released in September 2009.

Other publications from this study are listed below.

  • The Evaluation of Enhanced Academic Instruction in After-School Programs: Findings After the First Year of Implementation (June 2008)

A restricted-use file containing de-identified data is available for the purposes of replicating study findings and secondary analysis.

Questions about this project?

To answer additional questions about this project or provide feedback, please contact the program officer.

 

Tags

MathematicsReading

Share

Icon to link to Facebook social media siteIcon to link to X social media siteIcon to link to LinkedIn social media siteIcon to copy link value

Questions about this project?

To answer additional questions about this project or provide feedback, please contact the program officer.

 

You may also like

Student using blocks and a computer to learn math concepts.
Blog

Building Fraction Sense in Middle School

October 06, 2025 by IES Staff
Read More
Zoomed in IES logo
Cooperative agreement

National Research Center on Advanced Education

Award number: R305C250014
Read More
Zoomed in IES logo
Grant

Enhanced Decision Tool for Peer-Mediated Personali...

Award number: R305J250018
Read More
icon-dot-govicon-https icon-quote