Skip to main content

Breadcrumb

Home arrow_forward_ios Evaluations arrow_forward_ios Impact Evaluati ...
Home arrow_forward_ios ... arrow_forward_ios Impact Evaluati ...
Evaluations
Contract Closed

Impact Evaluation of Academic Instruction For After-School Programs

NCEE
Program: Elementary and Secondary Education Act
Award amount: $15,900,000
Awardee:
MDRC, Public/Private Ventures, Bloom Associates, Survey Research Management
Duration: 5 years 11 months (10/01/2003 - 09/01/2009)
Contract number: ED-01-CO-0060/0004

Background

The 21st Century Community Learning Centers Program, established in 1999, is a state-administered grant program to provide opportunities for academic enrichment to meet state and local student academic achievement standards in core academic subjects, such as reading and mathematics. This program is authorized as part of Title IV of the Elementary and Secondary Education Act and was funded at $1 billion in Fiscal Year 2008. The funding is targeted towards high-poverty schools, with priority given to schools in need of improvement.

Building off of a 2005 national evaluation of the 21st Century Community Learning Centers Program in which grantees were found to offer predominantly homework help that did not produce academic impacts, this study evaluated the impact of two structured and intensive academic programs. The two programs were Harcourt's Mathletics and Success for All's Adventure Island. Both programs were designed for the after-school setting, and so a study of these programs could provide valuable information to inform the 21st Century Community Learning Centers Program more broadly.

Project Activities

Research question

  • What was the effectiveness of offering one year of the academic program (reading or math)? Did program implementation and the one-year impact improve in a second year of operation?
  • What was the effectiveness of offering two years of the academic program (reading or math)?
  • What was the association between receiving the academic program (reading or math) for two consecutive years and math achievement?

Structured Abstract

Design

The evaluation consisted of two parallel studies at the elementary school level (25 programs for each study, one testing the math program—Harcourt Math—and one testing the reading program—Success for All). The evaluation initially included 1,000 students who were randomly assigned to receive treatment and 1,000 to receive the typical support (e.g., general help in a variety of subjects). A subset of the sites continued the program for a second year in which students were randomly assigned a second time to receive one year of treatment in the first year of program operation; to receive one year of treatment in the second year of program operation; to two years of services; and to zero years of the academic program.

Key findings

  • There was a positive impact on math achievement for students offered one year of the math program. Two years of the math program resulted in no difference between those offered and those not offered the math program.
  • There was no impact on reading comprehension achievement for students offered one year of the reading program. Two years of the reading program resulted in less gains in reading achievement for those offered relative to those not offered the reading program.

People and institutions involved

IES program contact(s)

Elizabeth Warner

Products and publications

The final report, titled The Evaluation of Enhanced Academic Instruction in After-School Programs: Final Report, was released in September 2009.

Other publications from this study are listed below.

  • The Evaluation of Enhanced Academic Instruction in After-School Programs: Findings After the First Year of Implementation (June 2008)

A restricted-use file containing de-identified data is available for the purposes of replicating study findings and secondary analysis.

Questions about this project?

To answer additional questions about this project or provide feedback, please contact the program officer.

 

Tags

MathematicsReading

Share

Icon to link to Facebook social media siteIcon to link to X social media siteIcon to link to LinkedIn social media siteIcon to copy link value

Questions about this project?

To answer additional questions about this project or provide feedback, please contact the program officer.

 

You may also like

Zoomed in IES logo
Descriptive Study

Factors Associated with Grade 9 Math Success in De...

Author(s): Sophia Seifert, Menbere Shiferaw, Riley Stone
Publication number: REL 2026–008
Read More
Zoomed in Yellow IES Logo
Compendium

Condition of Education 2026

Author(s): National Center for Education Statistics (NCES)
Publication number: NCES 2026144
Read More
Zoomed in IES logo
Fact Sheet/Infographic/FAQ

Computational Thinking-Pedagogical Content Knowled...

Author(s): REL Midwest
Read More
icon-dot-govicon-https icon-quote