Skip to main content

Breadcrumb

Home arrow_forward_ios Evaluations arrow_forward_ios Impact Evaluation of Academic Instr ...
Home arrow_forward_ios ... arrow_forward_ios Impact Evaluation of Academic Instr ...
Evaluations
Contract Closed

Impact Evaluation of Academic Instruction For After-School Programs

NCEE
Program: Elementary and Secondary Education Act
Award amount: $15,900,000
Awardee:
MDRC, Public/Private Ventures, Bloom Associates, Survey Research Management
Duration: 5 years 11 months (10/01/2003 - 09/01/2009)
Contract number: ED-01-CO-0060/0004

Background

The 21st Century Community Learning Centers Program, established in 1999, is a state-administered grant program to provide opportunities for academic enrichment to meet state and local student academic achievement standards in core academic subjects, such as reading and mathematics. This program is authorized as part of Title IV of the Elementary and Secondary Education Act and was funded at $1 billion in Fiscal Year 2008. The funding is targeted towards high-poverty schools, with priority given to schools in need of improvement.

Building off of a 2005 national evaluation of the 21st Century Community Learning Centers Program in which grantees were found to offer predominantly homework help that did not produce academic impacts, this study evaluated the impact of two structured and intensive academic programs. The two programs were Harcourt's Mathletics and Success for All's Adventure Island. Both programs were designed for the after-school setting, and so a study of these programs could provide valuable information to inform the 21st Century Community Learning Centers Program more broadly.

Project Activities

Research question

  • What was the effectiveness of offering one year of the academic program (reading or math)? Did program implementation and the one-year impact improve in a second year of operation?
  • What was the effectiveness of offering two years of the academic program (reading or math)?
  • What was the association between receiving the academic program (reading or math) for two consecutive years and math achievement?

Structured Abstract

Design

The evaluation consisted of two parallel studies at the elementary school level (25 programs for each study, one testing the math program—Harcourt Math—and one testing the reading program—Success for All). The evaluation initially included 1,000 students who were randomly assigned to receive treatment and 1,000 to receive the typical support (e.g., general help in a variety of subjects). A subset of the sites continued the program for a second year in which students were randomly assigned a second time to receive one year of treatment in the first year of program operation; to receive one year of treatment in the second year of program operation; to two years of services; and to zero years of the academic program.

Key findings

  • There was a positive impact on math achievement for students offered one year of the math program. Two years of the math program resulted in no difference between those offered and those not offered the math program.
  • There was no impact on reading comprehension achievement for students offered one year of the reading program. Two years of the reading program resulted in less gains in reading achievement for those offered relative to those not offered the reading program.

People and institutions involved

IES program contact(s)

Elizabeth Warner

Products and publications

The final report, titled The Evaluation of Enhanced Academic Instruction in After-School Programs: Final Report, was released in September 2009.

Other publications from this study are listed below.

  • The Evaluation of Enhanced Academic Instruction in After-School Programs: Findings After the First Year of Implementation (June 2008)

A restricted-use file containing de-identified data is available for the purposes of replicating study findings and secondary analysis.

Questions about this project?

To answer additional questions about this project or provide feedback, please contact the program officer.

 

Tags

MathematicsReading

Share

Icon to link to Facebook social media siteIcon to link to X social media siteIcon to link to LinkedIn social media siteIcon to copy link value

Questions about this project?

To answer additional questions about this project or provide feedback, please contact the program officer.

 

You may also like

Zoomed in IES logo
Data file

U.S. Program for the International Assessment of A...

Publication number: NCES 2025224
Read More
Blue 3 Placeholder Pattern 1
Statistical Analysis Report

2024 NAEP Mathematics Assessment: Results at Grade...

Author(s): National Center for Education Statistics (NCES)
Publication number: NCES 2024217
Read More
Zoomed in IES logo
Statistical Analysis Report

2024 NAEP Reading Assessment: Results at Grades 4 ...

Author(s): National Center for Education Statistics (NCES)
Publication number: NCES 2024218
Read More
icon-dot-govicon-https icon-quote