Impact Evaluation of Academic Instruction For After-School Programs

Contractors: MDRC, Public/Private Ventures, Bloom Associates, and Survey Research Management

Key Staff: Fred Doolittle (MDRC)

Research Questions:

• What is the effectiveness of offering intensive research-based reading support in an after-school program? Is it more effective than offering more general academic support such as homework help?
• What is the effectiveness of offering intensive research-based math support in an after-school program? Is it more effective than offering more general academic support such as homework help?

Design: The evaluation consists of two parallel studies at the elementary school level (25 programs for each study, one testing the math curriculum and one testing the reading curriculum). The evaluation design calls for program participants at each after-school center to be randomly assigned to either the intensive academic curriculum or to the academic support that the program provided prior to the implementation of the new curriculum. Each of the two studies will include approximately 1000 students who receive the treatment and 1000 that receive the typical support (e.g., homework help).

A pilot of the treatment was conducted in school year 2004-2005. Full implementation for the evaluation study occurred during school years 2005-06 and 2006-07 school year. Data collection included a standardized student achievement test, school records, a teacher survey, a student survey, and a survey of program staff.

Duration: 5 years (October 1, 2003 - September 30, 2008)

Reports: The final report on this study will be announced on http://ies.ed.gov/ncee/.

Current Status: (August 2008) The first year report is released. The second year report is being prepared.