Impact Evaluation of Title I Supplemental Educational Services

Contractors: Mathematica Policy Research, Inc (MPR)

Background/Research Questions:

The Title I program which began in 1965 as part of the Elementary and Secondary Education Act targets resources primarily to high-poverty districts and schools to help ensure that all children have the opportunity to obtain a high-quality education and reach proficiency on challenging state standards and assessments. Under Title I, districts with schools that miss AYP for a third year are required to offer Supplemental Educational Services (SES) to students attending those schools. SES are additional academic instruction offered outside the regular school day by state-approved providers. Districts are required to make available up to 20 percent of their total Title I funds to support SES and transportation for students using the school-choice option. Priority for these academic support services is required to be given to the lowest-achieving students in identified Title I schools, particularly when the number of students participating in SES is large enough that costs reach the SES expenditure cap. Findings from a prior non-experimental study has shown differences in individual student achievement before and after enrollment in SES suggesting a positive achievement trajectory. However, no studies to date have been conducted that rigorously evaluate the impact of SES. This study will address the following research questions:

• What is the impact of participation in Title I Supplemental Educational Services on student achievement in reading and mathematics?
• How does the impact of SES vary across district characteristics and student characteristics? What district practices or SES characteristics and services are related to student SES attendance and achievement?

Design:

The impact study will use a regression discontinuity design with student achievement measures used as a quantitative eligibility variable for student applicants within each participating district. Participating districts will have more applicants for SES than could be served by the funding required by the Title I program. The study will include a sample of up to 9 oversubscribed districts and approximately 50,000 students across districts. All eligible SES student applicants in participating districts will be included in the study sample. Data collection will include state student assessments in reading and math from 2006 to 2009, student participation hours in SES program for the 2008–2009 school year, and provider surveys administered in spring 2009. The evaluation will produce a report by fall of 2010.

Duration: 3 years (September 2007 – September 2010)

Current Status:

The study has identifying districts where Supplemental Educational Services are currently oversubscribed or potentially oversubscribed for the 2008–2009 school year. The study team has working with identified districts to implement a quantitative eligibility variable for student applicants. The final report on this study will be announced on http://ies.ed.gov/ncee/.