Impact Evaluation of Title I Supplemental Educational Services

Contractor: Mathematica Policy Research, Inc (MPR)

Background/Research Questions:

The Title I program which began in 1965 as part of the Elementary and Secondary Education Act targets resources primarily to high-poverty districts and schools to help ensure that all children have the opportunity to obtain a high-quality education and reach proficiency on challenging state standards and assessments. Under Title I, districts with schools that miss AYP for a third year are required to offer Supplemental Educational Services (SES) to students attending those schools. SES are additional academic instruction offered outside the regular school day by state-approved providers. Districts are required to make available up to 20 percent of their total Title I funds to support SES and transportation for students using the school-choice option. Priority for these academic support services is required to be given to the lowest-achieving students in identified Title I schools, particularly when the number of students participating in SES is large enough that costs reach the SES expenditure cap. Findings from prior non-experimental studies have shown differences in individual student achievement before and after enrollment in SES suggesting a positive achievement trajectory. This evaluation will assess the potential benefits of offering SES to applicants denied services due to limited district funds. The following research questions will be addressed:

• What is the average impact of offering Title I Supplemental Educational Services to eligible applicants who are currently on the cusp of having access to services, in school districts where services are currently oversubscribed?
• What are the characteristics of SES provided to students in oversubscribed districts? Are the characteristics of services, providers, or practices in the host school districts correlated with the estimated impacts of offering services to eligible students on the cusp of accessing SES?

Design:

The impact study will use a regression discontinuity design with student achievement measures used as a quantitative eligibility variable for student applicants within each participating district. Participating districts will have more applicants for SES than could be served by the funding required by the Title I program. The study will include a sample of 6 oversubscribed districts and approximately 24,000 students across districts. All eligible SES student applicants in participating districts will be included in the study sample. Data collection will include state student assessments in reading and math from 2006 to 2009, student participation in SES program information for the 2008–2009 school year, and SES service and staff characteristics information from provider surveys administered in spring 2009. The evaluation will produce a report in 2012.

Cost/Duration: $2,039,560 over 52 months (September 2007–January 2012)

Current Status: Report preparations for this study are currently underway. A report is expected to be released in 2012 and will be announced on http://ies.ed.gov/ncee/.