Feasibility and Conduct of an Impact Evaluation of Title I Supplemental Educational Services

Contractors: Mathematica Policy Research, Inc (MPR) and COSMOS Corp.

Key Staff:
Brian Gill, MPR
Kristin Hallgren, COSMOS

Research Questions:

Feasibility Study

• Are there a sufficient number of districts where there are more applicants for supplemental educational services that can be served by the funding required by the Title I program?
• Is there a sufficient sample size of districts that are willing to participate in an impact evaluation of supplemental educational services using a regression discontinuity design?

Impact Study

• What is the impact of participation in Title I Supplemental Educational Services on student achievement in reading and mathematics?
• Are district characteristics and practices, SES provider characteristics and services, and student characteristics related to the impact on student achievement?

Design: The feasibility of the study will depend on whether there a sufficient number of districts where there are more applicants for supplemental educational services that can be served by the funding required by the Title I program. If so, districts would need to agree to make decisions about which student applicants to serve based on quantifiable information with a cutoff point to continue with the study. The impact study will be based on a regression discontinuity design based on a quantitative eligibility variable for student applicants within each participating district.

Duration: 3 years (September 2007 - September 2010)

Reports: The final report on this study will be announced on http://ies.ed.gov/ncee/.

Current Status: (August 2008) The first step of the feasibility study has identified districts where Supplemental Educational Services are currently oversubscribed or potentially oversubscribed for the 2008-09 school year, and the study team is working with districts to implement a quantitative eligibility variable for student applicants.