Contract Closed

Impact Evaluation of the DC Choice Program

NCEE

Program: DC Opportunity Scholarship Program

Award amount: $7,998,164

Awardee:

Westat, University of Arkansas

Duration: 6 years 6 months (07/01/2004 - 01/01/2011)

Contract number: ED-04-CO-0126

Background

In 2004, Congress established the first federally-funded private school voucher program, with annual funding of about $14 million. The program provided scholarships of up to $7,500 for low-income residents of the District of Columbia to send their children to participating local private schools, with students from "schools in need of improvement" under the Elementary and Secondary School Act receiving the highest priority for admission. This study is in response to the law mandating that the U.S. Department of Education conduct an independent, rigorous impact evaluation of what is now called the DC Opportunity Scholarship Program (OSP).

Project Activities

Research question

What was the impact of the scholarship program on student academic achievement and attainment, overall and for students from the high priority group?
What effect did the program have on student and parent perceptions of school safety and satisfaction?
To what extent was the program influencing schools and expanding choice for parents in Washington, DC?

Structured Abstract

Design

The evaluation primarily compared outcomes of approximately 2,300 students randomly assigned by lottery to either receive a scholarship or not receive a scholarship. Lotteries of student applicants took place in spring 2004 (for student enrollment in fall 2004) and spring 2005 (for enrollment in fall 2005). Data were collected for four follow up years, for students in both the scholarship and non-scholarship groups. Study-administered academic assessments, as well as student, parent, and principal surveys, were also part of the data collection each spring.

Key findings

There was no conclusive evidence that the OSP affected student achievement overall, or for the high-priority group of students who applied from "schools in need of improvement."
The Program significantly improved students' chances of graduating from high school, according to parent reports. Overall, 82 percent of students offered scholarships received a high school diploma, compared to 70 percent of those who applied but were not offered scholarships. This graduation rate improvement also held for the subgroup of OSP students who came from "schools in need of improvement."
Although parents had higher satisfaction and rated schools as safer if their child was offered or used an OSP scholarship, students reported similar ratings for satisfaction and safety regardless of whether they were offered or used a scholarship.
The cumulative loss of students between 2004 and 2009 from DC public schools (traditional and charter schools) to the Program was about 3 percent. In contrast, an estimated 20 percent of students annually change schools or leave the district. Thus, OSP-related transfers to private schools may not have been distinguishable from the larger share of other student departures, and therefore less likely to have an impact on public school operations.

People and institutions involved

IES program contact(s)

Marsha Silverberg

Economist

NCEE

Products and publications

The final report, titled Evaluation of the Impact of the DC Opportunity Scholarship Program: Final Report, along with a study snapshot of findings, was released in June 2010.

Other publications from this study are listed below.

Reports on Interim Impacts

Descriptive Reports

A restricted-use file containing de-identified data is available for the purposes of replicating study findings and secondary analysis.

Questions about this project?

To answer additional questions about this project or provide feedback, please contact the program officer.