- Evaluation Studies Underway
- Literacy
- Mathematics
- Teacher Effectiveness
- Choice
- English Language Learning
- Students with Disabilities
- Pathways to Career or College
- Other Evaluations
- When Schools Stay Open Late: The National Evaluation of the 21st Century Community Learning Centers Program
- Impact Evaluation of Departmentalized Instruction in Elementary Schools
- Implementation of Title I/II Program Initiatives
- Integrated ARRA
- Race to the Top and School Improvement Grants Evaluation
- School Improvement Grants Case Studies
- Effectiveness of Educational Technology
- Title I Supplemental Educational Services
- After-School Programs
- School-Based Violence Prevention Program
- Student Mentoring
- Random Mandatory Student Drug Testing
- Evaluation of the Comprehensive Technical Assistance Centers, FY 2005 Grantees
- Evaluation of the Comprehensive Technical Assistance Centers, FY 2012 Grantees
- Regional Educational Laboratories
- Race to the Top—Early Learning Challenge: Descriptive Study of Tiered Quality Rating and Improvement Systems in Nine Round 1 States
- Evaluation of NAEP Achievement Levels
- Impact Evaluation of Parent Messaging Strategies on Student Attendance
- Technical Assistance
A Study of Implementation and Outcomes in Upward Bound and Other TRIO Programs
Contractors: Decision Information Resources, Abt Associates, MPR Associates
Background/Research Questions
Given new evaluation requirements in the 2008 reauthorization of HEA and the administration's emphasis on expanding access to college and improving the rate of college completion, policy makers would benefit from benefit from evaluations of implementation strategies in Upward Bound and other TRIO programs. With regard to Upward Bound, the 2008 HEA requires ED to conduct an evaluation that would identify effective program or project practices while not relying on random assignment to Upward Bound program status in the evaluation design. IES is planning a rigorous quasi-experimental evaluation of implementation strategies in the Upward Bound program, and development of designs that could be used to assess implementation strategies in other TRIO programs.
The feasibility and design phase of the study will address the following research questions:
- Can a rigorous quasi-experimental evaluation of implementation strategies of Upward Bound be carried out?
- Can the rigorous quasi-experimental designs developed for Upward Bound be applied to other TRIO programs?
If a rigorous quasi-experimental evaluation proves feasible, then ED will conduct a full evaluation that will address the following research questions:
- Are the different kinds of implementation strategies used by Upward Bound projects associated with improved student outcomes?
- Does the association between implementation strategies and student outcomes differ for students and projects with different characteristics?
- Tow what extent do students who in enroll in Upward Bound and Upward Bound Math Science in high school participate in the Student Support Services and TRIO McNair programs in college?
Design:
The design and feasibility report will examine several possible quasi-experimental designs and other designs for such an evaluation of Upward Bound, and the strengths and weaknesses of each. The report will examine the extent of meaningful variation in implementation strategies by the analysis of data collected via contractor site visits to communities served by UB projects. Given the similarity of program structures between Upward Bound and other TRIO programs and the overlapping data sets that would be used in evaluations of TRIO programs, the feasibility study will also examine the extent to which the evaluation designs developed for Upward Bound can be extended to other TRIO programs. In addition, the feasibility study will use Annual Performance Report data from TRIO grantees to examine the association between participation in Upward Bound or Upward Bound Math Science in high school and participation in Student Support Services or TRIO McNair undergraduate support programs in college.
Cost/Duration: $3,812,604 over 5 years (August 2010–August 2015)
Current Status
The 21-month design and feasibility study is underway.