Purpose: At the time of this study, evidence-based practice in education was increasing pressure on educators to enact reforms based on research findings. However, there was little research that measured the effectiveness of many instructional practices. Additionally, what evidence there was often did not consider the specific circumstances faced by education decision-makers in their schools or districts. In this project, the researchers planned to develop and test the feasibility of an approach to help school districts design and carry out their own experimental studies to guide their decision-making.

The researchers aimed to carry out this project in collaboration with a set of school districts. They planned to develop and refine a model to help school districts carry out randomized experiments of education interventions as a guide for decision-making. In phase 1, the researchers proposed to conduct 3 experiments with their district partners followed by 5 in phase 2 and 10 in phase 3. The research team also aimed to study whether the costs of these experiments were reasonable in relation to the cost implications of the school improvement decisions they were supposed to inform. A group of external evaluators was to provide feedback about the process and to help refine the model based on these experiences. The researchers' goal was to determine whether helping school districts develop and incorporate low-cost, scientifically sound randomized experiments into their program planning and decision-making was a workable, economical model for providing technical support for school district improvement efforts.

Products and Publications

ERIC Citations: Find available citations in ERIC for this award here.

WWC Review:

Cabalo, J. V., Ma, B., & Jaciw, A. (2007). Comparative Effectiveness of Carnegie Learning's" Cognitive Tutor Bridge to Algebra" Curriculum: A Report of a Randomized Experiment in the Maui School District. Research Report. Empirical Education Inc. [WWC Review]

Select Publications:

Books

Greene, D., and David, J.L. (2005). Implementing Low-Cost RCTs to Support School District Decisions: Formative Evaluation Report for Year One. Palo Alto, CA: Bay Area Research Group.

Newman, D. (2007). Generalization and the Unit of Decision Making. Palo Alto, CA: Empirical Education Inc.

Newman, D. (2007). The District Motivation and Design Constraints of Experimental Evaluations. Palo Alto, CA: Empirical Education Inc.

** This project was submitted to and funded under Education Policy, Finance, and Systems in FY 2004.

This study was listed twice for WWC-once without reservation and also under with or without reservation