Skip Navigation

List of Proposed Interventions for the Systematic Replication RFA

Mark Schneider, Director of IES   |   April 15, 2019

IES is working on next year’s RFAs, which we hope to release later this spring. As you may know, we are initiating a research competition focused on the systematic replication of interventions that IES believes have strong evidence of impact. The purpose and general outline of that competition can be found here.

I want to share with you a list of the NCER- and NCSER-funded studies that we are interested in having systematically replicated. These interventions meet the following criteria:

  • They are in one of the two areas on which we are focused this year – Reading and Math. We recognize the importance of interventions in science, social/behavioral outcomes, college and career readiness, etc. We will consider interventions in other areas in subsequent years.
  • A causal impact study funded by IES has been completed and a paper describing the results of that study has been published.
  • The causal impact study described in the paper has been reviewed by the WWC and meets WWC design standards with or without reservations (using version 2.0 or later of the standards).
    • Note: Some of the reviews of NCSER-funded studies were conducted for internal purposes and are not published on the WWC website.
  • IES believes that there were beneficial and meaningful impacts on student outcomes primarily targeted by the intervention.
  • The intervention is ready to be implemented (for example, it is available publicly or by request).
  • There have been no recent studies supported by IES or other funding sources to test the effectiveness of the intervention at scale.
  • There have not already been multiple replications of the intervention supported by IES.

Since this is a more targeted strategy for supporting replication than IES has used in the past, it is important to give the research community more time to think about how such systematic replication of these interventions could be implemented. There may be face-to-face interventions on this list that could be replicated via other technologies and we welcome such replications, as appropriate.

If we overlooked an intervention that meets these criteria or misidentified an intervention as meeting these criteria, please let me know—and, as always, we are interested in your feedback and thoughts about this effort.

Mark Schneider
Director of IES
Mark.Schneider@ed.gov

NCER

Intervention Name IES-Funded Causal Impact Paper WWC Review Outcomes Positively Impacted Availability
Reading
Targeted Reading Intervention (TRI) Vernon-Feagans, L., Bratsch-Hines, M., Varghese, C., Cutrer, E. A., & Garwood, J. D. (2018). Improving struggling readers’ early literacy skills through a Tier 2 professional development program for rural classroom teachers: The targeted reading intervention. The Elementary School Journal, 118(4), 525-548. WWC single study review Alphabetics; comprehension Directly from researcher, Lynne Vernon-Feagans
Kindergarten Peer Assisted Learning Strategies (PALS) Stein, M. L., Berends, M., Fuchs, D., McMaster, K., Sáenz, L., Yen, L., ... & Compton, D. L. (2008). Scaling up an early reading program: Relationships among teacher support, fidelity of implementation, and student performance across different sites and years. Educational Evaluation and Policy Analysis, 30(4), 368-388. WWC review for an intervention report Alphabetics PALS website
Read Aloud Baker, S. K., Santoro, L. E., Chard, D. J., Fien, H., Park, Y., & Otterstedt, J. (2013). An evaluation of an explicit read aloud intervention taught in whole-classroom formats in first grade. The Elementary School Journal, 113(3), 331-358. WWC review for a practice guide Vocabulary Directly from researcher, Scott Baker
Read Well Kindergarten Gunn, B., Smolkowski, K., & Vadasy, P. (2010). Evaluating the effectiveness of Read Well kindergarten. Journal of Research on Educational Effectiveness, 4(1), 53-86. WWC review for a practice guide Letter names and sounds; word reading Voyager Sopris Learning
Intelligent Tutoring for Structure Strategy (ITSS) Wijekumar, K. K., Meyer, B. J., & Lei, P. (2012). Large-scale randomized controlled trial with 4th graders using intelligent tutoring of the structure strategy to improve nonfiction reading comprehension. Educational Technology Research and Development, 60(6), 987-1013. WWC single study review Comprehension Directly from researcher, Kay Wijekumar    
Strategic Adolescent Reading Intervention (STARI) Kim, J. S., Hemphill, L., Troyer, M., Thomson, J. M., Jones, S. M., LaRusso, M. D., & Donovan, S. (2017). Engaging struggling adolescent readers to improve reading skills. Reading research quarterly, 52(3), 357-382. WWC review for a grant competition Alphabetics STARI website
Promoting Acceleration of Comprehension and Content Through Text (PACT) Vaughn, S., Swanson, E. A., Roberts, G., Wanzek, J., Stillmanā€Spisak, S. J., Solis, M., & Simmons, D. (2013). Improving reading comprehension and social studies knowledge in middle school. Reading Research Quarterly, 48(1), 77-93. WWC single study review Comprehension; social studies achievement PACT website
Math
Spatial Temporal Mathematics (ST Math) Schenke, K., Rutherford, T., & Farkas, G. (2014). Alignment of game design features and state mathematics standards: Do results reflect intentions? Computers & Education, 76, 215-224. WWC review for an IES performance measure Math achievement Directly from the MIND Research Institute
Schema-based Instruction Jitendra, A. K., Star, J. R., Rodriguez, M., Lindell, M., & Someki, F. (2011). Improving students’ proportional thinking using schema-based instruction. Learning and Instruction, 21(6), 731-745. WWC review for a practice guide Math problem solving Directly from researcher, Asha Jitendra

 

NCSER

Intervention Name IES-Funded Causal Impact Paper WWC Review Outcomes Positively Impacted Availability
Reading
Early Reading Intervention Simmons, D. C., Coyne, M. D., Hagan-Burke, S., Kwok, O., Simmons, L., Johnson, C., Zou, Y., Taylor, A. B., McAlenney, A. L., Ruby, M., & Crevecoeur, Y. C. (2011). Effects of supplemental reading interventions in authentic contexts: A comparison of kindergarteners' response. Exceptional Children, 77(2), 207-228. WWC review for a practice guide Phonology Directly from researcher, Deborah Simmons
SRA Early Interventions in Reading Allor, J.H., Mathes, P.G., Roberts, J.K., Cheatham, J. P., & Champlin, T.M.  (2010). Comprehensive reading instruction for students with intellectual disabilities: Findings from the first three years of a longitudinal study.  Psychology in the Schools, 47(5), 445-466. WWC review for an IES performance measure (not published on the website) Phonological awareness; phonemic decoding McGraw-Hill
Enhanced Core Reading Instruction (ECRI) Smith, J. L. M., Nelson, N. J., Smolkowski, K., Baker, S. K., Fien, H. & Kosty, D. (2016). Examining the efficacy of a multitiered intervention for at-risk readers in grade 1. Elementary School Journal, 116(4), 549-573.  WWC review for an IES performance measure (not published on the website)  Alphabetics ECRI website
Math
Moving Up! Mathematics (originally called ROOTS) Clarke, B., Doabler, C., Smolkowski, K., Kurtz Nelson, E., Fien, H., Baker, S. K., & Kosty, D. (2016). Testing the immediate and long-term efficacy of a Tier 2 kindergarten mathematics intervention. Journal of Research on Educational Effectiveness, 9(4), 607-634. WWC review for an IES performance measure (not published on the website) Math achievement Moving Up! Mathematics website
Enhanced Anchored Instruction Bottge, B. A., Ma, X., Gassaway, L., Toland, M. D., Butler, M., & Cho, S. J. (2014). Effects of blended instructional models on math performance. Exceptional Children, 80(4), 423-437. WWC review for an IES performance measure (not published on the website) Math problem solving Directly from researcher, Brian Bottge
Fraction intervention Fuchs, L. S., Schumacher, R. F., Long, J., Namkung, J., Hamlett, C. L., Cirino, P. T., ... & Changas, P. (2013). Improving at-risk learners’ understanding of fractions. Journal of Educational Psychology, 105(3), 683. WWC single study review Math achievement Directly from researcher, Lynn Fuchs
Pre-K Mathematics Tutorial (PKMT) Barnes, M. A., Klein, A., Swank, P., Starkey, P., McCandliss, B., Flynn, K., Zucker, T., Huang, C., Fall, A., & Roberts, G. (2016). Effects of Tutorial Interventions in Mathematics and Attention for Low-Performing Preschool Children. Journal of Research on Educational Effectiveness, 9(4), 577-606. WWC review for an IES performance measure Math achievement; social-emotional development Directly from researcher, Marcia Barnes