Skip to main content

Breadcrumb

Home arrow_forward_ios Evaluations arrow_forward_ios Study of Strategies to Address Unfi ...
Home arrow_forward_ios ... arrow_forward_ios Study of Strategies to Address Unfi ...
Evaluations
Contract Closed

Study of Strategies to Address Unfinished Learning in Math

NCEE Evaluation Division K-12 Studies
Program: Elementary and Secondary Education Act
Evaluation topic(s): Mathematics , Technology
Award amount: $15,000,000
Awardee:
MDRC, RAND Corporation, Digital Promise, Westat, Public Strategies
Year: 2021
Duration: 3 years 6 months (08/01/2021 - 02/10/2025)
Project type:
Impact
Contract number: 91990021D0001

Background

The coronavirus pandemic led to substantial unfinished learning in math and an important debate about how best to address it. Traditionally, policymakers and educators have advocated a "broad foundation skill building" approach, which systematically reteaches all below-grade content where there are knowledge gaps. "Just-in-time skill building" has received attention more recently, including in the U.S. Department of Education's COVID-19 Handbook. This alternative reteaches only below-grade content deemed most essential to understanding the current grade-level topic. But there is limited evidence on which approach is most effective for which students and which contexts. This evaluation compared the effectiveness of these two catch-up strategies when delivered via adaptive technology products in elementary schools, where the potential benefits of using technology supports are understudied. 

Project Activities

Research question

  • Which catch-up instructional strategy delivered through regular use of adaptive technology products was more effective at improving struggling students' learning — "just-in-time skill building" or "broad foundation skill building" — particularly in low-performing schools?
  • Which strategy was best for students who begin the year especially behind, and for low-income and students of color?
  • What below-grade math content was most strongly associated with successful learning of core elementary grade topics?

Structured Abstract

Design

This impact evaluation compared the effectiveness of two key catch-up learning strategies: "just-in-time" and "broad foundation." These strategies were delivered through two adaptive math technology products (i-Ready and Freckle), each of which has separate modes that deliver one of the two strategies. In the 2023-24 school year, 12 schools in 2 districts volunteered for the pilot study. In the 2024-25 school year, approximately 75 elementary schools in 9 districts and 7 states around the nation volunteered for the study. Each district selected to use either i-Ready or Freckle. Participating students in these schools were assigned by lottery to use their district's chose product in either the "just-in-time" or "broad foundation" skill-building mode. Data collection included: a teacher survey to examine how the technology relates to changes in classroom practice; product data to describe student engagement and implementation; and assessment data from both the products' diagnostics, as well as state assessments, to examine the effect of the catch-up strategies on students' achievement.

People and institutions involved

IES program contact(s)

Allie Perez

Products and publications

The contract for this study was canceled in February 2025. NCEE is evaluating what publications, if any, may arise from this work.

Questions about this project?

To answer additional questions about this project or provide feedback, please contact the program officer.

 

Tags

Education TechnologyK-12 EducationMathematics

Share

Icon to link to Facebook social media siteIcon to link to X social media siteIcon to link to LinkedIn social media siteIcon to copy link value

Questions about this project?

To answer additional questions about this project or provide feedback, please contact the program officer.

 

You may also like

Zoomed in IES logo
Workshop/Training

Innovation Science for Education Analytics (ISEA)

January 01, 2026
Read More
Blue zoomed in IES logo
News

IES Releases the Forum Guide to Student Mobility D...

October 28, 2025 by
Read More
Zoomed in IES logo
Forum Guide

Forum Guide to Student Mobility Data

Author(s): National Center for Education Statistics (NCES)
Publication number: NFES 2026001
Read More
icon-dot-govicon-https icon-quote