Project Activities
In Year 1, the research team will develop the TRI App based on an existing prototype and pilot and refine the TRI App through an iterative development process. In Year 2, the team will evaluate the TRI App using a quasi-experimental design and will conduct market research to determine the best approaches to scaling the TRI App.
Structured Abstract
Setting
Participating elementary schools include suburban and rural schools in Florida and North Carolina. Schools serving families who are socioeconomically, ethnically, and racially diverse will participate.
Sample
Participants will include 900 kindergarten through grade 3 students reading below grade level and the approximately 50 school staff providing them with supplemental instruction. The network team will identify students through the participating districts' progress monitoring tools as needing supplemental reading instruction.
TRI has been evaluated through previous IES-funded randomized controlled trials and is one of only a few reading programs that has shown significant impacts on alphabetics, reading comprehension, and fluency for early elementary students. The core components of TRI include the following: (1) Content (tutors will use TRI activities, strategies, and books to focus on sounds, decoding, word meaning, fluency, and comprehension using real words and texts); (2) Lesson delivery (tutors will structure and pace TRI lessons to guide students efficiently and rapidly through scope and sequence); and (3) Matched instruction (tutors will make instructional decisions diagnostically matched to each individual student based on assessments and TRI performance). In this project, the team will develop the TRI App to provide virtual training and coaching to tutors and to administer TRI lessons. At the initial training, tutors will learn diagnostic strategies for teaching students by watching training videos, observing coach modeling, practicing the activities with one another, and using TRI App activities and strategies with children. A TRI literacy coach will provide virtual coaching sessions to provide real-time feedback as a TRI tutor teaches a lesson using the TRI App. TRI literacy coaches will emphasize tutors' use of data when designing TRI lessons, rapidly building tutor capacity to serve students using data-based decision making.
Research design and methods
In Year 1, the research team will iteratively develop and test the TRI App to ensure that it is usable and feasible. In Year 2, the research team will implement a quasi-experimental design to test whether the TRI App improves learning relative to business-as-usual (BAU) instruction and relative to pre-pandemic rates of growth. Schools with tutors using the TRI App will be matched to other schools in the same district implementing BAU instruction. School-level data will be collected from each state and district to create a set of matching variables. Impact measures will be district-administered progress monitoring assessments for kindergarten through grade 3 students and third grade reading tests for third grade students. Fidelity measures will be embedded into the TRI App to assess tutor intervention implementation and coaching. An intent-to-treat analytic approach will estimate treatment effects on student outcomes. Analyses will involve hierarchical linear models to account for the nesting of students and tutors in schools. Additional analyses will compare evaluation students in 2023–24 to pre-pandemic students in 2018-19 to examine growth trajectories for the different cohorts. Market research and corresponding process measures (e.g., focus groups, interviews, surveys) will inform developing, refining, and scaling the TRI App.
Cost analysis strategy
An embedded cost analysis study will determine the start-up and annual maintenance costs for materials and time/effort of the TRI App. The team will use the ingredients approach to estimate costs such as personnel, training, facilities, materials, and technology.
People and institutions involved
IES program contact(s)
Products and publications
Products include a fully developed and operationalized digital application and corresponding professional development for school staff providing supplemental instruction for students reading below grade level. Additionally, the team will produce peer-reviewed publications, reports, and presentations for key school and district stakeholders, policymakers, families, and researchers.
Project website:
Additional project information
This project is part of the Leveraging Evidence to Accelerate Recovery Nationwide (LEARN) Network, which focuses on adapting and preparing to scale existing, evidence-based products that have the potential to accelerate students' learning relative to pre-pandemic rates of growth for the many learners enrolled in kindergarten through grade 12, postsecondary education, or adult education programs whose learning was affected by the COVID-19 pandemic.
Related projects
Questions about this project?
To answer additional questions about this project or provide feedback, please contact the program officer.
