Project Activities
In Year 1, the research team will develop a data-driven instructional differentiation component using curriculum-based measurement (CBM) Maze and a reading differentiation kit. The team will also explore the effects of this program modification on students' reading and will examine product-user fit. In Year 2, the research team will conduct a large-scale randomized-controlled trial (RCT) to determine whether PALS-RD accelerates reading improvement with respect to comparable controls and to comparable students' pre-pandemic performance. In Year 2, the research team will continue to explore the program's fit with classrooms and districts and will prepare for product scaling through data collection and analysis activities aimed at understanding market segmentation, differentiation, and size; stakeholder priorities; champions; and ecosystem shifts. Cost and cost-effectiveness data will also be collected and analyzed.
Structured Abstract
Setting
Participants include teachers and students from public schools in suburban and rural districts in Texas.
Sample
In Year 1, approximately 12 teachers and their 240 fourth-grade students will participate. In Year 2, approximately 80 teachers and their 1,600 fourth-grade students will participate. Students from 20 schools and 2 districts will participate. Participating schools serve primarily students of color, linguistically diverse students, and English Learners.
Research design and methods
In Year 1, the team will revise the existing PALS Reading program. Teachers and students will implement the existing PALS program. Every other week, teachers will assess students' reading progress with CBM Maze. Administrative data from the previous spring and spring of the study year will be compared to estimate reading gain. This gain will be compared to the gain of comparable fourth-grade students immediately prior to the pandemic. Finally, the research team will interview and survey teachers and students to gauge product fit. In Year 2, the research team will implement the modified PALS-RD program for 18 weeks in participating classrooms. The team will conduct an RCT, involving the randomized assignment of fourth-grade classrooms to PALS-RD and business-as-usual (BAU) conditions. Reading performance will be measured on CBM Maze and on administrative student learning measures. PALS-RD condition students' reading achievement on the administrative assessment will be compared to comparable fourth grade students' scores on the same assessments in the year immediately preceding the pandemic. Analyses will focus on two important contrasts: the first between PALS-RD condition and BAU condition students to determine the efficacy of the PALS-RD program; the second, to determine whether students in the PALS-RD group demonstrate progress equal to or better than comparable students in the year immediately preceding the pandemic. The research team will also conduct cost analyses and cost effectiveness analyses in Year 2. In Years 1 and 2, the research team will conduct prepare-to-scale activities.
Cost analysis strategy
The network team will collect and summarize cost-per-student and cost-effectiveness data annually for personnel, materials, and oversight based on data from monthly logs. The cost per student and cost-effectiveness are estimated for start-up versus maintenance and the cost per student and cost-effectiveness of PALS-RD versus controls.
People and institutions involved
IES program contact(s)
Project contributors
Products and publications
Final products will include the PALS-RD program, an adapted version of PALS Reading specifically designed to support accelerated learning. All PALS-RD materials will be available in English and Spanish. Additionally, the research team will produce a PALS-RD program implementation manual, preparation for scaling plan, and a slideshow describing the program. The research team will disseminate project findings through a range of media – such as journal articles, newspapers, podcasts, videos – to a variety of education stakeholders.
Additional project information
This project is part of the Leveraging Evidence to Accelerate Recovery Nationwide (LEARN) Network , which focuses on adapting and preparing to scale existing, evidence-based products that have the potential to accelerate students' learning relative to pre-pandemic rates of growth for the many learners enrolled in kindergarten through grade 12, postsecondary education, or adult education programs whose learning was affected by the COVID-19 pandemic.
Related projects
Supplemental information
Co-Principal Investigators: Fuchs, Douglas; Chamberlain, Steven; Venegas, Elena
Questions about this project?
To answer additional questions about this project or provide feedback, please contact the program officer.