Project Activities
During the initial development phase, the research team conducted a series of iterative testing activities to create RRK components that were practical for kindergarten teachers to implement in small-group settings and perceived as effective for students. RRK was designed to supplement, rather than replace, the core reading curriculum by offering additional targeted instruction for students who exhibited early signs of reading difficulties. Teachers tested each instructional component and provided feedback for revisions. The project experienced delays due to the COVID-19 pandemic, but this period allowed the team to explore how online features could enhance usability. In the next phase, a pilot study used a randomized controlled trial to evaluate the effectiveness of the fully developed RRK program. Researchers screened kindergarten students at the beginning of the school year to identify those who did not meet expected literacy benchmarks. Teachers then implemented RRK in small groups, with ongoing support from the research team. In the final phase, researchers shared promising intervention components with educators and disseminated findings through publications and professional presentations. The researchers combined the final kindergarten intervention with the previously developed Grade 1-3 units resulting in a 78-unit, online curriculum renamed Accelerated Early Reading Outcomes (AERO; https://aeroreading.org/).
Structured Abstract
Setting
This project took place in urban and suburban districts in Texas.
Sample
Participants in this project included over 125 kindergarten students across all phases of work. This included the pilot study sample of 21 kindergarten teachers and 92 students (n=50 in RRK; n=42 in control), of whom 85% qualified for the federal free or reduced-price lunch program and were primarily Hispanic (53%) and African American (37%).
RRK was designed to be delivered by the classroom teacher to groups of four to five students for 20 minutes a day, 4 days a week, for 27 weeks. Each session addresses multiple skills: phonological awareness, alphabet knowledge, decoding/phonics, handwriting, encoding/spelling, text reading, vocabulary, and written language. The instructional features include explicit, systematic instruction with multiple opportunities to respond to the teacher, interact verbally with peers, and respond to questions about text verbally and in writing. The intervention includes decodable texts, an initial placement test, ongoing mastery tests, and professional development resources for teachers.
Research design and methods
In Years 1 and 2, the research team used an iterative development approach with input kindergarten teachers and reading interventionists to develop and revise the intervention. Focus groups and interviews with teachers informed design and development of prototypes and revisions. Prototypes were field tested by teachers and evaluated based on student pre-test/post-test data. Revisions were made based on these data and teacher feedback. During Year 3, the project was impacted by the COVID pandemic; participating teachers shifted to piloting online components of the curriculum. In the Year 4 pilot study, researchers randomly assigned teachers and their students to a treatment group that used RRK or to a control group that did not.
Control condition
In the comparison condition, students received standard classroom practices and intervention services in place at the school.
Key measures
Student literacy measures for this study includes subscales from the: (a) Dynamic Indicators of Basic Early Literacy Skills (DIBELS), (b) Woodcock-Johnson Tests of Achievement IV (WJ-IV), (c) Woodcock-Johnson Test of Early Cognitive and Academic Development (ECAD), (d) Comprehensive Test of Phonological Processing (CTOPP), (e) the Clinical Evaluation of Language Fundamentals-5 (CELF-5). Teacher measures included literacy knowledge (Survey of Basic Language Constructs) and the Teachers’ Sense of Efficacy for Literacy Instruction (TSELI) survey. The research team gathered teacher implementation logs, fidelity observations, coaching logs, and teacher interviews on feasibility, usability, and implementation determinants.
Data analytic strategy
Researchers used multilevel regression models (with pretest as a covariate) to examine the promise of RRK for improving student outcomes. Additionally, the researchers examined how fidelity of implementing RRK as designed (e.g., adherence, dosage, quality) related to reading outcomes. To analyze qualitative data, the researchers used the frameworks from implementation science.
Cost analysis strategy
The researchers estimated the cost of implementing the paper-pencil version of RRK was $2,850 per student when delivered in small groups of about five students per classroom.
Key outcomes
- The RRK supplemental intervention was only effective for improve student outcomes when delivered with sufficient dosage. (Mesa et al., 2024).
- Participating kindergarten teachers reported barriers to implementing the intensive small-group intervention, such as limited instructional time and leadership support (Mesa et al., 2024) and variability in self-efficacy for teaching students with reading difficulties (Dahl-Leonard et al., 2023).
People and institutions involved
IES program contact(s)
Project contributors
Products and publications
Project website:
Publications:
ERIC Citations: Find available citations in ERIC for this award here.
Select Publications:
Mesa, M. P., Hall, C., Zucker, T., Dahl-Leonard, K., Oh, Y., & Denton, C. (2024). Unpacking Implementation: Fidelity and Barriers to Implementation of a Kindergarten Reading Intervention by Teachers. The Elementary School Journal, 125(1), 77–105. https://doi.org/10.1086/731257
Hall, C., Dahl-Leonard, K., Denton, C. A., Stevens, E. A., & Capin, P. (2021). Fostering independence while teaching students with or at risk for reading disabilities. Teaching Exceptional Children, 54(2), 124–133.
Dahl-Leonard, K., Hall, C., Mesa, M. P., Zucker, T. A., & Peacott, D. (2024). Exploring Small-Group Reading Instruction for Students at Risk for Reading Difficulties in Kindergarten Classrooms. Reading & Writing Quarterly, 1-18.
Available data:
These data were made publicly available at the LDbase registry: https://ldbase.org/projects/0a350ca0-0277-475d-8f37-70c5fa3dd3e1
Additional project information
Additional Online Resources and Information:
https://public.cliengage.org/tools/materials/aero-reading-program/
https://public.cliengage.org/reading-rules-kindergarten-rrk-interactive-activities/
https://childrenslearninginstitute.org/resources/reading-rules/
Related projects
Questions about this project?
To answer additional questions about this project or provide feedback, please contact the program officer.