Project Activities
The research team will use both extant and primary data in this project. The extant dataset includes kindergarten through third grade students' assessment data in their language, literacy, and executive functioning skills as well as classroom observation during their literacy instruction. For new data collection, the research team will observe and video record literacy instruction in kindergarten through third grade classrooms with a large number of ELs, and also assess ELs' language, literacy, and executive functioning skills. Extant and new classroom observation data will be coded with the OLOS (Optimizing Learning Opportunities for Students) observation system. The research team will analyze coded observation data and students' test scores to address the research questions.
Structured Abstract
Setting
This study uses both the extant data that already have been collected in two elementary schools in a suburban school district in Arizona and new data that researchers will collect in elementary schools in a suburban district in southern California.
Sample
The extant data include 223 kindergarten through third grade ELs (94% Hispanic) and their teachers (n = 8) in two elementary schools from the same school district in Arizona. These schools serve economically and ethnically diverse students (79% eligible for free or reduced lunch program, 80% Hispanic, 18% ELs). These children were from structured English immersion classrooms, and all students in these classes were classified as ELs by their school district. The research team will collect additional data from elementary schools (32 classrooms, 20 students in each classroom) in southern California. The participating school district in southern California serves highly diverse students (85% eligible for free or reduced lunch program, 85% Hispanic, and 53% ELs).
This study will examine the relation between ELs' malleable characteristics and the literacy instruction they receive. Specifically, the study will explore what constellations of skills ELs bring into their learning environment and how those skills interact with the literacy instruction they receive. In addition, the study will examine whether ELs' language, literacy, and cognitive skills, such as executive functioning, and discourse moves during literacy instruction have main and interaction effects with literacy instruction they receive on their language and literacy outcomes at the end of the school year.
Research design and methods
This study involves both primary data collection and data analysis. First, the research team will code video recordings from the extant data that were collected from eight classrooms using the OLOS observation system. In the extant data, classroom observations were conducted three times in the 2015–2016 school year. The researchers will also conduct observations three times a year in newly recruited schools in Years 2 and 3 and code them using OLOS. In the extant data, students were assessed in their language, literacy, and executive functioning skills twice during the school year; the researchers will use the same measures with their new sample and assess the students twice each year. The research team will use the coded observation data as well as students' assessment data to examine nature of and variability in literacy instruction among EL classes and test whether there are child by instruction interaction effects in ELs' later outcomes. In addition, the researchers will calculate recommended amounts and types of instruction for each student using the currently available A2i algorithms, as well as distance from recommendation (DFR)—the difference between the recommended and observed amounts for each type of instruction.
Control condition
There is no control condition in this study.
Key measures
Measures for the study include scores from A2i online adaptive assessments (Word Match Game, Letters2Meaning, Reading2Comprehension), Woodcock Johnson Tests of Achievement, Gates MacGinitie Reading Test, Social Skills Improvement System Rating Scale, Head Toes Knees Shoulders, and teacher reports of students' English and Spanish proficiency. Classroom observations will be coded using the OLOS observation system.
Data analytic strategy
The research team will conduct a series of HLM analyses to address the main research questions. In addition, they will conduct further analyses using simulations to modify the A2i algorithms.
Cost analysis strategy
Not applicable for this project.
People and institutions involved
IES program contact(s)
Project contributors
Products and publications
Products: Products from this project will include modified A2i algorithms for ELs. In addition, the research team will also produce peer-reviewed publications and participate in conference presentations.
Publications:
Cho, M., & Kim, Y. S. G. (2024). Examining linguistic and discourse features in oral text production and their dimensionality. First Language, 44(2), 153-172.
Connor, C. M., May, H., Sparapani, N., Hwang, J. K., Adams, A., Wood, T. S., ... & Day, S. (2022). Bringing Assessment-to-Instruction (A2i) technology to scale: Exploring the process from development to implementation. Journal of Educational Psychology, 114(7), 1495.
Sanabria, A., Kyoung Hwang, J., Zargar, E., Lowe Vandell, D., & Connor, C. M. (2024). A Multi-Site Study of Student Experiences with Code-and Meaning-Focused Literacy in Preschool-Third Grade Classrooms. Scientific Studies of Reading, 28(6), 656-684.
Related projects
Supplemental information
Co-Principal Investigators: Adams, Ashley; Kim, Young-Suk
Questions about this project?
To answer additional questions about this project or provide feedback, please contact the program officer.
