Project Activities
Researchers will conduct a cluster randomized-controlled trial to evaluate the effectiveness of Online CFC. Comparing Online CFC to business as usual for literacy coaching and professional development in the district, researchers will measure the quality of classroom text discussions, students' reading achievement scores, the inputs required to achieve these effects, and their costs. Using similar measures as in the efficacy trial, researchers also will employ an interrupted time series design to explore the implementation of Online CFC in three geographically and demographically diverse rural school districts
Structured Abstract
Setting
The proposed project is comprised of two studies: Researchers will conduct Study 1 in a large urban district located in New Jersey. The district mirrors the demographics of large urban school districts across the US. The majority of students (69%) are Latinx; 22% are African American, 6% Asian, and 5% white. About a third (35.6%) of the students are from families with incomes below the poverty line. Nearly 57% of the students speak a primary language other than English, and 8.3% are designated as English Learners (ELs). The research team will conduct Study 2 in three rural districts that reflect the diversity of rural education in the US. One district, designated as rural fringe, is located in Pennsylvania, and serves primarily (97%) white students, relatively few of whom are from families whose incomes are below the poverty line (10%). The second district, designated as rural distant, is in Virginia and serves mostly white (66%) and African American (27%) students, about a third of whom are from families whose income is below the poverty line. The third district, designated as rural remote, is located in South Dakota, and serves students from the Rosebud Sioux Tribe. The majority of students (81%) are American Indian, white (8%), or identify as two or more races. Over half (60%) of the students are from families whose income is below the poverty line.
Sample
Study 1 will take place with 112 fourth- and fifth-grade teachers in an urban district and their students. Study 2 will take place with 21 fourth- and fifth-grade teachers from three rural districts.
Online CFC is a fully developed professional development program that was created with support from an IES Development and Innovation grant. It is comprised of a six-week online workshop followed by five cycles of remote coaching centered on teachers' videoed class discussions. Through the workshop and coaching, teachers learn how to apply Questioning the Author and Accountable Talk techniques to increase the rigor and interactivity of their classroom text discussions. The intervention requires skilled coaches, access to technology for videos and online conferences, and approximately 30 hours of each teacher's time.
Research design and methods
Study 1 in urban schools (years 1 & 2) will be a cluster-randomized trial. Study 2 in rural school (years 1-4) will employ a quasi-experimental interrupted time-series design. Cost analysis will follow the Ingredients Method; the data collection and research design will parallel the outcomes analysis in each study.
Control condition
The control group (study 1) will continue with the coaching and professional development that is standard practice in the district and will have the option to take the CFC online workshop at the end of data collection in the district.
Key measures
Data sources include multiple videoed lessons, teacher surveys, teacher and coach logs, transcripts of coaching sessions, interviews, and state standardized reading achievement scores. Constructs measured in surveys include beliefs and endorsed practices aligned with dialogic reading instruction including the quality of teacher questions, teacher facilitation to elicit and extend student thinking, and student discussion participation. Implementation quality, participant response, and feasibility of the intervention also will be assessed. Prices of inputs will be measured for our participating districts (representing several states and spending environments) and national averages.
Data analytic strategy
Analytic methods include descriptive, correlational, multivariate, multi-level and longitudinal analyses. Researchers will use qualitative methods to analyze transcripts of coach-teacher conferences around teachers' videoed lessons, and teacher/school leader interviews in the rural schools.
Cost analysis strategy
Researchers will conduct a cost-effectiveness analysis to help schools and districts calculate the cost of implementing Online CFC under different conditions.
People and institutions involved
IES program contact(s)
Project contributors
Products and publications
Products will include evidence of the efficacy of Online CFC for improving teaching and students' reading skills, including the reading skills of English learners. Our cost-effectiveness estimates will provide school and district leaders with actionable evidence to guide their decisions about allocating resources for improving literacy versus competing initiatives. Other products will include tools and protocols that can be incorporated in coaching programs for professional learning purposes.
Related projects
Questions about this project?
To answer additional questions about this project or provide feedback, please contact the program officer.
