
Embedding reading comprehension training in content-area instruction.
Williams, J. P., Stafford, K. B., Lauer, K. D., Hall, K. M., & Pollini, S. (2009). Journal of Educational Psychology, 101(1), 1–20. Retrieved from: https://eric.ed.gov/?id=EJ829235
-
examining141Students, grade2
Practice Guide
Review Details
Reviewed: February 2023
- Practice Guide (findings for Embedded comprehension training-—Williams et al. (2009))
- Randomized Controlled Trial
- Meets WWC standards without reservations because it is a randomized controlled trial with low attrition.
This review may not reflect the full body of research evidence for this intervention.
Evidence Tier rating based solely on this study. This intervention may achieve a higher tier when combined with the full body of evidence.
Findings
Outcome measure |
Comparison | Period | Sample |
Intervention mean |
Comparison mean |
Significant? |
Improvement index |
Evidence tier |
---|---|---|---|---|---|---|---|---|
Vocabulary |
Embedded comprehension training-—Williams et al. (2009) vs. Business as usual |
0 Days |
Text structure vs. No instruction;
|
0.20 |
0.05 |
No |
|
Evidence Tier rating based solely on this study. This intervention may achieve a higher tier when combined with the full body of evidence.
Sample Characteristics
Characteristics of study sample as reported by study author.
-
Urban
Study Details
Setting
The study took place in 15 classrooms (5 classrooms per condition) taught by second-grade teachers from four elementary schools in a large metropolitan area.
Study sample
The sample was classes taught by second-grade teachers from four elementary schools in a large metropolitan area that had 90% of students eligible for free or reduced rate lunch and 6% of students receiving special education services, The school enrollment included 61% Hispanic and 37% African American.
Intervention Group
Both TS and CP interventions taught students about animals in 12 lessons taught over the course of 22 sessions (approximately 3 sessions per week). Each session was about 45 minutes in length and the intervention period lasted for about 2 months. Lessons 1-2 focused on familiar animals (e.g., cats and dogs), lessons 3-9 focused on compare-contrast paragraphs and lessons 10-12 focused on mixed-structure paragraphs. For the Text Structure program, each lesson began with clue words and continued with teachers reading about the target animals from the encyclopedia or trade books and introducing vocabulary concepts. Then students read silently the compare-contrast paragraph and also listened to the teacher read it aloud while following along with their own copies. The students analyzed the paragraph, and used matrices to organize the paragraph's content. Finally, the students wrote summaries of the text and ended the lesson with a lesson review with their teacher. For the Content program, each lesson began with background knowledge and trade book reading/discussion. The students then organized the paragraph content using information webs, were presented a list of vocabulary words to study, and read a compare-contrast paragraph. After that, a general discussion was held between students and teacher and students used the information web, the paragraph, and the class discussion to complete a "paragraph frame" with fill-in-the-blank responses. The lesson ended with an animal fact book and a lesson review. No student attended less than 64% of the lessons. These programs are extensions of programs used for a previous study (Williams et al. 2005 -- FR009217 from WWC review). These revised programs (interventions) are "more demanding" in that they require summary writing supported by the paragraph frame and independent summary writing. Both interventions focus on trade book reading and discussion, vocabulary, reading of a target paragraph, summaries of the paragraphs, and lesson reviews. The reading material included an animal encyclopedia, trade books, and 12 "compare-contrast and mixed-structure (compare-contrast and pro-con) paragraphs" (9 of which were used in the previous study). The mean readability of the paragraphs was at the 2.3 grade level according to the Dale-Chall Readability Scale. The Text Structure intervention focuses on clue words, compare-contrast questions, graphic organizers (matrices), and analysis of the target paragraphs. In contrast, the Content intervention focuses on background knowledge, general content discussion, graphic organizers (using an information web), and an animal fact book.
Comparison Group
The comparison condition was a business as usual group with no instruction in reading science content.
Support for implementation
About 1 week prior to the beginning of the instruction , teachers received Individual training sessions (30 min) to familiarize them to the program, including the program’s overall goals and a review of each section of the lessons. Lessons were reportedly very detailed with no need for additional teacher preparation. Teachers were asked to deliver all the content and concepts discussed in the teachers’ manual, but could tailor the instruction according to their own individual teaching styles and professional judgment.
IES Performance Measure
Review Details
Reviewed: October 2015
- IES Performance Measure (findings for Reading Comprehension Training Embedded in Content-Area Instruction)
- Randomized controlled trial
- Meets WWC standards without reservations
This review may not reflect the full body of research evidence for this intervention.
Evidence Tier rating based solely on this study. This intervention may achieve a higher tier when combined with the full body of evidence.
Findings
Outcome measure |
Comparison | Period | Sample |
Intervention mean |
Comparison mean |
Significant? |
Improvement index |
Evidence tier |
---|---|---|---|---|---|---|---|---|
Transfer-free summary |
Reading Comprehension Training Embedded in Content-Area Instruction vs. Content instruction |
posttest |
Intervention;
|
N/A |
N/A |
Yes |
|
|
Transfer-prompted summary |
Reading Comprehension Training Embedded in Content-Area Instruction vs. Content instruction |
posttest |
Intervention;
|
N/A |
N/A |
Yes |
|
|
Transfer-free summary |
Reading Comprehension Training Embedded in Content-Area Instruction vs. No content instruction |
posttest |
Intervention;
|
N/A |
N/A |
Yes |
|
|
Transfer-prompted summary |
Reading Comprehension Training Embedded in Content-Area Instruction vs. No content instruction |
posttest |
Intervention;
|
N/A |
N/A |
Yes |
|
Evidence Tier rating based solely on this study. This intervention may achieve a higher tier when combined with the full body of evidence.
Sample Characteristics
Characteristics of study sample as reported by study author.
-
Urban
-
Race Black 61% -
Ethnicity Hispanic 37% Not Hispanic or Latino 63%
An indicator of the effect of the intervention, the improvement index can be interpreted as the expected change in percentile rank for an average comparison group student if that student had received the intervention.
For more, please see the WWC Glossary entry for improvement index.
An outcome is the knowledge, skills, and attitudes that are attained as a result of an activity. An outcome measures is an instrument, device, or method that provides data on the outcome.
A finding that is included in the effectiveness rating. Excluded findings may include subgroups and subscales.
The sample on which the analysis was conducted.
The group to which the intervention group is compared, which may include a different intervention, business as usual, or no services.
The timing of the post-intervention outcome measure.
The number of students included in the analysis.
The mean score of students in the intervention group.
The mean score of students in the comparison group.
The WWC considers a finding to be statistically significant if the likelihood that the finding is due to chance alone, rather than a real difference, is less than five percent.
The WWC reviews studies for WWC products, Department of Education grant competitions, and IES performance measures.
The name and version of the document used to guide the review of the study.
The version of the WWC design standards used to guide the review of the study.
The result of the WWC assessment of the study. The rating is based on the strength of evidence of the effectiveness of the intervention. Studies are given a rating of Meets WWC Design Standards without Reservations, Meets WWC Design Standards with Reservations, or >Does Not Meet WWC Design Standards.
A related publication that was reviewed alongside the main study of interest.
Study findings for this report.
Based on the direction, magnitude, and statistical significance of the findings within a domain, the WWC characterizes the findings from a study as one of the following: statistically significant positive effects, substantively important positive effects, indeterminate effects, substantively important negative effects, and statistically significant negative effects. For more, please see the WWC Handbook.
The WWC may review studies for multiple purposes, including different reports and re-reviews using updated standards. Each WWC review of this study is listed in the dropdown. Details on any review may be accessed by making a selection from the drop down list.
Tier 1 Strong indicates strong evidence of effectiveness,
Tier 2 Moderate indicates moderate evidence of effectiveness, and
Tier 3 Promising indicates promising evidence of effectiveness,
as defined in the
non-regulatory guidance for ESSA
and the regulations for ED discretionary grants (EDGAR Part 77).