
The Effectiveness of a Program to Accelerate Vocabulary Development in Kindergarten (VOCAB): Kindergarten Final Evaluation Report. NCEE 2010-4014
Goodson, Barbara; Wolf, Anne; Bell, Steve; Turner, Herb; Finney, Pamela B. (2010). National Center for Education Evaluation and Regional Assistance. Retrieved from: https://eric.ed.gov/?id=ED512900
-
examining1,204Students, gradeK
Practice Guide
Review Details
Reviewed: February 2024
- Practice Guide (findings for Kindergarten PAVEd for Success (K-PAVE))
- Randomized Controlled Trial
- Meets WWC standards with reservations because it is a randomized control trial with cluster level inferences and joiners, but it demonstrates baseline equivalence.
This review may not reflect the full body of research evidence for this intervention.
Evidence Tier rating based solely on this study. This intervention may achieve a higher tier when combined with the full body of evidence.
Findings
Outcome measure |
Comparison | Period | Sample |
Intervention mean |
Comparison mean |
Significant? |
Improvement index |
Evidence tier |
---|---|---|---|---|---|---|---|---|
Kaufman Test of Educational Achievement–II (KTEA–II), Listening Comprehension subtest standard score |
Kindergarten PAVEd for Success (K-PAVE) vs. Business as usual |
0 Years |
Full sample;
|
89.95 |
88.32 |
No |
-- |
Outcome measure |
Comparison | Period | Sample |
Intervention mean |
Comparison mean |
Significant? |
Improvement index |
Evidence tier |
---|---|---|---|---|---|---|---|---|
Expressive Vocabulary Test–2 (EVT–2) standard score |
Kindergarten PAVEd for Success (K-PAVE) vs. Business as usual |
0 Years |
Full sample;
|
92.57 |
92.03 |
Yes |
|
|
Evidence Tier rating based solely on this study. This intervention may achieve a higher tier when combined with the full body of evidence.
Sample Characteristics
Characteristics of study sample as reported by study author.
-
Female: 50%
Male: 50% -
Rural
-
- B
- A
- C
- D
- E
- F
- G
- I
- H
- J
- K
- L
- P
- M
- N
- O
- Q
- R
- S
- V
- U
- T
- W
- X
- Z
- Y
- a
- h
- i
- b
- d
- e
- f
- c
- g
- j
- k
- l
- m
- n
- o
- p
- q
- r
- s
- t
- u
- v
- x
- w
- y
Mississippi
-
Race Black 85% Other or unknown 2% White 13%
Study Details
Setting
The intervention was implemented in kindergarten classes as a supplement to regular English language instruction. Schools were selected from the Mississippi Delta region and surrounding districts. Schools that were eligible for participation were those that had at least two kindergarten classrooms, at least two consenting kindergarten teachers, and at least 40% of students eligible for free or reduced-price meals.
Study sample
Teachers were primarily White (55%) or African American (45%), had early childhood certifications(76%), and approximately 16 years of teaching, with 10 years teaching in kindergarten. The student sample was 85% African American, 13.3% White, and 1.7% other. Approximately 93% of students were eligible for free or reduced-price meals. The median age was 6 years, 2 months.
Intervention Group
K-PAVE is an adaptation of a preschool program intended to increase vocabulary comprehension, and oral language skills. 1 Every week a new set of ten thematically-linked vocabulary words are introduced using explicit Instruction with picture cards. Students are introduced to the picture card, given a short definition, and asked to choose a picture of the target word from among other pictures of known words. 2 The new words are reinforced over multiple contexts throughout the day using interactive readings (see next item below), adult-child conversations, and extension activities in centers and other subject domains (e.g., if the target word is radish, then radishes might be used in a counting math activity that week). 3- Interactive readings of one nonfiction book and one fiction book containing the target words are conducted at least twice during the week. During the reading teachers ask at least two questions each in the following categories: a)questions that require students to students to label, recall, describe, and locate; b) questions that require students to students to judge, contrast, compare, summarize, predict, define, take another point of view, or solve problems; and c) questions that relate the book to students’ experiences. -The program is implemented as a supplement to the regular instructional environment. -There are 24 weekly units that are delivered throughout the day through explicit instruction, interactive book reading, and adult-child conversations. -A list of the ten words of the week are also sent home to parents, who are encouraged to use them in conversations with the child at home. -The regular classroom instructor delivers the intervention. -Materials include 24 fiction books and 24 nonfiction books, 240 picture cards for the 240 vocabulary words, and cards showing a picture of the target word among other pictures of known words. -The intervention is not scripted. -Formative assessments were not used. Fidelity of implementation results are presented on p. 66. Based on a 12-point fidelity checklist, 32% of teachers implemented 10-12 strategies, 37% implemented 8-9 strategies, 25% implemented 5-7 strategies, and 7% implemented four or fewer strategies. Three quarters of teachers implemented all strategies associated with interactive book reading, but only one quarter of teachers implemented strategies for explicit vocabulary instruction or adult-child interaction. Only 13% of teachers implemented all 12 strategies.
Comparison Group
The comparison condition were schools with similar demographic characteristics who did not implement the supplemental program and went about business as usual.
Support for implementation
Teachers were trained initially at a group training. Three follow-up teleconferences were held during the program intervention, and classroom visits were conducted to observe implementation and provide feedback for teachers who were not implementing with fidelity.
Foundational Skills to Support Reading for Understanding in Kindergarten Through 3rd Grade
Review Details
Reviewed: June 2016
- Randomized Controlled Trial
- Meets WWC standards without reservations
This review may not reflect the full body of research evidence for this intervention.
Evidence Tier rating based solely on this study. This intervention may achieve a higher tier when combined with the full body of evidence.
Findings
Evidence Tier rating based solely on this study. This intervention may achieve a higher tier when combined with the full body of evidence.
Sample Characteristics
Study sample characteristics were not reported.The Effectiveness of a Program to Accelerate Vocabulary Development in Kindergarten (VOCAB): Kindergarten Final Evaluation Report. NCEE 2010-4014
Review Details
Reviewed: June 2012
- Single Study Review (153 KB) (findings for Kindergarten PAVEd for Success (K-PAVE))
- Randomized controlled trial
- Meets WWC standards without reservations
This review may not reflect the full body of research evidence for this intervention.
Evidence Tier rating based solely on this study. This intervention may achieve a higher tier when combined with the full body of evidence.
Absence of conflict of interest: This study was conducted by staff from Mathematica Policy Research. Therefore, Mathematica reviewers were not involved in the WWC review of this study.
Findings
Outcome measure |
Comparison | Period | Sample |
Intervention mean |
Comparison mean |
Significant? |
Improvement index |
Evidence tier |
---|---|---|---|---|---|---|---|---|
Expressive Vocabulary Test- Second Edition (EVT-2) |
Kindergarten PAVEd for Success (K-PAVE) vs. Business as usual |
Posttest |
Kindergarten students;
|
N/A |
N/A |
Yes |
|
|
Kaufman Test of Educational Achievement II (KTEA-II): Listening Comprehension subtest |
Kindergarten PAVEd for Success (K-PAVE) vs. Business as usual |
Posttest |
Kindergarten students;
|
N/A |
N/A |
No |
-- |
Evidence Tier rating based solely on this study. This intervention may achieve a higher tier when combined with the full body of evidence.
Sample Characteristics
Characteristics of study sample as reported by study author.
-
Female: 50%
Male: 50% -
Rural
-
- B
- A
- C
- D
- E
- F
- G
- I
- H
- J
- K
- L
- P
- M
- N
- O
- Q
- R
- S
- V
- U
- T
- W
- X
- Z
- Y
- a
- h
- i
- b
- d
- e
- f
- c
- g
- j
- k
- l
- m
- n
- o
- p
- q
- r
- s
- t
- u
- v
- x
- w
- y
Mississippi
-
Race Black 85% Other or unknown 2% White 13%
An indicator of the effect of the intervention, the improvement index can be interpreted as the expected change in percentile rank for an average comparison group student if that student had received the intervention.
For more, please see the WWC Glossary entry for improvement index.
An outcome is the knowledge, skills, and attitudes that are attained as a result of an activity. An outcome measures is an instrument, device, or method that provides data on the outcome.
A finding that is included in the effectiveness rating. Excluded findings may include subgroups and subscales.
The sample on which the analysis was conducted.
The group to which the intervention group is compared, which may include a different intervention, business as usual, or no services.
The timing of the post-intervention outcome measure.
The number of students included in the analysis.
The mean score of students in the intervention group.
The mean score of students in the comparison group.
The WWC considers a finding to be statistically significant if the likelihood that the finding is due to chance alone, rather than a real difference, is less than five percent.
The WWC reviews studies for WWC products, Department of Education grant competitions, and IES performance measures.
The name and version of the document used to guide the review of the study.
The version of the WWC design standards used to guide the review of the study.
The result of the WWC assessment of the study. The rating is based on the strength of evidence of the effectiveness of the intervention. Studies are given a rating of Meets WWC Design Standards without Reservations, Meets WWC Design Standards with Reservations, or >Does Not Meet WWC Design Standards.
A related publication that was reviewed alongside the main study of interest.
Study findings for this report.
Based on the direction, magnitude, and statistical significance of the findings within a domain, the WWC characterizes the findings from a study as one of the following: statistically significant positive effects, substantively important positive effects, indeterminate effects, substantively important negative effects, and statistically significant negative effects. For more, please see the WWC Handbook.
The WWC may review studies for multiple purposes, including different reports and re-reviews using updated standards. Each WWC review of this study is listed in the dropdown. Details on any review may be accessed by making a selection from the drop down list.
Tier 1 Strong indicates strong evidence of effectiveness,
Tier 2 Moderate indicates moderate evidence of effectiveness, and
Tier 3 Promising indicates promising evidence of effectiveness,
as defined in the
non-regulatory guidance for ESSA
and the regulations for ED discretionary grants (EDGAR Part 77).