WWC review of this study

Evaluating the Impact of the Investing in Innovation Fund (i3) UPSTART Project on Rural Preschoolers' Early Literacy Skills

Hobbs, L. Jon, Overby, Melanie (2017). Culver City, CA: Evaluation and Training Institute (ETI). Retrieved from: https://eric.ed.gov/?id=ED608232

  • Randomized Controlled Trial
     examining 
    491
     Students
    , grade
    PK

Reviewed: September 2022

At least one finding shows strong evidence of effectiveness
At least one statistically significant positive finding
Meets WWC standards without reservations
Alphabetics outcomes—Statistically significant positive effects found
Outcome
measure
Comparison Period Sample Intervention
mean
Comparison
mean
Significant? Improvement
    index
Evidence
tier

Brigance Inventory of Early Development III (IEDIII): Academic Skills/Cognitive Development: Literacy: Alphabet Knowledge

Utah Preparing Students Today for a Rewarding Tomorrow (UPSTART) Reading Program vs. Utah Preparing Students Today for a Rewarding Tomorrow (UPSTART) - Math Program

0 Days

Full sample;
491 students

20.53

16.19

Yes

 
 
20
 
More Outcomes

Brigance Inventory of Early Development III (EID-III) - Names Uppercase Letters Subscale

Utah Preparing Students Today for a Rewarding Tomorrow (UPSTART) Reading Program vs. Utah Preparing Students Today for a Rewarding Tomorrow (UPSTART) - Math Program

0 Days

Full sample;
491 students

20.53

16.19

Yes

 
 
20
 

Brigance Inventory of Early Development III (IEDIII): Phonemic Manipulation sub-scale

Utah Preparing Students Today for a Rewarding Tomorrow (UPSTART) Reading Program vs. Utah Preparing Students Today for a Rewarding Tomorrow (UPSTART) - Math Program

0 Days

Full sample;
491 students

4.07

3.56

Yes

 
 
13
 

Preschool Early Learning Indicators (PELI) - Phonological Awareness - Initial Word Sounds

Utah Preparing Students Today for a Rewarding Tomorrow (UPSTART) Reading Program vs. Utah Preparing Students Today for a Rewarding Tomorrow (UPSTART) - Math Program

0 Days

Full sample;
491 students

10.53

9.19

Yes

 
 
12
 

Brigance Inventory of Early Development III (EID-III) - Phonological Awareness

Utah Preparing Students Today for a Rewarding Tomorrow (UPSTART) Reading Program vs. Utah Preparing Students Today for a Rewarding Tomorrow (UPSTART) - Math Program

0 Days

Full sample;
491 students

6.57

6.06

No

--
Comprehension outcomes—Indeterminate effects found
Outcome
measure
Comparison Period Sample Intervention
mean
Comparison
mean
Significant? Improvement
    index
Evidence
tier

Preschool Early Literacy Indicators (PELI): Listening Comprehension

Utah Preparing Students Today for a Rewarding Tomorrow (UPSTART) Reading Program vs. Utah Preparing Students Today for a Rewarding Tomorrow (UPSTART) - Math Program

0 Days

Full sample;
491 students

18.36

18.14

No

--
More Outcomes

Preschool Early Literacy Indicators (PELI) : Vocabulary and Oral Language

Utah Preparing Students Today for a Rewarding Tomorrow (UPSTART) Reading Program vs. Utah Preparing Students Today for a Rewarding Tomorrow (UPSTART) - Math Program

0 Days

Full sample;
491 students

22.48

22.68

No

--


Evidence Tier rating based solely on this study. This intervention may achieve a higher tier when combined with the full body of evidence.

Characteristics of study sample as reported by study author.


  • Other or unknown: 100%

  • Rural
    • B
    • A
    • C
    • D
    • E
    • F
    • G
    • I
    • H
    • J
    • K
    • L
    • P
    • M
    • N
    • O
    • Q
    • R
    • S
    • V
    • U
    • T
    • W
    • X
    • Z
    • Y
    • a
    • h
    • i
    • b
    • d
    • e
    • f
    • c
    • g
    • j
    • k
    • l
    • m
    • n
    • o
    • p
    • q
    • r
    • s
    • t
    • u
    • x
    • w
    • y

    Utah
  • Race
    Other or unknown
    100%
  • Ethnicity
    Other or unknown    
    100%
  • Eligible for Free and Reduced Price Lunch
    Other or unknown    
    100%

Setting

The UPSTART program was implemented in public schools in rural school districts in Utah. The intervention serves pre-kindergarten students.

Study sample

Information on sample demographics are not available; to note, program families were excluded from the evaluation if their child did not speak English or had a diagnosed learning disability.

Intervention Group

The intervention group had access to UPSTART Reading software at home. Recommended usage of the software was 15 minutes a day, five days a week. More generally, UPSTART)is a school readiness program that uses a home-based educational technology model with supportive resources that is well-suited to preschoolers and families residing in rural communities in Utah. The objective of UPSTART is to provide service to students in traditionally underserved rural areas, foster early cognitive growth, close reading achievement gaps, and increase school readiness at entry to kindergarten. While the UPSTART adaptive educational software is the core component of the program, the provision of technology in the form of computer hardware and/or high-speed internet access ensures equitable access for all. Additionally, UPSTART families are provided with technical, motivational, and curricular support to encourage program software usage and facilitate the academic supervision of children by parents

Comparison Group

The comparison group had access to UPSTART Math software at home. Recommended usage of the software is 15 minutes a day, five days a week.

Support for implementation

No further details provided.

 

Your export should download shortly as a zip archive.

This download will include data files for study and findings review data and a data dictionary.

Connect With the WWC

loading
back to top