WWC review of this study

Building a Future: Interim Impact Findings from the YouthBuild Evaluation

Miller, Cynthia, Millenky, Megan, Schwartz, Lisa, Goble, Lisbeth, Stein, Jillian (2016). MDRC . Retrieved from: https://eric.ed.gov/?id=ED571142

  • Randomized Controlled Trial
     examining 
    3,929
     Students
    , grade
    PS

Reviewed: February 2021

At least one finding shows strong evidence of effectiveness
At least one statistically significant positive finding
Meets WWC standards without reservations
College degree attainment (long-run) outcomes—Statistically significant positive effects found
Outcome
measure
Comparison Period Sample Intervention
mean
Comparison
mean
Significant? Improvement
    index
Evidence
tier

Received a degree

Adult Education vs. Business as usual

48 Months

Full sample;
3,929 students

1.70

0.90

Yes

 
 
15
 
More Outcomes
Show Supplemental Findings

Received a certificate

Adult Education vs. Business as usual

48 Months

Full sample;
3,929 students

1.20

0.60

No

--

Received a Bachelor’s degree

Adult Education vs. Business as usual

48 Months

Full sample;
3,929 students

0.01

0.02

No

--

Received an Associate's degree

Adult Education vs. Business as usual

48 Months

Full sample;
3,929 students

0.20

0.00

No

--

Received a Master's degree

Adult Education vs. Business as usual

48 Months

Full sample;
3,929 students

0.10

0.00

Yes

--
College degree attainment (short-run) outcomes—Statistically significant positive effects found
Outcome
measure
Comparison Period Sample Intervention
mean
Comparison
mean
Significant? Improvement
    index
Evidence
tier

Received a degree

Adult Education vs. Business as usual

30 Months

Full sample;
3,929 students

0.01

0.01

Yes

 
 
20
 
More Outcomes
Show Supplemental Findings

Received certificate

Adult Education vs. Business as usual

30 Months

Full sample;
3,929 students

1.10

0.40

Yes

 
 
23

Received a Bachelor's degree

Adult Education vs. Business as usual

30 Months

Full sample;
3,929 students

0.10

0.20

No

--

Received an Associate's degree

Adult Education vs. Business as usual

30 Months

Full sample;
3,929 students

0.20

0.00

Yes

--

Received a Master's degree

Adult Education vs. Business as usual

30 Months

Full sample;
3,929 students

0.00

0.00

No

--
College enrollment outcomes—Statistically significant positive effects found
Outcome
measure
Comparison Period Sample Intervention
mean
Comparison
mean
Significant? Improvement
    index
Evidence
tier

Enrolled in a 2-year institution

Adult Education vs. Business as usual

30 Months

Full sample;
3,929 students

15.10

8.00

Yes

 
 
17
 
More Outcomes

Enrolled in any college

Adult Education vs. Business as usual

48 Months

Full sample;
3,929 students

21.30

12.70

Yes

 
 
15
 

Enrolled in a 4-year institution

Adult Education vs. Business as usual

30 Months

Full sample;
3,929 students

3.00

2.40

No

--

Enrolled in a less-than-2-year institution

Adult Education vs. Business as usual

30 Months

Full sample;
3,929 students

0.20

0.00

No

--
Show Supplemental Findings

Attended college part time

Adult Education vs. Business as usual

30 Months

Full sample;
3,929 students

10.10

3.90

Yes

 
 
23

Attended college part time

Adult Education vs. Business as usual

48 Months

Full sample;
3,929 students

17.10

8.70

Yes

 
 
18

Attended public college

Adult Education vs. Business as usual

30 Months

Full sample;
3,929 students

15.50

8.00

Yes

 
 
17

Enrolled in a 2-year institution

Adult Education vs. Business as usual

48 Months

Full sample;
3,929 students

17.70

9.90

Yes

 
 
16

Attended college full time

Adult Education vs. Business as usual

30 Months

Full sample;
3,929 students

7.60

4.90

Yes

 
 
11

Attended college full time

Adult Education vs. Business as usual

48 Months

Full sample;
3,929 students

9.50

6.70

Yes

 
 
9

Enrolled in a 4-year institution

Adult Education vs. Business as usual

48 Months

Full sample;
3,929 students

4.50

3.50

No

--

Enrolled in private college

Adult Education vs. Business as usual

30 Months

Full sample;
3,929 students

2.70

2.40

No

--

Enrolled in a less-than-2-year institution

Adult Education vs. Business as usual

48 Months

Full sample;
3,929 students

0.20

0.00

No

--
Earnings (long-run) outcomes—Indeterminate effects found
Outcome
measure
Comparison Period Sample Intervention
mean
Comparison
mean
Significant? Improvement
    index
Evidence
tier

Earnings in Year 4

Adult Education vs. Business as usual

48 Months

Full sample;
3,878 students

6980.00

6729.00

No

--
More Outcomes
Show Supplemental Findings

Earnings in Year 2

Adult Education vs. Business as usual

30 Months

Full sample whose data were available in UI database;
3,877 students

3735.20

3936.70

No

--

Earning in quarter 10

Adult Education vs. Business as usual

30 Months

Full sample whose data were available in UI database;
3,877 students

1280.80

1277.00

No

--

Earning in quarter 10

Adult Education vs. Business as usual

30 Months

Female;
1,379 students

1100.00

1026.00

No

--

Earning in quarter 10

Adult Education vs. Business as usual

30 Months

Male;
2,492 students

1383.00

1418.00

No

--

Earnings in Year 3

Adult Education vs. Business as usual

48 Months

Full sample;
3,878 students

5442.00

5331.00

No

--

Earning in quarter 10

Adult Education vs. Business as usual

30 Months

Less than 11th grade;
2,076 students

1190.00

1094.00

No

--

Earning in quarter 10

Adult Education vs. Business as usual

30 Months

11th grade or higher;
1,748 students

1399.00

1494.00

No

--

Earnings in Year 4

Adult Education vs. Business as usual

48 Months

Less than 11th grade;
2,076 students

6364.00

6239.00

No

--

Earnings in Year 4

Adult Education vs. Business as usual

48 Months

11th grade or higher;
1,748 students

7752.00

7386.00

No

--

Earnings in Year 4

Adult Education vs. Business as usual

4 Years

Male;
2,492 students

7544.00

7091.00

No

--

Earnings in Year 4

Adult Education vs. Business as usual

4 Years

Female;
1,379 students

6029.00

6004.00

No

--
Earnings (short-run) outcomes—Statistically significant negative effects found
Outcome
measure
Comparison Period Sample Intervention
mean
Comparison
mean
Significant? Improvement
    index
Evidence
tier

Earnings in Year 1

Adult Education vs. Business as usual

30 Months

Full sample whose data were available in UI database;
3,877 students

2093.40

2407.70

Yes

--
Employment (long-run) outcomes—Indeterminate effects found
Outcome
measure
Comparison Period Sample Intervention
mean
Comparison
mean
Significant? Improvement
    index
Evidence
tier

Employed in Year 4

Adult Education vs. Business as usual

48 Months

Full sample;
3,929 students

71.60

73.30

No

--
More Outcomes
Show Supplemental Findings

Employed in Year 2

Adult Education vs. Business as usual

30 Months

Full sample whose data were available in UI database;
3,877 students

62.90

59.70

Yes

 
 
3

Employed in quarter 10

Adult Education vs. Business as usual

30 Months

Less than 11th grade;
2,076 students

43.30

40.30

No

--

Employed in Year 3

Adult Education vs. Business as usual

48 Months

Full sample;
3,929 students

68.40

66.30

No

--

Currently employed

Adult Education vs. Business as usual

30 Months

Female;
1,379 students

45.20

43.90

No

--

Employed in quarter 10

Adult Education vs. Business as usual

30 Months

Full sample;
3,877 students

44.40

44.80

No

--

Currently employed

Adult Education vs. Business as usual

30 Months

Male;
2,492 students

44.10

45.40

No

--

Employed in Year 4

Adult Education vs. Business as usual

48 Months

11th grade or higher;
1,748 students

74.00

75.40

No

--

Employed in Year 4

Adult Education vs. Business as usual

4 Years

Male;
2,492 students

71.20

72.70

No

--

Employed in Year 4

Adult Education vs. Business as usual

4 Years

Female;
1,379 students

72.70

74.00

No

--

Employed in Year 4

Adult Education vs. Business as usual

48 Months

Less than 11th grade;
2,076 students

69.60

71.80

No

--

Employed in quarter 10

Adult Education vs. Business as usual

30 Months

11th grade or higher;
1,748 students

45.70

50.20

No

--
Employment (short-run) outcomes—Indeterminate effects found
Outcome
measure
Comparison Period Sample Intervention
mean
Comparison
mean
Significant? Improvement
    index
Evidence
tier

Employed in Year 1

Adult Education vs. Business as usual

12 Months

Full sample whose data were available in UI database;
3,877 students

48.90

51.30

No

--


Evidence Tier rating based solely on this study. This intervention may achieve a higher tier when combined with the full body of evidence.

Characteristics of study sample as reported by study author.


  • Female: 36%
    Male: 64%
  • Race
    Black
    63%
    Other or unknown
    22%
    White
    15%
  • Ethnicity
    Hispanic    
    15%
    Not Hispanic or Latino    
    85%

Setting

The study took place in 75 YouthBuild programs across the country. Programs were located in 29 states, the U.S. Virgin Islands, and Washington DC, and were found both in both densely populated urban centers and rural areas.

Study sample

The initial sample consisted of 3,929 learners. These learners generally had to be between the ages of 16 and 24, have withdrawn from secondary education without a credential, have a referral from a high school, or have a deficiency in basic skills. Eligibility criteria varied depending on the YouthBuild program site. Sixty-three percent of learners were Black, and 64 percent were male. Ninety percent had not graduated from high school or passed a high school equivalency exam, and 79 percent were under the age of 22. The authors reported on outcome measures for the full sample as well as by gender and educational attainment subgroups, which met standards.

Intervention Group

The YouthBuild program includes instruction in basic skills, remedial education, and alternative education that is designed to lead to a high school diploma or equivalent credential. It also offers vocational training, which is typically training in construction, as well as youth development services including leadership training and community service. Supportive wraparound services could include counseling, case management, life-skills training, workforce preparation, follow-up services, stipends, and help with child care, transportation or housing.

Comparison Group

For two years, members of the comparison group were prohibited from enrolling in YouthBuild programs that were participating in the study and given information about other appropriate services in the community. About 1 percent of learners in the comparison group enrolled in local YouthBuild programs that were not participating in the study.

Support for implementation

The study does not provide specific information about support for implementation.

In the case of multiple manuscripts that report on one study, the WWC selects one manuscript as the primary citation and lists other manuscripts that describe the study as additional sources.

  • Miller, Cynthia, Cummings, Danielle, Millenky, Megan, Wiegand, Andrew, Long, David. (2018). Laying a Foundation: Four-Year Results from the National YouthBuild Evaluation. MDRC.

  • Wiegand, Andrew, Manno, Michelle, Leshnick, Sengsouvanh, Treskon, Louisa, Geckeler, Christian, Lewis-Charp, Heather, Sinicrope, Castle, Clark, Mika, Nicholson, Brandon. (2015). Adapting to Local Context: Findings from the Youthbuild Evaluation Implementation Study. MDRC.

 

Your export should download shortly as a zip archive.

This download will include data files for study and findings review data and a data dictionary.

Connect With the WWC

loading
back to top