Building a Future: Interim Impact Findings from the YouthBuild Evaluation
Miller, Cynthia; Millenky, Megan; Schwartz, Lisa; Goble, Lisbeth; Stein, Jillian (2016). MDRC. Retrieved from: https://eric.ed.gov/?id=ED571142
-
examining3,929Students, gradesPS-Not reported
Practice Guide
Review Details
Reviewed: April 2024
- Practice Guide (findings for YouthBuild)
- Randomized Controlled Trial
- Meets WWC standards without reservations because it is a randomized controlled trial with low attrition.
This review may not reflect the full body of research evidence for this intervention.
Evidence Tier rating based solely on this study. This intervention may achieve a higher tier when combined with the full body of evidence.
Findings
|
Outcome measure |
Comparison | Period | Sample |
Intervention mean |
Comparison mean |
Significant? |
Improvement index |
Evidence tier |
|
|---|---|---|---|---|---|---|---|---|---|
|
Received a certificate or degree |
YouthBuild vs. Business as usual |
30 Months |
Full sample;
|
1.40 |
0.60 |
No |
-- | ||
|
Received a postsecondary degree |
YouthBuild vs. Business as usual |
30 Months |
Survey sample;
|
1.10 |
1.00 |
No |
-- | ||
| Show Supplemental Findings | |||||||||
|
Received an Associate's degree |
YouthBuild vs. Business as usual |
30 Months |
Full sample;
|
0.20 |
0.00 |
No |
-- | ||
|
Received an Associate's degree |
YouthBuild vs. Business as usual |
48 Months |
Full sample;
|
0.20 |
0.00 |
No |
-- | ||
|
Received a Master's degree |
YouthBuild vs. Business as usual |
48 Months |
Full sample;
|
0.10 |
0.00 |
No |
-- | ||
|
Received certificate |
YouthBuild vs. Business as usual |
30 Months |
Full sample;
|
1.10 |
0.40 |
Yes |
|
||
|
Received certificate |
YouthBuild vs. Business as usual |
48 Months |
Full sample;
|
1.20 |
0.60 |
No |
-- | ||
|
Received other degree (not Associate's or Bachelor's) |
YouthBuild vs. Business as usual |
12 Months |
Survey sample;
|
0.20 |
0.10 |
No |
-- | ||
|
Received a Bachelor's degree |
YouthBuild vs. Business as usual |
48 Months |
Survey sample;
|
0.20 |
0.10 |
No |
-- | ||
|
Received a degree |
YouthBuild vs. Business as usual |
48 Months |
Full sample;
|
1.70 |
0.90 |
Yes |
|
||
|
Received an Associate's degree |
YouthBuild vs. Business as usual |
30 Months |
Survey sample;
|
0.90 |
0.50 |
No |
-- | ||
|
Received a postsecondary degree |
YouthBuild vs. Business as usual |
12 Months |
Survey sample;
|
15.90 |
11.10 |
Yes |
|
||
|
Received an associate degree |
YouthBuild vs. Business as usual |
48 Months |
Survey sample;
|
1.30 |
0.90 |
No |
-- | ||
|
Received a postsecondary degree |
YouthBuild vs. Business as usual |
48 Months |
Survey sample;
|
1.80 |
1.30 |
No |
-- | ||
|
Received an Associate's degree |
YouthBuild vs. Business as usual |
12 Months |
Survey sample;
|
0.40 |
0.30 |
No |
-- | ||
|
Received a Bachelor's degree |
YouthBuild vs. Business as usual |
30 Months |
Survey sample;
|
0.10 |
0.10 |
No |
-- | ||
|
Received a Bachelor's degree |
YouthBuild vs. Business as usual |
12 Months |
Survey sample;
|
0.10 |
0.10 |
No |
-- | ||
|
Received other degree (not Associate's or Bachelor's) |
YouthBuild vs. Business as usual |
48 Months |
Survey sample;
|
0.50 |
0.80 |
No |
-- | ||
|
Received other degree (not Associate's or Bachelor's) |
YouthBuild vs. Business as usual |
30 Months |
Survey sample;
|
0.30 |
0.50 |
No |
-- | ||
|
Received a Bachelor's degree |
YouthBuild vs. Business as usual |
30 Months |
Full sample;
|
0.10 |
0.20 |
No |
-- | ||
|
Received a Bachelor's degree |
YouthBuild vs. Business as usual |
48 Months |
Full sample;
|
0.10 |
0.20 |
No |
-- | ||
|
Received a Master's degree |
YouthBuild vs. Business as usual |
30 Months |
Full sample;
|
0.00 |
0.00 |
No |
-- | ||
|
Outcome measure |
Comparison | Period | Sample |
Intervention mean |
Comparison mean |
Significant? |
Improvement index |
Evidence tier |
|
|---|---|---|---|---|---|---|---|---|---|
|
Enrolled in post-secondary courses |
YouthBuild vs. Business as usual |
12 Months |
Survey sample;
|
15.90 |
11.10 |
Yes |
|
|
|
| Show Supplemental Findings | |||||||||
|
Enrolled in a less-than-2-year institution |
YouthBuild vs. Business as usual |
48 Months |
Full sample;
|
0.20 |
0.00 |
No |
-- | ||
|
Enrolled in a less-than-2-year institution |
YouthBuild vs. Business as usual |
30 Months |
Full sample;
|
0.20 |
0.00 |
No |
-- | ||
|
Enrolled in college part time |
YouthBuild vs. Business as usual |
30 Months |
Full sample;
|
10.10 |
3.90 |
Yes |
|
||
|
Enrolled in 4-year college |
YouthBuild vs. Business as usual |
12 Months |
Survey sample;
|
2.90 |
1.10 |
Yes |
|
||
|
Enrolled in college part time |
YouthBuild vs. Business as usual |
48 Months |
Full sample;
|
17.10 |
8.70 |
Yes |
|
||
|
Enrolled in 4-year college |
YouthBuild vs. Business as usual |
30 Months |
Survey sample;
|
4.50 |
2.20 |
Yes |
|
||
|
Enrolled in 2-year college |
YouthBuild vs. Business as usual |
30 Months |
Full sample;
|
15.10 |
8.00 |
Yes |
|
||
|
Enrolled in a public college |
YouthBuild vs. Business as usual |
30 Months |
Full sample;
|
15.50 |
8.00 |
Yes |
|
||
|
Enrolled in vocational school |
YouthBuild vs. Business as usual |
12 Months |
Survey sample;
|
25.90 |
14.90 |
Yes |
|
||
|
Attended college |
YouthBuild vs. Business as usual |
48 Months |
Full sample;
|
21.30 |
12.70 |
Yes |
|
||
|
Enrolled in a 2-year college |
YouthBuild vs. Business as usual |
48 Months |
Full sample;
|
17.10 |
9.90 |
Yes |
|
||
|
Enrolled in vocational school |
YouthBuild vs. Business as usual |
48 Months |
Survey sample;
|
32.90 |
21.70 |
Yes |
|
||
|
Enrolled in vocational school |
YouthBuild vs. Business as usual |
30 Months |
Survey sample;
|
30.40 |
20.40 |
Yes |
|
||
|
Currently enrolled in college courses |
YouthBuild vs. Business as usual |
12 Months |
Survey sample;
|
6.80 |
4.00 |
Yes |
|
||
|
Enrolled in college full time |
YouthBuild vs. Business as usual |
30 Months |
Full sample;
|
7.60 |
4.90 |
Yes |
|
||
|
Enrolled in college full time |
YouthBuild vs. Business as usual |
48 Months |
Full sample;
|
9.50 |
6.70 |
Yes |
|
||
|
Enrolled in post-secondary courses |
YouthBuild vs. Business as usual |
30 Months |
Survey sample;
|
23.60 |
18.10 |
Yes |
|
||
|
Enrolled in 2-year college |
YouthBuild vs. Business as usual |
30 Months |
Survey sample;
|
22.00 |
17.10 |
Yes |
|
||
|
Enrolled in 2-year college |
YouthBuild vs. Business as usual |
12 Months |
Survey sample;
|
14.30 |
10.60 |
Yes |
|
||
|
Currently enrolled in vocational school |
YouthBuild vs. Business as usual |
12 Months |
Survey sample;
|
6.40 |
4.60 |
No |
-- | ||
|
Enrolled in post-secondary courses |
YouthBuild vs. Business as usual |
48 Months |
Survey Sample;
|
26.90 |
21.70 |
Yes |
|
||
|
Enrolled in 4-year college |
YouthBuild vs. Business as usual |
30 Months |
Full sample;
|
3.00 |
2.40 |
No |
-- | ||
|
Enrolled in a 4-year college |
YouthBuild vs. Business as usual |
48 Months |
Full sample;
|
4.50 |
3.50 |
No |
-- | ||
|
Enrolled in private college |
YouthBuild vs. Business as usual |
30 Months |
Full sample;
|
2.70 |
2.40 |
No |
-- | ||
|
Outcome measure |
Comparison | Period | Sample |
Intervention mean |
Comparison mean |
Significant? |
Improvement index |
Evidence tier |
|
|---|---|---|---|---|---|---|---|---|---|
|
Earning $10/hour or more |
YouthBuild vs. Business as usual |
30 Months |
Survey sample;
|
17.50 |
14.20 |
Yes |
|
|
|
| Show Supplemental Findings | |||||||||
|
Earning $10/hour or more |
YouthBuild vs. Business as usual |
48 Months |
Survey sample;
|
27.50 |
23.00 |
No |
-- | ||
|
Earning $10/hour or more |
YouthBuild vs. Business as usual |
12 Months |
Survey sample;
|
8.30 |
8.00 |
No |
-- | ||
|
Earnings in Year 2 |
YouthBuild vs. Business as usual |
30 Months |
Full sample;
|
3735.20 |
3936.70 |
No |
-- | ||
|
Earnings in quarter 10 |
YouthBuild vs. Business as usual |
30 Months |
Full sample;
|
1280.80 |
1277.00 |
No |
-- | ||
|
Earnings in 1 Year |
YouthBuild vs. Business as usual |
30 Months |
Full sample;
|
2093.40 |
2407.70 |
Yes |
-- | ||
|
Average weekly earnings |
YouthBuild vs. Business as usual |
30 Months |
Survey sample;
|
150.20 |
134.50 |
No |
-- | ||
|
Earnings in Year 4 |
YouthBuild vs. Business as usual |
48 Months |
Full sample;
|
6980.00 |
6729.00 |
No |
-- | ||
|
Earnings in Year 3 |
YouthBuild vs. Business as usual |
48 Months |
Full sample;
|
5442.00 |
5331.00 |
No |
-- | ||
|
Average weekly earnings |
YouthBuild vs. Business as usual |
12 Months |
Survey sample;
|
92.30 |
90.20 |
No |
-- | ||
|
Average weekly earnings |
YouthBuild vs. Business as usual |
48 Months |
Survey sample;
|
206.70 |
174.10 |
Yes |
-- | ||
|
Outcome measure |
Comparison | Period | Sample |
Intervention mean |
Comparison mean |
Significant? |
Improvement index |
Evidence tier |
|
|---|---|---|---|---|---|---|---|---|---|
|
Currently employed |
YouthBuild vs. Business as usual |
30 Months |
Survey sample;
|
44.30 |
41.90 |
No |
-- | ||
|
Employed in Year 1 |
YouthBuild vs. Business as usual |
30 Months |
Full sample;
|
48.90 |
51.30 |
No |
-- | ||
| Show Supplemental Findings | |||||||||
|
Ever employed |
YouthBuild vs. Business as usual |
48 Months |
Survey sample;
|
89.40 |
85.30 |
Yes |
|
||
|
Self-employed |
YouthBuild vs. Business as usual |
30 Months |
Survey sample;
|
11.10 |
9.40 |
No |
-- | ||
|
Working though a temp agency |
YouthBuild vs. Business as usual |
30 Months |
Survey sample;
|
7.10 |
6.00 |
No |
-- | ||
|
Currently employed |
YouthBuild vs. Business as usual |
48 Months |
Survey sample;
|
50.90 |
46.40 |
Yes |
|
||
|
Currently working full time (35 hours per week) at 30 months |
YouthBuild vs. Business as usual |
48 Months |
Survey sample;
|
32.50 |
29.40 |
No |
-- | ||
|
Employed in Year 2 |
YouthBuild vs. Business as usual |
30 Months |
Full sample;
|
62.90 |
59.70 |
Yes |
|
||
|
Ever employed since random assignment |
YouthBuild vs. Business as usual |
30 Months |
Survey sample;
|
80.20 |
77.80 |
No |
-- | ||
|
Employed in Year 3 |
YouthBuild vs. Business as usual |
48 Months |
Full sample;
|
68.40 |
66.30 |
Yes |
|
||
|
Currently employed |
YouthBuild vs. Business as usual |
12 Months |
Survey sample;
|
33.20 |
31.70 |
No |
-- | ||
|
Working though a temp agency |
YouthBuild vs. Business as usual |
12 Months |
Survey sample;
|
5.60 |
5.20 |
No |
-- | ||
|
Currently working full time (35 hours per week) at 30 months |
YouthBuild vs. Business as usual |
30 Months |
Survey sample;
|
25.10 |
24.70 |
No |
-- | ||
|
Self-employed |
YouthBuild vs. Business as usual |
48 Months |
Survey sample;
|
10.00 |
9.70 |
No |
-- | ||
|
Working though a temp agency |
YouthBuild vs. Business as usual |
48 Months |
Survey sample;
|
7.80 |
7.40 |
No |
-- | ||
|
Employed in quarter 10 |
YouthBuild vs. Business as usual |
30 Months |
Full sample;
|
44.40 |
44.80 |
No |
-- | ||
|
Currently working full time (35 hours per week) at 30 months |
YouthBuild vs. Business as usual |
12 Months |
Survey sample;
|
15.20 |
15.40 |
No |
-- | ||
|
Ever employed |
YouthBuild vs. Business as usual |
12 Months |
Survey sample;
|
54.50 |
55.90 |
No |
-- | ||
|
Employed in Year 4 |
YouthBuild vs. Business as usual |
48 Months |
Full sample;
|
71.60 |
73.30 |
No |
-- | ||
|
Self-employed |
YouthBuild vs. Business as usual |
12 Months |
Survey sample;
|
7.90 |
8.70 |
No |
-- | ||
|
Outcome measure |
Comparison | Period | Sample |
Intervention mean |
Comparison mean |
Significant? |
Improvement index |
Evidence tier |
|
|---|---|---|---|---|---|---|---|---|---|
|
Earned a high school diploma or GED |
YouthBuild vs. Business as usual |
30 Months |
Survey sample;
|
49.30 |
36.70 |
Yes |
|
|
|
| Show Supplemental Findings | |||||||||
|
Earned a GED |
YouthBuild vs. Business as usual |
12 Months |
Survey sample;
|
26.10 |
11.30 |
Yes |
|
||
|
Earned a GED |
YouthBuild vs. Business as usual |
30 Months |
Survey sample;
|
31.20 |
17.50 |
Yes |
|
||
|
Earned a high school diploma or GED |
YouthBuild vs. Business as usual |
12 Months |
Survey sample;
|
37.80 |
23.30 |
Yes |
|
||
|
Earned a GED |
YouthBuild vs. Business as usual |
48 Months |
Survey sample;
|
34.50 |
23.50 |
Yes |
|
||
|
Earned a high school diploma or GED |
YouthBuild vs. Business as usual |
48 Months |
Survey sample;
|
54.60 |
45.70 |
Yes |
|
||
|
Earned a high school diploma |
YouthBuild vs. Business as usual |
12 Months |
Survey sample;
|
11.70 |
12.10 |
No |
-- | ||
|
Earned a high school diploma |
YouthBuild vs. Business as usual |
30 Months |
Survey sample;
|
18.10 |
19.20 |
No |
-- | ||
|
Earned a high school diploma |
YouthBuild vs. Business as usual |
48 Months |
Survey sample;
|
20.10 |
22.10 |
No |
-- | ||
|
Outcome measure |
Comparison | Period | Sample |
Intervention mean |
Comparison mean |
Significant? |
Improvement index |
Evidence tier |
|
|---|---|---|---|---|---|---|---|---|---|
|
Earned license or certificate for work |
YouthBuild vs. Business as usual |
30 Months |
Survey sample;
|
4.10 |
2.10 |
Yes |
|
|
|
| Show Supplemental Findings | |||||||||
|
Earned license or certificate for work |
YouthBuild vs. Business as usual |
12 Months |
Survey sample;
|
3.30 |
1.00 |
Yes |
|
||
|
Earned license or certificate for work |
YouthBuild vs. Business as usual |
48 Months |
Survey sample;
|
5.30 |
3.40 |
No |
-- | ||
|
Outcome measure |
Comparison | Period | Sample |
Intervention mean |
Comparison mean |
Significant? |
Improvement index |
Evidence tier |
|
|---|---|---|---|---|---|---|---|---|---|
|
Patient Health Questionnaire (PHQ-9) Depression Subscale Binary Score |
YouthBuild vs. Business as usual |
12 Months |
Survey sample;
|
18.00 |
17.30 |
No |
-- | ||
|
Self-Confidence |
YouthBuild vs. Business as usual |
12 Months |
Survey sample;
|
3.00 |
2.90 |
No |
-- | ||
|
Rosenberg Self-Esteem Scale, based on student report |
YouthBuild vs. Business as usual |
12 Months |
Survey sample;
|
3.30 |
3.20 |
No |
-- | ||
|
Social Support |
YouthBuild vs. Business as usual |
12 Months |
Survey sample;
|
3.10 |
3.10 |
No |
-- | ||
| Show Supplemental Findings | |||||||||
|
Patient Health Questionnaire (PHQ-9) Depression Subscale Binary Score |
YouthBuild vs. Business as usual |
48 Months |
Survey sample;
|
16.90 |
18.10 |
No |
-- | ||
|
Patient Health Questionnaire (PHQ-9) Depression Subscale Binary Score |
YouthBuild vs. Business as usual |
30 Months |
Survey sample;
|
16.70 |
18.30 |
No |
-- | ||
|
Self-Confidence |
YouthBuild vs. Business as usual |
30 Months |
Survey sample;
|
3.00 |
3.00 |
No |
-- | ||
|
Rosenberg Self-Esteem Scale, based on student report |
YouthBuild vs. Business as usual |
30 Months |
Survey sample;
|
3.30 |
3.30 |
No |
-- | ||
|
Rosenberg Self-Esteem Scale, based on student report |
YouthBuild vs. Business as usual |
48 Months |
Survey sample;
|
3.30 |
3.30 |
No |
-- | ||
|
Self-Confidence |
YouthBuild vs. Business as usual |
48 Months |
Survey sample;
|
3.00 |
3.00 |
No |
-- | ||
|
Social Support |
YouthBuild vs. Business as usual |
30 Months |
Survey Sample;
|
3.10 |
3.10 |
No |
-- | ||
|
Social Support |
YouthBuild vs. Business as usual |
48 Months |
Survey Sample;
|
3.00 |
3.00 |
No |
-- | ||
|
Outcome measure |
Comparison | Period | Sample |
Intervention mean |
Comparison mean |
Significant? |
Improvement index |
Evidence tier |
|
|---|---|---|---|---|---|---|---|---|---|
|
Enrolled in high school or GED classes |
YouthBuild vs. Business as usual |
12 Months |
Survey sample;
|
64.30 |
54.90 |
Yes |
|
|
|
| Show Supplemental Findings | |||||||||
|
Currently enrolled in other secondary school |
YouthBuild vs. Business as usual |
12 Months |
Survey sample;
|
6.20 |
3.10 |
Yes |
|
||
|
Enrolled in high school or GED classes |
YouthBuild vs. Business as usual |
30 Months |
Survey sample;
|
65.30 |
59.30 |
Yes |
|
||
|
Currently enrolled in high school or GED classes |
YouthBuild vs. Business as usual |
12 Months |
Survey sample;
|
14.20 |
14.60 |
No |
-- | ||
|
Outcome measure |
Comparison | Period | Sample |
Intervention mean |
Comparison mean |
Significant? |
Improvement index |
Evidence tier |
|
|---|---|---|---|---|---|---|---|---|---|
|
Charged with a crime |
YouthBuild vs. Business as usual |
12 Months |
Survey sample;
|
16.20 |
15.30 |
No |
-- | ||
|
Arrested |
YouthBuild vs. Business as usual |
12 Months |
Survey sample;
|
18.40 |
16.90 |
No |
-- | ||
|
Convicted or found delinquent |
YouthBuild vs. Business as usual |
12 Months |
Survey sample;
|
9.80 |
8.40 |
No |
-- | ||
|
Incarceration |
YouthBuild vs. Business as usual |
12 Months |
Survey sample;
|
5.10 |
3.90 |
No |
-- | ||
| Show Supplemental Findings | |||||||||
|
Charged with a crime |
YouthBuild vs. Business as usual |
30 Months |
Survey sample;
|
24.80 |
23.70 |
No |
-- | ||
|
Arrested |
YouthBuild vs. Business as usual |
30 Months |
Survey sample;
|
27.60 |
26.40 |
No |
-- | ||
|
Charged with a crime |
YouthBuild vs. Business as usual |
48 Months |
Survey sample;
|
28.50 |
27.80 |
No |
-- | ||
|
Arrested |
YouthBuild vs. Business as usual |
48 Months |
Survey sample;
|
32.00 |
31.30 |
No |
-- | ||
|
Incarceration |
YouthBuild vs. Business as usual |
48 Months |
Survey sample;
|
11.70 |
10.80 |
No |
-- | ||
|
Convicted or found delinquent |
YouthBuild vs. Business as usual |
30 Months |
Survey sample;
|
15.70 |
14.10 |
No |
-- | ||
|
Convicted or found delinquent |
YouthBuild vs. Business as usual |
48 Months |
Survey sample;
|
19.80 |
17.40 |
No |
-- | ||
|
Incarceration |
YouthBuild vs. Business as usual |
30 Months |
Survey sample;
|
8.90 |
7.30 |
No |
-- | ||
Evidence Tier rating based solely on this study. This intervention may achieve a higher tier when combined with the full body of evidence.
Sample Characteristics
Characteristics of study sample as reported by study author.
-
Female: 36%
Male: 64% -
Rural, Suburban, Town, Urban
-
- B
- A
- C
- D
- E
- F
- G
- I
- H
- J
- K
- L
- P
- M
- N
- O
- Q
- R
- S
- V
- U
- T
- W
- X
- Z
- Y
- a
- h
- i
- b
- d
- e
- f
- c
- g
- j
- k
- l
- m
- n
- o
- p
- q
- r
- s
- t
- u
- v
- x
- w
- y
California, Colorado, District of Columbia, Georgia, Iowa, Illinois, Kansas, Kentucky, Louisiana, Massachusetts, Maine, Michigan, Minnesota, Missouri, Mississippi, North Carolina, New Jersey, New York, Ohio, Oklahoma, Oregon, Pennsylvania, South Carolina, Territories and Freely Associated States, U.S. Virgin Islands, Washington, Wisconsin, West Virginia
-
Race Black 63% Other or unknown 22% White 15% -
Ethnicity Hispanic 15% Not Hispanic or Latino 84% Other or unknown 1% -
Eligible for Free and Reduced Price Lunch Other or unknown 100%
Study Details
Setting
The study took place in 75 YouthBuild programs across the country. Programs were located in 29 states, the U.S. Virgin Islands, and Washington DC, and were found in both densely populated urban centers and rural areas. Roughly 50 percent of YouthBuild programs were concentrated in or near major metropolitan areas with populations of a million or more (for example, New York City and Los Angeles) while about 20 percent were located in rural areas with populations of less than 50,000.
Study sample
The study took place at YouthBuild centers across 29 states, serving youth who had withdrawn from secondary education. The initial sample comprised 3,929 participants between the ages of 16 and 24. Of the randomized sample, 2,700 were assigned to the intervention group and 1,229 to the comparison. Participants did not carry a credential or other identification of basic skills. Approximately 64% of the students were male, 11% had a diagnosed learning, physical disability, or specific disability, 90% had not graduated from high school or passed a high school equivalency exam, and 79% were under the age of 22. Sixty-three percent were Black, 15% were White, and 22% did not specify. The authors also included Hispanic in their breakdown for race, which was 15% of this sample.
Intervention Group
The YouthBuild program includes instruction in basic skills, remedial education, and alternative education that is designed to lead to a high school diploma or equivalent credential. The program, which was provided to cohorts of individual participants, included other opportunities like vocational training, youth development services, counseling, case management, life-skills training, workforce preparation, follow-up services, stipends, and help with child care, transportation, or housing. Eligibility is typically limited to out-of-school young people ages 16 to 24 who have dropped out before completing high school and who meet one of the following criteria: They are from low-income or migrant families, are in foster care or are aging out of it, are ex-offenders, have disabilities, or are children of incarcerated parents. The program starts with a Mental Toughness Orientation (MTO), designed to facilitate bonding and prepare participants for the YouthBuild program’s activities. This can last a single day to several weeks. It also serves as a period when individuals are screened out because they stop attending or otherwise fail to follow established rules. After completing MTO, individuals were randomly assigned to the YouthBuild program or the comparison group. The average participant spent about 7.7 months in YouthBuild. The program group reportedly spent about four months participating in services for education-related activities, job or training, or personal development. New participants start the program in a group setting with other enrollees, and that group alternates weekly or every few weeks between a focus on education and a focus on vocational training. Program sites varied in implementation, but generally included all core aspects of YouthBuild. The components of the model are intended to be combined and offered together. YouthBuild aims to increase participants’ basic skills and help them earn a GED or high school diploma. Participants can also accumulate work experience at the work sites, earn training credentials, and find jobs. YouthBuild also aims to have participants enroll in and complete college, maintain stable employment, earn more money, and have less involvement than their peers in the criminal justice system.
Comparison Group
For two years, members of the comparison group were prohibited from enrolling in YouthBuild programs that were participating in the study and given information about other appropriate services in the community. About 1% of learners in the comparison group enrolled in local YouthBuild programs that were not participating in the study. Prior to random assignment, all potential participants at most YouthBuild sites attended the Mental Toughness Orientation (MTO).
Support for implementation
The study does not provide specific information about support for implementation.
Additional Sources
In the case of multiple manuscripts that report on one study, the WWC selects one manuscript as the primary citation and lists other manuscripts that describe the study as additional sources.
-
Wiegand, Andrew; Manno, Michelle; Leshnick, Sengsouvanh; Treskon, Louisa; Geckeler, Christian; Lewis-Charp, Heather; Sinicrope, Castle; Clark, Mika; Nicholson, Brandon. (2015). Adapting to Local Context: Findings from the Youthbuild Evaluation Implementation Study. MDRC.
-
Miller, Cynthia; Cummings, Danielle; Millenky, Megan; Wiegand, Andrew; Long, David. (2018). Laying a Foundation: Four-Year Results from the National YouthBuild Evaluation. MDRC.
Publication
Review Details
Reviewed: September 2023
- Publication (findings for YouthBuild)
- Randomized Controlled Trial
- Meets WWC standards without reservations because it is a randomized controlled trial with low attrition.
This review may not reflect the full body of research evidence for this intervention.
Evidence Tier rating based solely on this study. This intervention may achieve a higher tier when combined with the full body of evidence.
Findings
|
Outcome measure |
Comparison | Period | Sample |
Intervention mean |
Comparison mean |
Significant? |
Improvement index |
Evidence tier |
|
|---|---|---|---|---|---|---|---|---|---|
|
Received a degree |
YouthBuild vs. Business as usual |
48 Months |
Full sample;
|
1.70 |
0.90 |
Yes |
|
|
|
| Show Supplemental Findings | |||||||||
|
Received a certificate |
YouthBuild vs. Business as usual |
48 Months |
Full sample;
|
1.20 |
0.60 |
No |
-- | ||
|
Received a Bachelor’s degree |
YouthBuild vs. Business as usual |
48 Months |
Full sample;
|
0.01 |
0.02 |
No |
-- | ||
|
Received an Associate's degree |
YouthBuild vs. Business as usual |
48 Months |
Full sample;
|
0.20 |
0.00 |
No |
-- | ||
|
Received a Master's degree |
YouthBuild vs. Business as usual |
48 Months |
Full sample;
|
0.10 |
0.00 |
No |
-- | ||
|
Outcome measure |
Comparison | Period | Sample |
Intervention mean |
Comparison mean |
Significant? |
Improvement index |
Evidence tier |
|
|---|---|---|---|---|---|---|---|---|---|
|
Received a degree |
YouthBuild vs. Business as usual |
30 Months |
Full sample;
|
0.01 |
0.01 |
Yes |
|
|
|
| Show Supplemental Findings | |||||||||
|
Received certificate |
YouthBuild vs. Business as usual |
30 Months |
Full sample;
|
1.10 |
0.40 |
Yes |
|
||
|
Received a Bachelor's degree |
YouthBuild vs. Business as usual |
30 Months |
Full sample;
|
0.10 |
0.20 |
No |
-- | ||
|
Received an Associate's degree |
YouthBuild vs. Business as usual |
30 Months |
Full sample;
|
0.20 |
0.00 |
No |
-- | ||
|
Received a Master's degree |
YouthBuild vs. Business as usual |
30 Months |
Full sample;
|
0.00 |
0.00 |
No |
-- | ||
|
Outcome measure |
Comparison | Period | Sample |
Intervention mean |
Comparison mean |
Significant? |
Improvement index |
Evidence tier |
|
|---|---|---|---|---|---|---|---|---|---|
|
Enrolled in a 2-year institution |
YouthBuild vs. Business as usual |
30 Months |
Full sample;
|
15.10 |
8.00 |
Yes |
|
|
|
|
Enrolled in any college |
YouthBuild vs. Business as usual |
48 Months |
Full sample;
|
21.30 |
12.70 |
Yes |
|
|
|
|
Enrolled in a 4-year institution |
YouthBuild vs. Business as usual |
30 Months |
Full sample;
|
3.00 |
2.40 |
No |
-- | ||
|
Enrolled in a less-than-2-year institution |
YouthBuild vs. Business as usual |
30 Months |
Full sample;
|
0.20 |
0.00 |
No |
-- | ||
| Show Supplemental Findings | |||||||||
|
Attended college part time |
YouthBuild vs. Business as usual |
30 Months |
Full sample;
|
10.10 |
3.90 |
Yes |
|
||
|
Attended college part time |
YouthBuild vs. Business as usual |
48 Months |
Full sample;
|
17.10 |
8.70 |
Yes |
|
||
|
Attended public college |
YouthBuild vs. Business as usual |
30 Months |
Full sample;
|
15.50 |
8.00 |
Yes |
|
||
|
Enrolled in a 2-year institution |
YouthBuild vs. Business as usual |
48 Months |
Full sample;
|
17.70 |
9.90 |
Yes |
|
||
|
Attended college full time |
YouthBuild vs. Business as usual |
30 Months |
Full sample;
|
7.60 |
4.90 |
Yes |
|
||
|
Attended college full time |
YouthBuild vs. Business as usual |
48 Months |
Full sample;
|
9.50 |
6.70 |
Yes |
|
||
|
Enrolled in a 4-year institution |
YouthBuild vs. Business as usual |
48 Months |
Full sample;
|
4.50 |
3.50 |
No |
-- | ||
|
Enrolled in private college |
YouthBuild vs. Business as usual |
30 Months |
Full sample;
|
2.70 |
2.40 |
No |
-- | ||
|
Enrolled in a less-than-2-year institution |
YouthBuild vs. Business as usual |
48 Months |
Full sample;
|
0.20 |
0.00 |
No |
-- | ||
|
Outcome measure |
Comparison | Period | Sample |
Intervention mean |
Comparison mean |
Significant? |
Improvement index |
Evidence tier |
|
|---|---|---|---|---|---|---|---|---|---|
|
Earnings in Year 4 |
YouthBuild vs. Business as usual |
48 Months |
Full sample;
|
6980.00 |
6729.00 |
No |
-- | ||
| Show Supplemental Findings | |||||||||
|
Earnings in Year 2 |
YouthBuild vs. Business as usual |
30 Months |
Full sample whose data were available in UI database;
|
3735.20 |
3936.70 |
No |
-- | ||
|
Earning in quarter 10 |
YouthBuild vs. Business as usual |
30 Months |
Full sample whose data were available in UI database;
|
1280.80 |
1277.00 |
No |
-- | ||
|
Earning in quarter 10 |
YouthBuild vs. Business as usual |
30 Months |
Female;
|
1100.00 |
1026.00 |
No |
-- | ||
|
Earning in quarter 10 |
YouthBuild vs. Business as usual |
30 Months |
Male;
|
1383.00 |
1418.00 |
No |
-- | ||
|
Earnings in Year 3 |
YouthBuild vs. Business as usual |
48 Months |
Full sample;
|
5442.00 |
5331.00 |
No |
-- | ||
|
Earning in quarter 10 |
YouthBuild vs. Business as usual |
30 Months |
Less than 11th grade;
|
1190.00 |
1094.00 |
-- |
-- | ||
|
Earning in quarter 10 |
YouthBuild vs. Business as usual |
30 Months |
11th grade or higher;
|
1399.00 |
1494.00 |
No |
-- | ||
|
Earnings in Year 4 |
YouthBuild vs. Business as usual |
48 Months |
Less than 11th grade;
|
6364.00 |
6239.00 |
No |
-- | ||
|
Earnings in Year 4 |
YouthBuild vs. Business as usual |
48 Months |
11th grade or higher;
|
7752.00 |
7386.00 |
-- |
-- | ||
|
Earnings in Year 4 |
YouthBuild vs. Business as usual |
4 Years |
Male;
|
7544.00 |
7091.00 |
No |
-- | ||
|
Earnings in Year 4 |
YouthBuild vs. Business as usual |
4 Years |
Female;
|
6029.00 |
6004.00 |
No |
-- | ||
|
Outcome measure |
Comparison | Period | Sample |
Intervention mean |
Comparison mean |
Significant? |
Improvement index |
Evidence tier |
|---|---|---|---|---|---|---|---|---|
|
Earnings in Year 1 |
YouthBuild vs. Business as usual |
30 Months |
Full sample whose data were available in UI database;
|
2093.40 |
2407.70 |
Yes |
-- |
|
Outcome measure |
Comparison | Period | Sample |
Intervention mean |
Comparison mean |
Significant? |
Improvement index |
Evidence tier |
|
|---|---|---|---|---|---|---|---|---|---|
|
Employed in Year 4 |
YouthBuild vs. Business as usual |
48 Months |
Full sample;
|
71.60 |
73.30 |
No |
-- | ||
| Show Supplemental Findings | |||||||||
|
Employed in Year 2 |
YouthBuild vs. Business as usual |
30 Months |
Full sample whose data were available in UI database;
|
62.90 |
59.70 |
Yes |
|
||
|
Employed in quarter 10 |
YouthBuild vs. Business as usual |
30 Months |
Less than 11th grade;
|
43.30 |
40.30 |
No |
-- | ||
|
Employed in Year 3 |
YouthBuild vs. Business as usual |
48 Months |
Full sample;
|
68.40 |
66.30 |
No |
-- | ||
|
Currently employed |
YouthBuild vs. Business as usual |
30 Months |
Female;
|
45.20 |
43.90 |
No |
-- | ||
|
Employed in quarter 10 |
YouthBuild vs. Business as usual |
30 Months |
Full sample;
|
44.40 |
44.80 |
No |
-- | ||
|
Currently employed |
YouthBuild vs. Business as usual |
30 Months |
Male;
|
44.10 |
45.40 |
No |
-- | ||
|
Employed in Year 4 |
YouthBuild vs. Business as usual |
48 Months |
11th grade or higher;
|
74.00 |
75.40 |
No |
-- | ||
|
Employed in Year 4 |
YouthBuild vs. Business as usual |
4 Years |
Male;
|
71.20 |
72.70 |
No |
-- | ||
|
Employed in Year 4 |
YouthBuild vs. Business as usual |
4 Years |
Female;
|
72.70 |
74.00 |
No |
-- | ||
|
Employed in Year 4 |
YouthBuild vs. Business as usual |
48 Months |
Less than 11th grade;
|
69.60 |
71.80 |
No |
-- | ||
|
Employed in quarter 10 |
YouthBuild vs. Business as usual |
30 Months |
11th grade or higher;
|
45.70 |
50.20 |
No |
-- | ||
|
Outcome measure |
Comparison | Period | Sample |
Intervention mean |
Comparison mean |
Significant? |
Improvement index |
Evidence tier |
|---|---|---|---|---|---|---|---|---|
|
Employed in Year 1 |
YouthBuild vs. Business as usual |
12 Months |
Full sample whose data were available in UI database;
|
48.90 |
51.30 |
No |
-- |
Evidence Tier rating based solely on this study. This intervention may achieve a higher tier when combined with the full body of evidence.
Sample Characteristics
Characteristics of study sample as reported by study author.
-
Female: 36%
Male: 64% -
Race Black 63% Other or unknown 22% White 15% -
Ethnicity Hispanic 15% Not Hispanic or Latino 85%
Study Details
Setting
The study took place in 75 YouthBuild programs across the country. Programs were located in 29 states, the U.S. Virgin Islands, and Washington DC, and were found both in both densely populated urban centers and rural areas.
Study sample
The initial sample consisted of 3,929 learners. These learners generally had to be between the ages of 16 and 24, have withdrawn from secondary education without a credential, have a referral from a high school, or have a deficiency in basic skills. Eligibility criteria varied depending on the YouthBuild program site. Sixty-three percent of learners were Black, and 64 percent were male. Ninety percent had not graduated from high school or passed a high school equivalency exam, and 79 percent were under the age of 22. The authors reported on outcome measures for the full sample as well as by gender and educational attainment subgroups, which met standards.
Intervention Group
The YouthBuild program includes instruction in basic skills, remedial education, and alternative education that is designed to lead to a high school diploma or equivalent credential. It also offers vocational training, which is typically training in construction, as well as youth development services including leadership training and community service. Supportive wraparound services could include counseling, case management, life-skills training, workforce preparation, follow-up services, stipends, and help with child care, transportation or housing.
Comparison Group
For two years, members of the comparison group were prohibited from enrolling in YouthBuild programs that were participating in the study and given information about other appropriate services in the community. About 1 percent of learners in the comparison group enrolled in local YouthBuild programs that were not participating in the study.
Support for implementation
The study does not provide specific information about support for implementation.
Additional Sources
In the case of multiple manuscripts that report on one study, the WWC selects one manuscript as the primary citation and lists other manuscripts that describe the study as additional sources.
-
Miller, Cynthia; Cummings, Danielle; Millenky, Megan; Wiegand, Andrew; Long, David. (2018). Laying a Foundation: Four-Year Results from the National YouthBuild Evaluation. MDRC.
-
Wiegand, Andrew; Manno, Michelle; Leshnick, Sengsouvanh; Treskon, Louisa; Geckeler, Christian; Lewis-Charp, Heather; Sinicrope, Castle; Clark, Mika; Nicholson, Brandon. (2015). Adapting to Local Context: Findings from the Youthbuild Evaluation Implementation Study. MDRC.
An indicator of the effect of the intervention, the improvement index can be interpreted as the expected change in percentile rank for an average comparison group student if that student had received the intervention.
For more, please see the WWC Glossary entry for improvement index.
An outcome is the knowledge, skills, and attitudes that are attained as a result of an activity. An outcome measures is an instrument, device, or method that provides data on the outcome.
A finding that is included in the effectiveness rating. Excluded findings may include subgroups and subscales.
The sample on which the analysis was conducted.
The group to which the intervention group is compared, which may include a different intervention, business as usual, or no services.
The timing of the post-intervention outcome measure.
The number of students included in the analysis.
The mean score of students in the intervention group.
The mean score of students in the comparison group.
The WWC considers a finding to be statistically significant if the likelihood that the finding is due to chance alone, rather than a real difference, is less than five percent.
The WWC reviews studies for WWC products, Department of Education grant competitions, and IES performance measures.
The name and version of the document used to guide the review of the study.
The version of the WWC design standards used to guide the review of the study.
The result of the WWC assessment of the study. The rating is based on the strength of evidence of the effectiveness of the intervention. Studies are given a rating of Meets WWC Design Standards without Reservations, Meets WWC Design Standards with Reservations, or >Does Not Meet WWC Design Standards.
A related publication that was reviewed alongside the main study of interest.
Study findings for this report.
Based on the direction, magnitude, and statistical significance of the findings within a domain, the WWC characterizes the findings from a study as one of the following: statistically significant positive effects, substantively important positive effects, indeterminate effects, substantively important negative effects, and statistically significant negative effects. For more, please see the WWC Handbook.
The WWC may review studies for multiple purposes, including different reports and re-reviews using updated standards. Each WWC review of this study is listed in the dropdown. Details on any review may be accessed by making a selection from the drop down list.
Tier 1 Strong indicates strong evidence of effectiveness,
Tier 2 Moderate indicates moderate evidence of effectiveness, and
Tier 3 Promising indicates promising evidence of effectiveness,
as defined in the
non-regulatory guidance for ESSA
and the regulations for ED discretionary grants (EDGAR Part 77).