WWC review of this study

Career Academies: Impacts on Students' Engagement and Performance in High School.

Kemple, James J.; Snipes, Jason C. (2000). Retrieved from: https://eric.ed.gov/?id=ED441075

  • Randomized Controlled Trial
     examining 
    1,482
     Students
    , grades
    9-Adult

Reviewed: August 2023

At least one finding shows strong evidence of effectiveness
At least one statistically significant positive finding
Meets WWC standards without reservations
College Enrollment outcomes—Indeterminate effect found for the domain
Outcome
measure
Comparison Period Sample Intervention
mean
Comparison
mean
Significant? Improvement
    index
Evidence
tier

Researcher-developed measure of enrollment in a post-secondary education program

Career academies – Kemple et al. (2000) vs. Business as usual

14 Months

Full sample;
1,482 students

54.80

54.60

No

--
Show Supplemental Findings

Researcher-developed measure of enrollment in a post-secondary education program, skills training program

Career academies – Kemple et al. (2000) vs. Business as usual

14 Months

Full sample;
1,482 students

12.80

11.30

No

--

Researcher-developed measure of enrollment in a post-secondary education program

Career academies – Kemple et al. (2000) vs. Business as usual

8 Years

Full sample;
1,428 students

19.60

18.60

No

--

Researcher-developed measure of enrollment in a post-secondary education program, associate's degree program

Career academies – Kemple et al. (2000) vs. Business as usual

14 Months

Full sample;
1,482 students

27.30

27.80

No

--

Researcher-developed measure of enrollment in a post-secondary education program, bachelor's degree program

Career academies – Kemple et al. (2000) vs. Business as usual

14 Months

Full sample;
1,482 students

14.70

15.50

No

--
College Readiness outcomes—Indeterminate effect found for the domain
Outcome
measure
Comparison Period Sample Intervention
mean
Comparison
mean
Significant? Improvement
    index
Evidence
tier

Researcher-developed measure of submitting an application for a 2- or 4-year college

Career academies – Kemple et al. (2000) vs. Business as usual

0 Days

Full sample;
1,454 students

62.00

60.20

No

--
Earnings outcomes—Indeterminate effect found for the domain
Outcome
measure
Comparison Period Sample Intervention
mean
Comparison
mean
Significant? Improvement
    index
Evidence
tier

Researcher-developed measure of total annual earnings

Career academies – Kemple et al. (2000) vs. Business as usual

8 Years

Full sample;
1,404 students

28803.59

26042.80

No

--

Researcher-developed measure of average hourly wage

Career academies – Kemple et al. (2000) vs. Business as usual

1 Year

Full sample;
1,458 students

8.37

7.68

No

--

Researcher-developed measure of average monthly earnings

Career academies – Kemple et al. (2000) vs. Business as usual

1 Year

Full sample;
1,458 students

999.11

886.72

No

--
Show Supplemental Findings

Researcher-developed measure of average monthly earnings

Career academies – Kemple et al. (2000) vs. Business as usual

8 Years

Full sample;
1,404 students

2400.30

2170.23

--

--

Researcher-developed measure of average hourly wage

Career academies – Kemple et al. (2000) vs. Business as usual

8 Years

Full sample;
1,404 students

15.09

14.20

--

--
Employment outcomes—Indeterminate effect found for the domain
Outcome
measure
Comparison Period Sample Intervention
mean
Comparison
mean
Significant? Improvement
    index
Evidence
tier

Researcher-developed measure of ever being employed

Career academies – Kemple et al. (2000) vs. Business as usual

1 Year

Full sample;
1,458 students

85.00

82.10

No

--

Researcher-developed measure of number of months employed

Career academies – Kemple et al. (2000) vs. Business as usual

1 Year

Full sample;
1,458 students

8.00

7.50

No

--

Researcher-developed measure of average number of hours worked per week

Career academies – Kemple et al. (2000) vs. Business as usual

1 Year

Full sample;
1,458 students

24.70

23.00

No

--
Show Supplemental Findings

Researcher-developed measure of ever being employed full-time

Career academies – Kemple et al. (2000) vs. Business as usual

1 Year

Full sample;
1,458 students

69.20

65.90

No

--

Researcher-developed measure of ever being employed full-time

Career academies – Kemple et al. (2000) vs. Business as usual

8 Years

Full sample;
1,404 students

86.00

86.40

No

--

Researcher-developed measure of ever being employed

Career academies – Kemple et al. (2000) vs. Business as usual

8 Years

Full sample;
1,404 students

90.60

92.30

No

--

Researcher-developed measure of number of months employed

Career academies – Kemple et al. (2000) vs. Business as usual

8 Years

Full sample;
1,404 students

10.00

10.00

--

--

Researcher-developed measure of number of months employed full-time

Career academies – Kemple et al. (2000) vs. Business as usual

8 Years

Full sample;
1,404 students

9.20

8.80

--

--

Researcher-developed measure of average number of hours worked per week

Career academies – Kemple et al. (2000) vs. Business as usual

8 Years

Full sample;
1,404 students

35.20

34.30

--

--

Researcher-developed measure of number of months employed full-time

Career academies – Kemple et al. (2000) vs. Business as usual

1 Year

Full sample;
1,458 students

5.90

5.50

--

--
High School Completion outcomes—Indeterminate effect found for the domain
Outcome
measure
Comparison Period Sample Intervention
mean
Comparison
mean
Significant? Improvement
    index
Evidence
tier

Researcher-developed measure of earning a high school diploma

Career academies – Kemple et al. (2000) vs. Business as usual

14 Months

Full sample;
1,482 students

87.20

86.70

No

--
Show Supplemental Findings

Researcher-developed measure of earning a high school diploma, earned GED or other certificate

Career academies – Kemple et al. (2000) vs. Business as usual

14 Months

Full sample;
1,482 students

7.50

5.00

No

--

Researcher-developed measure of earning a high school diploma, late graduate

Career academies – Kemple et al. (2000) vs. Business as usual

14 Months

Full sample;
1,482 students

5.80

7.40

No

--

Researcher-developed measure of earning a high school diploma, earned GED or other certificate

Career academies – Kemple et al. (2000) vs. Business as usual

8 Years

Full sample;
1,428 students

12.10

10.00

No

--

Researcher-developed measure of earning a high school diploma, on-time graduate

Career academies – Kemple et al. (2000) vs. Business as usual

8 Years

Full sample;
1,428 students

74.70

73.30

No

--

Researcher-developed measure of earning a high school diploma, on-time graduate

Career academies – Kemple et al. (2000) vs. Business as usual

14 Months

Full sample;
1,482 students

74.00

74.00

No

--

Researcher-developed measure of earning a high school diploma, late graduate

Career academies – Kemple et al. (2000) vs. Business as usual

8 Years

Full sample;
1,428 students

9.00

10.30

No

--
Progressing in school (secondary school) outcomes—Statistically significant positive effect found for the domain
Outcome
measure
Comparison Period Sample Intervention
mean
Comparison
mean
Significant? Improvement
    index
Evidence
tier

Researcher-developed measure of the percentage of students who meet the total course credits for the graduation requirement

Career academies – Kemple et al. (2000) vs. Business as usual

0 Days

Full sample;
1,454 students

64.80

58.80

Yes

 
 
6
 
Staying in Secondary School outcomes—Indeterminate effect found for the domain
Outcome
measure
Comparison Period Sample Intervention
mean
Comparison
mean
Significant? Improvement
    index
Evidence
tier

Researcher-developed measure of dropping out of high school before the end of grade 12

Career academies – Kemple et al. (2000) vs. Business as usual

0 Days

Full sample;
1,454 students

10.10

12.40

No

--


Evidence Tier rating based solely on this study. This intervention may achieve a higher tier when combined with the full body of evidence.

Characteristics of study sample as reported by study author.


  • 8% English language learners

  • Female: 59%
    Male: 41%

  • Suburban, Town, Urban
    • B
    • A
    • C
    • D
    • E
    • F
    • G
    • I
    • H
    • J
    • K
    • L
    • P
    • M
    • N
    • O
    • Q
    • R
    • S
    • V
    • U
    • T
    • W
    • X
    • Z
    • Y
    • a
    • h
    • i
    • b
    • d
    • e
    • f
    • c
    • g
    • j
    • k
    • l
    • m
    • n
    • o
    • p
    • q
    • r
    • s
    • t
    • u
    • x
    • w
    • y

    California, District of Columbia, Florida, Maryland, Pennsylvania, Texas
  • Race
    Black
    29%
    Other or unknown
    64%
    White
    7%
  • Ethnicity
    Hispanic    
    57%
    Not Hispanic or Latino    
    43%
  • Eligible for Free and Reduced Price Lunch
    Other or unknown    
    100%

Setting

The study took place in 9 high schools, including one in the District of Columbia and others in large urban and small cities in Pennsylvania (1 school), Maryland (1 school), Florida (2 schools), Texas (1 school), and California (3 schools).

Study sample

The researchers randomly assigned 1,028 eligible students to the intervention group and 862 eligible students to the comparison group. A total of 1,482 students in grades 9 through 12 were included in the study. Approximately 59 percent of the students were female, 29 percent were Black, 7 percent were White, and 64 percent were Other or unknown. Fifty-seven percent were Hispanic. Eight percent of students were English language learners. The authors did not report on the percentage of students who received free or reduced price lunch.

Intervention Group

Career Academies is an academic and career development program for high school students that aims to increase their engagement and academic performance, while also providing students with the credentials and skills needed to successfully transition to post-secondary education and a career. Career Academies are small learning communities within high schools with about 50 to 75 students per grade. Students are taught by a team of about 3 to 5 teachers starting in grade 9 or 10 through grade 12. Career Academies provide students with academic and vocational courses that are based on a career theme. Students take at least three academic courses and at least one career- or occupation-related course per year. The curricula include a career theme that is based on local employment needs and demand for expertise, such as health professions, business and finance, electronics, travel and tourism, and information technology. Career Academies form partnerships with local employers to expose students to different career options and provide students with work-based learning opportunities. Through these partnerships, local employers sponsor a range of work- and career-related activities for students. Career Academies work with employer representatives to develop career-awareness and development activities, including field trips, job shadowing, and outside speakers from the business community.

Comparison Group

Most students in the comparison group received business-as-usual high school instruction, supports, and learning opportunities. However, about 7 percent of the comparison group students enrolled in a Career Academy at some point, and about 4 percent participated in Career Academies through high school graduation.

Support for implementation

All schools that were recruited for the study had implemented the Career Academies framework for at least two years prior to the beginning of the study. The teachers in the participating schools who taught the Career Academies model came from a variety of academic and vocational disciplines and had similar background characteristics as other teachers in the same high school who taught classes outside of the Career Academies.

In the case of multiple manuscripts that report on one study, the WWC selects one manuscript as the primary citation and lists other manuscripts that describe the study as additional sources.

  • Kemple, James J.; Rock, JoAnn Leah. (1996). Career Academies. Early Implementation Lessons from a 10-Site Evaluation.

  • Kemple, James J. (1997). Career Academies. Communities of Support for Students and Teachers: Emerging Findings from a 10-Site Evaluation.

  • Kemple, James J.; Poglinco, Susan M.; Snipes, Jason C. (1999). Career Academies: Building Career Awareness and Work-Based Learning Activities through Employer Partnerships.

  • Kemple, James J. (2004). Career Academies: Impacts on Labor Market Outcomes and Educational Attainment. MDRC.

  • Kemple, James J. (2001). Career Academies: Impacts on Students' Initial Transitions to Post-Secondary Education and Employment.

  • Kemple, J.J. (2008). Career Academies: Long-Term Impacts on Labor Market Outcomes, Educational Attainment, and Transitions to Adulthood. New York: MDRC. Retrieved from https://www.mdrc.org/sites/default/files/full_50.pdf.

  • Kemple, J.J. and Willner, C.J. (2008). Technical Resources for Career Academies: Long-Term Impacts on Labor Market Outcomes, Educational Attainment, and Transitions to Adulthood. New York: MDRC. Retrieved from: https://www.mdrc.org/sites/default/files/Technical%20Resources%20for%20Career%20Academies.pdf.

Reviewed: June 2023



Evidence Tier rating based solely on this study. This intervention may achieve a higher tier when combined with the full body of evidence.

Study sample characteristics were not reported.

Reviewed: September 2015

At least one finding shows strong evidence of effectiveness
At least one statistically significant positive finding
Meets WWC standards without reservations
Completing school outcomes—Statistically significant positive effect found for the domain
Outcome
measure
Comparison Period Sample Intervention
mean
Comparison
mean
Significant? Improvement
    index
Evidence
tier

Earned high school diploma or GED 8 years after projected date of graduation (%)

Career Academies vs. business as usual

2004

Full sample;
1,428 students

95.80

93.60

Yes

 
 
11
 
Progressing in school outcomes—Indeterminate effect found for the domain
Outcome
measure
Comparison Period Sample Intervention
mean
Comparison
mean
Significant? Improvement
    index
Evidence
tier

Total course credits

Career Academies vs. business as usual

End of 12th grade

Full sample;
1,379 students

22.30

21.80

No

--
Staying in School outcomes—Statistically significant positive effect found for the domain
Outcome
measure
Comparison Period Sample Intervention
mean
Comparison
mean
Significant? Improvement
    index
Evidence
tier

Dropped out of high school (%)

Career Academies vs. business as usual

End of 12th grade

Full sample;
1,454 students

10.10

12.40

Yes

 
 
6
 


Evidence Tier rating based solely on this study. This intervention may achieve a higher tier when combined with the full body of evidence.

Characteristics of study sample as reported by study author.


  • 8% English language learners

  • Female: 58%
    Male: 44%
    • B
    • A
    • C
    • D
    • E
    • F
    • G
    • I
    • H
    • J
    • K
    • L
    • P
    • M
    • N
    • O
    • Q
    • R
    • S
    • V
    • U
    • T
    • W
    • X
    • Z
    • Y
    • a
    • h
    • i
    • b
    • d
    • e
    • f
    • c
    • g
    • j
    • k
    • l
    • m
    • n
    • o
    • p
    • q
    • r
    • s
    • t
    • u
    • x
    • w
    • y

    California, District of Columbia, Florida, Maryland, Pennsylvania, Texas
  • Race
    Black
    30%
    Other or unknown
    7%
    White
    6%
  • Ethnicity
    Hispanic    
    56%
    Not Hispanic or Latino    
    44%

In the case of multiple manuscripts that report on one study, the WWC selects one manuscript as the primary citation and lists other manuscripts that describe the study as additional sources.

  • Kemple, J. J. (1997). Career Academies communities of support for students and teachers: Emerging findings from a 10-site evaluation. New York, NY: MDRC.

  • Kemple, James J. (2001). Career Academies: Impacts on Students' Initial Transitions to Post-Secondary Education and Employment.

  • Kemple, James J. (2004). Career Academies: Impacts on Labor Market Outcomes and Educational Attainment. MDRC.

  • Kemple, James J.; Rock, JoAnn Leah. (1996). Career Academies. Early Implementation Lessons from a 10-Site Evaluation.

  • Kemple, James J. (2004). Career Academies: Impacts on Labor Market Outcomes and Educational Attainment. MDRC.

Reviewed: February 2014

Does not meet WWC standards


Evidence Tier rating based solely on this study. This intervention may achieve a higher tier when combined with the full body of evidence.

Study sample characteristics were not reported.

Reviewed: September 2009



Evidence Tier rating based solely on this study. This intervention may achieve a higher tier when combined with the full body of evidence.

Study sample characteristics were not reported.

In the case of multiple manuscripts that report on one study, the WWC selects one manuscript as the primary citation and lists other manuscripts that describe the study as additional sources.

  • Kemple, James J.; Snipes, Jason C. (2000). Career Academies: Impacts on Students' Engagement and Performance in High School.

 

Your export should download shortly as a zip archive.

This download will include data files for study and findings review data and a data dictionary.

Connect With the WWC

loading
back to top