WWC review of this study

Four-Year Degree and Employment Findings from a Randomized Controlled Trial of a One-Year Performance-Based Scholarship Program in Ohio

Mayer, Alexander K.; Patel, Reshma; Gutierrez, Melvin (2016). Journal of Research on Educational Effectiveness, v9 n3 p283-306. Retrieved from: https://eric.ed.gov/?id=EJ1106520

  • Randomized Controlled Trial
     examining 
    2,285
     Students
    , grade
    PS

Reviewed: May 2022

At least one finding shows strong evidence of effectiveness
At least one statistically significant positive finding
Meets WWC standards without reservations
College degree attainment (long-run) outcomes—Indeterminate effect found for the domain
Outcome
measure
Comparison Period Sample Intervention
mean
Comparison
mean
Significant? Improvement
    index
Evidence
tier

Received a certificate or degree

TANF Educational Awards Program (TEAP) vs. Business as usual

3 Years

Full sample;
2,285 students

34.60

32.90

No

--
Show Supplemental Findings

Received a certificate or degree

TANF Educational Awards Program (TEAP) vs. Business as usual

1 Year

Full sample;
2,285 students

20.50

17.20

Yes

 
 
5

Received a certificate or degree

TANF Educational Awards Program (TEAP) vs. Business as usual

2 Years

Full sample;
2,285 students

28.30

24.50

Yes

 
 
5
College degree attainment (short-run) outcomes—Indeterminate effect found for the domain
Outcome
measure
Comparison Period Sample Intervention
mean
Comparison
mean
Significant? Improvement
    index
Evidence
tier

Received a certificate or degree

TANF Educational Awards Program (TEAP) vs. Business as usual

0 Days

Full sample;
2,285 students

9.50

8.50

No

--
Earnings (long-run) outcomes—Indeterminate effect found for the domain
Outcome
measure
Comparison Period Sample Intervention
mean
Comparison
mean
Significant? Improvement
    index
Evidence
tier

Earnings from unemployment insurance-covered jobs

TANF Educational Awards Program (TEAP) vs. Business as usual

3 Years

Full sample;
2,285 students

11710.00

11645.00

No

--

Total earnings from unemployment insurance-covered jobs, fiscal quarters 2-20 ($)

TANF Educational Awards Program (TEAP) vs. Business as usual

3 Years

Full sample;
2,285 students

45474.00

45557.00

No

--
Show Supplemental Findings

Earnings from unemployment insurance-covered jobs

TANF Educational Awards Program (TEAP) vs. Business as usual

1 Year

Full sample;
2,285 students

7776.00

7751.00

No

--

Earnings from unemployment insurance-covered jobs

TANF Educational Awards Program (TEAP) vs. Business as usual

2 Years

Full sample;
2,285 students

9851.00

9425.00

No

--
Earnings (short-run) outcomes—Indeterminate effect found for the domain
Outcome
measure
Comparison Period Sample Intervention
mean
Comparison
mean
Significant? Improvement
    index
Evidence
tier

Earnings from unemployment insurance-covered jobs

TANF Educational Awards Program (TEAP) vs. Business as usual

0 Days

Full sample;
2,285 students

6073.00

6496.00

No

--
Employment (long-run) outcomes—Indeterminate effect found for the domain
Outcome
measure
Comparison Period Sample Intervention
mean
Comparison
mean
Significant? Improvement
    index
Evidence
tier

Percentage of quarters employed

TANF Educational Awards Program (TEAP) vs. Business as usual

3 Years

Full sample;
2,285 students

56.20

55.90

No

--

Employment

TANF Educational Awards Program (TEAP) vs. Business as usual

3 Years

Full sample;
2,285 students

70.50

71.00

No

--

Ever employed during fiscal quarters 2-20 (%)

TANF Educational Awards Program (TEAP) vs. Business as usual

3 Years

Full sample;
2,285 students

87.00

88.30

No

--
Show Supplemental Findings

Employment

TANF Educational Awards Program (TEAP) vs. Business as usual

2 Years

Full sample;
2,285 students

69.00

65.90

No

--

Employment

TANF Educational Awards Program (TEAP) vs. Business as usual

1 Year

Full sample;
2,285 students

65.60

64.90

No

--
Employment (short-run) outcomes—Indeterminate effect found for the domain
Outcome
measure
Comparison Period Sample Intervention
mean
Comparison
mean
Significant? Improvement
    index
Evidence
tier

Employment

TANF Educational Awards Program (TEAP) vs. Business as usual

0 Days

Full sample;
2,285 students

62.10

64.50

No

--
Progressing in College outcomes—Statistically significant positive effect found for the domain
Outcome
measure
Comparison Period Sample Intervention
mean
Comparison
mean
Significant? Improvement
    index
Evidence
tier

Percentage of students earning 12 or more credits

TANF Educational Awards Program (TEAP) vs. Business as usual

0 Days

Full sample;
2,285 students

28.80

18.30

Yes

 
 
14
 

Registered for any course

TANF Educational Awards Program (TEAP) vs. Business as usual

1 Year

Full sample;
2,285 students

68.80

66.60

No

--
Show Supplemental Findings

Percentage of students earning 12 or more credits

TANF Educational Awards Program (TEAP) vs. Business as usual

-1 Semesters

Full sample;
2,285 students

33.20

26.30

Yes

 
 
8

Registered for any course

TANF Educational Awards Program (TEAP) vs. Business as usual

3 Years

Full sample;
2,285 students

34.70

33.40

No

--

Registered for any course

TANF Educational Awards Program (TEAP) vs. Business as usual

2 Years

Full sample;
2,285 students

48.80

50.20

No

--


Evidence Tier rating based solely on this study. This intervention may achieve a higher tier when combined with the full body of evidence.

Characteristics of study sample as reported by study author.


  • Female: 86%
    Male: 14%

  • Suburban, Urban
    • B
    • A
    • C
    • D
    • E
    • F
    • G
    • I
    • H
    • J
    • K
    • L
    • P
    • M
    • N
    • O
    • Q
    • R
    • S
    • V
    • U
    • T
    • W
    • X
    • Z
    • Y
    • a
    • h
    • i
    • b
    • d
    • e
    • f
    • c
    • g
    • j
    • k
    • l
    • m
    • n
    • o
    • p
    • q
    • r
    • s
    • t
    • u
    • x
    • w
    • y

    Ohio
  • Race
    Black
    31%
    Other or unknown
    14%
    White
    55%
  • Ethnicity
    Hispanic    
    9%
    Not Hispanic or Latino    
    91%

Setting

This study was conducted at three community colleges in Ohio: Lorain County Community College, Owens Community College, and Sinclair Community College. These colleges cover three of Ohio’s four geographic corners.

Study sample

The majority of the sample was female (86%), married (79%), a parent (100%), and lived in households receiving government benefits (69%). The average age was 30 years. Students reported their race/ethnicity as white (55%), black (31%), Asian or Pacific Islander (1%), and Hispanic (9%). Just under half (49%) were currently unemployed, and the average adjusted gross income was $10,317.

Intervention Group

The Temporary Aid to Needy Families (TANF) Educational Awards Program (TEAP) was developed for low-income students, using surplus funds from the TANF program. TEAP offers scholarships to low-income students that supplement any other aid they receive. Full-time students could receive up to $1800 during a 1-year period: $900 per semester at Lorain and Owens, and $600 per quarter at Sinclair, if they received a grade of "C" or better in 12 or more credits. Part-time students could receive $450 per semester or $300 per quarter for achieving a "C" or better in 6 to 11 credits. Participating students could earn any combination of part-time award, full-time award, or no award over the duration of the program. Students received regular email and postcard reminders about the scholarship throughout the semester or quarter, and were paid at the end of each semester or quarter.

Comparison Group

Students in the comparison condition attended the same schools as those in the intervention condition, but received the colleges' regular services.

Support for implementation

Research staff visited each of the colleges once in spring 2009 and noted that site staff were tracking students' performance and disbursing awards according to the program model.

 

Your export should download shortly as a zip archive.

This download will include data files for study and findings review data and a data dictionary.

Connect With the WWC

loading
back to top