WWC review of this study

Evaluation of Green Dot's Locke Transformation Project: Findings for Cohort 1 and 2 Students. CRESST Report 815

Herman, Joan L.; Wang, Jia; Rickles, Jordan; Hsu, Vivian; Monroe, Scott; Leon, Seth; Straubhaar, Rolf (2012). National Center for Research on Evaluation, Standards, and Student Testing (CRESST). Retrieved from: https://eric.ed.gov/?id=ED531993

  • Quasi-Experimental Design
     examining 
    2,446
     Students
    , grades
    9-12

Reviewed: January 2018

At least one finding shows moderate evidence of effectiveness
At least one statistically significant positive finding
Meets WWC standards with reservations
English language arts achievement outcomes—Statistically significant positive effect found for the domain
Outcome
measure
Comparison Period Sample Intervention
mean
Comparison
mean
Significant? Improvement
    index
Evidence
tier

Year 1 California Standards Test (CST): ELA

Green Dot Public Schools vs. Business as usual

1 Year

Cohort 3;
930 students

312.00

303.55

Yes

 
 
7
 

Year 3 California Standards Test (CST): ELA

Green Dot Public Schools vs. Business as usual

3 Years

Cohort 1 and 2;
752 students

299.98

297.54

No

--

Year 2 Sample California High School Exit Exam (CAHSEE): ELA Scale Score

Green Dot Public Schools vs. Business as usual

2 Years

Cohort 1 and 2;
935 students

355.24

353.46

No

--
Show Supplemental Findings

Year 1 California Standards Test (CST): ELA

Green Dot Public Schools vs. Business as usual

1 Year

Cohort 1;
330 students

314.72

305.50

Yes

 
 
8

9th Grade Sample California High School Exit Exam (CAHSEE): % Ever Passed ELA

Green Dot Public Schools vs. Business as usual

4 Years

Cohort 2;
1,024 students

69.00

61.00

Yes

 
 
7

Year 3 Sample California High School Exit Exam (CAHSEE): % Passed ELA in any attempts

Green Dot Public Schools vs. Business as usual

3 Years

Cohort 2 non-pref;
616 students

79.00

73.00

No

--

Year 2 Sample California High School Exit Exam (CAHSEE): % Passed ELA on 1st attempt

Green Dot Public Schools vs. Business as usual

2 Years

Cohort 2;
724 students

59.00

51.00

No

--

Year 4 Sample California High School Exit Exam (CAHSEE): % Ever Passed ELA

Green Dot Public Schools vs. Business as usual

4 Years

Cohort 2;
496 students

94.00

90.00

No

--

Year 2 Sample California High School Exit Exam (CAHSEE): ELA Scale Score

Green Dot Public Schools vs. Business as usual

2 Years

Cohort 2 non-pref;
725 students

357.53

353.74

No

--

Year 2 Sample California High School Exit Exam (CAHSEE): % Passed ELA on 1st attempt

Green Dot Public Schools vs. Business as usual

2 Years

Cohort 2 non-pref;
725 students

60.00

54.00

No

--

Year 2 California Standards Test (CST): ELA

Green Dot Public Schools vs. Business as usual

2 Years

Cohort 2 non-pref;
786 students

299.13

295.14

No

--

Year 3 California Standards Test (CST): ELA

Green Dot Public Schools vs. Business as usual

3 Years

Cohort 2;
564 students

302.71

298.00

No

--

Year 2 Sample California High School Exit Exam (CAHSEE): ELA Scale Score

Green Dot Public Schools vs. Business as usual

2 Years

Cohort 2;
705 students

355.94

353.00

No

--

Year 2 California Standards Test (CST): ELA

Green Dot Public Schools vs. Business as usual

2 Years

Cohort 1;
242 students

303.29

300.01

No

--

Year 1 California Standards Test (CST): ELA

Green Dot Public Schools vs. Business as usual

1 Year

Cohort 2 non-pref;
978 students

304.50

301.57

No

--

Year 3 Sample California High School Exit Exam (CAHSEE): % Passed ELA in any attempts

Green Dot Public Schools vs. Business as usual

3 Years

Cohort 1;
187 students

76.00

73.00

No

--

Year 1 California Standards Test (CST): ELA

Green Dot Public Schools vs. Business as usual

1 Year

Cohort 2;
888 students

304.42

301.00

No

--

Year 2 California Standards Test (CST): ELA

Green Dot Public Schools vs. Business as usual

2 Years

Cohort 2;
724 students

299.82

296.00

No

--

Year 3 California Standards Test (CST): ELA

Green Dot Public Schools vs. Business as usual

3 Years

Cohort 2 non-pref;
622 students

301.52

298.48

No

--

Year 3 California Standards Test (CST): ELA

Green Dot Public Schools vs. Business as usual

3 Years

Cohort 1;
188 students

291.77

296.15

No

--

Year 2 Sample California High School Exit Exam (CAHSEE): ELA Scale Score

Green Dot Public Schools vs. Business as usual

2 Years

Cohort 1;
230 students

353.00

354.94

No

--

Year 4 Sample California High School Exit Exam (CAHSEE): % Ever Passed ELA

Green Dot Public Schools vs. Business as usual

4 Years

Cohort 1;
166 students

86.00

90.00

No

--

Year 2 Sample California High School Exit Exam (CAHSEE): % Passed ELA on 1st attempt

Green Dot Public Schools vs. Business as usual

2 Years

Cohort 1;
230 students

54.00

62.00

No

--
General Mathematics Achievement outcomes—Statistically significant positive effect found for the domain
Outcome
measure
Comparison Period Sample Intervention
mean
Comparison
mean
Significant? Improvement
    index
Evidence
tier

Year 3 California Standards Test (CST): Sum. Math

Green Dot Public Schools vs. Business as usual

3 Years

Cohort 1 and 2;
189 students

271.55

243.95

Yes

 
 
22
 

Year 1 California Standards Test (CST): Geometry

Green Dot Public Schools vs. Business as usual

1 Year

Cohort 1, 2 and 3;
385 students

286.84

272.58

Yes

 
 
14
 

Year 2 California Standards Test (CST): Algebra 2

Green Dot Public Schools vs. Business as usual

2 Years

Cohort 1 and 2;
295 students

270.21

254.16

Yes

 
 
14
 

Year 1 California Standards Test (CST): Algebra 1

Green Dot Public Schools vs. Business as usual

1 Year

Cohort 1, 2 and 3;
1,718 students

277.86

265.42

Yes

 
 
12
 

Year 3 California Standards Test (CST): Algebra 2

Green Dot Public Schools vs. Business as usual

3 Years

Cohort 1 and 2;
406 students

253.73

244.65

Yes

 
 
11
 

Year 2 Sample California High School Exit Exam (CAHSEE): Math Scale Score

Green Dot Public Schools vs. Business as usual

2 Years

Cohort 1 and 2;
927 students

361.49

354.84

Yes

 
 
8
 

Year 2 California Standards Test (CST): Geometry

Green Dot Public Schools vs. Business as usual

2 Years

Cohort 1 and 2;
559 students

255.78

250.09

Yes

 
 
7
 
Show Supplemental Findings

Year 3 California Standards Test (CST): Sum. Math

Green Dot Public Schools vs. Business as usual

3 Years

Cohort 2;
139 students

270.80

244.00

Yes

 
 
23

Year 1 California Standards Test (CST): Geometry

Green Dot Public Schools vs. Business as usual

1 Year

Cohort 1;
47 students

300.94

273.83

Yes

 
 
21

Year 1 California Standards Test (CST): Algebra 1

Green Dot Public Schools vs. Business as usual

1 Year

Cohort 3;
726 students

288.09

264.35

Yes

 
 
20

Year 3 California Standards Test (CST): Sum. Math

Green Dot Public Schools vs. Business as usual

3 Years

Cohort 1;
50 students

273.67

243.83

No

--

Year 3 California Standards Test (CST): Sum. Math

Green Dot Public Schools vs. Business as usual

3 Years

Cohort 2 non-pref;
151 students

269.89

247.65

Yes

 
 
19

Year 2 California Standards Test (CST): Geometry

Green Dot Public Schools vs. Business as usual

2 Years

Cohort 1;
151 students

257.38

244.31

Yes

 
 
17

Year 3 California Standards Test (CST): Algebra 2

Green Dot Public Schools vs. Business as usual

3 Years

Cohort 2 non-pref;
316 students

255.34

242.90

Yes

 
 
14

Year 1 California Standards Test (CST): Algebra 1

Green Dot Public Schools vs. Business as usual

1 Year

Cohort 1;
278 students

278.82

264.12

Yes

 
 
13

Year 3 Sample California High School Exit Exam (CAHSEE): % Passed Math in any attempts

Green Dot Public Schools vs. Business as usual

3 Years

Cohort 1;
187 students

84.00

70.00

Yes

 
 
13

Year 3 California Standards Test (CST): Algebra 2

Green Dot Public Schools vs. Business as usual

3 Years

Cohort 2;
300 students

256.01

245.00

Yes

 
 
13

Year 2 Sample California High School Exit Exam (CAHSEE): Math Scale Score

Green Dot Public Schools vs. Business as usual

2 Years

Cohort 2;
699 students

362.47

354.00

Yes

 
 
11

Year 2 California Standards Test (CST): Algebra 2

Green Dot Public Schools vs. Business as usual

2 Years

Cohort 2 non-pref;
247 students

268.16

256.79

Yes

 
 
10

Year 2 California Standards Test (CST): Algebra 2

Green Dot Public Schools vs. Business as usual

2 Years

Cohort 2;
229 students

267.99

257.00

Yes

 
 
10

Year 2 Sample California High School Exit Exam (CAHSEE): Math Scale Score

Green Dot Public Schools vs. Business as usual

2 Years

Cohort 2 non-pref;
719 students

361.73

354.74

Yes

 
 
9

Year 3 Sample California High School Exit Exam (CAHSEE): % Passed Math in any attempts

Green Dot Public Schools vs. Business as usual

3 Years

Cohort 2 non-pref;
616 students

82.00

73.00

Yes

 
 
9

Year 4 Sample California High School Exit Exam (CAHSEE): % Ever Passed math

Green Dot Public Schools vs. Business as usual

4 Years

Cohort 2;
496 students

96.00

91.00

Yes

 
 
8

9th Grade Sample California High School Exit Exam (CAHSEE): % Ever Passed Math

Green Dot Public Schools vs. Business as usual

4 Years

Cohort 2;
1,024 students

69.00

61.00

Yes

 
 
7

Year 1 California Standards Test (CST): Geometry

Green Dot Public Schools vs. Business as usual

1 Year

Cohort 3;
179 students

280.66

274.32

No

--

Year 2 Sample California High School Exit Exam (CAHSEE): % Passed math on 1st attempt

Green Dot Public Schools vs. Business as usual

2 Years

Cohort 2;
724 students

59.00

51.00

Yes

 
 
6

Year 3 California Standards Test (CST): Algebra 2

Green Dot Public Schools vs. Business as usual

3 Years

Cohort 1;
106 students

247.30

243.64

No

--

Year 2 Sample California High School Exit Exam (CAHSEE): % Passed math on 1st attempt

Green Dot Public Schools vs. Business as usual

2 Years

Cohort 2 non-pref;
726 students

61.00

55.00

No

--

Year 2 California Standards Test (CST): Geometry

Green Dot Public Schools vs. Business as usual

2 Years

Cohort 2 non-pref;
446 students

255.23

251.93

No

--

Year 2 California Standards Test (CST): Geometry

Green Dot Public Schools vs. Business as usual

2 Years

Cohort 2;
408 students

255.12

252.00

No

--

Year 1 California Standards Test (CST): Algebra 1

Green Dot Public Schools vs. Business as usual

1 Year

Cohort 2 non-pref;
795 students

266.88

266.11

No

--

Year 2 Sample California High School Exit Exam (CAHSEE): Math Scale Score

Green Dot Public Schools vs. Business as usual

2 Years

Cohort 1;
228 students

358.62

357.56

No

--

Year 1 California Standards Test (CST): Algebra 1

Green Dot Public Schools vs. Business as usual

1 Year

Cohort 2;
714 students

266.70

267.00

No

--

Year 2 Sample California High School Exit Exam (CAHSEE): % Passed math on 1st attempt

Green Dot Public Schools vs. Business as usual

2 Years

Cohort 1;
228 students

57.00

59.00

No

--

Year 4 Sample California High School Exit Exam (CAHSEE): % Ever Passed math

Green Dot Public Schools vs. Business as usual

4 Years

Cohort 1;
166 students

90.00

92.00

No

--
School Attendance outcomes—Statistically significant positive effect found for the domain
Outcome
measure
Comparison Period Sample Intervention
mean
Comparison
mean
Significant? Improvement
    index
Evidence
tier

School Attendance: Year 4

Green Dot Public Schools vs. Business as usual

4 Years

Cohort 1 and 2;
662 students

0.94

0.92

Yes

 
 
10
 

School Attendance: Year 1

Green Dot Public Schools vs. Business as usual

1 Year

Cohort 3;
916 students

0.94

0.94

No

--
Show Supplemental Findings

School Attendance: Year 4

Green Dot Public Schools vs. Business as usual

4 Years

Cohort 1;
166 students

0.94

0.91

No

--

School Attendance: Year 3

Green Dot Public Schools vs. Business as usual

3 Years

Cohort 1;
187 students

0.95

0.93

No

--

School Attendance: Year 4

Green Dot Public Schools vs. Business as usual

4 Years

Cohort 2;
496 students

0.94

0.93

No

--

School Attendance: Year 1

Green Dot Public Schools vs. Business as usual

1 Year

Cohort 1;
330 students

93.00

93.00

No

--

School Attendance: Year 1

Green Dot Public Schools vs. Business as usual

1 Year

Cohort 2 non-pref;
978 students

0.92

0.92

No

--

School Attendance: Year 2

Green Dot Public Schools vs. Business as usual

2 Years

Cohort 2 non-pref;
779 students

0.93

0.93

No

--

School Attendance: Year 3

Green Dot Public Schools vs. Business as usual

3 Years

Cohort 2 non-pref;
622 students

0.93

0.93

No

--

School Attendance: Year 1

Green Dot Public Schools vs. Business as usual

1 Year

Cohort 2;
888 students

0.93

0.93

No

--

School Attendance: Year 3

Green Dot Public Schools vs. Business as usual

3 Years

Cohort 2;
564 students

0.94

0.94

No

--

School Attendance: Year 2

Green Dot Public Schools vs. Business as usual

2 Years

Cohort 1;
242 students

93.00

94.00

No

--

School Attendance: Year 2

Green Dot Public Schools vs. Business as usual

2 Years

Cohort 2;
718 students

0.93

0.93

No

--
Student progression outcomes—Statistically significant positive effect found for the domain
Outcome
measure
Comparison Period Sample Intervention
mean
Comparison
mean
Significant? Improvement
    index
Evidence
tier

% Graduated: 9th Grade Entry Sample

Green Dot Public Schools vs. Business as usual

4 Years

Cohort 2;
1,024 students

54.00

40.00

Yes

 
 
11
 

% Graduated w/ A-G: 9th Grade Entry Sample

Green Dot Public Schools vs. Business as usual

4 Years

Cohort 2;
1,024 students

25.00

16.00

Yes

 
 
9
 
Show Supplemental Findings

% Graduated w/ A-G: Year 4 Sample

Green Dot Public Schools vs. Business as usual

1 Year

Cohort 1;
166 students

47.00

13.00

Yes

 
 
28

% Graduated: Year 4 Sample

Green Dot Public Schools vs. Business as usual

4 Years

Cohort 1;
166 students

79.00

55.00

Yes

 
 
20

% Graduated: Year 4 Sample

Green Dot Public Schools vs. Business as usual

1 Year

Cohort 2;
496 students

88.00

70.00

Yes

 
 
17

% Graduated w/ A-G: Year 4 Sample

Green Dot Public Schools vs. Business as usual

1 Year

Cohort 2;
496 students

44.00

27.00

Yes

 
 
14


Evidence Tier rating based solely on this study. This intervention may achieve a higher tier when combined with the full body of evidence.

Characteristics of study sample as reported by study author.


  • 48% English language learners

  • Female: 52%
    Male: 48%

  • Urban
    • B
    • A
    • C
    • D
    • E
    • F
    • G
    • I
    • H
    • J
    • K
    • L
    • P
    • M
    • N
    • O
    • Q
    • R
    • S
    • V
    • U
    • T
    • W
    • X
    • Z
    • Y
    • a
    • h
    • i
    • b
    • d
    • e
    • f
    • c
    • g
    • j
    • k
    • l
    • m
    • n
    • o
    • p
    • q
    • r
    • s
    • t
    • u
    • x
    • w
    • y

    California
  • Race
    Black
    24%
    Other or unknown
    76%
  • Ethnicity
    Hispanic    
    76%
    Not Hispanic or Latino    
    24%

Setting

The study took place in 11 urban high schools in the Los Angeles Unified School District (LAUSD) in Los Angeles, California. Eight schools were Green Dot Public Schools, and three were traditional LAUSD high schools.

Study sample

The study included three cohorts based on year of entry into high school. Cohort 1 entered ninth grade during the 2007–08 school year, Cohort 2 started during the 2008–09 school year, and Cohort 3 started during the 2009–10 school year. Beginning in the fall of 2007, Green Dot started converting a single, existing LAUSD high school into Green Dot Public Schools. This transition started with two off-site small schools in the first year. By fall 2008, the total neighborhood catchment and full student community that was previously associated with the original LAUSD school became students in eight Green Dot Public Schools. The study used a quasi-experimental design to match Green Dot Public Schools students to similar students in three traditional high schools who did not have the opportunity to attend the eight Green Dot Public Schools. The authors first identified a set of six LAUSD middle schools where the majority of students in Green Dot Public Schools had attended eighth grade and the corresponding three traditional high schools where most students in those middle schools started ninth grade. The students in these traditional high schools formed the pool of potential matches for students in Green Dot Public Schools. Each student enrolled in Green Dot Public Schools was matched exactly to another student from the same cohort enrolled in one of the traditional high schools based on whether they had the same gender, ethnicity, parents’ education, poverty status, language classification, math subject exam taken on the eighth grade California Standards Test (CST), and had attended middle school in the same set of feeder middle schools as students in Green Dot Public Schools. When more than one student was identified as a possible match, the authors selected one to be included in the comparison group using nearest-neighbor propensity score matching based on eighth-grade CST scale scores in math and ELA and on eighth-grade attendance rates. Across the three cohorts, 71%–88% of students were eligible for free or reduced-price lunch, 31%–46% were classified as English language learners, 6%–9% of students had a disability, 74%–79% were Latino, 21%–26% were African American, and 51%–52% were female.

Intervention Group

Students in the intervention condition attended one of eight high schools in the Green Dot Public Schools network. The schools in the intervention condition were previously a single traditional LAUSD school that Green Dot Public Schools converted into multiple charter schools over a 2-year period. The school was divided into two schools for the first year (the 2007–08 school year), and into eight schools for the second year (the 2008–09 school year).

Comparison Group

Students in the comparison condition attended one of three traditional LAUSD schools.

Support for implementation

The Green Dot Public Schools model emphasizes partnerships with parents, the school district, and the community. Teachers and principals are provided with recommended best practices to achieve the goals of the organization.

In the case of multiple manuscripts that report on one study, the WWC selects one manuscript as the primary citation and lists other manuscripts that describe the study as additional sources.

  • Rickles, J., Wang, J., Herman, J., & CRESST. (2013). Evaluation of Green Dot’s Locke Transformation Project: Supplemental report on Cohort 2 student outcomes (CRESST Report 825). Los Angeles, CA: National Center for Research on Evaluation, Standards, and Student Testing (CRESST).

  • Herman, Joan L.; Rickles, Jordan; Hansen, Mark; Thomas, Larry; Gualpa, Alice; Wang, Jia. (2011). Evaluation of Green Dot's Locke Transformation Project: Findings from the 2007-08, 2008-09, and 2009-10 School Years. CRESST Report 799. National Center for Research on Evaluation, Standards, and Student Testing (CRESST).

Reviewed: September 2017

No statistically significant positive
findings
Meets WWC standards with reservations
Staying in School outcomes—Indeterminate effect found for the domain
Outcome
measure
Comparison Period Sample Intervention
mean
Comparison
mean
Significant? Improvement
    index
Evidence
tier

Staying in school

Dropout Prevention vs. Business as usual

0 Days

Cohort 1, Year 4;
386 students

49.00

49.00

No

--
Show Supplemental Findings

Staying in school

Dropout Prevention vs. Business as usual

0 Days

Cohort 2, Year 3;
1,130 students

65.00

60.00

No

--


Evidence Tier rating based solely on this study. This intervention may achieve a higher tier when combined with the full body of evidence.

Characteristics of study sample as reported by study author.


  • 46% English language learners

  • Female: 52%
    Male: 48%

  • Urban
    • B
    • A
    • C
    • D
    • E
    • F
    • G
    • I
    • H
    • J
    • K
    • L
    • P
    • M
    • N
    • O
    • Q
    • R
    • S
    • V
    • U
    • T
    • W
    • X
    • Z
    • Y
    • a
    • h
    • i
    • b
    • d
    • e
    • f
    • c
    • g
    • j
    • k
    • l
    • m
    • n
    • o
    • p
    • q
    • r
    • s
    • t
    • u
    • x
    • w
    • y

    California
  • Race
    Black
    21%
  • Ethnicity
    Hispanic    
    79%
    Not Hispanic or Latino    
    21%

Setting

The study took place in several high schools in the Los Angeles Unified School District. There were 2 treatment schools for cohort I in 2007 and 8 treatment schools for cohort II in 2008. Comparison students were selected from three Los Angeles Unified School District (LAUSD) schools (Fremont, Jordan, or Washington Preparatory) identified as schools which students in GDL schools would have entered had they not entered the GDL school.

Study sample

The students were equally divided by gender, were predominately Latino (79% in cohort I and 74% in cohort II), and most were on free/reduced price lunch (84% in cohort I and 88% in cohort II). A sizeable proportion of the sample were English learners (46% in cohort I and 35% in cohort II) and about 10 percent had a disability.

Intervention Group

The intervention involved transformation of the Alain Leroy Locke High School in Los Angeles into a set of smaller college preparatory academies (2 for cohort I in 2007, and 8 for cohort II in 2008). In addition to the new school structure, the model included recommended practices for how principals and teachers should fulfill the tenets of the school reform organization. The six tenets are: 1) small, safe, personalized schools; 2) high expectations for all students; 3) local control with extensive professional development and accountability; 4) parent participation; 5) maximize funding to the classroom; and 6) keep schools open later.

Comparison Group

The control condition were students who attended other high schools in the district and who were matched using nearest-neighbor propensity scores to treatment student based on neighborhood and 8th grade characteristics. The matching variables were gender, ethnicity, parents' education, poverty status, English language classification, match achievement score, and attending a feeder school.

Support for implementation

Transformation of the school required approval by district Board of Education. Describes the process as requiring "dramatic scale-up" to take over an entire high school and the catchment area.

 

Your export should download shortly as a zip archive.

This download will include data files for study and findings review data and a data dictionary.

Connect With the WWC

loading
back to top