Setting
The study was conducted in 44 secondary schools in nine school districts in eight states.
Study sample
The study included two cohorts of students in grades 6–12: one that participated in the 2009–10 school year, and one that participated in the 2010–11 school year. In each participating school, students were randomly assigned within “classroom matches” to either a class taught by a TNTP Teaching Fellows teacher or a class taught by a comparison teacher. A classroom match consisted of two or more classes covering the same eligible middle or high school math courses that were deemed comparable by the study authors based on factors such as level (for example, honors or regular), length (one or two semesters), and arrangements made for the inclusion of English learners and special education students. After 7,288 students (3,659 TNTP Teaching Fellows, 3,629 comparison) were randomly assigned, attrition occurred due to students leaving the school prior to the start of the school year, lack of parental consent, or students not having valid end-of-year mathematics achievement scores. The analytic sample included 4,116 students (2,127 TNTP Teaching Fellows, 1,989 comparison) taught by 153 teachers (69 TNTP Teaching Fellows, 84 comparison) in 44 schools. The mean age of the students was 14.3 years. Among the sample, 60% of students were in grades 9–12, 54% were female, 75% were eligible for free or reduced-price lunch, 7% were limited English proficient, and 6% had an individualized education plan. The racial/ethnic demographics were as follows: 50% were Black, 36% were Hispanic, 9% were Asian, 5% were White, and 1% were another race/ethnicity.
In addition, the authors present subgroup findings for school levels (middle or high school), years of teaching experience, and comparison group teachers’ route to certification (traditional or less selective alternative). The years of teaching experience comparisons include: (a) TNTP Teaching Fellows teachers in their first 3 years of teaching vs. non-TNTP Teaching Fellows teachers in their first 3 years of teaching, (b) TNTP Teaching Fellows teachers in their first 3 years of teaching vs. non-TNTP Teaching Fellows teachers with more than 3 years of experience, (c) TNTP Teaching Fellows teachers with more than 3 years of experience vs. non-TNTP Teaching Fellows teachers with more than 3 years of experience, and (d) TNTP Teaching Fellows teachers vs. non-TNTP Teaching Fellows teachers whose levels of teaching experience differ by no more than 2 years. The subgroup findings are reported in Appendix D. The supplemental findings do not factor into the intervention’s rating of effectiveness.
Intervention Group
Students were taught by TNTP Teaching Fellows teachers. The mean years of teaching experience at the end of the study year was 4.0. Among TNTP Teaching Fellows teachers, 72% had a bachelor’s degree from a most, highly, or very competitive college or university; 25% majored in math, none majored in secondary math education, and 33% majored in other math-related subjects. Regarding math content knowledge, the mean score was 158 among teachers who took the Praxis II Mathematics Content Knowledge Test (0.80 standard deviations higher than comparison teachers) and 187 among teachers who took the Praxis II Middle School Mathematics Test (0.92 standard deviations higher than comparison teachers). The mean age of TNTP Teaching Fellows teachers at the time of the study was 33.3 years, and 54% of TNTP Teaching Fellows teachers were female, 71% were White, 17% were Black, 9% were Hispanic, and 9% were Asian. The authors did not report any deviations from the TNTP Teaching Fellows model.
Comparison Group
Students in the comparison group were taught by teachers who did not enter teaching through TNTP Teaching Fellows, Teach For America, or other highly selective alternative routes to certification. The majority (73%) of comparison teachers entered teaching through a traditional route to certification (that is, they became certified teachers after completing a standard postsecondary program for teaching and related certification requirements), with the remainder entering through a less selective alternative route. The mean years of teaching experience at the end of the study year was 13.0. Among comparison teachers, 34% had a bachelor’s degree from a most, highly, or very competitive college or university; 43% majored in math, 13% majored in secondary math education, and 23% majored in other math-related subjects. Regarding math content knowledge, the mean score was 139 among teachers who took the Praxis II Mathematics Content Knowledge Test and 170 among teachers who took the Praxis II Middle School Mathematics Test. The mean age of comparison teachers at the time of the study was 41.0 years, and 57% of comparison teachers were female, 43% were White, 36% were Black, 19% were Asian, and 13% were Hispanic.
Support for implementation
Training provided to TNTP Teaching Fellows participants prior to their becoming classroom teachers consists of about 25 hours of independent study and a 4-hour orientation followed by an intensive 5- to 7-week summer institute that includes practice teaching in public summer school classrooms, coursework led by program and district staff, and program staff providing feedback after evaluating participants’ teaching performance. Of the eight TNTP Teaching Fellows programs in the study, three also provided a review of mathematical concepts in intensive summer “math immersion” programs for participants who otherwise might be ineligible to teach secondary math (for example, participants who lacked sufficient college math credits). After program participants begin teaching, TNTP Teaching Fellows staff provide about 10 hours of professional development in group sessions on topics such as classroom management, using data to inform instruction, and tailoring instruction for different students; conduct at least two formal classroom observations of each new teacher; hold at least two one-on-one meetings with each new teacher; and engage in informal check-in discussions or offer other support as needed. TNTP Teaching Fellows teachers also enrolled in local, state-authorized programs to complete the coursework required for certification.