Search Results

This practice guide provides school educators and administrators with four evidence-based recommendations for reducing dropout rates in middle and high schools and improving high school graduation rates. Each recommendation provides specific, actionable strategies; examples of how to implement the recommended practices in schools; advice on how to overcome potential obstacles; and a description of the supporting evidence.

This practice guide presents three evidence-based recommendations for helping students in grades 6–12 develop effective writing skills. Each recommendation includes specific, actionable guidance for educators on implementing practices in their classrooms. The guide also summarizes and rates the evidence supporting each recommendation, describes examples to use in class, and offers the panel’s advice on how to overcome potential implementation obstacles. This guide is geared towards administrators and teachers in all disciplines who want to help improve their students’ writing.

This practice guide provides three recommendations for teaching algebra to students in middle school and high school. Each recommendation includes implementation steps and solutions for common roadblocks. The recommendations also summarize and rate supporting evidence. This guide is geared toward teachers, administrators, and other educators who want to improve their students’ algebra knowledge.

Access to higher education remains a challenge for many students who face academic and informational barriers to college entry.

Out-of-school time programs can enhance academic achievement by helping students learn outside the classroom.

Geared toward educators, administrators, and policymakers, this guide provides recommendations that focus on reducing high school dropout rates.

This guide presents strategies that classroom teachers and specialists can use to increase the reading ability of adolescent students.

The objective of this guide is to provide teachers with specific recommendations that can be carried out in the classroom without requiring systemic change.

This guide includes a set of concrete actions relating to the use of instructional and study time that are applicable to subjects that demand a great deal of content learning, including social studies, science, and mathematics.

This guide offers five recommendations to help educators effectively use data to monitor students’ academic progress and evaluate instructional practices.

This guide identifies practices that can improve the performance of chronically low-performing schools—a process commonly referred to as creating "turnaround schools."

Good Behavior Game is a classroom management strategy that aims to improve social skills, minimize disruptive behaviors, and create a positive learning environment. Teachers place students into teams and reward them for demonstrating appropriate behaviors and following classroom rules.

Class-Wide Function-Related Intervention Teams (CW-FIT) is a classroom management strategy designed to help teachers create a positive learning environment by decreasing disruptive behavior and improving social skills and prosocial behaviors among students.

The Knowledge is Power Program (KIPP) is a nationwide network of free open-enrollment college-preparatory schools in under-resourced communities throughout the United States. KIPP schools are usually established under state charter school laws and KIPP is America’s largest network of charter schools. KIPP Aims to prepare poor and minority students to succeed in a college preparatory curriculum. It provides training for principals and offers them greater autonomy over budget and hiring decisions. KIPP schools provide about 60% more instructional time than traditional public schools—through a longer school day and additional instructional days on Saturdays and in the summer.

Dual enrollment programs allow high school students to take college courses and earn college credits while still attending high school. Such programs, also referred to as dual credit or early college programs, are designed to boost college access and degree attainment, especially for students typically underrepresented in higher education. Dual enrollment programs support college credit accumulation and degree attainment via at least three mechanisms. First, allowing high school students to experience college-level courses helps them prepare for the social and academic requirements of college while having the additional supports available to high school students; this may reduce the need for developmental coursework. Second, students who accumulate college credits early and consistently are more likely to attain a college degree. Third, many dual enrollment programs offer discounted or free tuition, which reduces the overall cost of college and may increase the number of low socioeconomic status students who can attend and complete college.

READ 180® is a reading program designed for struggling readers who are reading 2 or more years below grade level. It combines online and direct instruction, student assessment, and teacher professional development. READ 180® is delivered in 90-minute sessions that include whole-group instruction, three small-group rotations, and whole-class wrap-up. Small-group rotations include individualized instruction using an adaptive computer application, small-group instruction, and independent reading. READ 180® is designed for students in elementary through high school.

Test preparation programs—sometimes referred to as test coaching programs—have been implemented with the goal of increasing student scores on college entrance tests. They generally (a) familiarize students with the format of the test; (b) introduce general test-taking strategies (e.g., get a good night’s sleep); (c) introduce specific testtaking strategies (e.g., whether the test penalizes incorrect answers, and what this means for whether or not one should guess an answer if it is not known); and (d) specific drills (e.g., practice factoring polynomial expressions). The programs can be delivered in person or online, and in whole class settings, in small groups, and individually.

Teach For America (TFA) is a highly selective route to teacher certification that aims to place non-traditionally trained teachers in high-need public schools. Many TFA teachers hold bachelors’ degrees from selective colleges and universities, in fields outside of education. TFA teachers commit to teach for at least 2 years. TFA teachers receive 5–7 weeks of in-person training over the summer before they begin teaching, then continue to receive professional development and one-on-one coaching from TFA while teaching, in addition to support provided by their schools and districts. As full-time employees of the public schools where they work, TFA teachers receive the same salary and benefits as other first- or second-year teachers in their school or district.

Cognitive Tutor^®, published by Carnegie Learning, is a math curricula that combines textbooks and interactive software.

Reading Apprenticeship® is a professional development program that aims to help teachers improve their students’ literacy skills. The program also aims to improve student social-emotional learning outcomes such as belonging, social awareness, growth mindset, and self-efficacy. Reading Apprenticeship® trains teachers to model reading comprehension strategies and help students practice these strategies in their classrooms.

The Pathway to Academic Success Project trains teachers to improve the reading and writing abilities of English learners who have an intermediate level of English proficiency by incorporating cognitive strategies into reading and writing instruction. The cognitive strategies include goal setting, tapping prior knowledge, asking questions, making predictions, articulating and revising understanding of text, and evaluating writing.

Balanced Leadership® is a professional development program for school principals and other current and aspiring school leaders in schools serving kindergarten through grade 12. School leaders participate in professional development sessions with trained facilitators over one or two years, practice what they learn between sessions, and can receive additional coaching and online support. McREL International, the company that developed the Balanced Leadership® program, based the framework and content of the professional development on research identifying key actions and behaviors of school leaders that are associated with improved student outcomes.

Green Dot Public Schools is a nonprofit organization that operates more than 20 public charter middle and high schools in California, Tennessee, and Washington. The Green Dot Public Schools are regulated and monitored by the local school district, but operate outside of the district’s direct control. The Green Dot Public Schools model emphasizes high quality teaching, strong school leadership, a curriculum that prepares students for college, and partnerships with the community. Any student may enroll in a Green Dot Public School if there is space available. Many Green Dot Public Schools operate with unionized teachers and staff. Several of the Green Dot Public Schools were chartered in existing public schools which were performing below district or community expectations. Funding for Green Dot Public Schools operations comes through public federal, state, and local finances, while some transformations of existing district-run schools into charter schools have been funded partly by private foundations.

Self-Regulated Strategy Development (SRSD) is an intervention designed to improve students’ academic skills through a six-step process that teaches students specific academic strategies and self-regulation skills. The practice is especially appropriate for students with learning disabilities. The intervention begins with teacher direction and ends with students independently applying the strategy, such as planning and organizing ideas before writing an essay. More specifically, the six steps involve the teacher providing background knowledge, discussing the strategy with the student, modeling the strategy, helping the student memorize the strategy, supporting the strategy, and then watching as the student independently performs the strategy. A key part of the process is teaching self-regulation skills, such as goal-setting and self-monitoring, which aim to help students apply the strategy without guidance. The steps can be combined, changed, reordered, or repeated, depending on the needs of the student. The SRSD model can be used with students in grades 2 through 12 in individual, small group, or whole classroom settings.

UCSMP is a core mathematics curriculum that emphasizes problem solving, real-world applications, and the use of technology. The curriculum is based on a student-centered approach with a focus on active learning that incorporates reading and uses a flexible lesson organization.

Career Academies are school-within-school programs operating in high schools. Students in Career Academies take both career-related and academic courses and acquire work experience through partnerships with local employers.

MyTeachingPartner–Secondary (MTP-S) is a professional development program that aims to increase student learning and development through improved teacher–student interactions. Through the program, middle and high school teachers access a video library featuring examples of high-quality interactions and receive individualized, web-based coaching approximately twice per month during the school year. MTP-S uses the secondary school version of the Classroom Assessment Scoring System®–Secondary (CLASS-S) to define and observe effective teaching practices.

Check & Connect is a dropout prevention strategy that relies on close monitoring of school performance, mentoring, case management, and other supports. The program has two main components: “Check” and “Connect.” The Check component is designed to continually assess student engagement through close monitoring of student performance and progress indicators. The Connect component involves program staff giving individualized attention to students, in partnership with school personnel, family members, and community service providers. Students enrolled in Check & Connect are assigned a “monitor” who regularly reviews their performance (in particular, whether students are having attendance, behavior, or academic problems) and intervenes when problems are identified. The monitor also advocates for students, coordinates services, provides ongoing feedback and encouragement, and emphasizes the importance of staying in school.

Repeated reading is an academic practice that aims to increase oral reading fluency. Repeated reading can be used with students who have developed initial word reading skills but demonstrate inadequate reading fluency for their grade level. During repeated reading, a student sits in a quiet location with a teacher and reads a passage aloud at least three times. Typically, the teacher selects a passage of about 50 to 200 words in length. If the student misreads a word or hesitates for longer than 5 seconds, the teacher reads the word aloud, and the student repeats the word correctly. If the student requests help with a word, the teacher reads the word aloud or provides the definition. The student rereads the passage until he or she achieves a satisfactory fluency level.

Core-Plus Mathematics is a 4-year curriculum that replaces the traditional sequence with courses that each feature interwoven strands of algebra and functions, statistics and probability, geometry and trigonometry, and discrete mathematics. The curriculum emphasizes mathematical modeling, using technology to emphasize reasoning with multiple representations (verbal, numerical, graphical, and symbolic) and to focus on goals in which mathematical thinking and problem solving are central. Instructional materials promote active learning and teaching centered around collaborative small-group investigations of problem situations, followed by teacher-led whole-class summarizing activities that lead to analysis, abstraction, and further application of underlying mathematical ideas.

Fast ForWord® is a computer-based reading program intended to help students develop and strengthen the cognitive skills necessary for successful reading and learning. The program, which is designed to be used 30 to 100 minutes a day, five days a week, for 4 to 16 weeks, includes two components.

Reading Apprenticeship® is a professional development program that aims to help teachers improve their students’ literacy skills. The program also aims to improve student social-emotional learning outcomes such as belonging, social awareness, growth mindset, and self-efficacy. Reading Apprenticeship® trains teachers to model reading comprehension strategies and help students practice these strategies in their classrooms.

New Chance, a program for young welfare mothers who have dropped out of school, aims to improve both their employment potential and their parenting skills. Participants take GED (General Educational Development) preparation classes and complete a parenting and life skills curriculum. Once they complete this first phase of the program, they can receive occupational training and job placement assistance from New Chance, which also offers case management and child care.

High School Redirection is an alternative high school program for youth considered at risk of dropping out. The program emphasizes basic skills development (with a particular focus on reading skills) and offers limited extra-curricular activities. The schools operate in economically disadvantaged areas and serve students who have dropped out in the past, who are teen parents, who have poor test scores, or who are over-age for their grade. To foster a sense of community, the schools are small, and teachers are encouraged to act as mentors as well as instructors.

Connect with Kids aims to promote prosocial attitudes and positive behavior of elementary (grades 3–5) and secondary (grades 6–12) school students by teaching core character values. Lesson plans include videos, story summaries, discussion questions, student games, and activities for both core and supplemental character traits. The classroom curriculum is reinforced by a website component and schoolwide and community outreach components. The program can be incorporated into an existing curriculum or used as a standalone program. The school or teacher decides on the number of character traits covered in each session, so the program duration may vary from one semester to an entire academic year.

Fast ForWord® is a computer-based reading program intended to help students develop and strengthen the cognitive skills necessary for successful reading and learning. The program, which is designed to be used 30 to 100 minutes a day, five days a week, for 4 to 16 weeks, includes two components.

Too Good for Drugs and Violence is designed to promote high school students’ pro-social skills, positive character traits, and violence- and drug-free norms. The curriculum consists of 14 core lessons, as well as an additional 12 lessons that can be infused into other subject areas (such as English, science, and social studies). Teachers participate in 10 staff development lessons. The program includes optional elements of family and community involvement.

Prentice Hall/Pearson Literature© (2007–15) is an English language arts curriculum designed for students in grades 6–12 that focuses on building reading, vocabulary, literary analysis, and writing skills. It uses passages from fiction and nonfiction texts, poetry, and contemporary digital media. The curriculum is based on a textbook. The publisher also provides online components and other materials that enable teachers to provide personalized assignments, monitor students’ progress, and score writing assignments, enrich instruction, or provide additional practice to supplement the textbook.

TNTP Teaching Fellows is a highly selective route to teacher certification that aims to prepare people to teach in high-need public schools. The program recruits professionals seeking to change careers and recent college graduates who are not certified teachers. TNTP Teaching Fellows expects its participants to teach for many years, but does not require them to make a minimum time commitment to teaching. Program participants complete online coursework and receive 5–7 weeks of in-person training focused on foundational teaching skills during the summer before they begin teaching. They must demonstrate mastery of these core skills to be eligible to teach. They receive continued professional development and coaching from TNTP Teaching Fellows during their first year of teaching, and additional support provided by their schools and districts. As full-time employees of the public schools in which they work, new TNTP Teaching Fellows teachers receive the same salary and benefits as other beginning teachers in their school district.

Cognitive Tutor^®, published by Carnegie Learning, is a math curricula that combines textbooks and interactive software.

TAP™ (formerly known as the Teacher Advancement Program) is a comprehensive educator effectiveness program that aims to improve student achievement through supports and incentives that attract, retain, develop, and motivate effective teachers. The program provides teachers with leadership opportunities and associated salary increases; ongoing, school-based professional development; rigorous evaluations; and annual performance bonuses based on a combination of teacher value added to student achievement and observations of their classroom teaching.

Reciprocal teaching is an interactive instructional practice that aims to improve students’ reading comprehension by teaching strategies to obtain meaning from a text. The teacher and students take turns leading a dialogue regarding segments of the text. Students discuss with their teacher how to apply four comprehension strategies—generating questions, summarizing, clarifying, and predicting—to passages of text. During the early stages of reciprocal teaching, the teacher assumes primary responsibility for modeling how to use these strategies. As students become more familiar with the strategies, there is a gradual shift toward student responsibility for talking through the application of the strategies to the text.

Fast ForWord® is a computer-based reading program intended to help students develop and strengthen the cognitive skills necessary for successful reading and learning. The program, which is designed to be used 30 to 100 minutes a day, five days a week, for 4 to 16 weeks, includes two components.

LANGUAGE!® is a language arts intervention designed for struggling learners in grades 3–12 who score below the 40th percentile on standardized literacy tests. The curriculum integrates English literacy acquisition skills into a six-step lesson format. During a daily lesson, students work on phonemic awareness and phonics (word decoding), word recognition and spelling (word encoding), vocabulary and morphology (word meaning), grammar and usage (understanding the form and function of words in context), listening and reading comprehension, and speaking and writing.

Check & Connect is a dropout prevention strategy that relies on close monitoring of school performance, mentoring, case management, and other supports. The program has two main components: “Check” and “Connect.” The Check component is designed to continually assess student engagement through close monitoring of student performance and progress indicators. The Connect component involves program staff giving individualized attention to students, in partnership with school personnel, family members, and community service providers. Students enrolled in Check & Connect are assigned a “monitor” who regularly reviews their performance (in particular, whether students are having attendance, behavior, or academic problems) and intervenes when problems are identified. The monitor also advocates for students, coordinates services, provides ongoing feedback and encouragement, and emphasizes the importance of staying in school.

Repeated reading is an academic practice that aims to increase oral reading fluency. Repeated reading can be used with students who have developed initial word reading skills but demonstrate inadequate reading fluency for their grade level. During repeated reading, a student sits in a quiet location with a teacher and reads a passage aloud at least three times. Typically, the teacher selects a passage of about 50 to 200 words in length. If the student misreads a word or hesitates for longer than 5 seconds, the teacher reads the word aloud, and the student repeats the word correctly. If the student requests help with a word, the teacher reads the word aloud or provides the definition. The student rereads the passage until he or she achieves a satisfactory fluency level.

Reciprocal teaching is an interactive instructional practice that aims to improve students’ reading comprehension by teaching strategies to obtain meaning from a text. The teacher and students take turns leading a dialogue regarding segments of the text. Students discuss with their teacher how to apply four comprehension strategies—generating questions, summarizing, clarifying, and predicting—to passages of text. During the early stages of reciprocal teaching, the teacher assumes primary responsibility for modeling how to use these strategies. As students become more familiar with the strategies, there is a gradual shift toward student responsibility for talking through the application of the strategies to the text.

AVID is a college-readiness program whose primary goal is to prepare middle and high school students for enrollment in 4-year colleges through increased access to and support in advanced courses. The program, which focuses on underserved, middle-achieving students (defined as students earning B, C, and even D grades), places students in college preparatory classes (e.g., honors and Advancement Placement classes) while providing academic support through a daily elective period and ongoing tutorials.

READ 180® is a reading program designed for struggling readers who are reading 2 or more years below grade level. It combines online and direct instruction, student assessment, and teacher professional development. READ 180® is delivered in 90-minute sessions that include whole-group instruction, three small-group rotations, and whole-class wrap-up. Small-group rotations include individualized instruction using an adaptive computer application, small-group instruction, and independent reading. READ 180® is designed for students in elementary through high school.

Middle College High Schools are alternative high schools located on college campuses that aim to help at-risk students complete high school and encourage them to attend college. The schools offer a project-centered, interdisciplinary curriculum with an emphasis on team teaching, individualized attention, and development of critical thinking skills. Students are also offered support services, including specialized counseling, peer support, and career experience opportunities.

First Things First is a reform model intended to transform elementary, middle, and high schools serving significant proportions of economically disadvantaged students. Its three main components are: (1) “small learning communities” of students and teachers; (2) a family and student advocate system that pairs staff members and students to monitor and support progress, and that serves as a bridge between the school and family; and (3) instructional improvements to make classroom teaching more rigorous and engaging and more closely aligned with state standards and assessments.

Project “Graduation Really Achieves Dreams” (GRAD) is an initiative for students in economically disadvantaged communities that aims to reduce dropping out and increase rates of college enrollment and graduation by increasing reading and math skills, improving behavior in school, and providing a service safety net. At the high school level, Project GRAD provides 4-year college scholarships and summer institutes to promote attending and completing high school. Project GRAD also provides services in the elementary and middle schools that feed into the participating high schools.

The Quantum Opportunity Program (QOP) is an intensive and comprehensive program for high school-aged youth that offers case management, mentoring, tutoring, and other education and support services. The program also offers financial incentives for participation in program activities. Participants enter QOP in grade 9 and can receive services for 4–5 years, even if they drop out of school or move to another district.

Talent Development High Schools is a school reform model for restructuring large high schools with persistent attendance and discipline problems, poor student achievement, and high dropout rates. The model includes both structural and curriculum reforms. It calls for schools to reorganize into small “learning communities”—including ninth-grade academies for first-year students and career academies for students in upper grades—to reduce student isolation and anonymity. It also emphasizes high academic standards and provides all students with a college preparatory academic sequence.

Core-Plus Mathematics is a 4-year curriculum that replaces the traditional sequence with courses that each feature interwoven strands of algebra and functions, statistics and probability, geometry and trigonometry, and discrete mathematics. The curriculum emphasizes mathematical modeling, using technology to emphasize reasoning with multiple representations (verbal, numerical, graphical, and symbolic) and to focus on goals in which mathematical thinking and problem solving are central. Instructional materials promote active learning and teaching centered around collaborative small-group investigations of problem situations, followed by teacher-led whole-class summarizing activities that lead to analysis, abstraction, and further application of underlying mathematical ideas.

Lions Quest Skills for Action, a program to build positive character values and life and citizenship skills for students in grades 9–12, includes classroom lessons and service learning. The program includes more than 100 lessons focused around 26 personal, social, and thinking skills. Program length ranges from one semester to 4 years. Students explore personal stories highlighting values and behavior through teachers’ questions, group discussion, and resource pages in the curricular materials. For service learning, students perform school-based or community-based projects and reflect on their experiences. Optional components include a student magazine, an Advisory Team, and supplemental units on drug use prevention.

The New York City P-TECH 9-14 schools are an educational model that ties together the secondary, higher education, and workforce systems to improve outcomes across domains. The distinguishing feature of the model is a partnership among a high school, a community college, and one or more employer partners that focuses on preparing students for both college and careers within six years. P-TECH 9-14 schools collaborate with local colleges to provide students with an opportunity to earn a high school diploma within four years, followed by a cost-free, industry-recognized associate's degree. During the six-year program, employer partners provide students with work-based learning experiences such as internships, mentoring, and job shadowing. This evaluation provides the first rigorous evidence about the effects of the P-TECH 9-14 model on student outcomes. The study uses a lottery-based random assignment design that takes advantage of the nature of the New York City high school admissions process, in which students were randomly offered or not offered an opportunity to attend a P-TECH 9-14 school. This study has also investigated how P-TECH 9-14 schools implemented the elements of the model, and where implementation varied among schools, and has conducted a cost and cost-effectiveness analysis, which assesses the impacts relative to the cost of obtaining them. [For the Executive Summary, see ED632481.]

Following up on a previous impact study of Early Colleges (EC) based on retrospective admission lotteries, this study assessed longer-term impacts on students' postsecondary outcomes with 4 more years of data. The study found that students who won EC admission lotteries were significantly more likely to enroll in college, enroll in 2-year colleges, complete a college degree, complete associate's degrees or certificates, and complete bachelor's degrees within 6 years after expected high school graduation than control students. Moreover, it found that treatment students completed postsecondary degrees earlier and faster than control students. Consistent with EC's focus on college exposure during high school, the EC impacts on college enrollment and the completion of associate's degrees largely occurred within high school. The study also found that EC impacts did not vary significantly by students' demographic characteristics; however, some impacts were significantly stronger for students with higher levels of prior achievement.

The Linking Learning to Careers (LLC) program offered high school students with disabilities an individualized and targeted approach to strategically plan for their futures. The Vermont Division of Vocational Rehabilitation (DVR) designed LLC to build on its usual services for high school students to emphasize unpaid and paid work-based learning experiences (WBLEs) in integrated environments, college exploration and coursework opportunities at the Community College of Vermont, team-based guidance and support from DVR staff, dedicated support for assistive technology, and additional transportation funding. To support a rigorous evaluation, DVR relied on a randomized controlled trial design, recruiting 803 participants to participate. This report presents evidence on LLC's impacts up to two years after students enrolled in the program. The demonstration had impacts on services and education that were consistent with the LLC model and findings from the implementation evaluation. However, the program did not have consistent impacts on employment. [Mathematica prepared this report under contract to the Vermont Division of Vocational Rehabilitation under a grant from the U.S. Department of Education.]

There is a need for rigorous experimental research on restorative practices in schools as a means to reduce exclusionary discipline and the disproportionate sanctioning of Black students, male students, and students with disabilities. The current study addressed this need in its evaluation of Morningside Center for Teaching Social Responsibility's Whole School Restorative Practices (RP) Project. The study was conducted in a large Northeastern city using a cluster randomized control experimental design in 18 elementary, middle, and high schools. The RP Project was a 2-year initiative which was interrupted in its second year of implementation given the global health pandemic and the shift to remote schooling. After two years, it was anticipated that the nine RP project schools, relative to nine comparison schools, would have lower discipline incidents and narrowed discipline disparities across subgroups. Given the pandemic disruption, the effects of one year of implementation were examined despite that change was anticipated after two years. The 5,878 student sample was drawn from discipline incident record data provided by the public school district. After only one year of implementation, the study found that overall, students in the RP Project schools were less likely to receive a discipline incident record (11.1%) compared to students in the comparison schools (18.2%). In the single year of the two-year project, no differential effects of the intervention were noted based on student race, gender, or disability status. Given the project anticipated change after two years, the reduction in discipline incidents was striking. Future research will need to examine whether reducing incidents in year one of implementation sets the stage for narrowed discipline disparities in year two.

Early colleges are a new model of schooling in which the high school and college experiences are merged, shortening the total amount of time a student spends in school. This study uses a lottery-based experimental design to examine the impact of the model on longer term outcomes, including attainment of a postsecondary credential and academic performance in 4-year institutions. Results show that a significantly higher proportion of early college students were attaining postsecondary credentials. The results also show that early college students were completing their degrees more rapidly but that their performance in 4-year institutions was still comparable with the control students. [For the corresponding grantee submission, see ED604350.]

Developed in response to concerns that too few students were enrolling and succeeding in postsecondary education, early college high schools are small schools that blur the line between high school and college. This article presents results from a longitudinal experimental study comparing outcomes for students accepted to an early college through a lottery process with outcomes for students who were not accepted through the lottery and enrolled in high school elsewhere. Results show that treatment students attained significantly more college credits while in high school, and graduated from high school, enrolled in postsecondary education, and received postsecondary credentials at higher rates. Results for subgroups are included. [This paper was published in the "Journal of Research on Educational Effectiveness" (EJ1135800)]

Developed in response to concerns that too few students were enrolling and succeeding in postsecondary education, early college high schools are small schools that blur the line between high school and college. This article presents results from a longitudinal experimental study comparing outcomes for students accepted to an early college through a lottery process with outcomes for students who were not accepted through the lottery and enrolled in high school elsewhere. Results show that treatment students attained significantly more college credits while in high school, and graduated from high school, enrolled in postsecondary education, and received postsecondary credentials at higher rates. Results for subgroups are included.

This report presents the findings from an efficacy trial and process evaluation of the Parent Engagement Programme (PEP). The PEP was a school-level intervention designed to improve pupil outcomes by engaging parents in their children's learning. The programme was developed collaboratively by research teams from the University of Bristol and Harvard University and was delivered between September 2014 and July 2015. The study was conducted by the Centre for Effective Education, Queen's University Belfast between February 2014 and February 2016. The trial involved 15,697 students in Years 7, 9, and 11 from 36 English secondary schools, with schools sending an average of 30 texts to each parent over the period of the trial. The developers of the intervention managed its delivery to ensure optimal implementation. It was a cluster randomised controlled trial with randomisation at the Key Stage level, designed to determine the impact of the intervention on the academic outcomes of students in English, maths, and science, and the impact on absenteeism. A process evaluation used focus groups, telephone surveys, interviews, and an online survey to provide data on implementation and to capture the perceptions and experiences of participating parents, pupils, and teachers. Key conclusions include: (1) Children who had the intervention experienced about one month of additional progress in maths compared to other children. This positive result is unlikely to have occurred by chance; (2) Children who had the intervention had reduced absenteeism compared to other children. This positive result is unlikely to have occurred by chance; (3) Children who had the intervention appeared to experience about one month of additional progress in English compared to other children. However, analysis suggests that this finding might have been affected by bias introduced by missing data, so evaluators cannot reliably draw this conclusion. There is no evidence to suggest that the intervention had an impact on science attainment; (4) Schools embraced the programme and liked its immediacy and low cost. Many respondents felt that the presence of a dedicated coordinator would be valuable to monitor the accuracy and frequency of texts. Schools should consider whether they would be able to provide this additional resource; and (5) The vast majority of parents were accepting of the programme, including the content, frequency, and timing of texts. [Note: The post-reporting appendix was added in June 2017.]

This study examined the efficacy of a curriculum-based intervention for high school science students. Specifically, the intervention was two years of research-based, multidisciplinary curriculum materials for science supported by comprehensive professional development for teachers that focused on those materials. A modest positive effect was detected when comparing outcomes from this intervention to those of business-as-usual materials and professional development. However, this effect was typical for interventions at this grade span that are tested using a state achievement test. Tests of mediation suggest a large treatment effect on teachers and in turn a strong effect of teacher practice on student achievement--reinforcing the hypothesized key role of teacher practice. Tests of moderation indicate no significant treatment by demographic interactions.

This study presents findings from three cohorts of students--the classes of 2003, 2004, and 2005, in the School District of Philadelphia--that were admitted to the district's career and technical education (CTE) schools through a randomized lottery process. This study takes advantage of this so-called "'natural experiment' to compare high school academic outcomes for" lottery applicants who were admitted with those for students who did not receive an acceptance. Results find that CTE students had significantly better outcomes in terms of graduation rates, credit accumulation, and the successful completion of the college preparatory mathematics sequence algebra 1, algebra 2, and geometry. Results for other outcomes such as the completion of science and foreign language course sequences, overall grade point average, and mathematics and reading comprehension achievement, were inconsistent across cohorts and statistical tests, neither favoring nor against students accepted to CTE schools.

One of the most important questions in education research is whether the gains from interventions for which perceived short-term success can be sustained. The possibility of short-lived impacts is especially relevant for research on charter schools, where charter operators who face high-stakes assessments have an incentive to "teach to the test." The fact that charters are subject to intense scrutiny and evaluation may even create incentives for cheating (Jacob and Levitt, 2003), strategic instruction (Jacob, 2007), and a focus on small groups of students that are pivotal for official accountability measures (Neal and Schanzenbach, 2010). The purpose of this paper is to assess the impact of attendance at Boston's charter high schools on outcomes where the link with human capital and future earnings seems likely to be sustained and strong. Specifically, the authors focus on outcomes that are either essential to or facilitate post-secondary schooling: high school graduation, the attainment of state competency thresholds, scholarship qualification, Advanced Placement (AP) and SAT scores, college enrollment, and college persistence. Importantly, most of these outcomes are less subject to strategic manipulation than are the state's test-based assessments. As in earlier work, the research design implemented here exploits randomized enrollment lotteries at oversubscribed charter schools. The resulting estimates are likely to provide reliable measures of average causal effects for charter applicants. Six tables are appended.

Teach For America (TFA) and the Teaching Fellows programs are an important and growing source of teachers of hard-to-staff subjects in high-poverty schools, but comprehensive evidence of their effectiveness has been limited. This report presents findings from the first large-scale random assignment study of secondary math teachers from these programs. The study separately examined the effectiveness of TFA and Teaching Fellows teachers, comparing secondary math teachers from each program with other secondary math teachers teaching the same math courses in the same schools. The study focused on secondary math because this is a subject in which schools face particular staffing difficulties.The study had two main findings, one for each program studied: (1) TFA teachers were more effective than the teachers with whom they were compared. On average, students assigned to TFA teachers scored 0.07 standard deviations higher on end-of-year math assessments than students assigned to comparison teachers, a statistically significant difference. This impact is equivalent to an additional 2.6 months of school for the average student nationwide; and (2) Teaching Fellows were neither more nor less effective than the teachers with whom they were compared. On average, students of Teaching Fellows and students of comparison teachers had similar scores on end-of-year math assessments. By providing rigorous evidence on the effectiveness of secondary math teachers from TFA and the Teaching Fellows programs, the study can shed light on potential approaches for improving teacher effectiveness in hard-to-staff schools and subjects. The study findings can provide guidance to school principals faced with the choice of hiring teachers who have entered the profession via different routes to certification. The findings can also aid policymakers and funders of teacher preparation programs by providing information on the effectiveness of teachers from various routes to certification that use different methods to identify, attract, train, and support their teachers. Seven appendixes present: (1) Supplementary Technical Information on Study Design and Data Collection; (2) Supplementary Information on Analytic Methods; (3) Supplementary Information on Teach For America and Teaching Fellows Programs; (4) Teach For America and Teaching Fellows Teachers Compared with Comparison Teachers by Entry Route (Alternative or Traditional); (5) Supplementary Information on Teach For America and Teaching Fellows Teachers Compared with Comparison Teachers; (6) Supplementary Analyses of the Impacts of Teach For America and Teaching Fellows Teachers; and (7) Supplementary Findings on Factors Associated with Teacher Effectiveness. (Contains 96 tables, 21 figures, and 30 footnotes.)

In 2002, the Bill & Melinda Gates Foundation launched the Early College High School Initiative (ECHSI) with the primary goal of increasing the opportunity for underserved students to earn a postsecondary credential. To achieve this goal, Early Colleges provide underserved students with exposure to, and support in, college while they are in high school. Early Colleges partner with colleges and universities to offer all students an opportunity to earn an associate's degree or up to two years of college credits toward a bachelor's degree during high school at no or low cost to the students. The underlying assumption is that engaging underrepresented students in a rigorous high school curriculum tied to the incentive of earning college credit will motivate them and increase their access to additional postsecondary education and credentials after high school. Since 2002, more than 240 Early Colleges have opened nationwide. This study focused on the impact of Early Colleges. It addressed two questions: (1) Do Early College students have better outcomes than they would have had at other high schools?; and (2) Does the impact of Early Colleges vary by student background characteristics (e.g., gender and family income)? To answer these questions, the authors conducted a lottery-based randomized experiment, taking advantage of the fact that some Early Colleges used lotteries in their admissions processes. By comparing the outcomes for students who participated in admissions lotteries and were offered enrollment with the outcomes for students who participated in the lotteries but were not offered enrollment, they can draw causal conclusions about the impact of Early Colleges. The primary student outcomes for this study were high school graduation, college enrollment, and college degree attainment. The authors also examined students' high school and college experiences. Data on student background characteristics and high school outcomes came from administrative records from schools, districts, and states; data on college outcomes came from the National Student Clearinghouse (NSC); and data on high school and college experiences and intermediate outcomes such as college credit accrual came from a student survey. The authors assessed the impact of Early Colleges on these outcomes for a sample of 10 Early Colleges that did the following: (1) Enrolled students in grades 9-12 and had high school graduates in the study years (2005-2011); (2) Used lotteries as part of the admission processes in at least one of the study cohorts (students who entered ninth grade in 2005-06, 2006-07, or 2007-08); and (3) Retained the lottery records. Eight of the 10 Early Colleges in the study were included in the student survey. The overall study sample included 2,458 students and the survey sample included 1,294 students. The study extended through three years past high school.

In 2002, New York City embarked on an ambitious and wide-ranging series of education reforms. At the heart of its high school reforms were three interrelated changes: the institution of a district wide high school choice process for all rising ninth-graders, the closure of 31 large, failing high schools with an average graduation rate of 40 percent, and the opening of more than 200 new small high schools. Over half of the new small schools created between the fall of 2002 and the fall of 2008 were intended to serve students in some of the district's most disadvantaged communities and are located mainly in neighborhoods where large, failing high schools had been closed. MDRC has previously released two reports on these "small schools of choice," or SSCs (so called because they are small, are academically nonselective, and were created to provide a realistic choice for students with widely varying academic backgrounds). Those reports found marked increases in progress toward graduation and in graduation rates for the cohorts of students who entered SSCs in the falls of 2005 and 2006. The second report also found that the increase in graduation rates applied to every student subgroup examined, and that SSC graduation effects were sustained even after five years from the time sample members entered high school. This report updates those previous findings with results from a third cohort of students, those who entered ninth grade in the fall of 2007. In addition, for the first time it includes a look inside these schools through the eyes of principals and teachers, as reported in interviews and focus groups held at the 25 SSCs with the strongest evidence of effectiveness. In brief, the report's findings are: (1) SSCs in New York City continue to markedly increase high school graduation rates for large numbers of disadvantaged students of color, even as graduation rates are rising at the schools with which SSCs are compared; (2) The best evidence that exists indicates that SSCs may increase graduation rates for two new subgroups for which findings were not previously available: special education students and English language learners. However, given the still-limited sample sizes for these subgroups, the evidence will not be definitive until more student cohorts can be added to the analysis; and (3) Principals and teachers at the 25 SSCs with the strongest evidence of effectiveness strongly believe that academic rigor and personal relationships with students contribute to the effectiveness of their schools. They also believe that these attributes derive from their schools' small organizational structures and from their committed, knowledgeable, hardworking, and adaptable teachers. Appended are: (1) Sample, Data, and Analysis; (2) Estimated Effects of Winning a Student's First SSC Lottery; (3) 2008 Requirements for Proposals to Create New SSCs Specified by the New York City Department of Education; and (4) Documentation for Interviews and Focus Groups.

High school students from disadvantaged high schools in Toronto were invited to take two surveys, about three weeks apart. Half of the students taking the first survey were also shown a 3 minute video about the benefits of post secondary education (PSE) and invited to try out a financial-aid calculator. Most students' perceived returns to PSE were high, even among those not expecting to continue. Those exposed to the video, especially those initially unsure about their own educational attainment, reported significantly higher expected returns, lower concerns about costs, and expressed greater likelihood of PSE attainment. The two online surveys are appended.

This study estimates the effect of one year of Fusion Reading implementation, a multistrategy intervention, builds on the work of the Strategic Instruction Model's Learning Strategies Curriculum and Xtreme Reading by integrating some of the same strategies (e.g., paraphrasing, visual imagery, and self-questioning for information acquisition; mnemonics for information study; and writing and error monitoring for information expression), focusing on reading, and extending the time frame from 1 to 2 years in duration. Specifically, the study addressed the following: (1) What are the intent-to-treat impacts of the Fusion Reading intervention on the reading outcomes and motivation to read of struggling readers after receipt of 1 year of the intervention?; (2) For which students are the interventions most and least effective?; and (3) In what ways are implementation factors associated with impacts (or lack of impacts) on reading and motivation outcomes? The authors conducted a randomized controlled trial to estimate the effect of Fusion Reading on struggling readers in grades 6 through 10. Students in the intervention condition received the Fusion Reading intervention as a supplemental reading intervention in the 2010-11 school year, whereas students in the control condition engaged in nonliteracy, "business-as-usual" activities. After one year of implementation of a two year intervention, the authors learned that when vocabulary, paraphrasing and word study strategies are explicitly taught by following a specific instructional routine supported by motivation strategies (e.g., setting goals and reading text relevant for the age group), word reading outcomes will significantly improve compared to control middle and high school students. Future research is needed to fully understand whether the intended two year intervention will improve struggling adolescent's reading comprehension outcomes. Appended are: (1) References; and (2) Tables and Figures. (Contains 2 figures and 5 tables.)

American Institutes for Research (AIR) conducted an evaluation of the effect on struggling readers of implementing the READ 180 reading intervention in five participating schools in Milwaukee Public Schools (MPS) under a Striving Readers grant from the U.S. Department of Education. The evaluation used an experimental design in order to produce a rigorous estimate of the impact of the READ 180 intervention on measures of reading achievement for struggling students. The evaluation also explored implementation fidelity and the contexts and conditions of implementation that may extend or limit the intervention's effects. To measure program impact on students' academic performance in reading, AIR analyzed student achievement data collected from the Northwest Evaluation Association (NWEA) Measures of Academic Progress (MAP) benchmark assessment. AIR also administered a student survey to assess the impact on student engagement and self-efficacy for reading. This report asked the following research questions: (1) Does the READ 180 reading intervention improve students' academic performance in reading?; (2) With what fidelity did the program implement the professional development model and what factors mediated the level of implementation?; and (3) With what fidelity did classroom intervention teachers implement READ 180 and what factors mediated the level of implementation?

This study reports Year 1 findings from a multisite cluster randomized controlled trial of a cognitive strategies approach to teaching text-based analytical writing for mainstreamed Latino English language learners (ELLs) in 9 middle schools and 6 high schools. There were 103 English teachers stratified by school and grade and then randomly assigned to the Pathway Project professional development intervention or control group. The Pathway Project trains teachers to use a pretest on-demand writing assessment to improve text-based analytical writing instruction for mainstreamed Latino ELLs who are able to participate in regular English classes. The intervention draws on well-documented instructional frameworks for teaching mainstreamed ELLs. Such frameworks emphasize the merits of a cognitive strategies approach that supports these learners' English language development. Pathway teachers participated in 46 hrs of training and learned how to apply cognitive strategies by using an on-demand writing assessment to help students understand, interpret, and write analytical essays about literature. Multilevel models revealed significant effects on an on-demand writing assessment (d = 0.35) and the California Standards Test in English language arts (d = 0.07). (Contains 1 figure, 7 tables and 4 footnotes.)

Career Academies offer high schools--particularly those in urban communities that struggle to keep students in school and to prepare them for post-secondary education and employment opportunities--a systematic approach to addressing a range of challenges. Typically serving between 150 and 200 students from grades 9 or 10 through grade 12, Career Academies have three distinguishing features: (1) they are organized as small learning communities to create a more supportive, personalized learning environment; (2) they combine academic and career and technical curricula around a career theme to enrich teaching and learning; and (3) they establish partnerships with local employers to provide career awareness and work-based learning opportunities for students. There are estimated to be more than 2,500 Career Academies across the country, operating either as a single program or as multiple programs within a larger high school. This report examines the impact that Career Academies have had on the educational attainment and post-secondary labor market experiences of young people through the four years following their scheduled graduation from high school. It is based on survey data collected from 1,458 young people in the Career Academies Evaluation study sample (about 85 percent of whom are either Hispanic or African-American). Findings included: (1) the Career Academies substantially improved the labor market prospects of young men, a group that has experienced a severe decline in real earnings in recent years; (2) the Career Academies had no significant impacts (positive or negative) on the labor market outcomes for young women; (3) Overall, the Career Academies served as viable pathways to a range of post-secondary education opportunities, but they do not appear to have been more effective than options available to the non-Academy group; and (4) The positive labor market impacts were concentrated among Academy group members who were at high or medium risk of dropping out of high school when they entered the programs. The findings demonstrate the feasibility of improving labor market preparation and successful school-to-work transitions without compromising academic goals and preparation for college. (Contains 10 exhibits.) [Report written with Judith Scott-Clayton. Dissemination of MDRC publications is also supported by Starr Foundation.]

Career Academies offer high schools--particularly those in urban communities that struggle to keep students in school and to prepare them for post-secondary education and employment opportunities--a systematic approach to addressing a range of challenges. Typically serving between 150 and 200 students from grades 9 or 10 through grade 12, Career Academies have three distinguishing features: (1) they are organized as small learning communities to create a more supportive, personalized learning environment; (2) they combine academic and career and technical curricula around a career theme to enrich teaching and learning; and (3) they establish partnerships with local employers to provide career awareness and work-based learning opportunities for students. There are estimated to be more than 2,500 Career Academies across the country, operating either as a single program or as multiple programs within a larger high school. This report examines the impact that Career Academies have had on the educational attainment and post-secondary labor market experiences of young people through the four years following their scheduled graduation from high school. It is based on survey data collected from 1,458 young people in the Career Academies Evaluation study sample (about 85 percent of whom are either Hispanic or African-American). Findings included: (1) the Career Academies substantially improved the labor market prospects of young men, a group that has experienced a severe decline in real earnings in recent years; (2) the Career Academies had no significant impacts (positive or negative) on the labor market outcomes for young women; (3) Overall, the Career Academies served as viable pathways to a range of post-secondary education opportunities, but they do not appear to have been more effective than options available to the non-Academy group; and (4) The positive labor market impacts were concentrated among Academy group members who were at high or medium risk of dropping out of high school when they entered the programs. The findings demonstrate the feasibility of improving labor market preparation and successful school-to-work transitions without compromising academic goals and preparation for college. (Contains 10 exhibits.) [Report written with Judith Scott-Clayton. Dissemination of MDRC publications is also supported by Starr Foundation.]

The career academy approach is one of the oldest and most widely established high school reforms in the U.S., stretching back for more than 30 years. A large-scale, multi-site, random assignment research design was conducted to determine the impact of career academies on student outcomes. Some of the findings of the study include the following: (1) the career academies in the study increased both the level of interpersonal support students experienced and their participation in career awareness and work-based learning activities; (2) the career academies substantially improved high school outcomes among students at high risk of dropping out; (3) among students least likely to drop out, the career academies increased the likelihood of graduating on time; (4) in academies that greatly enhanced interpersonal support from teachers and peers, the dropout rates dropped dramatically; (5) the academies did not improve standardized mathematics and reading test scores; and (6) the impact of the academies and the types of students who participated in them varied greatly from site to site. The study concluded that career academies can be an effective means of reducing the high school dropout rate and enhancing students' engagement with school, especially if they increase personal support of students through involvement with teachers and peers. (Contains 33 references and two appendixes that provide supplementary information about the career academies research study and strategies for creating subgroups of students defined by at-risk characteristics.) (KC)

This report is the second in a series that presents evidence about the conditions under which Career and Technical Education (CTE) may be most and least effective and for whom. It focuses on a different set of schools: Comprehensive high schools in New York City (NYC) that offer CTE alongside other educational options. Like the CTE-Dedicated high schools, these Comprehensive high schools serve a large and diverse group of students. Between 2013 and 2016, for example, more than 80,000 8th grade students applied and were assigned to programs offering CTE in these schools through the City's High School Application Processing System (HSAPS). There are several important differences between the CTE-Dedicated and Comprehensive high school contexts that make this report and its findings distinctive. First, when students apply to Comprehensive high schools, they have the option of choosing programs that offer CTE as well as programs that do not. By contrast, when students apply to CTE-Dedicated high schools, every available option in that school offers a CTE Program of Study. In an effort to capture as much student engagement in CTE as possible, this report focuses only on students who chose CTE programs in Comprehensive high schools. Like those in CTE-Dedicated high schools, CTE programs in Comprehensive high schools must offer the full range of CTE courses, work-based learning opportunities, certified teachers, and dual enrollment opportunities required by the state.

The College and Career Readiness Expansion project was a five-year, federally funded effort to implement early college strategies in comprehensive high schools. This report presents the results from a quasi-experimental impact study of the project and a mixed methods examination of its implementation. Results showed that the program increased the percentage of students on-track for college in 9th and 10th grade and expanded the number of students taking dual enrollment courses, although there was no positive impact on college credits earned in high school. The implementation study found that schools were created a more future-oriented culture.

In Indiana and Minnesota the state education agency, state higher education agency, and the state workforce agency have collaborated to develop career and technical education courses intended to improve high school students' college and career readiness. These agencies partnered with the Regional Educational Laboratory Midwest to examine whether high school graduates in each state who completed a large number of career and technical education courses in a single career-oriented program of study (concentrators) had different college and workforce outcomes from graduates who completed fewer (samplers) or no career and technical education courses (nonparticipants). The study found that in the 2012/13-2017/18 graduation cohorts, male graduates were more likely to be concentrators than female graduates, and graduates who received special education services were more likely to be concentrators than those who did not receive services. Graduates who were not proficient in reading in grade 8 also were more likely to become concentrators than those who were proficient. Graduates who attended urban and suburban schools were more likely than students who attended town and rural schools to be nonparticipants. Concentrators were less likely than samplers and nonparticipants with similar characteristics to enroll in college, but the differences reflect mainly enrollment in four-year colleges. Concentrators were more likely to enroll in two-year colleges. Concentrators also were less likely than similar samplers and nonparticipants to complete a bachelor's degree within four to six years. Finally, compared with similar samplers and nonparticipants, concentrators were employed at higher rates in the first five years after high school and had higher earnings. [For the study brief, see ED613045; for the study snapshot, see ED613046; and for the appendixes, see ED613050.]

This study examined participation in accelerated college credit programs dual enrollment, concurrent enrollment, and Advanced Placement courses in Rhode Island high schools to understand their effects on educational attainment in the 2013/14 grade 9 cohort. The state, which has funded and promoted these opportunities for students to earn college credit during high school over the past five years, sought evidence of the programs' effects on participants' high school graduation rates, postsecondary enrollment rates, and enrollment rates in developmental education courses in college. The study found that male, economically disadvantaged, and racial/ethnic minority students were underrepresented in accelerated college credit programs. Participation in these programs had positive effects on students' rates of high school graduation and postsecondary enrollment. Among students in the cohort who enrolled in Rhode Island public colleges, participation was associated with lower rates of developmental education course enrollment in the first year of college. The effects of participating in an accelerated college credit program were similar for economically disadvantaged students and for their peers. [For the Study Snapshot, see ED612888. For the appendices, see ED612890.]

Education leaders in Nebraska and South Dakota partnered with the Regional Educational Laboratory Central to examine how completing a sequence of career and technical education (CTE) courses in high school affects students' rates of on-time high school graduation and their rates of postsecondary education enrollment and completion within two and five years. The study found that CTE concentrators (students who complete a sequence of CTE courses aligned to a specific career field such as manufacturing or education and training) were 7 percentage points more likely than non-CTE concentrators to graduate from high school on time and 10 percentage points more likely to enroll in any type of postsecondary education within two years of their expected high school graduation year. The study also found that CTE concentrators were 3 percentage points more likely than non-CTE concentrators to earn a postsecondary award, such as a professional certificate, diploma, or associate's or bachelor's degree, within five years of their expected high school graduation year. CTE concentrators were 4 percentage points more likely than non-CTE concentrators to obtain up to an associate's degree as their highest postsecondary award within five years of their expected high school graduation year but 1 percentage point less likely to obtain a bachelor's degree or higher. [For the appendixes, see ED612631; for the study brief, see ED612632; for the study snapshot, see ED612633.]

The purpose of this study is to evaluate the Advancement Via Individual Determination (AVID) program and to derive estimates of program costs. We used the Coarsened Exact Matching approach to match AVID students with non-AVID students on 40 baseline characteristics. After matching, we estimated group differences in high-school graduation and college enrollment. We used the ingredients method to estimate program costs and calculated cost-effectiveness ratios by the duration of participation. Findings indicate that students who complete at least one AVID elective have higher high school graduation and college enrollment rates than comparable non-AVID students. We discuss how AVID compares to other college outreach programs in terms of costs and effects.

Purpose: The purpose of this two-year study was to assess the impact of the CORE program, a model that integrates technology and active learning modules in high schools by providing multi-disciplinary teams of teachers and administrators with professional development and resources to support the development of students' non-cognitive skills and increase their college and career readiness. A fidelity of implementation study was also conducted to assess the seven key program components were being implemented as intended. Methods: This Randomized Control Trial (RCT) study followed a cohort of 9th and 10th grade high school students in 28 treatment and control schools; students completed the CWRA+ assessment and non-cognitive skills, engagement, and self-efficacy scales at three timepoints. Using the hierarchical linear model (HLM), the study assessed one-year program impact and two-year program impact. The two-year program impact model suffered a high attrition (due to COVID19) and the study became a quasi-experimental design (QED) study after propensity score matching analysis was applied. Results: Findings highlight how students at CORE schools showed increased scores across the two-year program intervention. Specifically, standardized effects on CWRA+ scores, the non-cognitive skills scale, engagement scale, and efficacy scale were respectively, 0.22, 0.22, 0.23, and 0.32. The effect size for the efficacy scale (0.32) was large enough to be considered important. To selectively mention exploratory findings, the level of program exposure both in terms of whether students were enrolled in the program-trained teachers' courses and whether teachers participated in PD activities seemed correlated with a higher growth in student's CWRA+ scores. Another set of exploratory findings implied that the program impact may interact with demographic characteristics of students. Findings demonstrate a need for further testing of differences between student subgroups based on demographics, as well as the importance of buy-in from program implementers to provide the customized PD support that educators and partners at rural schools need to more effectively serve their students. The exploratory findings suggested that the program exposure of teachers and students may be a key to enhance the CORE program impact. [This report was submitted by the ICF Evaluation Team.]

The purpose of this study was to determine the effectiveness of Get the Picture?! in improving the overall college/career readiness of 900 students with disabilities in each of the nine participating treatment high schools in nine rural, high poverty Kentucky school districts after four years of implementation. This quasi-experimental study followed the 9th grade cohort of students with disabilities in the nine treatment and 18 matched control schools over four school years, 2015-16 through 2018-19. Through the development of self-determination skills, the goal of the intervention was to increase the number of students with disabilities who achieved the state standard for College and/or Career Readiness by meeting established benchmarks on State/National assessments and/or completion of a recognized industry certification in each of the nine participating schools. For the confirmatory analyses, there were two outcome variables in two different outcome domains: (a) Transition Ready, a binary "Yes"/"No" variable [Transition Readiness domain], and (b) the cumulative number of in-school suspensions (a continuous variable) [Self-management behaviors domain]. For the confirmatory analyses, outcome data were examined using two-level Hierarchical Linear Models (HLM) (for Cumulative In-School Suspensions) and Hierarchical Generalized Linear Models (HGLM) (for Transition Ready) to account for the nested structure of the data (i.e., students nested within schools). Overall, after four years of implementation, Get the Picture?! was able to demonstrate a statistically significant positive impact on the Transition Readiness of participating 9th grade cohort students compared to controls. Treatment students had statistically significantly higher odds of being Transition Ready, and were more than twice as likely to achieve Transition Readiness status compared to control students. However, while the confirmatory study showed the intervention was also able to reduce the total number of in-school suspensions for treatment students relative to controls, the outcome was indeterminate (i.e., not statistically significant). The following are appended: (a) Kentucky Department of Education Revised Transition Readiness Standards, and (b) Fidelity of Implementation Final Report.

In 2013, the NYC Leadership Academy (NYCLA) developed a leadership intervention--the Targeted Intensive School Support (TISS) program--in collaboration with the New York City Department of Education (NYC DOE) to support schools that were facing particular challenges. NYCLA asked the RAND Corporation to provide an independent evaluation of the program's implementation and effects, and those findings are detailed in this report. The TISS program consisted of five key components: (1) teaming and collaborative training in aligned preservice preparation programs for a principal and assistant principal (AP); (2) coplacement of a principal and AP into an NYC DOE school; (3) team-based coaching to support the principal and AP; (4) 328 hours of extended coaching over the first three years after placement; and (5) use of a diagnostic process to guide goal setting and coaching according to school needs. Implementation findings suggest that only two of the five key components were implemented with fidelity. A propensity weighting approach was used to compare schools with TISS principals to other schools with new principals trained through residency-based preservice programs who did not participate in TISS. Findings suggest no statistically significant differences between TISS schools and comparison schools on measures of student achievement, school culture, and principal retention. TISS schools underperformed relative to comparison schools on the measure of chronic student absenteeism. [Sponsored by NYC Leadership Academy through a subgrant from the U.S. Department of Education.]

With the launch of the New York City Community Schools Initiative (NYC-CS) in 2014, the New York City Department of Education (NYCDOE) has increased its focus on the implementation of a holistic strategy of education reform to address the social consequences of poverty as a means to improving student outcomes. NYC-CS is a strategy to organize resources in schools and share leadership among stakeholders so that academics, health and wellness, youth development, and family engagement are integrated into the fabric of each school. New York City is implementing this strategy at a scale unmatched nationally. In this study, the authors assessed the impact of the NYC-CS through the 2017-2018 school year. The authors assessed the effects along seven outcome domains and explored the extent to which there is heterogeneity in programmatic impact based on student- and school-level characteristics. The authors leveraged innovative quasi-experimental methodology to determine whether students in the community schools are performing better than they would be had their schools not been designated as Community Schools. The findings of this report will contribute to the emerging evidence base on the efficacy of the community school strategy and will be useful for other school district- and state-level policymakers interested in developing or refining similar interventions that support students' and communities' academic, social, and emotional well-being. [The research described in this report was prepared for the New York City Mayor's Office for Economic Opportunity (NYC Opportunity).]

To support implementation of the "Next Generation Science Standards," we designed a high school biology unit, "Matter and Energy for Growth and Activity" (MEGA), that engages students in explaining physical and life science phenomena using evidence, models, and science ideas about matter and energy changes within systems and transfers between systems. The unit's promise was evaluated using a randomized control trial (RCT) involving fifteen teachers from two schools. Teachers were randomly assigned to implement either the MEGA unit or district-developed activities that targeted the same learning goals. Pre- and post-tests were administered, and the data were analyzed using Rasch modeling and hierarchical linear modeling. Here we describe the unit and report on RCT results. Our data showed that, when controlling for pretest score, gender, language, and ethnicity, students in the treatment group performed better on the post-test than the students in the comparison group, indicating the MEGA unit has promise in improving students' understanding. We also discuss a number of challenges that arose when developing and evaluating the unit.

We explore the impacts of a Consortium of rural high schools and colleges in Tennessee engaged in partnership activities to improve high school students' college and career readiness. These 29 Consortium schools received support from the federal Investing in Innovation Fund (i3) to scale up local promising practices, including distance and online learning, college partnerships to boost dual enrollment, professional development for teachers, and college and career counseling to students. Propensity score matching was used to select 29 comparison schools from among 288 regular high schools statewide. We used a quasi-experimental, matched-control study to compare students in Consortium schools to those in matched comparison schools and found that even though most of the Consortium's components of the intervention were implemented with at least moderate fidelity, most of the impacts on student outcomes were relatively small in magnitude and were not statistically significant for all cohorts. Outcomes with positive impacts include testing college ready, participating in Advanced Placement (AP) courses, receiving a score of 3 or greater on an AP examination, enrolling in college, and persisting in college. These findings suggest that schools faced considerable challenges to reforming college and career readiness that might reflect deeper issues associated with developing and maintaining relationships and changing the cultures of schools.

Across the country, school districts, their stakeholders, and policymakers have become increasingly concerned about suspensions, particularly about suspending students from elementary school and disproportionately suspending ethnic/racial minority students. Suspended students are less likely to graduate, possibly because they miss the instructional time they need to advance academically. Restorative practices have gained buy-in in the education community as a strategy to reduce suspension rates. Proactively improving relationships among students and staff and building a sense of community in classrooms and schools may make students less inclined to misbehave. And addressing severe misbehavior through a restorative approach may help students realize the impacts of their actions and make them less likely to offend again. This study of the implementation of restorative practices in the Pittsburgh Public Schools district (PPS) in school years 2015-16 and 2016-17 represents one of the first randomized controlled trials of the effects of restorative practices on classroom and school climates and suspension rates. The authors examined a specific restorative practices program -- the International Institute for Restorative Practices' SaferSanerSchools™ Whole-School Change program -- implemented in a selected group of PPS schools under a program called Pursuing Equitable and Restorative Communities, or PERC. The researchers found that PERC achieved several positive effects, including an improvement in overall school climates (as rated by teachers), a reduction in overall suspension rates, and a reduction in the disparities in suspension rates between African American and white students and between low- and higher-income students. Key Findings: Effects of the Pursuing Equitable and Restorative Communities (PERC) program in Pittsburgh Public Schools: (1) Implementation of restorative practices through PERC improved overall school climates, as rated by teachers; (2) Implementation of restorative practices reduced the average suspension rate: During the study period, average suspension rates decreased in both PERC and non-PERC schools, but rates decreased more in PERC schools; (3) Suspension rates of African American students and of those from low-income families also went down in PERC schools, shrinking the disparities in suspension rates between African American and white students and between low- and higher-income students; (4) Academic outcomes did not improve in PERC schools, and actually worsened for grades 6-8; and (5) Arrest rates among PERC schools did not decrease. Recommendations: (1) Given the constraints on teachers' time, emphasize restorative practices that can be woven into the school day; (2) Ensure that school leaders understand and can model restorative practices, including by providing mandatory professional development, books and other materials, and coaching on restorative practices; (3) Establish a mechanism for school staff to meet at least once per month as a professional learning community on restorative practices; (4) Ensure that leaders at the district level can coordinate this work; (5) Set, and update, clear expectations regarding the use of restorative practices; and (6) Implement data collection systems to collect accurate information on all types of behavioral incidents and remedies.

Although several studies have documented the effects of statewide private school choice programs on student test scores, this report is the first to examine the effects of one of these programs on college enrollment and graduation. Using data from the Florida Tax Credit (FTC) Scholarship program, we find that low-income Florida students who attended private schools using an FTC scholarship enrolled in and graduated from Florida colleges at a higher rate than their public school counterparts. [Additional support for this study was provided by the Bill and Susan Oberndorf Foundation and Kate and Bill Duhamel.]

The National Math + Science Initiative's (NMSI's) College Readiness Program (CRP) is an established program whose goal is to promote science, technology, engineering, and mathematics education in high schools to improve students' readiness for college. It provides teacher, student, and school supports to promote high school students' success in mathematics, science, and English Advanced Placement (AP) courses, with a focus on students who are traditionally underrepresented in the targeted AP courses. Through a federal Investing in Innovation Fund (i3) validation grant awarded to NMSI in 2011, CRP was implemented in a total of 58 high schools in two states--Colorado and Indiana--beginning in the 2012-13 school year. American Institutes for Research (AIR) conducted an independent evaluation of the impacts of CRP on students' AP outcomes in these schools for the three cohorts of schools that adopted the program in sequential years, using a comparative interrupted time series (CITS) design that matched comparison schools to program schools in the two states. Overall, schools implementing CRP demonstrated significantly larger increases in the share of students taking and passing AP tests in targeted areas relative to comparison schools in each of the three cohorts of schools, and the gains in CRP schools were sustained over time. Fidelity of program implementation was evaluated using a fidelity matrix approach required as part of the National Evaluation of the i3 program, which showed that not all elements of the program were implemented with high fidelity. Teachers and students were not always able to attend all meetings, and schools did not always meet negotiated enrollment targets. Teacher survey data indicated that teachers found the professional development activities provided by CRP to be the most helpful support they received under CRP, and students reported that the tutoring and special study sessions were the most helpful. Although the program provided financial incentives to both teachers and students that were tied to student performance on AP tests, these incentives were considered the least important element of the program by both teachers and students

Since their inception in 1992, the number of charter schools has grown to more than 6,800 nationally, serving nearly three million students. Various studies have examined charter schools' impacts on test scores, and a few have begun to examine longer-term outcomes including graduation and college attendance. This paper is the first to estimate charter schools' effects on earnings in adulthood, alongside effects on educational attainment. Using data from Florida, we first confirm previous research (Booker et al., 2011) that students attending charter high schools are more likely to graduate from high school and enroll in college. We then examine two longer-term outcomes not previously studied in research on charter schools--college persistence and earnings. We find that students attending charter high schools are more likely to persist in college, and that in their mid-20s they experience higher earnings.

KIPP (Knowledge is Power Program) is a national network of public charter schools whose stated mission is to help underserved students enroll in and graduate from college. Prior studies (see Tuttle et al. 2013) have consistently found that attending a KIPP middle school positively affects student achievement, but few have addressed longer-term outcomes and no rigorous research exists on impacts of KIPP schools at levels other than middle school. In this first high-quality study to rigorously examine the impacts of the network of KIPP public charter schools at all elementary and secondary grade levels, Mathematica found that KIPP schools have positive impacts on student achievement, particularly at the elementary and middle school levels. In addition, the study found positive impacts on student achievement for new entrants to the KIPP network in high school. For students continuing from a KIPP middle school, KIPP high schools' impacts on student achievement are not statistically significant, on average (in comparison to students who did not have the option to attend a KIPP high school and instead attended a mix of other non-KIPP charter, private, and traditional public high schools). Among these continuing students, KIPP high schools have positive impacts on several aspects of college preparation, including more discussions about college, increased likelihood of applying to college, and more advanced coursetaking. This report provides detailed findings and also includes the following appendices: (1) List of KIPP Schools In Network; (2) Detail on Survey Outcomes; (3) Cumulative Middle and High School Results; (4) Detailed Analytic Methods: Elementary School (Lottery-Based Analyses); (5) Detailed Analytic Methods: Middle School (Lottery-Based Analyses); (6) Understanding the Effects of KIPP As It Scales Mathematica Policy Research; (7) Detailed Analytic Methods: Middle School (Matched-Student Analyses); (8) Detailed Analytic Methods: High School (Matched-Student Analyses); (9) Detailed Analytic Methods: High School (Matched-School Analyses); and (10) Detailed Tables For What Works Clearinghouse Review. [For the executive summary, see ED560080; for the focus brief, see ED560043.]

My Teaching Partner-Secondary (MTP-S) is a web-mediated coaching intervention, which an initial randomized trial, primarily in middle schools, found to improve teacher-student interactions and student achievement. Given the dearth of validated teacher development interventions showing consistent effects, we sought to both replicate and extend these findings with a modified version of the program in a predominantly high school population, and in a more urban, sociodemographically diverse school district. MTP-S produced substantial gains in student achievement across 86 secondary school classrooms involving 1,194 students. Gains were robust across subject areas and equivalent to moving the average student from the 50th to the 59th percentile in achievement scores. Results suggest that MTP-S can enhance student outcomes across diverse settings and implementation modalities.

The current teacher workforce is younger, less experienced, more likely to turnover, and more diverse in preparation experiences than the workforce of two decades ago. Research shows that inexperienced teachers are less effective, but we know little about the effectiveness of teachers with different types of preparation. In this study, we classify North Carolina public school teachers into "portals"--fixed and mutually exclusive categories that capture teachers' formal preparation and qualifications upon first entering the profession--and estimate the adjusted average test score gains of students taught by teachers from each portal. Compared with undergraduate-prepared teachers from in-state public universities, (a) out-of-state undergraduate-prepared teachers are less effective in elementary grades and high school, (b) alternative entry teachers are less effective in high school, and (c) Teach For America corps members are more effective in STEM subjects and secondary grades.

Despite the growing popularity of dual-credit courses as a college readiness strategy, numerous reviews of the literature have noted a number of important limitations of the research on the effects of dual-credit on student postsecondary outcomes. This study addressed these gaps in the literature by estimating the impact of dual-credit courses on postsecondary access, first-to-second year persistence, and eventual college attainment, and overcame many of the methodological limitations of previous studies. The study utilized a statewide longitudinal data system (SLDS), allowing us to track an entire cohort of students through their transition into postsecondary statewide. Propensity score matching was used in order to reduce the self-selection bias associated with high achieving students being more likely to take dual-credit courses. We explored how the number of dual-credit courses students complete and the subject of the courses influences their impact. We also compared the effects of dual-credit to alternative advanced courses. Our results suggest that dual-credit is a promising strategy for increasing the likelihood of students accessing, persisting through, and completing a degree in postsecondary, and is possibly even more impactful than advanced coursework. However, significant variation in the benefit of dual-credit exists.

New Leaders is a nonprofit organization with a mission to ensure high academic achievement for all students by developing outstanding school leaders to serve in urban schools. Its premise is that a combination of preparation and improved working conditions for principals, especially greater autonomy, would lead to improved student outcomes. Its approach involves both preparing principals and partnering with school districts and charter management organizations (CMOs) to improve the conditions in which its highly trained principals work. As part of the partnerships, New Leaders agrees to provide carefully selected and trained principals who can be placed in schools that need principals and to provide coaching and other support after those principals are placed. The districts and CMOs agree to establish working conditions that support, rather than hinder, the principals' efforts to improve student outcomes. This report describes how the New Leaders program was implemented in partner districts, and it provides evidence of the effect that New Leaders has on student achievement. [The research in this report was produced within RAND Education. For the appendices that accompany this report, see ED561154. For the research brief, "Principal Preparation Matters: How Leadership Development Affects Student Achievement. Research Brief," see ED561155.]

With funding from the Bill and Melinda Gates Foundation, CRESST conducted a multi-year evaluation of a major school reform project at Alain Leroy Locke High School, historically one of California's lowest performing secondary schools. Beginning in 2007, Locke High School transitioned into a set of smaller, Green Dot Charter High Schools, subsequently referred to as Green Dot Locke (GDL) in this report. Based on 9th grade students who entered GDL in 2007 and 2008 respectively, CRESST used a range of student outcomes to monitor progress of the GDL transformation. The CRESST evaluation, employing a strong quasi-experimental design with propensity score matching, found statistically significant, positive effects for the GDL transformation including improved achievement, school persistence, and completion of college preparatory courses. Appended are: (1) Demographic Characteristics and Achievement of the Freshmen at GDL and LAUSD; (2) Cohort Specific Descriptives; and (3) General Descriptives. (Contains 17 figures, 43 tables and 6 footnotes.)

This is the final report in a five-year evaluation of the Milwaukee Parental Choice Program (MPCP). This report features analyses of student achievement growth four years after the authors carefully assembled longitudinal study panels of MPCP and Milwaukee Public Schools (MPS) students in 2006-07. The MPCP, which began in 1990, provides government-funded vouchers for low-income children to attend private schools in the City of Milwaukee. The maximum voucher amount in 2010-11 was $6,442, and 20,996 children used a voucher to attend either secular or religious private schools. The MPCP is the oldest and largest urban school voucher program in the United States. This evaluation was authorized by 2005 Wisconsin Act 125, which was enacted in 2006. The primary purpose of the evaluation is twofold: 1) to analyze the effectiveness of the MPCP in promoting growth in student achievement as compared to MPS; and 2) to examine the educational attainment--measured by high school graduation and college enrollment rates--of MPCP and MPS students. The first purpose is accomplished by gauging growth in student achievement--as measured by the Wisconsin Knowledge and Concepts Examinations (WKCE) in math and reading in grades 3 through 8 and grade 10--over a five-year period for a sample of MPCP students and a carefully matched group of MPS students. The second purpose is accomplished by following the 2006-07 8th and 9th grade MPCP and matched MPS cohorts over a five-year period during which they would have had the opportunity to graduate from high school and enroll in college. Appended are: (1) Descriptive Statistics; (2) Attrition Study; and (3) Stability of the Sample. (Contains 4 figures, 12 tables and 14 footnotes.) [For the "MPCP Longitudinal Educational Growth Study: Fourth Year Report. SCDP Milwaukee Evaluation. Report # 23", see ED518597. Additional support for this report was provided by the Robertson Foundation.]

Improving teaching quality is widely recognized as critical to addressing deficiencies in secondary school education, yet the field has struggled to identify rigorously evaluated teacher-development approaches that can produce reliable gains in student achievement. A randomized controlled trial of My Teaching Partner-Secondary--a Web-mediated approach focused on improving teacher-student interactions in the classroom--examined the efficacy of the approach in improving teacher quality and student achievement with 78 secondary school teachers and 2237 students. The intervention produced substantial gains in measured student achievement in the year following its completion, equivalent to moving the average student from the 50th to the 59th percentile in achievement test scores. Gains appeared to be mediated by changes in teacher-student interaction qualities targeted by the intervention. [For a related What Works Clearinghouse Intervention Report, see ED557783.]

Teach For America (TFA) selects and places graduates from the most competitive colleges as teachers in the lowest-performing schools in the country. This paper is the first study that examines TFA effects in high school. We use rich longitudinal data from North Carolina and estimate TFA effects through cross-subject student and school fixed effects models. We find that TFA teachers tend to have a positive effect on high school student test scores relative to non-TFA teachers, including those who are certified in field. Such effects offset or exceed the impact of additional years of experience and are particularly strong in science. (Contains 1 figure, 14 tables and 14 footnotes.)

Over the last decade, New York City has been the site of a systemwide high school reform effort that is unprecedented in its scope and pace. Since 2002, the school district has closed more than 20 failing high schools, opened more than 200 new secondary schools, and implemented a centralized high school admission process in which approximately 80,000 students a year indicate their school preferences from a wide-ranging choice of programs. At the heart of these reforms lie the new schools that in this report are called "small schools of choice" (SSCs)--small, academically nonselective, public high schools that were opened between 2002 and 2008. Serving approximately 100 students per grade in grades 9 through 12 and open to students at all levels of academic achievement, the SSCs in this study were created to serve the district's most disadvantaged and historically underserved students. Prior to the 2002-2003 school year, these students would have had little option but to enroll in one of the city's large, zoned high schools when they made the transition from eighth to ninth grade. Many of the large schools were low-performing, with graduation rates below 50 percent. This report presents encouraging findings from an unusually large and rigorous study, supported by the Bill & Melinda Gates Foundation, of the effects of SSCs on students' academic achievement in high school. SSCs have a substantial positive impact on the transition into high school during ninth grade, according to data using all four cohorts: (1) SSC enrollees were 10.8 percentage points more likely than the students who enrolled in other schools to earn 10 or more credits during their first year--73.1 percent compared with 62.3 percent; (2) SSC enrollees were 7.8 percentage points less likely to fail more than one core subject (39 percent compared with 46.8 percent); (3) Combining these two indicators, 58.5 percent of SSC enrollees were on track to graduate in four years compared with 48.5 percent of their counterparts who attended a different type of school--a 10 percentage point difference; and (4) During the first year of high school, SSC enrollees earn almost one full credit more (0.9 credit) toward graduation than do their control group counterparts. These positive effects on the transition into high school during ninth grade were seen among nearly all subgroups as defined by students' academic proficiency, socioeconomic status, race/ethnicity, and gender. For all students, second- and third-year follow-up data indicate that these effects are sustained and/or increased as they continue through high school. For the "first" cohort of students (the only cohort for whom there are four years of follow-up data), the evidence indicates that SSC improvements in students' academic progress and school engagement during the early years of high school translate into higher rates of on-time graduation after four years: (1) SSCs increase overall graduation rates by 6.8 percentage points, from 61.9 percent for students who attend schools other than SSCs to 68.7 percent for SSC enrollees; (2) A majority of the SSC effect on graduation rates reflects an increase in receipt of New York State Regents diplomas. For this type of diploma, students must pass a series of Regents examinations with a score of 65 points or above and pass all of their required courses; and (3) SSCs increase the proportion of students (by 5.3 percentage points) who passed the English Regents with a score of 75 points or higher, the threshold for exempting incoming students at the City University of New York from remedial courses. They did not have an effect on math Regents exams. (Contains 2 tables and 4 footnotes.) [For the full report, "Transforming the High School Experience: How New York City's New Small Schools Are Boosting Student Achievement and Graduation Rates," see ED511106.]

This study was conducted by members of a site of the California Writing Project in partnership with a large, urban, low-SES school district where 93% of the students speak English as a second language and 69% are designated Limited English Proficient. Over an eight-year period, a relatively stable group of 55 secondary teachers engaged in ongoing professional development implemented a cognitive strategies approach to reading and writing instruction, making visible for approximately 2000 students per year the thinking tools experienced readers and writers access in the process of meaning construction. The purpose of the study was to assess the impact of this approach on the reading and writing abilities of English language learners (ELLs) in all 13 secondary schools in the district. Students receiving cognitive strategies instruction significantly out-gained peers on holistically scored assessments of academic writing for seven consecutive years. Treatment-group students also performed significantly better than control-group students on GPA, standardized tests, and high-stakes writing assessments. Findings reinforce the importance of having high expectations for ELLs; exposing them to a rigorous language arts curriculum;explicitly teaching, modeling and providing guided practice in a variety of strategies to help students read and write about challenging texts; and involving students as partners in a community of learners. What distinguishes the project is its integrity with respect to its fidelity to three core dimensions: Teachers and students were exposed to an extensive set of cognitive strategies and a wide array of curricular approaches to strategy use (comprehensiveness) in a manner designed to cultivate deep knowledge and application of those strategies in reading and writing (density) over an extended period of time (duration). The consistency of positive outcomes on multiple measures strongly points to the efficacy of using this approach with ELLs. Appended are: (1) Great Expectations Writing Prompt; and (2) Student Models. (Contains 1 note, 5 tables, and 6 figures.)

With more than 290 Career and Technical Education (CTE) programs across 131 high schools, the NYC Department of Education (NYCDOE) oversees one of the largest and most diverse CTE systems in the country. In the last year, NYC's mayor and NYCDOE leadership have made a number of new investments in Career and Technical Education. The Research Alliance for New York City Schools, in collaboration with researchers from MDRC, Boston College, and the University of Connecticut, has undertaken a multi-year study that looks to New York City as a laboratory for learning about the implementation, impact, and cost of the wide array of educational options that fall under the heading of Career and Technical Education. Evidence from this ongoing study is informing the work of the Office of Student Pathways, which includes the team that centrally manages CTE in particular. Given the wide-ranging conditions under which CTE is implemented in NYC, and the diversity of students it serves, the study has the potential to inform policy and programming decisions across the country. This report is the first of several that will emerge from the larger study. It assesses the impact of the CTE-Dedicated high schools on key student outcomes, including academic engagement in 9th through 12th grade, high school graduation, and college enrollment. It also examines the degree to which key program elements were available to students in CTE-Dedicated high schools, highlighting policies and programming decisions that shaped the orientation and impact of these programs during the study period. [This report was written with John Sludden and Samuel J. Kamin.]

We tested the efficacy of a comprehensive intervention program designed for high school students across the autism spectrum, the Center on Secondary Education for Students with Autism (CSESA) model, in a cluster randomized control trial involving 60 high schools in three states (California, North Carolina, Wisconsin), with implementation occurring over a 2-year period. We examined outcomes for the schools, students (N = 547), and families. At the conclusion of the study, CSESA schools had significantly higher program quality than the services-as-usual (SAU) schools. In addition, students in the CSESA schools had significantly higher total attainment of educational goals than students in SAU schools. There were not significant differences between the two groups on standardized assessment outcomes. We discuss implications for intervention implementation and future research with this population in the public school context.

The New York City P-TECH Grades 9-14 schools represent an education model that ties together the secondary, higher education, and workforce systems as a way to improve outcomes in both domains. The distinguishing feature of the P-TECH 9-14 model, as it is referred to in this report, is a partnership between a high school, a local community college, and one or more employer partners that focuses on preparing students for both college and careers -- not one or the other -- within a six-year timeframe. Education and workforce development are traditionally seen as separate spheres of influence with multiple transition points that students have been left to navigate largely on their own (for example, high school to postsecondary, and postsecondary to the workforce). P-TECH 9-14 is designed to seamlessly assist student navigation of those points -- supporting student success and mitigating the potential for students to fall through the cracks. P-TECH 9-14 schools collaborate with local colleges to provide students with an opportunity to earn a high school diploma (within four years) followed by a cost-free, industry-recognized associate's degree. During the six-year program, employer partners support P-TECH 9-14 schools by providing students with work-based learning experiences such as internships, mentoring, and job shadowing. By design, the P-TECH 9-14 model offers students the opportunity to participate in focused and accelerated high school pathways, early college, and career-focused activities. This study offers initial impact and implementation findings from the first rigorous evaluation of the model, evaluating the first seven P-TECH 9-14 schools that opened in New York City. The study leverages the random lottery process created by the New York City High School Admissions System to identify impacts. The majority of the students in the sample who participated in the admissions lotteries were academically below proficiency in both math and English language arts (ELA) prior to entering high school. [This report was written with Fernando Medina. For the executive summary, see ED605313.]

The New York City P-TECH Grades 9-14 schools represent an education model that ties together the secondary, higher education, and workforce systems as a way to improve outcomes in both domains. The distinguishing feature of the P-TECH 9-14 model, as it is referred to in this report, is a partnership between a high school, a local community college, and one or more employer partners that focuses on preparing students for both college and careers -- not one or the other -- within a six-year timeframe. Education and workforce development are traditionally seen as separate spheres of influence with multiple transition points that students have been left to navigate largely on their own (for example, high school to postsecondary, and postsecondary to the workforce). P-TECH 9-14 is designed to seamlessly assist student navigation of those points -- supporting student success and mitigating the potential for students to fall through the cracks. P-TECH 9-14 schools collaborate with local colleges to provide students with an opportunity to earn a high school diploma (within four years) followed by a cost-free, industry-recognized associate's degree. During the six-year program, employer partners support P-TECH 9-14 schools by providing students with work-based learning experiences such as internships, mentoring, and job shadowing. By design, the P-TECH 9-14 model offers students the opportunity to participate in focused and accelerated high school pathways, early college, and career-focused activities. This study offers initial impact and implementation findings from the first rigorous evaluation of the model, evaluating the first seven P-TECH 9-14 schools that opened in New York City. The study leverages the random lottery process created by the New York City High School Admissions System to identify impacts. The majority of the students in the sample who participated in the admissions lotteries were academically below proficiency in both math and English language arts (ELA) prior to entering high school. [This report was written with Fernando Medina. For the executive summary, see ED605313.]

Disruptive behavior (DB) negatively affects the learning process in various ways, interfering with the educational process of individual students, the teacher, and/or the class as a whole. Group contingency interventions, such as the Good Behavior Game (GBG), are often used classwide to provide teachers with evidence-based management strategies while improving student behavior. In the present study, we evaluated the effects of a streamlined, no-teams version of the GBG in general education high school classrooms. Although the GBG has been assessed in a variety of settings, it has limited empirical evidence for use with secondary-level students, indicating a significant need for such an evaluation. The effects of the intervention were determined with an A/B/A/B single-case withdrawal design in three classrooms (ninth, 10th, and 11th grades). The results of the study indicated that the no-team version of the GBG was effective at reducing levels of DB and increasing levels of academic engagement in each classroom. Furthermore, the intervention procedures were found to be acceptable to each of the teachers, indicating that the streamlined version of the GBG is an efficient and effective strategy for improving student behavior in high school classrooms.

Two studies were conducted to examine the effects of a brief prompting intervention (verbal and visual reminder of classroom rules) to improve classroom behavior for an elementary student during small-group reading instruction in a special education classroom (Study 1) and for three high school students with mild disabilities in an inclusive general education classroom (Study 2). Using within-participant reversal designs, the teachers provided brief reminders of behavioral expectations just before class. Teachers were instructed to respond to the students' appropriate and inappropriate behaviors in a typical manner to ensure no programmed changes in the contingencies for student behavior. Results indicated improvements in classroom behavior for all four students, and teachers and students indicated positive perceptions about the intervention and its effects. Implications for future research and practice are discussed.

The STEM Early College Expansion Project is an effort to integrate STEM strategies with the early college model and implement this in comprehensive high schools. This report summarizes findings from two separate quasi-experimental impact studies of the model in Michigan and Connecticut. Results from Michigan showed statistically significant impacts on enrollment in college-level courses and on attainment of college credits. Treatment schools in Michigan also had descriptively lower dropout rates. The Connecticut impact study had challenges with the study design that resulted in an inability to make clear causal claims about the impact.

Building on a previous randomized experiment of the impact of Early Colleges (ECs) (Berger et al., 2013), this follow-up study assessed longer-term impacts of ECs on students' postsecondary outcomes 6 years after expected high school graduation. It also explored the extent to which students' high school experiences mediate EC impacts. Specifically, this study addressed three research questions: (1) Did EC students have better postsecondary outcomes (i.e., college enrollment and degree attainment) than control students? (2) Did the impacts of ECs vary by student background characteristics (i.e., gender, race/ethnicity, low-income status, and prior mathematics and English language arts [ELA] achievement)? and (3) Were the impacts of ECs mediated by students' high school experiences (i.e., college credit accrual during high school, instructional rigor, college-going culture, and student supports)? To answer these questions for the follow-up study, the authors analyzed 4 more years of postsecondary outcome data from the StudentTracker Service at the National Student Clearinghouse for students participating in the EC admission lotteries that were the basis of the previous impact study. They also analyzed data on student background characteristics from administrative records and data on high school experiences from a student survey administered in the previous impact study 5 or 6 years after students entered the ninth grade. [To view the earlier report, "Early College, Early Success: Early College High School Initiative Impact Study," see ED577243.]

Empirical Education Inc. is the independent evaluator of SRI International's 2014 Investing in Innovation (i3) Development grant called Redesigning Secondary Courses to Improve Academic Outcomes for Adolescents with Disabilities and Other Underperforming Adolescents. The goal of the grant is to develop "Enhanced Units" that combine research-based content enhancement routines, collaboration strategy, and technology components for secondary U.S. History and biology classes. This report presents findings of a randomized control trial (RCT) during the 2017-18 school year. The RCT measured the impact of "Enhanced Units" on higher order content skills (as measured through unit tests) in high school biology and U.S. History classes in three districts in Virginia and California. SRI, the Center for Applied Special Education Technology (CAST), and their research and practitioner partners developed "Enhanced Units" (EU) with the goal of integrating research-based content enhancement routines with technological enhancements to improve student content learning and higher order reasoning, especially for students with disabilities or other learning challenges. This study also documents the extent to which the core components of EU were implemented with fidelity. The authors provide descriptive results on classroom practices (as measured by teacher surveys) and contextual factors that support or hinder implementation (as described during teacher interviews). Future improvements to EU should focus on answering the question: "What is/are the best way(s) for teachers to present SIM routines to their students, particularly for students with learning challenges through SIM intervention?"

The Learning by Making (LbyM) project is funded by the U.S. Department of Education's Investing in Innovation Fund (i3). As a five-year development project (2014-2018), Sonoma State University (SSU), in partnership with high-need schools and districts, has been developing an innovative, integrated high school Science, Technology, Engineering, and Mathematics (STEM) curriculum. The curriculum consists of Disciplinary Core Ideas (DCIs) in earth science and biology as described in the Next Generation Science Standards (NGSS, 2013) and utilizes an easy-to-use Logo programming language that conducts data transfer and network communications in support of student-designed investigations. The purpose of this study is to understand how LbyM is implemented in high school classrooms in rural environments, to observe the influences of this curriculum on student learning and engagement, and to explore how teachers' instructional practices and technological capacities evolve while using the curriculum. The study used a quasi-experimental design. One hundred thirty-seven students were recruited to enroll in eight LbyM STEM classes in six participating high schools. Three of the participating high schools are small schools, and it is not possible to find comparison students from these small schools. Therefore, all comparison students were recruited from the larger schools, with a total of 141 comparison students from six classrooms in three out of six participating high schools. The results from the study indicated that the LbyM curriculum that was developed by SSU helped teachers integrate NGSS and project-based learning into classroom instruction. Teachers reported spending more instructional time supporting students to collect, organize, display, and present data. Students were highly engaged with the LbyM curriculum and demonstrated increased confidence and problem solving stamina. Teachers reported that some students who typically struggle to participate in class exhibited higher levels of participation in LbyM and even demonstrated leadership. They also reported that some students with special needs, while still requiring extra attention, remained engaged with the curriculum and were even quicker to complete certain activities than the other students. The LbyM curriculum was positively associated with significant gains in students' science content knowledge. It helped low-achieving students improve math understanding.

Developed in response to concerns that too few students were enrolling and succeeding in postsecondary education, early college high schools are small schools that blur the line between high school and college. This article presents results from a longitudinal experimental study comparing outcomes for students accepted to an early college through a lottery process with outcomes for students who were not accepted through the lottery and enrolled in high school elsewhere. Results show that treatment students attained significantly more college credits while in high school, and graduated from high school, enrolled in postsecondary education, and received postsecondary credentials at higher rates. Results for subgroups are included. [This paper was published in the "Journal of Research on Educational Effectiveness" (EJ1135800)]

This study reports 2 years of findings from a randomized controlled trial designed to replicate and demonstrate the efficacy of an existing, successful professional development program, the Pathway Project, that uses a cognitive strategies approach to text-based analytical writing. Building on an earlier randomized field trial in a large, urban, low socioeconomic status (SES) district in which 98% of the students were Latino and 88% were mainstreamed English learners (ELs) at the intermediate level of fluency, the project aimed to help secondary school students, specifically Latinos and mainstreamed ELs, in another large, urban, low-SES district to develop the academic writing skills called for in the rigorous Common Core State Standards for English Language Arts. The Pathway Project draws on well-documented instructional frameworks that support approaches that incorporate strategy instruction to enhance students' academic literacy. Ninety-five teachers in 16 secondary schools were stratified by school and grade and then randomly assigned to the Pathway or control group. Pathway teachers participated in 46 hr of training to help students write analytical essays. Difference-in-differences and regression analyses revealed significant effects on student writing outcomes in both years of the intervention (Year 1, d = 0.48; Year 2, d = 0.60). Additionally, Pathway students had higher odds than control students of passing the California High School Exit Exam in both years.

The National Math + Science Initiative's (NMSI's) College Readiness Program (CRP) is an established program whose goal is to promote science, technology, engineering, and mathematics education in high schools to improve students' readiness for college. It provides teacher, student, and school supports to promote high school students' success in mathematics, science, and English Advanced Placement (AP) courses, with a focus on students who are traditionally underrepresented in the targeted AP courses. Through a federal Investing in Innovation Fund (i3) validation grant awarded to NMSI in 2011, CRP was implemented in a total of 58 high schools in two states--Colorado and Indiana--beginning in the 2012-13 school year. American Institutes for Research (AIR) conducted an independent evaluation of the impacts of CRP on students' AP outcomes in these schools for the three cohorts of schools that adopted the program in sequential years, using a comparative interrupted time series (CITS) design that matched comparison schools to program schools in the two states. Overall, schools implementing CRP demonstrated significantly larger increases in the share of students taking and passing AP tests in targeted areas relative to comparison schools in each of the three cohorts of schools, and the gains in CRP schools were sustained over time. Fidelity of program implementation was evaluated using a fidelity matrix approach required as part of the National Evaluation of the i3 program, which showed that not all elements of the program were implemented with high fidelity. Teachers and students were not always able to attend all meetings, and schools did not always meet negotiated enrollment targets. Teacher survey data indicated that teachers found the professional development activities provided by CRP to be the most helpful support they received under CRP, and students reported that the tutoring and special study sessions were the most helpful. Although the program provided financial incentives to both teachers and students that were tied to student performance on AP tests, these incentives were considered the least important element of the program by both teachers and students

Enhancing the social and learning experiences of students with severe disabilities in inclusive classrooms has been a long-standing focus of research, legislative, and advocacy efforts. The authors used a randomized controlled experimental design to examine the efficacy of peer support arrangements to improve academic and social outcomes for 51 students with severe disabilities in high school general education classrooms. Paraprofessionals or special educators recruited, trained, and supported 106 peers to provide individualized academic and social assistance to students with severe disabilities throughout one semester. Compared to students exclusively receiving adult-delivered support (n = 48), students participating in peer support arrangements experienced increased interactions with peers, increased academic engagement, more progress on individualized social goals, increased social participation, and a greater number of new friendships. Moreover, an appreciable proportion of relationships lasted one and two semesters later after the intervention had concluded. These findings challenge prevailing practices for supporting inclusive education and establish the efficacy and social validity of peer support arrangements as a promising alternative to individually assigned paraprofessional support.

The purpose of this experimental study is to investigate the effects of using content acquisition podcasts (CAPs), an example of instructional technology, to provide vocabulary instruction to adolescents with and without learning disabilities (LD). A total of 279 urban high school students, including 30 with LD in an area related to reading, were randomly assigned to one of four experimental conditions with instruction occurring at individual computer terminals over a 3-week period. Each of the four conditions contained different configurations of multimedia-based instruction and evidence-based vocabulary instruction. Dependent measures of vocabulary knowledge indicated that students with LD who received vocabulary instruction using CAPs through an explicit instructional methodology and the keyword mnemonic strategy significantly outperformed other students with LD who were taught using the same content, but with multimedia instruction that did not adhere to a specific theoretical design framework. Results for general education students mirrored those for students with LD. Students also completed a satisfaction measure following instruction with multimedia and expressed overall agreement that CAPs are useful for learning vocabulary terms.

In 2002, the Bill & Melinda Gates Foundation launched the Early College High School Initiative (ECHSI) with the primary goal of increasing the opportunity for underserved students to earn a postsecondary credential. To achieve this goal, Early Colleges provide underserved students with exposure to, and support in, college while they are in high school. Early Colleges partner with colleges and universities to offer all students an opportunity to earn an associate's degree or up to two years of college credits toward a bachelor's degree during high school at no or low cost to the students. The underlying assumption is that engaging underrepresented students in a rigorous high school curriculum tied to the incentive of earning college credit will motivate them and increase their access to additional postsecondary education and credentials after high school. Since 2002, more than 240 Early Colleges have opened nationwide. This study focused on the impact of Early Colleges. It addressed two questions: (1) Do Early College students have better outcomes than they would have had at other high schools?; and (2) Does the impact of Early Colleges vary by student background characteristics (e.g., gender and family income)? To answer these questions, the authors conducted a lottery-based randomized experiment, taking advantage of the fact that some Early Colleges used lotteries in their admissions processes. By comparing the outcomes for students who participated in admissions lotteries and were offered enrollment with the outcomes for students who participated in the lotteries but were not offered enrollment, they can draw causal conclusions about the impact of Early Colleges. The primary student outcomes for this study were high school graduation, college enrollment, and college degree attainment. The authors also examined students' high school and college experiences. Data on student background characteristics and high school outcomes came from administrative records from schools, districts, and states; data on college outcomes came from the National Student Clearinghouse (NSC); and data on high school and college experiences and intermediate outcomes such as college credit accrual came from a student survey. The authors assessed the impact of Early Colleges on these outcomes for a sample of 10 Early Colleges that did the following: (1) Enrolled students in grades 9-12 and had high school graduates in the study years (2005-2011); (2) Used lotteries as part of the admission processes in at least one of the study cohorts (students who entered ninth grade in 2005-06, 2006-07, or 2007-08); and (3) Retained the lottery records. Eight of the 10 Early Colleges in the study were included in the student survey. The overall study sample included 2,458 students and the survey sample included 1,294 students. The study extended through three years past high school.

Dual enrollment in high school is viewed by many as one mechanism for widening college admission and completion of low-income students. However, little evidence demonstrates that these students discretely benefit from dual enrollment and whether these programs narrow attainment gaps vis-a-vis students from middle-class or affluent family backgrounds. Using the National Longitudinal Study of 1988 ("N"= 8,800), I find significant benefits in boosting rates of college degree attainment for low-income students while holding weaker effects for peers from more affluent backgrounds. These results remain even with analyses from newer data of college freshman of 2004. I conduct sensitivity analyses and find that these results are robust to relatively large unobserved confounders. However, expanding dual enrollment programs would modestly reduce gaps in degree attainment. (Contains 1 note and 4 tables.)

This ex post facto study evaluated Achieving a College Education (ACE) Plus program, a credit-based transition program between a high school district and a community college. Achieving a College Education Plus is an early outreach program. It is designed to aid at-risk students in graduating from high school and making a smooth transition to higher education, while taking college courses and earning college credit. The authors examined the efficacy of Achieving a College Education Plus with respect to retention rates, graduation rates, and rate of transfer to colleges. Sixty high school students who had participated in Achieving a College Education Plus were matched to a sample of 60 non-Achieving a College Education Plus students. Archival records, postgraduate survey, and school district transcript information comprised three sources of data for this study. Using a series of logistic regression analyses to assess data and provide adequate controls for prior academic achievement, the authors determined that there were no differences in the findings with respect to gender, ethnicity, and language spoken in the home. However, statistically significant differences were found in favor of the Achieving a College Education Plus program with regard to student retention, graduation, and college enrollment. With an increasing emphasis on college readiness and student retention, this study is timely and contributes empirical data and findings to the community college literature. (Contains 4 tables.)

Portland Public Schools (PPS), the largest school district in Oregon, serves more than 46,000 students in regular and special programs. More than 2,900 classroom teachers address the needs of a diverse student population (44% minority, 46% low income, 14% special education, 9% English language learners). A district needs assessment in fall 2005 revealed that 13 of Portland's 85 regular schools were eligible to participate in the Striving Readers program. Four of the high schools and 5 of the middle schools determined that they could meet the program's research requirements. All 9 schools had at each grade level a significant number of students who were at least 2 years behind in reading achievement; all received Title I funding; and none had achieved Adequate Yearly Progress under No Child Left Behind at the time of the Striving Readers application. School leaders expected the Striving Readers program to impact more than 6,400 students and 450 teachers in the 9 participating schools. After examining adolescent reading programs and studying the research on adolescent literacy, Portland Public Schools selected the Strategic Instruction Model Content Literacy Continuum developed by the University of Kansas' Center for Research on Learning to improve teacher instruction and student reading achievement in the participating middle and high schools. This report summarizes Year 1 (2006-2007), Year 2 (2007-2008), Year 3 (2008-2009), Year 4 (2009-2010), and Year 5 (2010-2011) of implementation of the targeted intervention for students reading at least 2 years below grade level in Grades 7-10 and the whole school intervention designed to help all students in Grades 6-12 learn the critical content in all curricular areas.

Aimed at low-income families in six of New York City's highest-poverty communities, Family Rewards ties cash rewards to a pre-specified set of activities and outcomes thought to be critical to families' short- and long-term success in the areas of children's education, family preventive health care, and parents' employment. The purpose of this project is to experimentally evaluate the effects of this three-year innovative holistic conditional cash transfer (CCT) initiative. This paper presents initial findings from an ongoing and comprehensive evaluation of Family Rewards. It examines the program's implementation in the field and families' responses to it during the first two of its three years of operations, and early findings on the program's impacts on children's educational processes and outcomes. More specifically, this paper addresses the following questions: (1) What are the effects of ONYC-Family Rewards on family income, poverty, and financial hardship?; (2) What are the effects of ONYC-Family Rewards on use of health care and health insurance?; (3) What are the effects of ONYC-Family Rewards on parents' employment and educational attainment?; and (4) What are the effects of ONYC-Family Rewards on children's educational outcomes? Overall, this study shows that, despite an extraordinarily rapid start-up, the program was operating largely as intended by its second year. Although many families struggled with the complexity of the program, most were substantially engaged with it and received a large amount of money for meeting the conditions it established. Specifically, nearly all families (98 percent) earned at least some rewards in both program years, with payments averaging more than $6,000 during the first two program years combined. The program reduced current poverty and hardship; increased savings; increased families' continuous use of health insurance coverage and increased their receipt of medical care; and increased employment in jobs that are not covered by the unemployment insurance (UI) system but reduced employment in UI-covered jobs. The program has had mixed success in improving children's academic performance specifically. Contrary to expectations, Family Rewards did not affect school attendance or annual standardized test scores in Math and English Language Arts (ELA) for either group of youngest children, but did lead to notable gains for a group of more academically prepared high school students. The program also had important effects on several key proposed mediators of the intervention. However, these effects vary by parents with different age groups of children. Appended are: (1) References; and (2) Tables and Figures. (Contains 2 tables.)

The District of Columbia School Choice Incentive Act of 2003, passed by Congress in January 2004, established the first federally funded, private school voucher program in the United States. Since that time, more than 8,400 students have applied for what is now called the DC Opportunity Scholarship Program (OSP), and a rigorous evaluation of the Program, mandated by Congress, has been underway. This last formal report from the ongoing evaluation describes the impacts of the Program at least four years after families who applied and were given the option to move from a public school to a participating private school of their choice. The research priorities for the evaluation were shaped largely by the primary topics of interest specified in the statute. This legislative mandate led the evaluators to focus on the following research questions: (1) What is the impact of the Program on student academic achievement? (2) What is the impact of the Program on other student measures? (3) What effect does the Program have on school safety and satisfaction? (4) What is the effect of attending private versus public schools? (5) To what extent is the Program influencing public schools and expanding choice options for parents in Washington, DC? These research questions are consistent with the topics that scholars and policymakers have identified as important questions of interest surrounding private school scholarship programs. The report found that that the Program had mixed longer-term effects on participating students and their parents, including: (1) No conclusive evidence that the OSP affected student achievement overall, or for the high-priority group of students who applied from "schools in need of improvement"; (2) The Program significantly improved students' chances of graduating from high school, according to parent reports. Overall, 82 percent of students offered scholarships received a high school diploma, compared to 70 percent of those who applied but were not offered scholarships. This graduation rate improvement also held for the subgroup of OSP students who came from "schools in need of improvement."; and (3) Although parents had higher satisfaction and rated schools as safer if their child was offered or used an OSP scholarship, students reported similar ratings for satisfaction and safety regardless of whether they were offered or used a scholarship. Appendices include: (1) Research Methodology; (2) Benjamini-Hochberg Adjustments for Multiple Comparisons; (3) Sensitivity Testing; (4) Relationship Between Attending a Private School and Key Outcomes; (5) Detailed ITT Tables; (6) Exploration of Whether Parents Get What They Seek From School Choice; (7) To What Extent Are Treatment Effects of the OSP Observed Across the Outcome Test-Score Distribution? Quantile Regression Analysis of the OSP; and (8) Intermediate Outcome Measures. (Contains 99 tables, 31 figures, and 61 footnotes.)

In the No Child Left Behind Act (NCLB), Congress called for the U.S. Department of Education (ED) to conduct a rigorous study of the conditions and practices under which educational technology is effective in increasing student academic achievement. A 2007 report presenting study findings for the 2004-2005 school year, indicated that, after one school year, differences in student test scores were not statistically significant between classrooms that were randomly assigned to use software products and those that were randomly assigned not to use products. School and teacher characteristics generally were not related to whether products were effective. The second year of the study examined whether an additional year of teaching experience using the software products increased the estimated effects of software products on student test scores. The evidence for this hypothesis is mixed. For reading, there were no statistically significant differences between the effects that products had on standardized student test scores in the first year and the second year. For sixth grade math, product effects on student test scores were statistically significantly lower (more negative) in the second year than in the first year, and for algebra I, effects on student test scores were statistically significantly higher in the second year than in the first year. The study also tested whether using any of the 10 software products increased student test scores. One product had a positive and statistically significant effect. Nine did not have statistically significant effects on test scores. Five of the insignificant effects were negative and four were positive. Study findings should be interpreted in the context of design and objectives. The study examined a range of reading and math software products in a range of diverse school districts and schools. But it did not study many forms of educational technology and it did not include many types of software products. How much information the findings provide about the effectiveness of products that are not in the study is an open question. Products in the study also were implemented in a specific set of districts and schools, and other districts and schools may have different experiences with the products. The findings should be viewed as one element within a larger set of research studies that have explored the effectiveness of software products. Three appendixes are included: (1) Second-Year Data Collection and Response Rates; (2) Description of Sample for the 10 Products; and (3) Details of Estimation Methods. (Contains 29 footnotes, 4 figures and 24 tables.

The "District of Columbia School Choice Incentive Act of 2003," passed by the Congress in January 2004, established the first federally funded, private school voucher program in the United States. The purpose of the new scholarship program was to provide low-income residents, particularly those whose children attend schools in need of improvement or corrective action under the "Elementary and Secondary Education Act," with "expanded opportunities to attend higher performing schools in the District of Columbia" (Sec. 303). As part of this legislation, the Congress mandated a rigorous evaluation of the impacts of the Program, now called the "DC Opportunity Scholarship Program" (OSP). This report presents findings from the evaluation on the impacts three years after families who applied were given the option to move from a public school to a participating private school of their choice. The evaluation is based on a randomized controlled trial design that compares the outcomes of eligible applicants randomly assigned to receive (treatment group) or not receive (control group) a scholarship through a series of lotteries. The main findings of the evaluation so far include: (1) After 3 years, there was a statistically significant positive impact on reading test scores, but not math test scores; (2) The OSP had a positive impact overall on parents' reports of school satisfaction and safety, but not on students' reports; (3) This same pattern of findings holds when the analysis is conducted to determine the impact of using a scholarship rather than being offered a scholarship; (4) The OSP improved reading achievement for 5 of the 10 subgroups examined; and (5) No achievement impacts were observed for five other subgroups of students, including those who entered the Program with relative academic disadvantage. Six appendices are included: (1) Research Methodology; (2) Benjamini-Hochberg Adjustments for Multiple Comparisons; (3) Sensitivity Testing; (4) Detailed ITT Tables; (5) Relationship Between Attending a Private School and Key Outcomes; and (6) Intermediate Outcome Measures.. (Contains 115 footnotes, 15 figures and 129 tables.) [For Executive Summary, see ED504784. For "Evaluation of the DC Opportunity Scholarship Program: Impacts after Two Years", see ED501696. For "Evaluation of the DC Opportunity Scholarship Program: Impacts after One Year", see ED497154.]

This research investigates the relative effectiveness (in terms of student tested achievement) of Teach for America (TFA) teachers, and examines the validity of the criticisms of TFA. Specifically, the authors look at TFA teachers in secondary schools, and especially in math and science, where considerable program growth is planned over the next few years. Using individual level student data linked to teacher data in North Carolina, the authors estimate the effects of having a TFA teacher compared to a traditional teacher on student performance. The North Carolina data they employ are uniquely suited for this type of analysis because it includes end of course (EOC) testing for students across multiple subjects. This allows them to employ statistical methods that attempt to account for the nonrandom nature of student assignments to classes/teachers, which have been shown to lead to biased estimates of the impact of teacher credentials (Clotfelter, Ladd, and Vigdor, 2007a; Goldhaber, 2007). The findings show that TFA teachers are more effective, as measured by student exam performance, than traditional teachers. Moreover, the authors suggest that the TFA effect, at least in the grades and subjects investigated, exceeds the impact of additional years of experience, implying that TFA teachers are more effective than experienced secondary school teachers. The positive TFA results are robust across subject areas, but are particularly strong for math and science classes. An appendix is included. (Contains 1 figure, 12 tables, 1 exhibit and 14 footnotes.) [This report was supported by the Steven L. Merrill Family Foundation.]

An experimental research design was used to examine the effectiveness of a targeted, long-term intervention to promote school completion and reduce dropout among urban high school students with emotional or behavioral disabilities. African American (67%) males (82%) composed a large portion of the sample. This intervention study was a replication of an empirically supported model referred to as check & connect. Study participants included 144 ninth graders, randomly assigned to the treatment or control group. The majority of youth were followed for 4 years, with a subsample followed for 5 years. Program outcomes included lower rates of dropout and mobility, higher rates of persistent attendance and enrollment status in school, and more comprehensive transition plans.

Explores the use of analogies while teaching important concepts in secondary content classrooms containing students of diverse abilities. Measures included students' knowledge of concepts, the numbers and types of analogies teachers used, and teacher and student satisfaction. Results reveal that teacher use of the routine led to increased student retention and expression of information. (Contains 49 references and 2 tables.) (Author/GCP)

This report focuses on young mothers who had children as teenagers, who had dropped out of high school, and who were receiving Aid to Families with Dependent Children. It was a voluntary demonstration project that provided comprehensive education, training, and other services intended to increase the long-term self-sufficiency and well-being of these mothers and their children. The evaluation of New Chance is one of the few large-scale, rigorous evaluations of programs designed to change the outcomes for this population. This is the last in a series of reports from the study. A variety of community-based organizations implemented the program well in 16 diverse sites, although participation by the enrollees was uneven. At the 18-month follow-up point, the program had created a substantial increase in educational attainment, with acquisition of a General Educational Development certificate by many participants, greater use of good quality child care, and improvement in parenting skills, balanced against high rates of repeat pregnancy, inconsistent program attendance, and the fact that more than 80% of the participants were still on welfare. A monograph based on 50 interviews with participants explored some of the circumstances behind these findings. This report extends the study to 42 months of follow-up. The 2,079 young mothers who were studied in the follow-up are now 22.4 years of age on average. For many measures, outcomes have improved for these young women since they enrolled in New Chance, but the sobering news is that the absolute levels of progress leave these families far from self-sufficiency. For most outcomes, New Chance did not improve progress over and above that shown by an equivalent group of young women who did not attend New Chance. Although the New Chance experience provides few definitive answers about what should be done, it does raise critical questions about the direction and consequences of public policy, and it does indicate the need for public policies that move beyond the scope of the welfare system to enhance young mothers' efforts to become self-sufficient. (Contains eight tables.) (SLD)

This study investigated the effectiveness of using a computer program over six weeks to teach high school students to use Latin and Greek root words for deciphering English terms in order to increase their scores on the verbal portion of the Scholastic Aptitude Test. Results indicated that knowledge of Latin and Greek root words improved students' English skills. (SM)

Compared students who had four years of the University of Chicago School Mathematics Project (UCSMP) secondary curriculum to two distinct groups of comparable students at three different sites (one urban and two suburban). UCSMP students at all three sites achieved higher but registered little difference in attitude. (Contains 48 references.) (MDH)

This is the final report of an independent evaluation of the CompuPower program that was developed by Arizona State University's Center for Gender Equity in Science and Technology (ASU CGEST). CompuPower is a multifaceted program for high school students that is centered on a culturally responsive computing course that includes four key components: the CompuPower course curriculum, mentor teacher professional development, a multi-day CompuPower Residency Experience, and a series of parent workshops. The evaluation of the CompuPower program was funded with a development grant from the U.S. Department of Education's Investing in Innovation (i3) program and carried out by the American Institutes for Research (AIR) over the 2019-20 and 2020-21 school years in nine mostly rural high schools. The evaluation employed a quasi-experimental matched comparison design to estimate the impact of CompuPower on one confirmatory student social emotional outcome--self-regulation--and two exploratory outcomes--critical thinking skills in everyday life and grade point average. The evaluation also assessed the implementation fidelity of the four key CompuPower program components. Across the four program components, only the mentor teacher professional development was implemented with fidelity. Most implementation challenges for the other three program components resulted from the COVID-19 pandemic, but there were other challenges as well. CompuPower students showed slightly higher scores on self-regulation, critical thinking skills in everyday life, and GPA measures than comparison group students, but the differences were not statistically significant.

Although Oregon has made recent gains in its overall high school graduation rate, 21?percent of public school students entering grade?9 in 2014 did not graduate within four years, by 2018. To improve graduation rates, Oregon voters approved Ballot Measure 98 in 2016 to fund dropout prevention and college and career readiness initiatives in high schools. Many districts used the funding to adopt an early indicator and intervention system (EIIS) to identify students who are not on track to graduate on time by monitoring related indicators, such as chronic absenteeism, disciplinary infractions, course progression, and academic performance, through a frequently updated data system. Districts can tailor the system by setting their own on-track thresholds for each indicator to identify students at risk of not graduating on time, assigning those students to interventions, and monitoring student response to the interventions. This study took advantage of the additional funding being offered to districts across the state to look at first-year effects on chronic absenteeism, disciplinary infractions, course progression, and academic performance by comparing the outcomes in 65 districts that adopted an EIIS to the outcomes in a set of similar districts that used the additional funding for other dropout prevention or college and career readiness initiatives. The study offers insight into the effectiveness of early efforts to scale up EIISs, a popular school-level intervention. EIIS adoption appears to have reduced the percentage of students who were chronically absent by 3.9?percentage points but does not appear to have had positive effects on the three other student outcomes during the first year: the percentage of students with disciplinary infractions, the percentage of grade?10 students who had acquired enough credits by the end of grade?9 to be considered on track for on-time graduation, or the percentage of grade?11 students meeting or exceeding proficiency standards on state math and English language arts tests. The findings offer the Oregon Department of Education information on the early effects of its efforts to promote EIIS across Oregon. The findings can also be used by other state and district education leaders to inform their considerations to scale up EIIS or other similar programs. [For the Study Snapshot, see ED614631. For the appendixes, see ED614632.]

We provide theory and evidence about how the design of college financial aid programs affects a variety of high school, college, and life outcomes. The evidence comes from an eight-year randomized trial where 2,587 high school ninth graders received a $12,000 merit-based grant offer. During high school, the program increased their college expectations and non-merit effort but had no effect on merit-related effort (e.g., GPA). After high school, the program increased graduation from two-year colleges only, apparently because of the free college design/framing in only that sector. But we see no effects on incarceration or teen pregnancy. Overall, the results suggest that free college affects student outcomes in ways similar to what advocates of free college suggest and making aid commitments early, well before college starts, increases some forms of high school effort. But we see no evidence that merit requirements are effective. Both the standard human capital model and behavioral economics are required to explain these results.

The Louisiana Scholarship Program (LSP) offers publicly funded vouchers to moderate- and low-income students in low-performing public schools to enroll in participating private schools. Established in 2008 as a pilot program in New Orleans, the LSP expanded statewide in 2012. Drawing upon the random lotteries that placed students in LSP schools, we estimate the causal impact of using an LSP voucher to enroll in a private school on student achievement on the state accountability assessments in math, English Language Arts, and science over a four-year period, as well as on the likelihood of enrolling in college. The results from our primary analytic sample indicate substantial negative achievement impacts, especially in math, that diminish after the first year but persist after four years. In contrast, when considering the likelihood of students entering college, we observe no statistically significant difference between scholarship users and their control counterparts.

In 2016, McREL and the University of Southern California (USC) were awarded a grant from the U.S. Department of Education's Investing in Innovation (i3) Fund (Award Number U411C150011) to develop a translation of the identity-based motivation (IBM) in vivo program "Pathways to Success" to a digital platform to deliver IBM to middle and high school students. The resulting digital "Pathways to Success" program consisted of 12 15-minute digital platform activities, planned to take place over the first six to eight weeks in the Fall semester of 2017 in 10 schools from five districts in Colorado. While the former McREL research director and the original external evaluator led the field operation and the randomization process, in 2018, there was a change in the Principal Investigator at McREL, and an evaluator from USC was contacted to conduct the independent evaluation. Project data, including student and teacher responses and administrative data from schools in years 2016-2017, 2017-2018, and 2018-2019 were provided by McREL to the USC evaluator. The report documented the implementation fidelity and examined the impact of digital "Pathways to Success" on students' overall, English language, and Math achievement, and "non-cognitive" variables in the IBM theory.

This study reports findings from a multisite cluster randomized controlled trial designed to validate and scale up an existing successful professional development program that uses a cognitive strategies approach to text-based analytical writing. The Pathway to Academic Success Project worked with partner districts affiliated with 4 National Writing Project (NWP) sites in southern California. Informed by a wide body of research on the efficacy of strategy instruction to enhance students' academic literacy, the intervention aimed to help secondary school students, particularly Latinos and mainstreamed English learners, to develop the academic writing skills called for in the rigorous Common Core State Standards for English Language Arts. Two hundred thirty teachers from partner districts affiliated with the NWP sites were stratified by school and grade and then randomly assigned to the treatment or control group. Treatment teachers participated in 46 hrs of training and learned how to apply cognitive strategies by using an on-demand writing assessment to help students understand, interpret, and write analytical essays about nonfiction texts. Multilevel models revealed significant effects on a holistic measure of an on-demand writing assessment (d = 0.32) as well as on 4 analytic attributes: content (d = 0.31), structure (d = 0.29), fluency (d = 0.27), and conventions (d = 0.32). Four dimensions of scaling up--spread, reform ownership, depth, and sustainability--are also discussed.

In contrast to prior federally mandated school reforms, the Every Student Succeeds Act (ESSA) allows states more discretion in reforming their lowest performing schools, removes requirements to disrupt the status quo, and does not allocate substantial additional funds. Using a regression discontinuity design, we evaluate a state turnaround initiative aligned with ESSA requirements. We find the effect on student achievement was not significant in year one and -0.13 in year two. Also, in year two, we find that teachers in turnaround schools were 22.5 percentage points more likely to turn over. While the increased teacher turnover in NCT schools in 2017 opens the possibility that reform schools were intentionally replacing less effective teachers with more effective ones, our analysis does not support that strategic staffing occurred. The negative effects on student achievement appear related to variable timing of implementation of one of the few required components for serving low-performing schools under ESSA--a comprehensive needs assessment which leads to comprehensive school improvement plans. These findings may serve as a cautionary tale for states planning low-performing school reforms under ESSA.

Pre-college advising programs exist in most disadvantaged high schools throughout the United States. These programs supplement traditional advising by high school guidance counselors and attempt to help underrepresented and disadvantaged students overcome the complexities of the postsecondary admission and financial aid processes. Existing evidence on these programs often uses within-school randomization where spillovers and alternative supports may confound estimates. We provide the first evidence on a whole school intervention resulting from a school-level randomized controlled trial in the United States. The college access program we study uses a near-peer model where a recent college graduate works at the school assisting students in the application and enrollment process. Pooled results across the first three years of program implementation find no significant impacts on overall college enrollment. However, subgroup analyses reveal positive, significant effects among the groups most targeted by the intervention: Hispanic and low-income students. Most of the impact comes through increasing two-year college enrollment, but this appears to be new entrants rather than inducing students to move from four-year to two-year colleges. The observed positive effects for these subgroups attenuate over time. We attribute this drop in the estimated impact to departures in fidelity of the experiment. Even among the cohorts for which we find positive enrollment impacts, we find no significant impacts on college persistence. [For the grantee submission, see ED594418.]

The study examined the effect of National Board Certified Teachers (NBCTs) in instructional leadership roles, operationalized as mentors to novice teachers, on (a) classroom practices of mentored novice teachers in Grades K-12 and (b) student achievement of mentored teachers' students in Grades 4-8. The study compared outcomes between NBCT mentors and non-NBCT mentors. The study examined the effect of NBCT mentors after one academic year and was conducted in San Francisco Unified School District. Using the Classroom Assessment Scoring System, we examined novice teachers' classroom practices on the domains of Emotional Support, Classroom Organization, Instructional Support, and across all three domains. The results did not reach statistical significance, but the effect sizes for Emotional Support, Classroom Organization, and a global measure across all domains suggest meaningful differences between classroom practices of novice teachers mentored by NBCTs and non-NBCTs. These effect sizes were 0.28, 0.28, and 0.21 standard deviations, respectively. The effect size for the domain of Instructional Support was near zero at -0.06 standard deviations. Our sample size for the analysis of classroom practices did not have sufficient power to estimate differences at a statistically significant level. We examined student achievement using the state's standardized test scores in mathematics and English language arts. Our achievement measure includes either subject: That is, we did not estimate effects separately for mathematics and English language arts. The results suggest that students taught by teachers mentored by NBCTs had a higher level of achievement than students mentored by non-NBCTs. The difference was statistically significant at a p value of 0.05, and the effect size was meaningful at 0.18 standard deviations. Small sample sizes and low statistical power prevent us from making confident conclusions about the effect of NBCTs in instructional leadership roles on classroom practices of supported teachers and student achievement. However, the evidence is encouraging and warrants additional rigorous research on the impact of NBCTs as instructional leaders.

The three-tiered Positive Behavioral Interventions and Supports (PBIS) framework promotes the development of systems and data analysis to guide the selection and implementation of evidence-based practices across multiple tiers. The current study examined the effects of universal (tier 1) or school-wide PBIS (SW-PBIS) in one state's scale-up of this tier of the framework. Annual propensity score weights were generated to examine the longitudinal effects of SW-PBIS from 2006-07 through 2011-12. School-level archival and administrative data outcomes were examined using panel models with an autoregressive structure. The sample included 1,316 elementary, middle, and high schools. Elementary schools trained in SW-PBIS demonstrated statistically significantly lower suspensions during the fourth and fifth study years (i.e., small effect size) and higher reading and math proficiency rates during the first two study years as well as in one and two later years (i.e., small to large effect sizes), respectively. Secondary schools implementing SW-PBIS had statistically significantly lower suspensions and truancy rates during the second study year and higher reading and math proficiency rates during the second and third study years. These findings demonstrate medium effect sizes for all outcomes except suspensions. Given the widespread use of SW-PBIS across nearly 26,000 schools in the U.S., this study has important implications for educational practices and policies. [This paper was published in the "Journal of School Psychology" v73 p41-55 Apr 2019 (ISSN 0022-4405).]

The Parent Leadership Institute (PLI) of Children's Aid (CA), funded via a 2013 Investing in Innovation (i3) development grant operated between the 2014-15 through 2018-19 school years. Key goals of the PLI included: (1) improving the capacity of parents to effectively engage in the school community in support of their child; and (2) increasing the capacity of school staff to create and support environments which are welcoming to and supportive of the active engagement of parents as key members of the school community. Through implementation of the PLI, CA expanded its partnership with six schools located in the South Bronx community of Morrisania, an area characterized by high levels of poverty, health disparities, and crime, and low levels of academic achievement and attainment among both children and adults. This report serves as the final report on this phase of the PLI and includes an exploration of implementation during year 4 (2016-17 school year) and analyses of quantitative data on student academic performance. [This report was prepared for Children's Aid New York.]

Group contingencies have been indicated to be effective in reducing disruptive behavior and increasing academic engagement in school settings. Previous research has demonstrated their efficacy with a wide range of student ages, but there have been few studies with older students who engage in severe disruptive behavior. In the current study, we implemented an interdependent group contingency in three high school classrooms of students aged 14-19 years with histories of delinquency, emotional and behavioral disorder diagnoses, or both. Results indicated that interdependent group contingencies can be effective in reducing the disruptive classroom behavior of these students. Implications for future research and special considerations for this population are discussed.

Empirical Education Inc. is the independent evaluator of SRI International's 2014 Investing in Innovation (i3) Development grant called Redesigning Secondary Courses to Improve Academic Outcomes for Adolescents with Disabilities and Other Underperforming Adolescents. The goal of the grant is to develop "Enhanced Units" that combine research-based content enhancement routines, collaboration strategy, and technology components for secondary U.S. History and biology classes. This report presents findings of a randomized control trial (RCT) during the 2017-18 school year. The RCT measured the impact of "Enhanced Units" on higher order content skills (as measured through unit tests) in high school biology and U.S. History classes in three districts in Virginia and California. SRI, the Center for Applied Special Education Technology (CAST), and their research and practitioner partners developed "Enhanced Units" (EU) with the goal of integrating research-based content enhancement routines with technological enhancements to improve student content learning and higher order reasoning, especially for students with disabilities or other learning challenges. This study also documents the extent to which the core components of EU were implemented with fidelity. The authors provide descriptive results on classroom practices (as measured by teacher surveys) and contextual factors that support or hinder implementation (as described during teacher interviews). Future improvements to EU should focus on answering the question: "What is/are the best way(s) for teachers to present SIM routines to their students, particularly for students with learning challenges through SIM intervention?"

Schools in the Internationals Network for Public Schools (Internationals) are public middle schools, high schools, and academies (i.e., schools within schools) that serve secondary English language learners (ELLs)--in particular, ELLs who have been enrolled in U.S. schools for fewer than 4 years and who are at the lowest levels of English proficiency. With funding from a 5-year Investing in Innovation (i3) development grant from the U.S. Department of Education's Office of Innovation and Improvement, Internationals received an opportunity to implement key components of its model in comprehensive high schools that serve both ELLs and non-ELLs. Internationals designed an intervention--Project RISE (Realizing Instructional Supports for English Language Learners)--that aimed to improve the educational outcomes of ELLs in Grades 9-12 in two schools by changing teachers' instructional practices and several key structures in which students and teachers are organized. The American Institutes for Research (AIR), an external evaluator of Project RISE, was charged with providing both a formative evaluation and an impact evaluation. The purpose of this document is to summarize the findings of formative and impact evaluations of Project RISE. First, the report presents the results of the formative evaluation accumulated during the 4-year evaluation period while the project was being implemented. Then the report presents the results of the impact evaluation conducted after Project RISE was completed.

As originally conceptualized, Early Colleges were small schools focused purposefully on college readiness for all students. Frequently located on college campuses, Early Colleges targeted students who might face challenges in postsecondary education, including students who were the first in their family to go to college, economically disadvantaged students, English Language Learners (ELL), or students who are members of racial or ethnic groups underrepresented in college. The Early College Expansion Partnership (ECEP) is among the first large-scale effort to apply Early College strategies into comprehensive high schools. Supported by a $15 million grant from U.S. Department of Education's Investing in Innovation (i3) program, the ECEP was designed to increase the number of students graduating from high school prepared for enrollment and success in postsecondary education. The project sought to blend high school and college by applying strategies from the successful Early College high school model to 14 middle schools, 12 high schools, and two 6th-12th-grade schools in three districts in two states: Colorado and Texas. ECEP implemented an adapted version of the Early College High School Model. The program provided a set of services that supported implementation of a whole-school reform model emphasizing the creation of a college-preparatory school environment. A primary emphasis of the program was increasing the number of students who participated in college-credit-bearing courses while in high school. This report describes the approach used to assess student impacts and to track changes over time; uses survey and site visit data to describe key changes that have been made at the district and school levels; presents the impact estimates for the core student-level outcomes; places the findings in context and discusses the broader implications of this work; and summarizes the overall findings. [For the companion report, "Implementation Supports of the Early College Expansion Partnership," see ED618696.]

"12 for Life" is an Investing in Innovation (i3) development grant funded by the Office of Innovation and Improvement, U.S. Department of Education. "12 for Life" provides a rigorous STEM curriculum, combined with on-the-job-training, work/life skills development, mentoring, and employment opportunities to high school students who are at high risk of dropping out of school. The impact evaluation used a quasi-experimental design (QED) to examine the effect of "12 for Life" on grade point average (GPA), number of suspensions, and incidence of dropping out of school. "12 for Life" students who enrolled in the program during the 2014-15 school year were followed for three years. Outcomes for "12 for Life" students were compared to a matched sample of students with similar risk factors for dropping out of school who started 10th grade in fall 2014 and who participate in business-as-usual, traditional academic instruction in the high school environment. Comparison students were followed for three years. Results showed no statistically significant impact on grade point average (GPA) at the end of 12th grade, number of suspensions, or incidence of dropping out of school.

"INSPIRE" is an Investing in Innovation (i3) development grant funded by the Office of Innovation and Improvement, U.S. Department of Education. "INSPIRE" provides an innovative integrated K-12 STEM pipeline approach focused on STEM course content and instructional redesign. The INSPIRE model was implemented in Cabarrus County Schools (CCS), which is among the largest school systems in North Carolina, serving nearly 30,000 students in 39 schools. The impact evaluation included two studies that examined the effect of INSPIRE on mathematics and science achievement as measured by North Carolina standardized End-of-Grades assessments. The elementary study (Study 1) used a three-year, longitudinal, single-cohort quasi-experimental design (QED) to assess the impact of INSPIRE on math achievement at the end of 5th grade after two years of program exposure. The secondary study (Study 2) used an individual-level, longitudinal, randomized controlled trial (RCT) with blocking by school level and cohort to assess the effects of INSPIRE on math and science achievement at the end of 7th and 10th grades after two years of program exposure. For both studies, we compared the outcomes of INSPIRE students with similar students from schools that did not offer a STEM program. For the elementary study, propensity score matching (PSM) was used to match INSPIRE elementary students and comparison student samples at baseline (on pre-test math achievement scores, gender, minority status, and economically disadvantaged status) and baseline equivalence was established all pre-test assessment measures; this study met What Works Clearinghouse (WWC) Group Design Standards with Reservations. For the secondary study, the overall and differential attrition rates were low based on the WWC attrition standards (WWC, 2017); this study met WWC Group Design Standards without Reservations. The results of the elementary study indicated a statistically significant difference between the "INSPIRE" treatment group and the business-as-usual comparison group on the math achievement outcome. Comparison students reported a statistically significant higher increase in math achievement than "INSPIRE" students. Results of the secondary study indicated no statistically significant difference between the "INSPIRE" treatment group and the business-as-usual comparison group on the math and science achievement outcome. The duration of students' exposure to INSPIRE, fidelity of implementation, alignment between PBL instruction and NC standardized assessments, and contextual factors that might have weakened the intervention strength relative to business-as-usual conditions are discussed as possible factors that account for these findings. The report concludes with suggestions for future research and implications for education policy.

This study examined the effects of Reading Intervention for Adolescents, a 2-year extensive reading intervention targeting current and former English learners identified as struggling readers based on their performance on the state accountability assessment. Students who enrolled at three participating urban high schools were randomly assigned to the Reading Intervention for Adolescents treatment condition (n = 175) or a business-as-usual comparison condition. Students assigned to the treatment condition participated in the intervention for approximately 50 minutes daily for 2 school years in lieu of a school-provided elective course, which business-as-usual students took consistent with typical scheduling. Findings revealed significant effects for the treatment condition on sentence-level fluency and comprehension (g = 0.18) and on a proximal measure of vocabulary learning (g = 0.41), but not on standardized measures of word reading, vocabulary, or reading comprehension (g range: -0.09 to 0.06). Posthoc moderation analyses investigated whether initial proficiency levels interacted with treatment effects. On sentence-level fluency and comprehension and on vocabulary learning, initial scores were significantly associated with treatment effects--however, in opposite directions. Students who scored low at baseline on sentence reading and comprehension scored relatively higher at posttest on that measure, whereas students who scored high at baseline on the proximal vocabulary measure scored relatively higher at posttest on that measure. The discussion focuses on the difficulty of remediating persistent reading difficulties in high school, particularly among English learners, who are often still in the process of acquiring academic proficiency in English. [This paper was published in the "Journal of Educational Psychology," 2018.]

Students who fail algebra are significantly less likely to graduate on time, and algebra failure rates are consistently high in urban districts. Identifying effective credit recovery strategies is critical for getting students back on track. Online courses are now widely used for credit recovery, yet there is no rigorous evidence about the relative efficacy of online versus face-to-face credit recovery courses. To address this gap, this study randomly assigned 1,224 ninth graders who failed algebra in 17 Chicago public high schools to take an online or face-to-face algebra credit recovery course. Compared to students in face-to-face credit recovery, students in online credit recovery reported that the course was more difficult, were less likely to recover credit, and scored lower on an algebra posttest. There were no statistically significant differences by condition on any outcomes measured during the second year of high school (standardized mathematics test and algebra subtest scores, likelihood of passing subsequent math classes, cumulative math credits, or on-track rates). The benefits and challenges of online learning for credit recovery are discussed in light of the findings to date.

Although high school graduation rates are rising--the national rate was 82 percent during the 2013/14 school year (U.S. Department of Education, 2015)--dropping out remains a persistent problem in the Midwest and nationally. Many schools now use early warning systems to identify students who are at risk of not graduating, with the goal of intervening early to help students get back on track for on-time graduation. Although research has guided decisions about the types of data and indicators used to flag students as being at risk, little is known about the impact of early warning systems on students and schools--and in particular, whether these systems do help get students back on track. This study, designed in collaboration with the REL Midwest Dropout Prevention Research Alliance, examined the impact and implementation of one early warning system--the Early Warning Intervention and Monitoring System (EWIMS)--on student and school outcomes. To assess the impact of EWIMS on student and school outcomes, 73 high schools in three Midwest Region states were randomly assigned to implement EWIMS during the 2014/15 school year (37 EWIMS schools) or to continue their usual practices for identifying and supporting students at risk of not graduating on time and to delay implementation of EWIMS until the following school year (36 control schools). The study included 37,671 students in their first or second year of high school, with 18,634 students in EWIMS schools and 19,037 students in control schools. EWIMS and control schools and students were similar on all background characteristics prior to random assignment. The study examined the impacts of EWIMS on indicators of student risk and on student progress in school after the first year of EWIMS adoption. The study found that EWIMS reduced the percentage of students with risk indicators related to chronic absence and course failure but not related to low GPAs or suspension: (1) The percentage of students who were chronically absent (missed 10 percent or more of instructional time) was lower in EWIMS schools (10 percent) than in control schools (14 percent); this 4 percentage point difference was statistically significant; and (2) The percentage of students who failed one or more courses was lower in EWIMS schools (21 percent) than in control schools (26 percent); this 5 percentage point difference was statistically significant; (3) The percentage of students who had a low GPA (2.0 or lower) was 17 percent in EWIMS schools and 19 percent in control schools; this difference was not statistically significant. However, sensitivity analyses that used continuous GPA data instead of the binary risk indicator showed that, on average, GPAs were higher in EWIMS schools (2.98) than in control schools (2.87); this difference was statistically significant; and (4) The percentage of students who were suspended once or more was 9 percent in both EWIMS and control schools; there was no statistically significant difference. EWIMS did not have an impact on student progress in school. That is, there was not a statistically significant difference between EWIMS and control schools in the percentage of students who earned insufficient credits to be on track to graduate within four years (14 percent in both). At the school level, EWIMS did not have a detectable impact on school data culture, that is, the ways in which schools use data to make decisions and identify students in need of additional support. In nearly all participating schools, overall implementation of the EWIMS seven-step process was low, and implementation was challenging. Nevertheless, EWIMS schools were more likely than control schools to report using an early warning system and having a dedicated team to identify and support at-risk students, but EWIMS schools did not differ from control schools in the frequency of data review or the number and type of interventions offered. This report provides rigorous initial evidence that even with limited implementation during the first year of adoption, using a comprehensive early warning system can reduce the percentage of students who are chronically absent or who fail one or more courses. These short-term results are promising because chronic absence and course failure in grades 9 and 10 are two key indicators that students are off track for on-time graduation. However, because the past research linking indicators to on-time graduation is correlational, it is not yet known if improving these indicators leads to improving on-time graduation rates. Also, EWIMS did not have a detectable impact on other measured indicators that are related to students' likelihood of on-time graduation, including low GPAs, suspensions, and earning insufficient credits. Future research is needed to better understand the mechanisms through which EWIMS had an impact on chronic absence and course failure and why EWIMS did not affect other outcomes. In particular, studies could focus on identifying which staff actions and student experiences lead to improved student outcomes. Studies should also examine whether schools achieve improved overall implementation in subsequent years and whether (and how) the observed impacts fade, grow larger, or extend to other risk indicators (low GPAs and suspensions); to intermediate outcomes (including student persistence and progress in school); and to long-term outcomes (including dropout and on-time graduation rates). The following are appended: (1) Planned implementation of the Early Warning Intervention and Monitoring System; (2) Recruitment, random assignment, and study sample; (3) Data collection and analytic methods; (4) Detailed findings and supplementary analyses; and (5) Disclosure of potential conflicts of interest.

In 2011, the University of Alaska Fairbanks (UAF) received an Investing in Innovation (i3) Grant through the U.S. Department of Education. UAF applied for the grant to expand the predominantly rural-serving Alaska Statewide Mentor Project (ASMP) to urban settings. ASMP is a professional development initiative that supplies fully released, highly trained mentors to early career teachers (ECTs). UAF's i3 grant, The Urban Growth Opportunity (UGO), included five districts: Anchorage, Fairbanks North Star Borough, Kenai Peninsula Borough, Matanuska-Susitna Borough, and Sitka. This is the final report for the grant conducted over four years (2011 2012 to 2014 2015). The research team randomly assigned 556 ECTs to treatment (UGO) and business as usual (BAU) groups. UGO ECTs received an ASMP mentor for two years; BAU ECTs received their districts' business as usual support that varied by district and included content coaches without mentoring support and non-ASMP instructional mentoring support. Researchers conducted impact, implementation, and intervention studies. The impact study included seven outcomes: teacher retention; teacher instructional practice as measured by the three Classroom Assessment Scoring System (CLASS®) domains (Emotional Support, Classroom Organization, and Instructional Support); and student achievement in reading, writing, and mathematics as measured by the state assessment. While UGO ECTs were retained as teachers in Alaska public schools at higher rates than BAU ECTs, the difference was not statistically significant. There were no statistically significant differences between UGO and BAU ECTs on instructional practices as measured by CLASS®. Finally, student achievement was generally higher for students of UGO ECTs, but differences in achievement were statistically significant only for some student groups: primary reading students and secondary math students who were White, Hispanic, Alaskan Native, or two or more races. Results from the implementation study, conducted over three of the four years of implementation, found ASMP implemented UGO with fidelity across all components: mentor recruitment and assignment, mentor participation in professional development, mentor interaction with their ECTs, and mentors' use of formative assessment tools. Results from the intervention study identified two types of mentor-mentee dyads: Gliders and Sliders, with gliders engaging in longer conversations, focused more explicitly on instruction and students, responding to each other more often, and engaging as peers more frequently than the slider dyads.

Urban school districts often rely on alternative teacher certification programs to help address ongoing demands for recruiting and hiring qualified teachers. These programs offer pathways into teaching outside of traditional university-based teacher education programs. TNTP's Teaching Fellows program has been one of the most prominent alternative certification providers in the U.S., primarily serving urban communities. TNTP (formerly known as The New Teacher Project) recruits aspiring teachers, whom it refers to as Fellows, through a selective process and provides a summer pre-service training institute and in-service seminars and coaching in the first year of teaching. At the end of the first year of teaching, TNTP uses a performance assessment to determine whether or not Fellows will be recommend for certification. This report summarizes a multi-year evaluation of the implementation and impacts of TNTP's Teaching Fellows program in seven large urban districts, supported by an Investing in Innovation (i3) grant from the U.S. Department of Education. Primary outcomes included student achievement and classroom observation scores in the second year of teaching. We employed quasi-experimental methods to match Fellows and similar new teachers who were not trained by TNTP, and match students of these teachers, using extant de-identified data from districts. This approach allowed us to construct and analyze large samples of teachers and students across districts, including more than 20,000 students taught by approximately 1,000 teachers to examine impacts on student achievement. TNTP implemented the program with fidelity during the evaluation period, with all district sites meeting predetermined benchmarks for implementation of core program components. We found no differences in teacher instructional practice or student achievement between Fellows and matched comparison teachers, though Fellows demonstrated higher retention into the second year of teaching than other new teachers in their districts. These findings suggest that the Teaching Fellows program was able to provide the districts with additional candidates for teaching vacancies without reducing teacher quality or student academic outcomes in these districts.

In 2012, WestEd received a "Development" grant from the U.S. Department of Education's Investing in Innovation (i3) competition to develop and implement Internet-based Reading Apprenticeship Improving Science Education ("iRAISE"). "iRAISE" was implemented in Michigan and Pennsylvania and was provided to over 100 teachers who served approximately 20,000 students during the grant period. This report presents findings from the randomized control trial of "iRAISE," which took place during the 2014-15 school year and investigated the impact of the program on teacher and student outcomes. Data sources for this report include teacher surveys; PD observations and attendance records; school district student records; and an assessment of students' literacy skills. Despite levels of implementation that did not meet the expectations of the program developers, teachers self-reported that they did change their classroom practice as a result of the "iRAISE" program, and impacts of "iRAISE" were greater for students who were performing at lower levels of incoming achievement. Given that "iRAISE" had an impact on teacher practices in literacy instruction and increased benefits for low-achieving students-consistent with positive findings from prior studies, evaluators express confidence in the promise of low-cost, accessible, and high-quality online-only professional Development (PD), addressing the needs of schools struggling to meet the demands of literacy for college and career readiness. Appended are the following: (1) Considerations for Statistical Power; (2) Details of the Approach to Estimating Impacts; (3) Reporting the Results; (4) A Post-Experimental Method to Assessing Impact under Strong Implementation; (5) Fidelity of Implementation; and (6) Teacher Survey Constructs.

The purpose of this study is to describe and examine the structures and policies a public, comprehensive high school put in place to implement problem-based learning (PBL) across content areas. Starting in 2010, the school implemented PBL in the hopes of increasing students' career and college readiness skills. The research took place at a comprehensive, public high school in the Pacific Northwest that serves a racially, ethnically, linguistically, and learning ability-diverse population of students. In this mixed-methods study we share findings describing the impacts of PBL adoption on teacher learning, student learning, and students' career and college readiness. Qualitative data was collected during the 2010-2015 school years. To describe how the school implemented PBL pedagogy, we take a grounded theory approach to qualitative data collection including collection and analysis of teacher and school leader interviews, teacher focus groups, classroom observations, and document review. Quantitative data was collected from the 2002-2015 school years and was part of several exploratory studies meant to examine possible changes in student performance and changes in their career and college readiness using student achievement on Advanced Placement (AP) tests over time as our primary tool of measurement. We compare the mean AP scores of two groups of students, matched according to grade point average (GPA), free and reduced lunch (FRL) status, whether or not students speak a first language other than English at home, and students who qualify for Special Education accommodations (SWD). The first group of students (comparison group) attended the school for at least 3 years before PBL adoption and received no exposure to PBL curriculum or coursework. The second group of students (treatment group) attended the school for at least 3 years during and after the school had adopted PBL and received full exposure to PBL curriculum and coursework. Qualitative findings indicate that between 2010-2015, teachers gained and deepened their expertise in PBL pedagogy and principles in part due to redesigned professional learning experiences provided to teachers during that time. Quantitative findings indicate that students in the treatment group experienced gains on AP scores across multiple AP courses in all four core content areas. Notably, student gains on AP scores were statistically significant in AP Biology, AP Calculus (combined BC and BCAB), AP Chemistry, AP United States Government, AP Psychology, AP United States History, and AP World History. Students in the treatment group also experienced gains in AP pass rates overall that paralleled higher enrollment in AP coursework and increased numbers of AP tests takers. Lastly, the data suggest a strong correlation between the number of PBL courses students complete and an increase in mean AP scores throughout their high school career. While student gains in mean AP scores are encouraging and suggest PBL may augment student performance in AP coursework, more research is needed to further explore this relationship. Our data suggest that PBL-focused school transformation necessitates a long-term, school-wide, inside-out approach. Appendices include: (1) Implementing PBL Classroom Observation Protocol; (2) Key Element Classroom Observation Protocol; and (3) Levels of Use (LOU) Teacher Interview Protocol. (Contains 40 Tables and 39 Charts).

The Reading Apprenticeship instructional framework was developed by WestEd's Strategic Literacy Initiative (SLI) two decades ago to help teachers provide the literacy support students need to be successful readers in the content areas. It has since reached over 100,000 teachers in schools across the country, at the middle school, high school, and college levels. The Reading Apprenticeship framework focuses on four interacting dimensions of classroom learning culture: Social, Personal, Cognitive, and Knowledge-Building. These four dimensions are woven into subject-area teaching through metacognitive conversation--conversations about the thinking processes students and teachers engage in as they read. The context in which this all takes place is extensive reading--increased in-class opportunities for students to practice reading complex academic texts in more skillful ways. Teachers also work with students on explicit comprehension strategy instruction, vocabulary and academic language development techniques, text-based discussion, and writing. Reading Apprenticeship is designed to help teachers create classroom cultures in which students feel safe to share reading processes, problems, and solutions. In 2010, WestEd received a "Validation" grant from the Department of Education's Investing in Innovation Fund (i3) competition to scale-up and conduct a randomized controlled trial of the intervention through a project called Reading Apprenticeship Improving Secondary Success (RAISE). RAISE took place in California, Michigan, Utah, Pennsylvania, and Indiana and worked with nearly 2,000 teachers who served approximately 630,000 students during the grant period. This report presents findings from the randomized controlled trial conducted in two of those states: California and Pennsylvania. The report presents key implementation and impact findings from the i3 impact evaluation of the RAISE project. Most of the findings in this report are from the sample of students and data collected during teachers' second year in the study, after treatment teachers had received the full "dose" of professional development delivered over 12 months and could therefore be expected to fully implement Reading Apprenticeship. Data sources for this report include principal, teacher, and student surveys; professional development observations and attendance records; school district student records; and an assessment of students' literacy skills. Overall, the study's findings demonstrate the potential of RAISE to address the paucity of content-specific reading instruction in U.S. secondary schools--especially in science, where the need may be greatest. Appended are the following: (1) Impact Estimation Model; (2) Student Survey Constructs; (3) Teacher Survey Constructs; (4) Analytic Sample Baseline Equivalence; (5) Student Literacy Assessment; (6) Sample Attrition; (7) Additional Impact Analyses for Teacher Mediating Outcomes; (8) Additional Impact Analyses for Student Mediating Outcomes; (9) Additional Impact Analyses for Student Literacy; (10) Fidelity of Implementation Summary; and (11) Context for Program Implementation.

The purpose of the present study was to extend previous research by evaluating the effect of the interdependent group contingency procedure known as the Good Behavior Game (GBG) on decreasing disruptive behaviors with general-education high school students. Although many studies exist that have used the GBG to alter behaviors across ages ranging from preschool to adulthood, few studies exist in which the GBG has been used in general-education high school classrooms. The present study used separate ABAB withdrawal designs in three classrooms, with withdrawal and reimplementation in two of the classrooms. All three classrooms demonstrated large effect sizes with clear and substantial decreases in disruptive behaviors during the intervention phases. Teachers found the intervention acceptable, supporting the use of a modified version of the GBG in high school classrooms. Students found it generally acceptable as well, though with some reservations regarding certain aspects of the procedure.

We present the results of three large-scale randomized controlled trials (RCTs) carried out in Chicago, testing interventions to reduce crime and dropout by changing the decision-making of economically disadvantaged youth. We study a program called Becoming a Man (BAM), developed by the non-profit Youth Guidance, in two RCTs implemented in 2009-10 and 2013-15. In the two studies participation in the program reduced total arrests during the intervention period by 28-35%, reduced violent-crime arrests by 45-50%, improved school engagement, and in the first study where we have follow-up data, increased graduation rates by 12-19%. The third RCT tested a program with partially overlapping components carried out in the Cook County Juvenile Temporary Detention Center (JTDC), which reduced readmission rates to the facility by 21%. These large behavioral responses combined with modest program costs imply benefit-cost ratios for these interventions from 5-to-1 up to 30-to-1 or more. Our data on mechanisms are not ideal, but we find no positive evidence that these effects are due to changes in emotional intelligence or social skills, self-control or "grit," or a generic mentoring effect. We find suggestive support for the hypothesis that the programs work by helping youth slow down and reflect on whether their automatic thoughts and behaviors are well suited to the situation they are in, or whether the situation could be construed differently. [A full list of sponsors of this project can be found on the NBER web site: http://www.nber.org/papers/w21178.ack.]

This study uses a randomized design to assess the impact of the Balanced Leadership program on principal leadership, instructional climate, principal efficacy, staff turnover, and student achievement in a sample of rural northern Michigan schools. Participating principals report feeling more efficacious, using more effective leadership practices, and having a better instructional climate than control group principals. However, teacher reports indicate that the instructional climate of the schools did not change. Furthermore, we find no impact of the program on student achievement. There was an impact of the program on staff turnover, with principals and teachers in treatment schools significantly more likely to remain in the same school over the 3 years of the study than staff in control schools.

Too many students drop out and never earn their high school diploma. For students at risk of dropping out, academic, social, and other supports may help. "Communities In Schools" seeks to organize and provide these supports to at-risk students in the nation's poorest-performing schools, including through "case-managed" services. This report, the first of two from a random assignment evaluation of "Communities In Schools" case management, focuses primarily on the implementation of case management in 28 secondary schools during the 2012-2013 school year. The report also includes interim one-year findings about case management's impact on student outcomes. The report concludes with suggestions for improvement for "Communities In Schools" based mainly on the implementation findings. The next report will present two-year impact findings and more about the implementation of case management in the 2013-2014 school year. Appended to the report are: (1) Statistical Model and Statistical Power; and (2) Sample and Response Analysis.

This article examines the effectiveness of a technology-based algebra curriculum in a wide variety of middle schools and high schools in seven states. Participating schools were matched into similar pairs and randomly assigned to either continue with the current algebra curriculum for 2 years or to adopt Cognitive Tutor Algebra I (CTAI), which uses a personalized, mastery-learning, blended-learning approach. Schools assigned to implement CTAI did so under conditions similar to schools that independently adopt it. Analysis of posttest outcomes on an algebra proficiency exam finds no effects in the first year of implementation, but finds evidence in support of positive effects in the second year. The estimated effect is statistically significant for high schools but not for middle schools; in both cases, the magnitude is sufficient to improve the median student's performance by approximately eight percentile points.

This addendum to previously published results presents alternative analyses of data from large-scale effectiveness studies of Cognitive Tutor Algebra I in middle schools and high schools. These alternative analyses produce results that are substantively the same as previously reported. We find a significant positive effect of 0.21 standard deviation units for high school students in the second year of the study. An appendix containing additional tables is included. [See the study: "Effectiveness of Cognitive Tutor Algebra I at Scale," "Educational Evaluation and Policy Analysis," v36 n2 p127-144 Jun 2014 at EJ1024233.]

Improving the long-term life outcomes of disadvantaged youth remains a top policy priority in the United States, although identifying successful interventions for adolescents--particularly males--has proven challenging. This paper reports results from a large randomized controlled trial of an intervention for disadvantaged male youth grades 7-10 from high-crime Chicago neighborhoods. The intervention was delivered by two local non-profits and included regular interactions with a pro-social adult, after-school programming, and--perhaps the most novel ingredient--in-school programming designed to reduce common judgment and decision-making problems related to automatic behavior and biased beliefs, or what psychologists call cognitive behavioral therapy (CBT). We randomly assigned 2,740 youth to programming or to a control group; about half those offered programming participated, with the average participant attending 13 sessions. Program participation reduced violent-crime arrests during the program year by 8.1 per 100 youth (a 44 percent reduction). It also generated sustained gains in schooling outcomes equal to 0.14 standard deviations during the program year and 0.19 standard deviations during the follow-up year, which we estimate could lead to higher graduation rates of 3-10 percentage points (7-22 percent). Depending on how one monetizes the social costs of crime, the benefit-cost ratio may be as high as 30:1 from reductions in criminal activity alone. [A full list of sponsors of this project can be found on NBER's web site: http://www.nber.org/papers/w19014.ack.]

Charter schools--public schools of choice that are operated autonomously, outside the direct control of local school districts--have become more prevalent over the past two decades. There is no consensus about whether, on average, charter schools are doing better or worse than conventional public schools at promoting the achievement of their students. Nonetheless, one research finding is clear: Effects vary widely among different charter schools. Many educators, policymakers, and funders are interested in ways to identify and replicate successful charter schools and help other public schools adopt effective charter school practices. Charter-school management organizations (CMOs), which establish and operate multiple charter schools, represent one prominent attempt to bring high performance to scale. The National Study of CMO Effectiveness aims to fill the gap in systematic evidence about CMOs, providing the first rigorous nationwide examination of CMOs' effects on students' achievement and attainment. The study includes an examination of the relationships between the practices of individual CMOs and their effects on student achievement, with the aim of providing useful guidance to the field. This updated edition of the report provides key findings from the study on CMO practices, impacts, and the relationships between them. A forthcoming report will explore promising practices in greater depth. This study uses multiple data sources to describe CMOs, assess their impacts on students, and identify practices associated with positive impacts in order to address the following research questions: (1) How quickly are CMOs growing? Which students and areas do they serve and what resources do they use? What are the practices and structures of CMOs? What state policies and other factors appear to influence the location and growth of CMOs?; (2) What are the impacts of CMOs on student outcomes and to what extent do these impacts vary across CMOs?; and (3) Which CMO practices and structures are positively associated with impacts? To examine eligible CMOs and address the research questions, the authors conducted a survey of CMO central office staff, surveys of CMO principals and principals in nearby conventional public schools, a survey of CMO teachers, and site visits to 10 CMOs and 20 schools. In addition, they collected and analyzed school records with data on student characteristics and outcomes (including test scores), and they examined CMO financial records and business plans. Findings include: (1) Comprehensive behavior policies are positively associated with student impacts; (2) Intensive teacher coaching is positively associated with student impacts; (3) CMOs using TFA and teaching fellow teachers have higher impacts, but other staffing decisions are not associated with impacts; (4) CMOs categorized as "data-driven" and "time on task" have larger impacts, on average, than two other categories of CMOs; and (5) Tightness of CMO management is weakly associated with impacts. As is often the case in studies of this kind, some of the interesting findings raise other important questions. The following questions are discussed in this report: (1) To what extent do CMOs produce positive effects on longer term student outcomes?; (2) What explains why some CMOs have negative impacts on test scores?; (3) Which promising strategies should CMOs implement and how should they implement them?; (5) To what extent do CMOs add value compared to independent charter schools?; (6) Are new CMOs using the same strategies and producing the same impacts as more established CMOs?; and (7) What other factors might contribute to CMO impacts? Appended are: (1) Construction and Analysis of Measures Used in Chapter III; (2) Experimental Impacts; (3) Validation of Impact Estimation Approach; (4) Methodology for Estimating CMO and School- Level Impacts on Achievement in Middle- Schools; (5) Baseline Equivalence; (6) Method for Dealing with Grade Repetition; (7) Methodology and Results for CMO Impacts on High School Achievement and Attainment; (8) Impacts on Middle School Test Scores by CMO, Year, and Subject; (9) Comparing CMO and Independent Charter Impacts; (10) Subgroup Impacts; (11) Multiple Comparison Adjustments for Impact Analyses; (12) Methods for Correlating Impacts and CMO Characteristics; and (13) Correlational Analysis Results. Individual chapters contain footnotes. (Contains 56 tables and 49 figures.) [This document was commissioned by NewSchools Venture Fund and written with assistance from Michael Barna, Emily Caffery, Hanley Chiang, John Deke, Melissa Dugger, Emma Ernst, Alena Davidoff-Gore, Eric Grau, Thomas Decker, Mason DeCamillis, Philip Gleason, Amanda Hakanson, Jane Nelson, Antoniya Owens, Julie Redline, Davin Reed, Chris Rodger, Margaret Sullivan, Christina Tuttle, Justin Vigeant, Tiffany Waits, and Clare Wolfendale. For an earlier edition of this report, "The National Study of Charter Management Organization (CMO) Effectiveness. Charter-School Management Organizations: Diverse Strategies and Diverse Student Impacts," see ED526951.]

In this study, 72 secondary English teachers from the Santa Ana Unified School District were randomly assigned to participate in the Pathway Project, a cognitive strategies approach to teaching interpretive reading and analytical writing, or to a control condition involving typical district training focusing on teaching content from the textbook. Pathway teachers learned how to use an on-demand writing assessment to help mainstreamed English learners understand, interpret, and write analytical essays. In Year 2, treatment effects were replicated on an on-demand writing assessment (d = 0.67) and showed evidence of transfer to improved performance on a standardized writing test (d = 0.10). The results underscore the efficacy of a cognitive strategies reading/writing intervention for mainstreamed English learners (ELs) in the secondary grades. (Contains 1 note, 4 tables, and 3 figures.)

Financial incentives for teachers to increase student performance is an increasingly popular education policy around the world. This paper describes a school-based randomized trial in over two-hundred New York City public schools designed to better understand the impact of teacher incentives on student achievement. I find no evidence that teacher incentives increase student performance, attendance, or graduation, nor do I find any evidence that the incentives change student or teacher behavior. If anything, teacher incentives may decrease student achievement, especially in larger schools. The paper concludes with a speculative discussion of theories that may explain these stark results.

In the 2007-2008 school year, the New York City Department of Education and the United Federation of Teachers jointly implemented the Schoolwide Performance Bonus Program in a random sample of the city's high-needs public schools. The program lasted for three school years, and its broad objective was to improve student performance through school-based financial incentives. The question, of course, was whether it was doing so. To examine its implementation and effects, the department tasked a RAND Corporation-led partnership with the National Center on Performance Incentives at Vanderbilt University to conduct a two-year study of the program that would offer an independent assessment. This report describes the results of our analyses for all three years of the program, from 2007-2008 through 2009-2010. This work built on past research and was guided by a theory of action articulated by program leaders. Researchers examined student test scores; teacher, school staff, and administrator surveys; and interviews with administrators, staff members, program sponsors, and union and district officials. The researchers found that the program did not, by itself, improve student achievement, perhaps in part because conditions needed to motivate staff were not achieved (e.g., understanding, buy-in for the bonus criteria) and because of the high level of accountability pressure all the schools already faced. Individual chapters contain footnotes. (Contains 12 figures and 66 tables.) [Additional funding for this paper was provided by the New York City Fund for Public Schools. For "What New York City's Experiment with Schoolwide Performance Bonuses Tells Us about Pay for Performance. Research Brief," see ED521918.]

This is the third-year report in a five-year evaluation of the Milwaukee Parental Choice Program (MPCP). The MPCP, which began in 1990, provides government-funded vouchers for low-income children to attend private schools in the City of Milwaukee. The general purposes of the evaluation are to analyze the effectiveness of the MPCP in terms of longitudinal student achievement growth and educational attainment as measured by high school graduation rates. The former will be primarily accomplished by measuring and estimating student growth in achievement as measured by the Wisconsin Knowledge and Concepts Examinations (WKCE) in math and reading in 2006-07, grades 3 through 8 over a five-year period. The latter will be accomplished by following the 2006-07 8th and 9th grade cohorts over a five-year period or longer. The general research design consists of a comparison between a random sample of MPCP students and a matched sample of Milwaukee Public School (MPS) students. This third year report presents results from the November 2008 WKCE tests as second year student achievement growth in MPCP relative to the matched MPS sample. We provide varying descriptive statistics comparing test score means and distributions for math and reading for 2006-07 (baseline year) and 2008-09 (second outcome year) for each sample. The report also analyzes achievement growth using several multivariate techniques and models. The primary finding in all these comparisons is that, in general, there are few statistically significant differences between levels of MPCP and MPS student achievement growth in either math or reading two years after they were carefully matched to each other. In one of the ways of estimating these results, focusing only on those students who have remained in the public or private sector for all three years, private, voucher students are slightly behind MPS students in mathematics achievement growth. The report offers several cautions in interpreting this result against the overwhelming set of results that indicate no difference in achievement growth. Appended are additional tables and study attrition. (Contains 9 tables, 2 figures, and 7 footnotes.) [Additional funding for this project was provided by the Robertson Foundation.]

Although writing learning journals is a powerful learning tool, instructional support is needed to overcome deficits in the use of self-regulated learning strategies. In a 2 x 2 experimental design with high-school students (N = 70), we analysed the effects of two modes of instruction (namely, informed prompting and learning-journal example) along with prompts. Informed prompting that provided background information on the prompted strategies enhanced learning in the training and transfer session. A learning-journal example that modelled the application of the strategies primarily fostered the strategy used in the training session and learning in the transfer session. Theoretically, the results provide support for the self-regulation view of writing-to-learn. (Contains 1 figure and 2 tables.)

This experimental study was conducted to examine the efficacy of repeated reading and wide reading practice interventions for high school students with severe reading disabilities. Effects on comprehension, fluency, and word reading were evaluated. Participants were 96 students with reading disabilities in grades 9-12. Students were paired within classes and pairs were randomly assigned to one of three groups: repeated reading (N = 33), wide reading (N = 34), or typical instruction (N = 29). Intervention was provided daily for approximately 15-20 minutes for 10 weeks. Results indicated no overall statistically significant differences for any condition, with effect sizes ranging from -0.31 to 0.27. Findings do not support either approach for severely impaired readers at the high school level. We hypothesize that these students require more intensive interventions that include direct and explicit instruction in word- and text-level skills as well as engaged reading practice with effective feedback.

This randomized, controlled field trial estimated the causal impact of a technology-based geometry curriculum on students' geometry achievement, as well as their attitudes toward mathematics and technology. The curriculum combines learner-centered classroom pedagogy with individualized, computer-based student instruction. Conducted over a 3-year period in eight high schools within an urban fringe district, the study found that students assigned to the treatment curriculum scored 19% of a standard deviation lower on the geometry posttest than their counterparts assigned to the district's standard curriculum, but found no statistically significant impact on students' attitudes toward mathematics and technology. Researchers also collected observation and interview data on teachers' instructional practices. These data suggest that many teachers had difficulty implementing the treatment curriculum's learner-centered pedagogy. In fact, observed levels of learner-centered practices were only modestly higher in treatment classes than in control classes. In both treatment and control classes, however, higher levels of learner-centered pedagogy were associated with higher student achievement in geometry. (Contains 4 figures, 10 footnotes, and 5 tables.)

These two recipients of this year's Alan C. Purves Award reflect on their work (reported in "RTE" Vol. 41, No. 3, pp. 269-303) on "A Cognitive Strategies Approach to Reading and Writing Instruction for English Language Learners in Secondary School" and the lessons they learned from their original research study as they tried to replicate the project in two additional districts outside their service area, to determine if the implications of their study would hold beyond the local context. The Alan C. Purves Award is given to the "RTE" article in the previous volume year judged most likely to impact educational practice. (Contains 1 figure and 4 tables.)

Numerous high school students, including many who are enrolled in career and technical education (CTE) courses, do not have the math skills necessary for today's high-skill workplace or college entrance requirements. This study tests a model for enhancing mathematics instruction in five high school CTE programs (agriculture, auto technology, business and marketing, health, and information technology). The model includes a pedagogy and intense teacher professional development. Volunteer CTE teachers were randomly assigned to an experimental (n = 59) or control (n = 78) group. The experimental teachers worked with math teachers to develop CTE instructional activities that integrated more mathematics into the occupational curriculum. After 1 year of the math-enhanced CTE lessons, students in the experimental classrooms performed equally on technical skills and significantly better than control students on two standardized tests of math ability (TerraNova and ACCUPLACER[R]). (Contains 5 tables, 1 figure, and 9 notes.)

Under the "Math Science Partnership Grant," the Maui Hawaii Educational Consortium sought scientifically based evidence for the effectiveness of Carnegie Learning's "Cognitive Tutor[R]" (CT) program as part of the adoption process for pre-Algebra program. During the 2006-2007 school year, the researchers conducted a follow-on study to a previous randomized experiment in the Maui School District of the effectiveness of "CT" in Algebra I. In this second year, the focus was on the newly developed "Bridge to Algebra" program for pre-Algebra. The question being addressed specifically by the research is whether students in classes that use "CT" materials achieve higher scores on the standardized math assessment, as measured by the Northwest Evaluation Association (NWEA) General Math Test, than they would if they had been in a control classroom using the pre-Algebra curricula the Maui schools currently have in place. The researchers found that most students in both "CT" and control groups improved overall on the NWEA General Math Test. They did not find a difference in student performance in math between groups. Their analysis of the Algebraic Operations sub-strand revealed that many students in both groups did not demonstrate the growth in this scale, again with no discernible group differences. However, for Algebraic Operations outcomes, the researchers found a significant interaction between the pre-test and "CT": student scoring low before participating in "CT" got more benefit from the program's algebraic operations instruction than students with high initial scores. (Contains 8 figures, 33 tables, and 14 footnotes.) [For "Comparative Effectiveness of Carnegie Learning's "Cognitive Tutor Bridge to Algebra" Curriculum: A Report of a Randomized Experiment in the Maui School District. Research Summary," see ED538962.]

Because a significant portion of U.S. students lacks critical mathematic skills, schools across the country are investing heavily in computerized curriculums as a way to enhance education output, even though there is surprisingly little evidence that they actually improve student achievement. In this paper we present results from a randomized study in three urban school districts of a well-defined use of computers in schools: a popular instructional computer program which is designed to teach pre-algebra and algebra. We assess the impact of the program using statewide tests that cover a range of math skills and tests designed specifically to target pre-algebra and algebra skills. We find that students randomly assigned to computer-aided instruction score at least 0.17 of a standard deviation higher on a pre-algebra/algebra test than students randomly assigned to traditional instruction. We hypothesize that the effectiveness arises from increased individualized instruction as the effects appear larger for students in larger classes and those in classes in which students are frequently absent. (Detailed data information is appended. Contains 40 footnotes and 17 tables.)

This report describes the effects of Project Graduation Really Achieves Dreams (GRAD) on student progress at three high schools in Houston (the initiative's original site) and at high schools in two other school districts (Columbus, Ohio, and Atlanta, Georgia). MDRC--a nonprofit, nonpartisan research organization--conducted a third-party evaluation to determine the effects of Project GRAD by comparing the changes in student outcomes at Project GRAD schools with changes at similar, non-Project GRAD schools in the same districts. (A companion report discusses findings for Project GRAD elementary schools.) In general, Project GRAD student outcomes are tracked from the implementation of the first components of the model at each site until the 2002-2003 school year. The key findings of this report are: At Jefferson Davis High School in Houston, the initiative's flagship school, Project GRAD had a statistically significant positive impact on the proportion of students who completed a core academic curriculum on time--that is, received an average grade of 75 out of 100 in their core courses; earned four credits in English, three in math, two in science, and two in social students; and graduated from high school within four years. As Project GRAD expanded into two other Houston high schools, these positive effects on students' academic preparation were not evident. Student outcomes at the newer Project GRAD high schools improved, but generally this progress was matched by progress at the comparison high schools. Improvements in graduation rates at the three Project GRAD Houston high schools were generally matched by improvements in graduation rates at the comparison schools. Looking at early indicators of student success, the initial Project GRAD high schools in Columbus and Atlanta showed improvements in attendance and promotion to tenth grade that appear to have outpaced improvements at the comparison schools, although the differences are only sometimes statistically significant. The following are appended: (1) The Impacts on High School Graduation among All Ninth-Grade Students in Houston; (2) High School Achievement in Houston: Was There Shifting of the Pool of Test-Takers?; and (3) Selecting Comparison Schools. (Contains 3 boxes, 6 tables, and 20 figures.) [Additional supplemental funding for this document was provided by the Lucent Technologies Foundation; and Project GRAD USA.]

According to the National Assessment of Educational Progress, nearly 4 in 10 fourth graders read below the basic level. These literacy problems get worse as students advance through school and are exposed to progressively more complex concepts and courses. The purpose of this study was to assess the effectiveness of four remedial reading programs in improving the reading skills of 3rd and 5th graders, whether the impacts of the programs vary across students with difference baseline characteristics, and to what extent can this instruction close the reading gap and bring struggling readers within the normal range--relative to the instruction normally provided by their schools. The study took place in elementary schools in 27 districts of the Allegheny Intermediate Unit outside Pittsburgh, PA during the 2003-04 school year. Within each of 50 schools, 3rd and 5th grade students were identified as struggling readers by their teachers. These students were tested and were eligible for the study if they scored at or below the 30th percentile on a word-level reading test and at or above the 5th percentile on a vocabulary test. The final sample contains a total of 742 students. There are 335 3rd graders ? 208 treatment and 127 control students. There are 407 5th graders ? 228 treatment and 179 control students. Four existing programs were used: Spell Read P.A.T., Corrective Reading, Wilson Reading, and Failure Free Reading. Corrective Reading and Wilson Reading were modified to focus only on word-level skills. Spell Read P.A.T. and Failure Free Reading were intended to focus equally on word-level skills and reading comprehension/vocabulary. Teachers received 70 hours of professional development and support during the year. Instruction was delivered in small groups of 3 students, 5 days a week, for a total of 90 hours. Seven measures of reading skill were administered at the beginning and end of the school year to assess student progress: Word Attack, Word Identification Comprehension (Woodcock Reading Mastery Test); Phonemic Decoding Efficiency and Sight Word Efficiency (Test of Word Reading Efficiency); Oral Reading Fluency (Edformation); and Passage Comprehension (Group Reading Assessment and Diagnostic Evaluation). After one year of instruction, there were significant impacts on phonemic decoding, word reading accuracy and fluency, and comprehension for 3rd graders, but not for 5th graders. For third graders in the reading programs, the gap in word attach skills between struggling readers and average readers was reduced by about two-thirds. It was found that reading skills of 3rd graders can be significantly improved through instruction in word-level skills, but not the reading skills of 5th graders. The following are appended: (1) Details of Study Design and Implementation; (2) Data Collection; (3) Weighting Adjustment and Missing Data; (4) Details of Statistical Methods; (5) Intervention Impacts on Spelling and Calculation; (6) Instructional Group Clustering; (7) Parent Survey; (8) Teacher Survey and Behavioral Rating Forms; (9) Instructional Group Clustering; (10) Videotape Coding Guidelines for Each Reading Program; (11) Supporting Tables; (12) Sample Test Items; (13) Impact Estimate Standard Errors and P-Values; (14) Association between Instructional Group Heterogeneity and The Outcome; (15) Teacher Rating Form; (16) School Survey; and (17) Scientific Advisory Board. [This report was produced by the Corporation for the Advancement of Policy Evaluation. Additional support provided by the Barksdale Reading Institute, and the Haan Foundation for Children.]

In low-performing public high schools in U.S. cities, high proportions of students drop out, students who stay in school typically do not succeed academically, and efforts to make substantial reforms often meet with little success. The Talent Development High School model is a comprehensive school reform initiative that has been developed to address these challenges. Targeting some of the most troubled schools in the country, the model seeks to raise the expectations of teachers and students and to prepare all students for postsecondary education and employment. MDRC, a nonpartisan, nonprofit education and social policy research organization, conducted an independent, third-party evaluation of Talent Development. This rigorous evaluation focuses on the first five high schools to begin using the model in the School District of Philadelphia. The evaluation follows 20 cohorts of ninth-grade students for up to four years of high school using a comparative interrupted time series research design. Appended are: (1) Tables for First-Time Ninth-Grade Students; and (2) Tables for Repeating Ninth-Grade Students. (Contains 16 tables, 9 figures, and 3 boxes.)[Dissemination of MDRC publications is also supported by Starr Foundation.]

Policymakers have long been concerned about the disparities in college attendance between more and less advantaged groups of students. Upward Bound is one of the largest and longest running federal programs designed to help economically disadvantaged students prepare for, enter and succeed in college. Since December 1991, Mathematica Policy Research, Inc., (MPR) has been conducting the national evaluation of Upward Bound for the U.S. Department of Education (ED). The evaluation has focused on program implementation issues and the effects of the program on student outcomes. The "impact study" is designed to measure the impacts or effects of regular Upward Bound on student outcomes, and it is based on a longitudinal evaluation in which eligible applicants from a nationally representative sample of projects were randomly assigned to Upward Bound or to a control group. The results in this document are based on the national evaluation's third follow-up data collection, which was completed in 2000. Because the entire sample of students was beyond high school age by that time, the report includes updated findings on the effects of Upward Bound on high school outcomes. In addition, based on data covering the first few years after sample members left high school, the report addresses the following research questions: (1) What effect does Upward Bound have on students' postsecondary experiences? (2) Who benefits most from Upward Bound? and (3) What is the association between staying in Upward Bound and student outcomes? Findings in this report suggest that for the average student, Upward Bound: (1) increased the number of high school math credits earned by participants; (2) did not affect other measures of high school academic preparation; (3) may have increased enrollment at four-year institutions; and (4) did not affect enrollment at postsecondary institutions more generally when all types of postsecondary institutions are considered. Appended are: (1) Sample Design Unit Nonresponse and Weights; (2) Baseline Characteristics of the Treatment and Control Groups, Third Follow-Up Survey Respondents; (3) Program Effects and Standard Errors; (4) The Effect of Upward Bound on High School Outcomes by Selected Subgroups; (5) The Effect of Upward Bound on College Engagement by Selected Subgroups; (6) Methods Used to Estimate the Effects of Additional Upward Bound Participation; (7) Weighted Standard Deviations for All Outcome Variables; (8) Data Collection; and (9) Sample Sizes and Standard Errors for Reported Impact Estimates. (Contains 29 tables and 3 figures.)

Career academies are characterized by these three basic features: a school-within-a-school organizational structure, curricula that combine academic and career or technical courses based on a career theme, and partnerships with local employers. In a 10-year longitudinal study of the academy model, begun in 1993 in 9 schools around the country, some 1,700 academy applicants in the 8th or 9th grade were randomly assigned to their high schools' academy or any other high school program. The evaluation found, as of the year after scheduled high school graduation, that although the career academies enhanced the high school experiences of their students in ways that were consistent with the reform's short-term goals, these positive effects did not translate into changes in high school graduation rates or initial transitions to postsecondary education and jobs. Other key findings included: (1) the academies had little influence on course content, classroom instructional practices, and standardized test scores; (2) for students at high risk of dropping out, the academies increased the likelihood of staying in school through 12th grade, improved attendance, and increased number of credits earned; and (3) relative to similar students nationally, both studied groups had high rates of high school graduation, college enrollment, and employment. The results suggest that career academies should consider expanding their efforts to recruit students who may not be motivated to enroll in academies on their own, to provide college counseling, and to increase teacher professional development activities in order to improve curriculum and instruction. (Contains 25 references, 10 figures, and 6 tables.) (KC)

In 2 experiments with 74 high school students, subjects studied worked examples while learning how to translate English expressions into algebraic equations. Those using worked examples outperformed the control group on posttests, made fewer errors, completed work more rapidly, and required less assistance from the teacher. (SLD)