The current study investigated the effectiveness of three distinct educational technologies--two game-based applications (From Here to There and DragonBox 12+) and two modes of online problem sets in ASSISTments (an Immediate Feedback condition and an Active Control condition with no immediate feedback) on Grade 7 students' algebraic knowledge. More than 3,600 Grade 7 students across nine in-person and one virtual schools within the same district were randomly assigned to one of the four conditions. Students received nine 30-minute intervention sessions from September 2020 to March 2021. Hierarchical linear modeling analyses of the final analytic sample (N = 1,850) showed significantly higher posttest scores for students who used From Here to There and DragonBox 12+ compared to the Active Control condition. No significant difference was found for the Immediate Feedback condition. The findings have implications for understanding how game-based applications can affect algebraic understanding, even within pandemic pressures on learning.

The current study investigated the effectiveness of three distinct educational technologies--two game-based applications (From Here to There and DragonBox 12+) and two modes of online problem sets in ASSISTments (an Immediate Feedback condition and an Active Control condition with no immediate feedback) on Grade 7 students' algebraic knowledge. More than 3,600 Grade 7 students across nine in-person and one virtual schools within the same district were randomly assigned to one of the four conditions. Students received nine 30-minute intervention sessions from September 2020 to March 2021. Hierarchical linear modeling analyses of the final analytic sample (N = 1,850) showed significantly higher posttest scores for students who used From Here to There and DragonBox 12+ compared to the Active Control condition. No significant difference was found for the Immediate Feedback condition. The findings have implications for understanding how game-based applications can affect algebraic understanding, even within pandemic pressures on learning.

This study examines the efficacy, cost, and implementation of an integrated science and literacy curriculum for kindergarten. The study was conducted in a large urban district and included 1,589 students in 71 classrooms in 21 schools. The research includes a multi-site cluster-randomized controlled trial and mixed-methods cost and implementation studies. Analysis revealed significant impacts on comprehension, letter-naming fluency, and motivation to read. No main impacts were observed on decoding, word identification, or writing; however, exploratory analysis revealed that students whose teachers implemented the treatment with fidelity performed statistically significantly better in writing and decoding. The cost to produce the observed effects was estimated at $480 per student, two-thirds of which was borne by the school. Despite this cost, treatment classrooms achieved savings by using an average of three fewer instructional programs than control classrooms. Teachers reported positive effects from the integrated curriculum on student engagement, learning, and behavior.

This study utilized a partially nested randomized control design to investigate the impact of Fusion, a first grade math intervention. Blocking on classrooms, students were randomly assigned to one of three conditions: a Fusion two student group, a Fusion five student group, or a no treatment control group. Two primary research questions were examined: What was the overall impact of the Fusion intervention as compared to a business-as-usual comparison condition? and Was there a differential impact on student outcomes between the 2:1 Fusion and the 5:1 Fusion conditions? Analyses found a positive effects on four outcome measures favoring Fusion groups over control with two of the differences statistically significant. Results between Fusion groups found positive effects favoring the Fusion 2:1 group compared to the Fusion 5:1 group on all four outcome measures with two of the differences statistically significant. On a second grade follow up measure no difference was found between Fusion groups and control but a statistically significant difference was found between Fusion groups favoring the 2:1 Fusion group. Future research directions and implications for practice are discussed. [This paper will be published in the "Journal of Research on Educational Effectiveness."]

This report presents the findings from an independent evaluation conducted by WestEd on the Expository Reading and Writing Curriculum (ERWC). Funded by an Investing in Innovation (i3) Validation grant, the ERWC is a grade 11 and grade 12 English language arts (ELA) curriculum developed by the California State University. The independent evaluation includes an evaluation of the fidelity of implementation of the curriculum and an impact evaluation that took place during the 2020/21 school year. The fidelity of implementation evaluation found that a high percentage of teachers participated in the professional learning with fidelity but that few teachers taught the full curriculum with fidelity, and these results were due to many factors, including time constraints and shifts in instruction due to the COVID-19 pandemic. The grade 11 impact evaluation found that assignment to the ERWC had a positive and statistically significant impact on student achievement as measured by the Non-Performance Task Interim Comprehensive Assessment; however, no statistically significant impact was detected among the students who took the Smarter Balanced Summative Assessment. In the grade 12 impact evaluation, there was no statistically significant difference in achievement between students who had enrolled in the ERWC and students who had enrolled in the comparison English course. Further evaluation of the ERWC in a non-pandemic year during which schooling takes place in person is recommended.

This is the first study to provide experimental evidence of the impact of corequisite remediation for students underprepared in reading and writing. We examine the short-term impacts of three different approaches to corequisite remediation that were implemented at five large urban community colleges in Texas, and we explore whether corequisites have differential impacts on students with different characteristics. Results from three first-time-in-college cohorts indicate that corequisite remediation increased the probability of completing a first college-level English course within one year by 24 percentage points and within two years by 18 percentage points. The impacts were positive for all three of the corequisite models examined and for traditionally underrepresented groups, including Hispanic students, first-generation college students, and students whose first language is not English. We saw modest positive impacts on the accumulation of college credits but no effect on persistence in college.

Most community college students are referred to developmental education courses to build basic skills. These students often struggle in these courses and college more broadly. CUNY Start is a prematriculation program for students assessed as having significant remedial needs. CUNY Start students delay matriculation for one semester and receive time-intensive instruction in math, reading, and writing with a prescribed pedagogy delivered by trained teachers. The program aims to help students complete remediation and prepare for college-level courses. This article describes the results of an experiment at four community colleges (n [is approximately equal to] 3,800). We estimate that over three years, including one semester that students spent in the program and two-and-a-half years after the program was complete, CUNY Start substantially increased college readiness, slightly increased credit accumulation, and modestly increased graduation rates (by increasing participation in CUNY's highly effective ASAP).

This paper presents new estimates of the effects of the City University of New York (CUNY) Accelerated Study in Associate Programs (ASAP) model, evaluated using a randomized controlled trial first in New York and later through a replication in Ohio. It describes longer-term effects of CUNY ASAP in New York, showing that the program's effects on associate's degree receipt persisted through eight years and likely represent a permanent increase in degree receipt. The paper also offers an analysis from the pooled study samples in New York and Ohio. The findings indicate that the program has consistent effects on degree receipt across different states but also for somewhat different levels of service contrast, such as the number of additional advising visits.

Researchers have shown that children's social-emotional growth is inextricably connected to academic learning. We developed the Social-Emotional Learning Foundations (SELF) intervention, a Grade K-1 curriculum merging social-emotional learning (SEL) and literacy instruction, to promote language supported self-regulation, specifically for primary grade children at early risk for emotional or behavioral difficulties. We report findings from a pretest-posttest cluster randomized efficacy trial with one fixed between-subjects factor to test the effects of teacher-delivered SEL instruction against those of business as usual (BAU). We recruited 163 kindergarten (K) and 141 first grade teachers from 52 schools across 11 school districts within one southeastern state. Our student sample (n=1154) consisted of 627 kindergarteners and 527 first graders identified by teachers as at risk for internalizing or externalizing emotional and behavioral problems using the "Systematic Screening for Behavioral Disorders"; 613 of these students participated in the SELF condition and 541 participated in the BAU condition. We randomly assigned schools to SELF or BAU and used a multilevel model with three levels (i.e., children, classrooms, schools) to analyze data on subscales of six (four teacher-report and two direct) assessments related to self-regulation, social-emotional learning, social-emotional vocabulary, and general behavioral functioning. We found positive main effects of SELF compared to BAU on all but one measure, with effect sizes (calculated using Hedges' "g") ranging from 0.20 to 0.65. Findings provide evidence for guiding future SEL intervention research and informing practice to improve student outcomes, particularly for children at risk for behavior problems. [This is the online first version of an article published in "Journal of School Psychology."]

Many talented students in under-resourced schools do not reach their full potential. Research shows that by sixth grade, children born into poverty have likely spent 6,000 fewer hours learning than their middle-class counterparts. Higher Achievement, an intensive summer and after-school program, aims to close that learning gap. It offers participants more than 500 hours of academic enrichment activities a year to help them meet the high academic standards expected of college-bound students. Known as "scholars"; Higher Achievement students enter the program during the summer before either fifth or sixth grade and commit to attending through eighth grade. The summer program consists of six weeks of morning classes in English Language Arts (ELA), math, science, and, in some centers, social studies, followed by enrichment activities in the afternoon, including chess, cooking, art, and soccer. During the school year, in addition to the program's regular study hall and enrichment activities, a cadre of mostly young professionals volunteer one day a week, delivering 75-minute ELA or math lessons to small groups of scholars. These volunteers receive detailed lesson plans and training so they can successfully execute the program's rigorous curricula. Part of what makes Higher Achievement affordable is its use of volunteers in this way. An earlier experimental evaluation of Metro DC, Higher Achievement's flagship affiliate in Washington, DC, and Alexandria, Virginia, found that the program was effective in improving academic performance two years after students applied. Since then, Higher Achievement has expanded to three new cities: Baltimore, Maryland; Richmond, Virginia; and Pittsburgh, Pennsylvania. Keenly aware that many effective flagship programs fail to be effective in new locations, the federal government funded an experimental validation study to examine the impacts at these expansion sites. Eligible students were randomly assigned either to a program group that could participate in Higher Achievement, or to a control group that could not enroll in the program. Comparing the two groups' outcomes provided an estimate of the program's impacts. The study found that the expansion sites experienced many of the implementation challenges common to school-based, out-of-school-time programs (for example, staff turnover, coordination with the host school, and lower-than-hoped-for attendance by middle school students), as well as those often seen in new programs (such as a lack of strong relationships with key partners and difficulty recruiting volunteers). Even so, Higher Achievement was found to be at least adequately implemented in all three cities. The study found that the program's detailed lesson plans, with scripted questions and student instructions, enabled the volunteers to deliver rigorous academic lessons. This report addresses the following questions: (1) How did the Higher Achievement centers operate during the study and what lessons are there for similar programs?; (2) Did scholars receive more academic enrichment over the two-year study period than they would have received without Higher Achievement?; and (3) How did Higher Achievement impact scholars' grades and test scores over the two years since they applied?

Mission HydroSci (MHS) is a 3D game-based learning environment and curriculum that supports middle school student learning of water systems science and scientific argumentation. MHS is a rigorous, coherent and engaging 6 to 8-day curriculum with all learning activities and social interactions taking place in the virtual world and with teachers observing and supporting students through an online support system enhanced by analytics. MHS was evaluated in comparison to a high- quality alternative intervention developed by the Biological Sciences Curriculum Study (BSCS) using a stratified randomized block experimental design where 'classroom' was the unit of random assignment, stratified by teacher. The comparison curriculum is called Earth's Water Systems (EWS) and is provided online using the Canvas learning management platform. Three measurable outcomes: (1) content knowledge, (2) competency in scientific argumentation, and (3) affect for science and technology were used in the pre- post-comparison of MHS with EWS. The findings of this randomized experiment showed that MHS achieved roughly equivalent water systems learning outcomes and significantly higher development of argumentation competencies when compared to the EWS curriculum. The impacts of both MHS and the EWS curriculum on affect for science and technology were equivalent and slightly negative. A secondary exploratory quasi-experimental design (QED) analysis was conducted that found significant positive effects for MHS in comparison to EWS on water systems understandings and stronger detected effects for students' argumentation.

The purpose of this study was to examine the treatment effects of the Incredible Years Teacher Classroom Management (IY TCM), a universal classroom management intervention, on the outcomes of children with aggressive behavior in elementary school. Classroom management has been demonstrated as a factor in either escalating children's aggressive behavior or decreasing those problematic behaviors. Participants included 1,817 students (Grade K to 3) and 105 teachers from nine elementary schools in a large urban Midwestern school district. Teachers were randomly assigned to receive IY TCM or to a wait-list comparison group. The hypotheses were that baseline levels of aggression would moderate the relationship between intervention status and outcomes. Findings indicated the hypothesized moderation effect on several outcome variables; specifically, children with baseline aggression problems who were in IY TCM classrooms had significantly improved math achievement, emotional regulation, prosocial behaviors, and observed aggression in comparison to similar peers in the control classrooms. Implications for practice and future research based on the findings are discussed.

The purpose of this study was to test the efficacy of a comprehensive program model originally developed by the National Professional Development Center on Autism Spectrum Disorder (NPDC). Sixty elementary schools with 486 participants were randomly assigned to an NPDC and services as usual condition (SAU). Significantly greater changes in program quality occurred in the inclusive NPDC programs as compared with the SAU schools. Teachers in NPDC schools reported using more evidence-based practices (EBPs) and implemented EBPs with significantly greater fidelity than teachers in SAU schools. Autistic students in NPDC schools had significantly higher total attainment of educational goals than students in SAU schools, and the two groups made equivalent progress on standardized assessment outcomes across the school year. [This is the online first version of an article published in "Journal of Autism and Developmental Disorders."]

The New York City P-TECH Grades 9-14 schools represent an education model that ties together the secondary, higher education, and workforce systems as a way to improve outcomes in both domains. The distinguishing feature of the P-TECH 9-14 model, as it is referred to in this report, is a partnership between a high school, a local community college, and one or more employer partners that focuses on preparing students for both college and careers -- not one or the other -- within a six-year timeframe. Education and workforce development are traditionally seen as separate spheres of influence with multiple transition points that students have been left to navigate largely on their own (for example, high school to postsecondary, and postsecondary to the workforce). P-TECH 9-14 is designed to seamlessly assist student navigation of those points -- supporting student success and mitigating the potential for students to fall through the cracks. P-TECH 9-14 schools collaborate with local colleges to provide students with an opportunity to earn a high school diploma (within four years) followed by a cost-free, industry-recognized associate's degree. During the six-year program, employer partners support P-TECH 9-14 schools by providing students with work-based learning experiences such as internships, mentoring, and job shadowing. By design, the P-TECH 9-14 model offers students the opportunity to participate in focused and accelerated high school pathways, early college, and career-focused activities. This study offers initial impact and implementation findings from the first rigorous evaluation of the model, evaluating the first seven P-TECH 9-14 schools that opened in New York City. The study leverages the random lottery process created by the New York City High School Admissions System to identify impacts. The majority of the students in the sample who participated in the admissions lotteries were academically below proficiency in both math and English language arts (ELA) prior to entering high school. [This report was written with Fernando Medina. For the executive summary, see ED605313.]

Early colleges are a new model of schooling in which the high school and college experiences are merged, shortening the total amount of time a student spends in school. This study uses a lottery-based experimental design to examine the impact of the model on longer term outcomes, including attainment of a postsecondary credential and academic performance in 4-year institutions. Results show that a significantly higher proportion of early college students were attaining postsecondary credentials. The results also show that early college students were completing their degrees more rapidly but that their performance in 4-year institutions was still comparable with the control students. [For the corresponding grantee submission, see ED604350.]

Early colleges are a new model of schooling in which the high school and college experiences are merged, shortening the total amount of time a student spends in school. This study uses a lottery-based experimental design to examine the impact of the model on longer term outcomes, including attainment of a postsecondary credential and academic performance in 4-year institutions. Results show that a significantly higher proportion of early college students were attaining postsecondary credentials. The results also show that early college students were completing their degrees more rapidly but that their performance in 4-year institutions was still comparable with the control students. [For the corresponding grantee submission, see ED604350.]

The New York City P-TECH Grades 9-14 schools represent an education model that ties together the secondary, higher education, and workforce systems as a way to improve outcomes in both domains. The distinguishing feature of the P-TECH 9-14 model, as it is referred to in this report, is a partnership between a high school, a local community college, and one or more employer partners that focuses on preparing students for both college and careers -- not one or the other -- within a six-year timeframe. Education and workforce development are traditionally seen as separate spheres of influence with multiple transition points that students have been left to navigate largely on their own (for example, high school to postsecondary, and postsecondary to the workforce). P-TECH 9-14 is designed to seamlessly assist student navigation of those points -- supporting student success and mitigating the potential for students to fall through the cracks. P-TECH 9-14 schools collaborate with local colleges to provide students with an opportunity to earn a high school diploma (within four years) followed by a cost-free, industry-recognized associate's degree. During the six-year program, employer partners support P-TECH 9-14 schools by providing students with work-based learning experiences such as internships, mentoring, and job shadowing. By design, the P-TECH 9-14 model offers students the opportunity to participate in focused and accelerated high school pathways, early college, and career-focused activities. This study offers initial impact and implementation findings from the first rigorous evaluation of the model, evaluating the first seven P-TECH 9-14 schools that opened in New York City. The study leverages the random lottery process created by the New York City High School Admissions System to identify impacts. The majority of the students in the sample who participated in the admissions lotteries were academically below proficiency in both math and English language arts (ELA) prior to entering high school. [This report was written with Fernando Medina. For the executive summary, see ED605313.]

This report presents findings from Encouraging Additional Summer Enrollment [EASE], which used behavioral insights in two informational campaigns, with and without tuition assistance, to encourage community college students to take summer classes. Both interventions increased enrollment and had a modest impact on credits earned and positive return on investment for colleges. [The Encouraging Additional Summer Enrollment (EASE) project is funded by Ascendium Education Group. This report was written with Xavier Alemañy.]

The nation's community colleges play a central role in producing a more educated workforce and promoting social mobility. They serve about 40 percent of all college students and, not surprisingly, they serve a disproportionate number of low-income and underrepresented students. But most students who enter these colleges do not graduate--only about a third of entering students earn a degree or certificate within six years. Among the many programs that have attempted to increase graduation rates, one program stands out. Developed by the City University of New York (CUNY), the Accelerated Study in Associate Programs (ASAP) is a comprehensive program that provides students with up to three years of financial and academic support and other support services. Along with those services and other forms of support comes an obligation to attend full time and participate in essential program services. An experimental evaluation of CUNY ASAP found that the program nearly doubled graduation rates after three years. This report presents findings through three years from a replication of the ASAP model at three community colleges in Ohio. Low-income students were randomly assigned either to a program group, who could participate in their colleges' new programs based closely on ASAP (called the Ohio Programs), or to a control group, who could receive the usual college services. Comparing the two groups' outcomes provides an estimate of the Ohio Programs' effects. The findings from the evaluation add to a body of evidence showing that comprehensive programs that offer academic, financial, and other forms of student support for multiple years are an effective way to increase college completion rates. The fact that the earlier CUNY ASAP findings have now been replicated in Ohio suggests that ASAP in particular can serve as a national model to help students succeed.

Financial aid from the Susan Thompson Buffett Foundation (STBF) provides exceptionally generous support to a college population similar to that served by a host of state aid programs. In conjunction with STBF, we randomly assigned aid awards to thousands of Nebraska high school graduates from low-income, minority, and first-generation college households. Randomly- assigned STBF awards boost bachelor's (BA) degree completion for students targeting four-year schools by about 8 points. Degree gains are concentrated among four-year applicants who would otherwise have been unlikely to pursue a four-year program. Degree effects are mediated by award-induced increases in credits earned towards a BA in the first year of college. The extent of initial four-year college engagement explains heterogeneous effects by target campus and across covariate subgroups. Most program spending is a transfer, reducing student debt without affecting degree attainment. Award-induced marginal spending is modest. The projected lifetime earnings impact of awards exceeds marginal educational spending for all of the subgroups examined in the study. Projected earnings gains exceed funder costs for low-income, non-white, urban, and first-generation students, and for students with relatively weak academic preparation. [Financial support for this report was provided from the Susan Thompson Buffett Foundation and the MIT SEII seed fund.]

Most students who begin at a community college leave without earning a degree. Given the growing emphasis on student success, many colleges have implemented re-enrollment campaigns designed to foster re-engagement and degree completion among former students. However, there is a lack of causal evidence on their effectiveness. We implement a text message-based re-enrollment campaign in partnership with several Florida community colleges. Former students who were previously successful academically are randomly assigned to one of two treatment groups that either receives information to simplify the re-enrollment process or receives both information and a one-course tuition waiver. When comparing outcomes of former students who received information on re-enrollment to members in the control group, we find that providing information that simplifies the re-enrollment process has a small, statistically insignificant effect on re-enrolling. In contrast, offering both information and a one-course tuition waiver to recent dropouts significantly increases the likelihood of re-enrollment by 1.5 percentage points (21 percent) and full-time re-enrollment by 0.6 percentage points (22 percent). The effects are concentrated among former students who have accumulated the most credits and those with lower grade point averages. This study highlights the importance of targeted interventions that address informational and financial barriers facing former students.

Pell Grants are the cornerstone of federal financial aid for low-income students enrolled in postsecondary education. Currently, these grants are available only to those who seek an initial undergraduate degree or credential lasting at least a typical semester. Because these rules may restrict access to programs providing skills needed for new or better jobs, the U.S. Department of Education (ED) began pilots of two experimental expansions to Pell Grant eligibility in 2011. The first experiment allowed income-eligible students with a bachelor's degree to obtain Pell Grants for short-term occupational training programs. The second experiment allowed income-eligible students to obtain Pell Grants for very short-term programs lasting as little as eight weeks. This report presents the results from a rigorous evaluation of the experiments conducted by ED's Institute of Education Sciences. The evaluation examined whether these pilot eligibility expansions increased enrollment in and completion of occupational training programs, a first step toward improving individuals' success in the labor market. [For the appendix, see ED609409. For the study highlights, see ED609410.]

Virtually all community colleges and more than 90 percent of public four-year colleges use the results of placement tests--either alone or in concert with other information--to determine whether students are ready for college-level coursework or need remedial help in math or English. Evidence suggests that placement tests do a poor job of indicating which students need remediation. The Center for the Analysis of Postsecondary Readiness (CAPR) is studying an alternative placement system that uses multiple measures--including both placement test scores and high school GPAs--in predictive algorithms to place incoming students into remedial or college-level courses. Seven community colleges in the State University of New York system participated in the random assignment study to determine whether multiple measures placement leads to better student outcomes than a system based on test scores alone. Using multiple measures placement, many more students were assigned to college-level courses. In math, gains in college-level enrollment and completion were small and short-lived. But in English, the effects were much larger and lasted through at least three semesters. Regardless of whether they were predicted to succeed, students did better when they were allowed to start in college-level courses. A report on longer-term outcomes from the study will be released in summer 2022.

Preschool teachers from a high-poverty, urban school district were trained to implement Story Talk, a book reading intervention designed to increase children's vocabulary and language development using supportive materials and strategic individualized coaching. Thirty-five teachers were randomly assigned by site to the intervention (20) or the control condition (15). Teachers in the intervention were provided with training; one-to-one, bi-monthly coaching; and Story Maps that included target vocabulary, open-ended questions to promote conversations during book reading, and suggested extension activities that support use of target vocabulary. The results suggested that teachers in the intervention increased on the global quality of their instruction, as well as on their fidelity to the project's strategies and their use of target vocabulary words. In addition, children in the intervention classrooms performed significantly better on measures of taught vocabulary words, and HLM analyses found gains on the Peabody Picture Vocabulary Test-4 (d?=?0.19) and the Expressive One Word Picture Vocabulary Test-4 (d?=?0.14), both standardized measures of vocabulary development. The results suggest that Story Talk holds promise as a relatively resource-conservative PD intervention that can be implemented with fidelity and can significantly improve children's vocabulary development, especially among children in high-poverty schools.

Postsecondary education is widely seen as a necessity in the modern economy, yet among low and middle-income families, college enrollment rates are dismayingly low -- and graduation rates are even lower. College Promise programs, which cover local students' college tuition and fees, are one strategy states and municipalities use to help. But traditionally, these programs look only to expand college access, not to address college success. Detroit's Promise program was designed to encourage college attendance among some of the nation's most underserved students, those in Detroit, Michigan. The next step was to help students succeed once they enrolled in college. To do so, MDRC and the Detroit Promise partnered to create the Detroit Promise Path, an evidence-based student services program. This report presents findings from MDRC's randomized controlled trial evaluation of the Detroit Promise Path. About two-thirds of eligible students were randomly assigned to be offered the new program, while the rest were assigned to a control group who receives the Promise scholarship alone, and thus does not meet with coaches or receive incentives. Comparing the two groups' outcomes over time provides a reliable estimate of the effects of the Detroit Promise Path. The findings in this report include the following: (1) The program has a positive effect on students' persistence in school, full-time enrollment, and credit accumulation; (2) Although it is too early to reach a conclusion about effects in the second year of the study, the early findings are encouraging; and (3) Participation rates were high among enrolled students, and students reported positive experiences in the program, especially in their relationships with their coaches. It is clear that Detroit Promise Path is having a positive effect on students in the first two years. This evaluation shows that building student support services into Promise scholarships can have a meaningful effect on students' academic progress. [Additional funding for this report was provided by the Michigan Education Excellence foundation.]

Nationwide, graduation rates at community colleges are discouragingly low. This randomized experiment provides evidence that graduation rates can be increased dramatically. The City University of New York's (CUNY) Accelerated Study in Associate Programs (ASAP) is a comprehensive, integrated, 3-year program that has an estimated 18 percentage point effect on 3-year graduation rates, increases 6-year graduation rates by an estimated 10 percentage points, and helps students graduate more quickly. Graduation effect estimates of this magnitude are exceptional in randomized experiments conducted in higher education, offering hope of what is possible when serving low-income students.

Analyses of literacy and numeracy levels worldwide by the Organisation for Economic Cooperation and Development suggest that the U.S. population has one of the lowest numeracy levels among developed nations. Sixty-four percent of American adults are unable to use math and interpret math problems that most higher-level jobs require, and a full 30 percent can perform only basic mathematical computations such as arithmetic or solve simple one-step operations such as counting. These findings reveal the critical need to improve American adults' math skills. Even in the U.S. educational context, many people continue to struggle with learning math, and college preparatory math classes, also known as developmental or remedial math, present a particular challenge. This report presents the findings of a study of a popular math pathways innovation, the Dana Center Mathematics Pathways (DCMP, formerly the New Mathways Project). It examines the effects of the implementation of the DCMP's curricular models, which entail changes in both math content and instructional methods in developmental education and college-level courses while also accelerating developmental students' progress into college-level math. Using a randomized controlled trial, this evaluation examines how four Texas community colleges implemented the DCMP at their institutions in developmental and college-level classrooms and looks at the differences in instruction between these courses and colleges' standard math courses. Additionally, the study analyzes the impact of the DCMP on students' academic outcomes for up to four semesters and compares the costs of the initiative with colleges' standard course pathways. Following an introduction in chapter one, the remainder of the report is divided into five chapters. Chapter 2 discusses in more detail the DCMP model and expectations for its implementation. Chapter 3 discusses the implementation of the DCMP at the four colleges, and the fidelity and contrast between the DCMP and the colleges' standard math courses. Chapter 4 analyzes the DCMP's impact on students' outcomes. Chapter 5 examines the costs of the DCMP. Finally, Chapter 6 provides concluding thoughts and recommendations for next steps in research and practice. [For the Executive Summary, see ED600651.]

In 2010, the Administration for Children and Families (ACF) within the U.S. Department of Health and Human Services awarded the first round of five-year Health Profession Opportunity Grants (HPOG 1.0) to 32 organizations in 23 states; five were tribal organizations. The purpose of the HPOG Program is to provide education and training to Temporary Assistance for Needy Families (TANF) recipients and other low-income individuals for occupations in the healthcare field that pay well and are expected to either experience labor shortages or be in high demand. HPOG 1.0 grantees designed and implemented programs to provide eligible participants with education, occupational training, and support and employment services to help them train for and find jobs in a variety of healthcare professions. The ACF Office of Planning, Research, and Evaluation supports a multipronged research and evaluation strategy to assess the success of the HPOG Program. To assess its effectiveness, the first round of local HPOG programs was evaluated using an experimental design in which eligible program applicants were assigned at random to a "treatment" group that could access the program or a "control" group that could not. To compute the program's impact, the outcomes for each group were compared. This document reports on the impacts that arose about three years after random assignment. It reports an overall average impact across the diverse HPOG 1.0 programs, as well as impacts for selected subgroups of study participants.

Colleges throughout the United States are evaluating the effectiveness of the strategies used to decide whether to place students into college-level or developmental education courses. Developmental, or remedial, courses are designed to develop the reading, writing, or math skills of students deemed underprepared for college-level courses, a determination usually made through standardized placement tests. However, increasing numbers of colleges are using multiple measures to place students, including additional types of placement tests, high school transcripts, and evaluations of student motivation. The current study was developed to add to the understanding about the implementation, cost, and efficacy of an multiple measures assessment (MMA) system using locally determined rules. As part of a randomized controlled trial, the study team evaluated MMA programs and interviewed and observed staff at five colleges in Minnesota and Wisconsin; it also wrote a short case study about one Wisconsin college. The five colleges in the random assignment study targeted all students taking placement tests in the months before the fall 2018 semester. In the four colleges included in the current analysis, 5,282 students participated in the study; of these, 3,677 were tested for English, and 4,487 were tested for math. The findings suggest that while implementation (especially automation) was not easy, it was possible; and using the new MMA systems became much easier once they were established.

The recent wave of test-based accountability reforms has negatively impacted the provision of K-12 arts educational experiences. Advocates contend that, in addition to providing intrinsic benefits, the arts can positively influence academic and social development. However, the empirical evidence to support such claims is limited. We conducted a randomized controlled trial with 10,548 3rd-8th grade students who were enrolled in 42 schools that were assigned by lottery to receive substantial influxes of arts education experiences provided through school-community partnerships with local arts organizations, cultural institutions, and teaching-artists. We find that these increases in arts educational experiences significantly reduce the proportion of students receiving disciplinary infractions by 3.6 percentage points, improve STAAR writing achievement by 0.13 of a standard deviation, and increase students' compassion for others by 0.08 of a standard deviation. For students in elementary schools, which comprise 86 percent of the sample, we find that these arts educational experiences also significantly improve school engagement, college aspirations, and arts-facilitated empathy. These findings provide strong evidence that arts educational experiences can produce significant positive impacts on student academic and social development. Policymakers should consider these multifaceted educational benefits when assessing the role and value of the arts in K-12 schools.

Building on a previous randomized experiment of the impact of Early Colleges (ECs) (Berger et al., 2013), this follow-up study assessed longer-term impacts of ECs on students' postsecondary outcomes 6 years after expected high school graduation. It also explored the extent to which students' high school experiences mediate EC impacts. Specifically, this study addressed three research questions: (1) Did EC students have better postsecondary outcomes (i.e., college enrollment and degree attainment) than control students? (2) Did the impacts of ECs vary by student background characteristics (i.e., gender, race/ethnicity, low-income status, and prior mathematics and English language arts [ELA] achievement)? and (3) Were the impacts of ECs mediated by students' high school experiences (i.e., college credit accrual during high school, instructional rigor, college-going culture, and student supports)? To answer these questions for the follow-up study, the authors analyzed 4 more years of postsecondary outcome data from the StudentTracker Service at the National Student Clearinghouse for students participating in the EC admission lotteries that were the basis of the previous impact study. They also analyzed data on student background characteristics from administrative records and data on high school experiences from a student survey administered in the previous impact study 5 or 6 years after students entered the ninth grade. [To view the earlier report, "Early College, Early Success: Early College High School Initiative Impact Study," see ED577243.]

We investigated whether individual differences in overall receptive vocabulary knowledge measured at the beginning of the year moderated the effects of a kindergarten vocabulary intervention that supplemented classroom vocabulary instruction. We also examined whether moderation would offset the benefits of providing Tier-2 vocabulary intervention within a multitiered-system-of-support (MTSS) or response-to-intervention framework. Participants included students from two previous studies identified as at risk for language and learning difficulties who were randomly assigned in clusters to receive small-group vocabulary intervention in addition to classroom vocabulary instruction (n = 825) or to receive classroom vocabulary instruction only (n = 781). A group of not-at-risk students (n = 741) who received classroom vocabulary instruction served as a reference group. Initial vocabulary knowledge measured at pretest moderated the impact of intervention on experimenter-developed measures of expressive vocabulary learning and listening comprehension favoring students with higher initial vocabulary knowledge. Tier-2 intervention substantially counteracted the Matthew effect for target word learning. Intervention effects on listening comprehension depended on students' initial vocabulary knowledge. Implications present benefits and challenges of supporting vocabulary learning within an MTSS framework.

The period of early adolescence is characterized by dramatic changes, simultaneously affecting physiological, psychological, social, and cognitive development. The physical transition from elementary to middle school can exacerbate the stress and adversity experienced during this critical life stage. Middle school students often struggle to find social and emotional support, and many students experience a decreased sense of belonging in school, diverting students from promising academic and career trajectories. Drawing on psychological insights for promoting belonging, we fielded a brief intervention designed to help students reappraise concerns about fitting in at the start of middle school as both temporary and normal. We conducted the first district-wide double-blind experimental study of this approach with middle-school students (N=1,304). Compared to the control condition activities, the intervention reduced sixth-grade disciplinary incidents across the district by 34%, increased attendance by 12%, and reduced the number of failing grades by 18%. Differences in benefits across demographic groups were not statistically significant but some impacts were descriptively larger for historically underserved minority students and boys. A mediational analysis suggested 80% of long-term intervention effects on students' GPA were accounted for by changes in students' attitudes and behaviors. These results demonstrate the long-term benefits of psychologically reappraising stressful experiences during critical transitions and the psychological and behavioral mechanisms that support them. Furthermore, this brief intervention is a highly cost-effective and scalable approach that schools may use to help address the troubling decline in positive attitudes and academic outcomes typically accompanying adolescence and the middle school transition. [This paper was published in "Proceeedings of the National Academy of Sciences" v116 p16286-16291 2019.]

The purpose of this replication study was to provide replication evidence not currently available of the effects of a research-based mathematics program, schema-based instruction, on the mathematical problem-solving performance of 7th-grade students. The replication was implemented in 36 schools in 5 districts; 59 mathematics teachers and their students (N = 1,492) participated in the study. Multilevel hierarchical linear analyses revealed statistically significant differences between conditions on proximal and distal measures of mathematics problem solving, with effects sizes similar to those reported in Jitendra et al. (2015).

We report the results of a preregistered, cluster randomized controlled trial of a mathematics learning intervention known as interleaved practice. Whereas most mathematics assignments consist of a block of problems devoted to the same skill or concept, an interleaved assignment is arranged so that no 2 consecutive problems require the same strategy. Previous small-scale studies found that practice assignments with a greater proportion of interleaved practice produced higher test scores. In the present study, we assessed the efficacy and feasibility of interleaved practice in a naturalistic setting with a large, diverse sample. Each of 54 7th-grade mathematics classes periodically completed interleaved or blocked assignments over a period of 4 months, and then both groups completed an interleaved review assignment. One month later, students took an unannounced test, and the interleaved group outscored the blocked group, 61% versus 38%, d 0.83. Teachers were able to implement the intervention without training, and they later expressed support for interleaved practice in an anonymous survey they completed before they knew the results of the study. Although important caveats remain, the results suggest that interleaved mathematics practice is effective and feasible.

This is the final report of a large-scale independent evaluation of the Building Assets and Reducing Risks (BARR) model in ninth grade in eleven high schools in Maine, California, Minnesota, Kentucky, and Texas. This sample of schools included large and small schools in urban, suburban, and rural areas, serving students from a wide range of demographic and socio-economic backgrounds. Funded with a validation grant from the U.S. Department of Education's Investing in Innovation (i3) program and carried out by researchers at the American Institutes for Research (AIR), this evaluation used random assignment of ninth-grade students to BARR and control conditions to estimate the impacts of the BARR model after one year. The evaluation also assessed the fidelity of implementation of BARR in the eleven study schools and identified barriers to and facilitators of successful implementation. The evaluation focused on several teacher- and student-level outcomes. The teacher outcomes included measures of teacher collaboration, and use of data, among others. The academic outcomes included course failure, students' grade point average (GPA), and performance on the Northwest Evaluation Association's (NWEA) Measures of Academic Progress (MAP) standardized reading and mathematics assessments. Student-reported experiences included measures of supportive relationships, perceptions of teachers' expectations of them, student engagement, and others. In addition to these outcomes, the report includes impact estimates for attendance, suspensions, and persistence into 10th grade. [This report was written with Brenna O'Brien, Cheryl Graczewski, So Jung Park, Feng Liu, Ethan Adelman-Sil, Lynn Hu.]

Data-based problem solving is a hallmark of research-supported practices such as positive behavioral interventions and supports. In this study, we provided members of positive behavioral interventions and supports (PBIS) teams from 38 elementary schools with professional development focused on a research-supported problem-solving model (Team-Initiated Problem Solving). We used direct observations to document procedures, practices, and outcomes before and after participating in the professional development workshop. Within the context of a randomized waitlist controlled trial, team members in the Immediate Group demonstrated greater improvement in (a) problem-solving procedures, (b) decision-making practices, and (c) meeting outcomes than did members of PBIS teams in the Waitlist Group. Our findings extend what is known about team-based problem solving and provide a framework for future research and improved practice related to decision making by school teams.

The U.S. Department of Education tested a set of promising, low-cost advising strategies, called "Find the Fit," designed to help low-income and "first generation" students enrolled in the Department's Upward Bound program choose more selective colleges and stay in until they complete a degree. About 200 Upward Bound projects with 4,500 seniors agreed to participate. The projects were randomly assigned to receive "Find the Fit" to supplement their regular college advising (treatment group) or to offer their regular advising (control group). This first of three reports looks at "Find the Fit's" effects on students' steps toward enrolling in a more selective college. The study found that the enhanced advising increased the number and selectivity of colleges to which students applied. [For the study snapshot, "Study of Enhanced College Advising in Upward Bound: Impacts on Steps toward College. Study Snapshot. NCEE 2019-4002," see ED588785. For the study highlights, "Study of Enhanced College Advising in Upward Bound: Impacts on Steps toward College. Study Highlights. NCEE 2019-4002," see ED588786.]

This report documents the implementation and early impacts of the Carreras en Salud (Careers in Health) program, operated by Instituto del Progreso Latino, in Chicago, Illinois. The Carreras en Salud program is one promising effort aimed at helping low-income, low-skilled adults access and complete occupational training that can lead to increased employment and higher earnings. A distinctive feature of this program is its focus on training for low-income Latinos for employment in healthcare occupations, primarily Certified Nursing Assistant (CNA) and Licensed Practical Nurse (LPN). It is among nine career pathways programs being evaluated in the Pathways for Advancing Careers and Education (PACE) study sponsored by the Administration for Children and Families. The Carreras en Salud program consists of five elements: (1) a structured healthcare training pathway, starting at low skill levels; (2) contextualized and accelerated basic skills and ESL instruction; (3) academic advising and non-academic supports; (4) financial assistance; and (5) employment services. Using a rigorous research design, the study found that the Carreras en Salud program increased hours of occupational training and basic skills instruction received and the attainment of education credentials within an 18-month follow-up period. The program also increased employment in the healthcare field and resulted in a reduction of participants reporting financial hardship.

While the United States has made strides in increasing college access among low-income students, college completion has remained low. Graduation rates are particularly low at the nation's community colleges, which enroll a disproportionate percentage of low-income and nontraditional college students. Seeking to address this problem, in 2014 three community colleges in Ohio -- Cincinnati State Technical and Community College, Cuyahoga Community College, and Lorain County Community College -- undertook a new strategy to help more of their lowest-performing students succeed academically. The highly successful Accelerated Study in Associate Programs (ASAP) developed by the City University of New York (CUNY) provided a model. ASAP is a comprehensive program that provides students with up to three years of financial and academic support and other support services to address multiple barriers to student success, with the goal of helping more students graduate within three years. This brief presents two-year impact, implementation, and cost findings for the pooled, full study sample in the ASAP Ohio demonstration. The findings show that students in the program group clearly outperformed the control group with respect to persistence in school, credit accumulation, and graduation. Graduation rates more than doubled: 19 percent of the program group earned a degree or credential after two years compared with 8 percent of the control group. The brief also presents some findings from analyses of the programs' implementation and costs. [This report was written with Sean Blake and Erick Alonzo.]

Many incoming college students are referred to remedial programs in math or English based on scores they earn on standardized placement tests. Yet research shows that some students assigned to remediation based on test scores would likely succeed in a college-level course in the same subject area without first taking a remedial course if given that opportunity. Research also suggests that other measures of student skills and performance, and in particular high school grade point average (GPA), may be useful in assessing college readiness. The Center for the Analysis of Postsecondary Readiness (CAPR) is conducting a random assignment study of a multiple measures placement system based on data analytics to determine whether it yields placement determinations that lead to better student outcomes than a system based on test scores alone. Seven community colleges in the State University of New York (SUNY) system are participating in the study. The alternative placement system evaluated uses data on prior students to weight multiple measures--including both placement test scores and high school GPAs--in predictive algorithms developed at each college that are then used to place incoming students into remedial or college-level courses. Over 13,000 incoming students who arrived at these colleges in the fall 2016, spring 2017, and fall 2017 terms were randomly assigned to be placed using either the status quo placement system (the control group) or the alternative placement system (the program group). The three cohorts of students will be tracked through the fall 2018 term, resulting in the collection of three to five semesters of outcomes data, depending on the cohort. This interim report, the first of two, examines implementation of the alternative placement system at the colleges and presents results on first-term impacts for 4,729 students in the fall 2016 cohort. The initial results are promising. The final report, to be released in 2019, will examine a range of student outcomes for all three cohorts, including completion of introductory college-level courses, persistence, and the accumulation of college credits over the long term. [This report was written with Dan Cullinan.]

This report describes the implementation and early impacts of the Washington State Integrated Basic Education and Skills Training (I-BEST) program at three colleges: Bellingham Technical College, Everett Community College, and Whatcom Community College. I-BEST is a nationally known program that aims to increase access to and completion of college-level occupational training in a variety of in-demand occupational areas. Its signature feature is team teaching by a basic skills instructor and an occupational instructor during at least 50 percent of occupational training class time. Colleges operated I-BEST programs in one or more occupational areas including automotive, electrical, office skills, nursing, precision machining, and welding. I-BEST is one of nine career pathways programs being evaluated under the Pathways for Advancing Careers and Education (PACE) study sponsored by the Administration for Children and Families. The I-BEST program was launched in Washington in the 2006-07 academic year by the Washington State Board for Community and Technical Colleges. I-BEST aims to help students in basic skills programs (e.g., Adult Basic Education, English as a Second Language), who otherwise might have spent time in remediation, to enroll and succeed in college-level occupational training courses. Each I-BEST program is a course of study within a structured career pathway, and it offers students the opportunity to obtain credentials and college credits in in-demand occupations. Besides the team teaching, the I-BEST program evaluated in PACE also included two enhancements: financial support for tuition and associated materials; and additional advising services focused on supporting students' academic needs, navigating college procedures, and career planning. Using a rigorous research design, the study found that the I-BEST programs at the three colleges increased participation in college level courses, number of credits earned and credential attainment. Future reports will examine whether the I-BEST program resulted in gains in employment and earnings.

Many students who enter community college are deemed underprepared for college-level courses and are referred to developmental (remedial) education courses to build their math, reading, or writing skills. These students often struggle in developmental courses and in college more broadly. To help them, the City University of New York (CUNY) developed CUNY Start. CUNY Start targets incoming students who are assessed as needing remediation in math, reading, and writing. The program delays college matriculation (enrollment in a degree program) for one semester and provides intensive instruction in math, reading, and writing during that semester with a prescribed instructional approach. It also provides advising, tutoring, and a weekly seminar that teaches students skills they need to succeed in college. This report is an evaluation of the program. Findings in this report include: (1) CUNY Start was implemented as it was designed, and the contrast between the program and the colleges' standard courses and services was substantial; (2) During the first semester in the study, program group students made substantially more progress through developmental education than control group students; effects were especially large in math. In contrast, during that same semester, control group students earned more college credits than program group students, as predicted by CUNY Start's designers; and (3) During the second semester, program group students enrolled at CUNY colleges (that is, participated in CUNY Start or enrolled in any non-CUNY Start courses as matriculated students) at a higher rate than control group students. Seven appendices are included.

This report documents the implementation and early impacts of Year Up--a national sectoral training program for urban young adults aged 18-24. Operated by an organization of the same name, Year Up provides six months of full-time training in the IT and financial service sectors followed by six-month internships at major firms. The full-time program provides extensive supports--including weekly stipends--and puts a heavy emphasis on the development of professional and technical skills. Year Up is one of nine programs in the federally sponsored Pathways for Advancing Careers and Education (PACE) evaluation. It is among the most intensive workforce training programs tested to date. More than half (59 percent) of the program's $28,290 per-participant cost is funded by employer payments for interns. Using a random assignment design, the study found that Year Up increased receipt of employment and training services. Compared to control group members who were not able to access the program, treatment group members were more likely to report that their classes used active learning methods, taught life skills, and were relevant to their lives and careers. Most importantly, young adults with access to Year Up had higher average quarterly earnings in the sixth and seventh quarters after random assignment--the confirmatory outcome selected to gauge Year Up's overall success for this report. Persisting over a three-year follow-up period, Year Up's earnings impacts are the largest reported to date for workforce programs tested using a random assignment design.

Policymakers face dilemmas when choosing a policy, program, or practice to implement. Researchers in education, public health, and other fields have proposed a sequential approach to identifying interventions worthy of broader adoption, involving pilot, efficacy, effectiveness, and scale-up studies. In this paper, we examine a scale-up of an early math intervention to the state level, using a cluster randomized controlled trial. The intervention, "Pre-K Mathematics," has produced robust positive effects on children's math ability in prior pilot, efficacy, and effectiveness studies. In the current study, we ask if it remains effective at a larger scale in a heterogeneous collection of pre-K programs that plausibly represent all low-income families with a child of pre-K age who live in California. We find that "Pre-K Mathematics" remains effective at the state level, with positive and statistically significant effects (effect size = 0.30, p < 0.01). In addition, we develop a framework of the dimensions of scale-up to explain why effect sizes might decrease as scale increases. Using this framework, we compare the causal estimates from the present study to those from earlier, smaller studies. Consistent with our framework, we find that effect sizes have decreased over time. We conclude with a discussion of the implications of our study for how we think about the external validity of causal relationships. [This is the online version of an article published in "Evaluation Review."]

Research has consistently linked early problem behavior with later adjustment problems, including antisocial behavior, learning problems and risk for the development of emotional/behavioral disorders (EBDs). Researchers have focused upon developing effective intervention programs for young children who arrive in preschool exhibiting chronic problem behaviors; however, Tier-2 interventions that can be delivered by teachers with fidelity in authentic settings are lacking. This study examined the effect of BEST in CLASS, a Tier-2 intervention delivered by teachers, on child problem behavior, teacher-child interactions and teacher-child relationships using a cluster randomized controlled trial design. Participants were 465 children (3-5 year olds) identified at risk for the development of EBDs and their 185 teachers from early childhood programs located in two southeastern states. Significant effects were found across both teacher reported (ES ranging from 0.23 to 0.42) and observed child outcomes (ES ranging form 0.44-0.46), as well as teacher-child relationships (ES ranging from 0.26 to 0.29) and observed teacher-children interactions (ES ranging from 0.26 to 0.45), favoring the BEST in CLASS condition. Results suggest the promise of BEST in CLASS as a Tier-2 intervention for use in authentic early childhood classroom contexts and provide implications for future research on transactional models of teacher and child behavior.

UPSTART is a federally funded i3 validation project that uses a computer-based program to develop the school readiness skills of preschool children in rural Utah. Researchers used a randomized control trial design to evaluate the impact of the program in advancing children's early literacy skills. Preschoolers in the experimental group were randomly assigned to the UPSTART Reading software, while control group students were assigned to UPSTART Math. Standardized early literacy assessments were administered prior to program commencement and upon completion. Results revealed that there was a significant difference in children's mean scores on measures of letter knowledge and phonological awareness, after controlling for prior knowledge, missing pre-test data, and children's school district between those who participated in UPSTART Reading and those in the comparison group. There were no differences between the two groups on assessments measuring vocabulary and oral language or listening comprehension.

This report summarizes the implementation and evaluation of the Accelerating Connections to Employment (ACE) program. The ACE program model is designed to improve employment and employment-related outcomes for low-skilled workers through formal partnerships between Workforce Investment Boards (WIBs) and community colleges. Implemented at nine sites across four states (Maryland, Texas, Connecticut and Georgia) from 2012 to 2015, ACE provided training, support services, job readiness and job placement support to 1,258 participants. The ACE program is defined by five core activities: (1) a program planning stage, consisting of a program selection process informed by local labor market information, (2) intake and eligibility testing, consisting of program orientation and suitability assessments, (3) training, incorporating elements of the I-BEST model to provide integrated basic and vocational skills instruction, (4) support services, including academic and transportation support and (5) transition and tracking, including job readiness and placement services. The final report describes these components and their implementation in detail, highlighting challenges encountered and lessons learned. Quantitative results from the randomized controlled trial (RCT) evaluation of ACE are presented, as well as the results of a cost study describing the costs associated with implementing the ACE model. The research draws on quantitative data collected from state unemployment insurance (UI) records, a one-year and two-year multi-modal follow-up survey and intake and tracking data collected by ACE staff. Additional qualitative information, used to inform the implementation study, are drawn from annual site visit interviews, focus groups and classroom observations, as well as open-ended survey questions included in each of the follow-up surveys. Key findings. The quantitative results of the RCT evaluation show that ACE has a significant positive impact on employment rates and earnings for ACE participants at all but one of the ACE sites, as well as positive and significant impacts on credential attainment. The implementation study and fidelity assessment indicate that each of the ACE sites followed the program model, although the implementation of the ACE model evolved as sites identified new staffing and service needs. Specifically, sites adapted to unanticipated challenges by adding new staff positions and adapting program procedures to better serve participants. [This report was Submitted to the Baltimore County Department of Economic and Workforce Development and the Workforce Innovation Fund National Evaluation Coordinator. For the Appendices, see ED618507.]

Senior year of high school can be a pivotal time in a young person's life. For some, it is the last step on the path to college and work. For others, finding stable employment or attending university after high school is far from guaranteed. Urban Alliance, headquartered in Washington, DC, helps students at risk of becoming disconnected from work or school transition to higher education or employment after high school. Through its High School Internship Program, it offers participating high school seniors training, an internship, and mentoring to help them succeed. The Urban Institute recently completed an evaluation of the program in Washington, DC, and Baltimore. Using an experimental design, the study revealed several key findings approximately two years after high school.

This article describes the effects of an analysis-of-practice professional development (PD) program on elementary school students' (Grades 4-6) science outcomes. The study design was a cluster-randomized trial with an analysis sample of 77 schools, 144 teachers and 2,823 students. Forty-two schools were randomly assigned to treatment, (88.5 hours) of integrated analysis-of-practice and content deepening PD (over the course of one year) while 35 schools were randomly assigned to receive an equal number of PD hours in science content deepening alone. Students' content knowledge, as measured by a project-specific test, was compared across treatment groups. The effect size for this comparison was 0.52 standard deviations in favor of students whose teachers participated in the PD that included analysis-of-practice. This effect compares favorably to that of other elementary school interventions whose effectiveness was studied with a narrowly focused outcome measure. Analysis of the demographics of the study schools suggests that the treatment effect could be relevant outside the local study context. Implications for future research include tests of mediation for teacher-level outcomes and efficacy tests of specific teaching strategies (intervention subcomponents).

With national focus on reading and math achievement, science and social studies have received less instructional time. Yet, accumulating evidence suggests that content knowledge is an important predictor of proficient reading. Starting with a design study, we developed content-area literacy instruction (CALI) as an individualized (or personalized) instructional program for kindergarteners through 4th graders to build science and social studies knowledge. We developed CALI to be implemented in general education classrooms, over multiple iterations (n = 230 students), using principles of design-based implementation research. The aims were to develop CALI as a usable and feasible instructional program that would, potentially, improve science and social studies knowledge, and could be implemented during the literacy block without negatively affecting students' reading gains (i.e., no opportunity cost). We then evaluated the efficacy of CALI in a randomized controlled field trial with 418 students in kindergarten through 4th grade. Results reveal that CALI demonstrates promise as a usable and feasible instructional individualized general education program, and is efficacious in improving social studies (d = 2.2) and science (d = 2.1) knowledge, with some evidence of improving oral and reading comprehension skills (d = 0.125).

Using data from seven cohorts of language immersion lottery applicants in a large, urban school district, we estimate the causal effects of immersion programs on students' test scores in reading, mathematics, and science, and on English learners' (EL) reclassification. We estimate positive intent-to-treat (ITT) effects on reading performance in fifth and eighth grades, ranging from 13 to 22 percent of a standard deviation, reflecting 7 to 9 months of learning. We find little benefit in terms of mathematics and science performance, but also no detriment. By sixth and seventh grade, lottery winners' probabilities of remaining classified as EL are three to four percentage points lower than those of their counterparts. This effect is stronger for ELs whose native language matches the partner language. [This article was published in: "American Educational Research Journal" v54 n1 suppl p282S-306S Apr 2017 (EJ1155308).]

This study used a randomized controlled trial design to investigate the ROOTS curriculum, a 50-lesson kindergarten mathematics intervention. Ten ROOTS-eligible students per classroom (n = 60) were randomly assigned to one of three conditions: a ROOTS five-student group, a ROOTS two-student group, and a no-treatment control group. Two primary research questions were investigated as part of this study: What was the overall impact of the treatment (the ROOTS intervention) as compared with the control (business as usual)? Was there a differential impact on student outcomes between the two treatment conditions (two- vs. five-student group)? Initial analyses for the first research question indicated a significant impact on three outcomes and positive but nonsignificant impacts on three additional measures. Results for the second research question, comparing the two- and five-student groups, indicated negligible and nonsignificant differences. Implications for practice are discussed. [For the corresponding grantee submission, see ED578431.]

Developed in response to concerns that too few students were enrolling and succeeding in postsecondary education, early college high schools are small schools that blur the line between high school and college. This article presents results from a longitudinal experimental study comparing outcomes for students accepted to an early college through a lottery process with outcomes for students who were not accepted through the lottery and enrolled in high school elsewhere. Results show that treatment students attained significantly more college credits while in high school, and graduated from high school, enrolled in postsecondary education, and received postsecondary credentials at higher rates. Results for subgroups are included.

Developed in response to concerns that too few students were enrolling and succeeding in postsecondary education, early college high schools are small schools that blur the line between high school and college. This article presents results from a longitudinal experimental study comparing outcomes for students accepted to an early college through a lottery process with outcomes for students who were not accepted through the lottery and enrolled in high school elsewhere. Results show that treatment students attained significantly more college credits while in high school, and graduated from high school, enrolled in postsecondary education, and received postsecondary credentials at higher rates. Results for subgroups are included. [This paper was published in the "Journal of Research on Educational Effectiveness" (EJ1135800)]

Developed in response to concerns that too few students were enrolling and succeeding in postsecondary education, early college high schools are small schools that blur the line between high school and college. This article presents results from a longitudinal experimental study comparing outcomes for students accepted to an early college through a lottery process with outcomes for students who were not accepted through the lottery and enrolled in high school elsewhere. Results show that treatment students attained significantly more college credits while in high school, and graduated from high school, enrolled in postsecondary education, and received postsecondary credentials at higher rates. Results for subgroups are included. [This paper was published in the "Journal of Research on Educational Effectiveness" (EJ1135800)]

This report presents the findings from an efficacy trial and process evaluation of the Parent Engagement Programme (PEP). The PEP was a school-level intervention designed to improve pupil outcomes by engaging parents in their children's learning. The programme was developed collaboratively by research teams from the University of Bristol and Harvard University and was delivered between September 2014 and July 2015. The study was conducted by the Centre for Effective Education, Queen's University Belfast between February 2014 and February 2016. The trial involved 15,697 students in Years 7, 9, and 11 from 36 English secondary schools, with schools sending an average of 30 texts to each parent over the period of the trial. The developers of the intervention managed its delivery to ensure optimal implementation. It was a cluster randomised controlled trial with randomisation at the Key Stage level, designed to determine the impact of the intervention on the academic outcomes of students in English, maths, and science, and the impact on absenteeism. A process evaluation used focus groups, telephone surveys, interviews, and an online survey to provide data on implementation and to capture the perceptions and experiences of participating parents, pupils, and teachers. Key conclusions include: (1) Children who had the intervention experienced about one month of additional progress in maths compared to other children. This positive result is unlikely to have occurred by chance; (2) Children who had the intervention had reduced absenteeism compared to other children. This positive result is unlikely to have occurred by chance; (3) Children who had the intervention appeared to experience about one month of additional progress in English compared to other children. However, analysis suggests that this finding might have been affected by bias introduced by missing data, so evaluators cannot reliably draw this conclusion. There is no evidence to suggest that the intervention had an impact on science attainment; (4) Schools embraced the programme and liked its immediacy and low cost. Many respondents felt that the presence of a dedicated coordinator would be valuable to monitor the accuracy and frequency of texts. Schools should consider whether they would be able to provide this additional resource; and (5) The vast majority of parents were accepting of the programme, including the content, frequency, and timing of texts. [Note: The post-reporting appendix was added in June 2017.]

This study examined the efficacy of a supplemental, multicomponent adolescent reading intervention for middle school students who scored below proficient on a state literacy assessment. Using a within-school experimental design, the authors randomly assigned 483 students in grades 6-8 to a business-as-usual control condition or to the Strategic Adolescent Reading Intervention (STARI), a supplemental reading program involving instruction to support word-reading skills, fluency, vocabulary, and comprehension, and peer talk to promote reading engagement and comprehension. The authors assessed behavioral engagement by measuring how much of the STARI curricular activities students completed during an academic school year, and collected intervention teachers' ratings of their students' reading engagement. STARI students outperformed control students on measures of word recognition (Cohen's d = 0.20), efficiency of basic reading comprehension (Cohen's d = 0.21), and morphological awareness (Cohen's d = 0.18). Reading engagement in its behavioral form, as measured by students' participation and involvement in the STARI curriculum, mediated the treatment effects on each of these three posttest outcomes. Intervention teachers' ratings of their students' emotional and cognitive engagement explained unique variance on reading posttests. Findings from this study support the hypothesis that (a) behavioral engagement fosters struggling adolescents' reading growth, and (b) teachers' perceptions of their students' emotional and cognitive engagement further contribute to reading competence.

In a randomized field trial with 2,850 seventh-grade mathematics students, we evaluated whether an educational technology intervention increased mathematics learning. Assigning homework is common yet sometimes controversial. Building on prior research on formative assessment and adaptive teaching, we predicted that combining an online homework tool with teacher training could increase learning. The online tool ASSISTments (a) provides timely feedback and hints to students as they do homework and (b) gives teachers timely, organized information about students' work. To test this prediction, we analyzed data from 43 schools that participated in a random assignment experiment in Maine, a state that provides every seventh-grade student with a laptop to take home. Results showed that the intervention significantly increased student scores on an end-of-the-year standardized mathematics assessment as compared with a control group that continued with existing homework practices. Students with low prior mathematics achievement benefited most. The intervention has potential for wider adoption. [For the corresponding grantee submission, see ED575159.]

The purpose of this report is to present the results of a two-year randomized control trial evaluation of the SPARK literacy program. SPARK is an early grade literacy program developed by Boys & Girls Clubs of Greater Milwaukee. In 2010, SPARK was awarded an Investing in Innovation (i3) Department of Education grant to further develop the program and test its impact in seven Milwaukee Public Schools (MPS). The evaluation used a randomized control trial selection to test the impact of SPARK across three domains: reading achievement, literacy, and school attendance. Informed consent was obtained from 576 parents for their students to participate in the study. A random sample of kindergarten, 1st, and 2nd grade students in seven MPS schools was selected in October and November of 2013 to participate. 286 students were randomly selected as SPARK participants and 290 students were randomly selected as control students. Stratification was done by school and grade level within school. The specific number of students selected to receive SPARK within each strata was determined both by the number of consented students and the capacity to serve students within each site. Students with a reading-related IEP or who were English Language Learners were not eligible to participate in the evaluation but were eligible to receive tutoring. All other students were eligible to participate. The results suggest that SPARK had statistically significant, positive impacts on reading achievement, literacy, and regular school day attendance. Tables are appended. [SREE documents are structured abstracts of SREE conference symposium, panel, and paper or poster submissions.]

For most students from low- or moderate-income families, successfully completing the Free Application for Federal Student Aid (FAFSA) is a crucial gateway on the path to college access. However, FAFSA filing and income verification tasks pose substantial barriers to college access for low-income students. In this paper, the authors report on a pair of interventions that utilize automated, text-based outreach to: (1) provide students and families with customized information about the importance of and their status on completing the FAFSA; (2) simplify information for students and families about how to complete the FAFSA; and (3) connect students and families to personalized counseling assistance to complete the FAFSA as well as the subsequent verification process, if selected. Data from the study points to the benefit of text-based outreach as a low-cost and readily scalable strategy for improving student completion of important college-going milestones, such as timely FAFSA filing. Tables and figures are appended.

This study reports the results of a cluster RCT evaluating the impact of Enhanced Core Reading Instruction on reading achievement of grade 1 at-risk readers. Forty-four elementary schools, blocked by district, were randomly assigned to condition. In both conditions, at-risk readers received 90 minutes of whole-group instruction (Tier 1) plus an additional 30 minutes of daily, small-group intervention (Tier 2). In the treatment condition, Tier 1 instruction included enhancements to the core program and Tier 2 intervention was highly aligned with the core program. In the comparison condition, Tier 1 instruction used the same core program as treatment schools in the district and Tier 2 intervention followed standard district protocol. Significant treatment effects were found on measures of phonemic decoding and oral reading fluency from fall to winter and word reading from fall to spring. Student- and classroom-level variables predicted student response to instruction differentially by condition.

A report released in April 2013 by Benjamin L Castleman of Harvard University and Lindsay C. Page of the Center for Education Policy Research at Harvard University examines the implications of two forms of interventions during the summer between high school and the first year of college on college enrollment. "Summer Nudging: Can Personalized Text Messages and Peer Mentor Outreach Increase College Going Among Low-Income High School Graduates?" details findings that text message reminders and peer mentor outreach programs can be an effective way to mitigate summer attrition. The report details two large-scale randomized trials done in collaboration with three educational agencies: the Dallas Independent School District (Dallas ISD), uAspire (a Boston-based nonprofit organization focused on college affordability), and Mastery Charter Schools (a network of charter schools in the Philadelphia metropolitan area). Castleman and Page reveal the positive impact these low-cost initiatives can have on college enrollment within low-income communities during an increasingly technological era.

Many college students never take, or do not pass, required remedial mathematics courses theorized to increase college-level performance. Some colleges and states are therefore instituting policies allowing students to take college-level courses without first taking remedial courses. However, no experiments have compared the effectiveness of these approaches, and other data are mixed. We randomly assigned 907 students to (a) remedial elementary algebra, (b) that course with workshops, or (c) college-level statistics with workshops (corequisite remediation). Students assigned to statistics passed at a rate 16 percentage points higher than those assigned to algebra (p < 0.001), and subsequently accumulated more credits. A majority of enrolled statistics students passed. Policies allowing students to take college-level instead of remedial quantitative courses can increase student success.

A college degree is often viewed as a key step toward better employment and higher earnings. Many community college students, however, never graduate and cannot reap the financial benefits associated with a college degree. Although existing research suggests that financial aid interventions can modestly improve students' short-term academic outcomes, there is little rigorous evidence on the critical question of whether such interventions improve graduation rates or employment outcomes. This study helps to fill that gap using a randomized controlled trial involving over 2,000 community college students in Ohio. It focuses on a student population composed predominantly of low-income mothers. The study includes four years of post-random assignment data to examine the long-term impact of a performance-based scholarship program--financial aid that is contingent on academic performance--on degree receipt, employment, and earnings. The findings provide evidence that the one-year program made a lasting impact on students' credit accumulation--still evident after four years--and decreased the time it took students to earn a degree, but the study does not provide evidence of impacts on employment outcomes.

Young people have been hit especially hard by changes in the labor market over the past decades. Unemployment among 16- to 24-year-olds increased the most of any age group during the recent recession, and remains more than double that among older adults. The unemployment rate is especially high for young people without high school diplomas. YouthBuild is one program that attempts to help this group, serving over 10,000 of them each year at over 250 organizations nationwide. Each organization provides construction-related or other vocational training, educational services, counseling, and leadership-development opportunities to low-income young people ages 16 to 24 who did not complete high school. YouthBuild is being evaluated using a randomized controlled trial, in which eligible young people at participating programs were assigned either to a program group, invited to enroll in YouthBuild, or to a control group, referred to other services in the community. The evaluation includes 75 programs across the country funded by the U.S. Department of Labor or the Corporation for National and Community Service and nearly 4,000 young people who enrolled in the study between 2011 and 2013. This report, the second in the evaluation, presents the program's effects on young people through two and a half years. About 75 percent of the young people assigned to the program group participated in YouthBuild, and about half of these participants reported that they graduated from the program within 12 months. YouthBuild led to a number of positive effects on young people, most consistently in the area of education and training. Main findings include: (1) YouthBuild increased participation in education and training, even though a high percentage of the young people in the control group also sought out and participated in education and training. Overall, participants rated their experiences in YouthBuild favorably, although some program components were rated more highly than others; (2) YouthBuild increased the rate at which participants earned high school equivalency credentials, enrolled in college, and participated in vocational training; (3) YouthBuild led to a small increase in wages and earnings at 30 months; (4) YouthBuild increased civic engagement, particularly volunteering, but had few effects on other measures of youth development or attitudes; and (5) YouthBuild had few effects on involvement in the criminal justice system. The program's interim effects on education and training are encouraging. A later report, measuring effects through four years, will examine whether these interim effects lead to longer-term gains in work and earnings. The following are appended: (1) Site Selection, Random Assignment, the Analysis Model, and Previous Evaluations; (2) Response Analyses for the 12- and 30-Month Surveys; (3) Survey Responses About YouthBuild Experiences and Service Receipt at 30 Months; and (4) Survey-Based Impacts and Subgroup Impacts at 12 Months and Selected Impacts Per Participant.

We conducted a potential efficacy trial examining the effects of classroom-wide implementation of the "Pyramid Model for Promoting Young Children's Social-Emotional Competence" on teachers' implementation of "Pyramid Model" practices and children's social-emotional skills and challenging behavior. Participants were 40 preschool teachers and 494 children. Using a randomized controlled design, 20 teachers received a professional development (PD) intervention to support their implementation of the practices. The 20 teachers in the control condition received workshops after all study-related data were collected. Teachers who received PD significantly improved their implementation of "Pyramid Model" practices relative to control teachers. Children in intervention teachers' classrooms were rated as having better social skills and fewer challenging behaviors relative to children in control teachers' classrooms. Exploratory analyses showed that children at elevated risk for behavior disorders in intervention teachers' classrooms had improvements in their observed social interaction skills relative to similar children in control teachers' classrooms.

Two intervention approaches designed to address the multifaceted academic and cognitive difficulties of low-income children who enter pre-K with very low math knowledge were tested in a randomized experiment. Blocking on classroom, children who met screening criteria were assigned to a Math + Attention condition in which the Pre-Kindergarten Mathematics Tutorial (PKMT) intervention was implemented (4 days/week for 24 weeks) in addition to 16 adaptive attention training sessions, a Math-Only condition using the PKMT intervention, or a business-as-usual condition. Five hundred eighteen children were assessed at pretest and posttest. There was a significant effect of the PKMT intervention on a broad measure of informal mathematical knowledge and a small but significant effect on a measure of numerical knowledge. Attention training was associated with small effects on attention, but did not provide additional benefit for mathematics. A main effect of state on math outcomes was associated with a stronger, numeracy-focused Tier 1 mathematics curriculum in one state. Findings are discussed with respect to increasing intensity of math-specific and domain-general interventions for young children at risk for mathematical learning difficulties.

Community colleges offer a pathway to the middle class for low-income individuals. Although access to college has expanded, graduation rates at community colleges remain low, especially for students who need developmental (remedial) courses to build their math, reading, or writing skills. The City University of New York's (CUNY's) Accelerated Study in Associate Programs (ASAP), launched in 2007, is an uncommonly comprehensive and long-term program designed to help more students graduate and help them graduate more quickly. This report presents results from a random assignment study of ASAP at three CUNY community colleges: Borough of Manhattan, Kingsborough, and LaGuardia. Low-income students who needed one or two developmental courses were randomly assigned either to a program group, who could participate in ASAP, or to a control group, who could receive the usual college services. Comparing the two groups' outcomes provides an estimate of ASAP's effects. Key findings from the report are included. The following are appended: (1) Additional Baseline Information; (2) MDRC Student Survey Documentation and Analyses; and (3) Additional Impact Tables. [See earlier CUNY's ASAP reports: "What Can a Multifaceted Program Do for Community College Students? Early Results from an Evaluation of Accelerated Study in Associate Programs (ASAP) for Developmental Education Students" at ED532840 and "More Graduates: Two-Year Results from an Evaluation of Accelerated Study in Associate Programs (ASAP) for Developmental Education Students" at ED546636.]

Reading Recovery (RR) is a short-term, one-to-one intervention designed to help the lowest achieving readers in first grade. This article presents first-year results from the multisite randomized controlled trial (RCT) and implementation study under the $55 million Investing in Innovation (i3) Scale-Up Project. For the 2011-2012 school year, the estimated standardized effect of RR on students' Iowa Tests of Basic Skills (ITBS) Total Reading Scores was 0.69 standard deviations relative to the population of struggling readers eligible for RR under the i3 scale-up and 0.47 standard deviations relative to the nationwide population of all first graders. School-level implementation of RR was, in most respects, faithful to the RR "Standards and Guidelines," and the intensive training provided to new RR teachers was viewed as critical to successful implementation.

This study examined the efficacy of a curriculum-based intervention for high school science students. Specifically, the intervention was two years of research-based, multidisciplinary curriculum materials for science supported by comprehensive professional development for teachers that focused on those materials. A modest positive effect was detected when comparing outcomes from this intervention to those of business-as-usual materials and professional development. However, this effect was typical for interventions at this grade span that are tested using a state achievement test. Tests of mediation suggest a large treatment effect on teachers and in turn a strong effect of teacher practice on student achievement--reinforcing the hypothesized key role of teacher practice. Tests of moderation indicate no significant treatment by demographic interactions.

Prior research on mentoring relationships outside of school does point toward relationship closeness and related indicators of the emotional quality of the mentor-protégé tie as important influences on youth outcomes. There is preliminary evidence that this may also be the case for School Based Mentoring (SBM), or at least that closeness promotes protégé and mentor perceptions of relationship quality. The overarching aim of this paper is to enrich the field's understanding of how volunteer mentors can best support the academic mission of schools. The central empirical analysis investigates whether emotionally closer relationships between mentors and protégés lead to better academic outcomes. The sample for the study consists of the students who participated in the randomized control trial of the Big Brothers Big Sisters of America (BBBSA) SBM program during the 2004-2005 school year. Study participants were recruited by 10 BBBSA study agencies across the country, each with four or more years of experience in SBM. Evidence is found that a close mentoring relationship positively affects academic performance. Effect sizes, obtained by dividing the impact coefficients reported in the table by the standard deviation of the appropriate outcome measure, range from 0.13 standard deviations (for overall academic performance and scholastic efficacy) to 0.18 standard deviations (for completeness of schoolwork), and are consistent across alternative specifications. A table is appended.

A multisite cluster randomized trial was conducted to examine the effects of the Social Skills Improvement System Classwide Intervention Program (SSIS-CIP; Elliott & Gresham, 2007) on students' classroom social behavior. The final sample included 432 students across 38 second grade classrooms. Social skills and problem behaviors were measured via the SSIS rating scale for all participants, and direct observations were completed for a subsample of participants within each classroom. Results indicated that the SSIS-CIP demonstrated positive effects on teacher ratings of participants' social skills and internalizing behaviors, with the greatest changes occurring in classrooms with students who exhibited lower skill proficiency prior to implementation. Statistically significant differences were not observed between treatment and control participants on teacher ratings of externalizing problem behaviors or direct observation.

This study reports on an evaluation of the "Reading Partners" program, which uses community volunteers to provide one-on-one tutoring to struggling readers in underresourced elementary schools. Established in 1999 in East Menlo Park, California, the mission of "Reading Partners" is to help children become lifelong readers by empowering communities to provide individualized instruction with measurable results. This report builds on those initial findings by describing the "Reading Partners" program and its implementation in greater detail, exploring whether the program is more or less effective for particular subgroups of students, and assessing some of the potential explanations for the program's success to date. In addition, this report includes an analysis of the cost of implementing the Reading Partners program in 6 of the 19 sites. The following are appended: (1) Implementation Study Methods; (2) Impact Study Methods and Teacher Survey; (3) Tutor Background Characteristics and Additional Impact Findings; (4) Cost Study Methods; and (5) Additional Cost Findings. [This report was written with A. Brooks Bowden and Yilin Pan.]

Success for All (SFA), one of the best-known school reform models, aims to improve the reading skills of all children but is especially directed at schools that serve large numbers of students from low-income families. First implemented in 1987, SFA combines a challenging reading program, whole-school reform elements, and an emphasis on continuous improvement, with the goal of ensuring that every child learns to read well in the elementary grades. This is the third and final report from an independent evaluation of the scale-up demonstration of the SFA elementary school reading program. Both the demonstration and the evaluation have been funded under the U.S. Department of Education's Investing in Innovation (i3) competition. Conducted by MDRC--a nonprofit, nonpartisan education and social policy research organization--the evaluation examines SFA's implementation and impacts in five school districts over a three-year period (the 2011-2012 school year through the 2013-2014 school year). It also includes an analysis of program costs. Finally, it considers the scale-up process itself--the methods employed and the extent to which the Success for All Foundation (SFAF), the organization that developed and provides technical assistance to schools operating the program, achieved its scale-up goals. [This report was written with Emma Alterman, Herbert Collado, and Emily Pramik. For the executive summary of this report, see ED579090. For the Early Findings report, see ED545452. For the Interim Report, see ED546642.]

KIPP (Knowledge is Power Program) is a national network of public charter schools whose stated mission is to help underserved students enroll in and graduate from college. Prior studies (see Tuttle et al. 2013) have consistently found that attending a KIPP middle school positively affects student achievement, but few have addressed longer-term outcomes and no rigorous research exists on impacts of KIPP schools at levels other than middle school. In this first high-quality study to rigorously examine the impacts of the network of KIPP public charter schools at all elementary and secondary grade levels, Mathematica found that KIPP schools have positive impacts on student achievement, particularly at the elementary and middle school levels. In addition, the study found positive impacts on student achievement for new entrants to the KIPP network in high school. For students continuing from a KIPP middle school, KIPP high schools' impacts on student achievement are not statistically significant, on average (in comparison to students who did not have the option to attend a KIPP high school and instead attended a mix of other non-KIPP charter, private, and traditional public high schools). Among these continuing students, KIPP high schools have positive impacts on several aspects of college preparation, including more discussions about college, increased likelihood of applying to college, and more advanced coursetaking. This report provides detailed findings and also includes the following appendices: (1) List of KIPP Schools In Network; (2) Detail on Survey Outcomes; (3) Cumulative Middle and High School Results; (4) Detailed Analytic Methods: Elementary School (Lottery-Based Analyses); (5) Detailed Analytic Methods: Middle School (Lottery-Based Analyses); (6) Understanding the Effects of KIPP As It Scales Mathematica Policy Research; (7) Detailed Analytic Methods: Middle School (Matched-Student Analyses); (8) Detailed Analytic Methods: High School (Matched-Student Analyses); (9) Detailed Analytic Methods: High School (Matched-School Analyses); and (10) Detailed Tables For What Works Clearinghouse Review. [For the executive summary, see ED560080; for the focus brief, see ED560043.]

A large-scale randomized controlled trial tested the effects of researcher-developed learning games on a transfer measure of fractions knowledge. The measure contained items similar to standardized assessments. Thirty treatment and 29 control classrooms (~1500 students, 9 districts, 26 schools) participated in the study. Students in treatment classrooms played fractions games and students in the control classrooms played solving equations games. Multilevel multidimensional item response theory modeling of the outcome measure produced scaled scores that were more sensitive to the instructional treatment than standard measurement approaches. Hierarchical linear modeling of the scaled scores showed that the treatment condition performed significantly higher on the outcome measure than the control condition. The effect (d = 0.58) was medium to large (Cohen, 1992). Two appendices are included: (1) Descriptive Statistics of Pretest and Posttest Scores by Schools and Conditions; and (2) Summary of Efficacy Trial Procedures.

One of the most important questions in education research is whether the gains from interventions for which perceived short-term success can be sustained. The possibility of short-lived impacts is especially relevant for research on charter schools, where charter operators who face high-stakes assessments have an incentive to "teach to the test." The fact that charters are subject to intense scrutiny and evaluation may even create incentives for cheating (Jacob and Levitt, 2003), strategic instruction (Jacob, 2007), and a focus on small groups of students that are pivotal for official accountability measures (Neal and Schanzenbach, 2010). The purpose of this paper is to assess the impact of attendance at Boston's charter high schools on outcomes where the link with human capital and future earnings seems likely to be sustained and strong. Specifically, the authors focus on outcomes that are either essential to or facilitate post-secondary schooling: high school graduation, the attainment of state competency thresholds, scholarship qualification, Advanced Placement (AP) and SAT scores, college enrollment, and college persistence. Importantly, most of these outcomes are less subject to strategic manipulation than are the state's test-based assessments. As in earlier work, the research design implemented here exploits randomized enrollment lotteries at oversubscribed charter schools. The resulting estimates are likely to provide reliable measures of average causal effects for charter applicants. Six tables are appended.

We describe the development and initial evaluation of the efficacy of "We Have Skills!" (WHS), a video-based social skills instructional program for early elementary school students. The components of WHS were designed to be scientifically sound, maximally useful to elementary school teachers, and effective in increasing students' social skills. Results from feasibility and social validity testing showed that teachers felt the program was easy to implement and highly recommended its use. The initial efficacy evaluation of WHS conducted with 70 classrooms randomly assigned to intervention and control conditions showed that teachers in the intervention group scored significantly higher on self-efficacy than teachers in the control group. Students in the intervention classrooms were rated significantly higher on key social skills by their teachers at posttest compared to students in the control group. Implications for further testing of WHS are discussed, along with study limitations and recommendations for future research and practice.

Despite decades of policy intervention to increase college entry and success among low-income students, considerable gaps by socioeconomic status remain. To date, policymakers have overlooked the summer after high school as an important time period in students' transition to college, yet recent research documents high rates of summer attrition from the college pipeline among college-intending high school graduates, a phenomenon we refer to as "summer melt." We report on two randomized trials investigating efforts to mitigate summer melt. Offering college-intending graduates two to three hours of summer support increased enrollment by 3 percentage points overall, and by 8 to 12 percentage points among low-income students, at a cost of $100 to $200 per student. Further, summer support has lasting impacts on persistence several semesters into college.

Online instruction is quickly gaining in importance in U.S. higher education, but little rigorous evidence exists as to its effect on student learning. We measure the effect on learning outcomes of a prototypical interactive learning online statistics course by randomly assigning students on six public university campuses to take the course in a hybrid format (with machine-guided instruction accompanied by one hour of face-to-face instruction each week) or a traditional format (as it is usually offered by their campus, typically with about three hours of face-to-face instruction each week). We find that learning outcomes are essentially the same--that students in the hybrid format are not harmed by this mode of instruction in terms of pass rates, final exam scores, and performance on a standardized assessment of statistical literacy. We also conduct speculative cost simulations and find that adopting hybrid models of instruction in large introductory courses has the potential to significantly reduce instructor compensation costs in the long run.

Online instruction is quickly gaining in importance in U.S. higher education, but little rigorous evidence exists as to its effect on student learning. We measure the effect on learning outcomes of a prototypical interactive learning online statistics course by randomly assigning students on six public university campuses to take the course in a hybrid format (with machine-guided instruction accompanied by one hour of face-to-face instruction each week) or a traditional format (as it is usually offered by their campus, typically with about three hours of face-to-face instruction each week). We find that learning outcomes are essentially the same—that students in the hybrid format are not harmed by this mode of instruction in terms of pass rates, final exam scores, and performance on a standardized assessment of statistical literacy. We also conduct speculative cost simulations and find that adopting hybrid models of instruction in large introductory courses has the potential to significantly reduce instructor compensation costs in the long run. C 2013 by the Association for Public Policy Analysis and Management.

College graduation rates often lag behind college attendance rates. One theory as to why students do not complete college is that they lack key information about how to be successful or fail to act on the information that they have. We present evidence from a randomized experiment which tests the effectiveness of individualized student coaching. Over the course of two separate school years, InsideTrack, a student coaching service, provided coaching to students attending public, private, and proprietary universities. Most of the participating students were nontraditional college students enrolled in degree programs. The participating universities and InsideTrack randomly assigned students to be coached. The coach contacted students regularly to develop a clear vision of their goals, to guide them in connecting their daily activities to their long-term goals, and to support them in building skills, including time management, self-advocacy, and study skills. Students who were randomly assigned to a coach were more likely to persist during the treatment period and were more likely to be attending the university 1 year after the coaching had ended. Coaching also proved a more cost-effective method of achieving retention and completion gains when compared with previously studied interventions such as increased financial aid.

Despite decades of policy intervention to increase college entry and success among low-income students, considerable gaps by socioeconomic status remain. To date, policymakers have overlooked the summer after high school as an important time period in students' transition to college, yet recent research documents high rates of summer attrition from the college pipeline among college-intending high school graduates, a phenomenon we refer to as "summer melt." We report on two randomized trials investigating efforts to mitigate summer melt. Offering college-intending graduates two to three hours of summer support increased enrollment by 3 percentage points overall, and by 8 to 12 percentage points among low-income students, at a cost of $100 to $200 per student. Further, summer support has lasting impacts on persistence several semesters into college.

While postsecondary completion rates are a concern among many student populations across the country, college graduation rates for Latino students, especially Latino male students, are even lower than the national average. Low-income Latino men face many barriers to postsecondary success, including both financial and personal obstacles. This report presents findings from a study of performance-based scholarships paired with a robust set of student services designed to help low-income Latino men succeed at Pima Community College in Tucson, Arizona. Students who were eligible for the Adelante Performance Award Program could receive up to $4,500 in total over three semesters. Payments were contingent on their meeting academic benchmarks throughout the semester and participating in student support services such as advising, tutoring, and workshops. The program in Arizona is one of six being studied as part of the Performance-Based Scholarship Demonstration. Each program employs a random assignment research design to test an alternative incentive structure and is intended to serve a different target population. The program at Pima was designed with three main goals in mind: first, to help make college more affordable to low-income students; second, to structure scholarship payments to provide an incentive for good academic progress; and third, to encourage and directly reward participation in student services. The program was funded by a consortium of private foundations and operated from the fall of 2010 through the fall of 2012. This report provides analysis over two semesters of follow-up and suggests that: (1) Program group students participated at high rates in the support services offered; (2) The program led to a net increase in financial aid and allowed some students to reduce their dependence on loans; (3) The program had a small but positive effect on retention; (4) The program increased full-time enrollment in students' second semester; and (5) The program increased the number of credits earned. Some of the main goals of the program and its design have been achieved, at least in the short term. Appended are: (1) Selected Characteristics of Sample Members at Baseline, by Research Group; and (2) Adelante Program Materials. [This report was written with Drew McDermott.]

This policy brief presents results from a random assignment evaluation of the City University of New York's Accelerated Study in Associate Programs (ASAP). An ambitious and promising endeavor, ASAP provides a comprehensive array of services and supports to help community college students graduate and to help them graduate sooner. The evaluation targeted low-income students who needed one or two developmental (remedial) courses. ASAP requires students to enroll full time and provides block-scheduled classes, comprehensive advisement, tutoring, career services, a tuition waiver, free monthly MetroCards for use on public transportation, and free use of textbooks for up to three years. After two years, compared with regular college services, ASAP increased the number of credits students earned as well as their persistence in college. Most notably, the program boosted two-year graduation rates substantially--by 66 percent. A future report will present the program's effects after three years.

This report presents results from the "Ready To Learn" Prekindergarten Transmedia Mathematics Study, a principal part of the summative evaluation of "Ready To Learn," which is a partnership between the US Department of Education, the Corporation for Public Broadcasting, and PBS. Researchers found that preschool children who experienced a PBS KIDS Transmedia Math Supplement developed essential early mathematics skills. The PBS KIDS Transmedia Math Supplement was centered around public media videos and digital games, played on a selected set of learning technologies (interactive whiteboards and laptop computers). The important skills measure--counting; subitizing; recognizing numerals; recognizing, composing, and representing shapes; and patterning--increased significantly for the study's four- and five-year-old children, who were from traditionally economically disadvantaged communities where children are often less prepared for kindergarten than are their more socially and economically advantaged peers. Also important, preschool teachers who enacted the PBS KIDS Transmedia Math Supplement reported significant changes in their confidence and comfort with early mathematics concepts and teaching with technology. [This report was co-produced by SRI's Center for Technology in Learning (CTL).]

The purpose of this study was to investigate the effects of 1st-grade number knowledge tutoring with contrasting forms of practice. Tutoring occurred 3 times per week for 16 weeks. In each 30-min session, the major emphasis (25 min) was number knowledge; the other 5 min provided practice in 1 of 2 forms. Nonspeeded practice reinforced relations and principles addressed in number knowledge tutoring. Speeded practice promoted quick responding and use of efficient counting procedures to generate many correct responses. At-risk students were randomly assigned to number knowledge tutoring with speeded practice (n = 195), number knowledge tutoring with nonspeeded practice (n = 190), and control (no tutoring, n = 206). Each tutoring condition produced stronger learning than control on all 4 mathematics outcomes. Speeded practice produced stronger learning than nonspeeded practice on arithmetic and 2-digit calculations, but effects were comparable on number knowledge and word problems. Effects of both practice conditions on arithmetic were partially mediated by increased reliance on retrieval, but only speeded practice helped at-risk children compensate for weak reasoning ability. (Contains 7 tables, 2 figures and 6 footnotes.)

The purpose of this study was to investigate the effects of 1st-grade number knowledge tutoring with contrasting forms of practice. Tutoring occurred 3 times per week for 16 weeks. In each 30-min session, the major emphasis (25 min) was number knowledge; the other 5 min provided practice in 1 of 2 forms. Nonspeeded practice reinforced relations and principles addressed in number knowledge tutoring. Speeded practice promoted quick responding and use of efficient counting procedures to generate many correct responses. At-risk students were randomly assigned to number knowledge tutoring with speeded practice (n = 195), number knowledge tutoring with nonspeeded practice (n = 190), and control (no tutoring, n = 206). Each tutoring condition produced stronger learning than control on all 4 mathematics outcomes. Speeded practice produced stronger learning than nonspeeded practice on arithmetic and 2-digit calculations, but effects were comparable on number knowledge and word problems. Effects of both practice conditions on arithmetic were partially mediated by increased reliance on retrieval, but only speeded practice helped at-risk children compensate for weak reasoning ability. (Contains 7 tables, 2 figures and 6 footnotes.)

The purpose of this study was to investigate the effects of 1st-grade number knowledge tutoring with contrasting forms of practice. Tutoring occurred 3 times per week for 16 weeks. In each 30-min session, the major emphasis (25 min) was number knowledge; the other 5 min provided practice in 1 of 2 forms. Nonspeeded practice reinforced relations and principles addressed in number knowledge tutoring. Speeded practice promoted quick responding and use of efficient counting procedures to generate many correct responses. At-risk students were randomly assigned to number knowledge tutoring with speeded practice (n = 195), number knowledge tutoring with nonspeeded practice (n = 190), and control (no tutoring, n = 206). Each tutoring condition produced stronger learning than control on all 4 mathematics outcomes. Speeded practice produced stronger learning than nonspeeded practice on arithmetic and 2-digit calculations, but effects were comparable on number knowledge and word problems. Effects of both practice conditions on arithmetic were partially mediated by increased reliance on retrieval, but only speeded practice helped at-risk children compensate for weak reasoning ability. (Contains 7 tables, 2 figures and 6 footnotes.)

Reading Recovery (RR) is a short-term early intervention designed to help the lowest-achieving readers in first grade reach average levels of classroom performance in literacy. Students identified to receive Reading Recovery meet individually with a specially trained Reading Recovery (RR) teacher every school day for 30-minute lessons over a period of 12 to 20 weeks. The purpose of these lessons is to support rapid acceleration of each child's literacy learning. In 2010, The Ohio State University received a Scaling Up What Works grant from the U.S. Department of Education's Investing in Innovation (i3) Fund to expand the use of Reading Recovery across the country. The award was intended to fund the scale-up of Reading Recovery by training 3,675 new RR Teachers in U.S. schools, thereby expanding capacity to allow service to an additional 88,200 students. The Consortium for Policy Research in Education (CPRE) was contracted to conduct an independent evaluation of the i3 scale up of Reading Recovery over the course of five years. The evaluation includes parallel rigorous experimental and quasi-experimental designs for estimating program impacts, coupled with a large-scale mixed-methods study of program implementation under the i3 scale-up. This report presents findings through the second year of the evaluation. The primary goals of this evaluation were: (1) to assess the success of the scale-up in meeting the i3 grant's expansion goals; (2) to document the implementation of scale-up and fidelity to program standards; and (3) to provide experimental evidence of the impacts of Reading Recovery on student learning under this scale-up effort. This document is the first in a series of three annual reports produced based on our external evaluation of the Reading Recovery i3 Scale-Up. This report presents early results from the experimental impact and implementation studies conducted over the 2010-11 and 2011-12 school years. An appendix includes: Statistical Model for Impacts of Reading Scores. [For "WWC Review of the Report 'Evaluation of the i3 Scale-up of Reading Recovery Year One Report, 2011-12.' What Works Clearinghouse Single Study Review," see ED547670.]

The purposes of this study were to investigate the effects of an intervention designed to improve at-risk 4th graders' understanding of fractions and to examine the processes by which effects occurred. The intervention focused more on the measurement interpretation of fractions; the control condition focused more on the part-whole interpretation of fractions and on procedures. Intervention was also designed to compensate for at-risk students' limitations in the domain-general abilities associated with fraction learning. At-risk students (n = 259) were randomly assigned to intervention and control. Whole-number calculation skill, domain-general abilities (working memory, attentive behavior, processing speed, listening comprehension), and fraction proficiency were pretested. Intervention occurred for 12 weeks, 3 times per week, 30 min per session, and then fraction performance was reassessed. On each conceptual and procedural fraction outcome, effects favored intervention over control (effect sizes = 0.29 to 2.50), and the gap between at-risk and low-risk students narrowed for the intervention group but not the control group. Improvement in the accuracy of children's measurement interpretation of fractions mediated intervention effects. Also, intervention effects were moderated by domain-general abilities, but not whole-number calculation skill.

One way to improve struggling schools' access to effective teachers is to use selective transfer incentives. Such incentives offer bonuses for the highest-performing teachers to move into schools serving the most disadvantaged students. In this report, we provide evidence from a randomized experiment that tested whether such a policy intervention can improve student test scores and other outcomes in low-achieving schools. The intervention, known to participants as the Talent Transfer Initiative (TTI), was implemented in 10 school districts in seven states. The highest-performing teachers in each district--those who ranked in roughly the top 20 percent within their subject and grade span in terms of raising student achievement year after year (an approach known as value added)--were identified. These teachers were offered $20,000, paid in installments over a two-year period, if they transferred into and remained in designated schools that had low average test scores. The main findings from the study include: (1) The transfer incentive successfully attracted high value-added teachers to fill targeted vacancies; (2) The transfer incentive had a positive impact on test scores (math and reading) in targeted elementary classrooms; and (3) The transfer incentive had a positive impact on teacher-retention rates during the payout period; retention of the high-performing teachers who transferred was similar to their counterparts in the fall immediately after the last payout. Seven appendixes are included: (1) Supplemental Materials for Chapters I and II; (2) Value-Added Analysis to Identify Highest-Performing Teachers; (3) Supplemental Materials for Chapter III; (4) Identification of Focal Teachers; (5) Supplemental Materials for Chapter IV; (6) Supplemental Materials for Chapter V; and (7) Supplemental Materials for Chapter VI. (Contains 114 footnotes, 61 figures, and 92 tables.) [For the executive summary, see ED544268.]

In 2002, the Bill & Melinda Gates Foundation launched the Early College High School Initiative (ECHSI) with the primary goal of increasing the opportunity for underserved students to earn a postsecondary credential. To achieve this goal, Early Colleges provide underserved students with exposure to, and support in, college while they are in high school. Early Colleges partner with colleges and universities to offer all students an opportunity to earn an associate's degree or up to two years of college credits toward a bachelor's degree during high school at no or low cost to the students. The underlying assumption is that engaging underrepresented students in a rigorous high school curriculum tied to the incentive of earning college credit will motivate them and increase their access to additional postsecondary education and credentials after high school. Since 2002, more than 240 Early Colleges have opened nationwide. This study focused on the impact of Early Colleges. It addressed two questions: (1) Do Early College students have better outcomes than they would have had at other high schools?; and (2) Does the impact of Early Colleges vary by student background characteristics (e.g., gender and family income)? To answer these questions, the authors conducted a lottery-based randomized experiment, taking advantage of the fact that some Early Colleges used lotteries in their admissions processes. By comparing the outcomes for students who participated in admissions lotteries and were offered enrollment with the outcomes for students who participated in the lotteries but were not offered enrollment, they can draw causal conclusions about the impact of Early Colleges. The primary student outcomes for this study were high school graduation, college enrollment, and college degree attainment. The authors also examined students' high school and college experiences. Data on student background characteristics and high school outcomes came from administrative records from schools, districts, and states; data on college outcomes came from the National Student Clearinghouse (NSC); and data on high school and college experiences and intermediate outcomes such as college credit accrual came from a student survey. The authors assessed the impact of Early Colleges on these outcomes for a sample of 10 Early Colleges that did the following: (1) Enrolled students in grades 9-12 and had high school graduates in the study years (2005-2011); (2) Used lotteries as part of the admission processes in at least one of the study cohorts (students who entered ninth grade in 2005-06, 2006-07, or 2007-08); and (3) Retained the lottery records. Eight of the 10 Early Colleges in the study were included in the student survey. The overall study sample included 2,458 students and the survey sample included 1,294 students. The study extended through three years past high school.

In 2002, New York City embarked on an ambitious and wide-ranging series of education reforms. At the heart of its high school reforms were three interrelated changes: the institution of a district wide high school choice process for all rising ninth-graders, the closure of 31 large, failing high schools with an average graduation rate of 40 percent, and the opening of more than 200 new small high schools. Over half of the new small schools created between the fall of 2002 and the fall of 2008 were intended to serve students in some of the district's most disadvantaged communities and are located mainly in neighborhoods where large, failing high schools had been closed. MDRC has previously released two reports on these "small schools of choice," or SSCs (so called because they are small, are academically nonselective, and were created to provide a realistic choice for students with widely varying academic backgrounds). Those reports found marked increases in progress toward graduation and in graduation rates for the cohorts of students who entered SSCs in the falls of 2005 and 2006. The second report also found that the increase in graduation rates applied to every student subgroup examined, and that SSC graduation effects were sustained even after five years from the time sample members entered high school. This report updates those previous findings with results from a third cohort of students, those who entered ninth grade in the fall of 2007. In addition, for the first time it includes a look inside these schools through the eyes of principals and teachers, as reported in interviews and focus groups held at the 25 SSCs with the strongest evidence of effectiveness. In brief, the report's findings are: (1) SSCs in New York City continue to markedly increase high school graduation rates for large numbers of disadvantaged students of color, even as graduation rates are rising at the schools with which SSCs are compared; (2) The best evidence that exists indicates that SSCs may increase graduation rates for two new subgroups for which findings were not previously available: special education students and English language learners. However, given the still-limited sample sizes for these subgroups, the evidence will not be definitive until more student cohorts can be added to the analysis; and (3) Principals and teachers at the 25 SSCs with the strongest evidence of effectiveness strongly believe that academic rigor and personal relationships with students contribute to the effectiveness of their schools. They also believe that these attributes derive from their schools' small organizational structures and from their committed, knowledgeable, hardworking, and adaptable teachers. Appended are: (1) Sample, Data, and Analysis; (2) Estimated Effects of Winning a Student's First SSC Lottery; (3) 2008 Requirements for Proposals to Create New SSCs Specified by the New York City Department of Education; and (4) Documentation for Interviews and Focus Groups.

The Knowledge Is Power Program (KIPP) is a rapidly expanding network of public charter schools whose mission is to improve the education of low-income children. As of the 2012-2013 school year, 125 KIPP schools are in operation in 20 different states and the District of Columbia (DC). Ultimately, KIPP's goal is to prepare students to enroll and succeed in college. Prior research has suggested that KIPP schools have positive impacts on student achievement, but most of the studies have included only a few KIPP schools or have had methodological limitations. This is the second report of a national evaluation of KIPP middle schools being conducted by Mathematica Policy Research. The evaluation uses experimental and quasi-experimental methods to produce rigorous and comprehensive evidence on the effects of KIPP middle schools across the country. The study's first report, released in 2010, described strong positive achievement impacts in math and reading for the 22 KIPP middle schools for which data were available at the time. For this phase of the study, the authors nearly doubled the size of the sample, to 43 KIPP middle schools, including all KIPP middle schools that were open at the start of the study in 2010 for which they were able to acquire relevant data from local districts or states. The average impact of KIPP on student achievement is positive, statistically significant, and educationally substantial. KIPP impact estimates are consistently positive across the four academic subjects examined, in each of the first four years after enrollment in a KIPP school, and for all measurable student subgroups. A large majority of the individual KIPP schools in the study show positive impacts on student achievement as measured by scores on state-mandated assessments. KIPP produces similar positive impacts on the norm-referenced test, which includes items assessing higher-order thinking. Estimated impacts on measures of student attitudes and behavior are less frequently positive, but the authors found evidence that KIPP leads students to spend significantly more time on homework, and that KIPP increases levels of student and parent satisfaction with school. On the negative side, the findings suggest that enrollment in a KIPP school leads to an increase in the likelihood that students report engaging in undesirable behavior such as lying to or arguing with parents. These findings are described in this report. The following appendixes are included: (1) Sample selection and baseline characteristics; (2) Constructing survey outcomes; (3) Schools attended by lottery winners and lottery non-winners; (4) Analytic methods for the matched comparison group analysis; (5) Analytic methods for lottery-based analysis; and (6) Validation of matching methods using lottery-based impact estimates. (Contains 46 tables, 78 footnotes, and 16 figures.) [For "What Works Clearinghouse Quick Review: 'KIPP Middle Schools: Impacts on Achievement and Other Outcomes, Final Report,'" see ED540896.]

One crucial decision that middle schoolers (and their families) make is where they will attend high school. Many districts employ school choice systems designed to allow students to pick a high school that will meet their needs and interests. Yet most students prefer high schools that are close to home, and for youth in low-income neighborhoods, this often means attending a more disadvantaged, lower performing school (Nathanson et al. 2013). Youth who defy these odds and choose a competitive high school instead have much to gain. Cullen et al. (2005), for instance, found that Chicago public middle school students who chose to attend a higher-achieving high school were substantially more likely to graduate. However, even as eighth graders, these students already differed in many ways from their peers who chose a neighborhood school--they had better self-reported grades and higher expectations for the future, felt more prepared for high school, and were more likely to have spoken with their parents about what school to attend. These findings raise the question of how we can prepare more disadvantaged students to take the many steps necessary-throughout the middle school years-to successfully transition to a competitive, high-quality high school that can ultimately launch them toward college and careers. The Washington, DC-based Higher Achievement program is taking on this challenge. Higher Achievement targets rising fifth and sixth graders from "at-risk communities" and serves them throughout the middle school years. Its goal is to strengthen participants' academic skills, attitudes and behaviors, reinforce high aspirations and help students and their families navigate the process of applying to and selecting a high-quality high school. In 2006, the authors began a comprehensive multi-year evaluation of Higher Achievement to test its impact on participants' academic performance, attitudes and behaviors and on their high school enrollment. The evaluation used random assignment-the most rigorous design available to researchers-to assess program impacts. This brief summarizes the study's findings. Findings suggest that the program does appear to expand the options available to its students by making them more likely to apply to and attend private schools and less likely to apply to and attend weaker public magnet and charter schools. This, in turn, may position youth for better outcomes in high school and beyond. [This research was made possible by grants from The Atlantic Philanthropies, Bank of America, the Smith Richardson Foundation, the Spencer Foundation, The Wallace Foundation and the William T. Grant Foundation.]

Teach For America (TFA) and the Teaching Fellows programs are an important and growing source of teachers of hard-to-staff subjects in high-poverty schools, but comprehensive evidence of their effectiveness has been limited. This report presents findings from the first large-scale random assignment study of secondary math teachers from these programs. The study separately examined the effectiveness of TFA and Teaching Fellows teachers, comparing secondary math teachers from each program with other secondary math teachers teaching the same math courses in the same schools. The study focused on secondary math because this is a subject in which schools face particular staffing difficulties.The study had two main findings, one for each program studied: (1) TFA teachers were more effective than the teachers with whom they were compared. On average, students assigned to TFA teachers scored 0.07 standard deviations higher on end-of-year math assessments than students assigned to comparison teachers, a statistically significant difference. This impact is equivalent to an additional 2.6 months of school for the average student nationwide; and (2) Teaching Fellows were neither more nor less effective than the teachers with whom they were compared. On average, students of Teaching Fellows and students of comparison teachers had similar scores on end-of-year math assessments. By providing rigorous evidence on the effectiveness of secondary math teachers from TFA and the Teaching Fellows programs, the study can shed light on potential approaches for improving teacher effectiveness in hard-to-staff schools and subjects. The study findings can provide guidance to school principals faced with the choice of hiring teachers who have entered the profession via different routes to certification. The findings can also aid policymakers and funders of teacher preparation programs by providing information on the effectiveness of teachers from various routes to certification that use different methods to identify, attract, train, and support their teachers. Seven appendixes present: (1) Supplementary Technical Information on Study Design and Data Collection; (2) Supplementary Information on Analytic Methods; (3) Supplementary Information on Teach For America and Teaching Fellows Programs; (4) Teach For America and Teaching Fellows Teachers Compared with Comparison Teachers by Entry Route (Alternative or Traditional); (5) Supplementary Information on Teach For America and Teaching Fellows Teachers Compared with Comparison Teachers; (6) Supplementary Analyses of the Impacts of Teach For America and Teaching Fellows Teachers; and (7) Supplementary Findings on Factors Associated with Teacher Effectiveness. (Contains 96 tables, 21 figures, and 30 footnotes.)

In 2002, the Bill & Melinda Gates Foundation launched the Early College High School Initiative (ECHSI) with the primary goal of increasing the opportunity for underserved students to earn a postsecondary credential. To achieve this goal, Early Colleges provide underserved students with exposure to, and support in, college while they are in high school. Early Colleges partner with colleges and universities to offer all students an opportunity to earn an associate's degree or up to two years of college credits toward a bachelor's degree during high school at no or low cost to the students. The underlying assumption is that engaging underrepresented students in a rigorous high school curriculum tied to the incentive of earning college credit will motivate them and increase their access to additional postsecondary education and credentials after high school. Since 2002, more than 240 Early Colleges have opened nationwide. This study focused on the impact of Early Colleges. It addressed two questions: (1) Do Early College students have better outcomes than they would have had at other high schools?; and (2) Does the impact of Early Colleges vary by student background characteristics (e.g., gender and family income)? To answer these questions, the authors conducted a lottery-based randomized experiment, taking advantage of the fact that some Early Colleges used lotteries in their admissions processes. By comparing the outcomes for students who participated in admissions lotteries and were offered enrollment with the outcomes for students who participated in the lotteries but were not offered enrollment, they can draw causal conclusions about the impact of Early Colleges. The primary student outcomes for this study were high school graduation, college enrollment, and college degree attainment. The authors also examined students' high school and college experiences. Data on student background characteristics and high school outcomes came from administrative records from schools, districts, and states; data on college outcomes came from the National Student Clearinghouse (NSC); and data on high school and college experiences and intermediate outcomes such as college credit accrual came from a student survey. The authors assessed the impact of Early Colleges on these outcomes for a sample of 10 Early Colleges that did the following: (1) Enrolled students in grades 9-12 and had high school graduates in the study years (2005-2011); (2) Used lotteries as part of the admission processes in at least one of the study cohorts (students who entered ninth grade in 2005-06, 2006-07, or 2007-08); and (3) Retained the lottery records. Eight of the 10 Early Colleges in the study were included in the student survey. The overall study sample included 2,458 students and the survey sample included 1,294 students. The study extended through three years past high school.

Early college high schools are a new and rapidly spreading model that merges the high school and college experiences and that is designed to increase the number of students who graduate from high school and enroll and succeed in postsecondary education. This article presents results from a federally funded experimental study of the impact of the early college model on Grade 9 outcomes. Results show that, as compared to control group students, a statistically significant and substantively higher proportion of treatment group students are taking core college preparatory courses and succeeding in them. Students in the treatment group also have statistically significantly higher attendance and lower suspension rates than students in the control group. (Contains 10 footnotes, 5 tables and 1 figure.)

The Louisiana Striving Readers evaluation assessed the implementation and effectiveness of the Voyager "Passport Reading Journeys" (PRJ), a widely used supplemental literacy intervention for struggling adolescent readers that reflects the research-based practices recommended by the National Reading Panel (2000) and other more recent syntheses (Biancarosa & Snow, 2004; Edmonds, et al., 2009; Kamil, et al., 2008; Scammacca et al., 2007; Torgesen et al., 2007). To date, PRJ has been adopted in 45 states across the country in almost 470 districts and over 2,200 schools, and has served over 268,000 students. PRJ offers four levels of instruction appropriate for middle and high school students. The PRJ curriculum uses direct, explicit instruction in reading comprehension, vocabulary, and word study for adolescents who struggle with reading using age-appropriate fiction and non-fiction texts. The Louisiana Striving Readers Program, funded by the Louisiana Department of Education (LDOE) through a grant from the U.S. Department of Education, targeted over 1,200 struggling readers in grades 6-7 from ten middle schools across the state of Louisiana. The grant required a rigorous, independent experimental evaluation, conducted by SEDL, addressing fidelity of program implementation and program impacts on student motivation and reading achievement. The study reported here had two specific aims: (1) determine the fidelity of implementation, or the extent to which the program was delivered as the grant indicated it should be implemented; and (2) determine the impacts of PRJ on student reading and other related outcomes (i.e., student motivation and engagement in reading) and how the effects may have varied by student subgroups. This report details the intervention, the implementation study design and results, and the impact study design and results.

American Institutes for Research (AIR) conducted an evaluation of the effect on struggling readers of implementing the READ 180 reading intervention in five participating schools in Milwaukee Public Schools (MPS) under a Striving Readers grant from the U.S. Department of Education. The evaluation used an experimental design in order to produce a rigorous estimate of the impact of the READ 180 intervention on measures of reading achievement for struggling students. The evaluation also explored implementation fidelity and the contexts and conditions of implementation that may extend or limit the intervention's effects. To measure program impact on students' academic performance in reading, AIR analyzed student achievement data collected from the Northwest Evaluation Association (NWEA) Measures of Academic Progress (MAP) benchmark assessment. AIR also administered a student survey to assess the impact on student engagement and self-efficacy for reading. This report asked the following research questions: (1) Does the READ 180 reading intervention improve students' academic performance in reading?; (2) With what fidelity did the program implement the professional development model and what factors mediated the level of implementation?; and (3) With what fidelity did classroom intervention teachers implement READ 180 and what factors mediated the level of implementation?

This study estimates the effect of one year of Fusion Reading implementation, a multistrategy intervention, builds on the work of the Strategic Instruction Model's Learning Strategies Curriculum and Xtreme Reading by integrating some of the same strategies (e.g., paraphrasing, visual imagery, and self-questioning for information acquisition; mnemonics for information study; and writing and error monitoring for information expression), focusing on reading, and extending the time frame from 1 to 2 years in duration. Specifically, the study addressed the following: (1) What are the intent-to-treat impacts of the Fusion Reading intervention on the reading outcomes and motivation to read of struggling readers after receipt of 1 year of the intervention?; (2) For which students are the interventions most and least effective?; and (3) In what ways are implementation factors associated with impacts (or lack of impacts) on reading and motivation outcomes? The authors conducted a randomized controlled trial to estimate the effect of Fusion Reading on struggling readers in grades 6 through 10. Students in the intervention condition received the Fusion Reading intervention as a supplemental reading intervention in the 2010-11 school year, whereas students in the control condition engaged in nonliteracy, "business-as-usual" activities. After one year of implementation of a two year intervention, the authors learned that when vocabulary, paraphrasing and word study strategies are explicitly taught by following a specific instructional routine supported by motivation strategies (e.g., setting goals and reading text relevant for the age group), word reading outcomes will significantly improve compared to control middle and high school students. Future research is needed to fully understand whether the intended two year intervention will improve struggling adolescent's reading comprehension outcomes. Appended are: (1) References; and (2) Tables and Figures. (Contains 2 figures and 5 tables.)

High school students from disadvantaged high schools in Toronto were invited to take two surveys, about three weeks apart. Half of the students taking the first survey were also shown a 3 minute video about the benefits of post secondary education (PSE) and invited to try out a financial-aid calculator. Most students' perceived returns to PSE were high, even among those not expecting to continue. Those exposed to the video, especially those initially unsure about their own educational attainment, reported significantly higher expected returns, lower concerns about costs, and expressed greater likelihood of PSE attainment. The two online surveys are appended.

Domestic attempts to use financial incentives for teachers to increase student achievement have been ineffective. In this paper, we demonstrate that exploiting the power of loss aversion--teachers are paid in advance and asked to give back the money if their students do not improve sufficiently--increases math test scores between 0.201 (0.076) and 0.398 (0.129) standard deviations. This is equivalent to increasing teacher quality by more than one standard deviation. A second treatment arm, identical to the loss aversion treatment but implemented in the standard fashion, yields smaller and statistically insignificant results. This suggests it is loss aversion, rather than other features of the design or population sampled, that leads to the stark differences between our findings and past research.

To identify links among professional development, teacher knowledge, practice, and student achievement, researchers have called for study designs that allow causal inferences and that examine relationships among features of interventions and multiple outcomes. In a randomized experiment implemented in six states with over 270 elementary teachers and 7,000 students, this project compared three related but systematically varied teacher interventions--"Teaching Cases, Looking at Student Work, and Metacognitive Analysis"--along with no-treatment controls. The three courses contained identical science content components, but differed in the ways they incorporated analysis of learner thinking and of teaching, making it possible to measure effects of these features on teacher and student outcomes. Interventions were delivered by staff developers trained to lead the teacher courses in their regions. Each course improved teachers' and students' scores on selected-response science tests well beyond those of controls, and effects were maintained a year later. Student achievement also improved significantly for English language learners in both the study year and follow-up, and treatment effects did not differ based on sex or race/ethnicity. However, only Teaching Cases and Looking at Student Work courses improved the accuracy and completeness of students' written justifications of test answers in the follow-up, and only Teaching Cases had sustained effects on teachers' written justifications. Thus, the content component in common across the three courses had powerful effects on teachers' and students' ability to choose correct test answers, but their ability to explain why answers were correct only improved when the professional development incorporated analysis of student conceptual understandings and implications for instruction; metacognitive analysis of teachers' own learning did not improve student justifications either year. Findings suggest investing in professional development that integrates content learning with analysis of student learning and teaching rather than advanced content or teacher metacognition alone. (Contains 1 figure and 4 tables.)

Reading comprehension is a challenge for K-12 learners and adults. Nonfiction texts, such as expository texts that inform and explain, are particularly challenging and vital for students' understanding because of their frequent use in formal schooling (e.g., textbooks) as well as everyday life (e.g., newspapers, magazines, and medical information). The structure strategy is explicit instruction about how to strategically use knowledge about text structures for encoding and retrieval of information from nonfiction and has consistently shown significant improvements in reading comprehension. We present the delivery of the structure strategy using a web-based intelligent tutoring system (ITSS) that has the potential to offer consistent modeling, practice tasks, assessment, and feedback to the learner. Finally, we report on statistically significant findings from a large scale randomized controlled efficacy trial with rural and suburban 4th-grade students using ITSS.

This report presents the results of an experiment conducted in Alabama beginning in the 2006/07 school year, to determine the effectiveness of the Alabama Math, Science, and Technology Initiative (AMSTI), which aims to improve mathematics and science achievement in the state's K-12 schools. This study is the first randomized controlled trial testing the effectiveness of AMSTI in improving mathematics problem solving and science achievement in upper-elementary and middle schools. AMSTI is an initiative specific to Alabama and was developed and supported through state resources. An important finding is the positive and statistically significant effect of AMSTI on mathematics achievement as measured by the SAT 10 mathematics problem solving assessment administered by the state to students in grades 4-8. After one year in the program, student mathematics scores were higher than those of a control group that did not receive AMSTI by 0.05 standard deviation, equivalent to 2 percentile points. Nine of the 10 sensitivity analyses yielded effect estimates that were statistically significant at the 0.025 level, consistent with the main finding. The estimated effect of AMSTI on science achievement measured after one year was not statistically significant. Based on the SAT 10 science test administered by the state to students in grades 5 and 7, no difference between AMSTI and control schools could be discerned after one year. Changes in classroom instructional strategies, especially an emphasis on more active-learning strategies, are important to the AMSTI theory of action. Therefore, a secondary investigation of classroom practices was conducted, based on data from survey responses from teachers. For both mathematics and science, statistically significant differences were found between AMSTI and control teachers in the average reported time spent using the strategies. The effect of AMSTI on these instructional strategies was 0.47 standard deviation in mathematics and 0.32 standard deviation in science. Two years of AMSTI appeared to have a positive and statistically significant effect on achievement in mathematics problem solving, compared to no AMSTI. Two years of AMSTI appeared to have a positive and statistically significant effect on achievement in science. AMSTI appeared to have a positive and statistically significant effect on reading achievement as measured by the SAT 10 test of reading administered by the state to students in grades 4-8. AMSTI did not appear to have a statistically significant effect on teacher-reported content knowledge in mathematics or science after one year. AMSTI did not appear to have statistically significant differential effects on student achievement in mathematics problem solving or science based on racial/ethnic minority status, enrollment in the free or reduced-price lunch program, gender, or pretest level. Appended are: (1) Explanation of primary and secondary confirmatory outcome measures; (2) Explanation of exploratory research questions; (3) Selection and random assignment of schools; (4) Statistical power analysis; (5) Data collection procedures and timeline; (6) Description of program implementation data collected but not used in report; (7) Alabama Math, Science, and Technology Initiative (AMSTI) teacher survey #3; (8) Data cleaning and data file construction; (9) Attrition through study stages for samples used in the confirmatory analysis; (10) Description of degree rank; (11) Equivalence of Year 1 baseline and analyzed samples for confirmatory student-level and classroom practice outcomes; (12) Internal consistency and validity of active learning measures; (13) Number of students and teachers in schools in analytic samples used to analyze Year 1 confirmatory questions; (14) Attrition through study stages for samples used in Year 1 exploratory analysis; (15) Tests of equivalence for baseline and analytic samples for Year 1 exploratory outcomes; (16) Statistical power analyses for moderator analyses; (17) Derivation and motivation of the Bell-Bradley estimator when measuring estimated two-year effect of the Alabama Math, Science, and Technology Initiative (AMSTI); (18) Attrition through study stages for samples contributing to estimation of two-year effects; (19) Examination of equivalence in baseline and analytic samples used in the estimation of two-year effects; (20) Estimation model for two-year effects of the Alabama Math, Science, and Technology Initiative (AMSTI); (21) Topics and instructional methods used at the Alabama Math, Science, and Technology Initiative (AMSTI) summer institute; (22) Parameter estimates on probability scale for odds-ratio tests of differences between Alabama Math, Science, and Technology Initiative (AMSTI) and control conditions in Year 1 (associated with summer professional development and in-school support outcomes); (23) Descriptive statistics for variables that change to a binary scale used in the Alabama Math, Science, and Technology Initiative (AMSTI) and control conditions in Year 1; (24) Comparison of assumed parameter values and observed sample statistics for statistical power analysis after one year; (25) Parameter estimates for Stanford Achievement Test Tenth Edition (SAT 10) mathematics problem solving after one year; (26) Parameter estimates for Stanford Achievement Test Tenth Edition (SAT 10) science after one year; (27) Parameter estimates for active learning in mathematics after one year; (28) Parameter estimates for active learning in science after one year; (29) Sensitivity analyses of effect of the Alabama Math, Science, and Technology Initiative (AMSTI) on Stanford Achievement Test Tenth Edition (SAT 10) mathematics problem solving achievement after one year; (30) Sensitivity analyses of effect of the Alabama Math, Science, and Technology Initiative (AMSTI) on Stanford Achievement Test Tenth Edition (SAT 10) science achievement after one year; (31) Sensitivity analyses of effect of the Alabama Math, Science, and Technology Initiative (AMSTI) on active learning instructional strategies in mathematics classrooms after one year; (32) Sensitivity analyses of effect of the Alabama Math, Science, and Technology Initiative (AMSTI) on active learning instructional strategies in science classrooms after one year; (33) Tests for violations of factors associated with assumption of equal first year effects on students in Alabama Math, Science, and Technology Initiative (AMSTI) and control schools; (34) Post hoc adjustment to standard error for estimate of two-year effect of the Alabama Math, Science, and Technology Initiative (AMSTI) on mathematics achievement after two years; (35) Parameter estimates for effect of the Alabama Math, Science, and Technology Initiative (AMSTI) after two years; (36) Parameter estimates for effect of the Alabama Math, Science, and Technology Initiative (AMSTI) on student reading achievement after one year; (37) Parameter estimates for teacher content and student engagement after one year; (38) Estimates of effects for terms involving the indicator of treatment status in the analysis of the moderating effect of the three-level pretest variable; (39) Parameter estimates for the analysis of the moderating effect of racial/ethnic minority status on the impact of the Alabama Math, Science, and Technology Initiative (AMSTI) on reading after one year; (40) Parameter estimates for analysis of average effect of the Alabama Math, Science, and Technology Initiative (AMSTI) on reading by racial/ethnic minority students after one year; and (41) Parameter estimates for effect of the Alabama Math, Science, and Technology Initiative (AMSTI) on reading for White students after one year. (Contains 26 figures, 136 tables, 1 box and 130 footnotes.)

This study investigates whether a curriculum supplement organized as a sequence of teacher-led literacy activities using digital content from public educational television programs can improve early literacy outcomes of low-income preschoolers. The study sample was 436 children in 80 preschool classrooms in California and New York. Preschool teachers were randomly assigned to implement either a 10-week media-rich early literacy intervention that employed clips from "Sesame Street", "Between the Lions", and "SuperWhy!" or to a comparison condition. The media-rich literacy supplement had positive impacts (+0.20 less than or equal to d less than or equal to +0.55) on children's ability to recognize letters, sounds of letters and initial sounds of words, and children's concepts of story and print. The study findings show the potential for incorporating literacy content from public media programming into curriculum supplements supported by professional development to impact early literacy outcomes of low-income children. (Contains 4 tables.)

In 2006, the National Center for Postsecondary Research, of which is MDRC is a partner, launched a demonstration of one-semester learning community programs at six colleges; five of these programs focused on developmental education. This is the final report from the project and includes findings from analyses that pool data across these five programs as well as the results for developmental education students at a sixth program at Kingsborough Community College, operated earlier under the Opening Doors demonstration. Across the six programs, almost 7,000 students were randomly assigned, about half into 174 learning communities, and tracked for three semesters. Key findings suggest that when compared with business as usual, one-semester learning communities in developmental education, on average, lead to: (1) A modest (half-credit) estimated impact on credits earned in the targeted subject (English or mathematics) but no impact on credits earned outside the targeted subject; (2) A modest (half-credit) estimated impact on total credits earned; and (3) No impact on persistence in college. The developmental education students in the Kingsborough program, which had some different features from the other five programs, including enhanced support services, showed somewhat larger results than the other sites in credits earned in the targeted subject. An MDRC report on the overall Kingsborough learning communities program, which served "both" developmental and college-ready students, shows a positive impact on degree attainment after six years. The graduation effect was driven primarily by students who had placed into college-level English, although there is also evidence that the program had a positive impact on long-term outcomes for students with the greatest developmental needs in English. Together, these evaluations suggest that, while most typical one-semester learning communities for developmental education students are not likely to lead to large effects on students' outcomes, a program with additional supports can have longer-term impacts for developmental students. Appended are: (1) Impact Analyses; (2) Supplementary Exhibits for Chapter 3; (3) Instructor Survey Details; (4) Cost Details; and (5) Supplementary Table for Chapter 5. Individual chapters contain footnotes. (Contains 25 tables, 10 figures and 2 boxes.) [This paper was written with Jedediah Teres and Kelley Fong. For "The Effects of Learning Communities for Students in Developmental Education: A Synthesis of Findings from Six Community Colleges. Executive Summary," see ED533826.]

College completion and college success often lag behind college attendance. One theory as to why students do not succeed in college is that they lack key information about how to be successful or fail to act on the information that they have. We present evidence from a randomized experiment which tests the effectiveness of individualized student coaching. Over the course of two separate school years, InsideTrack, a student coaching service, provided coaching to students from public, private, and proprietary universities. Most of the participating students were non-traditional college students enrolled in degree programs. The participating universities and InsideTrack randomly assigned students to be coached. The coach contacted students regularly to develop a clear vision of their goals, to guide them in connecting their daily activities to their long term goals, and to support them in building skills, including time management, self advocacy, and study skills. Students who were randomly assigned to a coach were more likely to persist during the treatment period, and were more likely to be attending the university one year after the coaching had ended. Coaching also proved a more cost-effective method of achieving retention and completion gains when compared to previously studied interventions such as increased financial aid.

Community colleges across the United States face a difficult challenge. On the one hand, they are "open access" institutions, with a mission to serve students from all backgrounds and at varying levels of college readiness. On the other hand, they must uphold high academic standards in order to maintain accreditation and prepare students for employment or transfer to four-year schools. How, then, can community colleges best serve students who want to learn but do not meet minimum academic standards? Chaffey College, a large community college located about 40 miles east of Los Angeles, began to wrestle with this question early in the twenty-first century. Under the auspices of a national demonstration project called Opening Doors, Chaffey developed a program designed to increase probationary students' chances of succeeding in college. Chaffey's program included a "College Success" course, taught by a counselor, which provided basic information on study skills and the requirements of college. As part of the course, students were expected to complete five visits to "Success Centers," where their assignments, linked to the College Success course, covered skills assessment, learning styles, time management, use of resources, and test preparation. In 2005, MDRC collaborated with Chaffey College to evaluate the one-semester, voluntary Opening Doors program. In 2006, the program was improved to form the two-semester Enhanced Opening Doors program, in which probationary students were told that they were required to take the College Success course. In MDRC's evaluation of each program, students were randomly assigned either to a program group that had the opportunity to participate in the program or to a control group that received the college's standard courses and services. This report presents the outcomes for both groups of students in the Enhanced Opening Doors evaluation for four years after they entered the study. The findings include: (1) The message matters--optional program activities had lower participation rates compared with required program activities; (2) Chaffey's Enhanced Opening Doors program had positive short-term effects; and (3) Despite the program's encouraging short-term effects, it did not meaningfully improve students' long-term academic outcomes. This report presents detailed findings from Chaffey's Enhanced Opening Doors initiative, including the cost and cost-effectiveness of the program, and considers the implications of this research for designing services for probationary students in community college. Appended are: (1) Sample Characteristics at Baseline, by Research Group, and Supplementary Four-Year Impact Tables; (2) Measure Creation; and (3) Statistical Model for the Impact Analysis. Individual chapters contain footnotes. (Contains 20 tables, 7 figures and 1 box.) [Additional funding for this paper was provided by the MacArthur Foundation Research Network on Socioeconomic Status and Health and the MacArthur Foundation Research Network on Transitions to Adulthood. For "Serving Community College Students on Probation: Four-Year Findings from Chaffey College's Opening Doors Program. Executive Summary," see ED526394.]

To date, there have been few causally interpretable evaluations of the impacts of preschool curricula on the skills of children at-risk for academic difficulties, and even fewer studies have demonstrated statistically significant or educationally meaningful effects. In this cluster-randomized study, we evaluated the impacts of a literacy-focused preschool curriculum and two types of professional development on the emergent literacy skills of preschool children at-risk for educational difficulties. Forty-eight preschools were randomly assigned to a business-as-usual control, a literacy-focused curriculum with workshop-only professional development, or a literacy-focused curriculum with workshop plus in-class mentoring professional development conditions. An ethnically diverse group of 739 preschool children was assessed on language and literacy outcomes. Results revealed significant and moderate effects for the curriculum and small, mostly nonsignificant, effects of professional development across child outcomes and classroom measures.

Too many children fail to learn how to read proficiently with serious consequences for their overall well-being and long-term success in school. This may be because providing effective instruction is more complex than many of the current models of reading instruction portray; there are Child Characteristic x Instruction (CXI) interactions. Here we present efficacy results for a randomized control field trial of the Individualizing Student Instruction (ISI) intervention, which relies on dynamic system forecasting intervention models to recommend amounts of reading instruction for each student, taking into account CXI interactions that consider his or her vocabulary and reading skills. The study, conducted in seven schools with 25 teachers and 396 first graders, revealed that students in the ISI intervention classrooms demonstrated significantly greater reading skill gains by spring than did students in control classrooms. Plus, they were more likely to receive differentiated reading instruction based on CXI interaction guided recommended amounts than were students in control classrooms. The precision with which students received the recommended amounts of each type of literacy instruction, the distance from recommendation, also predicted reading outcomes. (Contains 7 figures and 6 tables.)

The purpose of this study was to examine the hypothesis that helping preschoolers learn words through categorization may enhance their ability to retain words and their conceptual properties, acting as a bootstrap for self-learning. We examined this hypothesis by investigating the effects of the World of Words instructional program, a supplemental intervention for children in preschool designed to teach word knowledge and conceptual development through taxonomic categorization and embedded multimedia. Participants in the study included 3- and 4-year-old children from 28 Head Start classrooms in 12 schools, randomly assigned to treatment and control groups. Children were assessed on word knowledge, expressive language, conceptual knowledge, and categories and properties of concepts in a yearlong intervention. Results indicated that children receiving the WOW treatment consistently outperformed their control counterparts; further, treatment children were able to use categories to identify the meaning of novel words. Gains in word and categorical knowledge were sustained six months later for those children who remained in Head Start. These results suggest that a program targeted to learning words within taxonomic categories may act as a bootstrap for self-learning and inference generation. (Contains 2 notes, 10 tables, and 1 figure.)

This study reports Year 1 findings from a multisite cluster randomized controlled trial of a cognitive strategies approach to teaching text-based analytical writing for mainstreamed Latino English language learners (ELLs) in 9 middle schools and 6 high schools. There were 103 English teachers stratified by school and grade and then randomly assigned to the Pathway Project professional development intervention or control group. The Pathway Project trains teachers to use a pretest on-demand writing assessment to improve text-based analytical writing instruction for mainstreamed Latino ELLs who are able to participate in regular English classes. The intervention draws on well-documented instructional frameworks for teaching mainstreamed ELLs. Such frameworks emphasize the merits of a cognitive strategies approach that supports these learners' English language development. Pathway teachers participated in 46 hrs of training and learned how to apply cognitive strategies by using an on-demand writing assessment to help students understand, interpret, and write analytical essays about literature. Multilevel models revealed significant effects on an on-demand writing assessment (d = 0.35) and the California Standards Test in English language arts (d = 0.07). (Contains 1 figure, 7 tables and 4 footnotes.)

This report presents findings from a randomized control trial designed to inform the decisions of policymakers who are considering using online courses to provide access to Algebra I in grade 8. It focuses on students judged by their schools to be ready to take Algebra I in grade 8 but who attend schools that do not offer the course. The study tested the impact of offering an online Algebra I course on students' algebra achievement at the end of grade 8 and their subsequent likelihood of participating in an advanced mathematics course sequence in high school. The study was designed to respond to both broad public interest in the deployment of online courses for K-12 students and to calls from policymakers to provide students with adequate pathways to advanced coursetaking sequences in mathematics (National Mathematics Advisory Panel 2008). This study is the first of its kind to rigorously evaluate the impact of offering an online version of Algebra I in schools that otherwise do not typically offer the course, even though they have students who are ready to take it. For educators and students facing similar challenges, the results of this study may be particularly informative and promising. Results showed that offering an online course to AR students is an effective way to broaden access to Algebra I in grade 8 and later, to more challenging mathematics course opportunities. The study demonstrates that an online course as implemented is more effective in promoting students' success in mathematics than existing practices in these schools. Appended are: (1) Study Design, Study Samples, and Statistical Precision; (2) Measures; (3) Intervention Features; (4) Estimation Methods and Hypothesis Testing; (5) Sensitivity Analyses; and (6) Missing Data and Multiple Imputation. (Contains 77 tables, 12 figures and 61 footnotes.)

Students (n = 797) from 36 4th-grade classrooms were taught the control of variables strategy for designing experiments. In the instruct condition, classes were taught in an interactive lecture format. In the manipulate condition, students worked in groups to design and run experiments to determine the effects of four variables. In the both condition, classes received the interactive lecture and also designed and ran experiments. We assessed students' understanding using a written test of their ability to distinguish valid from invalid experimental comparisons. Performance on this test improved from the pretest to the immediate posttest in all conditions, and gains were maintained at a 5-month delay. For students from both higher and lower achieving schools, gains ordered as follows: both greater than instruct greater than manipulate. However, students from higher achieving schools showed greater gains in all conditions. Item analyses showed that the interactive lecture improved students' understanding of the need to control irrelevant variables, and experimentation improved students' understanding of the need to vary the focal variable. (Contains 4 tables, 2 figures and 1 footnote.)

This study examined the effect of linguistic modification on middle school students' ability to show what they know and can do on math assessments. REL West's study on middle school math assessment accommodations found that simplifying the language--or linguistic modification--on standardized math test items made it easier for English Language learners to focus on and grasp math concepts, and thus was a more accurate assessment of their math skills. The results contribute to the body of knowledge informing assessment practices and accommodations appropriate for English language learner students. The study examined students' performance on two sets of math items--both the originally worded items and those that had been modified. Researchers analyzed results from three subgroups of students--English learners (EL), non-English language arts proficient (NEP), and English language arts proficient (EP) students. Key results include: (1) Linguistically modifying the language of mathematics test items did not change the math knowledge being assessed; (2) The effect of linguistic modification on students' math performance varied between the three student subgroups. The results also varied depending on how scores were calculated for each student; and (3) For each of the four scoring approaches analyzed, the effect of linguistic modification was greatest for EL students, followed by NEP and EP students. The report is structured as follows. Following an Executive Summary and a Study Overview, Chapter 2 describes the study design, sample selection and recruitment, item set development processes, and standardized administration procedures. Chapter 3 describes the implementation of the accommodation (linguistic modification), including discussion of considerations and methods for data analysis. Chapter 4 presents findings from data analyses. Chapter 5 summarizes and interprets key findings, describes study challenges, comments on implications of the findings, and offers recommendations for future research. Appendices include: (1) Power analysis for primary research questions; (2) Operational test administration manual; (3) Student Language Background Survey; (4) Guide for developing a linguistically modified assessment; (5) Workgroup training materials; (6) Overview and protocol for cognitive interviews; (7) Item parameter estimates for IRT models; (8) Descriptive statistics from four scoring approaches; (9) ANOVA findings across four scoring approaches; (10) Cross-approach comparisons; (11) Results of the classical item-level analyses; (12) Summary of differential item functioning findings; (13) Exploratory factor analysis results; (14) Operational item set--original; and (15) Operational item set--linguistically modified. (Contains 31 tables, 10 figures, and 45 footnotes.)

The authors present three studies (two randomized controlled experiments and one embedded quasi-experiment) designed to evaluate the impact of replacement units targeting student learning of advanced middle school mathematics. The studies evaluated the SimCalc approach, which integrates an interactive representational technology, paper curriculum, and teacher professional development. Each study addressed both replicability of findings and robustness across Texas settings, with varied teacher characteristics (backgrounds, knowledge, attitudes) and student characteristics (demographics, levels of prior mathematics knowledge). Analyses revealed statistically significant main effects, with student-level effect sizes of 0.63, 0.50, and 0.56. These consistent gains support the conclusion that SimCalc is effective in enabling a wide variety of teachers in a diversity of settings to extend student learning to more advanced mathematics. (Contains 4 tables, 5 figures, and 1 note.)

According to the National Assessment of Educational Progress (NAEP), just over 70 percent of students nationally arrive in high school with reading skills that are below "proficient"--defined as demonstrating competency over challenging subject matter. Of these students, nearly half do not exhibit even partial mastery of the knowledge and skills that are fundamental to proficient work at grade level. These limitations in literacy skills are a major source of course failure, high school dropout, and poor performance in postsecondary education. While research is beginning to emerge about the special needs of striving adolescent readers, very little is known about effective interventions aimed at addressing these needs. To help fill this gap and to provide evidence-based guidance to practitioners, the U.S. Department of Education initiated the Enhanced Reading Opportunities (ERO) study--a demonstration and rigorous evaluation of supplemental literacy programs targeted to ninth-grade students whose reading skills are at least two years below grade level. As part of this demonstration, 34 high schools from 10 school districts implemented one of two reading interventions: Reading Apprenticeship Academic Literacy (RAAL), designed by WestEd, and Xtreme Reading, designed by the University of Kansas Center for Research on Learning. These programs were implemented in the study schools for two school years. The U.S. Department of Education's (ED) Office of Elementary and Secondary Education (OESE) funded the implementation of these programs, and its Institute of Education Sciences (IES) was responsible for oversight of the evaluation. MDRC--a nonprofit, nonpartisan education and social policy research organization--conducted the evaluation in partnership with the American Institutes for Research (AIR) and Survey Research Management (SRM). The goal of the reading interventions--which consist of a year-long course that replaces a ninth-grade elective class--is to help striving adolescent readers develop the strategies and routines used by proficient readers, thereby improving their reading skills and ultimately, their academic performance in high school. The first two reports for the study evaluated the programs' impact on the two most proximal outcomes targeted by the interventions--students' reading skills and their reading behaviors at the end of ninth grade. This report--which is the final of three reports for this evaluation--examines the impact of the ERO programs on the more general outcomes that the programs hope to affect--students' academic performance in high school (grade point average [GPA], credit accumulation, and state test scores) as well as students' behavioral outcomes (attendance and disciplinary infractions). These academic and behavioral outcomes are examined during the year in which they were enrolled in the ERO programs (ninth grade), as well as the following school year (tenth grade for most students). Appendices include: (1) The ERO Programs and the ERO Teachers; (2) ERO Student Survey Measures; (3) ERO Implementation Fidelity; (4) State Tests Included in the ERO Study; (5) Response Analysis and Baseline Comparison Tables; (6) Technical Notes for Impact Findings; (7) Statistical Power and Minimum Detectable Effect Size; (8) Supplementary Impact Findings; (9) Baseline and Impact Findings, by Cohort; (10) The Association Between Reading Outcomes and Academic Performance in High School; (11) Variation in Impacts Across Sites and Cohorts; (12) Program Costs; and (13) Poststudy Adolescent Literacy Programming in the ERO Schools: Methodology and Additional Findings. (Contains 97 tables, 23 figures, 2 boxes, and 185 footnotes.) [This paper was written with Edmond Wong. For the first-year report, see ED499778. For the second report, see ED503380.]

According to the National Assessment of Educational Progress (NAEP), just over 70 percent of students nationally arrive in high school with reading skills that are below "proficient"--defined as demonstrating competency over challenging subject matter. Of these students, nearly half do not exhibit even partial mastery of the knowledge and skills that are fundamental to proficient work at grade level. These limitations in literacy skills are a major source of course failure, high school dropout, and poor performance in postsecondary education. While research is beginning to emerge about the special needs of striving adolescent readers, very little is known about effective interventions aimed at addressing these needs. To help fill this gap and to provide evidence-based guidance to practitioners, the U.S. Department of Education initiated the Enhanced Reading Opportunities (ERO) study--a demonstration and rigorous evaluation of supplemental literacy programs targeted to ninth-grade students whose reading skills are at least two years below grade level. As part of this demonstration, 34 high schools from 10 school districts implemented one of two reading interventions: Reading Apprenticeship Academic Literacy (RAAL), designed by WestEd, and Xtreme Reading, designed by the University of Kansas Center for Research on Learning. These programs were implemented in the study schools for two school years. The U.S. Department of Education's (ED) Office of Elementary and Secondary Education (OESE) funded the implementation of these programs, and its Institute of Education Sciences (IES) was responsible for oversight of the evaluation. MDRC--a nonprofit, nonpartisan education and social policy research organization--conducted the evaluation in partnership with the American Institutes for Research (AIR) and Survey Research Management (SRM). The goal of the reading interventions--which consist of a year-long course that replaces a ninth-grade elective class--is to help striving adolescent readers develop the strategies and routines used by proficient readers, thereby improving their reading skills and ultimately, their academic performance in high school. The first two reports for the study evaluated the programs' impact on the two most proximal outcomes targeted by the interventions--students' reading skills and their reading behaviors at the end of ninth grade. This report--which is the final of three reports for this evaluation--examines the impact of the ERO programs on the more general outcomes that the programs hope to affect--students' academic performance in high school (grade point average [GPA], credit accumulation, and state test scores) as well as students' behavioral outcomes (attendance and disciplinary infractions). These academic and behavioral outcomes are examined during the year in which they were enrolled in the ERO programs (ninth grade), as well as the following school year (tenth grade for most students). Appendices include: (1) The ERO Programs and the ERO Teachers; (2) ERO Student Survey Measures; (3) ERO Implementation Fidelity; (4) State Tests Included in the ERO Study; (5) Response Analysis and Baseline Comparison Tables; (6) Technical Notes for Impact Findings; (7) Statistical Power and Minimum Detectable Effect Size; (8) Supplementary Impact Findings; (9) Baseline and Impact Findings, by Cohort; (10) The Association Between Reading Outcomes and Academic Performance in High School; (11) Variation in Impacts Across Sites and Cohorts; (12) Program Costs; and (13) Poststudy Adolescent Literacy Programming in the ERO Schools: Methodology and Additional Findings. (Contains 97 tables, 23 figures, 2 boxes, and 185 footnotes.) [This paper was written with Edmond Wong. For the first-year report, see ED499778. For the second report, see ED503380.]

According to the National Assessment of Educational Progress (NAEP), just over 70 percent of students nationally arrive in high school with reading skills that are below "proficient"--defined as demonstrating competency over challenging subject matter. Of these students, nearly half do not exhibit even partial mastery of the knowledge and skills that are fundamental to proficient work at grade level. These limitations in literacy skills are a major source of course failure, high school dropout, and poor performance in postsecondary education. While research is beginning to emerge about the special needs of striving adolescent readers, very little is known about effective interventions aimed at addressing these needs. To help fill this gap and to provide evidence-based guidance to practitioners, the U.S. Department of Education initiated the Enhanced Reading Opportunities (ERO) study--a demonstration and rigorous evaluation of supplemental literacy programs targeted to ninth-grade students whose reading skills are at least two years below grade level. As part of this demonstration, 34 high schools from 10 school districts implemented one of two reading interventions: Reading Apprenticeship Academic Literacy (RAAL), designed by WestEd, and Xtreme Reading, designed by the University of Kansas Center for Research on Learning. These programs were implemented in the study schools for two school years. The U.S. Department of Education's (ED) Office of Elementary and Secondary Education (OESE) funded the implementation of these programs, and its Institute of Education Sciences (IES) was responsible for oversight of the evaluation. MDRC--a nonprofit, nonpartisan education and social policy research organization--conducted the evaluation in partnership with the American Institutes for Research (AIR) and Survey Research Management (SRM). The goal of the reading interventions--which consist of a year-long course that replaces a ninth-grade elective class--is to help striving adolescent readers develop the strategies and routines used by proficient readers, thereby improving their reading skills and ultimately, their academic performance in high school. The first two reports for the study evaluated the programs' impact on the two most proximal outcomes targeted by the interventions--students' reading skills and their reading behaviors at the end of ninth grade. This report--which is the final of three reports for this evaluation--examines the impact of the ERO programs on the more general outcomes that the programs hope to affect--students' academic performance in high school (grade point average [GPA], credit accumulation, and state test scores) as well as students' behavioral outcomes (attendance and disciplinary infractions). These academic and behavioral outcomes are examined during the year in which they were enrolled in the ERO programs (ninth grade), as well as the following school year (tenth grade for most students). Appendices include: (1) The ERO Programs and the ERO Teachers; (2) ERO Student Survey Measures; (3) ERO Implementation Fidelity; (4) State Tests Included in the ERO Study; (5) Response Analysis and Baseline Comparison Tables; (6) Technical Notes for Impact Findings; (7) Statistical Power and Minimum Detectable Effect Size; (8) Supplementary Impact Findings; (9) Baseline and Impact Findings, by Cohort; (10) The Association Between Reading Outcomes and Academic Performance in High School; (11) Variation in Impacts Across Sites and Cohorts; (12) Program Costs; and (13) Poststudy Adolescent Literacy Programming in the ERO Schools: Methodology and Additional Findings. (Contains 97 tables, 23 figures, 2 boxes, and 185 footnotes.) [This paper was written with Edmond Wong. For the first-year report, see ED499778. For the second report, see ED503380.]

This report summarizes evaluation results for an efficacy study of the Leveled Literacy Intervention system (LLI) implemented in Tift County Schools (TCS) in Georgia and the Enlarged City School District of Middletown (ECSDM) in New York during the 2009-2010 school year. Developed by Fountas & Pinnell (2009) and published by Heinemann, LLI is a short-term, small-group, supplemental literacy intervention system designed for students in kindergarten through second grade (K-2) who struggle with literacy. The goal of LLI is to provide intensive support to help these early learners quickly achieve grade-level competency. Both school districts evaluated in this study adopted the targeted, small-group implementation model of LLI in their schools with support from Heinemann consultants providing LLI professional development. This report focuses on the implementation and impact of this model during the first full school year of the system in these schools. The purpose of this study was threefold: (1) to determine the efficacy of the Leveled Literacy Intervention system (LLI) in increasing reading achievement for K-2 students; (2) to examine the implementation fidelity of LLI; and (3) to determine perceptions of the LLI system according to relevant stakeholders. This study focused on two U.S. school districts and comprised 427 K-2 students who were matched demographically and randomly assigned to treatment and control groups. This evaluation used a mixed-methods design to address the following key research questions: (1) What progress in literacy do students who receive LLI make compared to students who receive only regular classroom literacy instruction? (2) Was LLI implemented with fidelity to the developers' model? and (3) What were LLI teachers' perceptions of LLI and its impact on their students' literacy? Altogether, the results from this evaluation allow us to conclude that the LLI system positively impacts students' literacy skills. These results also suggest that continued implementation of LLI would be beneficial in both Tift County Schools and the Enlarged City School District of Middletown. From this evaluation, CREP proposes several recommendations. (Contains 34 tables, 8 footnotes, and 1 figure.) [This study was supported by funding from Heinemann Publishing.]

Schoolwide Positive Behavioral Interventions and Supports (SWPBIS) is a universal, schoolwide prevention strategy that is currently implemented in over 9,000 schools across the nation to reduce disruptive behavior problems through the application of behavioral, social learning, and organizational behavioral principles. SWPBIS aims to alter school environments by creating improved systems and procedures that promote positive change in student behavior by targeting staff behaviors. This study uses data from a 5-year longitudinal randomized controlled effectiveness trial of SWPBIS conducted in 37 elementary schools to examine the impact of training in SWPBIS on implementation fidelity as well as student suspensions, office discipline referrals, and academic achievement. School-level longitudinal analyses indicated that the schools trained in SWPBIS implemented the model with high fidelity and experienced significant reductions in student suspensions and office discipline referrals. (Contains 1 table and 5 figures.)

State education departments, in discussions with Regional Educational Laboratory (REL) Southeast, identified low reading achievement as a critical issue for their students and expressed an interest in identifying effective strategies to promote the foundational skills in young students that might improve reading achievement. The Mississippi State Department of Education has focused specifically on interventions that might enhance students' vocabulary knowledge. Kindergarten PAVEd for Success (K-PAVE) was selected to be tested in Mississippi for three reasons. First, there were only a small number of vocabulary interventions appropriate for this age group to be considered. Second, among these, PAVE--the preschool version of the intervention--was the only one for which an impact study had been completed that provided some evidence of effects. Third, K-PAVE was the only curriculum that had developed teacher training materials and a training protocol, which meant that it could be implemented with sufficient fidelity across a variety of districts and school settings. The primary research question for the study addressed the impact of K-PAVE on kindergarten students' expressive vocabulary. Secondary research questions addressed the impacts on kindergarten students' academic knowledge and listening comprehension. Although the study was concerned primarily with the impacts of K-PAVE on students, impacts on intermediate classroom instruction outcomes were also assessed to provide context for understanding potential impacts on students. The study addressed research questions about impacts on classroom instruction in vocabulary and comprehension support, instructional support, and emotional support. Finally, the study examined whether the introduction of K-PAVE had the unintended consequence of reducing the time spent on areas of literacy instruction other than vocabulary and comprehension (such as phonological awareness, alphabet knowledge, print concepts, and decoding). The study found that kindergarten students in schools using K-PAVE as a supplement to the regular literacy instruction performed better than kindergarten students in control schools on the Expressive Vocabulary Test-2 administered at the end of the school year. The study also found that kindergarten students in K-PAVE schools performed better than students in control schools on the measure of academic knowledge administered at the end of the year. K-PAVE caused a positive and statistically significant impact on one of the three kindergarten classroom instructional practices examined: vocabulary and comprehension support, which includes introducing vocabulary words during read-alouds, introducing vocabulary words throughout the school day, asking higher order questions during read-alouds, and providing comprehension support during book read-alouds. Appendices include: (1) Mississippi Counties with Study Schools, by County; (2) Statistical Power Analysis; (3) Random Assignment; (4) Recruitment and Random Selection of the Student Sample; (5) Comparison of Students Missing and Not Missing Baseline Assessment; (6) Classroom Observation Measures for Impact Evaluation; (7) Teacher Survey; (8) K-PAVE Fidelity Observer Handbook and Training Fidelity Checklist; (9) Data Collection Procedures; (10) Data Quality Assurance Procedures; (11) Model Specifications; (12) Flowchart Illustrating Sample Attrition from Data Collection; (13) Missing Data Imputation; (14) Sensitivity Analyses; (15) School, Teacher, and Student Covariates; (16) List of K-PAVE Materials Provided to Teachers; (17) Sample Weekly Unit from K-PAVE Program; (18) List of the 240 K-PAVE Target Words; (19) K-PAVE Teacher Training Agenda; (20) K-PAVE Teacher Phone Follow-Up Agenda; (21) Sample Means and Standard Deviations for Student and Classroom Outcome Measures, by Intervention Status; (22) Checking Model Assumptions; and (23) Translating Impacts on Students into Age-Equivalent Differences in Posttest Outcomes. (Contains 53 tables, 16 figures, 1 map, 3 boxes, and 86 footnotes

This report addresses the following four questions by reporting on the impacts of Head Start on children and families during the children's preschool, kindergarten, and 1st grade years: (1) What difference does Head Start make to key outcomes of development and learning (and in particular, the multiple domains of school readiness) for low-income children? (2) What difference does Head Start make to parental practices that contribute to children's school readiness? (3) Under what circumstances does Head Start achieve the greatest impact? What works for which children? (4) What Head Start services are most related to impact? The Head Start Impact Study was conducted with a nationally representative sample of 84 grantee/delegate agencies and included nearly 5,000 newly entering, eligible 3- and 4-year-old children who were randomly assigned to either: (1) a Head Start group that had access to Head Start program services or (2) a control group that did not have access to Head Start, but could enroll in other early childhood programs or non-Head Start services selected by their parents. The study was designed to separately examine two cohorts of children, newly entering 3-and 4-year-olds. This design reflects the hypothesis that different program impacts may be associated with different age of entry into Head Start. Differential impacts are of particular interest in light of a trend of increased enrollment of the 3-year-olds in some grantee/delegate agencies presumably due to the growing availability of preschool options for 4-year-olds. Consequently, the study included two separate samples: a newly entering 3-year-old group (to be studied through two years of Head Start participation i.e., Head Start year and age 4 year, kindergarten and 1st grade), and a newly entering 4-year-old group (to be studied through one year of Head Start participation, kindergarten and 1st grade). The study showed that the two age cohorts varied in demographic characteristics, making it even more appropriate to examine them separately. The racial/ethnic characteristics of newly entering children in the 3-year-old cohort were substantially different from the characteristics of children in the newly entering 4-year-old cohort. While the newly entering 3-year-olds were relatively evenly distributed between Black children and Hispanic children (Black children 32.8%, Hispanic children 37.4%, and White/other children 29.8%), about half of newly entering 4-year-olds were Hispanic children (Black children 17.5%, Hispanic children 51.6%, and White/other children 30.8%). The ethnic difference is also reflected in the age-group differences in child and parent language. This report presents the findings from the preschool years through children's 1st grade experience. This document consists of the Executive Summary and nine chapters. Chapter 1 presents the study background, including a literature review of related Head Start research and the study purpose and objectives. Chapter 2 provides details about the study design and implementation. It discusses the experimental design, sample selection prior to random assignment, data collection, and data analysis. To provide a context in which to understand the impact findings, Chapter 3 examines the impact of Head Start on the services and child care settings that children experience prior to starting school. It also provides the impact of Head Start on the educational and child care settings, setting characteristics, and services that children experience during kindergarten and 1st grade. Chapters 4 through 7 present the impact of Head Start on children's outcomes and parenting practices for the years before school and then for kindergarten and 1st grade. Chapter 4 presents the impact of Head Start on children's cognitive development, Chapter 5 presents the impact of Head Start on children's social-emotional development, Chapter 6 presents the impact of Head Start on children's health status and access to health services, and Chapter 7 presents the impact of Head Start on parenting practices in the areas of educational activities, discipline practices, and school involvement. Chapter 8 examines variation in impacts by child characteristics, parent and family characteristics, and community characteristics. Chapter 9 provides an overall summary of the findings, implications for the Head Start Program, and unanswered questions. Appendices in this volume include the Head Start Impact Study legislation, a list of the official Head Start Impact Study Advisory Committee members, the language decision form used to determine the language in which the child was assessed, and data tables that elaborate on the findings presented in the volume (e.g., Impact on Treated (IOT) findings). The findings from a sample of programs in Puerto Rico are also provided in an appendix. Programs in Puerto Rico were included in the study with the intent that data on children in these programs would be analyzed along with the data on children in the 50 states and the District of Columbia, once children reached school-age. (Contains 1 figure, 117 footnotes, and 114 exhibits.) [The ERIC version of this document contains the following supplementary materials: Head Start Impact Study Main Impact Tables, 2003 through 2006; and Head Start Impact Study Subgroup Impact Tables, 2003 through 2006. For the "Head Start Impact Study Technical Report," see ED507846. For the "Head Start Impact Study Final Report. Executive Summary," see ED507847.]

Connecticut's interdistrict magnet schools offer a model of choice-based desegregation that appears to satisfy current legal constraints. This study presents evidence that interdistrict magnet schools have provided students from Connecticut's central cities access to less racially and economically isolated educational environments and estimates the impact of attending a magnet school on student achievement. To address potential selection biases, the analyses exploit the random assignment that results from lottery-based admissions for a small set of schools, as well as value-added and fixed-effect estimators that rely on pre-magnet school measures of student achievement to obtain effect estimates for a broader set of interdistrict magnet schools. Results indicate that attendance at an interdistrict magnet high school has positive effects on the math and reading achievement of central city students and that interdistrict magnet middle schools have positive effects on reading achievement. (Contains 20 notes, 8 tables, and 1 figure.)

This report summarizes the findings from a national evaluation of mentoring programs funded under the U.S. Department of Education's Student Mentoring Program. The impact evaluation used an experimental design in which students were randomly assigned to a treatment or control group. Thirty-two purposively selected School Mentoring Programs and 2,573 students took part in the evaluation, which estimated the impact of the programs over one school year on a range of student outcomes. The evaluation also describes the characteristics of the program and the mentors, and provides information about program delivery. The Student Mentoring Program is designed to fund grantees to enable them to provide mentoring to at-risk students in grades 4-8. The ultimate goal of the program is to improve student academic and behavioral outcomes through the guidance and encouragement of a volunteer mentor. Seventeen total impacts in the domains of academic achievement/engagement, interpersonal relationships/personal responsibility, and high-risk/delinquent behavior were measured. The main finding of the Impact Study was that there were no statistically significant impacts of the Student Mentoring Program for the sample as a whole on this array of student outcomes. However, there was some scattered evidence that impacts were heterogeneous across types of students. In particular, impacts on girls were statistically significantly different from impacts on boys for two self-reported scales: Scholastic Efficacy and School Bonding, and Pro-social Behaviors. For boys, the impact on Prosocial Behaviors was negative and statistically significant. For girls, the impact on Scholastic Efficacy and School Bonding was positive and statistically significant. The impact on truancy was negative and statistically significant for students below age 12. There were negative associations between program supervision of mentors and site-level impacts on three of the seventeen individual outcome measures: Pro-social Behaviors, grades in math and social studies, and a positive relationship with the outcome of school-reported delinquency. The report also presented results demonstrating that the Student Mentoring Program represented a fairly low level of intensity in terms of service: although grantees, on average, adhered to the general intents of the legislation and program guidance, they were simultaneously constrained by the limits of the school calendar and the population from which to draw mentors. Thirty-five percent of the control group students reported receiving mentoring either from the program or elsewhere in the community; this finding, coupled with the fact that not all treatment group students met with a mentor, reduced the treatment contrast and may have led to some dilution of the impacts on students compared to expectations. Seven appendices are included; (1) Sampling Design and Methodology; (2) Survey Instruments; (3) Construction of Student Outcome Measures; (4) Impact Analysis Results on Original Student Survey Scales and Measures; (5) Sensitivity Tests; (6) Standard Errors and Confidence Intervals of Main Effects; and (7) Site-Level Predictors and Impacts. (Contains 109 footnotes and 122 exhibits.) ["Impact Evaluation of the U.S. Department of Education's Student Mentoring Program. Final Report" was written with the assistance of Christine Dyous, Michelle Klausner, Nancy McGarry, Rachel Luck and William Rhodes.]

This project entailed a three-year efficacy evaluation of the Computer and Team Assisted Mathematical Acceleration (CATAMA) Lab developed by the Center for Social Organization of Schools at Johns Hopkins University. The CATAMA Lab was proposed as an immediate and practical approach to addressing the different types of math deficits held by students at urban high-poverty schools. The Lab required only 1 teacher per school reducing staff and professional development requirements. It used multiple instructional techniques (including individualized computer instruction, direct instruction, pair and team learning, and individual instruction) to teach math concepts and skills. By taking the place of an elective it allowed students to continue with their on-grade math class. For a more detailed description of the Lab see Appendix 2. The original goal of the project was to establish the Lab at three urban schools serving high-poverty high-minority middle grade students (grades 5-8). Students underperforming in mathematics (as established by district standardized tests) were to take a trimester course of study in the Lab to increase their knowledge of math concepts and skills taught by a regular math teacher receiving extensive ongoing professional development. Students were to take the Lab as an elective course while continuing with their regular math class. From each school's pool of students eligible to participate, students were to be randomly assigned to take the Lab. An implementation analysis was to measure the teaching of the concepts and skills to be taught in the Lab. To evaluate the impact of the intervention, students' math achievement, as measured by standardized math tests, was to be compared to eligible students not assigned to the Lab. This report discusses the project in three sections: (1) A comparison of the actual project with the planned project; (2) The descriptive results from the project; (a) Description of the sample; (b) Description of implementation of the CATAMA Lab; and (3) The evaluative results from the project.

Successful implementation of evidence-based educational practices at scale is of great importance but has presented significant challenges. In this article, the authors address the following questions: How does the level of on-site technical assistance affect student outcomes? Do teachers' fidelity of treatment implementation and their perceptions of school climate mediate effects on student performance? Using a randomized control trial at scale, the authors examine Kindergarten Peer Assisted Learning Strategies, which previously has been shown to be effective in increasing student reading achievement. Analyzing data from 2 years and three sites, the analyses show that the level of on-site technical support has significant effects on reading achievement gains, are robust across multiple sites, and are mediated by fidelity of implementation within teachers' classrooms. (Contains 2 figures and 4 tables.)

In this article, the authors report achievement outcomes of a multisite cluster randomized field trial of Open Court Reading 2005 (OCR), a K-6 literacy curriculum published by SRA/McGraw-Hill. The participants are 49 first-grade through fifth-grade classrooms from predominantly minority and poor contexts across the nation. Blocking by grade level within schools, the trial includes 27 classrooms receiving the OCR curricular materials and professional development and 22 "business-as-usual" control classrooms. Multilevel analyses of classroom-level effects of assignment to OCR reveal statistically significant treatment effects on all three of the Comprehensive Test of Basic Skills, 5th edition, Terra Nova literacy posttests. The OCR effect sizes are d = 0.16 for the Reading Composite, d = 0.19 for Vocabulary, and d = 0.12 for Reading Comprehension. These effects achieved across 27 classrooms and 5 schools demonstrate the potential for replicating improved literacy outcomes through the scale-up of OCR. (Contains 4 tables and 1 note.)

Using a cluster randomization design, schools were randomly assigned to implement Success for All, a comprehensive reading reform model, or control methods. This article reports final literacy outcomes for a 3-year longitudinal sample of children who participated in the treatment or control condition from kindergarten through second grade and a combined longitudinal and in-mover student sample, both of which were nested within 35 schools. Hierarchical linear model analyses of all three outcomes for both samples revealed statistically significant school-level effects of treatment assignment as large as one third of a standard deviation. The results correspond with the Success for All program theory, which emphasizes both comprehensive school-level reform and targeted student-level achievement effects through a multi-year sequencing of literacy instruction. (Contains 5 tables.)

This paper reports on a randomized experiment to study the impact of an alternative teacher preparation program, Teach for America (TFA), on student achievement and other outcomes. We found that TFA teachers had a positive impact on math achievement and no impact on reading achievement. The size of the impact on math scores was about 15 percent of a standard deviation, equivalent to about one month of instruction. The general conclusions did not differ substantially for subgroups of teachers, including novice teachers, or for subgroups of students. We found no impacts on other student outcomes such as attendance, promotion, or disciplinary incidents, but TFA teachers were more likely to report problems with student behavior than were their peers. The findings contradict claims that such programs allowing teachers to bypass the traditional route to the classroom harm students.

Community colleges, which tend to be more accessible and affordable than other postsecondary institutions, are a critical resource for low-income people striving to improve their prospects in the labor market and in life. Yet nearly half of students who begin at community colleges leave school before receiving a credential. Research by MDRC and others suggests that many community college students want to earn a degree but are overwhelmed by the competing demands of work, family, and school. Institutional barriers, such as poorly tailored instruction, insufficient financial aid, or inadequate advising, may also impede their academic progress. In 2003, MDRC launched the Opening Doors demonstration project to study the effects of innovative programs designed to help students stay in school and succeed. Six colleges in four states are taking part in the demonstration. This report presents early findings from Louisiana Opening Doors, an enhanced financial aid program targeting low-income parents at two community colleges in the New Orleans area: Delgado Community College and Louisiana Technical College-West Jefferson. This program was designed to help students with their expenses and provide an incentive to make good academic progress. Students randomly assigned to Opening Doors were offered a $1,000 scholarship for each of two semesters, in addition to the regular financial aid they qualified for, if they enrolled at least half time and earned at least a C average. They also received enhanced counseling. Students in a control group received only regular financial aid and the counseling available to all students. The early findings in Louisiana are compelling and suggest that a performance-based scholarship can indeed have a positive effect on persistence and academic achievement among a student population that faces multiple barriers to completing college. The students in Opening Doors were more likely to enroll in college full time, passed more courses, earned more course credits, and had higher rates of persistence. (Contains 30 endnotes, 3 tables, and 1 figure.) [The opening Doors Project was also funded by MacArthur Foundation Research Network on Socioeconomic Status and Health; MacArthur Foundation Research Network on Transitions to Adulthood.]

Teach For America (TFA) was founded in 1989 to address the educational inequities facing children in low-income communities across the United States by expanding the pool of teacher candidates available to the schools those children attend. TFA recruits seniors and recent graduates from colleges around the country, people who are willing to commit to teach for a minimum of two years in low-income schools. TFA focuses its recruitment on people with strong academic records and leadership capabilities, whether or not they have planned to teach or have taken education courses. TFA is particularly interested in candidates that have the potential to be effective in the classroom but in the absence of TFA would not consider a teaching career. Consequently, most TFA recruits do not have education-related majors in college and therefore have not received the same training that traditional teachers are expected to have. After an executive summary and introduction, this discussion paper addresses the following: (1) How TFA Works; (2) Study Design; (3) Who Teaches in the Schools Where TFA Places Teachers?; (4) What Does Our Sample of Students Look Like?; (5) Were TFA Teachers Effective in the Classroom?; and (6) Did TFA Have an Impact on Other Student Outcomes? Primary findings from the study include: from the perspective of a community or a school faced with the opportunity to hire TFA teachers, TFA offers an appealing pool of candidates; from the perspective of TFA and its funders, the organization is making progress toward its primary mission of reducing inequities in education--it supplies low-income schools with academically talented teachers who contribute positively to the academic achievement of their students; and from the perspective of policymakers who are trying to improve the educational opportunities of children in poor communities, many of the control teachers in the study were not certified or did not have formal pre-service training, highlighting the need for programs or policies that offer the potential of attracting good teachers to schools in the most disadvantaged communities--the findings show that TFA is one such program. Appended are: (1) Supplementary Tables; and (2) Estimation Approach. (Contains 17 tables and 6 figures.)

Career Academies offer high schools--particularly those in urban communities that struggle to keep students in school and to prepare them for post-secondary education and employment opportunities--a systematic approach to addressing a range of challenges. Typically serving between 150 and 200 students from grades 9 or 10 through grade 12, Career Academies have three distinguishing features: (1) they are organized as small learning communities to create a more supportive, personalized learning environment; (2) they combine academic and career and technical curricula around a career theme to enrich teaching and learning; and (3) they establish partnerships with local employers to provide career awareness and work-based learning opportunities for students. There are estimated to be more than 2,500 Career Academies across the country, operating either as a single program or as multiple programs within a larger high school. This report examines the impact that Career Academies have had on the educational attainment and post-secondary labor market experiences of young people through the four years following their scheduled graduation from high school. It is based on survey data collected from 1,458 young people in the Career Academies Evaluation study sample (about 85 percent of whom are either Hispanic or African-American). Findings included: (1) the Career Academies substantially improved the labor market prospects of young men, a group that has experienced a severe decline in real earnings in recent years; (2) the Career Academies had no significant impacts (positive or negative) on the labor market outcomes for young women; (3) Overall, the Career Academies served as viable pathways to a range of post-secondary education opportunities, but they do not appear to have been more effective than options available to the non-Academy group; and (4) The positive labor market impacts were concentrated among Academy group members who were at high or medium risk of dropping out of high school when they entered the programs. The findings demonstrate the feasibility of improving labor market preparation and successful school-to-work transitions without compromising academic goals and preparation for college. (Contains 10 exhibits.) [Report written with Judith Scott-Clayton. Dissemination of MDRC publications is also supported by Starr Foundation.]

Career Academies offer high schools--particularly those in urban communities that struggle to keep students in school and to prepare them for post-secondary education and employment opportunities--a systematic approach to addressing a range of challenges. Typically serving between 150 and 200 students from grades 9 or 10 through grade 12, Career Academies have three distinguishing features: (1) they are organized as small learning communities to create a more supportive, personalized learning environment; (2) they combine academic and career and technical curricula around a career theme to enrich teaching and learning; and (3) they establish partnerships with local employers to provide career awareness and work-based learning opportunities for students. There are estimated to be more than 2,500 Career Academies across the country, operating either as a single program or as multiple programs within a larger high school. This report examines the impact that Career Academies have had on the educational attainment and post-secondary labor market experiences of young people through the four years following their scheduled graduation from high school. It is based on survey data collected from 1,458 young people in the Career Academies Evaluation study sample (about 85 percent of whom are either Hispanic or African-American). Findings included: (1) the Career Academies substantially improved the labor market prospects of young men, a group that has experienced a severe decline in real earnings in recent years; (2) the Career Academies had no significant impacts (positive or negative) on the labor market outcomes for young women; (3) Overall, the Career Academies served as viable pathways to a range of post-secondary education opportunities, but they do not appear to have been more effective than options available to the non-Academy group; and (4) The positive labor market impacts were concentrated among Academy group members who were at high or medium risk of dropping out of high school when they entered the programs. The findings demonstrate the feasibility of improving labor market preparation and successful school-to-work transitions without compromising academic goals and preparation for college. (Contains 10 exhibits.) [Report written with Judith Scott-Clayton. Dissemination of MDRC publications is also supported by Starr Foundation.]

The College and Career Readiness Expansion project was a five-year, federally funded effort to implement early college strategies in comprehensive high schools. This report presents the results from a quasi-experimental impact study of the project and a mixed methods examination of its implementation. Results showed that the program increased the percentage of students on-track for college in 9th and 10th grade and expanded the number of students taking dual enrollment courses, although there was no positive impact on college credits earned in high school. The implementation study found that schools were created a more future-oriented culture.

This study examined participation in accelerated college credit programs dual enrollment, concurrent enrollment, and Advanced Placement courses in Rhode Island high schools to understand their effects on educational attainment in the 2013/14 grade 9 cohort. The state, which has funded and promoted these opportunities for students to earn college credit during high school over the past five years, sought evidence of the programs' effects on participants' high school graduation rates, postsecondary enrollment rates, and enrollment rates in developmental education courses in college. The study found that male, economically disadvantaged, and racial/ethnic minority students were underrepresented in accelerated college credit programs. Participation in these programs had positive effects on students' rates of high school graduation and postsecondary enrollment. Among students in the cohort who enrolled in Rhode Island public colleges, participation was associated with lower rates of developmental education course enrollment in the first year of college. The effects of participating in an accelerated college credit program were similar for economically disadvantaged students and for their peers. [For the Study Snapshot, see ED612888. For the appendices, see ED612890.]

Education leaders in Nebraska and South Dakota partnered with the Regional Educational Laboratory Central to examine how completing a sequence of career and technical education (CTE) courses in high school affects students' rates of on-time high school graduation and their rates of postsecondary education enrollment and completion within two and five years. The study found that CTE concentrators (students who complete a sequence of CTE courses aligned to a specific career field such as manufacturing or education and training) were 7 percentage points more likely than non-CTE concentrators to graduate from high school on time and 10 percentage points more likely to enroll in any type of postsecondary education within two years of their expected high school graduation year. The study also found that CTE concentrators were 3 percentage points more likely than non-CTE concentrators to earn a postsecondary award, such as a professional certificate, diploma, or associate's or bachelor's degree, within five years of their expected high school graduation year. CTE concentrators were 4 percentage points more likely than non-CTE concentrators to obtain up to an associate's degree as their highest postsecondary award within five years of their expected high school graduation year but 1 percentage point less likely to obtain a bachelor's degree or higher. [For the appendixes, see ED612631; for the study brief, see ED612632; for the study snapshot, see ED612633.]

In Indiana and Minnesota the state education agency, state higher education agency, and the state workforce agency have collaborated to develop career and technical education courses intended to improve high school students' college and career readiness. These agencies partnered with the Regional Educational Laboratory Midwest to examine whether high school graduates in each state who completed a large number of career and technical education courses in a single career-oriented program of study (concentrators) had different college and workforce outcomes from graduates who completed fewer (samplers) or no career and technical education courses (nonparticipants). The study found that in the 2012/13-2017/18 graduation cohorts, male graduates were more likely to be concentrators than female graduates, and graduates who received special education services were more likely to be concentrators than those who did not receive services. Graduates who were not proficient in reading in grade 8 also were more likely to become concentrators than those who were proficient. Graduates who attended urban and suburban schools were more likely than students who attended town and rural schools to be nonparticipants. Concentrators were less likely than samplers and nonparticipants with similar characteristics to enroll in college, but the differences reflect mainly enrollment in four-year colleges. Concentrators were more likely to enroll in two-year colleges. Concentrators also were less likely than similar samplers and nonparticipants to complete a bachelor's degree within four to six years. Finally, compared with similar samplers and nonparticipants, concentrators were employed at higher rates in the first five years after high school and had higher earnings. [For the study brief, see ED613045; for the study snapshot, see ED613046; and for the appendixes, see ED613050.]

On average, Florida students earn only half of the points possible in the statistics content area of the state's annual mathematics assessment. Leaders in Broward County Public Schools, a large, diverse, urban school district, viewed changes to statistics curriculum and instruction as one way to address this issue. This study randomly assigned 40 middle schools in the district to either implement a replacement curriculum unit with four days of teacher professional development in probability and statistics or continue with their practice-as-usual instruction in probability and statistics. The replacement unit supported teaching and learning of all the probability and statistics standards in the grade 7 course description. The replacement unit with the associated professional development, called the Supporting Teacher Enactment of the Probability and Statistics Standards program, improved student understanding of statistics and statistics instruction. The magnitude of the effect on student understanding was 23 percent of 1 standard deviation, which is comparable to an increase of 9 percentile points for an average student. [For the appendixes, see ED610168. For the study snapshot, see ED610167.]

District leaders in a large urban school district in central Florida wanted to examine the efficacy of a new curriculum designed to enhance the word knowledge of grade 5 students so as to improve reading achievement. The new curriculum, called Word Knowledge Instruction (WKI), consists of 15-minute lessons 4 days a week for 20 weeks. The lessons address state standards and cover 20 prefixes and suffixes. Thirty-nine schools participated in the study, with 92 English language arts (ELA) teachers in high-poverty schools randomly assigned within schools either to use WKI or to continue to use their standard ELA curriculum. Classroom observations revealed that WKI was implemented as intended. WKI had a positive effect, equivalent to an increase of 9 percentile points, on students' ability to correctly extract and spell a base word from a derived word, one of the skills explicitly taught by WKI. WKI had no effect on two other related reading skills that were not directly taught by WKI (students' ability to select a nonword that best fits the grammatical context of a sentence or to use knowledge of word parts to infer meaning of new words) or on students' vocabulary or reading scores. These findings suggest that, although students learned what they were explicitly taught, the transferability to related but not directly taught skills might require more intense or longer duration instruction or additional professional development for teachers. [For the study snapshot, see ED611684. For the appendix, see ED611685.]

"G[superscript 2]ROW STEM" is an Investing in Innovation (i3) development grant funded by the Office of Innovation and Improvement, U.S. Department of Education. "G[superscript 2]ROW STEM" targets high-need middle school students, particularly females and minorities, that tend to be underrepresented in STEM careers. "G[superscript 2]ROW STEM" focuses on providing students with engaging, hands-on, project-based, extended-learning experiences to inspire interest in STEM and improve achievement. The impact evaluation used a quasi-experimental design (QED) to examine the effect of "G[superscript 2]ROW STEM" on academic achievement in science and math. "G[superscript 2]ROW STEM" student enrollment began during the 2016-17 school year and students were followed for three years, through the 2018-19 school year. Academic achievement outcomes for "G[superscript 2]ROW STEM" students were compared to a matched sample of students within the same grade in the same schools who participated in business-as-usual, traditional academic instruction with no extended learning experiences. Academic achievement for comparison students was also tracked over a three-year period. Results showed statistically significant differences between treatment and comparison groups in achievement test scores across both math and science. Overall, treatment students gained seven NCE score points more than the comparison group students did after up to three years in the "G[superscript 2]ROW STEM" program. This is roughly equivalent to one-third of a standard deviation. Significant differences were also noted for student subgroups with non-minority students realizing slightly higher gains in NCE scores than minority students by the end of the program (over all analyses a difference of 2.25 NCE points).

In 2015 Oregon became the second state in the country to implement a statewide promise program. Its program, Oregon Promise, seeks to promote students' postsecondary attainment by covering nearly all community college tuition. This study used student data from K-12 public schools, Oregon Promise applications, and postsecondary records to examine which public high school seniors the program reached and served and to assess the program's impact on high school graduates' postsecondary outcomes in its first two years. The study found that Oregon Promise applicants generally reflected the demographic composition of all Oregon public high school seniors in 2015/16 and 2016/17, although applicants were more likely to be female and less likely to have received special education services. While applicant characteristics were similar in the first and second years, there were fewer eligible applicants and recipients in the second year, when an expected family contribution limit was added, than in the first year, and they were more likely to be from low-income households and to be students of color. Using grade point average (GPA) data from the Portland metropolitan area, the study also found that lowering the GPA requirement would have increased the overall applicant pool, as well as the number of applicants from low-income households and applicants of color. Just over half of recipients in the first year of the program renewed their award and received it in their second year at a community college. These recipients had better high school attendance and were more likely to have participated in college-level coursework during high school than recipients who received an award only in their first year. Finally, among high school graduates in the Portland metropolitan area with a GPA close to the eligibility cutoff (2.5), the offer of an award had a positive impact on first-year persistence and on persistence or college completion within four years of high school graduation. Findings from the statewide exploratory analysis also found positive program impacts on first-year persistence and persistence or college completion within three or four years of high school graduation for all 2015/16 and 2016/17 seniors in the state. Oregon stakeholders can use the findings to better understand the reach and impact of the Oregon Promise program, implications of program requirements on the number and composition of applicants and recipients, and the high school experiences of recipients who renewed their award. [For the Study Snapshot, see ED615646. For the appendixes, see ED615648.]

In 2013, the NYC Leadership Academy (NYCLA) developed a leadership intervention--the Targeted Intensive School Support (TISS) program--in collaboration with the New York City Department of Education (NYC DOE) to support schools that were facing particular challenges. NYCLA asked the RAND Corporation to provide an independent evaluation of the program's implementation and effects, and those findings are detailed in this report. The TISS program consisted of five key components: (1) teaming and collaborative training in aligned preservice preparation programs for a principal and assistant principal (AP); (2) coplacement of a principal and AP into an NYC DOE school; (3) team-based coaching to support the principal and AP; (4) 328 hours of extended coaching over the first three years after placement; and (5) use of a diagnostic process to guide goal setting and coaching according to school needs. Implementation findings suggest that only two of the five key components were implemented with fidelity. A propensity weighting approach was used to compare schools with TISS principals to other schools with new principals trained through residency-based preservice programs who did not participate in TISS. Findings suggest no statistically significant differences between TISS schools and comparison schools on measures of student achievement, school culture, and principal retention. TISS schools underperformed relative to comparison schools on the measure of chronic student absenteeism. [Sponsored by NYC Leadership Academy through a subgrant from the U.S. Department of Education.]

With the launch of the New York City Community Schools Initiative (NYC-CS) in 2014, the New York City Department of Education (NYCDOE) has increased its focus on the implementation of a holistic strategy of education reform to address the social consequences of poverty as a means to improving student outcomes. NYC-CS is a strategy to organize resources in schools and share leadership among stakeholders so that academics, health and wellness, youth development, and family engagement are integrated into the fabric of each school. New York City is implementing this strategy at a scale unmatched nationally. In this study, the authors assessed the impact of the NYC-CS through the 2017-2018 school year. The authors assessed the effects along seven outcome domains and explored the extent to which there is heterogeneity in programmatic impact based on student- and school-level characteristics. The authors leveraged innovative quasi-experimental methodology to determine whether students in the community schools are performing better than they would be had their schools not been designated as Community Schools. The findings of this report will contribute to the emerging evidence base on the efficacy of the community school strategy and will be useful for other school district- and state-level policymakers interested in developing or refining similar interventions that support students' and communities' academic, social, and emotional well-being. [The research described in this report was prepared for the New York City Mayor's Office for Economic Opportunity (NYC Opportunity).]

The term dual, or concurrent, enrollment refers to the broad array of programs available to high school students that allow them to take college-level courses for credit. Dual enrollment creates multiple pathways to college by enabling high school students to take: (1) selected academic courses on college campuses; (2) college-led academic courses at their high school; or, (3) a hybrid of both. In addition, some dual enrollment programs permit students to take post-secondary level career and technical education courses. This study shows Concurrent Enrollment to be highly effective in increasing college graduation for high school students in Colorado. The sample included students across different demographics and academic abilities. Compared to students who did not take college courses while in high school, students who took Concurrent Enrollment courses were more likely to: (1) Attend college within one year following high school graduation, (2) Earn a college degree on time or early, and (3) Have higher workforce earnings after five years. [The Institute of Behavioral Science (IBS) at the University of Colorado Boulder also produced this report.]

The purpose of this study is to evaluate the Advancement Via Individual Determination (AVID) program and to derive estimates of program costs. We used the Coarsened Exact Matching approach to match AVID students with non-AVID students on 40 baseline characteristics. After matching, we estimated group differences in high-school graduation and college enrollment. We used the ingredients method to estimate program costs and calculated cost-effectiveness ratios by the duration of participation. Findings indicate that students who complete at least one AVID elective have higher high school graduation and college enrollment rates than comparable non-AVID students. We discuss how AVID compares to other college outreach programs in terms of costs and effects.

Purpose: The purpose of this two-year study was to assess the impact of the CORE program, a model that integrates technology and active learning modules in high schools by providing multi-disciplinary teams of teachers and administrators with professional development and resources to support the development of students' non-cognitive skills and increase their college and career readiness. A fidelity of implementation study was also conducted to assess the seven key program components were being implemented as intended. Methods: This Randomized Control Trial (RCT) study followed a cohort of 9th and 10th grade high school students in 28 treatment and control schools; students completed the CWRA+ assessment and non-cognitive skills, engagement, and self-efficacy scales at three timepoints. Using the hierarchical linear model (HLM), the study assessed one-year program impact and two-year program impact. The two-year program impact model suffered a high attrition (due to COVID19) and the study became a quasi-experimental design (QED) study after propensity score matching analysis was applied. Results: Findings highlight how students at CORE schools showed increased scores across the two-year program intervention. Specifically, standardized effects on CWRA+ scores, the non-cognitive skills scale, engagement scale, and efficacy scale were respectively, 0.22, 0.22, 0.23, and 0.32. The effect size for the efficacy scale (0.32) was large enough to be considered important. To selectively mention exploratory findings, the level of program exposure both in terms of whether students were enrolled in the program-trained teachers' courses and whether teachers participated in PD activities seemed correlated with a higher growth in student's CWRA+ scores. Another set of exploratory findings implied that the program impact may interact with demographic characteristics of students. Findings demonstrate a need for further testing of differences between student subgroups based on demographics, as well as the importance of buy-in from program implementers to provide the customized PD support that educators and partners at rural schools need to more effectively serve their students. The exploratory findings suggested that the program exposure of teachers and students may be a key to enhance the CORE program impact. [This report was submitted by the ICF Evaluation Team.]

The purpose of this study was to determine the effectiveness of Get the Picture?! in improving the overall college/career readiness of 900 students with disabilities in each of the nine participating treatment high schools in nine rural, high poverty Kentucky school districts after four years of implementation. This quasi-experimental study followed the 9th grade cohort of students with disabilities in the nine treatment and 18 matched control schools over four school years, 2015-16 through 2018-19. Through the development of self-determination skills, the goal of the intervention was to increase the number of students with disabilities who achieved the state standard for College and/or Career Readiness by meeting established benchmarks on State/National assessments and/or completion of a recognized industry certification in each of the nine participating schools. For the confirmatory analyses, there were two outcome variables in two different outcome domains: (a) Transition Ready, a binary "Yes"/"No" variable [Transition Readiness domain], and (b) the cumulative number of in-school suspensions (a continuous variable) [Self-management behaviors domain]. For the confirmatory analyses, outcome data were examined using two-level Hierarchical Linear Models (HLM) (for Cumulative In-School Suspensions) and Hierarchical Generalized Linear Models (HGLM) (for Transition Ready) to account for the nested structure of the data (i.e., students nested within schools). Overall, after four years of implementation, Get the Picture?! was able to demonstrate a statistically significant positive impact on the Transition Readiness of participating 9th grade cohort students compared to controls. Treatment students had statistically significantly higher odds of being Transition Ready, and were more than twice as likely to achieve Transition Readiness status compared to control students. However, while the confirmatory study showed the intervention was also able to reduce the total number of in-school suspensions for treatment students relative to controls, the outcome was indeterminate (i.e., not statistically significant). The following are appended: (a) Kentucky Department of Education Revised Transition Readiness Standards, and (b) Fidelity of Implementation Final Report.

The STEM Early College Expansion Project is an effort to integrate STEM strategies with the early college model and implement this in comprehensive high schools. This report summarizes findings from two separate quasi-experimental impact studies of the model in Michigan and Connecticut. Results from Michigan showed statistically significant impacts on enrollment in college-level courses and on attainment of college credits. Treatment schools in Michigan also had descriptively lower dropout rates. The Connecticut impact study had challenges with the study design that resulted in an inability to make clear causal claims about the impact.

To support implementation of the "Next Generation Science Standards," we designed a high school biology unit, "Matter and Energy for Growth and Activity" (MEGA), that engages students in explaining physical and life science phenomena using evidence, models, and science ideas about matter and energy changes within systems and transfers between systems. The unit's promise was evaluated using a randomized control trial (RCT) involving fifteen teachers from two schools. Teachers were randomly assigned to implement either the MEGA unit or district-developed activities that targeted the same learning goals. Pre- and post-tests were administered, and the data were analyzed using Rasch modeling and hierarchical linear modeling. Here we describe the unit and report on RCT results. Our data showed that, when controlling for pretest score, gender, language, and ethnicity, students in the treatment group performed better on the post-test than the students in the comparison group, indicating the MEGA unit has promise in improving students' understanding. We also discuss a number of challenges that arose when developing and evaluating the unit.

The three-tiered Positive Behavioral Interventions and Supports (PBIS) framework promotes the development of systems and data analysis to guide the selection and implementation of evidence-based practices across multiple tiers. The current study examined the effects of universal (tier 1) or school-wide PBIS (SW-PBIS) in one state's scale-up of this tier of the framework. Annual propensity score weights were generated to examine the longitudinal effects of SW-PBIS from 2006-07 through 2011-12. School-level archival and administrative data outcomes were examined using panel models with an autoregressive structure. The sample included 1,316 elementary, middle, and high schools. Elementary schools trained in SW-PBIS demonstrated statistically significantly lower suspensions during the fourth and fifth study years (i.e., small effect size) and higher reading and math proficiency rates during the first two study years as well as in one and two later years (i.e., small to large effect sizes), respectively. Secondary schools implementing SW-PBIS had statistically significantly lower suspensions and truancy rates during the second study year and higher reading and math proficiency rates during the second and third study years. These findings demonstrate medium effect sizes for all outcomes except suspensions. Given the widespread use of SW-PBIS across nearly 26,000 schools in the U.S., this study has important implications for educational practices and policies. [This paper was published in the "Journal of School Psychology" v73 p41-55 Apr 2019 (ISSN 0022-4405).]

A growing body of research points to the ways in which principals influence teachers, classrooms, and, ultimately, student achievement. New Leaders aims to prepare transformational school leaders by partnering with districts and charter schools to offer rigorous, research-based training for aspiring principals. The Aspiring Principals program is New Leaders' signature program and has three core features: selective recruitment and admission, training and endorsement, and support for principals early in their tenure. This report is a follow-up to the 2014 evaluation of New Leaders' Aspiring Principals program. Focusing on the revised program, which was first implemented in 2012, the authors present evidence of the effectiveness of the revised Aspiring Principals program and share lessons that can inform principal-preparation policy and practice. To assess the effect of New Leaders' Aspiring Principals program, researchers analyzed whether schools and students led by graduates of the program outperformed comparison schools and students in the same district, focusing on student achievement and principal retention. They also examined program graduate placement and satisfaction with the Aspiring Principals program. [For the appendixes, see ED605724.]

The UPSTART Summer program is a federally funded i3 validation project that uses a computer-based program to maintain and develop the literacy skills of elementary school students in rural Utah during the summer months when school is out of session. Researchers used a quasi-experimental design to evaluate the impact of the program in forestalling literacy learning loss during several summer periods. Students in the treatment group participated in the UPSTART Summer program, in the summer periods after kindergarten, first grade, and/or second grade. A second group of children, who were not enrolled in the program served as a comparison. Statistical matching procedures were used to create separate treatment and comparison analytic samples for each outcome measure that were equivalent on baseline scores and demographic variables (e.g., school, gender, race, language learner status, household income, Title 1 school enrollment, etc.). Standardized literacy assessments of letter knowledge, phonics, and reading fluency were administered prior to program commencement at the end of the academic school year and upon program completion at the beginning of the following school year. Results revealed that the UPSTART Summer program had a significant impact in reducing literacy learning loss in rising first graders on assessments of letter naming fluency, nonsense word fluency (correct letter sounds), and a reading composite score when compared to a matched comparison group. There were no differences in learning loss rates between rising first graders and comparison students on assessments measuring phoneme segmentation fluency or nonsense word reading (whole words read). Additionally, the UPSTART Summer program did not have an impact on literacy learning loss prevention in rising second or third grade students as measured by assessments of nonsense word reading, oral reading fluency, or overall reading composites. Taken together these results suggest that the UPSTART program helps to maintain early literacy skills in the summer months between Kindergarten and first grade.

Seventh- and 8th-grade students in a within-teacher randomized control study read from visual-syntactic formatted text for 44 min per week over the course of 1 year. On the annual state assessment, we found small statistically significant improvements on the overall English Language Arts scaled score (ES = 0.05, p < .05) and the writing assessment (ES = 0.07, p < .01) for the treatment group compared to the control group. We found no interactions between gifted, special education, or English learner classification and treatment status on the effect on overall English Language Arts score, but our categorical and subgroup analyses showed that the use of visual-syntactic text formatting provided a modest benefit to middle school students who were near or at grade level in the prior school year.

Access to middle class jobs increasingly requires a college degree or credential. Individuals with postsecondary education have competitive advantage in the labor market: even when a job does not explicitly require a degree, a candidate with a degree will tend to be hired over an equally qualified candidate without one. Low-income students, in particular, along with first-generation students and racial/ethnic minorities, are underrepresented in postsecondary education Massachusetts is faced with an aging workforce where nearly half of the labor market is 45 or older. In Boston, the six-year college graduation rate for the city's 2011 public high school graduates who enrolled in college was 52 percent. This rate improves upon the 39 percent seven-year rate for 2000 graduates, yet likely is not sufficient to meet the predicted demand for a college-educated workforce. One-on-one coaching from experienced counselors when students are completing their senior year in high school and beginning college can help them succeed. A core strategy of the city-wide "Success Boston" initiative is one-on-one transition coaching. The coaching model is implemented across a network of nonprofit organizations (that provide coaching) in partnership with institutions of higher education. Transition coaching offers students sustained, proactive, and responsive support in their first two years after high school. This report refers to the transition coaching program as Success Boston Coaching (SBC). The report is designed to answer four main research questions about implementation and impact: (1) What is the effect of SBC on student success in college?; (2) How, if at all, do the impacts of SBC vary by student characteristics and features of the coaching?; (3) How is SBC implemented across partner organizations and partner colleges? and (4) What resources are necessary to implement SBC? This report focuses on the effectiveness of coaching on students' persistence and achievement early in college, answering the first and second research questions. [For the previous report, "Success Boston: Coaching for Completion. 2015-16 Implementation Report," see ED582088. For the companion report, "The Story of Scaling Up: Highlights from the Interim Report on the Impact of Success Boston's Coaching for Completion," see ED602749.]

This study evaluated the efficacy of the Word Learning Strategies (WLS) supplementary program to improve elementary students' vocabulary skills and reading comprehension. The study used a multi-site cluster randomized, experimental design, which randomly assigned 92 4th grade classrooms (n=2558 students) from two cohorts to a treatment or control group. Results indicated that the program was positively associated with gains in students' vocabulary learning and knowledge as measured by the Word Learning Strategies Test and the VASE Assessment, and in students' reading comprehension as measured by the Gates-MacGrinitie Reading Test, after accounting for differences in baseline measures. The use of the WLS program also led to increases in teachers' awareness of strategies to support their students' vocabulary and reading comprehension. [This paper was published in the Proceedings of the 2019 Annual Meeting of the American Educational Research Association (AERA), Toronto, Canada.]

More than half of community college students fail to meet college-readiness standards in math. Developmental education (dev-ed) aims to help students acquire the knowledge and skills to succeed in college-level math but is plagued with low rates of advancement. We examined the impact of a model that accelerates developmental math coursework so that students can complete dev-ed and college math courses in their programs of study within 1 year. Using data from Texas and a propensity score matching approach, we tested the impact of the model on several college milestones. Results suggest that students in the accelerated model were more likely to persist and accumulate college-level credits during the 1st year than those in traditional dev-ed math. After 3 years, there was a strong positive relationship between participation in the accelerated model and important college milestones, like college math course completion and total accumulated college-level credits.

To improve outcomes in math, many Texas colleges are adopting mathematics pathways, which accelerate developmental math and tailor math courses to different majors instead of requiring all students to take algebra. This study examines whether students participating in Dana Center Mathematics Pathways (DCMP) developmental courses enroll in and pass college-level math courses at higher rates than students who take traditional developmental math courses. It employs regression analysis controlling for student characteristics using student-level data compiled by the state from the more than 20 Texas community colleges that implemented the DCMP model in 2015 and 2016. Results from this study are encouraging. They suggest that DCMP compressed prerequisite developmental courses are effective at accelerating community college students through their math requirements. Yet this study also found systematic sorting of students into DCMP by race/ethnicity, which could exacerbate educational inequalities. Key findings include: (1) DCMP students were about 13 percentage points more likely to enroll in college-level math in the next semester and 8 percentage points more likely to pass college-level math in that term than peers in non-DCMP developmental courses; (2) The advantaged gained by DCMP students was maintained over time--there was still a 5-percentage-point improvement in passing college-level math two years later among students in the fall 2015 cohort; and (3) Compared with non-DCMP courses, DCMP courses included more White students and fewer Hispanic students than would be expected based on the distribution of students at the colleges. This indicates inequality in subgroup access to reformed developmental math pathways.

Research for Action's Year Two evaluation report indicates that most lead teachers demonstrated high fidelity to the key elements of the Blueprint approach in the classroom, though some teachers experienced issues related to differentiating instruction and the simultaneous implementation of Blueprint and Creative Curriculum. The authors found strong evidence of impact on teachers and students: multiple data sources demonstrated that teachers and children in Blueprint centers benefitted from the Blueprint curriculum and professional development. Children in Children's Literacy Initiative (CLI)-served classrooms made 2-3 months of additional progress in vocabulary development compared to children in similar classrooms not supported by CLI. Though less than a quarter of lead teachers in Blueprint classrooms in Spring 2018 received intended amount of training and coaching due to high turnover and variable attendance, most teachers had at least attended the Introduction to Blueprint 3.0 training and received at least one full year's worth of coaching (over 20 hours). This report is comprised of two studies that provide in-depth findings of Year Two Blueprint implementation (resources and activities) and impacts (teacher and student outcomes). Study 1: Blueprint Implementation is a descriptive study of the quality of implementation of Blueprint in 11 Philadelphia pre-K centers. This study also followed up on findings from Year One, including an in-depth exploration of challenges to implementation-- consistent attendance at trainings, finding time for coaching conferences, and coaching amidst high teacher turnover--and CLI strategies to address them. Study 2: Impact of Blueprint on Teachers and Students is a study that employed a mixed-methods quasi-experimental research design, involving 11 centers receiving Blueprint professional development and curriculum and 11 centers serving as a comparison group. [Additional funding for this report was provided by The 25th Century Foundation, The Caroline Alexander Buck Foundation, and The Capital Group Companies.]

The English Language and Literacy Acquisition--Validation (ELLA-V) study was a five-year evaluation of a program that provided professional development, coaching, and curricula that targeted English-as-a-second-language (ESL) instruction for teachers of K-3 English learners (ELs). ELLA-V was implemented in 10 school districts in Texas in the 2013-14 through 2016-17 school years. The project was federally funded by a grant from the U.S. Department of Education's Investing in Innovation (i3) Fund (PR/Award Number U411B120047). Professors at Texas A&M University were the recipients of the grant and developed the professional development, the coaching program, and the curricula. Researchers at the Center for Research and Reform in Education (CRRE) at Johns Hopkins University were contracted to conduct the independent evaluation. The evaluation of ELLA-V was a multi-site cluster randomized trial designed to meet the What Works Clearinghouse (WWC) standards for rigorous education research (WWC, 2017). The study used a mixed method design to estimate program impacts on student and teacher outcomes and document the fidelity of implementation and perceived quality of the program. [This report was published at the Center for Research and Reform in Education (ED594703). Principal Investigators were Rafael Lara-Alecio, Beverly Irby, and Fuhui Tong. Cindy Guerrero and Laura Cajiao-Wingenbach were Lead Coordinators.]

The 3-year Pennsylvania Dyslexia Screening and Early Literacy Intervention Pilot Program (Pilot) began in 2015-16 (Year 1) with the kindergarten class of 2015-16 (Cohort 1). In 2016-17 (Year 2), the Pilot was implemented with Cohort 1 students, now in first grade, and a second cohort of kindergarteners (Cohort 2). A third cohort will be added in 2017-18. The Pilot provides two levels of support: (1) a classroom program, which supplements core instruction for all students, with an increased focus on phonemic awareness and multisensory structured language (MSL), and (2) an MSL intervention to provide extra instruction for students identified as needing more support based on early literacy screening in the winter of kindergarten. Both levels of support are meant to affect special education referrals and students' literacy skills, measured by the Dynamic Indicators of Basic Early Literacy Skills (DIBELS) Next benchmark assessments (only DIBELS data are available at this time). This report presents key findings from Year 2. The effectiveness of the classroom program was evaluated using a school-level matched design, in which the performance of students in the 21 Pilot schools was compared with the performance of students in 21 matched comparison (Comparison) schools identified through Mahalanobis distance matching. These analyses suggest that both Pilot cohorts (21 schools) outperformed the Comparison sample on some spring 2017 (Year 2) measures (nonsense word fluency for both cohorts and letter naming fluency for Cohort 2). This may be because of improved implementation in Year 2, and is particularly encouraging given the Comparison sample's participation in another literacy initiative, which may result in an underestimation of Pilot program effects compared with typical schools (which may not use universal screening to inform core instruction and identify students to receive supplemental intervention). The effectiveness of the MSL intervention was assessed using a regression discontinuity (RD) design, in which Pilot students eligible for the intervention were compared with similarly performing students in the same schools who were not eligible for the intervention. Although these analyses yielded no positive effects, exploratory analyses suggest that the intervention may have contributed to improved performance for Cohort 1 Pilot intervention students compared to similar Comparison students. Exploratory analyses also found an association between intervention hours and outcomes, suggesting increased dosage might yield stronger intervention effects (most schools did not meet target hours). These findings suggest that the combination of enhanced core instruction and supplemental MSL intervention improve some student outcomes in school settings, warranting further study. The Pilot's final evaluation report will cover the third year of Pilot implementation, allowing comparisons across three cohorts and expanding the Pilot to second grade (Cohort 1), and consider other variables such as special education status. This report includes numerous exhibits to explain implementation, samples, and findings, and includes the following appendices: (1) Study Design; (2) Matching to Establish Comparison Sample; (3) Supplementary Implementation Information; (4) Comparisons of Analysis Samples; (5) Sample Parent Notification and Opt-Out Template Provided by PDE to Pilot Districts; (6) Technical Information.

Across the country, school districts, their stakeholders, and policymakers have become increasingly concerned about suspensions, particularly about suspending students from elementary school and disproportionately suspending ethnic/racial minority students. Suspended students are less likely to graduate, possibly because they miss the instructional time they need to advance academically. Restorative practices have gained buy-in in the education community as a strategy to reduce suspension rates. Proactively improving relationships among students and staff and building a sense of community in classrooms and schools may make students less inclined to misbehave. And addressing severe misbehavior through a restorative approach may help students realize the impacts of their actions and make them less likely to offend again. This study of the implementation of restorative practices in the Pittsburgh Public Schools district (PPS) in school years 2015-16 and 2016-17 represents one of the first randomized controlled trials of the effects of restorative practices on classroom and school climates and suspension rates. The authors examined a specific restorative practices program -- the International Institute for Restorative Practices' SaferSanerSchools™ Whole-School Change program -- implemented in a selected group of PPS schools under a program called Pursuing Equitable and Restorative Communities, or PERC. The researchers found that PERC achieved several positive effects, including an improvement in overall school climates (as rated by teachers), a reduction in overall suspension rates, and a reduction in the disparities in suspension rates between African American and white students and between low- and higher-income students. Key Findings: Effects of the Pursuing Equitable and Restorative Communities (PERC) program in Pittsburgh Public Schools: (1) Implementation of restorative practices through PERC improved overall school climates, as rated by teachers; (2) Implementation of restorative practices reduced the average suspension rate: During the study period, average suspension rates decreased in both PERC and non-PERC schools, but rates decreased more in PERC schools; (3) Suspension rates of African American students and of those from low-income families also went down in PERC schools, shrinking the disparities in suspension rates between African American and white students and between low- and higher-income students; (4) Academic outcomes did not improve in PERC schools, and actually worsened for grades 6-8; and (5) Arrest rates among PERC schools did not decrease. Recommendations: (1) Given the constraints on teachers' time, emphasize restorative practices that can be woven into the school day; (2) Ensure that school leaders understand and can model restorative practices, including by providing mandatory professional development, books and other materials, and coaching on restorative practices; (3) Establish a mechanism for school staff to meet at least once per month as a professional learning community on restorative practices; (4) Ensure that leaders at the district level can coordinate this work; (5) Set, and update, clear expectations regarding the use of restorative practices; and (6) Implement data collection systems to collect accurate information on all types of behavioral incidents and remedies.

"Driven by a series of natural and man-made disasters that took place in the northeast in 2012 and early 2013, including the shooting at Sandy Hook Elementary School, the Boston Marathon bombings, and Hurricane Sandy, seven community colleges in Connecticut, Massachusetts, New Jersey, and New York formed the Northeast Resiliency Consortium (NRC) to address the acute need for resilience in their communities, and were awarded a Round III TAACCCT grant from the U.S. Department of Labor. The NRC sought to take strategic action to build a highly skilled and qualified workforce to help mitigate their communities’ short- and long-term vulnerabilities and risks, and build resilient workers, institutions, and communities. The NRC used this grant to expand and enhance its programs to close the skills gap in healthcare, information technology, hospitality, and environmental science. Through these training programs, the NRC would cultivate resiliency for participants to rapidly and effectively adapt and respond to internal or external opportunities, disruptions, or threats. Resiliency also refers to helping workers and employers develop advanced skills that facilitate adaptation to global competition, evolving technologies, and workforce demands. The NRC prioritized efforts focused on credential completion and employment in sectors that are critical to the functioning of communities, including in healthcare, where remaining adept at responding to emergencies and crises is critical for survival; information technology, where data networks must remain functional during catastrophes; and environmental technologies, where resilient infrastructures can help states and communities prevent and recover from disasters. In total, NRC colleges offered 84 programs of study to participants, with 44 continuing education programs and 40 credit programs. The NRC aimed to serve more than 3,462 unique participants during the three-year period of the grant. Preliminary performance numbers indicate the consortium surpassed its original goal by 15% – serving 3,987 unique participants. This final evaluation report documents findings from the impact and implementation studies, with an emphasis on the consortium’s approach to creating pathways from continuing education to credit programs, and colleges’ provision of comprehensive career, personal, and academic support services to participants."

Although several studies have documented the effects of statewide private school choice programs on student test scores, this report is the first to examine the effects of one of these programs on college enrollment and graduation. Using data from the Florida Tax Credit (FTC) Scholarship program, we find that low-income Florida students who attended private schools using an FTC scholarship enrolled in and graduated from Florida colleges at a higher rate than their public school counterparts. [Additional support for this study was provided by the Bill and Susan Oberndorf Foundation and Kate and Bill Duhamel.]

Playground Physics is a technology-based application and accompanying curriculum designed by New York Hall of Science (NYSCI) to support middle school students' science engagement and learning of force, energy, and motion. The program includes professional development, the Playground Physics app, and a curriculum aligned with New York State Learning Standards, Common Core State Standards, and Next Generation Science Standards. The iOS app allows students to record and review videos through three "lenses": (1) motion; (2) force (Newton's third law); and (3) energy, and the curriculum integrates informal and formal, inquiry-based learning strategies to promote greater student knowledge and understanding of physics. The program was designed to be implemented in a formal school setting during the regular school day. This report describes the results of an experimental study of the Playground Physics program's impact on learning of physics concepts, student engagement, and science-related attitudes. Sixty New York City middle grade teachers were randomly assigned to treatment or control conditions. Treatment teachers were asked to participate in Playground Physics professional development and use Playground Physics as part of their physics instruction during the 2015-16 academic year; control teachers were asked to use their regular instruction. In total, 15 teachers left the study. The final sample included student data from 24 treatment teachers and 21 control teachers. The following are appended: (1) Playground Physics Curriculum Activities; (2) Student Outcome Measures; (3) Teacher Survey; (4) Impact Analysis Technical Approach; (5) Output from Statistical Models; (6) Knowledge Assessment Responses and Standards Alignment; (7) 2014-15 Fidelity of Implementation Analysis; and (8) Supplemental Analysis.

Supporting the reading comprehension and content knowledge acquisition of English language learners (ELs) requires instructional practices that continue beyond developing the foundational skills of reading. In particular, the challenges ELs face highlight the importance of teaching reading comprehension practices in the middle grades through content acquisition. We conducted a randomized control trial to examine the efficacy of a content acquisition and reading comprehension intervention implemented in eighth-grade social studies classrooms with English language learners. Using a within-teacher design, in which 18 eighth-grade teachers' social studies classes were randomly assigned to treatment or comparison conditions. Teachers taught the same instructional content to treatment and comparison classes, but the treatment classes used instructional practices that included comprehension canopy, essential words, knowledge acquisition, and team-based learning. Students in the treatment group (n = 845) outperformed students in the comparison group (n = 784) on measures of content knowledge acquisition and content reading comprehension but not general reading comprehension. Both ELs and non-ELs who received the treatment outperformed those assigned to the BAU comparison condition on measures of content knowledge acquisition (ES = 0.40) and content-related reading comprehension (ES = 0.20). In addition, the proportion of English language learners in classes moderated outcomes for content knowledge acquisition.

Reading comprehension in the content areas is a challenge for many middle grade students. Text structure-based instruction has yielded positive outcomes in reading comprehension at all grade levels in small and large studies. The text structure strategy delivered via the web, called Intelligent Tutoring System for the Text Structure Strategy (ITSS), has proven successful in large-scale studies at 4th and 5th grades and a smaller study at 7th grade. Text structure-based instruction focuses on selection and encoding of strategic memory. This strategic memory proves to be an effective springboard for many comprehension-based activities such as summarizing, inferring, elaborating, and applying. This was the first large-scale randomized controlled efficacy study on the web-based delivery of the text structure strategy to 7th-grade students. 108 classrooms from rural and suburban schools were randomly assigned to ITSS or control and pretests and posttests were administered at the beginning and end of the school year. Multilevel data analyses were conducted on standardized and researcher designed measures of reading comprehension. Results showed that ITSS classrooms outperformed the control classrooms on all measures with the highest effects reported for number of ideas included in the main idea. Results have practical implications for classroom practices.

This article presents the findings of an evaluation of the eMINTS (enhancing Missouri's Instructional Networked Teaching Strategies) professional development program. eMINTS is an intensive teacher professional development program designed to promote inquiry-based learning, support high-quality lesson design, build community among students and teachers, and create technology-rich learning environments. This evaluation included 60 high-poverty rural schools across Missouri that were randomly assigned to two treatment conditions and a control condition, with approximately 200 teachers and 3,000 students in the 2011-2012 baseline academic year. The researchers conclude that after 3 years, the eMINTS treatment group and an eMINTS treatment group with an additional year of Intel support resulted in changed teacher instructional behaviors and increased student achievement in mathematics.

An extensive theoretical and qualitative literature stresses the promise of instructional practices and content aligned with the cultural experiences of minority students. Ethnic studies courses provide a growing but controversial example of such "culturally relevant pedagogy." However, the empirical evidence on the effectiveness of these courses is limited. In this study, we estimate the causal effects of an ethnic studies curriculum piloted in several San Francisco high schools. We rely on a "fuzzy" regression discontinuity design based on the fact that several schools assigned students with eighth-grade GPAs below a threshold to take the course in ninth grade. Our results indicate that assignment to this course increased ninth-grade student attendance by 21 percentage points, GPA by 1.4 grade points, and credits earned by 23. These surprisingly large effects are consistent with the hypothesis that the course reduced dropout rates and suggest that culturally relevant teaching, when implemented in a supportive, high-fidelity context, can provide effective support to at-risk students.

Since their inception in 1992, the number of charter schools has grown to more than 6,800 nationally, serving nearly three million students. Various studies have examined charter schools' impacts on test scores, and a few have begun to examine longer-term outcomes including graduation and college attendance. This paper is the first to estimate charter schools' effects on earnings in adulthood, alongside effects on educational attainment. Using data from Florida, we first confirm previous research (Booker et al., 2011) that students attending charter high schools are more likely to graduate from high school and enroll in college. We then examine two longer-term outcomes not previously studied in research on charter schools--college persistence and earnings. We find that students attending charter high schools are more likely to persist in college, and that in their mid-20s they experience higher earnings.

Behavioral trajectories during middle childhood are predictive of consequential outcomes later in life (e.g., substance abuse, violence). Social and emotional learning (SEL) programs are designed to promote trajectories that reflect both growth in positive behaviors and inhibited development of negative behaviors. The current study used growth mixture models to examine effects of the "Positive Action" program (PA) on behavioral trajectories of social-emotional and character development (SECD) and misconduct using data from a cluster-randomized trial that involved 14 schools and a sample of predominately low-income, urban youth followed from 3rd through 8th grade. For SECD, findings indicated that PA was similarly effective at improving trajectories within latent classes characterized as "High/declining" and "Low/stable". Favorable program effects were likewise evident to a comparable degree for misconduct across observed latent classes that reflected "Low/rising" and "High/rising" trajectories. These findings suggest that PA and perhaps other school-based universal SEL programs have the potential to yield comparable benefits across subgroups of youth with differing trajectories of positive and negative behaviors, making them promising strategies for achieving the intended goal of school-wide improvements in student outcomes. [This paper was published in "Prevention Science" v18 p214-224 2017.]

We study the effectiveness of teachers certified by the National Board for Professional Teaching Standards (NBPTS) in Washington State, which has one of the largest populations of National Board-Certified Teachers (NBCTs) in the nation. Based on value-added models in math and reading, we find that NBPTS-certified teachers are about 0.01-0.05 student standard deviations more effective than non-NBCTS with similar levels of experience. Certification effects vary by subject, grade level, and certification type, with greater effects for middle school math certificates. We find mixed evidence that teachers who pass the assessment are more effective than those who fail, but that the underlying NBPTS assessment score predicts student achievement.

In Fall 2010, the Niswonger Foundation received a five-year validation grant from the Investing in Innovation Fund (i3) to create the Northeast Tennessee College and Career Ready Consortium of 29 high schools and five colleges. This report evaluates the Consortium's impact on student outcomes during each of the four years of program implementation. The findings from the confirmatory impact analyses indicate that students in Consortium schools had higher ACT scores, were more likely to participate in Advanced Placement (AP) courses, score a 3 or higher on an AP exam, enroll in college, and persist in college than students in matched comparison schools. Also, about half of all program components scored 2.0 or higher on a 3-point scale, indicating moderate fidelity of implementation. This report contains the results submitted to the National Evaluation of i3 (NEi3), which determines the overall impact of the federal investment in the i3 program. Appended to the report are: (1) Criteria for the NEi3 Evaluation; (2) Technical Information on Propensity Score Matching and Statistical Models; and (3) Supplemental Tables.

Funded most recently by a Round 2 Trade Adjustment Assistance and Community College and Career Training (TAACCCT) grant from the U.S. Department of Labor (USDOL), the ShaleNET initiative was aimed at expanding the breadth and effectiveness of the training options and career pathways through which individuals could work towards careers in the shale oil and gas industry. A consortium of four educational institutions (referred to as “hubs) located in three states received funding from the Round 2 TAACCCT grant: Pennsylvania College of Technology (PCT) and Westmoreland County Community College (WCCC) in Pennsylvania, Stark State College (Stark State) in Ohio, and Navarro College (Navarro) in Texas (see Exhibit ES-1). PCT was the leader of the consortium during the grant period. Each of these institutions was located in or near three major shale gas and oil production plays: the Marcellus Shale Play (located under parts of Pennsylvania, West Virginia, Ohio, and New York), the Utica Shale Play (located under nearly all of the Marcellus Play, but covering a bit more of Ohio and Pennsylvania), and the Eagle Ford Shale Play (located under a large swathe of southern Texas).

Single Stop U.S.A.'s Community College Initiative was designed to improve the well-being of low-income communities by connecting individuals to public benefits and other institutional and community resources to address nonacademic barriers to college completion. Through offices located on community college campuses, Single Stop provides students with a range of free services, including screenings and applications for public benefit programs; tax services, financial counseling, and legal services; and case management with referrals to a wide variety of resources and support programs across the institution and community. This report presents an evaluation of the Single Stop program and its impact on students' postsecondary outcomes. The authors examined the Single Stop program at four community college systems: Bunker Hill Community College, City University of New York, Delgado Community College, and Miami Dade College. The analysis indicates that use of Single Stop was associated with improved postsecondary outcomes. The findings suggest that access to alternative financial resources from government benefit programs alongside a network of institutional and community support programs can offer valuable support to college students.

"Wisconsin’s Making the Future TAACCCT 2 consortium grant brought together 16 technical colleges along with employers and workforce development groups to develop, improve, and expand stacked and latticed pathway programs – often called career pathways – in advanced manufacturing. The focus on stacked and latticed pathways was not new to Wisconsin, but instead emerged from the Regional Industry Skills Education initiative that began in the state in 2007 as part of the Joyce Foundation’s multi-state Shifting Gears initiative. Developing a series of interconnected stacked and latticed pathway credentials was an expectation of the TAACCCT Round 2 grants, as specified in the U.S. Department of Labor Employment and Training Administration’s Solicitation for Grant Applications. As such, consortium colleges created new manufacturing pathways and modified existing pathways to enable participants to earn short-term credentials (less than one year) that stack toward one-year and two-year technical diplomas, and in some instances, Associate’s degrees. Wisconsin’s approach to stacked and latticed pathways consists of embedding short-term certificates or credentials within longer-term “parent” programs. The goal of the Making the Future consortium was to increase the attainment of industry-recognized and industry-valued certifications, certificates, diplomas, and other credentials that better prepare program participants for high-skill, high-wage employment or re-employment in manufacturing careers. Wisconsin’s technical colleges aimed to serve more than 2,657 unique participants during the three-year period of the grant. In fact, preliminary performance numbers indicate the consortium widely surpassed its goal, serving 3,795 unique participants or 143% of the goal."

Replication studies are extremely rare in education. This randomized controlled trial (RCT) is a scale-up replication of Fuchs et al., which in a sample of 139 found a statistically significant positive impact for Number Rockets, a small-group intervention for at-risk first graders that focused on building understanding of number operations. The study was relatively small scale (one site) and highly controlled. This replication was implemented at a much larger scale--in 76 schools in four urban districts; 994 at-risk students participated. Intervention students participated in approximately 30 hours of small-group work in addition to classroom instruction; control students received typical instruction and whatever assistance the teacher would normally provide. Intervention students showed significantly superior performance on a broad measure of mathematics proficiency.

KIPP (Knowledge is Power Program) is a national network of public charter schools whose stated mission is to help underserved students enroll in and graduate from college. Prior studies (see Tuttle et al. 2013) have consistently found that attending a KIPP middle school positively affects student achievement, but few have addressed longer-term outcomes and no rigorous research exists on impacts of KIPP schools at levels other than middle school. In this first high-quality study to rigorously examine the impacts of the network of KIPP public charter schools at all elementary and secondary grade levels, Mathematica found that KIPP schools have positive impacts on student achievement, particularly at the elementary and middle school levels. In addition, the study found positive impacts on student achievement for new entrants to the KIPP network in high school. For students continuing from a KIPP middle school, KIPP high schools' impacts on student achievement are not statistically significant, on average (in comparison to students who did not have the option to attend a KIPP high school and instead attended a mix of other non-KIPP charter, private, and traditional public high schools). Among these continuing students, KIPP high schools have positive impacts on several aspects of college preparation, including more discussions about college, increased likelihood of applying to college, and more advanced coursetaking. This report provides detailed findings and also includes the following appendices: (1) List of KIPP Schools In Network; (2) Detail on Survey Outcomes; (3) Cumulative Middle and High School Results; (4) Detailed Analytic Methods: Elementary School (Lottery-Based Analyses); (5) Detailed Analytic Methods: Middle School (Lottery-Based Analyses); (6) Understanding the Effects of KIPP As It Scales Mathematica Policy Research; (7) Detailed Analytic Methods: Middle School (Matched-Student Analyses); (8) Detailed Analytic Methods: High School (Matched-Student Analyses); (9) Detailed Analytic Methods: High School (Matched-School Analyses); and (10) Detailed Tables For What Works Clearinghouse Review. [For the executive summary, see ED560080; for the focus brief, see ED560043.]

This study presents findings from three cohorts of students--the classes of 2003, 2004, and 2005, in the School District of Philadelphia--that were admitted to the district's career and technical education (CTE) schools through a randomized lottery process. This study takes advantage of this so-called "'natural experiment' to compare high school academic outcomes for" lottery applicants who were admitted with those for students who did not receive an acceptance. Results find that CTE students had significantly better outcomes in terms of graduation rates, credit accumulation, and the successful completion of the college preparatory mathematics sequence algebra 1, algebra 2, and geometry. Results for other outcomes such as the completion of science and foreign language course sequences, overall grade point average, and mathematics and reading comprehension achievement, were inconsistent across cohorts and statistical tests, neither favoring nor against students accepted to CTE schools.

In 2009, Vanderbilt University's Peabody Research Institute, in coordination with the Tennessee Department of Education's Division of Curriculum and Instruction, initiated a rigorous, independent evaluation of the state's Voluntary Prekindergarten program (TN- VPK). TN-VPK is a full-day prekindergarten program for four-year-old children expected to enter kindergarten the following school year. The program in each participating school district must meet standards set by the State Board of Education that require each classroom to have a teacher with a license in early childhood development and education, an adult-student ratio of no less than 1:10, a maximum class size of 20, and an approved age-appropriate curriculum. TN-VPK is an optional program focused on the neediest children in the state. It uses a tiered admission process, with children from low-income families who apply to the program admitted first. Any remaining seats in a given location are then allocated to otherwise at-risk children, including those with disabilities and limited English proficiency. The current report presents findings from this evaluation summarizing the longitudinal effects of TN-VPK on pre-kindergarten through third grade achievement and behavioral outcomes for an Intensive Substudy Sample of 1076 children, of which 773 were randomly assigned to attend TN-VPK classrooms and 303 were not admitted. Both groups have been followed since the beginning of the pre-k year.

The Bill and Melinda Gates Foundation invested in the Literacy Design Collaborative (LDC) as one strategy to support teachers' and students' transition to the Common Core State Standards (CCSS) in English language arts. This report provides an early look at the implementation of LDC in sixth-grade Advanced Reading classes in a large Florida district, and the effectiveness of the intervention in this setting. The study found that teachers understood LDC and implemented it with fidelity and that curriculum modules were well crafted. Teachers also generally reported positive attitudes about the effectiveness of LDC and its usefulness as a tool for teaching CCSS skills. Although implementation results were highly positive, quasi-experimental analyses employing matched control group and regression discontinuity designs found no evidence of an impact of LDC on student performance on state reading or district writing assessments. Furthermore, students generally performed at basic levels on assessments designed to align with the intervention, suggesting the challenge of meeting CCSS expectations. Exploratory analyses suggest that LDC may have been most effective for higher achieving students. However understandable, the findings thus suggest that, in the absence of additional scaffolding and supports for low-achieving students, LDC may be gap enhancing. Two appendices are included: (1) LDC Instruments and Rubrics; and (2) Summary Report: Developing an Assignment Measure to Assess Quality of LDC Modules (Abby Reisman, Joan Herman, Rebecca Luskin, and Scott Epstein).

KIPP (Knowledge is Power Program) is a national network of public charter schools whose stated mission is to help underserved students enroll in and graduate from college. Prior studies (see Tuttle et al. 2013) have consistently found that attending a KIPP middle school positively affects student achievement, but few have addressed longer-term outcomes and no rigorous research exists on impacts of KIPP schools at levels other than middle school. In this first high-quality study to rigorously examine the impacts of the network of KIPP public charter schools at all elementary and secondary grade levels, Mathematica found that KIPP schools have positive impacts on student achievement, particularly at the elementary and middle school levels. In addition, the study found positive impacts on student achievement for new entrants to the KIPP network in high school. For students continuing from a KIPP middle school, KIPP high schools' impacts on student achievement are not statistically significant, on average (in comparison to students who did not have the option to attend a KIPP high school and instead attended a mix of other non-KIPP charter, private, and traditional public high schools). Among these continuing students, KIPP high schools have positive impacts on several aspects of college preparation, including more discussions about college, increased likelihood of applying to college, and more advanced coursetaking. This report provides detailed findings and also includes the following appendices: (1) List of KIPP Schools In Network; (2) Detail on Survey Outcomes; (3) Cumulative Middle and High School Results; (4) Detailed Analytic Methods: Elementary School (Lottery-Based Analyses); (5) Detailed Analytic Methods: Middle School (Lottery-Based Analyses); (6) Understanding the Effects of KIPP As It Scales Mathematica Policy Research; (7) Detailed Analytic Methods: Middle School (Matched-Student Analyses); (8) Detailed Analytic Methods: High School (Matched-Student Analyses); (9) Detailed Analytic Methods: High School (Matched-School Analyses); and (10) Detailed Tables For What Works Clearinghouse Review. [For the executive summary, see ED560080; for the focus brief, see ED560043.]

This experimental study evaluated the effectiveness of a research-based intervention, schema-based instruction (SBI), on students' proportional problem solving. SBI emphasizes the underlying mathematical structure of problems, uses schematic diagrams to represent information in the problem text, provides explicit problem solving and metacognitive strategy instruction, and focuses on the flexible use of multiple solution strategies. Eighty-two teachers/classrooms with a total of 1,999 seventh-grade students across 50 school districts were randomly assigned to a treatment (SBI) or control (business-as-usual) condition. An observational measure provided evidence that the SBI intervention was implemented with fidelity. Results of multilevel modeling indicated that the SBI group scored on average significantly higher than the control group on the posttest and retention test (9 weeks later) and also showed significantly more growth in proportional problem solving. There were no treatment effects on the Process and Applications subtest of the Group Mathematics Assessment and Diagnostic Evaluation. These results demonstrate that SBI can be more effective than the control approach in improving students' proportional problem solving. [This paper was published in the "Journal of Educational Psychology," (EJ1082754).]

The purpose of this study was to evaluate the impact of Achieve3000, a differentiated online literacy curriculum, on students' scores on the California State Test (CST). In the 2011-12 school year, 1,957 students in Chula Vista began using Achieve3000's solutions in 3rd through 8th grade. Using a form of propensity score matching called Inverse Probability-of-Treatment Weighting (IPTW), the researchers assigned weights for the likelihood that students in the non-user comparison group (N = 7,598) could have been in the Achieve3000 treatment group. A Weighted Least Squares (WLS) regression model with IPTW weights estimated the average treatment effect. The researchers found that, overall, the students assigned to Achieve3000 performed statistically significantly higher on the CST, by 2.4 points, than students who were not using these solutions. This suggests the program is effective in improving student learning over conventional classroom activities in the first year of use, however more data is needed to determine the long term impact of usage. Five appendices contain supplemental tables and figures.

My Teaching Partner-Secondary (MTP-S) is a web-mediated coaching intervention, which an initial randomized trial, primarily in middle schools, found to improve teacher-student interactions and student achievement. Given the dearth of validated teacher development interventions showing consistent effects, we sought to both replicate and extend these findings with a modified version of the program in a predominantly high school population, and in a more urban, sociodemographically diverse school district. MTP-S produced substantial gains in student achievement across 86 secondary school classrooms involving 1,194 students. Gains were robust across subject areas and equivalent to moving the average student from the 50th to the 59th percentile in achievement scores. Results suggest that MTP-S can enhance student outcomes across diverse settings and implementation modalities.

New Leaders is a nonprofit organization with a mission to ensure high academic achievement for all students by developing outstanding school leaders to serve in urban schools. Its premise is that a combination of preparation and improved working conditions for principals, especially greater autonomy, would lead to improved student outcomes. Its approach involves both preparing principals and partnering with school districts and charter management organizations (CMOs) to improve the conditions in which its highly trained principals work. As part of the partnerships, New Leaders agrees to provide carefully selected and trained principals who can be placed in schools that need principals and to provide coaching and other support after those principals are placed. The districts and CMOs agree to establish working conditions that support, rather than hinder, the principals' efforts to improve student outcomes. This report describes how the New Leaders program was implemented in partner districts, and it provides evidence of the effect that New Leaders has on student achievement. [The research in this report was produced within RAND Education. For the appendices that accompany this report, see ED561154. For the research brief, "Principal Preparation Matters: How Leadership Development Affects Student Achievement. Research Brief," see ED561155.]

Despite the growing popularity of dual-credit courses as a college readiness strategy, numerous reviews of the literature have noted a number of important limitations of the research on the effects of dual-credit on student postsecondary outcomes. This study addressed these gaps in the literature by estimating the impact of dual-credit courses on postsecondary access, first-to-second year persistence, and eventual college attainment, and overcame many of the methodological limitations of previous studies. The study utilized a statewide longitudinal data system (SLDS), allowing us to track an entire cohort of students through their transition into postsecondary statewide. Propensity score matching was used in order to reduce the self-selection bias associated with high achieving students being more likely to take dual-credit courses. We explored how the number of dual-credit courses students complete and the subject of the courses influences their impact. We also compared the effects of dual-credit to alternative advanced courses. Our results suggest that dual-credit is a promising strategy for increasing the likelihood of students accessing, persisting through, and completing a degree in postsecondary, and is possibly even more impactful than advanced coursework. However, significant variation in the benefit of dual-credit exists.

This randomized control trial examined the efficacy of team-based learning implemented within 11th-grade social studies classes. A randomized blocked design was implemented with 26 classes randomly assigned to treatment or comparison. In the treatment classes teachers implemented team-based learning practices to support students in engaging in dialogue about course content, application of content to solve problems, and use of evidence to support responses. Significant differences in favor of the treatment group on content acquisition were noted (Hedges's g = 0.19). Examination of differences in response to the treatment indicated groups of students classified with high or moderate pretest scores benefitted from the treatment, whereas a group of students classified with low pretest scores did not benefit from the treatment.

The current teacher workforce is younger, less experienced, more likely to turnover, and more diverse in preparation experiences than the workforce of two decades ago. Research shows that inexperienced teachers are less effective, but we know little about the effectiveness of teachers with different types of preparation. In this study, we classify North Carolina public school teachers into "portals"--fixed and mutually exclusive categories that capture teachers' formal preparation and qualifications upon first entering the profession--and estimate the adjusted average test score gains of students taught by teachers from each portal. Compared with undergraduate-prepared teachers from in-state public universities, (a) out-of-state undergraduate-prepared teachers are less effective in elementary grades and high school, (b) alternative entry teachers are less effective in high school, and (c) Teach For America corps members are more effective in STEM subjects and secondary grades.

This brief aims to help educators understand the implications of math curriculum choice in the early elementary grades by presenting new findings from a study that examined how four math curricula affect students' achievement across two years--from 1st through 2nd grades. The four curricula were (1) Investigations in Number, Data, and Space (Investigations); (2) Math Expressions; (3) Saxon Math (Saxon); and (4) Scott Foresman-Addison Wesley Mathematics (SFAW), which the developer revised and renamed enVision Math (enVision) during the study. These curricula are widely used and differ in their approaches to teaching and learning. Within districts, we randomly assigned one of the four curricula to each school that participated in the study. After one year (by the end of 1st grade), students taught with Math Expressions and Saxon made greater gains in achievement than students taught with Investigations and SFAW. After two years (by the end of 2nd grade), Investigations students continued to lag behind Math Expressions and Saxon students, while SFAW/enVision students caught up to Math Expressions and Saxon students. Therefore, Math Expressions, Saxon, and SFAW/enVision improved 1st-through-2nd-grade math achievement by similar amounts, and all three outperformed Investigations. Our findings also suggest that switching between some of the study's curricula does not harm student achievement and can even be beneficial. (Contains 24 endnotes, 3 figures, and 2 tables.) [For "After Two Years, Three Elementary Math Curricula Outperform a Fourth. NCEE Technical Appendix. NCEE 2013-4019", see ED544187.]

For this study, the authors designed an experiment to test whether some high-achieving, low-income students would change their behavior if they knew more about colleges and, more importantly, whether a cost-effective way to help such students realize their full array of college opportunities can be implemented. This was done by randomly assigning interventions that provide different types of information to roughly 18,000 students, including 3,000 students who serve as controls. The most comprehensive form of the intervention, which is called the Expanding College Opportunities-Comprehensive (ECO-C) Intervention, combined application guidance, semicustomized information about the net cost of attending different colleges, and no-paperwork application fee waivers. Expanding College Opportunities Project was designed to to test several hypotheses about why most high-achieving, low-income students do not apply to and attend selective colleges. The application guidance component of ECO-C provides the kind of advice that an expert college counselor would give a high-achieving student. An expert counselor would advise such a student to apply to eight or more colleges, including a combination of "safety," "match," and "reach" colleges. The authors call this group of colleges that are within an appropriate range for a given student's achievement "peer" colleges. Using random assignment of thousands of students, the authors successfully demonstrated that a low-cost, fully scalable intervention can help many high-achieving, low-income students recognize their full array of college opportunities.

Mathematics Recovery (MR) is designed to identify first graders who are struggling in mathematics and provide them with intensive one-to-one tutoring. We report findings from a 2-year evaluation of MR conducted in 20 elementary schools across five districts in two states. The design allowed for the estimation of the counterfactual growth trajectory based on those students randomly assigned either to a tutoring cohort with a delayed start or to a wait list. Results demonstrate strong end of first grade effects on a diagnostic measure developed by MR and weak to moderate effects (effect size, 0.15-0.30) on measures administered by external evaluators. By the end of second grade, no significant effects were found on any measures. Practical and research implications are discussed. (Contains 7 tables, 3 figures, and 5 notes.)

Expeditionary Learning (EL) is a growing provider of curriculum and professional development services to teachers and school leaders. The EL model combines an interdisciplinary instructional approach with ongoing training and coaching for teachers and school leaders. The EL curriculum uses an experiential approach in which students conduct research projects to share with outside audiences. Learning expeditions--case-studies of academic topics--often bring together teachers from different subjects to coordinate shared projects; this curriculum includes several elements that are closely aligned with the Common Core standards for English-language arts and literacy. As of the 2010-2011 school year, EL's network included a total of 161 schools in 30 states. This report presents findings from the first rigorous study of the impacts of EL schools. This research aims to use the best available quasi-experimental methods to estimate the impacts of five urban EL middle schools on students' reading and math test scores. Using the study's data on student characteristics, the report also provides additional descriptive information on the types of students who enroll in EL schools. [The report was submitted to Expeditionary Learning.]

This evaluation report presents implementation and impact findings to date regarding the Striving Readers grant as implemented by the Springfield and Chicopee Public School Districts. Any questions regarding this final report should be directed to the Office of Elementary and Secondary Education (OESE) at the U.S. Department of Education. There were 25,213 students enrolled in Springfield and 7,845 in Chicopee in the 2010-11 school year. The districts differed in terms of student demographics as well as in size. In Springfield, 88% to 92% of the students were designated as minority in the participating schools as compared to 25% to 35% in Chicopee. Over three-quarters of the students in Springfield were also eligible for free or reduced lunch (80% to 84%) as compared to approximately one half in Chicopee (44% to 51%). [This report was prepared by the Research & Evaluation Division at the Education Alliance at Brown University.]

This evaluation report presents implementation and impact findings to date regarding the Striving Readers grant as implemented by the Springfield and Chicopee Public School Districts. Any questions regarding this final report should be directed to the Office of Elementary and Secondary Education (OESE) at the U.S. Department of Education. There were 25,213 students enrolled in Springfield and 7,845 in Chicopee in the 2010-11 school year. The districts differed in terms of student demographics as well as in size. In Springfield, 88% to 92% of the students were designated as minority in the participating schools as compared to 25% to 35% in Chicopee. Over three-quarters of the students in Springfield were also eligible for free or reduced lunch (80% to 84%) as compared to approximately one half in Chicopee (44% to 51%). [This report was prepared by the Research & Evaluation Division at the Education Alliance at Brown University.]

With funding from the Bill and Melinda Gates Foundation, CRESST conducted a multi-year evaluation of a major school reform project at Alain Leroy Locke High School, historically one of California's lowest performing secondary schools. Beginning in 2007, Locke High School transitioned into a set of smaller, Green Dot Charter High Schools, subsequently referred to as Green Dot Locke (GDL) in this report. Based on 9th grade students who entered GDL in 2007 and 2008 respectively, CRESST used a range of student outcomes to monitor progress of the GDL transformation. The CRESST evaluation, employing a strong quasi-experimental design with propensity score matching, found statistically significant, positive effects for the GDL transformation including improved achievement, school persistence, and completion of college preparatory courses. Appended are: (1) Demographic Characteristics and Achievement of the Freshmen at GDL and LAUSD; (2) Cohort Specific Descriptives; and (3) General Descriptives. (Contains 17 figures, 43 tables and 6 footnotes.)

States and school districts are searching for strategies to raise the college and career readiness of high school graduates--imperative in an era when postsecondary credentials are the key to good jobs, better pay, and stronger economies. The creation and implementation of higher graduation standards aligned to college and career expectations is the most visible and emblematic effort by states to ensure students are prepared to succeed after high school, but it is far from the only one. A policy strategy of increasing interest is the practice of providing students with the opportunity to take college courses while in high school, known as dual enrollment. The premise of dual enrollment is that high school students can enhance their chances for college success if they better understand what it takes to succeed in college: they do this by actually experiencing real college coursework, often earning "dual credit" for both high school and college. New research, conducted in Texas by Jobs for the Future (JFF), points to the effectiveness of dual enrollment as a strategy for improving postsecondary success. This study focused on the academic outcomes of 32,908 Texas students from the high school graduating class of 2004. Like some of these studies, the authors' research used rigorous quasi-experimental methods to control for factors other than dual enrollment that could explain student success by comparing dual enrollees to non-dual enrollees who are otherwise closely matched academically and socially. JFF's methodological approach, known as a propensity score matching model, enabled the authors to account for student background characteristics to the highest degree possible short of a randomized study. This greatly increases the certainty that the better college outcomes found for dual enrollment participants are due t o the effects of the dual enrollment courses they completed. Appended are: (1) Propensity Score Model; (2) Cohort, Treatment, and Control Group, by Region; (3) Educational Attainment of Treatment and Control Groups; (4) Test Scores by Treatment and Control Groups; (5) Odds Ratios for College Access Model; (6) Odds Ratios for College Completion Model; and (7) Dual-credit Study Methodology. (Contains 2 figures, 7 tables, and 15 endnotes.)

This study contributes to the body of research that is attempting to uncover what student characteristics and university programs and policies are predictive of student persistence and graduation. Loss of student enrollments through attrition prior to graduation and low graduation rates have significant negative consequences for universities and the attempt to better understand how to mitigate this attrition is an important priority for both researchers and university administrators and policymakers. This study differs from previous research in that it both provides a new theoretical framework for understanding possible causes of student attrition and by advancing methods and quality of the data used in the study of predictors of attrition. A theoretical framework informed by radical alterity (Keesing, 1974), Turner's liminal theory (1967, 1969, 1974), Keefer's domain theory (2006) and assimilation contrast theory (Meyers-Levy & Sternthal, 1993; Warner 2007) are used to test the hypothesis that the likelihood of persisting and attaining a baccalaureate degree are related to, in part, freshman seminar participation and high core curriculum completion rates. Specifically, this study examines the effects that freshman seminar and core completion ratios have on both freshman to sophomore persistence and degree completion at a US, Master's Large, Western, public university. Multi-level logistic regression is used to provide a measure of the likelihood of persisting when controlling for the clustering effects of major choice and year of initial enrollment. Survival analysis will allow for the examination of the probable hazard of dropout over time based on first-term academic events. Results indicate that core curriculum completion ratios in the areas of English, mathematics, and science play key roles in both freshmen to sophomore persistence. Furthermore, socially oriented freshmen seminar programming is central to increased retention rates for specific student populations. [The dissertation citations contained here are published with the permission of ProQuest LLC. Further reproduction is prohibited without permission. Copies of dissertations may be obtained by Telephone (800) 1-800-521-0600. Web page: http://www.proquest.com/en-US/products/dissertations/individuals.shtml.]

This is the final report in a five-year evaluation of the Milwaukee Parental Choice Program (MPCP). This report features analyses of student achievement growth four years after the authors carefully assembled longitudinal study panels of MPCP and Milwaukee Public Schools (MPS) students in 2006-07. The MPCP, which began in 1990, provides government-funded vouchers for low-income children to attend private schools in the City of Milwaukee. The maximum voucher amount in 2010-11 was $6,442, and 20,996 children used a voucher to attend either secular or religious private schools. The MPCP is the oldest and largest urban school voucher program in the United States. This evaluation was authorized by 2005 Wisconsin Act 125, which was enacted in 2006. The primary purpose of the evaluation is twofold: 1) to analyze the effectiveness of the MPCP in promoting growth in student achievement as compared to MPS; and 2) to examine the educational attainment--measured by high school graduation and college enrollment rates--of MPCP and MPS students. The first purpose is accomplished by gauging growth in student achievement--as measured by the Wisconsin Knowledge and Concepts Examinations (WKCE) in math and reading in grades 3 through 8 and grade 10--over a five-year period for a sample of MPCP students and a carefully matched group of MPS students. The second purpose is accomplished by following the 2006-07 8th and 9th grade MPCP and matched MPS cohorts over a five-year period during which they would have had the opportunity to graduate from high school and enroll in college. Appended are: (1) Descriptive Statistics; (2) Attrition Study; and (3) Stability of the Sample. (Contains 4 figures, 12 tables and 14 footnotes.) [For the "MPCP Longitudinal Educational Growth Study: Fourth Year Report. SCDP Milwaukee Evaluation. Report # 23", see ED518597. Additional support for this report was provided by the Robertson Foundation.]

In 2007, using funds from the federal Teacher Incentive Fund (TIF) and private foundations, the Chicago Public Schools (CPS) began piloting its version of a schoolwide reform model called the Teacher Advancement Program (TAP). Under the TAP model, teachers can earn extra pay and take on increased responsibilities through promotion (to mentor teacher or master teacher), and they become eligible for annual performance bonuses based on a combination of their contribution to student achievement (known as "value added") and observed performance in the classroom. The model calls for weekly meetings of teachers and mentors ("cluster groups"), and regular classroom observations by a school leadership team to help teachers meet their performance goals. The idea behind TAP is that giving teachers performance incentives, along with tools to track their performance and improve instruction, will help schools attract and retain talented teachers and help all teachers raise student achievement. This report is the last in a series of reports providing evidence on the impacts of CPS' version of TAP, called "Chicago TAP." It presents findings from the four-year implementation period, with special emphasis on the 2009-2010 and 2010-2011 school years, the third and fourth years of the program's rollout in Chicago. Earlier reports (Glazerman et al. 2009; Glazerman and Seifullah 2010) provide detailed data on each of the first two years of the program, respectively. CPS implemented Chicago TAP as a pilot program intended for 40 high-need schools. The program began in 10 schools in the first year (cohort 1) with a rollout plan to add 10 more Chicago TAP schools (cohorts 2, 3, and 4) in each year of the TIF grant's four-year implementation period. The authors address three research questions regarding Chicago TAP: (1) How was the program implemented?; (2) What impact did the program have on student achievement?; and (3) What impact did the program have on teacher retention within schools? To assess the first year under Chicago TAP for schools that began the program in fall 2009 (cohort 3), the authors looked at how teacher development and compensation practices in Chicago TAP schools differ from practices normally implemented in CPS schools. The authors found that teachers in Chicago TAP schools reported receiving significantly more mentoring support than teachers in similar non-TAP (control) schools. This finding reflects the fact that under the Chicago TAP model, teachers are guided by mentor teachers, and cluster groups meet weekly. They also found that veteran teachers in Chicago TAP schools were more likely than their control group counterparts to provide mentoring support to their colleagues; this finding is consistent with the fact that under Chicago TAP, teachers have the opportunity to assume leadership roles and responsibilities as Chicago TAP mentor or lead teachers. Teachers in Chicago TAP schools (veteran and novice) were aware of their eligibility for performance-based compensation. The authors found that the amount of compensation they expected approached the amount that was eventually paid out; that is, the average expectation was about $900, and the actual amount paid out in bonuses to this group was an average of about $1,100 per teacher. They generally did not find evidence of an impact of Chicago TAP on teacher attitudes or school climate. While the introduction of Chicago TAP led to real changes inside the schools, the program did not consistently raise student achievement as measured by growth in Illinois Standards Achievement Test (ISAT) scores. The authors found evidence of both positive and negative test score impacts in selected subjects, years, and cohorts of schools, but overall there was no detectable impact on math, reading, or science achievement that was robust to different methods of estimation. For example, impacts on science scores overall (across years and cohorts) were positive, but not statistically significant unless they used one particular matching method that excluded some Chicago TAP schools from the analysis. The authors did find evidence suggesting that Chicago TAP increased schools' retention of teachers, although the impacts were not uniform or universal across years, cohorts, and subgroups of teachers. They found that teachers who were working in Chicago TAP schools in 2007 returned in each of the following three years at higher rates than teachers in comparable non-TAP schools. For example, the authors found that 67 percent of classroom teachers in cohort 1 schools in fall 2007 returned to their same school in fall 2010 compared to about 56 percent of teachers in non-TAP schools, an impact of nearly 12 percentage points. In other words, teachers in Chicago TAP schools in fall 2007 were about 20% more likely than teachers in comparison schools to be in those same schools three years later. When the authors looked at teachers who were working in schools that started Chicago TAP in later years, some of the impact estimates were not statistically significant. The authors also found some evidence of impacts on retention for subgroups of teachers, such as those with less experience, but the pattern of findings was not consistent. When they considered retention of teachers in the district, the authors did not find consistent evidence of a measurable impact. Given that Chicago TAP is a school-specific program, their main focus was on school-level retention, as opposed to retention in the district. Appended are: (1) Propensity Score Matching; and (2) Supplemental Tables. (Contains 32 tables, 6 figures and 27 footnotes.) [For related reports, see "An Evaluation of the Teacher Advancement Program (TAP) in Chicago: Year One Impact Report. Final Report" (ED507502) and "An Evaluation of the Teacher Advancement Program (TAP) in Chicago: Year Two Impact Report" (ED510712).]

We used a cluster randomized trial to evaluate the effectiveness of a research-based model for scaling up educational interventions, focusing on the persistence of effects with and without a follow-through intervention. The instantiation of the Technology-enhanced, Research-based, Instruction, Assessment, and professional Development (TRIAD) model emphasized teaching early mathematics for understanding via learning trajectories and technology. The TRIAD implementation began in 42 schools in two city districts serving low-resource communities, randomly assigned to three conditions. In pre-kindergarten, the 2 experimental interventions were identical, but 1 included follow-through in the kindergarten year, including knowledge of the pre-K intervention and ways to build upon that knowledge using learning trajectories. Intent-to-treat analyses showed that students in both the follow-through condition (g = 0.33) and non-follow-through condition (g = 0.22) scored statistically significantly higher than children in the control condition. Both groups outperformed the control condition in treatment-on-the-treated analyses (g = 0.38, follow-through; g = 0.30 non-follow-through). Moderators and mediators were also analyzed. We conclude that the instantiation of the TRIAD model was successful and that follow through may contribute to the persistence of the effects of preschool interventions. (Contains 5 tables and 3 figures.)

A socioeconomic status (SES) gap in mathematical knowledge emerges early and widens prior to school entry. To address this gap, a curricular intervention, "Pre-K Mathematics," was developed and found to be effective in prior efficacy research. In the present project, the next step was taken in evaluating this intervention. Specifically, an effectiveness study was conducted to determine the degree to which the intervention improves pre-kindergarten (4-year-old) children's mathematical knowledge when implemented by local program staff in multiple settings that serve a heterogeneous population of low-SES families. In contrast with the prior efficacy study, the effectiveness study required that all teachers, rather than volunteer teachers, in their public preschool programs be available for random selection and random assignment. It also used curriculum coaches who were either members of the participating school districts or Head Start programs' permanent training staff or independent contractors, depending on the way a program a routinely supported teacher learning for its in-service teaching staff. Participating programs included publicly funded Head Start and state preschool programs serving low-income, ethnically/racially diverse, urban families in California and low-income, predominantly White, rural families in Kentucky and Indiana. A trainer-of-trainers model was used (1) to train curriculum coaches to support teachers' implementation and (2) to train teachers to implement Pre-K Mathematics with adequate fidelity. A two-condition (treatment and control) RCT was conducted, with clusters of pre-kindergarten classrooms as the unit of randomization. Treatment teachers implemented Pre-K Mathematics and control teachers continued their usual classroom practices. Children were assessed at pretest, posttest, and kindergarten follow up using the Child Math Assessment (CMA) and the Test of Early Mathematics Ability, 3rd Edition (TEMA-3). Classroom observations were made to measure the nature and amount of math support provided by treatment and control teachers during the school year. Coaches supported implementation and teachers implemented with adequate to high levels of fidelity. Multi-level analyses revealed that treatment children made significantly greater gains in mathematical knowledge than control children during the pre-kindergarten year as measured by the CMA (ES = 0.83) and TEMA-3 (ES = 0.45). A multilevel mediation analysis found evidence that time spent in mathematically focused small-group activities had a significant indirect effect on children's math outcomes. Thus, this effectiveness study found that the Pre-K Mathematics intervention had a significant positive effect on low-SES children's mathematical knowledge. An implication of this finding is that early mathematics intervention is a promising educational strategy for reducing the SES gap in mathematical knowledge.

School leaders are increasingly being asked, whether by rhetoric or policy, to measurably improve student achievement. The resultant need to assist school leaders in their ability to improve teaching and learning for all students in their schools led to the establishment of the National Institute of School Leadership's (NISL's) Executive Development Program. The NISL program emphasizes the role of principals as strategic thinkers, instructional leaders, and creators of a just, fair, and caring culture in which all students meet high standards. The current national focus on the importance of effective, instructional leadership has, in turn, led to calls for principal evaluation to be tied directly to student achievement (Davis, Kearney, Sanders, Thomas, and Leon, 2011). Within this milieu, effective and proven principal leadership development programs are crucial. (Contains 3 tables and 2 figures.) [This report was produced by the Center for Educational Partnerships, Old Dominion University.]

Teach For America (TFA) selects and places graduates from the most competitive colleges as teachers in the lowest-performing schools in the country. This paper is the first study that examines TFA effects in high school. We use rich longitudinal data from North Carolina and estimate TFA effects through cross-subject student and school fixed effects models. We find that TFA teachers tend to have a positive effect on high school student test scores relative to non-TFA teachers, including those who are certified in field. Such effects offset or exceed the impact of additional years of experience and are particularly strong in science. (Contains 1 figure, 14 tables and 14 footnotes.)

Over the last decade, New York City has been the site of a systemwide high school reform effort that is unprecedented in its scope and pace. Since 2002, the school district has closed more than 20 failing high schools, opened more than 200 new secondary schools, and implemented a centralized high school admission process in which approximately 80,000 students a year indicate their school preferences from a wide-ranging choice of programs. At the heart of these reforms lie the new schools that in this report are called "small schools of choice" (SSCs)--small, academically nonselective, public high schools that were opened between 2002 and 2008. Serving approximately 100 students per grade in grades 9 through 12 and open to students at all levels of academic achievement, the SSCs in this study were created to serve the district's most disadvantaged and historically underserved students. Prior to the 2002-2003 school year, these students would have had little option but to enroll in one of the city's large, zoned high schools when they made the transition from eighth to ninth grade. Many of the large schools were low-performing, with graduation rates below 50 percent. This report presents encouraging findings from an unusually large and rigorous study, supported by the Bill & Melinda Gates Foundation, of the effects of SSCs on students' academic achievement in high school. SSCs have a substantial positive impact on the transition into high school during ninth grade, according to data using all four cohorts: (1) SSC enrollees were 10.8 percentage points more likely than the students who enrolled in other schools to earn 10 or more credits during their first year--73.1 percent compared with 62.3 percent; (2) SSC enrollees were 7.8 percentage points less likely to fail more than one core subject (39 percent compared with 46.8 percent); (3) Combining these two indicators, 58.5 percent of SSC enrollees were on track to graduate in four years compared with 48.5 percent of their counterparts who attended a different type of school--a 10 percentage point difference; and (4) During the first year of high school, SSC enrollees earn almost one full credit more (0.9 credit) toward graduation than do their control group counterparts. These positive effects on the transition into high school during ninth grade were seen among nearly all subgroups as defined by students' academic proficiency, socioeconomic status, race/ethnicity, and gender. For all students, second- and third-year follow-up data indicate that these effects are sustained and/or increased as they continue through high school. For the "first" cohort of students (the only cohort for whom there are four years of follow-up data), the evidence indicates that SSC improvements in students' academic progress and school engagement during the early years of high school translate into higher rates of on-time graduation after four years: (1) SSCs increase overall graduation rates by 6.8 percentage points, from 61.9 percent for students who attend schools other than SSCs to 68.7 percent for SSC enrollees; (2) A majority of the SSC effect on graduation rates reflects an increase in receipt of New York State Regents diplomas. For this type of diploma, students must pass a series of Regents examinations with a score of 65 points or above and pass all of their required courses; and (3) SSCs increase the proportion of students (by 5.3 percentage points) who passed the English Regents with a score of 75 points or higher, the threshold for exempting incoming students at the City University of New York from remedial courses. They did not have an effect on math Regents exams. (Contains 2 tables and 4 footnotes.) [For the full report, "Transforming the High School Experience: How New York City's New Small Schools Are Boosting Student Achievement and Graduation Rates," see ED511106.]

This article reports the outcomes of an experimental evaluation of "Read Well Kindergarten" (RWK), a program that focuses on the development of vocabulary, phonological awareness, alphabetic understanding, and decoding. Kindergarten teachers in 24 elementary schools in New Mexico and Oregon were randomly assigned, by school, to teach RWK or their own program. Treatment teachers received 2 days of training and taught daily lessons. Project staff assessed 1,520 students at pretest and 1,428 at posttest with measures of vocabulary, phonological awareness, alphabetic understanding, and decoding. Follow-up testing was conducted in fall and spring of first grade. Analyses of final outcomes revealed a statistically significant difference favoring intervention students on curriculum-based measures of sight words and decodable words. Although these results did not generalize to standardized measures, follow-up analyses indicated that the impact of RWK rested on the rate of opportunities for independent student practice for letter names, letter sounds, sight words, and oral reading fluency, collected at the end of kindergarten. The findings suggest the potential efficacy of RWK in conjunction with frequent opportunities for independent practice for developing beginning reading skills. (Contains 2 figures and 5 tables.)

Improving teaching quality is widely recognized as critical to addressing deficiencies in secondary school education, yet the field has struggled to identify rigorously evaluated teacher-development approaches that can produce reliable gains in student achievement. A randomized controlled trial of My Teaching Partner-Secondary--a Web-mediated approach focused on improving teacher-student interactions in the classroom--examined the efficacy of the approach in improving teacher quality and student achievement with 78 secondary school teachers and 2237 students. The intervention produced substantial gains in measured student achievement in the year following its completion, equivalent to moving the average student from the 50th to the 59th percentile in achievement test scores. Gains appeared to be mediated by changes in teacher-student interaction qualities targeted by the intervention. [For a related What Works Clearinghouse Intervention Report, see ED557783.]

National achievement data show that elementary school students in the United States, particularly those from low socioeconomic backgrounds, have weak math skills (National Center for Education Statistics 2009). In fact, data show that, even before they enter elementary school, children from disadvantaged backgrounds are behind their more advantaged peers in basic competencies such as number-line ordering and magnitude comparison (Rathburn and West 2004). Furthermore, after a year of kindergarten, disadvantaged students still have less extensive knowledge of mathematics than their more affluent peers (Denton and West 2002). This study examines whether some early elementary school math curricula are more effective than others at improving student math achievement in disadvantaged schools. A small number of curricula, which are based on different approaches for developing student math skills, dominate elementary math instruction--7 curricula make up 91 percent of those used by K-2 educators, according to a 2008 survey (Resnick et al. 2010). Little rigorous evidence exists to support one approach over another, however, which means that research does not provide educators with much useful information when choosing a math curriculum to use. The key findings in this report include the following: (1) Teachers used their assigned curriculum, and the instructional approaches of the four curriculum groups differed as expected; (2) Math instruction varied in other notable ways across the curriculum groups; (3) In terms of student math achievement, the curriculum used by the study schools mattered; and (4) The curriculum used in different contexts also mattered, and some of these findings are consistent with findings based on all students whereas others are not. Appendices include: (1) Data Collection and Response Rates; (2) Teacher-Reported Frequency of Implementing Other Curriculum-Specific Activities; (3) Glossary of Curriculum-Specific Terms; and (4) Constructing the Analyses Samples and Estimating Curriculum Effects. (Contains 82 tables, 7 figures and 97 footnotes.) [For the executive summary, see ED512553.]

The effectiveness study examined a supplemental reading intervention that may be appropriate as one component of a response-to-intervention (RTI) system. First-grade students in 31 schools who were at risk for reading difficulties were randomly assigned to receive Responsive Reading Instruction (RRI; Denton, 2001; Denton & Hocker, 2006; n = 182) or typical school practice (TSP; n = 240). About 43% of the TSP students received an alternate school-provided supplemental reading intervention. Results indicated that the RRI group had significantly higher outcomes than the TSP group on multiple measures of reading. About 91% of RRI students and 79% of TSP students met word reading criteria for adequate intervention response, but considerably fewer met a fluency benchmark. (Contains 8 tables.)

Integrated Basic Education and Skills Training (I-BEST) was developed by the community and technical colleges in Washington State to increase the rate at which adult basic skills students enter and succeed in postsecondary occupational education and training. Under the I-BEST model, basic skills instructors and career-technical faculty jointly design and teach college-level occupational courses for adult basic skills students. The model challenges the conventional notion that basic skills instruction should be completed by students prior to starting college-level courses and offers the potential to accelerate the transition of adult basic skills students into college programs. This Brief presents findings from a CCRC study that investigated the outcomes of students who participated in the program. The study compared, over a two-year tracking period, the educational outcomes of I-BEST students with those of other basic skills students, including non-I-BEST basic skills students who enrolled in at least one workforce course during the period of enrollment examined in the study. The analyses controlled for observed differences in background characteristics and enrollment patterns of students in the sample. Data was examined for more than 31,000 basic skills students, including nearly 900 I-BEST participants. Findings indicate that students participating in I-BEST achieved better educational outcomes than did those nonparticipating basic skills students who also enrolled in at least one workforce course in the same academic year. Using regression analysis, I-BEST students were found to be more likely than Non-I-BEST Workforce students to continue into credit-bearing coursework and to earn credits that count toward a college credential. They were more likely to persist into the second year, to earn educational awards, and to show point gains in basic skills testing. (Contains 1 table.) [For the full report, "Educational Outcomes of I-BEST, Washington State Community and Technical College System's Integrated Basic Education and Skills Training Program: Findings from a Multivariate Analysis. CCRC Working Paper No. 16," see ED505331.]

In 1997 a medium-size Midwestern public university in the U.S. initiated a first year experience program. The program is designed to infuse added curricular and extracurricular components into core courses in an effort to integrate students into the university community. This article examined the FYE impact on grade point average (GPA) and retention after 1 year for the fall 2006 cohort of entering students. The findings suggest no positive FYE effect on retention, but on average FYE students earned higher GPAs than non-FYE students. Reducing the sample to include only courses identified as goal compatible FYE courses yielded a positive effect on retention and also accentuated the GPA differential. The estimated positive FYE impact on retention was larger for below average students (especially females) and smaller for above average students.

This study was conducted by members of a site of the California Writing Project in partnership with a large, urban, low-SES school district where 93% of the students speak English as a second language and 69% are designated Limited English Proficient. Over an eight-year period, a relatively stable group of 55 secondary teachers engaged in ongoing professional development implemented a cognitive strategies approach to reading and writing instruction, making visible for approximately 2000 students per year the thinking tools experienced readers and writers access in the process of meaning construction. The purpose of the study was to assess the impact of this approach on the reading and writing abilities of English language learners (ELLs) in all 13 secondary schools in the district. Students receiving cognitive strategies instruction significantly out-gained peers on holistically scored assessments of academic writing for seven consecutive years. Treatment-group students also performed significantly better than control-group students on GPA, standardized tests, and high-stakes writing assessments. Findings reinforce the importance of having high expectations for ELLs; exposing them to a rigorous language arts curriculum;explicitly teaching, modeling and providing guided practice in a variety of strategies to help students read and write about challenging texts; and involving students as partners in a community of learners. What distinguishes the project is its integrity with respect to its fidelity to three core dimensions: Teachers and students were exposed to an extensive set of cognitive strategies and a wide array of curricular approaches to strategy use (comprehensiveness) in a manner designed to cultivate deep knowledge and application of those strategies in reading and writing (density) over an extended period of time (duration). The consistency of positive outcomes on multiple measures strongly points to the efficacy of using this approach with ELLs. Appended are: (1) Great Expectations Writing Prompt; and (2) Student Models. (Contains 1 note, 5 tables, and 6 figures.)

We explored how a progress monitoring and instructional management system can be used to help educators differentiate instruction and meet the wide-ranging learning needs of their increasingly diverse classrooms. We compared classrooms in 24 states that used a curriculum-based progress monitoring and instructional management system, Accelerated Math, to same school control classrooms that did not use it. Among the major findings were the following: (1) At every grade level there were large differences in grade equivalent score and percentile gains for students in the experimental and control classrooms; (2) Gains were experienced across the achievement spectrum. An analysis of low-, middle-, and high-achieving students showed consistent rates of gain for each math objective mastered; (3) Intervention integrity had a significant effect on student achievement; (4) Teachers using the progress monitoring and instructional management system spent more time providing individual versus group instruction and felt better able to meet the individual needs of their students; and (5) Significantly more students who were in classrooms where teachers used the progress monitoring and instructional management system reported that they like math, help each other with math, and like math better this year than last year. Addition of a progress monitoring and instructional management system to ongoing mathematics instruction improves mathematics outcomes for students. The effects of the program clearly are a function of intervention integrity; when progress monitoring and instructional management practices are implemented with high fidelity or integrity, the mathematics performance of all students is significantly enhanced. Implications for practice are discussed.

The No Child Left Behind (NCLB) Act of 2001 created the Early Reading First (ERF) program to enhance teacher practices, instructional content, and classroom environments in preschools and to help ensure that young children start school with the skills needed for academic success. This report to Congress describes the impacts of the Early Reading First program on the language and literacy skills of children and on the instructional content and practices in preschool classrooms. The main findings of the national evaluation of ERF show that the program had positive, statistically significant impacts on several classroom and teacher outcomes and on one of four child outcomes measured. The program had no effect on children's phonological awareness or oral language. This report contains an executive summary and eight chapters: (1) Introduction and Study Background; (2) Study Design; (3) Characteristics of Participating Children and Families; (4) Characteristics of Programs Receiving ERF Funding; (5) Professional Development, Instructional Practices, and Classroom Environments in ERF Preschools; (6) Impacts on Teachers and Classroom Practices; (7) Impact Findings: ERF Impacts on Children's Language and Literacy Skills and Social-Emotional Outcomes; and (8) Analysis of Mediators of ERF's Impacts on Classroom Instructional Practice and Children's Language and Literacy Skills. Appendices include: (A) Impact Analysis Methods and Sensitivity of Results; (B) Data-Collection Methods; (C) Assessment and Observation Measures Used for ERF Data Collection; (D) Supplementary Tables on the Impacts of ERF on Teachers and Classroom Environments; (E) ERF Impacts on Teacher and Classroom Outcomes; Subgroups Analyses; (F) ERF Impacts on Child Outcomes; Subgroups Analyses; and (G) Supplemental Descriptive Tables for Teacher Outcomes and Classroom Practice. (Contains 63 tables, 12 figures, and 5 exhibits.) [This report was produced by the National Center for Education Evaluation and RegionalAssistance, Institute of Education Sciences.]

The article presents the results of a randomized experimental study of a writing curriculum for college developmental writing courses based on strategy instruction with self-regulation integrated with practices common in college composition. Students in a full semester course learned strategies for planning and revising based on rhetorical analysis and genres. In addition, they learned metacognitive, self-regulation strategies for goal setting, task management, self-evaluation, and reflection. A prior quasi-experiment found positive effects of the curriculum on writing quality, self-efficacy, and mastery motivation. The current study included 19 instructors and 207 students across two colleges. Using hierarchical linear modeling (HLM) with students nested within instructors and with condition and college as factors and pretest scores as covariates, analyses found positive effects of the treatment for quality of argumentative writing (ES = 1.18), quality of writing on an independent writing assessment (ES = 0.67), and several motivation outcomes, including self-efficacy (for tasks and processes, ES = 0.50; for grammar, ES = 0.36; and for self-regulation, ES = 0.40), affect (ES = 0.32), and beliefs about the importance of content (ES = 0.29). No significant effects were found for grammar/conventions or reading comprehension. Teachers in the treatment condition commented positively on the approach and noted improvements in student writing and motivation. Students also shared positive experiences and noted improvement in their writing. [For the corresponding grantee submission, see ED614889.]

We tested the efficacy of a comprehensive intervention program designed for high school students across the autism spectrum, the Center on Secondary Education for Students with Autism (CSESA) model, in a cluster randomized control trial involving 60 high schools in three states (California, North Carolina, Wisconsin), with implementation occurring over a 2-year period. We examined outcomes for the schools, students (N = 547), and families. At the conclusion of the study, CSESA schools had significantly higher program quality than the services-as-usual (SAU) schools. In addition, students in the CSESA schools had significantly higher total attainment of educational goals than students in SAU schools. There were not significant differences between the two groups on standardized assessment outcomes. We discuss implications for intervention implementation and future research with this population in the public school context.

Disruptive behavior disorders in childhood are increasingly pervasive and associated with numerous, negative long-term outcomes. The current study examined whether adding a brief, home-visitation intervention to an existing, multi-component (child and teacher) intervention, would improve social-emotional and behavioral outcomes for young children with challenging behavior in home and school settings who required intensive support. A total of 379 teacher-parent-student triads were screened for elevated levels of behavioral risk in school and home settings and then randomly assigned to school only intervention (i.e., teacher and student components), home only intervention (i.e., parent), both combined, or business-as-usual control conditions. We examined baseline and posttest outcomes across prosocial behavior, problem behavior, and academic domains. The results demonstrated substantial support for the teacher and child-focused condition and combined conditions, and modest support for the parent-focused condition. The study advances the literature by increasing the knowledge base related to these interventions implemented alone and in combination.

Disruptive behavior disorders in childhood are increasingly pervasive and associated with numerous, negative long-term outcomes. The current study examined whether adding a brief, home-visitation intervention to an existing, multi-component (child and teacher) intervention, would improve social-emotional and behavioral outcomes for young children with challenging behavior in home and school settings who required intensive support. A total of 379 teacher-parent-student triads were screened for elevated levels of behavioral risk in school and home settings and then randomly assigned to school only intervention (i.e., teacher and student components), home only intervention (i.e., parent), both combined, or business-as-usual control conditions. We examined baseline and posttest outcomes across prosocial behavior, problem behavior, and academic domains. The results demonstrated substantial support for the teacher and child-focused condition and combined conditions, and modest support for the parent-focused condition. The study advances the literature by increasing the knowledge base related to these interventions implemented alone and in combination.

Disruptive behavior disorders in childhood are increasingly pervasive and associated with numerous, negative long-term outcomes. The current study examined whether adding a brief, home-visitation intervention to an existing, multi-component (child and teacher) intervention, would improve social-emotional and behavioral outcomes for young children with challenging behavior in home and school settings who required intensive support. A total of 379 teacher-parent-student triads were screened for elevated levels of behavioral risk in school and home settings and then randomly assigned to school only intervention (i.e., teacher and student components), home only intervention (i.e., parent), both combined, or business-as-usual control conditions. We examined baseline and posttest outcomes across prosocial behavior, problem behavior, and academic domains. The results demonstrated substantial support for the teacher and child-focused condition and combined conditions, and modest support for the parent-focused condition. The study advances the literature by increasing the knowledge base related to these interventions implemented alone and in combination.

This study utilized a partially nested randomized control design to investigate the impact of Fusion, a first grade math intervention. Blocking on classrooms, students were randomly assigned to one of three conditions: a Fusion two student group, a Fusion five student group, or a no treatment control group. Two primary research questions were examined: What was the overall impact of the Fusion intervention as compared to a business-as-usual comparison condition? and Was there a differential impact on student outcomes between the 2:1 Fusion and the 5:1 Fusion conditions? Analyses found a positive effects on four outcome measures favoring Fusion groups over control with two of the differences statistically significant. Results between Fusion groups found positive effects favoring the Fusion 2:1 group compared to the Fusion 5:1 group on all four outcome measures with two of the differences statistically significant. On a second grade follow up measure no difference was found between Fusion groups and control but a statistically significant difference was found between Fusion groups favoring the 2:1 Fusion group. Future research directions and implications for practice are discussed. [This paper will be published in the "Journal of Research on Educational Effectiveness."]

Learning fractions is a critical step in children's mathematical development. However, many children struggle with learning fractions, especially fraction arithmetic. In this article, we propose a general framework for integrating understanding of individual fractions and fraction arithmetic, and we use the framework to generate interventions intended to improve understanding of both individual fractions and fraction addition. The framework, Putting Fractions Together (PFT), emphasizes that both individual fractions and sums of fractions are composed of unit fractions and can be represented by concatenating them (putting them together). To illustrate, both "3/9" and "2/9 + 1/9" can be represented by concatenating three 1/9s; similarly, 2/9 + 1/8 can be represented by concatenating two 1/9s and one 1/8. Interventions based on the PFT framework were tested in 2 experiments with fourth, fifth, and sixth grade children. The interventions led to improved performance on number line estimation and magnitude comparison tasks involving individual fractions and sums of fractions with equal and unequal denominators. Especially large improvements were observed on relatively difficult unequal-denominator fraction sum problems. The findings suggest that viewing individual nonunit fractions and sums of fractions as concatenations of unit fractions provides a sound conceptual foundation for improving children's knowledge of both. We discuss implications of the research for teaching and learning fractions, children's numerical development, and mathematics education in general. [The article was published in "Journal of Educational Psychology" (EJ1291033).]

The purpose of this study was to explore the paths by which word-problem intervention, with versus without embedded prealgebraic reasoning instruction, improved word-problem performance. Students with mathematics difficulty (MD; n = 304) were randomly assigned to a business-as-usual condition or 1 of 2 variants of word-problem intervention. The prealgebraic reasoning component targeted relational understanding of the equal sign as well as standard and nonstandard equation solving. Intervention occurred for 16 weeks, 3 times per week, 30 min per session. Sequential mediation models revealed main effects, in which each intervention condition significantly and substantially outperformed the business-as-usual condition, corroborating prior research on the efficacy of schema word-problem intervention. Yet despite comparable effects on word-problem outcomes between the two word-problem conditions, the process by which effects accrued differed: An indirect path via equal-sign understanding and then equation solving was significant only for the word-problem intervention condition with embedded prealgebraic reasoning instruction. Additionally, the effect of this condition on equal-sign reasoning was strong. Given the link between equal-sign reasoning for success with algebra and the importance of algebra for success with advanced mathematics, results suggest an advantage for embedding prealgebraic reasoning instruction within word-problem intervention.

This study examines the effectiveness of scaling up a vocabulary intervention, pre-K-first grade, using a structured adaptation of the World of Words that allowed teachers some autonomy over its implementation. The purpose was to determine whether such an adaptation could maintain fidelity and promote positive child outcomes. Classrooms (pre-K through grade 1) from 12 elementary schools in a large metropolitan area were randomly selected into treatment (N = 39) and control groups (N = 34). The 21-week intervention involved a shared book reading about science topics, using cross-cutting concepts and vocabulary within taxonomic categories to build knowledge networks. Pre- and posttests examined child outcomes in vocabulary, concepts, and expressive language. Results indicated that fidelity was largely maintained, with significant standardized gains in language and vocabulary for pre-K children. Conversational turns predicted statistically significant improvements in language, suggesting that such adaptations may hold promise for scaling up an intervention.

We assessed the effects of a whole-school equity intervention implemented within a school-wide positive behavioral interventions and supports (PBIS) framework on racial inequities in school discipline in eight elementary schools with inequitable referrals for Black students. The intervention involved assessing patterns of racial disparities in school discipline decisions and providing professional development on adapting school-wide behavior systems to improve cultural responsiveness through concrete strategies targeting the patterns. After consent and matching on existing levels of racial inequities, half of the schools were randomly assigned to receive the intervention. Analyses showed that schools receiving the intervention had significant decreases in racial disparities in school discipline and rates of office discipline referrals (ODRs) for Black students, while control schools had minimal change. Results are discussed in terms of improving equity in school discipline within multitiered systems of support.

The purpose of this study was to evaluate the Literacy-Infused Science Using Technology Innovation Opportunity (LISTO) validation project (Valid 45). LISTO was funded by the Investing in Innovation (i3) Fund and involved a multi-year intervention that provided virtual professional development and coaching, and literacy-infused science curricula to fifth-grade science teachers who taught predominantly low-income students and in predominantly rural public schools in Texas. The overarching goal of LISTO is to validate, via a 5-year longitudinal randomized controlled trial (RCT) study, literacy-infused science (LIS) instructional and curricular innovations to increase instructional capacity of teachers and to improve students' science and reading/writing literacy achievement in rural/non-rural schools for economically challenged (EC), inclusive of English language learners (ELL) students. Outcomes collected in the 2017-18 school year were considered to be exploratory, given the timing of Hurricane Harvey, which impacted Texas in August of 2017. Outcomes in the 2018-19 school year served as the confirmatory contrasts. LISTO resulted in increased teacher capacity to implement research-based strategies while teaching science content, yet this improvement did not necessarily translate into improved student achievement in science or reading. The LISTO professional development and coaching covered pedagogical strategies for teaching science, including those that have been shown to improve literacy and be particularly effective for ELs. There was a negative impact on students' science achievement in both 2017-18 (ES = -0.10) and in 2018--19 (ES = -0.13). There was a negative program impact on students' science interest (ES = -0.14), as measured by a survey, in 2017-18, and no impact in 2018-19. These quantitative findings were in conflict with qualitative data collected from LISTO teachers, who indicated that the program led to improvements in both science vocabulary and engagement and self-efficacy in science for students. LISTO had positive effects on teacher practices for a subsample of teachers, specifically on increased delivery of research-based instruction to teach science content as rated on a rubric by external reviewers (ES = +1.12). LISTO appeared to improve instructional practices for a sample of teachers who implemented the program for two years with complete data but did not positively impact student or teacher outcomes more broadly. However, results should be cautiously interpreted due to limitations of delayed and incomplete implementation in the first year of the project due to Hurricane Harvey. Encouragingly, teachers' overall positive reactions to the program suggest its potential to improve student affect and learning, but more extensive implementation experience by teachers and multi-year exposure by students starting from early grades may be needed to yield measurable benefits. Clearly, such focuses emerge as a highly recommended topic for future research.

Learning fractions is a critical step in children's mathematical development. However, many children struggle with learning fractions, especially fraction arithmetic. In this article, we propose a general framework for integrating understanding of individual fractions and fraction arithmetic, and we use the framework to generate interventions intended to improve understanding of both individual fractions and fraction addition. The framework, Putting Fractions Together (PFT), emphasizes that both individual fractions and sums of fractions are composed of unit fractions and can be represented by concatenating them (putting them together). To illustrate, both "3/9" and "2/9 + 1/9" can be represented by concatenating three 1/9s; similarly, 2/9 + 1/8 can be represented by concatenating two 1/9s and one 1/8. Interventions based on the PFT framework were tested in 2 experiments with fourth, fifth, and sixth grade children. The interventions led to improved performance on number line estimation and magnitude comparison tasks involving individual fractions and sums of fractions with equal and unequal denominators. Especially large improvements were observed on relatively difficult unequal-denominator fraction sum problems. The findings suggest that viewing individual nonunit fractions and sums of fractions as concatenations of unit fractions provides a sound conceptual foundation for improving children's knowledge of both. We discuss implications of the research for teaching and learning fractions, children's numerical development, and mathematics education in general.

Previous studies have often compared and contrasted differences among media presentations, including traditional storybooks and videos and their potential for incidental word learning among preschoolers. Studies have shown that children learn words from a variety of media, and that repetition is an important source for incidental learning. Yet, to date, little is known about how repeated presentations of different media, and the possible additive effect of these presentations may affect incidental word learning. Conducted over three phases, 140 preschoolers viewed or listened to two stories, repeated either with a single medium (traditional book "or" video) or two media (book "and" video) to stories. Results indicated that gains in incidental word learning were significantly stronger when children viewed two different media of comparable content compared to two exposures to a single medium. However, neither condition affected children's comprehension of the story. Findings suggest that two media presentations of comparable stories may be more effective in promoting incidental word learning than repeated presentations of a single medium.

Objective: The current study reports functional outcomes from a multi-site randomized trial of a cognitive-behavioral treatment program for college students diagnosed with ADHD. Methods: A sample of emerging adults (N = 250; ages 18 to 30) currently attending college were comprehensively evaluated and diagnosed with ADHD (M age = 19.7; 66% female, 6.8% Latino, 66.3% Caucasian). Participants were randomized to either a two-semester intervention (Accessing Campus Connections and Empowering Student Success (ACCESS)) or a delayed treatment condition. Participants were assessed with measures of academic, daily life, and relationship functioning prior to treatment, at the end of the first semester, and after the second semester of treatment. Results: Multi-group latent growth curve models revealed moderate effect size improvements on self-report measures of study skills and strategies, as well as on self-report measures of time management, daily functioning, and overall well-being for participants in ACCESS. Importantly, treatment effects were maintained or increased in some cases from the end of the first semester to the end of the second semester. Improvements in self-reported interpersonal functioning were not significantly different across condition and neither condition demonstrated significant change over time in educational record outcomes (GPA and number of credits earned). Conclusions: ACCESS appears to promote improvements in self-reported general well-being and functioning, time management, and study skills and strategies. However, improvements in interpersonal relationships and objective academic outcomes such as GPA were not observed. Clinical implications and future directions for treating ADHD on university and college campuses are discussed. [This is the online version of an article published in "Journal of Clinical Child & Adolescent Psychology."]

In 2015, Bergen Community College (BCC) received a grant from the U.S. Department of Education First in the World Grant Program. The grant entitled Alternatives to Mathematics Education: An Unprecedented Program (AMP-UP), was awarded to conduct a randomized control trial on a corequisite approach to developmental math education. This study was conducted by researchers at the Education and Employment Research Center (EERC) at Rutgers, The State University of New Jersey. EERC investigated whether an accelerated delivery of developmental and college-level mathematics coursework would improve student retention, gateway course completion, credit accumulation, and degree completion over three years. The intervention group enrolled in accelerated developmental and college-level coursework; those in the group who placed into developmental arithmetic also participated in a self-paced Summer Bridge program. The comparison group followed the college's usual developmental mathematics sequence, generally enrolling in their first math course in the Fall term of their first year. The study found that both groups enrolled in a similar number of terms over three years. But in that period, intervention group students were 13 percentage points more likely to complete a developmental mathematics course and 30 percentage points more likely to complete a college-level mathematics course. The intervention group also earned 5.1 more credits and was 8 percentage points more likely to complete a degree in the study period. [This report was published by Rutgers' Education and Employment Research Center at the School of Management and Labor Relations.]

Disruptive behavior problems frequently emerge in the preschool years and are associated with numerous, long-term negative outcomes, including comorbid disorders. First Step is a psychosocial early intervention with substantial empirical evidence supporting its efficacy among young children (Walker et al., 2014). The present study reports on a validation study of the revised and updated First Step early intervention, called First Step Next (Walker, Stiller et al. 2015), conducted within four preschool settings. One hundred sixty students at risk for school failure, and their teachers, were randomized to intervention and control conditions. Results indicated coach and teacher adherence to implementing the core components of the program was excellent. Teachers and parents had high satisfaction ratings. For the three First Step Next pro-social domains, Hedges' g effect sizes ranged from 0.34 to 0.91. For the problem behavior domain, children who received the First Step Next intervention had significant reductions in teacher and parent-reported problem behavior as compared to children randomized to the control condition. For the problem behavior domain, Hedges' g effect sizes ranged from 0.33 to 0.63, again favoring the intervention condition. All of the domains were statistically significant. This study builds on the evidence base supporting the First Step intervention in preschool settings (Feil et al., 2014; 2016; Frey et al., 2015). [This paper will be published in "Exceptional Children."]

In 2016, Union County College began a four-year experiment with corequisite developmental mathematics as part of a grant from the U.S. Department of Education's First in the World (FITW) program. In this experiment, students assessed as needing to take developmental mathematics courses would be eligible to receive a waiver from their developmental requirements and instead proceed to college-level mathematics courses. Students selected to receive a waiver would also be required to participate weekly in tutoring services offered by the college. The Education and Employment Research Center at Rutgers University served as the external evaluator for the study. The evaluation focuses on three key outcomes: continuous enrollment, passing college-level mathematics, and degree completion. The outcomes assessment found that students assigned to the intervention group -- those who had the immediate opportunity to proceed to college-level mathematics with support -- benefitted primarily from the intervention itself. In other words, intervention group students were substantially more likely to have passed a college-level mathematics course within three years than their counterparts in the comparison group, who would have had to first complete a developmental mathematics sequence prior to enrolling in college-level math. Assignment to the treatment group did not, however, have a measurable impact on either student persistence at the college or on degree completion in the study period. [This report was produced by Rutgers' Education and Employment Research Center.]

Inference skill is one of the most important predictors of reading comprehension. Still, there is little rigorous research investigating the effects of inference instruction on reading comprehension. There is no research investigating the effects of inference instruction on reading comprehension for English learners with reading comprehension difficulties. The current study investigated the effects of small-group inference instruction on the inference generation and reading comprehension of sixth- and seventh-grade students who were below-average readers (M = 86.7, SD = 8.1). Seventy-seven percent of student participants were designated limited English proficient. Participants were randomly assigned to 24, 40-min sessions of the inference instruction intervention (n = 39) or to business-as-usual English language arts instruction (n = 39). Membership in the treatment condition statistically significantly predicted higher outcome score on the "Gates-MacGinitie Reading Test" Reading Comprehension subtest (d = 0.60, 95% confidence interval [CI] [0.16, 1.03]), but not on the other measures of inference skill.

Positive behavior interventions and supports (PBIS) improve student behavior. Yet, teachers may not receive adequate training to implement PBIS at the classroom level. This study evaluated class-wide function-related intervention teams (CW-FIT) as a classroom-level behavior management system to determine whether the behavior of middle school students would improve with teacher implementation of CW-FIT. A multiple-baseline across conditions design was used to evaluate changes in on-task behavior of adolescent students in sixth and seventh grade from a socioeconomically and ethnically diverse middle school. In addition, the effects on teacher behavior-specific praise statements and teacher reprimands were assessed. Consistent with previous evaluations of CW-FIT, findings indicated a functional relation between the intervention and increases in on-task student behavior. In addition, the findings also showed improvements to teacher behavior with increases in behavior-specific praise statements; however, no effect was observed with teacher reprimands. Social validity measures indicated students and teachers found the intervention favorable. Implications, limitations, and areas for future inquiry are discussed.

Research indicates that students with emotional and behavioral disorders (EBD) may engage in severe disruptions and off-task behaviors in the classroom setting that adversely impact the learning environment. This leads to many students identified as having EBD being placed in alternative education settings, such as restrictive schools or residential facilities. Due to placement in more restrictive environments and high rates of disciplinary actions, it is especially critical to decrease disruptive behaviors for students diagnosed with EBD. In addition, classroom teachers report disruptive behaviors and conduct problems as a major barrier to teaching their students. An ABC multiple baseline across classes design was used in an alternative school setting to evaluate the effects of explicit social skills training combined with a group contingency on class-wide levels of engagement and disruptive behavior. Participants were students in the first through sixth grade diagnosed with EBD. Through the class-wide intervention, social skills acquisition deficits were targeted through social skills instruction and social skills performance deficits were targeted through reinforcement programs. Results showed an increase in engagement and a decrease in disruptive behavior across all classrooms as a result of the intervention package.

The purpose of this cluster randomized group study was to investigate the effect of multitiered, dual-language instruction on children's oral language skills, including vocabulary, narrative retell, receptive and expressive language, and listening comprehension. The participants were 3- to 5-year-old children (n = 81) who were learning English and whose home language was Spanish. Across the school year, classroom teachers in the treatment group delivered large-group lessons in English to the whole class twice per week. For a Tier 2 intervention, the teachers delivered small-group lessons 4 days a week, alternating the language of intervention daily (first Spanish, then English). Group posttest differences were statistically significant, with moderate to large effect sizes favoring the treatment group on all the English proximal measures and on three of the four Spanish proximal measures. Treatment group advantages were observed on Spanish and English norm-referenced standardized measures of language (except vocabulary) and a distal measure of language comprehension. [For the corresponding grantee submission, see ED603565.]

The purpose of this conceptual replication study was to investigate the efficacy of an early literacy intervention when it was implemented by special educators in general education classrooms with students in the class participating in the lessons. The study was conducted in 16 schools in three states. Eighty students with severe disabilities participated in the study. Students in the intervention group received Early Literacy Skills Builder (ELSB) instruction, and students in the "business-as-usual" control group received literacy instruction planned by special education teachers to address the students' individualized education program literacy goals. Literacy assessments were conducted in five waves scheduled across the school year. Results showed that students receiving ELSB instruction made greater gains in assessed literacy skills than students in the control group. These findings provide evidence that students with severe disabilities can benefit from comprehensive emergent literacy instruction when it is implemented in general education settings. [For the corresponding grantee submission, see ED601011.]

The purposes of this study were to assess the effects of fractions intervention for students who are at-risk for poor outcomes and to examine whether a component that combines self-regulated learning with growth mindset instruction (SR-GM) provides added value for improving outcomes. At-risk students (N = 84) were randomly assigned to 3 conditions: fractions intervention, fractions intervention with embedded SR-GM, and a control group. Intervention was conducted 3 times per week for 35 min per session for 13 weeks. Multilevel models indicated both fractions intervention conditions produced strong effects, with no added value for SR-GM. Posttest fractions achievement gaps for both intervention conditions held steady, narrowed, or closed, while the control group's gaps remained sizeable or grew. Results suggest that intervention can address challenging mathematics standards for at-risk learners and that SR-GM instruction may not be necessary in the context of strong intervention. [This is the in press version of an article published in "Exceptional Children."]

This study examined the effects of a small group intervention targeting paraphrasing and text structure instruction on the main idea generation and reading comprehension of students with reading disabilities in Grades 4 and 5. Students (N = 62) were randomly assigned to receive the Tier 2-type intervention or business-as-usual instruction. Students in the intervention received 25, 40-minute lessons focused on paraphrasing sections of text by identifying the main topic and the most important idea about that topic. Students utilized the text structure organization to inform their main idea generation. Results yielded statistically significant, positive effects in favor of the intervention group on near-transfer and mid-transfer measures of text structure identification (g = 0.75) and main idea generation (g = 0.70), but no statistically significant effect on a far-transfer measure of reading comprehension. These findings provide initial support for utilizing this instruction to improve students' main idea generation on taught and untaught structures.

The impact of the Good Behavior Game (GBG) on students' classroom behavior has been studied for 50 years. What is less established is the impact of the GBG on students' academic progress. With emerging research in curriculum-based measurement for written expression (WE-CBM), it may be possible to observe changes in students' writing output while playing the GBG versus when the game is not played. The purpose of the current study was to systematically introduce the GBG during writing practice time in a Grade 1 and Grade 2 classroom, and observe any changes to all students' academic engagement, disruptive behavior, as well as target students' writing output using WE-CBM. Results indicated large increases in all students' academic engagement and decreases in disruptive behavior when the GBG was played. For writing output, target students demonstrated modest improvement in the amount of words written and accuracy of writing when the game was played, especially students identified as having emerging writing skills. Future studies might continue to empirically explore the connection between behavioral intervention and academic output by replicating study procedures in different contexts and/or with alternative WE-CBM indices.

We present findings from a randomized controlled trial of "Descubriendo la Lectura" (DLL), an intervention designed to improve the literacy skills of Spanish-speaking first graders, who are struggling with reading. DLL offers one-on-one native language literacy instruction for 12 to 20 weeks to each school's lowest performing first-graders. Examining literacy outcomes for 187 students, hierarchical linear model analyses revealed statistically significant effects of student-level assignment to DLL on all 9 outcomes evaluated. Impacts were as large as 1.24 standard deviations, or a learning advantage relative to controls exceeding a full school year of achievement growth. The mean effect size of d = 0.66 across the nine literacy measures is equal to approximately two thirds of the overall literacy growth that occurs across the first-grade year.

Given the growing number of Latino English learners and the lack of evidence-based educational opportunities they are provided, we investigated the impact of one potentially effective literacy intervention that targets struggling first-grade Spanish-speaking students: Descubriendo La Lectura (DLL). DLL provides first-grade Spanish-speaking students one-on-one literacy instruction in their native language and is implemented at an individualized pace for approximately 12 to 20 weeks by trained bilingual teachers. Using a multisite, multicohort, student-level randomized controlled trial, we examined the impact of DLL on both Spanish and English literacy skills. In this article, we report findings from the first of three cohorts of students to participate in the study. Analyses of outcomes indicate that treated students outperformed control students on all 11 Spanish literacy assessments with statistically significant effect sizes ranging from 0.34 to 1.06. Analyses of outcomes on four English literacy assessments yielded positive effect sizes, though none were statistically significant. [This article was published in "AERA Open" (EJ1229779).]

This randomized control trial examined the efficacy of an intervention aimed at improving multisyllabic word reading (MWR) skills among fourth- and fifth-grade struggling readers (n = 109, 48.6% male), as well as the relative effects of an embedded motivational beliefs training component. This study was a closely aligned replication of our earlier work. The intervention was replicated with a three-condition design: MWR only, MWR with a motivational beliefs component, and business-as-usual control. Students were tutored in small groups for 40 lessons (four 40-min lessons each week). When we combined performance of students in both MWR conditions, intervention students significantly outperformed controls on proximal measures of affix reading and MWR, as well as standardized measures of decoding, spelling, and text comprehension. Furthermore, there was a noted interaction between English learner status and treatment on spelling performance. There were no statistically significant main effects between the MWR groups on proximal or standardized measures of interest. Findings are discussed in terms of their relevance to MWR instruction for students with persistent reading difficulties and considerations for future research related to the malleability of motivation.

We examine the efficacy of an intervention to improve word reading and reading comprehension in fourth- and fifth-grade students with significant reading problems. Using a randomized control trial design, we compare the fourth- and fifth-grade reading outcomes of students with severe reading difficulties who were provided a researcher-developed treatment with reading outcomes of students in a business-as-usual (BAU) comparison condition. A total of 280 fourth- and fifth-grade students were randomly assigned within school in a 1:1 ratio to either the BAU comparison condition (n = 139) or the treatment condition (n = 141). Treatment students were provided small-group tutoring for 30 to 45 minutes for an average of 68 lessons (mean hours of instruction = 44.4, SD = 11.2). Treatment students performed statistically significantly higher than BAU students on a word reading measure (effect size [ES] = 0.58) and a measure of reading fluency (ES = 0.46). Though not statistically significant, effect sizes for students in the treatment condition were consistently higher than BAU students for decoding measures (ES = 0.06, 0.08), and mixed for comprehension (ES = -0.02, 0.14).

Students in the elementary grades often experience difficulty setting up and solving word problems. Using an equation to represent the structure of the problem serves as an effective tool for solving word problems, but students may require specific pre-algebraic reasoning instruction about the equal sign as a relational symbol to set up and solve such equations successfully. We identified students with mathematics difficulty (n = 138) from a sample of 916 third-grade students. We randomly assigned students to a word-problem intervention with a pre-algebraic reasoning component, a word-problem intervention without pre-algebraic reasoning, or the business-as-usual. Students in the 2 active intervention conditions participated in 45 individual sessions and learned about 3 additive word-problem schemas. Students who received word-problem intervention with a pre-algebraic reasoning component demonstrated improved nonstandard equation solving, equal sign understanding, and word-problem solving compared to students in the other two conditions. [The paper will be published in "ZDM Mathematics Education."]

Models are central to the practice and teaching of science. Yet people often fail to grasp how scientific models explain their observations of the world. Realizing the explanatory power of a model may require aligning its relational structure to that of the observable phenomena. The present research tested whether "relational scaffolding"--guided comparisons between observable and modeled events--enhances children's understanding of scientific models. We tested relational scaffolding during instruction about the day-night cycle, a topic that involves relating "Earth-based" observations to a "space-based" model of Earth rotation. Experiment 1 found that 3rd graders (N = 108) learned more from instruction that incorporated relational scaffolding. Experiment 2 (N = 99) found that guided comparison--not merely viewing observable and modeled events--is a critical component of relational scaffolding, especially for children with low initial knowledge. Relational scaffolding could be applied broadly to assist the many students who struggle with science. [This is the in press version of an article to be published in "Psychological Science."]

The purpose of this study was to explore the efficacy of fractions intervention with and without an embedded self-regulation (SR) component for third-grade students at risk for mathematics disabilities. Fractions intervention focused on magnitude understanding and word problems. Embedded SR was designed to support a growth mindset (fostering belief that intellectual and academic abilities can be developed) along with SR processes in which students set goals, self-monitor, and use strategies to engage motivationally, metacognitively, and behaviorally through challenging tasks. Students (n = 69) were randomly assigned to business-as-usual control and the two versions of fractions intervention. Multilevel models, accounting for the nested structure of the data, identified a moderation effect on fraction word problems: For students receiving fractions intervention with embedded SR, response to intervention was robust across the continuum of students' pretest word problem skill; by contrast, without SR, response to fractions intervention depended on students' pretest word problem skill. On the remaining outcomes, results reflected stronger outcomes when fractions intervention embedded SR instruction without moderation. [This paper will be published in the "Journal of Learning Disabilities."]

Objective: There are currently no empirically-supported, comprehensive school-based interventions (CSBIs) for children with autism spectrum disorder (ASD) without concomitant intellectual and language disability. This study compared outcomes for a CSBI (schoolMAX) to typical educational programming (services-as-usual [SAU]) for these children. Method: A total of 103 children (ages 6-12 years) with ASD (without intellectual and language disability) were randomly assigned by school buildings (clusters) to receive the CSBI (n=52 completed) or SAU (n=50 completed). The CSBI was implemented by trained school personnel and targeted social competence and ASD symptoms using social skills groups, emotion recognition instruction, therapeutic activities, behavioral reinforcement, and parent training. Outcome measures tested the effects of the CSBI on social competence and ASD symptoms, as well as potential collateral effects on academic achievement. Outcomes (baseline-to-follow-up) were assessed using tests of social-cognition and academic skills and behavioral observations (by masked evaluators) and parent-teacher ratings of ASD symptoms and social/social-communication skills (non-masked) [ClinicalTrials.gov, NCT03338530, https://www.clinicaltrials.gov/]. Results: The CSBI group improved significantly more than the SAU group on the test of emotion recognition skills and parent-teacher ratings of ASD symptoms (primary outcomes) and social/social-communication skills (secondary outcome). No differences between groups were detected for recess social interactions or academic skills. Conclusions: The CSBI improved several core areas of functioning for children with ASD compared to usual educational programming. Additional intervention elements may be needed to expand the efficacy of the CSBI so that the observed skills/symptom improvements generalize to recess social interactions and/or academic skills are enhanced. [This paper was published in the "Journal of Clinical Child and Adolescent Psychology" v48 n6 p922-933 Dec 2019.]

Two studies were conducted to examine the effects of a brief prompting intervention (verbal and visual reminder of classroom rules) to improve classroom behavior for an elementary student during small-group reading instruction in a special education classroom (Study 1) and for three high school students with mild disabilities in an inclusive general education classroom (Study 2). Using within-participant reversal designs, the teachers provided brief reminders of behavioral expectations just before class. Teachers were instructed to respond to the students' appropriate and inappropriate behaviors in a typical manner to ensure no programmed changes in the contingencies for student behavior. Results indicated improvements in classroom behavior for all four students, and teachers and students indicated positive perceptions about the intervention and its effects. Implications for future research and practice are discussed.

Empirical Education Inc. is the independent evaluator of SRI International's 2014 Investing in Innovation (i3) Development grant called Redesigning Secondary Courses to Improve Academic Outcomes for Adolescents with Disabilities and Other Underperforming Adolescents. The goal of the grant is to develop "Enhanced Units" that combine research-based content enhancement routines, collaboration strategy, and technology components for secondary U.S. History and biology classes. This report presents findings of a randomized control trial (RCT) during the 2017-18 school year. The RCT measured the impact of "Enhanced Units" on higher order content skills (as measured through unit tests) in high school biology and U.S. History classes in three districts in Virginia and California. SRI, the Center for Applied Special Education Technology (CAST), and their research and practitioner partners developed "Enhanced Units" (EU) with the goal of integrating research-based content enhancement routines with technological enhancements to improve student content learning and higher order reasoning, especially for students with disabilities or other learning challenges. This study also documents the extent to which the core components of EU were implemented with fidelity. The authors provide descriptive results on classroom practices (as measured by teacher surveys) and contextual factors that support or hinder implementation (as described during teacher interviews). Future improvements to EU should focus on answering the question: "What is/are the best way(s) for teachers to present SIM routines to their students, particularly for students with learning challenges through SIM intervention?"

During the transition from the elementary to middle grades, young adolescents may become increasingly vulnerable for emotional and behavioral problems. Class-Wide Function-Related Intervention Teams for middle level school (CW-FIT MS), the independent variable examined in this study, was developed to improve teaching and learning by fostering student engagement. The study's purpose was to examine the feasibility and effects of CW-FIT MS Tier 1 implementation in nine middle level school classes using a single-subject ABAB withdrawal design. Participants were 234 students in grades 6-8, including 23 identified as at risk for emotional behavioral disorders. Results of CW-FIT MS Tier 1 implementation showed significant improvement in on-task behavior for groups as well as individual target students, increased teacher praise-to-reprimand ratios, and decreased target student disruptions. Outcomes of social validity surveys were consistent with earlier studies. Study findings extend previous results by demonstrating positive intervention effects in novel settings with a greater number of participants. Study limitations and areas for future research are discussed.

The effectiveness of an experimental middle school fraction intervention was evaluated. The intervention was centered on the number line and incorporated key principles from the science of learning. Sixth graders (N = 51) who struggled with fraction concepts were randomly assigned at the student level to the experimental intervention (n = 28) or to a business-as-usual control who received their school's intervention (n = 23). The experimental intervention occurred over 6 weeks (27 lessons). Fraction number line estimation, magnitude comparisons, concepts, and arithmetic were assessed at pretest, posttest, and delayed posttest. The experimental group demonstrated significantly more learning than the control group from pretest to posttest, with meaningful effect sizes on measures of fraction concepts (g = 1.09), number line estimation as measured by percent absolute error (g = -0.85), and magnitude comparisons (g = 0.82). These improvements held at delayed posttest 7 weeks later. Exploratory analyses showed a significant interaction between classroom attentive behavior and intervention group on fraction concepts at posttest, suggesting a buffering effect of the experimental intervention on the normally negative impact of low attentive behavior on learning. A number line-centered approach to teaching fractions that also incorporates research-based learning strategies helps struggling learners to make durable gains in their conceptual understanding of fractions. [This paper will be published in the "Journal of Educational Psychology."]

Although basing instruction on learning trajectories (LTs) is often recommended, there is little direct evidence regarding the premise of a LT approach--that instruction should be presented (only) one LT level beyond a child's present level. We evaluated this hypothesis in the domain of early shape composition. One group of preschoolers, who were at least two levels below the target instructional LT level, received instruction based on an empirically validated LT. The counterfactual (skip-levels) group received an equal amount of instruction focused only on the target level. At posttest, children in the LT condition exhibited significantly greater learning than children in the skip-levels condition, mainly on near-transfer items; no child-level variables were significant moderators. Implications for theory and practice are discussed. [For the corresponding grantee submission, see ED594902.]

The current study reports the results of a randomized controlled trial examining the impact of the Getting Ready parent engagement intervention on young children's social-emotional competencies and the quality of the student-teacher and parent-teacher relationships. Participants were 267 preschool-aged children and their parents, as well as 97 preschool teachers. All children attended publicly funded preschool programs and were low income. In addition, all were considered educationally at risk due to developmental concerns in the areas of language, cognition and/or social-emotional development. Parent and teacher surveys were administered twice per academic year (fall and spring) for two academic years. Findings indicated that children in the treatment group were rated by their teachers to have greater improvement in social skills over two years of preschool as compared to their peers in the comparison condition. Teachers in the treatment condition reported significantly greater increases in their relationships with children as compared to children in the comparison group. Teachers in the intervention group also reported significant increases in their overall relationships with parents. The current findings illustrate the efficacy of Getting Ready at improving the social skills and important relationships for preschool children experiencing developmental risk. [This paper was published in "Early Childhood Research Quarterly" v48 n3 p303-316 2019.]

Considerable research has examined interventions that facilitate school readiness skills in young children. One intervention, "Red Light, Purple Light Circle Time Games" (RLPL; Tominey and McClelland, 2011; Schmitt et al., 2015), includes music and movement games that aim to foster self-regulation skills. The present study (N = 157) focused on children from families with low-income and compared the RLPL intervention (SR) to a revised version of RLPL that included literacy and math content (SR+) and a Business-As-Usual (BAU) control group. In both versions of the intervention, teachers were trained to administer the self-regulation intervention in preschool classrooms with coaching support. Although not statistically significant, children receiving either version of the intervention gained more in self-regulation on the Head-Toes-Knees-Shoulders (HTKS) over the preschool year compared to the BAU group (ß = 0.09, p = 0.082, Cohen's d = 0.31). Effect sizes were similar to previous studies (Schmitt et al., 2015; Duncan et al., 2018) and translated to a 21% difference in self-regulation over and above the BAU group at post-test. Furthermore, children participating in either version of the intervention gained significantly more in math across the school year compared to children in the BAU group (ß = 0.14; p = 0.003, Cohen's d = 0.38), which translated to a 24% difference in math over and above the BAU group at post-test. Results were somewhat stronger for the SR+ version, although effect sizes across intervention conditions were comparable. There were no statistically significant differences across groups for literacy skills. Results extend previous research and suggest that the RLPL intervention, which includes an explicit focus on self-regulation through music and movement games, may improve children's self-regulation and math scores over the preschool year. [This article was published in "Frontiers in Psychology" 2019.]

This study is a randomized control trial of full- versus half-day prekindergarten (pre-K) in a school district near Denver, Colorado. Four-year-old children were randomly assigned an offer of half-day (4 days/week) or full-day (5 days/week) pre-K that increased class time by 600 hours. The full-day pre-K offer produced substantial, positive effects on children's receptive vocabulary skills (0.275 standard deviations) by the end of pre-K. Among children enrolled in district schools, full-day participants also outperformed their peers on teacher-reported measures of cognition, literacy, math, physical, and socioemotional development. At kindergarten entry, children offered full day still outperformed peers on a widely used measure of basic literacy. The study provides the first rigorous evidence on the impact of full-day preschool on children's school readiness skills.

The advancing social-communication and play (ASAP) intervention was designed as a classroom-based intervention, in which the educational teams serving preschool-aged children with autism spectrum disorder are trained to implement the intervention in order to improve these children's social-communication and play skills. In this 4-year, multi-site efficacy trial, classrooms were randomly assigned to ASAP or a business-as-usual control condition. A total of 78 classrooms, including 161 children, enrolled in this study. No significant group differences were found for the primary outcomes of children's social-communication and play. However, children in the ASAP group showed increased classroom engagement. Additionally, participation in ASAP seemed to have a protective effect for one indicator of teacher burnout. Implications for future research are discussed.

"The SATTS administered a TAACCCT Round 4 institutional grant with a primary goal of applying competency-based education (CBE) to a wide range of career and technical education (CTE) and applied technology programs. The SATTS envisioned using the TAACCCT funds to make its curriculum “more open to the larger environment and successful in transitioning students into employment and further education” (Salt Lake Community College, 2014a). Whereas the SATTS had implemented a form of CBE in the past, the TAACCCT grant provided the opportunity to update CBE to a more current and potentially more impactful model. The version of CBE that SATTS envisioned would shift away from using seat-time, clock-hours, and predominantly face-to-face instruction to credentialing students upon mastery of competencies. This new vision of CBE began to emerge when SLCC joined the Competency-based Education Network (C-BEN) in 2010, making it one of the first community colleges in the nation to join C-BEN, with the TAACCCT grant providing the resources and momentum to scale CBE throughout the SATTS. To this end, the SATTS designated 20 high priority programs of study (POS) to enable students to master industry-focused competencies and obtain credentials to secure living-wage employment. This final third-party evaluation (TPE) report integrates findings from the interim report submitted to Salt Lake Community College (SLCC) and subsequently to the US Department of Labor (DoL) in October 2016 (Bragg, Cosgrove & Cosgrove, 2016) and all evaluation activities through August 31, 2018. This report addresses the DoL requirements to evaluate implementation of the grant-funded POS and all other strategies funded by the grant, as well as to determine the outcomes and impact of the POS using a quasiexperimental design in the form of Propensity Score Matching (PSM). The evaluation had three distinct but also interlocking parts: implementation evaluation, program enrollment and outcomes evaluation, and impact evaluation. "

This report documents the implementation and early impacts of the Workforce Training Academy Connect (WTA Connect) program, operated by Des Moines Area Community College (DMACC) in Des Moines, Iowa. WTA Connect aimed to help low-income, low-skilled adults access and complete occupational training that can lead to increased employment and higher earnings. It is one of nine career pathways programs being evaluated under the Pathways for Advancing Careers and Education (PACE) study sponsored by the Administration for Children and Families. Using a rigorous research design, the study found that WTA Connect resulted in a modest increase in attainment of credentials by participants within the 18-month follow-up period, but no other educational or career impacts. Future reports will examine whether this credential effect translates into gains in employment and earnings. Primary research questions for the study include: (1) Was the intervention implemented as designed?; (2) How did services received differ between study participants who could access the WTA Connect program versus those who could not?; and (3) What were the effects of access to WTA Connect on short-term educational outcomes: credentials attained and hours of occupational training received?

The efficacy of a research-based fraction sense intervention for sixth graders with or at risk for mathematics difficulties (N = 52) was examined. The intervention aimed to build understanding of fraction magnitudes on the number line. Key concepts were taught with a narrow range of denominators to develop deep understanding. The intervention was centered on a visual number line in the meaningful context of a color run race. Students were randomly assigned to the fraction sense intervention (n = 25) or a business-as-usual control group (n = 27). Students in the intervention condition received 21 lessons in small groups (45 min each) during their regular mathematics intervention period. Students in the intervention group performed significantly better than those in the control group on a measure of fraction number line estimation and a more general measure of fraction concepts, both at immediate posttest and delayed posttest, with large effect sizes; lesser effects were shown for fraction arithmetic. [This paper will be published in "Remedial and Special Education."]

The goal of this randomized controlled trial (RCT) was to evaluate the effectiveness of a small-group intervention in fractions for fifth-graders who are performing below grade level in mathematics. The impact of the fractions intervention was assessed on fifth-grade at-risk students' understanding of foundational fractions concepts and procedural competence with fractions. For the fractions intervention, lessons from the "TransMath"® curriculum (Level 2; Woodward & Stroh, 2015) were modified to create 52 thirty-five-minute lessons focused only on fourth- and fifth-grade level fractions content that could be used in a small-group setting. In this rigorous large-scale RCT, a sample of 1,123 students from three school districts across two U.S. states were screened at the beginning of the school year using a fractions measure developed by the research team. Two hundred and five students who scored between the 15th and the 37th percentile on the screening measure and received parental consent to participate were randomly assigned to the intervention (n = 102) and comparison (n = 103) conditions. Students in the fractions intervention condition received 35-minute tutoring sessions 3-4 times a week. Fraction instruction using the 52 "TransMath" lessons was provided by trained tutors. The comparison condition (n = 103) was business as usual instruction (i.e., core classroom fractions instruction, including intervention or support traditionally provided by the school). Results from the final analytic sample of 186 students (87 in intervention, 99 in comparison) showed that the intervention group significantly outperformed the comparison group on all outcome measures, which included an array of assessments used to measure both student understanding of foundational fractions concepts as well as procedural competence with grade-level fraction material (Hedges' g = 0.66 to 1.08; p < 0.0001).

This article presents findings from an intervention across sixth and seventh grades to teach academic words to middle school students. The goals included investigating a progression of outcomes from word knowledge to comprehension and investigating the processes students use in establishing word meaning. Participants in Year 1 were two sixth-grade reading teachers and 105 students (treatment n = 62; control n = 43) and in Year 2, one seventh-grade reading teacher and 87 students (treatment n = 44; control n = 43) from the same public school. In both years, results favored instructed students in word knowledge, lexical access, and morphological awareness on researcher-designed measures. In Year 2, small advances were also found for comprehension. Transcripts of lessons shed light on processes of developing representations of unfamiliar words.

The purpose of the study was to conduct a randomized controlled trial (RCT) to demonstrate efficacy of the Class-wide Function-Related Intervention Teams (CW-FIT) program. The study was designed to replicate an initial RCT conducted by the CW-FIT developers in 1 site, with 2 additional research groups not involved in its development. The study was conducted across 3 states, in 21 culturally diverse schools, and with 83 teachers (classrooms) assigned to CW-FIT and 74 teachers (classrooms) assigned to the comparison group. The CW-FIT intervention included teaching prosocial skills and use of differential attention (teacher praise and points) for appropriate behaviors using a group contingency, class teams, goal setting, points, and rewards. Class-wide student on-task behavior improved, teacher praise and attention to appropriate behaviors increased, and reprimands decreased in the CW-FIT classes with significantly fewer changes over time for the comparison group.

This article presents findings from a randomized controlled trial (RCT) testing the impact of a novel coaching approach utilized as one element of the Double Check cultural responsivity and student engagement model. The RCT included 158 elementary and middle school teachers randomized to receive coaching or serve as comparisons; all participating teachers were exposed to school-wide professional development activities. Pre-post nonexperimental comparisons indicated improvements in self-reported culturally responsive behavior management and self-efficacy for teachers in both conditions following professional development exposure. With regard to the experimental findings, trained observers recorded significantly more proactive behavior management and anticipation of student problems by teachers, higher student cooperation, less student noncooperation, and fewer disruptive behaviors in classrooms led by coached teachers relative to comparison teachers. Taken together, the findings suggest the potential promise of coaching combined with school-wide professional development for improving classroom management practices and possibly reducing office discipline referrals among Black students.

Purpose: This study aimed to examine the effect of an intensive vocabulary intervention embedded in e-books on the vocabulary skills of young Spanish-English speaking English learners (ELs) from low-socioeconomic status backgrounds. Method: Children (N = 288) in kindergarten and 1st grade were randomly assigned to treatment and read-only conditions. All children received e-book readings approximately 3 times a week for 10-20 weeks using the same books. Children in the treatment condition received e-books supplemented with vocabulary instruction that included scaffolding through explanations in Spanish, repetition in English, checks for understanding, and highlighted morphology. Results: There was a main effect of the intervention on expressive labeling (g = 0.38) and vocabulary on the Peabody Picture Vocabulary Test--Fourth Edition (g = 0.14; Dunn & Dunn, 2007), with no significant moderation effect of initial Peabody Picture Vocabulary Test score. There was no significant difference between conditions on children's expressive definitions. Conclusion: Findings substantiate the effectiveness of computer-implemented embedded vocabulary intervention for increasing ELs' vocabulary knowledge.

The Good Behavior Game (GBG) is a classwide group contingency shown to reduce disruptive student behavior. We examined the feasibility of training young students to lead the GBG in one first-grade and three kindergarten classes. We also examined teacher preference for teacher-led GBG, student-led GBG, or no GBG using a concurrent chains procedure. We successfully trained students in all classes to lead the GBG, and the GBG reduced disruptive behavior regardless of who implemented it. Preference for who implemented the game varied across teachers. Results of this study suggest that students as young as kindergarten age can be trained to implement the GBG and that teacher preference should be taken into account when determining how classwide interventions are to be implemented.

This report presents the SPARK literacy model, an innovative approach developed by Boys & Girls Clubs of Greater Milwaukee, for addressing the literacy needs of low-income and minority schools in Milwaukee. It also presents the results of a two-year randomized control trial evaluation of the SPARK literacy program's impact on reading achievement. Through a family-school-community partnership model, SPARK attempts to both build student literacy skills and develop natural supports in the student's family and community that promote a sustained programmatic impact. SPARK was awarded an Investing in Innovation (i3) Department of Education grant to develop the program and test its impact in six Milwaukee Public Schools (MPS). While SPARK was still being developed, 251 students were randomly assigned to receive SPARK for two years and 245 were assigned to the "business as usual" control condition. The study found that SPARK had a small but statistically significant positive impact on student reading achievement, but no impact was found on regular school day attendance. Although the results of the study were somewhat mixed, the family-school-community partnership approach employed by SPARK holds great promise for having a sustained impact on student literacy.

The Learning by Making (LbyM) project is funded by the U.S. Department of Education's Investing in Innovation Fund (i3). As a five-year development project (2014-2018), Sonoma State University (SSU), in partnership with high-need schools and districts, has been developing an innovative, integrated high school Science, Technology, Engineering, and Mathematics (STEM) curriculum. The curriculum consists of Disciplinary Core Ideas (DCIs) in earth science and biology as described in the Next Generation Science Standards (NGSS, 2013) and utilizes an easy-to-use Logo programming language that conducts data transfer and network communications in support of student-designed investigations. The purpose of this study is to understand how LbyM is implemented in high school classrooms in rural environments, to observe the influences of this curriculum on student learning and engagement, and to explore how teachers' instructional practices and technological capacities evolve while using the curriculum. The study used a quasi-experimental design. One hundred thirty-seven students were recruited to enroll in eight LbyM STEM classes in six participating high schools. Three of the participating high schools are small schools, and it is not possible to find comparison students from these small schools. Therefore, all comparison students were recruited from the larger schools, with a total of 141 comparison students from six classrooms in three out of six participating high schools. The results from the study indicated that the LbyM curriculum that was developed by SSU helped teachers integrate NGSS and project-based learning into classroom instruction. Teachers reported spending more instructional time supporting students to collect, organize, display, and present data. Students were highly engaged with the LbyM curriculum and demonstrated increased confidence and problem solving stamina. Teachers reported that some students who typically struggle to participate in class exhibited higher levels of participation in LbyM and even demonstrated leadership. They also reported that some students with special needs, while still requiring extra attention, remained engaged with the curriculum and were even quicker to complete certain activities than the other students. The LbyM curriculum was positively associated with significant gains in students' science content knowledge. It helped low-achieving students improve math understanding.

The purpose of this study was to examine the relative effectiveness of two computer supported approaches to teaching beginning reading skills that differed in important aspects of their instructional approach and emphasis. One of the programs was "Auditory Discrimination in Depth," which provides very explicit instruction and practice in acquiring phonological awareness and phonemic decoding skills. In this program, children spend a lot of time practicing word reading skills out of context, but they also read phonetically controlled text in order to learn how to apply their word reading skills to passages that convey meaning. The other program was "Read, Write, and Type," which provides explicit instruction and practice in phonological awareness, letter sound correspondences, and phonemic decoding, but does so primarily in the context of encouraging children to express themselves in written language. In this program, children spend a greater proportion of their time processing meaningful written material, and they are encouraged to acquire "phonics" knowledge to enable written communication. All the first grade children in five elementary schools were initially screened using a test of letter-sound knowledge. Selection procedures identified 18% of children as the most at risk in these schools to develop problems in learning to read. These 104 children were randomly assigned to the ADD group, and the RWT group. Children were seen from October through May in groups of three children. The children received four, 50 minute sessions per week during this time. Approximately half the time in each instructional session was devoted to direct instruction by a trained teacher in skills and concepts that would be practiced on the computer. The big surprise here was how well everyone did. Particularly in phonemic reading skills, the children in both groups showed very large gains (two full standard deviations) in this area, and their gains in fluency were almost as strong as those for accuracy. The results are encouraging for both intervention programs. It is also important to note that the reading comprehension scores were higher than expected based on the children's estimated general verbal ability.

The National Math + Science Initiative's (NMSI's) College Readiness Program (CRP) is an established program whose goal is to promote science, technology, engineering, and mathematics education in high schools to improve students' readiness for college. It provides teacher, student, and school supports to promote high school students' success in mathematics, science, and English Advanced Placement (AP) courses, with a focus on students who are traditionally underrepresented in the targeted AP courses. Through a federal Investing in Innovation Fund (i3) validation grant awarded to NMSI in 2011, CRP was implemented in a total of 58 high schools in two states--Colorado and Indiana--beginning in the 2012-13 school year. American Institutes for Research (AIR) conducted an independent evaluation of the impacts of CRP on students' AP outcomes in these schools for the three cohorts of schools that adopted the program in sequential years, using a comparative interrupted time series (CITS) design that matched comparison schools to program schools in the two states. Overall, schools implementing CRP demonstrated significantly larger increases in the share of students taking and passing AP tests in targeted areas relative to comparison schools in each of the three cohorts of schools, and the gains in CRP schools were sustained over time. Fidelity of program implementation was evaluated using a fidelity matrix approach required as part of the National Evaluation of the i3 program, which showed that not all elements of the program were implemented with high fidelity. Teachers and students were not always able to attend all meetings, and schools did not always meet negotiated enrollment targets. Teacher survey data indicated that teachers found the professional development activities provided by CRP to be the most helpful support they received under CRP, and students reported that the tutoring and special study sessions were the most helpful. Although the program provided financial incentives to both teachers and students that were tied to student performance on AP tests, these incentives were considered the least important element of the program by both teachers and students

Researchers are increasingly interested in working memory (WM) training. However, it is unclear whether it strengthens comprehension in young children who are at risk for learning difficulties. We conducted a modest study of whether the training of verbal WM would improve verbal WM and passage listening comprehension and whether training effects differed between two approaches: training with and without strategy instruction. A total of 58 first-grade children were randomly assigned to three groups: WM training with a rehearsal strategy, WM training without strategy instruction, and controls. Each member of the two training groups received a one-to-one, 35-min session of verbal WM training on each of 10 consecutive school days, totaling 5.8 hr. Both training groups improved on trained verbal WM tasks, with the rehearsal group making greater gains. Without correction for multiple group comparisons, the rehearsal group made reliable improvements over controls on an untrained verbal WM task and on passage listening comprehension and listening retell measures. The no-strategy-instruction group outperformed controls on passage listening comprehension. When corrected for multiple contrasts, these group differences disappeared but were associated with moderate to large effect sizes. Findings suggest--however tentatively--that brief but intensive verbal WM training may strengthen the verbal WM and comprehension performance of young children at risk. Necessary caveats and possible implications for theory and future research are discussed.

The purpose of this study was to investigate the effectiveness of a variation of the Good Behavior Game (GBG) in which teachers used ClassDojo to manage each team's progress. ClassDojo is a computer-based program that enables teachers to award students with points for demonstrating target behaviors. Dependent variables included class-wide disruptive and academically engaged behavior, teachers' ratings on the Behavior Intervention Rating Scale (BIRS), and the rate of teacher praise statements delivered in each phase. Overall, results indicated that the GBG with ClassDojo was effective at reducing disruptive behavior, increasing academically engaged behavior, and was rated as socially valid. Additionally, when the intervention was in place, increases in the amount of behavior-specific praise statements delivered were observed across all three classrooms.

School psychologists will likely become more involved in supporting the reading achievement of English language learners (ELLs). This requires evidence-based interventions that are validated for ELL students. Incremental rehearsal (IR) is an evidence-based intervention for teaching words, but the resource intensity often precludes its use. Using peers as interventionists may increase the contextual validity of IR while maintaining the benefits when compared with other drill techniques. This efficacy study examined if (a) peer-mediated IR (PMIR) was effective for teaching ELL students high-frequency words and (b) improvements in word reading generalized to changes in students' oral reading fluency. Five ELL students participated in a randomized multiple-baseline design across participants. Results indicated that PMIR was functionally related to an increase in word reading for all 5 participants. Effect sizes estimated using TauU and multilevel modeling indicated that PMIR had a large effect on sight-word reading. No functional relationship between PMIR and oral reading fluency was observed. PMIR was generally acceptable to target students and peer tutors. Limitations and potential implications of the results are discussed.

The achievement gaps between poor and more affluent students are persistent and chronic, as many students living in poverty are also members of more isolated communities where dialects such as African American English and Southern Vernacular English are often spoken. Non-mainstream dialect use is associated with weaker literacy achievement. The principal aims of the two experiments described in this paper were to examine whether second through fourth graders, who use home English in contexts where more formal school English is expected, can be taught to dialect shift between home and school English depending on context; and whether this leads to stronger writing and literacy outcomes. The results of two randomized controlled trials with students within classrooms randomly assigned to DAWS (Dialect Awareness, a program to explicitly teach dialect shifting), editing instruction, or a business as usual group revealed (1) that DAWS was more effective in promoting dialect shifting than instruction that did not explicitly contrast home and school English; and (2) that students in both studies who participated in DAWS were significantly more likely to use school English in contexts where it was expected on proximal and distal outcomes including narrative writing, morphosyntactic awareness, and reading comprehension. Implications for theory and practice are discussed.

This study reports the results of a randomized controlled trial examining the effect of Conjoint Behavioral Consultation (CBC), a family-school partnership intervention, on children's behaviors, parents' skills, and parent-teacher relationships in rural community and town settings. Participants were 267 children, 267 parents, and 152 teachers in 45 Midwestern schools. Using an Intent to Treat approach and data analyzed within a multilevel modeling framework, CBC yielded promising results for some but not all outcomes. Specifically, children participating in CBC experienced decreases in daily reports of aggressiveness, noncompliance, and temper tantrums; and increases in parent-reported adaptive skills and social skills at a significantly greater pace than those in a control group. Other outcomes (e.g., parent reports of internalizing and externalizing behaviors) suggested a nonsignificant effect at post-test. CBC parents reported using more effective parenting strategies, gaining more competence in their problem-solving practices, and feeling more efficacious for helping their child succeed in school than parents in the control group. Parents participating in CBC also reported significant improvements in the parent-teacher relationship, and the parent-teacher relationship mediated the effect of CBC on children's adaptive skills. Implications for practice in rural communities, study limitations, and directions for future research are discussed. [This article was published in "Journal of School Psychology" v62 p81-101 2017.]

The acquisition of early mathematical knowledge is critical for successful long-term academic development. Mathematical language is one of the strongest predictors of children's early mathematical success. Findings from previous studies have provided correlational evidence supporting the importance of mathematical language to the development of children's mathematics skills, but there is limited causal evidence supporting this link. To address this research gap, 47 Head Start children were randomly assigned to a mathematical language intervention group or a business-as-usual group. Over the course of eight weeks, interventionists implemented a dialogic reading intervention focused on quantitative and spatial mathematical language. At posttest, students in the intervention group significantly outperformed the students in the comparison group not only on a mathematical language assessment, but on a mathematical knowledge assessment as well. These findings indicate that increasing children's exposure to mathematical language can positively affect their general mathematics skills. This study is an important first step in providing causal evidence of the importance of early mathematical language for children's general mathematical knowledge and the potential for mathematical language interventions to increase children's overall mathematics abilities.

Reading achievement scores for adolescents with disabilities are markedly lower than the scores of adolescents without disabilities. For example, 62% of students with disabilities read "below" the basic level on the NAEP Reading assessment, compared to 19% of their nondisabled peers. This achievement gap has been a continuing challenge for more than 35 years. In this article, we report on the promise of a comprehensive 2-year reading program called Fusion Reading. Fusion Reading is designed to significantly narrow the reading achievement gap of middle school students with reading disabilities. Using a quasi-experimental design with matched groups of middle school students with reading disabilities, statistically significant differences were found between the experimental and comparison conditions on multiple measures of reading achievement with scores favoring the experimental condition. The effect size of the differences were Hedges's g = 1.66 to g = 1.04 on standardized measures of reading achievement.

Objective: To evaluate the effectiveness of 2 brief school-based interventions targeting the homework problems of adolescents with attention-deficit/hyperactivity disorder (ADHD)--the Homework, Organization, and Planning Skills (HOPS) intervention and the Completing Homework by Improving Efficiency and Focus (CHIEF) intervention, as implemented by school mental health providers during the school day. A secondary goal was to use moderator analyses to identify student characteristics that may differentially predict intervention response. Method: Two-hundred and eighty middle school students with ADHD were randomized to the HOPS or CHIEF interventions or to waitlist, and parent and teacher ratings were collected pre, post, and at a 6-month follow-up. Results: Both interventions were implemented with fidelity by school mental health providers. Participants were pulled from elective periods and sessions averaged less than 20 min. Participants in HOPS and CHIEF demonstrated significantly greater improvements in comparison with waitlist on parent ratings of homework problems and organizational skills and effect sizes were large. HOPS participants also demonstrated moderate effect size improvements on materials management and organized action behaviors according to teachers. HOPS participants made significantly greater improvements in parent- and teacher-rated use of organized actions in comparison with CHIEF, but not on measures of homework problems. Moderation analyses revealed that participants with more severe psychopathology and behavioral dysregulation did significantly better with the HOPS intervention as compared to the CHIEF intervention. Conclusions: Brief school-based interventions implemented by school providers can be effective. This type of service delivery model may facilitate overcoming the oft cited research-to-practice gap. [At the time of submission to ERIC, this article was in press with "Journal of Consulting and Clinical Psychology."]

This study reports 2 years of findings from a randomized controlled trial designed to replicate and demonstrate the efficacy of an existing, successful professional development program, the Pathway Project, that uses a cognitive strategies approach to text-based analytical writing. Building on an earlier randomized field trial in a large, urban, low socioeconomic status (SES) district in which 98% of the students were Latino and 88% were mainstreamed English learners (ELs) at the intermediate level of fluency, the project aimed to help secondary school students, specifically Latinos and mainstreamed ELs, in another large, urban, low-SES district to develop the academic writing skills called for in the rigorous Common Core State Standards for English Language Arts. The Pathway Project draws on well-documented instructional frameworks that support approaches that incorporate strategy instruction to enhance students' academic literacy. Ninety-five teachers in 16 secondary schools were stratified by school and grade and then randomly assigned to the Pathway or control group. Pathway teachers participated in 46 hr of training to help students write analytical essays. Difference-in-differences and regression analyses revealed significant effects on student writing outcomes in both years of the intervention (Year 1, d = 0.48; Year 2, d = 0.60). Additionally, Pathway students had higher odds than control students of passing the California High School Exit Exam in both years.

Challenging behavior in preschool is a serious concern for teachers. Positive behavior interventions and supports (PBIS) have been shown to be effective in reducing such behaviors. Class-Wide Function-Related Intervention Teams (CW-FIT) is a specific multi-tiered intervention for implementing effective classroom management strategies using PBIS practices. CW-FIT has been shown to be effective in elementary classrooms but has not yet been evaluated with younger age groups. CW-FIT Tier 1 is a group contingency utilizing social skills training, teacher praise, and positive reinforcement to improve student behavior. The present study examined the effects of CW-FIT Tier 1 implementation on student group on-task behavior and on teacher praise and reprimand rates in four preschool classrooms. A single-subject delayed multiple baseline design with embedded reversals was used to evaluate impact. Results indicated the intervention increased student group on-task behavior and teacher praise to reprimand ratios. Both teachers and children found CW-FIT Tier 1 to be socially valid. Limitations and implications of this study for researchers and practitioners are discussed.

Comprehension monitoring has received substantial attention as a reading comprehension strategy. However, comprehension monitoring is not limited to the reading context, but applies to the oral context for children's listening comprehension, which is a critical foundation for reading comprehension. Therefore, a systematic and explicit instructional routine for comprehension monitoring in oral language contexts was developed for prekindergartners from low-income families. Instruction was provided in small groups for approximately 5 min a day for 4 days a week for 8 weeks. Results showed that children who received comprehension monitoring instruction were better at identifying inconsistencies in short stories than those who received typical instruction with a medium effect size (d = 0.57). These results suggest comprehension monitoring is malleable and can be taught in the oral language context to prereaders from low socioeconomic backgrounds. Furthermore, the instructional routine reported in this study is flexible for individual, small group, or whole class settings, and likely can be easily delivered by educators such as teachers and paraeducators.

Purpose: We examined the effects of a text-processing reading comprehension intervention emphasizing listening comprehension and expressive language practices with middle school students with reading difficulties. Method: A total of 134 struggling readers in grades 6-8 were randomly assigned to treatment (n = 83) and control conditions (n = 51) using a 2:1 ratio (two students randomized to treatment for every one student randomized to control). Students in the treatment condition received 40 min of daily instruction in small groups of four to six students for approximately 17 hr. Results: One-way analysis of covariance models on outcome measures with the respective pretest scores as a covariate revealed significant gains on proximal measures of vocabulary and key word and main idea formulation. No significant differences were found on standardized measures of listening and reading comprehension. Discussion: Results provide preliminary support for integrating listening comprehension and expressive language practices within a text-processing reading comprehension intervention framework for middle-grade struggling readers.

Schools continue to strive for the use of evidenced-based interventions and policies to foster well-managed classrooms that promote improved student outcomes. The present study examined the effects of the Class-Wide Function-related Intervention Teams (CW-FIT), a group contingency intervention, on the on-task and disruptive behavior of elementary school students with or at risk for emotional behavior disorders (EBD). Seventeen elementary schools, 159 general education teachers, and 313 students participated in the randomized-control group design study. Fidelity of implementation was strong for intervention group teachers and was measured across groups and throughout baseline conditions. Results suggest that CW-FIT can be used to increase on-task behavior and reduce the disruptive behavior of students with or at risk for EBD. In addition, teachers in intervention classes increased praise and reduced reprimands to individual students and along with their students, reported high levels of consumer satisfaction.

Enhancing the social and learning experiences of students with severe disabilities in inclusive classrooms has been a long-standing focus of research, legislative, and advocacy efforts. The authors used a randomized controlled experimental design to examine the efficacy of peer support arrangements to improve academic and social outcomes for 51 students with severe disabilities in high school general education classrooms. Paraprofessionals or special educators recruited, trained, and supported 106 peers to provide individualized academic and social assistance to students with severe disabilities throughout one semester. Compared to students exclusively receiving adult-delivered support (n = 48), students participating in peer support arrangements experienced increased interactions with peers, increased academic engagement, more progress on individualized social goals, increased social participation, and a greater number of new friendships. Moreover, an appreciable proportion of relationships lasted one and two semesters later after the intervention had concluded. These findings challenge prevailing practices for supporting inclusive education and establish the efficacy and social validity of peer support arrangements as a promising alternative to individually assigned paraprofessional support.

The purpose of this study was to investigate the effects of an early numeracy intervention delivered by kindergarten teachers to students identified as having mathematics difficulties. A multigroup growth-modeling-with-random-assignment-to-intervention-condition design was employed. Thirty-two teachers were randomly assigned to the treatment or comparison condition. A total of 71 students participated in the study, 47 in the treatment group and 24 in the comparison group. Results indicated that the treatment condition students outperformed comparison students (g* = 0.99) and demonstrated statistically significantly higher scores on all proximal measures of early numeracy. Also, about 80% to 100% of the variance was accounted for at the student level. Performance on distal measures was less impressive, with no significant differences between groups; the effect size was 0.44. Teachers rated components of the intervention highly, reflecting strong teacher satisfaction.

The purpose of this closely aligned conceptual replication study was to investigate the efficacy of a Tier 2 kindergarten mathematics intervention. The replication study differed from the initial randomized controlled trial on three important elements: geographical region, timing of the intervention, and instructional context of the counterfactual. Similar to the original investigation, however, the current study tested the same intervention, used the same outcome measures and statistical analyses, and involved the same population of learners. A total of 319 kindergarten students with mathematics difficulties from 36 kindergarten classrooms participated in the study. Students who were randomly assigned to the treatment condition received the intervention in small-group formats, with 2 or 5 students per group. Control students participated in a no-treatment control condition. Significant effects on proximal and distal measures of mathematics achievement were found. Effect sizes obtained for all measures fell within or exceeded the upper bound of the effects reported in the initial study. Implications for systematically situating replication studies in larger frameworks of intervention research and reporting rates of treatment response across replication studies are discussed.

The purpose of this closely aligned conceptual replication study was to investigate the efficacy of a Tier 2 kindergarten mathematics intervention. The replication study differed from the initial randomized controlled trial on three important elements: geographical region, timing of the intervention, and instructional context of the counterfactual. Similar to the original investigation, however, the current study tested the same intervention, used the same outcome measures and statistical analyses, and involved the same population of learners. A total of 319 kindergarten students with mathematics difficulties from 36 kindergarten classrooms participated in the study. Students who were randomly assigned to the treatment condition received the intervention in small-group formats, with 2 or 5 students per group. Control students participated in a no-treatment control condition. Significant effects on proximal and distal measures of mathematics achievement were found. Effect sizes obtained for all measures fell within or exceeded the upper bound of the effects reported in the initial study. Implications for systematically situating replication studies in larger frameworks of intervention research and reporting rates of treatment response across replication studies are discussed. [This paper was published in "Exceptional Children" (EJ1116305).]

This study evaluated the effects of a mathematics software program, the Building Blocks software suite, on young children's mathematics performance. Participants included 247 Kindergartners from 37 classrooms in 9 schools located in low-income communities. Children within classrooms were randomly assigned to receive 21 weeks of computer-assisted instruction (CAI) in mathematics with Building Blocks or in literacy with Earobics Step 1. Children in the Building Blocks condition evidenced higher posttest scores on tests of numeracy and Applied Problems after controlling for beginning-of-year numeracy scores and classroom nesting. These findings, together with a review of earlier CAI, provide guidance for future work on CAI aiming to improve mathematics performance of children from low-income backgrounds. [This paper was published in "Journal for Research in Mathematics Education" (EJ1100307).]

Objectives: This study evaluated the efficacy of a novel psychosocial intervention (Collaborative Life Skills, CLS) for primary-school students with ADHD symptoms. CLS is a 12-week program consisting of integrated school, parent, and student treatments delivered by school-based mental health providers. Using a cluster randomized design, CLS was compared to usual school/community services on psychopathology and functional outcomes. Methods: Schools within a large urban public school district were randomly assigned to CLS (12 schools) or usual services (11 schools). Approximately six students participated at each school (N = 135, mean age = 8.4 years, grade range = 2nd-5th, 71% boys). Using PROC GENMOD (SAS 9.4) the difference between the means of CLS and usual services for each outcome at post-treatment was tested. To account for clustering effects by school, the Generalized Estimating Equation method was used. Results: Students from schools assigned to CLS, relative to those assigned to usual services, had significantly greater improvement on parent and teacher ratings of ADHD symptom severity and organizational functioning, teacher-rated academic performance and parent ratings of ODD symptoms and social/interpersonal skills. Conclusions: These results support the efficacy of CLS relative to typical school and community practices for reducing ADHD and ODD symptoms and improving key areas of functional impairment. They further suggest that existing school-based mental health resources can be re-deployed from non-empirically supported practices to those with documented efficacy. This model holds promise for improving access to efficient, evidence-based treatment for inattentive and disruptive behavior beyond the clinic setting. [This article was published in the "Journal of the American Academy of Child and Adolescent Psychiatry," v55 p762-770 2016.]

The goal of the current research was to better understand when and why feedback has positive effects on learning and to identify features of feedback that may improve its efficacy. In a randomized experiment, second-grade children (N = 75) received instruction on a correct problem-solving strategy and then solved a set of relevant problems. Children were assigned to receive no feedback, immediate feedback, or summative feedback from the computer. On a posttest the following day, feedback resulted in higher scores relative to no feedback for children who started with low prior knowledge. Immediate feedback was particularly effective, facilitating mastery of the material for children with both low and high prior knowledge. Results suggest that minimal computer-generated feedback can be a powerful form of guidance during problem solving.

The goal of the current research was to better understand when and why feedback has positive effects on learning and to identify features of feedback that may improve its efficacy. In a randomized experiment, second-grade children (N = 75) received instruction on a correct problem-solving strategy and then solved a set of relevant problems. Children were assigned to receive no feedback, immediate feedback, or summative feedback from the computer. On a posttest the following day, feedback resulted in higher scores relative to no feedback for children who started with low prior knowledge. Immediate feedback was particularly effective, facilitating mastery of the material for children with both low and high prior knowledge. Results suggest that minimal computer-generated feedback can be a powerful form of guidance during problem solving.

The purposes of this study were to (a) investigate the efficacy of a core fraction intervention program on understanding and calculation skill and (b) isolate the effects of different forms of fraction word-problem (WP) intervention delivered as part of the larger program. At-risk 4th graders (n = 213) were randomly assigned at the individual level to receive the school's business-as-usual program or 1 of 2 variants of the core fraction intervention (each 12 weeks, 3 sessions/week). In each session of the 2 variants, 28 min were identical, focused mainly on the measurement interpretation of fractions. The other 7 min addressed fraction WPs: multiplicative WPs versus additive WPs. Children were pre- and posttested on fraction understanding, calculations, and WPs. On understanding and calculations, both intervention conditions outperformed the control group, and the effect of intervention versus control on released fraction items from the National Assessment of Education Progress were mediated by children's improvement in the measurement interpretation of fractions. On multiplicative WPs, multiplicative WP intervention was superior to the other 2 conditions, but additive WP intervention and the control group performed comparably. By contrast, on additive WPs, there was a step-down effect in which additive WP intervention was superior to multiplicative WP intervention, which was superior to control. [This paper was published in "Elementary School Journal," v116 n4 p625-661 Jun 2016 (EJ1103953).]

The purposes of this study were to (a) investigate the efficacy of a core fraction intervention program on understanding and calculation skill and (b) isolate the effects of different forms of fraction word-problem (WP) intervention. At-risk fourth graders (n = 213) were randomly assigned to the school's business-as-usual program, or one of two variants of the core fraction intervention (each 12 weeks, 36 sessions). In each session of the two variants, 28 minutes were identical, focused mainly on the measurement interpretation of fractions. The other 7 minutes addressed multiplicative WPs versus additive WPs. Children were pre-/posttested on fraction understanding, calculations, and WPs. On understanding and calculations, both intervention conditions outperformed the control group. The effect of intervention versus control on released fraction items from the National Assessment of Education Progress was mediated by children's improvement in the measurement interpretation of fractions. On multiplicative WPs, multiplicative WP intervention was superior to the other conditions, but additive WP intervention and the control group performed comparably. On additive WPs, additive WP intervention was superior to multiplicative WP intervention, which was superior to control.

The main purposes of this study were to test the effects of teaching at-risk 4th graders to provide explanations for their mathematics work and examine whether those effects occur by compensating for limitations in cognitive processes. We randomly assigned 212 children to 3 conditions: a control group and 2 variants of a multicomponent fraction intervention. Both intervention conditions included 36 sessions, each lasting 35 min. All but 7 min of each session were identical. In the 7-min component, students were taught to provide high quality explanations when comparing fraction magnitudes or to solve fraction word problems. Children were pretested on cognitive variables and pre/posttested on fraction knowledge. On accuracy of magnitude comparisons and quality of explanations, children who received the explaining intervention outperformed those in the word-problem condition. On word problems, children who received the word-problem intervention outperformed those in the explaining condition. Moderator analyses indicated that the explaining intervention was more effective for students with weaker working memory, while the word-problem intervention was more effective for students with stronger reasoning ability.

The main purposes of this study were to test the effects of teaching at-risk 4th graders to provide explanations for their mathematics work and examine whether those effects occur by compensating for limitations in cognitive processes. We randomly assigned 212 children to 3 conditions: a control group and 2 variants of a multicomponent fraction intervention. Both intervention conditions included 36 sessions, each lasting 35 min. All but 7 min of each session were identical. In the 7-min component, students were taught to provide high quality explanations when comparing fraction magnitudes or to solve fraction word problems. Children were pretested on cognitive variables and pre/posttested on fraction knowledge. On accuracy of magnitude comparisons and quality of explanations, children who received the explaining intervention outperformed those in the word-problem condition. On word problems, children who received the word-problem intervention outperformed those in the explaining condition. Moderator analyses indicated that the explaining intervention was more effective for students with weaker working memory, while the word-problem intervention was more effective for students with stronger reasoning ability.

The main purposes of this study were to test the effects of teaching at-risk 4th graders to provide explanations for their mathematics work and examine whether those effects occur by compensating for limitations in cognitive processes. We randomly assigned 212 children to 3 conditions: a control group and 2 variants of a multicomponent fraction intervention. Both intervention conditions included 36 sessions, each lasting 35 min. All but 7 min of each session were identical. In the 7-min component, students were taught to provide high quality explanations when comparing fraction magnitudes or to solve fraction word problems. Children were pretested on cognitive variables and pre/posttested on fraction knowledge. On accuracy of magnitude comparisons and quality of explanations, children who received the explaining intervention outperformed those in the word-problem condition. On word problems, children who received the word-problem intervention outperformed those in the explaining condition. Moderator analyses indicated that the explaining intervention was more effective for students with weaker working memory, while the word-problem intervention was more effective for students with stronger reasoning ability.

The purpose of this study was to test the promise of the NumberShire Level 1 Gaming Intervention (NS1) to accelerate math learning for first-grade students with or at risk for math difficulties. The NS1 intervention was developed through the Institute of Education Sciences, Small Business Innovation Research Program (Gause, Fien, Baker, & Clarke, 2011 Gause, M., Fien, H., Baker, S. K., & Clarke, B. (2011). Project NumberShire I: A game-based integrated learning and assessment system to target whole number concepts. This study used a randomized controlled trial design to test the promise of the NS1 intervention. In total, 250 first-grade students were randomly assigned within classrooms to the treatment condition or a control condition. Results indicate significant effects favoring the treatment group on proximal measures of whole-number concepts and skills. Intervention effects were not statistically significant for distal outcome measures. Treatment effects were not moderated by special education or English learner status; however, the condition by initial skill level interaction approached significance. Additionally, there was no relationship between dosage variables and students' response to the intervention. Limitations and future directions for research are discussed. [This paper was published in "Journal of Research on Educational Effectiveness" (EJ1115268).]

This report presents the final results of a four-year independent external evaluation of the impacts and implementation of the scale-up of Reading Recovery, a literacy intervention targeting struggling 1st-grade students. The evaluation of Reading Recovery includes parallel rigorous experimental and quasi-experimental designs for estimating program impacts, coupled with a large-scale, mixed-methods study of program implementation under the Investing in Innovation (i3) scale-up. The primary goals of the evaluation are to: (1) Provide experimental evidence of the short- and long-term impacts of Reading Recovery on student learning in schools that are part of the i3 scale-up; and (2) Assess the implementation of Reading Recovery under the i3 grant, including fidelity to the program model and progress toward the scale-up goals. The impact evaluation includes a multi-site randomized controlled trial (RCT) for estimating immediate impacts, a regression discontinuity study (RD) for estimating longterm impacts, and an implementation study for assessing fidelity of implementation and exploring program implementation in depth. The RCT includes nearly 7,000 randomized students in more than 1,200 schools over four years. The RD study measures Reading Recovery's impacts at the end of first grade and in third grade, and replicates the RCT's immediate post-treatment findings in a separate sample of students. The implementation study involves a combination of qualitative and quantitative research executed on a large scale over the same four-year timeframe. The evaluation's key findings pertain to the following topics: (1) Scale-Up Processes, Challenges, and Outcomes; (2) Immediate Impacts of Reading Recovery; (3) Sustained Impacts of Reading Recovery; and (4) Implementation Fidelity. The authors' analysis revealed strong fidelity to the program model in all of these areas and all years of the scale-up. This suggests that the intervention was delivered as designed to the students in the scale-up, and that teachers delivering Reading Recovery lessons were properly trained. In total, the results of the fidelity analysis support the validity of their impact findings. Three appendices are included. [To view the brief for this report, "Evidence for Early Literacy Intervention: The Impacts of Reading Recovery," see ED586802.]

The Expository Reading and Writing Course (ERWC) was developed by California State University (CSU) faculty and high school educators to improve the academic literacy of high school seniors, thereby reducing the need for students to enroll in remedial English courses upon entering college. This report, produced by Innovation Studies at WestEd, presents the findings of an independent evaluation of the ERWC funded by an Investing in Innovation (i3) development grant from the U.S. Department of Education. The study sample for the evaluation included more than 5,000 12th grade students in 24 high schools across nine California school districts in the 2013/14 school year. The authors of the report found that the ERWC has a statistically significant positive impact on student achievement. Results from an analysis of implementation fidelity are also presented, along with qualitative findings based on survey data from study participants. Appendixes include: (1) Statistical Power for Impact Estimates; (2) Data Collection Instruments to Measure Fidelity of Implementation; and (3) Rubric for Calculating Fidelity of Implementation for Each Component of the Expository Reading and Writing Course.

Background/Context: Billions of dollars are spent annually on professional development (PD) for educators, yet few randomized controlled trials (RCT) have demonstrated the ultimate impact PD has on student learning. Further, while policymakers and others speak to the role schools should play in developing students' civic awareness, RCTs of PD designed to foster civic learning are rare. This randomized controlled trial contributes to the knowledge base on the effectiveness of PD designed to integrate civic learning, ethical reflection, and historical thinking skills into high school humanities courses. Focus of Study: The study examined the impact of a PD intervention in two areas: (a) teacher self-efficacy, burnout, and professional engagement and satisfaction; and (b) the academic, civic, social, and ethical competencies of 9th and 10th grade students in the teachers' classes. Population/Participants/Subjects: The study involved 113 teachers and 1,371 9th and 10th grade students in 60 high schools from eight metropolitan regions in the United States. Intervention/Program/Practice: The intervention, Facing History and Ourselves, provides PD through a five-day seminar, curricular materials, and follow-up coaching and workshops to help teachers develop their capacities to implement an interdisciplinary historical case study unit using student-centered pedagogy. Research Design: The study used a school-level, randomized, experimental design to investigate impacts of the intervention for teachers and their 9th and 10th grade students. Findings/Results: Intervention teachers showed significantly greater self-efficacy in all eight assessed domains, more positive perceptions of professional support, satisfaction and growth, and greater personal accomplishment. Intervention students demonstrated stronger skills for analyzing evidence, agency, and cause and effect on an historical understanding performance measure; greater self-reported civic efficacy and tolerance for others with different views; and more positive perceptions of the classroom climate and the opportunities afforded for engaging with civic matters. Fidelity analysis found these causal effects despite the fact that roughly half of the intervention teachers did not fully implement the program. Conclusions/Recommendations: Educators need evidence-based approaches for teaching complex social, civic, and political issues enabling students of diverse mindsets and backgrounds to engage constructively with one another while obtaining necessary skills and knowledge. These findings provide empirical support for a professional development approach that engages teachers in fostering academic and civic competencies critical to both participation in a democracy and success in college and career.

Chicago Public Schools initiated the Excellence in Teaching Project, a teacher evaluation program designed to increase student learning by improving classroom instruction through structured principal-teacher dialogue. The pilot began in forty-four elementary schools in 2008-09 (cohort 1) and scaled up to include an additional forty-eight elementary schools in 2009-10 (cohort 2). Leveraging the experimental design of the roll-out, cohort 1 schools performed better in reading and math than cohort 2 schools at the end of the first year, though the math effects are not statistically significant. We find the initial improvement for cohort 1 schools remains even after cohort 2 schools adopted the program. Moreover, the pilot differentially impacted schools with different characteristics. Higher-achieving and lower-poverty schools were the primary beneficiaries, suggesting the intervention was most successful in more advantaged schools. These findings are relevant for policy makers and school leaders who are implementing evaluation systems that incorporate classroom observations.

Students often misinterpret the equal sign (=) as operational instead of relational. Research indicates misinterpretation of the equal sign occurs because students receive relatively little exposure to equations that promote relational understanding of the equal sign. No study, however, has examined effects of nonstandard equations on the equation solving and equal-sign understanding of students with mathematics difficulty (MD). In the present study, second-grade students with MD (n = 51) were randomly assigned to standard equations tutoring, combined tutoring (standard and nonstandard equations), and no-tutoring control. Combined tutoring students demonstrated greater gains on equation-solving assessments and equal-sign tasks compared to the other two conditions. Standard tutoring students demonstrated improved skill on equation solving over control students, but combined tutoring students' performance gains were significantly larger. Results indicate that exposure to and practice with nonstandard equations positively influence student understanding of the equal sign.

Students often misinterpret the equal sign (=) as operational instead of relational. Research indicates misinterpretation of the equal sign occurs because students receive relatively little exposure to equations that promote relational understanding of the equal sign. No study, however, has examined effects of nonstandard equations on the equation solving and equal-sign understanding of students with mathematics difficulty (MD). In the present study, second-grade students with MD (n = 51) were randomly assigned to standard equations tutoring, combined tutoring (standard and nonstandard equations), and no-tutoring control. Combined tutoring students demonstrated greater gains on equation-solving assessments and equal-sign tasks compared to the other two conditions. Standard tutoring students demonstrated improved skill on equation solving over control students, but combined tutoring students' performance gains were significantly larger. Results indicate that exposure to and practice with nonstandard equations positively influence student understanding of the equal sign.

The focus of the present study was enhancing word problem and calculation achievement in ways that support prealgebraic thinking among second-grade students at risk for mathematics difficulty. Intervention relied on a multitier support system (i.e., responsiveness to intervention, or RTI) in which at-risk students participate in general classroom instruction and receive supplementary small-group tutoring. Participants were 265 students in 110 classrooms in 25 schools. Teachers were randomly assigned to one of three conditions: calculation RTI, word problem RTI, or business-as-usual control. Intervention lasted 17 weeks. Multilevel modeling indicated that calculation RTI improved calculation but not word problem outcomes, word problem RTI enhanced proximal word problem outcomes as well as performance on some calculation outcomes, and word problem RTI provided a stronger route than calculation RTI to prealgebraic knowledge.

The focus of the present study was enhancing word problem and calculation achievement in ways that support prealgebraic thinking among second-grade students at risk for mathematics difficulty. Intervention relied on a multitier support system (i.e., responsiveness to intervention, or RTI) in which at-risk students participate in general classroom instruction and receive supplementary small-group tutoring. Participants were 265 students in 110 classrooms in 25 schools. Teachers were randomly assigned to one of three conditions: calculation RTI, word problem RTI, or business-as-usual control. Intervention lasted 17 weeks. Multilevel modeling indicated that calculation RTI improved calculation but not word problem outcomes, word problem RTI enhanced proximal word problem outcomes as well as performance on some calculation outcomes, and word problem RTI provided a stronger route than calculation RTI to prealgebraic knowledge.

A two-cohort cluster randomized trial was conducted to estimate effects of small-group supplemental vocabulary instruction for at-risk kindergarten English learners (ELs). "Connections" students received explicit instruction in high-frequency decodable root words, and interactive book reading (IBR) students were taught the same words in a storybook reading context. A total of 324 EL students representing 24 home languages and averaging in the 10th percentile in receptive vocabulary completed the study ("Connections" n = 163 in 75 small groups; IBR n = 161 in 72 IBR small groups). Although small groups in both conditions made significant immediate gains across all measures, "Connections" students made significantly greater gains in reading vocabulary and decoding (d = 0.64 and 0.45, respectively). At first-grade follow-up, longer-term gains were again greater for Connections students, but with smaller effect sizes (d = 0.29 and 0.27, respectively). Results indicate that explicit "Connections" instruction features designed to build semantic, orthographic and phonological connections for word learning were effective for improving proximal reading vocabulary and general decoding; however, increases in root word reading vocabulary did not transfer to general vocabulary knowledge. Additional tables are presented in two appendices. [At time of submission to ERIC this article was in press with the "Journal of Research on Educational Effectiveness."]

The efficacy of a research-based number-sense intervention for low-achieving kindergartners was examined. Children (N = 126) were randomly assigned to 1 of 3 conditions: a number-sense intervention followed by a number-fact practice session, an identical number-sense intervention followed by a number-list practice session, or a business-as-usual control group. The number-fact practice condition not only gave children an additional advantage over the number-list practice condition on the outcomes at delayed posttest 8 weeks later but also was especially effective for producing gains in English learners.