This practice guide provides four evidence-based recommendations that teachers can use to deliver reading interventions to meet the needs of their students.

This practice guide provides evidence-based practices that can help teachers tailor their instructional approaches and/or their mathematics intervention programs to meet the needs of their students.

This practice guide presents three evidence-based recommendations for helping students in grades 6–12 develop effective writing skills. Each recommendation includes specific, actionable guidance for educators on implementing practices in their classrooms. The guide also summarizes and rates the evidence supporting each recommendation, describes examples to use in class, and offers the panel’s advice on how to overcome potential implementation obstacles. This guide is geared towards administrators and teachers in all disciplines who want to help improve their students’ writing.

This practice guide provides four recommendations that address what works for English learners during reading and content area instruction. Each recommendation includes extensive examples of activities that can be used to support students as they build the language and literacy skills needed to be successful in school. The recommendations also summarize and rate supporting evidence. This guide is geared toward teachers, administrators, and other educators who want to improve instruction in academic content and literacy for English learners in elementary and middle school.

This practice guide provides four recommendations for improving elementary students’ writing. Each recommendation includes implementation steps and solutions for common roadblocks. The recommendations also summarize and rate supporting evidence. This guide is geared toward teachers, literacy coaches, and other educators who want to improve the writing of their elementary students.

This practice guide provides five recommendations for improving students’ mathematical problem solving in grades 4 through 8. This guide is geared toward teachers, math coaches, other educators, and curriculum developers who want to improve the mathematical problem solving of students.

This practice guide presents five recommendations intended to help educators improve students’ understanding of fractions. Recommendations include strategies to develop young children’s understanding of early fraction concepts and ideas for helping older children understand the meaning of fractions and the computations involved. The guide also highlights ways to build on students’ existing strategies to solve problems involving ratios, rates, and proportions.

Out-of-school time programs can enhance academic achievement by helping students learn outside the classroom.

Taking early action may be key to helping students struggling with mathematics.

Designed for elementary school educators and school- and district-level administrators, this guide offers prevention, implementation, and schoolwide strategies that can be used to reduce problematic behavior that interferes with the ability of students to attend to and engage fully in instructional activities.

This guide presents strategies that classroom teachers and specialists can use to increase the reading ability of adolescent students.

The target audience for this guide is a broad spectrum of school practitioners such as administrators, curriculum specialists, coaches, staff development specialists and teachers who face the challenge of providing effective literacy instruction for English language learners in the elementary grades.

The objective of this guide is to provide teachers with specific recommendations that can be carried out in the classroom without requiring systemic change.

This guide includes a set of concrete actions relating to the use of instructional and study time that are applicable to subjects that demand a great deal of content learning, including social studies, science, and mathematics.

This guide offers five recommendations to help educators effectively use data to monitor students’ academic progress and evaluate instructional practices.

This guide identifies practices that can improve the performance of chronically low-performing schools—a process commonly referred to as creating "turnaround schools."

Class-Wide Function-Related Intervention Teams (CW-FIT) is a classroom management strategy designed to help teachers create a positive learning environment by decreasing disruptive behavior and improving social skills and prosocial behaviors among students.

Good Behavior Game is a classroom management strategy that aims to improve social skills, minimize disruptive behaviors, and create a positive learning environment. Teachers place students into teams and reward them for demonstrating appropriate behaviors and following classroom rules.

Web-Based Intelligent Tutoring for the Structure Strategy (ITSS) is a supplemental web-based program for students in grades K-8. It is intended to develop literacy skills needed to understand factual texts encountered in classrooms and everyday life. The program teaches students how to follow the logical structure of factual text and to use text structure to improve understanding and recall. In particular, ITSS highlights five main text structures that are used to (1) make comparisons; (2) present problems and solutions; (3) link causes and effects; (4) present sequences; and (5) describe things, people, creatures, places, or events. The program helps students classify the structure of a passage by identifying certain key words, such as “solution” and “in contrast,” that clue readers in to the type of arguments the text is making.

The Knowledge is Power Program (KIPP) is a nationwide network of free open-enrollment college-preparatory schools in under-resourced communities throughout the United States. KIPP schools are usually established under state charter school laws and KIPP is America’s largest network of charter schools. KIPP Aims to prepare poor and minority students to succeed in a college preparatory curriculum. It provides training for principals and offers them greater autonomy over budget and hiring decisions. KIPP schools provide about 60% more instructional time than traditional public schools—through a longer school day and additional instructional days on Saturdays and in the summer.

READ 180® is a reading program designed for struggling readers who are reading 2 or more years below grade level. It combines online and direct instruction, student assessment, and teacher professional development. READ 180® is delivered in 90-minute sessions that include whole-group instruction, three small-group rotations, and whole-class wrap-up. Small-group rotations include individualized instruction using an adaptive computer application, small-group instruction, and independent reading. READ 180® is designed for students in elementary through high school.

Teach For America (TFA) is a highly selective route to teacher certification that aims to place non-traditionally trained teachers in high-need public schools. Many TFA teachers hold bachelors’ degrees from selective colleges and universities, in fields outside of education. TFA teachers commit to teach for at least 2 years. TFA teachers receive 5–7 weeks of in-person training over the summer before they begin teaching, then continue to receive professional development and one-on-one coaching from TFA while teaching, in addition to support provided by their schools and districts. As full-time employees of the public schools where they work, TFA teachers receive the same salary and benefits as other first- or second-year teachers in their school or district.

Dual language programs are long-term instructional programs that provide content and literacy instruction to all students through two languages—English and a partner language—with the goals of promoting academic achievement, bilingualism and biliteracy, and sociocultural competence. Dual language programs can be implemented with students from one language group (in one-way programs) or with students from two language groups (in two-way programs).

The eMINTS Comprehensive Program aims to help teachers improve their practice and the outcomes of their students by offering structured professional development, coaching, and support for integrating technology into the classroom. The program’s goals include supporting teachers in using classroom technology to implement high-quality, inquiry-based learning, in which students develop understanding and knowledge of content matter by engaging in meaningful investigations that require reasoning, judgement, and decision making. The intervention can provide support to teachers in any subject area, including math, literacy, and science.

Achieve3000® is a supplemental online literacy program that provides nonfiction reading content to students in grades preK–12 and focuses on building phonemic awareness, phonics, fluency, reading comprehension, vocabulary, and writing skills. Achieve3000® is designed to help students advance their nonfiction reading skills by providing differentiated online instruction. Teachers use the program with an entire class but the assignments are tailored to each student’s reading ability level. For example, teachers assign an article and related activities to an entire class; the program then tailors the version of the article to each student by automatically increasing the difficulty of text when a student is ready for more challenging text. Achieve3000® provides lessons that follow a five-step routine: (1) respond to a Before Reading Poll, (2) read an article, (3) answer activity questions, (4) respond to an After Reading Poll, and (5) answer a Thought Question. Progress reports and student usage data, provided by the online tool, enable teachers to track both whole-class and individual student progress. The program is designed for diverse student groups, including general education students, struggling readers in need of intensive tutoring, and English learners.

Odyssey® Math is a web-based program developed by Compass Learning® for mathematics instruction in grades K–8. The online program includes a mathematics curriculum and formative assessments designed to support differentiated and data-driven instruction. Based on assessment results, the program generates an individualized sequence of mathematics topics and skills—a “learning path.” Odyssey® Math is often used as a prescriptive tool, where students can start by taking a diagnostic assessment aligned with local or state standards. Teachers can modify learning paths to match their lesson plans or to align them with district scopes and sequences.

Cooperative Integrated Reading and Composition^® (CIRC^®) is a comprehensive reading and writing program for students in grades 2–8. It includes story-related activities, direct instruction in reading comprehension, and integrated reading and language arts activities. Pairs of students (grouped either by or across ability levels) read to each other, predict how stories will end, summarize stories, write responses, and practice spelling, decoding, and vocabulary. Within cooperative teams of four, students work to understand the main idea of a story and work through the writing process. The CIRC^® process includes teacher instruction, team practice, peer assessment, and team/partner recognition. A Spanish version of the program was also designed for grades 2–5.

Peer-Assisted Learning Strategies is a peer-tutoring program for grades K–6 that aims to improve student proficiency in several disciplines. During the 30-35 minute peer-tutoring sessions, students take turns acting at the tutor, coaching and correcting one another as they work through problems. The designation of tutoring pairs and skill assignment is based on teacher judgement of student needs and abilities, and teachers reassign tutoring pairs regularly.  

Science Teachers Learning through Lesson Analysis (STeLLA®) is a professional development program, developed by BSCS Science Learning, that aims to improve students’ science achievement by improving teachers’ science content knowledge and their abilities to (a) explain science concepts to students, (b) clearly identify to students the science concepts used in student learning activities, and (c) engage students in thinking about science.

Balanced Leadership® is a professional development program for school principals and other current and aspiring school leaders in schools serving kindergarten through grade 12. School leaders participate in professional development sessions with trained facilitators over one or two years, practice what they learn between sessions, and can receive additional coaching and online support. McREL International, the company that developed the Balanced Leadership® program, based the framework and content of the professional development on research identifying key actions and behaviors of school leaders that are associated with improved student outcomes.

Self-Regulated Strategy Development (SRSD) is an intervention designed to improve students’ academic skills through a six-step process that teaches students specific academic strategies and self-regulation skills. The practice is especially appropriate for students with learning disabilities. The intervention begins with teacher direction and ends with students independently applying the strategy, such as planning and organizing ideas before writing an essay. More specifically, the six steps involve the teacher providing background knowledge, discussing the strategy with the student, modeling the strategy, helping the student memorize the strategy, supporting the strategy, and then watching as the student independently performs the strategy. A key part of the process is teaching self-regulation skills, such as goal-setting and self-monitoring, which aim to help students apply the strategy without guidance. The steps can be combined, changed, reordered, or repeated, depending on the needs of the student. The SRSD model can be used with students in grades 2 through 12 in individual, small group, or whole classroom settings.

Functional behavioral assessment (FBA) is an individualized problem-solving process for addressing student problem behavior. An assessment is conducted to identify the purpose or function of a student's problem behavior. This assessment process involves collecting information about the environmental conditions that precede the problem behavior and the subsequent rewards that reinforce the behavior. The information that is gathered is then used to identify and implement individualized interventions aimed at reducing problem behaviors and increasing positive behaviors. Accordingly, the studies evaluating FBA examine different FBA-based interventions identified for each student. FBA-based interventions can be used to address diverse problem behaviors, such as disruptive and off-task behaviors, noncompliance, and inappropriate social interactions.

Everyday Mathematics® is a core curriculum for students in prekindergarten through grade 6. At each grade level, the Everyday Mathematics® curriculum provides students with multiple opportunities to learn concepts and practice skills. Across grade levels, concepts are reviewed and extended in varying instructional contexts. The distinguishing features of Everyday Mathematics® are its focus on real-life problem solving, student communication of mathematical thinking, and appropriate use of technology. This curriculum also emphasizes balancing different types of instruction (including collaborative learning), using various methods for skills practice, and fostering parent involvement in student learning.

Open Court Reading© is a reading program for grades K–6 that is designed to teach decoding, comprehension, inquiry, and writing in a three-part progression. Part One of each unit, Preparing to Read, focuses on phonemic awareness, sounds and letters, phonics, fluency, and word knowledge. Part Two, Reading and Responding, emphasizes reading literature for understanding, comprehension, inquiry, and practical reading applications. Part Three, Language Arts, focuses on writing, spelling, grammar, usage, mechanics, and basic computer skills.

Repeated reading is an academic practice that aims to increase oral reading fluency. Repeated reading can be used with students who have developed initial word reading skills but demonstrate inadequate reading fluency for their grade level. During repeated reading, a student sits in a quiet location with a teacher and reads a passage aloud at least three times. Typically, the teacher selects a passage of about 50 to 200 words in length. If the student misreads a word or hesitates for longer than 5 seconds, the teacher reads the word aloud, and the student repeats the word correctly. If the student requests help with a word, the teacher reads the word aloud or provides the definition. The student rereads the passage until he or she achieves a satisfactory fluency level.

Read Naturally is an elementary and middle school supplemental reading program designed to improve reading fluency using a combination of books, audiotapes, and computer software. The program has three main strategies: repeated reading of text for developing oral reading fluency, teacher modeling of story reading, and systematic monitoring of student progress by teachers and the students themselves. Students work at a reading level appropriate for their achievement level, progress through the program at their own rate, and, for the most part, work on an independent basis. Read Naturally® can be used in a variety of settings, including classrooms, resource rooms, or computer or reading labs. Although the program was not originally developed for English language learners, additional materials for these students are currently available.

SpellRead™ (formerly known as SpellRead Phonological Auditory Training®) is a literacy program for struggling readers in grade 2 or above, including special education students, English language learners, and students more than 2 years below grade level in reading. SpellRead integrates the auditory and visual aspects of the reading process and emphasizes specific skill mastery through systematic and explicit instruction. Students are taught to recognize and manipulate English sounds; to practice, apply, and transfer their skills using texts at their reading level; and to write about their reading.

Great Explorations in Math and Science^® (GEMS^®) Space Science Sequence is an instructional curriculum for grades 3–5 that covers fundamental concepts, including planetary sizes and distance, the earth’s shape and movement, gravity, and moon phases and eclipses. Part of the GEMS^® core curriculum, GEMS^® Space Science Sequence uses the solar system as the focal point for learning. The sequence uses models, hands-on investigations, peer-to-peer discussions, reflection, and informational student readings. Students complete four units, each lasting between four and nine sessions. Each unit builds upon knowledge from previous units and can be used independently or in conjunction with one another for an overall learning progression.

Peer-Assisted Learning Strategies is a peer-tutoring program for grades K–6 that aims to improve student proficiency in several disciplines. During the 30-35 minute peer-tutoring sessions, students take turns acting at the tutor, coaching and correcting one another as they work through problems. The designation of tutoring pairs and skill assignment is based on teacher judgement of student needs and abilities, and teachers reassign tutoring pairs regularly.  

Peer-Assisted Learning Strategies is a peer-tutoring program for grades K–6 that aims to improve student proficiency in several disciplines. During the 30-35 minute peer-tutoring sessions, students take turns acting at the tutor, coaching and correcting one another as they work through problems. The designation of tutoring pairs and skill assignment is based on teacher judgement of student needs and abilities, and teachers reassign tutoring pairs regularly.  

Peer-Assisted Learning Strategies is a peer-tutoring program for grades K–6 that aims to improve student proficiency in several disciplines. During the 30-35 minute peer-tutoring sessions, students take turns acting at the tutor, coaching and correcting one another as they work through problems. The designation of tutoring pairs and skill assignment is based on teacher judgement of student needs and abilities, and teachers reassign tutoring pairs regularly.  

Reading Plus® is a web-based reading intervention that uses technology to provide individualized scaffolded silent reading practice for students in grades 3 and higher. Reading Plus® aims to develop and improve students’ silent reading fluency, comprehension, and vocabulary. Reading Plus® is designed to adjust the difficulty of the content and duration of reading activities so that students proceed at a pace that corresponds to their reading skill level. The intervention includes differentiated reading activities, computer-based reading assessments, tools to monitor student progress, ongoing implementation support, and supplemental offline activities.

Fast ForWord® is a computer-based reading program intended to help students develop and strengthen the cognitive skills necessary for successful reading and learning. The program, which is designed to be used 30 to 100 minutes a day, five days a week, for 4 to 16 weeks, includes two components.

Reading Mastery is designed to provide systematic reading instruction to students in grades K–6. Reading Mastery can be used as an intervention program for struggling readers, as a supplement to a school’s core reading program, or as a stand-alone reading program, and is available in three versions. During the implementation of Reading Mastery, students are grouped with other students at a similar reading level, based on program placement tests. The program includes a continuous monitoring component.

Cooperative Integrated Reading and Composition^® (CIRC^®) is a comprehensive reading and writing program for students in grades 2–8. It includes story-related activities, direct instruction in reading comprehension, and integrated reading and language arts activities. Pairs of students (grouped either by or across ability levels) read to each other, predict how stories will end, summarize stories, write responses, and practice spelling, decoding, and vocabulary. Within cooperative teams of four, students work to understand the main idea of a story and work through the writing process. The CIRC^® process includes teacher instruction, team practice, peer assessment, and team/partner recognition. A Spanish version of the program was also designed for grades 2–5.

Accelerated Reader™ is a computerized supplementary reading program that provides guided reading instruction to students in grades K–12. It aims to improve students’ reading skills through reading practice and by providing frequent feedback on students’ progress to teachers. The Accelerated Reader™ program requires students to select and read a book based on their area of interest and reading level. Upon completion of a book, students take a computerized quiz based on the book’s content and vocabulary. Quiz performance allows teachers to monitor student progress and to identify students who may need additional reading assistance.

Read Naturally is an elementary and middle school supplemental reading program designed to improve reading fluency using a combination of books, audiotapes, and computer software. The program has three main strategies: repeated reading of text for developing oral reading fluency, teacher modeling of story reading, and systematic monitoring of student progress by teachers and the students themselves. Students work at a reading level appropriate for their achievement level, progress through the program at their own rate, and, for the most part, work on an independent basis. Read Naturally® can be used in a variety of settings, including classrooms, resource rooms, or computer or reading labs. Although the program was not originally developed for English language learners, additional materials for these students are currently available.

Project CRISS® (CReating Independence through Student-owned Strategies) is a professional development program for teachers that aims to improve reading, writing, and learning for students in grades 3–12. The implementation of Project CRISS® does not require a change in the curriculum or materials being used in the classroom, but instead calls for a change in teaching style to focus on three primary concepts derived from cognitive psychology and brain research. These three concepts include students (1) monitoring their learning to assess when they have understood content, (2) integrating new information with prior knowledge, and (3) being actively involved in the learning process through discussing, writing, organizing information, and analyzing the structure of text to help improve comprehension.

Corrective Reading is designed to promote reading accuracy (decoding), fluency, and comprehension skills of students in grade 3 or higher who are reading below their grade level. The program has four levels that correspond to students’ decoding skills. All lessons in the program are sequenced and scripted. Corrective Reading can be implemented in small groups of 4–5 students or in a whole-class format. Corrective Reading is intended to be taught in 45-minute lessons 4–5 times a week.

Peer Tutoring and Response Groups aims to improve the language and achievement of English learners by pairing or grouping students to work on a task. The students may be grouped by age or ability, or the groups may be mixed. Peer tutoring typically consists of two students assuming the roles of tutor and tutee, or “coach and player” roles. Peer response groups give four or five students shared responsibility for a task, such as editing a passage or reading and answering comprehension questions. Both peer tutoring pairs and peer response groups emphasize peer interaction and discussion to complete a task.

SpellRead™ (formerly known as SpellRead Phonological Auditory Training®) is a literacy program for struggling readers in grade 2 or above, including special education students, English language learners, and students more than 2 years below grade level in reading. SpellRead integrates the auditory and visual aspects of the reading process and emphasizes specific skill mastery through systematic and explicit instruction. Students are taught to recognize and manipulate English sounds; to practice, apply, and transfer their skills using texts at their reading level; and to write about their reading.

Caring School Community™ (CSC) is a modified version of a program formerly known as the Child Development Project. CSC is a multiyear school improvement program that involves all students in grades K–6. The program aims to promote core values, prosocial behavior, and a schoolwide feeling of community. The program consists of four elements originally developed for the Child Development Project: class meeting lessons, cross-age “buddies” programs, “homeside” activities, and schoolwide community. Class lessons provide teachers and students with a forum to get to know one another, discuss issues, identify and solve problems collaboratively, and make a range of decisions that affect classroom life. Cross-age buddies activities pair whole classes of older and younger students for academic and recreational activities that build caring cross-age relationships and create a schoolwide climate of trust. Homeside activities include short conversational activities that are sent home with students for them to do with parents or caregivers and then to discuss back in their classroom. The activities incorporate the families’ perspectives, cultures, and traditions, thereby promoting interpersonal understanding. Schoolwide community-building activities bring students, parents, and school staff together to create new school traditions.

Positive Action, at its core, teaches the philosophy that you feel good about yourself when you do positive actions and there is always a positive way to do everything. It is illustrated by the the Thoughts-Actions-Feelings about self Circle where positive thoughts lead to positive actions, which in turn lead to positive feelings about oneself. It also teaches the positive actions for physical, intellectual, social and emotional areas—the whole self. It is a Pre-K-12 school-based program that aims to promote good behavior while disrupting problem behaviors, improves academics, and develops social-emotional and character skills while improving mental and physical health and self-concept. Lessons are scripted and use a wide variety of strategies: classroom discussion, role-play, games, songs, journals, manipulatives and activity sheets and text booklets.

The Vocabulary Improvement Program for English Language Learners and Their Classmates (VIP) is a vocabulary development curriculum for English language learners and native English speakers in grades 4–6. The 15-week program includes 30–45 minute whole class and small group activities that aim to increase students’ understanding of target vocabulary words included in a weekly reading assignment.

The goal of Instructional Conversations is to help English learners develop reading comprehension ability along with English language proficiency. Acting as facilitators, teachers engage students in discussions about stories, key concepts, and related personal experiences, allowing students to appreciate and build on each others’ experiences, knowledge, and understanding. Literature Logs require students to respond in writing to prompts or questions related to sections of stories. These responses are then shared in small groups or with a partner.

Connect with Kids aims to promote prosocial attitudes and positive behavior of elementary (grades 3–5) and secondary (grades 6–12) school students by teaching core character values. Lesson plans include videos, story summaries, discussion questions, student games, and activities for both core and supplemental character traits. The classroom curriculum is reinforced by a website component and schoolwide and community outreach components. The program can be incorporated into an existing curriculum or used as a standalone program. The school or teacher decides on the number of character traits covered in each session, so the program duration may vary from one semester to an entire academic year.

Lessons in Character is designed to promote elementary and middle school students’ knowledge about core character education values and, through that knowledge, shape children’s positive behaviors and support academic success. It consists of 24 lessons organized around weekly themes, writing activities, and class projects. Teachers introduce the theme with a story that shows a value in action; students then engage that topic with a variety of activities. The program also includes daily oral language development and weekly writing assignments, optional parts of the program’s implementation.

Reading Mastery is designed to provide systematic reading instruction to students in grades K–6. Reading Mastery can be used as an intervention program for struggling readers, as a supplement to a school’s core reading program, or as a stand-alone reading program, and is available in three versions. During the implementation of Reading Mastery, students are grouped with other students at a similar reading level, based on program placement tests. The program includes a continuous monitoring component.

Fast ForWord® is a computer-based reading program intended to help students develop and strengthen the cognitive skills necessary for successful reading and learning. The program, which is designed to be used 30 to 100 minutes a day, five days a week, for 4 to 16 weeks, includes two components.

The Leadership and Assistance for Science Education Reform (LASER) program is intended to build capacity for implementing inquiry-based science curricula in schools and districts. When participating in LASER, school or district teams attend leadership development institutes to plan the implementation of inquiry-based science curricula. These school or district teams receive support for key aspects of implementation such as professional development for teachers, access to instructional materials, and support for selecting appropriate assessments. LASER also helps schools and districts partner with scientists, science educators, and local business and community leaders who can promote and further support the implementation of inquiry-based science instruction.

The Promoting Alternative THinking Strategies (PATHS®) program is a curriculum that aims to promote emotional and social competencies and to reduce aggression and behavior problems in elementary school children. PATHS® is delivered through short lessons given two to three times a week over the school year. The program is based on the principle that understanding and regulating emotions are central to effective problem solving. The lessons focus on (1) self-control, (2) emotional literacy, (3) social competence, (4) positive peer relations, and (5) interpersonal problem-solving skills. There is a separate curriculum for each grade.

Literacy Design Collaborative provides professional development, coaching, and resources to support teachers to work collaboratively in their schools to design and use high-quality, standards-aligned literacy instruction materials aimed at building students’ reading, research, and writing skills. Literacy Design Collaborative guides teachers to implement literacy modules they can use to teach students the content and literacy skills needed to complete a culminating writing task. Teachers implement existing modules and design new ones. Teachers across content areas—including English language arts, social studies, and science—can use the Literacy Design Collaborative program.

Word Generation is a supplemental program that aims to improve students’ reading comprehension by building students’ vocabulary, academic language, and perspective-taking skills through classroom discussion and debate. Word Generation was developed for all students; however, English learners in particular could benefit from its focus on academic language. Word Generation consists of a series of interdisciplinary units with daily lessons focused on a high-interest issue to increase student engagement. Each unit targets a small number of academic vocabulary words that are integrated into texts, activities, writing tasks, debates, and discussions across content areas. Several Word Generation programs exist. In the Word Generation Weekly (WordGen Weekly) and Word Generation Elementary (WordGen Elementary) programs, units are intended to be used across English language arts, math, science, and social studies in grades 6–8 and grades 4 and 5, respectively. In the Science Generation (SciGen) and Social Studies Generation (SoGen) programs, units can supplement or be used in place of regular science and social studies curriculum units in grades 6–8. The different Word Generation programs can be implemented separately or together.

The National Board for Professional Teaching Standards (NBPTS) establishes standards for accomplished teachers and awards professional certification to teachers who can demonstrate that their teaching practices meet those standards. Educators and experts in child development and related fields established the organization, and these experts work to develop and refine the standards for accomplished teaching based on the knowledge and skills that effective teachers demonstrate. The standards reflect five core propositions: (1) effective teachers are committed to students and their learning, (2) effective teachers know the subjects they teach and how to teach those subjects to students, (3) effective teachers manage and monitor student learning, (4) effective teachers think systematically about their practice and learn from experience, and (5) effective teachers are members of learning communities. Those seeking certification from the NBPTS must complete a computer-based assessment and three portfolio entries. The certification process can take 1 to 5 years.

Achieve3000® is a supplemental online literacy program that provides nonfiction reading content to students in grades preK–12 and focuses on building phonemic awareness, phonics, fluency, reading comprehension, vocabulary, and writing skills. Achieve3000® is designed to help students advance their nonfiction reading skills by providing differentiated online instruction. Teachers use the program with an entire class but the assignments are tailored to each student’s reading ability level. For example, teachers assign an article and related activities to an entire class; the program then tailors the version of the article to each student by automatically increasing the difficulty of text when a student is ready for more challenging text. Achieve3000® provides lessons that follow a five-step routine: (1) respond to a Before Reading Poll, (2) read an article, (3) answer activity questions, (4) respond to an After Reading Poll, and (5) answer a Thought Question. Progress reports and student usage data, provided by the online tool, enable teachers to track both whole-class and individual student progress. The program is designed for diverse student groups, including general education students, struggling readers in need of intensive tutoring, and English learners.

Accelerated Math®, published by Renaissance Learning, is a software tool that provides practice problems for students in grades K–12 and provides teachers with reports to monitor student progress. Accelerated Math® creates individualized student assignments, scores the assignments, and generates reports on student progress. The software is typically used with the math curriculum being used in the classroom to add practice for students and help teachers differentiate instruction through the program’s progress-monitoring data.

Accelerated Math®, published by Renaissance Learning, is a software tool that provides practice problems for students in grades K–12 and provides teachers with reports to monitor student progress. Accelerated Math® creates individualized student assignments, scores the assignments, and generates reports on student progress. The software is typically used with the math curriculum being used in the classroom to add practice for students and help teachers differentiate instruction through the program’s progress-monitoring data.

Accelerated Reader™ is a computerized supplementary reading program that provides guided reading instruction to students in grades K–12. It aims to improve students’ reading skills through reading practice and by providing frequent feedback on students’ progress to teachers. The Accelerated Reader™ program requires students to select and read a book based on their area of interest and reading level. Upon completion of a book, students take a computerized quiz based on the book’s content and vocabulary. Quiz performance allows teachers to monitor student progress and to identify students who may need additional reading assistance.

The SuccessMaker program is a set of computer-based courses used to supplement regular classroom reading instruction in grades K–8. Using adaptive lessons tailored to a student’s reading level, SuccessMaker aims to improve understanding in areas such as phonological awareness, phonics, fluency, vocabulary, comprehension, and concepts of print.

The New Teacher Center (NTC) Induction Model is a comprehensive and systemic approach to support beginning teachers (i.e., teachers new to the profession). The induction model aims to accelerate the effectiveness of beginning teachers at increasing student learning by providing one-on-one mentoring and professional development in a supportive school environment. The NTC works with school districts and state departments of education to design, develop, and implement induction programs that are aligned with both district priorities and NTC standards.

TAP™ (formerly known as the Teacher Advancement Program) is a comprehensive educator effectiveness program that aims to improve student achievement through supports and incentives that attract, retain, develop, and motivate effective teachers. The program provides teachers with leadership opportunities and associated salary increases; ongoing, school-based professional development; rigorous evaluations; and annual performance bonuses based on a combination of teacher value added to student achievement and observations of their classroom teaching.

Reading Mastery is designed to provide systematic reading instruction to students in grades K–6. Reading Mastery can be used as an intervention program for struggling readers, as a supplement to a school’s core reading program, or as a stand-alone reading program, and is available in three versions. During the implementation of Reading Mastery, students are grouped with other students at a similar reading level, based on program placement tests. The program includes a continuous monitoring component.

Reciprocal teaching is an interactive instructional practice that aims to improve students’ reading comprehension by teaching strategies to obtain meaning from a text. The teacher and students take turns leading a dialogue regarding segments of the text. Students discuss with their teacher how to apply four comprehension strategies—generating questions, summarizing, clarifying, and predicting—to passages of text. During the early stages of reciprocal teaching, the teacher assumes primary responsibility for modeling how to use these strategies. As students become more familiar with the strategies, there is a gradual shift toward student responsibility for talking through the application of the strategies to the text.

Scott Foresman-Addison Wesley Elementary Mathematics is a core curriculum for students at all ability levels in kindergarten through grade 6. The program supports students’ understanding of key math concepts and skills, and it covers a range of mathematical content across grades. The curriculum focuses on questioning strategies, problem-solving skills, embedded assessment, and exercises tailored to students of different ability levels. The program provides explicit problem-solving instruction, hands-on activities, and opportunities to extend students’ mathematical understanding through reading and writing connections.

Read Naturally is an elementary and middle school supplemental reading program designed to improve reading fluency using a combination of books, audiotapes, and computer software. The program has three main strategies: repeated reading of text for developing oral reading fluency, teacher modeling of story reading, and systematic monitoring of student progress by teachers and the students themselves. Students work at a reading level appropriate for their achievement level, progress through the program at their own rate, and, for the most part, work on an independent basis. Read Naturally® can be used in a variety of settings, including classrooms, resource rooms, or computer or reading labs. Although the program was not originally developed for English language learners, additional materials for these students are currently available.

Fast ForWord® is a computer-based reading program intended to help students develop and strengthen the cognitive skills necessary for successful reading and learning. The program, which is designed to be used 30 to 100 minutes a day, five days a week, for 4 to 16 weeks, includes two components.

Investigations in Number, Data, and Space is an activity-based, K–5 mathematics curriculum designed to help students understand number and operations, geometry, data, measurement, and early algebra. Each instructional unit focuses on a particular content area and lasts for 2–5.5 weeks. The curriculum encourages students to develop their own strategies for solving problems and engage in discussion about their reasoning and ideas. The lessons are activity-based in order to facilitate increased comprehension of basic math fundamentals. The curriculum is presented through a series of resource books called ”curriculum units” that provide teachers with guidance on implementation. One or more of the units for each year has a software program associated with it. Other materials include manipulatives, flash cards, overheads, and textbooks.

Peer-Assisted Learning Strategies is a peer-tutoring program for grades K–6 that aims to improve student proficiency in several disciplines. During the 30-35 minute peer-tutoring sessions, students take turns acting at the tutor, coaching and correcting one another as they work through problems. The designation of tutoring pairs and skill assignment is based on teacher judgement of student needs and abilities, and teachers reassign tutoring pairs regularly.  

Open Court Reading© is a reading program for grades K–6 that is designed to teach decoding, comprehension, inquiry, and writing in a three-part progression. Part One of each unit, Preparing to Read, focuses on phonemic awareness, sounds and letters, phonics, fluency, and word knowledge. Part Two, Reading and Responding, emphasizes reading literature for understanding, comprehension, inquiry, and practical reading applications. Part Three, Language Arts, focuses on writing, spelling, grammar, usage, mechanics, and basic computer skills.

Reading Mastery is designed to provide systematic reading instruction to students in grades K–6. Reading Mastery can be used as an intervention program for struggling readers, as a supplement to a school’s core reading program, or as a stand-alone reading program, and is available in three versions. During the implementation of Reading Mastery, students are grouped with other students at a similar reading level, based on program placement tests. The program includes a continuous monitoring component.

Coping Power is based on the earlier Anger Coping Power program. It emphasizes social and emotional skills that are needed during the transition to middle school. The program incorporates child and parent components. The child component consists of thirty-four 50-minute group sessions and periodic individual sessions over the course of 15–18 months, although the program can be shortened to fit into a single school year. Lessons focus on goal setting, problem solving, anger management, and peer relationships. The parent component is composed of 16 group sessions and periodic individual meetings. Lessons support the child component of the program and address setting expectations, praise, discipline, managing stress, communication, and child study skills.

Repeated reading is an academic practice that aims to increase oral reading fluency. Repeated reading can be used with students who have developed initial word reading skills but demonstrate inadequate reading fluency for their grade level. During repeated reading, a student sits in a quiet location with a teacher and reads a passage aloud at least three times. Typically, the teacher selects a passage of about 50 to 200 words in length. If the student misreads a word or hesitates for longer than 5 seconds, the teacher reads the word aloud, and the student repeats the word correctly. If the student requests help with a word, the teacher reads the word aloud or provides the definition. The student rereads the passage until he or she achieves a satisfactory fluency level.

Reciprocal teaching is an interactive instructional practice that aims to improve students’ reading comprehension by teaching strategies to obtain meaning from a text. The teacher and students take turns leading a dialogue regarding segments of the text. Students discuss with their teacher how to apply four comprehension strategies—generating questions, summarizing, clarifying, and predicting—to passages of text. During the early stages of reciprocal teaching, the teacher assumes primary responsibility for modeling how to use these strategies. As students become more familiar with the strategies, there is a gradual shift toward student responsibility for talking through the application of the strategies to the text.

Corrective Reading is designed to promote reading accuracy (decoding), fluency, and comprehension skills of students in grade 3 or higher who are reading below their grade level. The program has four levels that correspond to students’ decoding skills. All lessons in the program are sequenced and scripted. Corrective Reading can be implemented in small groups of 4–5 students or in a whole-class format. Corrective Reading is intended to be taught in 45-minute lessons 4–5 times a week.

READ 180® is a reading program designed for struggling readers who are reading 2 or more years below grade level. It combines online and direct instruction, student assessment, and teacher professional development. READ 180® is delivered in 90-minute sessions that include whole-group instruction, three small-group rotations, and whole-class wrap-up. Small-group rotations include individualized instruction using an adaptive computer application, small-group instruction, and independent reading. READ 180® is designed for students in elementary through high school.

Read Naturally is an elementary and middle school supplemental reading program designed to improve reading fluency using a combination of books, audiotapes, and computer software. The program has three main strategies: repeated reading of text for developing oral reading fluency, teacher modeling of story reading, and systematic monitoring of student progress by teachers and the students themselves. Students work at a reading level appropriate for their achievement level, progress through the program at their own rate, and, for the most part, work on an independent basis. Read Naturally® can be used in a variety of settings, including classrooms, resource rooms, or computer or reading labs. Although the program was not originally developed for English language learners, additional materials for these students are currently available.

Project Read® is a multisensory language arts curriculum designed for use in a classroom or group setting. Two main objectives of the program are to use language in all its forms, and to use responsive instruction rather than preplanned textbook lessons. The program emphasizes direct instruction, and lessons move from letter-sounds to words, sentences, and stories. Project Read® has three strands: Phonics/Linguistics, Reading Comprehension, and Written Expression, which are integrated at all grade levels, though the emphasis of the specific strands differs by grade.

Accelerated Reader™ is a computerized supplementary reading program that provides guided reading instruction to students in grades K–12. It aims to improve students’ reading skills through reading practice and by providing frequent feedback on students’ progress to teachers. The Accelerated Reader™ program requires students to select and read a book based on their area of interest and reading level. Upon completion of a book, students take a computerized quiz based on the book’s content and vocabulary. Quiz performance allows teachers to monitor student progress and to identify students who may need additional reading assistance.

Project Read® is a multisensory language arts curriculum designed for use in a classroom or group setting. Two main objectives of the program are to use language in all its forms, and to use responsive instruction rather than preplanned textbook lessons. The program emphasizes direct instruction, and lessons move from letter-sounds to words, sentences, and stories. Project Read® has three strands: Phonics/Linguistics, Reading Comprehension, and Written Expression, which are integrated at all grade levels, though the emphasis of the specific strands differs by grade.

The SuccessMaker program is a set of computer-based courses used to supplement regular classroom reading instruction in grades K–8. Using adaptive lessons tailored to a student’s reading level, SuccessMaker aims to improve understanding in areas such as phonological awareness, phonics, fluency, vocabulary, comprehension, and concepts of print.

The SuccessMaker program is a set of computer-based courses used to supplement regular classroom reading instruction in grades K–8. Using adaptive lessons tailored to a student’s reading level, SuccessMaker aims to improve understanding in areas such as phonological awareness, phonics, fluency, vocabulary, comprehension, and concepts of print.

The SuccessMaker program is a set of computer-based courses used to supplement regular classroom reading instruction in grades K–8. Using adaptive lessons tailored to a student’s reading level, SuccessMaker aims to improve understanding in areas such as phonological awareness, phonics, fluency, vocabulary, comprehension, and concepts of print.

Houghton Mifflin Mathematics is a core mathematics curriculum for students at all ability levels in kindergarten through grade 6. At each grade level, the program focuses on basic skills development, problem solving, and vocabulary expansion to help students master key math concepts. Students practice daily math lessons through instructional software, enrichment worksheets, manipulatives, and workbooks, in addition to student textbooks. The program incorporates assessments—including lesson-level interventions to meet the needs of all learners—to monitor students’ progress.

An Ethics Curriculum for Children, a read-aloud literature-based curriculum, aims to teach elementary school students seven universal attributes of good character. Lessons and home assignments are organized around multicultural stories. The program activities are designed to connect the experiences of characters in the stories to students’ own lives. Optional parts of the Heartwood Ethics Curriculum for Children also include integration of character education themes across curricular topics and parental notification and involvement.

Open Court Reading© is a reading program for grades K–6 that is designed to teach decoding, comprehension, inquiry, and writing in a three-part progression. Part One of each unit, Preparing to Read, focuses on phonemic awareness, sounds and letters, phonics, fluency, and word knowledge. Part Two, Reading and Responding, emphasizes reading literature for understanding, comprehension, inquiry, and practical reading applications. Part Three, Language Arts, focuses on writing, spelling, grammar, usage, mechanics, and basic computer skills.

Many talented students in under-resourced schools do not reach their full potential. Research shows that by sixth grade, children born into poverty have likely spent 6,000 fewer hours learning than their middle-class counterparts. Higher Achievement, an intensive summer and after-school program, aims to close that learning gap. It offers participants more than 500 hours of academic enrichment activities a year to help them meet the high academic standards expected of college-bound students. Known as "scholars"; Higher Achievement students enter the program during the summer before either fifth or sixth grade and commit to attending through eighth grade. The summer program consists of six weeks of morning classes in English Language Arts (ELA), math, science, and, in some centers, social studies, followed by enrichment activities in the afternoon, including chess, cooking, art, and soccer. During the school year, in addition to the program's regular study hall and enrichment activities, a cadre of mostly young professionals volunteer one day a week, delivering 75-minute ELA or math lessons to small groups of scholars. These volunteers receive detailed lesson plans and training so they can successfully execute the program's rigorous curricula. Part of what makes Higher Achievement affordable is its use of volunteers in this way. An earlier experimental evaluation of Metro DC, Higher Achievement's flagship affiliate in Washington, DC, and Alexandria, Virginia, found that the program was effective in improving academic performance two years after students applied. Since then, Higher Achievement has expanded to three new cities: Baltimore, Maryland; Richmond, Virginia; and Pittsburgh, Pennsylvania. Keenly aware that many effective flagship programs fail to be effective in new locations, the federal government funded an experimental validation study to examine the impacts at these expansion sites. Eligible students were randomly assigned either to a program group that could participate in Higher Achievement, or to a control group that could not enroll in the program. Comparing the two groups' outcomes provided an estimate of the program's impacts. The study found that the expansion sites experienced many of the implementation challenges common to school-based, out-of-school-time programs (for example, staff turnover, coordination with the host school, and lower-than-hoped-for attendance by middle school students), as well as those often seen in new programs (such as a lack of strong relationships with key partners and difficulty recruiting volunteers). Even so, Higher Achievement was found to be at least adequately implemented in all three cities. The study found that the program's detailed lesson plans, with scripted questions and student instructions, enabled the volunteers to deliver rigorous academic lessons. This report addresses the following questions: (1) How did the Higher Achievement centers operate during the study and what lessons are there for similar programs?; (2) Did scholars receive more academic enrichment over the two-year study period than they would have received without Higher Achievement?; and (3) How did Higher Achievement impact scholars' grades and test scores over the two years since they applied?

The purpose of this study was to test the efficacy of a comprehensive program model originally developed by the National Professional Development Center on Autism Spectrum Disorder (NPDC). Sixty elementary schools with 486 participants were randomly assigned to an NPDC and services as usual condition (SAU). Significantly greater changes in program quality occurred in the inclusive NPDC programs as compared with the SAU schools. Teachers in NPDC schools reported using more evidence-based practices (EBPs) and implemented EBPs with significantly greater fidelity than teachers in SAU schools. Autistic students in NPDC schools had significantly higher total attainment of educational goals than students in SAU schools, and the two groups made equivalent progress on standardized assessment outcomes across the school year. [This is the online first version of an article published in "Journal of Autism and Developmental Disorders."]

The recent wave of test-based accountability reforms has negatively impacted the provision of K-12 arts educational experiences. Advocates contend that, in addition to providing intrinsic benefits, the arts can positively influence academic and social development. However, the empirical evidence to support such claims is limited. We conducted a randomized controlled trial with 10,548 3rd-8th grade students who were enrolled in 42 schools that were assigned by lottery to receive substantial influxes of arts education experiences provided through school-community partnerships with local arts organizations, cultural institutions, and teaching-artists. We find that these increases in arts educational experiences significantly reduce the proportion of students receiving disciplinary infractions by 3.6 percentage points, improve STAAR writing achievement by 0.13 of a standard deviation, and increase students' compassion for others by 0.08 of a standard deviation. For students in elementary schools, which comprise 86 percent of the sample, we find that these arts educational experiences also significantly improve school engagement, college aspirations, and arts-facilitated empathy. These findings provide strong evidence that arts educational experiences can produce significant positive impacts on student academic and social development. Policymakers should consider these multifaceted educational benefits when assessing the role and value of the arts in K-12 schools.

Data-based problem solving is a hallmark of research-supported practices such as positive behavioral interventions and supports. In this study, we provided members of positive behavioral interventions and supports (PBIS) teams from 38 elementary schools with professional development focused on a research-supported problem-solving model (Team-Initiated Problem Solving). We used direct observations to document procedures, practices, and outcomes before and after participating in the professional development workshop. Within the context of a randomized waitlist controlled trial, team members in the Immediate Group demonstrated greater improvement in (a) problem-solving procedures, (b) decision-making practices, and (c) meeting outcomes than did members of PBIS teams in the Waitlist Group. Our findings extend what is known about team-based problem solving and provide a framework for future research and improved practice related to decision making by school teams.

Using data from seven cohorts of language immersion lottery applicants in a large, urban school district, we estimate the causal effects of immersion programs on students' test scores in reading, mathematics, and science, and on English learners' (EL) reclassification. We estimate positive intent-to-treat (ITT) effects on reading performance in fifth and eighth grades, ranging from 13 to 22 percent of a standard deviation, reflecting 7 to 9 months of learning. We find little benefit in terms of mathematics and science performance, but also no detriment. By sixth and seventh grade, lottery winners' probabilities of remaining classified as EL are three to four percentage points lower than those of their counterparts. This effect is stronger for ELs whose native language matches the partner language. [This article was published in: "American Educational Research Journal" v54 n1 suppl p282S-306S Apr 2017 (EJ1155308).]

This article describes the effects of an analysis-of-practice professional development (PD) program on elementary school students' (Grades 4-6) science outcomes. The study design was a cluster-randomized trial with an analysis sample of 77 schools, 144 teachers and 2,823 students. Forty-two schools were randomly assigned to treatment, (88.5 hours) of integrated analysis-of-practice and content deepening PD (over the course of one year) while 35 schools were randomly assigned to receive an equal number of PD hours in science content deepening alone. Students' content knowledge, as measured by a project-specific test, was compared across treatment groups. The effect size for this comparison was 0.52 standard deviations in favor of students whose teachers participated in the PD that included analysis-of-practice. This effect compares favorably to that of other elementary school interventions whose effectiveness was studied with a narrowly focused outcome measure. Analysis of the demographics of the study schools suggests that the treatment effect could be relevant outside the local study context. Implications for future research include tests of mediation for teacher-level outcomes and efficacy tests of specific teaching strategies (intervention subcomponents).

This study reports on an evaluation of the "Reading Partners" program, which uses community volunteers to provide one-on-one tutoring to struggling readers in underresourced elementary schools. Established in 1999 in East Menlo Park, California, the mission of "Reading Partners" is to help children become lifelong readers by empowering communities to provide individualized instruction with measurable results. This report builds on those initial findings by describing the "Reading Partners" program and its implementation in greater detail, exploring whether the program is more or less effective for particular subgroups of students, and assessing some of the potential explanations for the program's success to date. In addition, this report includes an analysis of the cost of implementing the Reading Partners program in 6 of the 19 sites. The following are appended: (1) Implementation Study Methods; (2) Impact Study Methods and Teacher Survey; (3) Tutor Background Characteristics and Additional Impact Findings; (4) Cost Study Methods; and (5) Additional Cost Findings. [This report was written with A. Brooks Bowden and Yilin Pan.]

One of the most important questions in education research is whether the gains from interventions for which perceived short-term success can be sustained. The possibility of short-lived impacts is especially relevant for research on charter schools, where charter operators who face high-stakes assessments have an incentive to "teach to the test." The fact that charters are subject to intense scrutiny and evaluation may even create incentives for cheating (Jacob and Levitt, 2003), strategic instruction (Jacob, 2007), and a focus on small groups of students that are pivotal for official accountability measures (Neal and Schanzenbach, 2010). The purpose of this paper is to assess the impact of attendance at Boston's charter high schools on outcomes where the link with human capital and future earnings seems likely to be sustained and strong. Specifically, the authors focus on outcomes that are either essential to or facilitate post-secondary schooling: high school graduation, the attainment of state competency thresholds, scholarship qualification, Advanced Placement (AP) and SAT scores, college enrollment, and college persistence. Importantly, most of these outcomes are less subject to strategic manipulation than are the state's test-based assessments. As in earlier work, the research design implemented here exploits randomized enrollment lotteries at oversubscribed charter schools. The resulting estimates are likely to provide reliable measures of average causal effects for charter applicants. Six tables are appended.

The Knowledge Is Power Program (KIPP) is a rapidly expanding network of public charter schools whose mission is to improve the education of low-income children. As of the 2012-2013 school year, 125 KIPP schools are in operation in 20 different states and the District of Columbia (DC). Ultimately, KIPP's goal is to prepare students to enroll and succeed in college. Prior research has suggested that KIPP schools have positive impacts on student achievement, but most of the studies have included only a few KIPP schools or have had methodological limitations. This is the second report of a national evaluation of KIPP middle schools being conducted by Mathematica Policy Research. The evaluation uses experimental and quasi-experimental methods to produce rigorous and comprehensive evidence on the effects of KIPP middle schools across the country. The study's first report, released in 2010, described strong positive achievement impacts in math and reading for the 22 KIPP middle schools for which data were available at the time. For this phase of the study, the authors nearly doubled the size of the sample, to 43 KIPP middle schools, including all KIPP middle schools that were open at the start of the study in 2010 for which they were able to acquire relevant data from local districts or states. The average impact of KIPP on student achievement is positive, statistically significant, and educationally substantial. KIPP impact estimates are consistently positive across the four academic subjects examined, in each of the first four years after enrollment in a KIPP school, and for all measurable student subgroups. A large majority of the individual KIPP schools in the study show positive impacts on student achievement as measured by scores on state-mandated assessments. KIPP produces similar positive impacts on the norm-referenced test, which includes items assessing higher-order thinking. Estimated impacts on measures of student attitudes and behavior are less frequently positive, but the authors found evidence that KIPP leads students to spend significantly more time on homework, and that KIPP increases levels of student and parent satisfaction with school. On the negative side, the findings suggest that enrollment in a KIPP school leads to an increase in the likelihood that students report engaging in undesirable behavior such as lying to or arguing with parents. These findings are described in this report. The following appendixes are included: (1) Sample selection and baseline characteristics; (2) Constructing survey outcomes; (3) Schools attended by lottery winners and lottery non-winners; (4) Analytic methods for the matched comparison group analysis; (5) Analytic methods for lottery-based analysis; and (6) Validation of matching methods using lottery-based impact estimates. (Contains 46 tables, 78 footnotes, and 16 figures.) [For "What Works Clearinghouse Quick Review: 'KIPP Middle Schools: Impacts on Achievement and Other Outcomes, Final Report,'" see ED540896.]

One way to improve struggling schools' access to effective teachers is to use selective transfer incentives. Such incentives offer bonuses for the highest-performing teachers to move into schools serving the most disadvantaged students. In this report, we provide evidence from a randomized experiment that tested whether such a policy intervention can improve student test scores and other outcomes in low-achieving schools. The intervention, known to participants as the Talent Transfer Initiative (TTI), was implemented in 10 school districts in seven states. The highest-performing teachers in each district--those who ranked in roughly the top 20 percent within their subject and grade span in terms of raising student achievement year after year (an approach known as value added)--were identified. These teachers were offered $20,000, paid in installments over a two-year period, if they transferred into and remained in designated schools that had low average test scores. The main findings from the study include: (1) The transfer incentive successfully attracted high value-added teachers to fill targeted vacancies; (2) The transfer incentive had a positive impact on test scores (math and reading) in targeted elementary classrooms; and (3) The transfer incentive had a positive impact on teacher-retention rates during the payout period; retention of the high-performing teachers who transferred was similar to their counterparts in the fall immediately after the last payout. Seven appendixes are included: (1) Supplemental Materials for Chapters I and II; (2) Value-Added Analysis to Identify Highest-Performing Teachers; (3) Supplemental Materials for Chapter III; (4) Identification of Focal Teachers; (5) Supplemental Materials for Chapter IV; (6) Supplemental Materials for Chapter V; and (7) Supplemental Materials for Chapter VI. (Contains 114 footnotes, 61 figures, and 92 tables.) [For the executive summary, see ED544268.]

One crucial decision that middle schoolers (and their families) make is where they will attend high school. Many districts employ school choice systems designed to allow students to pick a high school that will meet their needs and interests. Yet most students prefer high schools that are close to home, and for youth in low-income neighborhoods, this often means attending a more disadvantaged, lower performing school (Nathanson et al. 2013). Youth who defy these odds and choose a competitive high school instead have much to gain. Cullen et al. (2005), for instance, found that Chicago public middle school students who chose to attend a higher-achieving high school were substantially more likely to graduate. However, even as eighth graders, these students already differed in many ways from their peers who chose a neighborhood school--they had better self-reported grades and higher expectations for the future, felt more prepared for high school, and were more likely to have spoken with their parents about what school to attend. These findings raise the question of how we can prepare more disadvantaged students to take the many steps necessary-throughout the middle school years-to successfully transition to a competitive, high-quality high school that can ultimately launch them toward college and careers. The Washington, DC-based Higher Achievement program is taking on this challenge. Higher Achievement targets rising fifth and sixth graders from "at-risk communities" and serves them throughout the middle school years. Its goal is to strengthen participants' academic skills, attitudes and behaviors, reinforce high aspirations and help students and their families navigate the process of applying to and selecting a high-quality high school. In 2006, the authors began a comprehensive multi-year evaluation of Higher Achievement to test its impact on participants' academic performance, attitudes and behaviors and on their high school enrollment. The evaluation used random assignment-the most rigorous design available to researchers-to assess program impacts. This brief summarizes the study's findings. Findings suggest that the program does appear to expand the options available to its students by making them more likely to apply to and attend private schools and less likely to apply to and attend weaker public magnet and charter schools. This, in turn, may position youth for better outcomes in high school and beyond. [This research was made possible by grants from The Atlantic Philanthropies, Bank of America, the Smith Richardson Foundation, the Spencer Foundation, The Wallace Foundation and the William T. Grant Foundation.]

Domestic attempts to use financial incentives for teachers to increase student achievement have been ineffective. In this paper, we demonstrate that exploiting the power of loss aversion--teachers are paid in advance and asked to give back the money if their students do not improve sufficiently--increases math test scores between 0.201 (0.076) and 0.398 (0.129) standard deviations. This is equivalent to increasing teacher quality by more than one standard deviation. A second treatment arm, identical to the loss aversion treatment but implemented in the standard fashion, yields smaller and statistically insignificant results. This suggests it is loss aversion, rather than other features of the design or population sampled, that leads to the stark differences between our findings and past research.

Reading comprehension is a challenge for K-12 learners and adults. Nonfiction texts, such as expository texts that inform and explain, are particularly challenging and vital for students' understanding because of their frequent use in formal schooling (e.g., textbooks) as well as everyday life (e.g., newspapers, magazines, and medical information). The structure strategy is explicit instruction about how to strategically use knowledge about text structures for encoding and retrieval of information from nonfiction and has consistently shown significant improvements in reading comprehension. We present the delivery of the structure strategy using a web-based intelligent tutoring system (ITSS) that has the potential to offer consistent modeling, practice tasks, assessment, and feedback to the learner. Finally, we report on statistically significant findings from a large scale randomized controlled efficacy trial with rural and suburban 4th-grade students using ITSS.

This report presents the results of an experiment conducted in Alabama beginning in the 2006/07 school year, to determine the effectiveness of the Alabama Math, Science, and Technology Initiative (AMSTI), which aims to improve mathematics and science achievement in the state's K-12 schools. This study is the first randomized controlled trial testing the effectiveness of AMSTI in improving mathematics problem solving and science achievement in upper-elementary and middle schools. AMSTI is an initiative specific to Alabama and was developed and supported through state resources. An important finding is the positive and statistically significant effect of AMSTI on mathematics achievement as measured by the SAT 10 mathematics problem solving assessment administered by the state to students in grades 4-8. After one year in the program, student mathematics scores were higher than those of a control group that did not receive AMSTI by 0.05 standard deviation, equivalent to 2 percentile points. Nine of the 10 sensitivity analyses yielded effect estimates that were statistically significant at the 0.025 level, consistent with the main finding. The estimated effect of AMSTI on science achievement measured after one year was not statistically significant. Based on the SAT 10 science test administered by the state to students in grades 5 and 7, no difference between AMSTI and control schools could be discerned after one year. Changes in classroom instructional strategies, especially an emphasis on more active-learning strategies, are important to the AMSTI theory of action. Therefore, a secondary investigation of classroom practices was conducted, based on data from survey responses from teachers. For both mathematics and science, statistically significant differences were found between AMSTI and control teachers in the average reported time spent using the strategies. The effect of AMSTI on these instructional strategies was 0.47 standard deviation in mathematics and 0.32 standard deviation in science. Two years of AMSTI appeared to have a positive and statistically significant effect on achievement in mathematics problem solving, compared to no AMSTI. Two years of AMSTI appeared to have a positive and statistically significant effect on achievement in science. AMSTI appeared to have a positive and statistically significant effect on reading achievement as measured by the SAT 10 test of reading administered by the state to students in grades 4-8. AMSTI did not appear to have a statistically significant effect on teacher-reported content knowledge in mathematics or science after one year. AMSTI did not appear to have statistically significant differential effects on student achievement in mathematics problem solving or science based on racial/ethnic minority status, enrollment in the free or reduced-price lunch program, gender, or pretest level. Appended are: (1) Explanation of primary and secondary confirmatory outcome measures; (2) Explanation of exploratory research questions; (3) Selection and random assignment of schools; (4) Statistical power analysis; (5) Data collection procedures and timeline; (6) Description of program implementation data collected but not used in report; (7) Alabama Math, Science, and Technology Initiative (AMSTI) teacher survey #3; (8) Data cleaning and data file construction; (9) Attrition through study stages for samples used in the confirmatory analysis; (10) Description of degree rank; (11) Equivalence of Year 1 baseline and analyzed samples for confirmatory student-level and classroom practice outcomes; (12) Internal consistency and validity of active learning measures; (13) Number of students and teachers in schools in analytic samples used to analyze Year 1 confirmatory questions; (14) Attrition through study stages for samples used in Year 1 exploratory analysis; (15) Tests of equivalence for baseline and analytic samples for Year 1 exploratory outcomes; (16) Statistical power analyses for moderator analyses; (17) Derivation and motivation of the Bell-Bradley estimator when measuring estimated two-year effect of the Alabama Math, Science, and Technology Initiative (AMSTI); (18) Attrition through study stages for samples contributing to estimation of two-year effects; (19) Examination of equivalence in baseline and analytic samples used in the estimation of two-year effects; (20) Estimation model for two-year effects of the Alabama Math, Science, and Technology Initiative (AMSTI); (21) Topics and instructional methods used at the Alabama Math, Science, and Technology Initiative (AMSTI) summer institute; (22) Parameter estimates on probability scale for odds-ratio tests of differences between Alabama Math, Science, and Technology Initiative (AMSTI) and control conditions in Year 1 (associated with summer professional development and in-school support outcomes); (23) Descriptive statistics for variables that change to a binary scale used in the Alabama Math, Science, and Technology Initiative (AMSTI) and control conditions in Year 1; (24) Comparison of assumed parameter values and observed sample statistics for statistical power analysis after one year; (25) Parameter estimates for Stanford Achievement Test Tenth Edition (SAT 10) mathematics problem solving after one year; (26) Parameter estimates for Stanford Achievement Test Tenth Edition (SAT 10) science after one year; (27) Parameter estimates for active learning in mathematics after one year; (28) Parameter estimates for active learning in science after one year; (29) Sensitivity analyses of effect of the Alabama Math, Science, and Technology Initiative (AMSTI) on Stanford Achievement Test Tenth Edition (SAT 10) mathematics problem solving achievement after one year; (30) Sensitivity analyses of effect of the Alabama Math, Science, and Technology Initiative (AMSTI) on Stanford Achievement Test Tenth Edition (SAT 10) science achievement after one year; (31) Sensitivity analyses of effect of the Alabama Math, Science, and Technology Initiative (AMSTI) on active learning instructional strategies in mathematics classrooms after one year; (32) Sensitivity analyses of effect of the Alabama Math, Science, and Technology Initiative (AMSTI) on active learning instructional strategies in science classrooms after one year; (33) Tests for violations of factors associated with assumption of equal first year effects on students in Alabama Math, Science, and Technology Initiative (AMSTI) and control schools; (34) Post hoc adjustment to standard error for estimate of two-year effect of the Alabama Math, Science, and Technology Initiative (AMSTI) on mathematics achievement after two years; (35) Parameter estimates for effect of the Alabama Math, Science, and Technology Initiative (AMSTI) after two years; (36) Parameter estimates for effect of the Alabama Math, Science, and Technology Initiative (AMSTI) on student reading achievement after one year; (37) Parameter estimates for teacher content and student engagement after one year; (38) Estimates of effects for terms involving the indicator of treatment status in the analysis of the moderating effect of the three-level pretest variable; (39) Parameter estimates for the analysis of the moderating effect of racial/ethnic minority status on the impact of the Alabama Math, Science, and Technology Initiative (AMSTI) on reading after one year; (40) Parameter estimates for analysis of average effect of the Alabama Math, Science, and Technology Initiative (AMSTI) on reading by racial/ethnic minority students after one year; and (41) Parameter estimates for effect of the Alabama Math, Science, and Technology Initiative (AMSTI) on reading for White students after one year. (Contains 26 figures, 136 tables, 1 box and 130 footnotes.)

Schoolwide Positive Behavioral Interventions and Supports (SWPBIS) is a universal, schoolwide prevention strategy that is currently implemented in over 9,000 schools across the nation to reduce disruptive behavior problems through the application of behavioral, social learning, and organizational behavioral principles. SWPBIS aims to alter school environments by creating improved systems and procedures that promote positive change in student behavior by targeting staff behaviors. This study uses data from a 5-year longitudinal randomized controlled effectiveness trial of SWPBIS conducted in 37 elementary schools to examine the impact of training in SWPBIS on implementation fidelity as well as student suspensions, office discipline referrals, and academic achievement. School-level longitudinal analyses indicated that the schools trained in SWPBIS implemented the model with high fidelity and experienced significant reductions in student suspensions and office discipline referrals. (Contains 1 table and 5 figures.)

This report summarizes the findings from a national evaluation of mentoring programs funded under the U.S. Department of Education's Student Mentoring Program. The impact evaluation used an experimental design in which students were randomly assigned to a treatment or control group. Thirty-two purposively selected School Mentoring Programs and 2,573 students took part in the evaluation, which estimated the impact of the programs over one school year on a range of student outcomes. The evaluation also describes the characteristics of the program and the mentors, and provides information about program delivery. The Student Mentoring Program is designed to fund grantees to enable them to provide mentoring to at-risk students in grades 4-8. The ultimate goal of the program is to improve student academic and behavioral outcomes through the guidance and encouragement of a volunteer mentor. Seventeen total impacts in the domains of academic achievement/engagement, interpersonal relationships/personal responsibility, and high-risk/delinquent behavior were measured. The main finding of the Impact Study was that there were no statistically significant impacts of the Student Mentoring Program for the sample as a whole on this array of student outcomes. However, there was some scattered evidence that impacts were heterogeneous across types of students. In particular, impacts on girls were statistically significantly different from impacts on boys for two self-reported scales: Scholastic Efficacy and School Bonding, and Pro-social Behaviors. For boys, the impact on Prosocial Behaviors was negative and statistically significant. For girls, the impact on Scholastic Efficacy and School Bonding was positive and statistically significant. The impact on truancy was negative and statistically significant for students below age 12. There were negative associations between program supervision of mentors and site-level impacts on three of the seventeen individual outcome measures: Pro-social Behaviors, grades in math and social studies, and a positive relationship with the outcome of school-reported delinquency. The report also presented results demonstrating that the Student Mentoring Program represented a fairly low level of intensity in terms of service: although grantees, on average, adhered to the general intents of the legislation and program guidance, they were simultaneously constrained by the limits of the school calendar and the population from which to draw mentors. Thirty-five percent of the control group students reported receiving mentoring either from the program or elsewhere in the community; this finding, coupled with the fact that not all treatment group students met with a mentor, reduced the treatment contrast and may have led to some dilution of the impacts on students compared to expectations. Seven appendices are included; (1) Sampling Design and Methodology; (2) Survey Instruments; (3) Construction of Student Outcome Measures; (4) Impact Analysis Results on Original Student Survey Scales and Measures; (5) Sensitivity Tests; (6) Standard Errors and Confidence Intervals of Main Effects; and (7) Site-Level Predictors and Impacts. (Contains 109 footnotes and 122 exhibits.) ["Impact Evaluation of the U.S. Department of Education's Student Mentoring Program. Final Report" was written with the assistance of Christine Dyous, Michelle Klausner, Nancy McGarry, Rachel Luck and William Rhodes.]

In this article, the authors report achievement outcomes of a multisite cluster randomized field trial of Open Court Reading 2005 (OCR), a K-6 literacy curriculum published by SRA/McGraw-Hill. The participants are 49 first-grade through fifth-grade classrooms from predominantly minority and poor contexts across the nation. Blocking by grade level within schools, the trial includes 27 classrooms receiving the OCR curricular materials and professional development and 22 "business-as-usual" control classrooms. Multilevel analyses of classroom-level effects of assignment to OCR reveal statistically significant treatment effects on all three of the Comprehensive Test of Basic Skills, 5th edition, Terra Nova literacy posttests. The OCR effect sizes are d = 0.16 for the Reading Composite, d = 0.19 for Vocabulary, and d = 0.12 for Reading Comprehension. These effects achieved across 27 classrooms and 5 schools demonstrate the potential for replicating improved literacy outcomes through the scale-up of OCR. (Contains 4 tables and 1 note.)

This project entailed a three-year efficacy evaluation of the Computer and Team Assisted Mathematical Acceleration (CATAMA) Lab developed by the Center for Social Organization of Schools at Johns Hopkins University. The CATAMA Lab was proposed as an immediate and practical approach to addressing the different types of math deficits held by students at urban high-poverty schools. The Lab required only 1 teacher per school reducing staff and professional development requirements. It used multiple instructional techniques (including individualized computer instruction, direct instruction, pair and team learning, and individual instruction) to teach math concepts and skills. By taking the place of an elective it allowed students to continue with their on-grade math class. For a more detailed description of the Lab see Appendix 2. The original goal of the project was to establish the Lab at three urban schools serving high-poverty high-minority middle grade students (grades 5-8). Students underperforming in mathematics (as established by district standardized tests) were to take a trimester course of study in the Lab to increase their knowledge of math concepts and skills taught by a regular math teacher receiving extensive ongoing professional development. Students were to take the Lab as an elective course while continuing with their regular math class. From each school's pool of students eligible to participate, students were to be randomly assigned to take the Lab. An implementation analysis was to measure the teaching of the concepts and skills to be taught in the Lab. To evaluate the impact of the intervention, students' math achievement, as measured by standardized math tests, was to be compared to eligible students not assigned to the Lab. This report discusses the project in three sections: (1) A comparison of the actual project with the planned project; (2) The descriptive results from the project; (a) Description of the sample; (b) Description of implementation of the CATAMA Lab; and (3) The evaluative results from the project.

This paper reports on a randomized experiment to study the impact of an alternative teacher preparation program, Teach for America (TFA), on student achievement and other outcomes. We found that TFA teachers had a positive impact on math achievement and no impact on reading achievement. The size of the impact on math scores was about 15 percent of a standard deviation, equivalent to about one month of instruction. The general conclusions did not differ substantially for subgroups of teachers, including novice teachers, or for subgroups of students. We found no impacts on other student outcomes such as attendance, promotion, or disciplinary incidents, but TFA teachers were more likely to report problems with student behavior than were their peers. The findings contradict claims that such programs allowing teachers to bypass the traditional route to the classroom harm students.

Teach For America (TFA) was founded in 1989 to address the educational inequities facing children in low-income communities across the United States by expanding the pool of teacher candidates available to the schools those children attend. TFA recruits seniors and recent graduates from colleges around the country, people who are willing to commit to teach for a minimum of two years in low-income schools. TFA focuses its recruitment on people with strong academic records and leadership capabilities, whether or not they have planned to teach or have taken education courses. TFA is particularly interested in candidates that have the potential to be effective in the classroom but in the absence of TFA would not consider a teaching career. Consequently, most TFA recruits do not have education-related majors in college and therefore have not received the same training that traditional teachers are expected to have. After an executive summary and introduction, this discussion paper addresses the following: (1) How TFA Works; (2) Study Design; (3) Who Teaches in the Schools Where TFA Places Teachers?; (4) What Does Our Sample of Students Look Like?; (5) Were TFA Teachers Effective in the Classroom?; and (6) Did TFA Have an Impact on Other Student Outcomes? Primary findings from the study include: from the perspective of a community or a school faced with the opportunity to hire TFA teachers, TFA offers an appealing pool of candidates; from the perspective of TFA and its funders, the organization is making progress toward its primary mission of reducing inequities in education--it supplies low-income schools with academically talented teachers who contribute positively to the academic achievement of their students; and from the perspective of policymakers who are trying to improve the educational opportunities of children in poor communities, many of the control teachers in the study were not certified or did not have formal pre-service training, highlighting the need for programs or policies that offer the potential of attracting good teachers to schools in the most disadvantaged communities--the findings show that TFA is one such program. Appended are: (1) Supplementary Tables; and (2) Estimation Approach. (Contains 17 tables and 6 figures.)

"G[superscript 2]ROW STEM" is an Investing in Innovation (i3) development grant funded by the Office of Innovation and Improvement, U.S. Department of Education. "G[superscript 2]ROW STEM" targets high-need middle school students, particularly females and minorities, that tend to be underrepresented in STEM careers. "G[superscript 2]ROW STEM" focuses on providing students with engaging, hands-on, project-based, extended-learning experiences to inspire interest in STEM and improve achievement. The impact evaluation used a quasi-experimental design (QED) to examine the effect of "G[superscript 2]ROW STEM" on academic achievement in science and math. "G[superscript 2]ROW STEM" student enrollment began during the 2016-17 school year and students were followed for three years, through the 2018-19 school year. Academic achievement outcomes for "G[superscript 2]ROW STEM" students were compared to a matched sample of students within the same grade in the same schools who participated in business-as-usual, traditional academic instruction with no extended learning experiences. Academic achievement for comparison students was also tracked over a three-year period. Results showed statistically significant differences between treatment and comparison groups in achievement test scores across both math and science. Overall, treatment students gained seven NCE score points more than the comparison group students did after up to three years in the "G[superscript 2]ROW STEM" program. This is roughly equivalent to one-third of a standard deviation. Significant differences were also noted for student subgroups with non-minority students realizing slightly higher gains in NCE scores than minority students by the end of the program (over all analyses a difference of 2.25 NCE points).

District leaders in a large urban school district in central Florida wanted to examine the efficacy of a new curriculum designed to enhance the word knowledge of grade 5 students so as to improve reading achievement. The new curriculum, called Word Knowledge Instruction (WKI), consists of 15-minute lessons 4 days a week for 20 weeks. The lessons address state standards and cover 20 prefixes and suffixes. Thirty-nine schools participated in the study, with 92 English language arts (ELA) teachers in high-poverty schools randomly assigned within schools either to use WKI or to continue to use their standard ELA curriculum. Classroom observations revealed that WKI was implemented as intended. WKI had a positive effect, equivalent to an increase of 9 percentile points, on students' ability to correctly extract and spell a base word from a derived word, one of the skills explicitly taught by WKI. WKI had no effect on two other related reading skills that were not directly taught by WKI (students' ability to select a nonword that best fits the grammatical context of a sentence or to use knowledge of word parts to infer meaning of new words) or on students' vocabulary or reading scores. These findings suggest that, although students learned what they were explicitly taught, the transferability to related but not directly taught skills might require more intense or longer duration instruction or additional professional development for teachers. [For the study snapshot, see ED611684. For the appendix, see ED611685.]

With the launch of the New York City Community Schools Initiative (NYC-CS) in 2014, the New York City Department of Education (NYCDOE) has increased its focus on the implementation of a holistic strategy of education reform to address the social consequences of poverty as a means to improving student outcomes. NYC-CS is a strategy to organize resources in schools and share leadership among stakeholders so that academics, health and wellness, youth development, and family engagement are integrated into the fabric of each school. New York City is implementing this strategy at a scale unmatched nationally. In this study, the authors assessed the impact of the NYC-CS through the 2017-2018 school year. The authors assessed the effects along seven outcome domains and explored the extent to which there is heterogeneity in programmatic impact based on student- and school-level characteristics. The authors leveraged innovative quasi-experimental methodology to determine whether students in the community schools are performing better than they would be had their schools not been designated as Community Schools. The findings of this report will contribute to the emerging evidence base on the efficacy of the community school strategy and will be useful for other school district- and state-level policymakers interested in developing or refining similar interventions that support students' and communities' academic, social, and emotional well-being. [The research described in this report was prepared for the New York City Mayor's Office for Economic Opportunity (NYC Opportunity).]

In 2013, the NYC Leadership Academy (NYCLA) developed a leadership intervention--the Targeted Intensive School Support (TISS) program--in collaboration with the New York City Department of Education (NYC DOE) to support schools that were facing particular challenges. NYCLA asked the RAND Corporation to provide an independent evaluation of the program's implementation and effects, and those findings are detailed in this report. The TISS program consisted of five key components: (1) teaming and collaborative training in aligned preservice preparation programs for a principal and assistant principal (AP); (2) coplacement of a principal and AP into an NYC DOE school; (3) team-based coaching to support the principal and AP; (4) 328 hours of extended coaching over the first three years after placement; and (5) use of a diagnostic process to guide goal setting and coaching according to school needs. Implementation findings suggest that only two of the five key components were implemented with fidelity. A propensity weighting approach was used to compare schools with TISS principals to other schools with new principals trained through residency-based preservice programs who did not participate in TISS. Findings suggest no statistically significant differences between TISS schools and comparison schools on measures of student achievement, school culture, and principal retention. TISS schools underperformed relative to comparison schools on the measure of chronic student absenteeism. [Sponsored by NYC Leadership Academy through a subgrant from the U.S. Department of Education.]

A growing body of research points to the ways in which principals influence teachers, classrooms, and, ultimately, student achievement. New Leaders aims to prepare transformational school leaders by partnering with districts and charter schools to offer rigorous, research-based training for aspiring principals. The Aspiring Principals program is New Leaders' signature program and has three core features: selective recruitment and admission, training and endorsement, and support for principals early in their tenure. This report is a follow-up to the 2014 evaluation of New Leaders' Aspiring Principals program. Focusing on the revised program, which was first implemented in 2012, the authors present evidence of the effectiveness of the revised Aspiring Principals program and share lessons that can inform principal-preparation policy and practice. To assess the effect of New Leaders' Aspiring Principals program, researchers analyzed whether schools and students led by graduates of the program outperformed comparison schools and students in the same district, focusing on student achievement and principal retention. They also examined program graduate placement and satisfaction with the Aspiring Principals program. [For the appendixes, see ED605724.]

The three-tiered Positive Behavioral Interventions and Supports (PBIS) framework promotes the development of systems and data analysis to guide the selection and implementation of evidence-based practices across multiple tiers. The current study examined the effects of universal (tier 1) or school-wide PBIS (SW-PBIS) in one state's scale-up of this tier of the framework. Annual propensity score weights were generated to examine the longitudinal effects of SW-PBIS from 2006-07 through 2011-12. School-level archival and administrative data outcomes were examined using panel models with an autoregressive structure. The sample included 1,316 elementary, middle, and high schools. Elementary schools trained in SW-PBIS demonstrated statistically significantly lower suspensions during the fourth and fifth study years (i.e., small effect size) and higher reading and math proficiency rates during the first two study years as well as in one and two later years (i.e., small to large effect sizes), respectively. Secondary schools implementing SW-PBIS had statistically significantly lower suspensions and truancy rates during the second study year and higher reading and math proficiency rates during the second and third study years. These findings demonstrate medium effect sizes for all outcomes except suspensions. Given the widespread use of SW-PBIS across nearly 26,000 schools in the U.S., this study has important implications for educational practices and policies. [This paper was published in the "Journal of School Psychology" v73 p41-55 Apr 2019 (ISSN 0022-4405).]

Across the country, school districts, their stakeholders, and policymakers have become increasingly concerned about suspensions, particularly about suspending students from elementary school and disproportionately suspending ethnic/racial minority students. Suspended students are less likely to graduate, possibly because they miss the instructional time they need to advance academically. Restorative practices have gained buy-in in the education community as a strategy to reduce suspension rates. Proactively improving relationships among students and staff and building a sense of community in classrooms and schools may make students less inclined to misbehave. And addressing severe misbehavior through a restorative approach may help students realize the impacts of their actions and make them less likely to offend again. This study of the implementation of restorative practices in the Pittsburgh Public Schools district (PPS) in school years 2015-16 and 2016-17 represents one of the first randomized controlled trials of the effects of restorative practices on classroom and school climates and suspension rates. The authors examined a specific restorative practices program -- the International Institute for Restorative Practices' SaferSanerSchools™ Whole-School Change program -- implemented in a selected group of PPS schools under a program called Pursuing Equitable and Restorative Communities, or PERC. The researchers found that PERC achieved several positive effects, including an improvement in overall school climates (as rated by teachers), a reduction in overall suspension rates, and a reduction in the disparities in suspension rates between African American and white students and between low- and higher-income students. Key Findings: Effects of the Pursuing Equitable and Restorative Communities (PERC) program in Pittsburgh Public Schools: (1) Implementation of restorative practices through PERC improved overall school climates, as rated by teachers; (2) Implementation of restorative practices reduced the average suspension rate: During the study period, average suspension rates decreased in both PERC and non-PERC schools, but rates decreased more in PERC schools; (3) Suspension rates of African American students and of those from low-income families also went down in PERC schools, shrinking the disparities in suspension rates between African American and white students and between low- and higher-income students; (4) Academic outcomes did not improve in PERC schools, and actually worsened for grades 6-8; and (5) Arrest rates among PERC schools did not decrease. Recommendations: (1) Given the constraints on teachers' time, emphasize restorative practices that can be woven into the school day; (2) Ensure that school leaders understand and can model restorative practices, including by providing mandatory professional development, books and other materials, and coaching on restorative practices; (3) Establish a mechanism for school staff to meet at least once per month as a professional learning community on restorative practices; (4) Ensure that leaders at the district level can coordinate this work; (5) Set, and update, clear expectations regarding the use of restorative practices; and (6) Implement data collection systems to collect accurate information on all types of behavioral incidents and remedies.

Although several studies have documented the effects of statewide private school choice programs on student test scores, this report is the first to examine the effects of one of these programs on college enrollment and graduation. Using data from the Florida Tax Credit (FTC) Scholarship program, we find that low-income Florida students who attended private schools using an FTC scholarship enrolled in and graduated from Florida colleges at a higher rate than their public school counterparts. [Additional support for this study was provided by the Bill and Susan Oberndorf Foundation and Kate and Bill Duhamel.]

Playground Physics is a technology-based application and accompanying curriculum designed by New York Hall of Science (NYSCI) to support middle school students' science engagement and learning of force, energy, and motion. The program includes professional development, the Playground Physics app, and a curriculum aligned with New York State Learning Standards, Common Core State Standards, and Next Generation Science Standards. The iOS app allows students to record and review videos through three "lenses": (1) motion; (2) force (Newton's third law); and (3) energy, and the curriculum integrates informal and formal, inquiry-based learning strategies to promote greater student knowledge and understanding of physics. The program was designed to be implemented in a formal school setting during the regular school day. This report describes the results of an experimental study of the Playground Physics program's impact on learning of physics concepts, student engagement, and science-related attitudes. Sixty New York City middle grade teachers were randomly assigned to treatment or control conditions. Treatment teachers were asked to participate in Playground Physics professional development and use Playground Physics as part of their physics instruction during the 2015-16 academic year; control teachers were asked to use their regular instruction. In total, 15 teachers left the study. The final sample included student data from 24 treatment teachers and 21 control teachers. The following are appended: (1) Playground Physics Curriculum Activities; (2) Student Outcome Measures; (3) Teacher Survey; (4) Impact Analysis Technical Approach; (5) Output from Statistical Models; (6) Knowledge Assessment Responses and Standards Alignment; (7) 2014-15 Fidelity of Implementation Analysis; and (8) Supplemental Analysis.

We study the effectiveness of teachers certified by the National Board for Professional Teaching Standards (NBPTS) in Washington State, which has one of the largest populations of National Board-Certified Teachers (NBCTs) in the nation. Based on value-added models in math and reading, we find that NBPTS-certified teachers are about 0.01-0.05 student standard deviations more effective than non-NBCTS with similar levels of experience. Certification effects vary by subject, grade level, and certification type, with greater effects for middle school math certificates. We find mixed evidence that teachers who pass the assessment are more effective than those who fail, but that the underlying NBPTS assessment score predicts student achievement.

Behavioral trajectories during middle childhood are predictive of consequential outcomes later in life (e.g., substance abuse, violence). Social and emotional learning (SEL) programs are designed to promote trajectories that reflect both growth in positive behaviors and inhibited development of negative behaviors. The current study used growth mixture models to examine effects of the "Positive Action" program (PA) on behavioral trajectories of social-emotional and character development (SECD) and misconduct using data from a cluster-randomized trial that involved 14 schools and a sample of predominately low-income, urban youth followed from 3rd through 8th grade. For SECD, findings indicated that PA was similarly effective at improving trajectories within latent classes characterized as "High/declining" and "Low/stable". Favorable program effects were likewise evident to a comparable degree for misconduct across observed latent classes that reflected "Low/rising" and "High/rising" trajectories. These findings suggest that PA and perhaps other school-based universal SEL programs have the potential to yield comparable benefits across subgroups of youth with differing trajectories of positive and negative behaviors, making them promising strategies for achieving the intended goal of school-wide improvements in student outcomes. [This paper was published in "Prevention Science" v18 p214-224 2017.]

The purpose of this study was to evaluate the impact of Achieve3000, a differentiated online literacy curriculum, on students' scores on the California State Test (CST). In the 2011-12 school year, 1,957 students in Chula Vista began using Achieve3000's solutions in 3rd through 8th grade. Using a form of propensity score matching called Inverse Probability-of-Treatment Weighting (IPTW), the researchers assigned weights for the likelihood that students in the non-user comparison group (N = 7,598) could have been in the Achieve3000 treatment group. A Weighted Least Squares (WLS) regression model with IPTW weights estimated the average treatment effect. The researchers found that, overall, the students assigned to Achieve3000 performed statistically significantly higher on the CST, by 2.4 points, than students who were not using these solutions. This suggests the program is effective in improving student learning over conventional classroom activities in the first year of use, however more data is needed to determine the long term impact of usage. Five appendices contain supplemental tables and figures.

The current teacher workforce is younger, less experienced, more likely to turnover, and more diverse in preparation experiences than the workforce of two decades ago. Research shows that inexperienced teachers are less effective, but we know little about the effectiveness of teachers with different types of preparation. In this study, we classify North Carolina public school teachers into "portals"--fixed and mutually exclusive categories that capture teachers' formal preparation and qualifications upon first entering the profession--and estimate the adjusted average test score gains of students taught by teachers from each portal. Compared with undergraduate-prepared teachers from in-state public universities, (a) out-of-state undergraduate-prepared teachers are less effective in elementary grades and high school, (b) alternative entry teachers are less effective in high school, and (c) Teach For America corps members are more effective in STEM subjects and secondary grades.

New Leaders is a nonprofit organization with a mission to ensure high academic achievement for all students by developing outstanding school leaders to serve in urban schools. Its premise is that a combination of preparation and improved working conditions for principals, especially greater autonomy, would lead to improved student outcomes. Its approach involves both preparing principals and partnering with school districts and charter management organizations (CMOs) to improve the conditions in which its highly trained principals work. As part of the partnerships, New Leaders agrees to provide carefully selected and trained principals who can be placed in schools that need principals and to provide coaching and other support after those principals are placed. The districts and CMOs agree to establish working conditions that support, rather than hinder, the principals' efforts to improve student outcomes. This report describes how the New Leaders program was implemented in partner districts, and it provides evidence of the effect that New Leaders has on student achievement. [The research in this report was produced within RAND Education. For the appendices that accompany this report, see ED561154. For the research brief, "Principal Preparation Matters: How Leadership Development Affects Student Achievement. Research Brief," see ED561155.]

In 2007, using funds from the federal Teacher Incentive Fund (TIF) and private foundations, the Chicago Public Schools (CPS) began piloting its version of a schoolwide reform model called the Teacher Advancement Program (TAP). Under the TAP model, teachers can earn extra pay and take on increased responsibilities through promotion (to mentor teacher or master teacher), and they become eligible for annual performance bonuses based on a combination of their contribution to student achievement (known as "value added") and observed performance in the classroom. The model calls for weekly meetings of teachers and mentors ("cluster groups"), and regular classroom observations by a school leadership team to help teachers meet their performance goals. The idea behind TAP is that giving teachers performance incentives, along with tools to track their performance and improve instruction, will help schools attract and retain talented teachers and help all teachers raise student achievement. This report is the last in a series of reports providing evidence on the impacts of CPS' version of TAP, called "Chicago TAP." It presents findings from the four-year implementation period, with special emphasis on the 2009-2010 and 2010-2011 school years, the third and fourth years of the program's rollout in Chicago. Earlier reports (Glazerman et al. 2009; Glazerman and Seifullah 2010) provide detailed data on each of the first two years of the program, respectively. CPS implemented Chicago TAP as a pilot program intended for 40 high-need schools. The program began in 10 schools in the first year (cohort 1) with a rollout plan to add 10 more Chicago TAP schools (cohorts 2, 3, and 4) in each year of the TIF grant's four-year implementation period. The authors address three research questions regarding Chicago TAP: (1) How was the program implemented?; (2) What impact did the program have on student achievement?; and (3) What impact did the program have on teacher retention within schools? To assess the first year under Chicago TAP for schools that began the program in fall 2009 (cohort 3), the authors looked at how teacher development and compensation practices in Chicago TAP schools differ from practices normally implemented in CPS schools. The authors found that teachers in Chicago TAP schools reported receiving significantly more mentoring support than teachers in similar non-TAP (control) schools. This finding reflects the fact that under the Chicago TAP model, teachers are guided by mentor teachers, and cluster groups meet weekly. They also found that veteran teachers in Chicago TAP schools were more likely than their control group counterparts to provide mentoring support to their colleagues; this finding is consistent with the fact that under Chicago TAP, teachers have the opportunity to assume leadership roles and responsibilities as Chicago TAP mentor or lead teachers. Teachers in Chicago TAP schools (veteran and novice) were aware of their eligibility for performance-based compensation. The authors found that the amount of compensation they expected approached the amount that was eventually paid out; that is, the average expectation was about $900, and the actual amount paid out in bonuses to this group was an average of about $1,100 per teacher. They generally did not find evidence of an impact of Chicago TAP on teacher attitudes or school climate. While the introduction of Chicago TAP led to real changes inside the schools, the program did not consistently raise student achievement as measured by growth in Illinois Standards Achievement Test (ISAT) scores. The authors found evidence of both positive and negative test score impacts in selected subjects, years, and cohorts of schools, but overall there was no detectable impact on math, reading, or science achievement that was robust to different methods of estimation. For example, impacts on science scores overall (across years and cohorts) were positive, but not statistically significant unless they used one particular matching method that excluded some Chicago TAP schools from the analysis. The authors did find evidence suggesting that Chicago TAP increased schools' retention of teachers, although the impacts were not uniform or universal across years, cohorts, and subgroups of teachers. They found that teachers who were working in Chicago TAP schools in 2007 returned in each of the following three years at higher rates than teachers in comparable non-TAP schools. For example, the authors found that 67 percent of classroom teachers in cohort 1 schools in fall 2007 returned to their same school in fall 2010 compared to about 56 percent of teachers in non-TAP schools, an impact of nearly 12 percentage points. In other words, teachers in Chicago TAP schools in fall 2007 were about 20% more likely than teachers in comparison schools to be in those same schools three years later. When the authors looked at teachers who were working in schools that started Chicago TAP in later years, some of the impact estimates were not statistically significant. The authors also found some evidence of impacts on retention for subgroups of teachers, such as those with less experience, but the pattern of findings was not consistent. When they considered retention of teachers in the district, the authors did not find consistent evidence of a measurable impact. Given that Chicago TAP is a school-specific program, their main focus was on school-level retention, as opposed to retention in the district. Appended are: (1) Propensity Score Matching; and (2) Supplemental Tables. (Contains 32 tables, 6 figures and 27 footnotes.) [For related reports, see "An Evaluation of the Teacher Advancement Program (TAP) in Chicago: Year One Impact Report. Final Report" (ED507502) and "An Evaluation of the Teacher Advancement Program (TAP) in Chicago: Year Two Impact Report" (ED510712).]

School leaders are increasingly being asked, whether by rhetoric or policy, to measurably improve student achievement. The resultant need to assist school leaders in their ability to improve teaching and learning for all students in their schools led to the establishment of the National Institute of School Leadership's (NISL's) Executive Development Program. The NISL program emphasizes the role of principals as strategic thinkers, instructional leaders, and creators of a just, fair, and caring culture in which all students meet high standards. The current national focus on the importance of effective, instructional leadership has, in turn, led to calls for principal evaluation to be tied directly to student achievement (Davis, Kearney, Sanders, Thomas, and Leon, 2011). Within this milieu, effective and proven principal leadership development programs are crucial. (Contains 3 tables and 2 figures.) [This report was produced by the Center for Educational Partnerships, Old Dominion University.]

We explored how a progress monitoring and instructional management system can be used to help educators differentiate instruction and meet the wide-ranging learning needs of their increasingly diverse classrooms. We compared classrooms in 24 states that used a curriculum-based progress monitoring and instructional management system, Accelerated Math, to same school control classrooms that did not use it. Among the major findings were the following: (1) At every grade level there were large differences in grade equivalent score and percentile gains for students in the experimental and control classrooms; (2) Gains were experienced across the achievement spectrum. An analysis of low-, middle-, and high-achieving students showed consistent rates of gain for each math objective mastered; (3) Intervention integrity had a significant effect on student achievement; (4) Teachers using the progress monitoring and instructional management system spent more time providing individual versus group instruction and felt better able to meet the individual needs of their students; and (5) Significantly more students who were in classrooms where teachers used the progress monitoring and instructional management system reported that they like math, help each other with math, and like math better this year than last year. Addition of a progress monitoring and instructional management system to ongoing mathematics instruction improves mathematics outcomes for students. The effects of the program clearly are a function of intervention integrity; when progress monitoring and instructional management practices are implemented with high fidelity or integrity, the mathematics performance of all students is significantly enhanced. Implications for practice are discussed.

The purpose of this study was to evaluate the Literacy-Infused Science Using Technology Innovation Opportunity (LISTO) validation project (Valid 45). LISTO was funded by the Investing in Innovation (i3) Fund and involved a multi-year intervention that provided virtual professional development and coaching, and literacy-infused science curricula to fifth-grade science teachers who taught predominantly low-income students and in predominantly rural public schools in Texas. The overarching goal of LISTO is to validate, via a 5-year longitudinal randomized controlled trial (RCT) study, literacy-infused science (LIS) instructional and curricular innovations to increase instructional capacity of teachers and to improve students' science and reading/writing literacy achievement in rural/non-rural schools for economically challenged (EC), inclusive of English language learners (ELL) students. Outcomes collected in the 2017-18 school year were considered to be exploratory, given the timing of Hurricane Harvey, which impacted Texas in August of 2017. Outcomes in the 2018-19 school year served as the confirmatory contrasts. LISTO resulted in increased teacher capacity to implement research-based strategies while teaching science content, yet this improvement did not necessarily translate into improved student achievement in science or reading. The LISTO professional development and coaching covered pedagogical strategies for teaching science, including those that have been shown to improve literacy and be particularly effective for ELs. There was a negative impact on students' science achievement in both 2017-18 (ES = -0.10) and in 2018--19 (ES = -0.13). There was a negative program impact on students' science interest (ES = -0.14), as measured by a survey, in 2017-18, and no impact in 2018-19. These quantitative findings were in conflict with qualitative data collected from LISTO teachers, who indicated that the program led to improvements in both science vocabulary and engagement and self-efficacy in science for students. LISTO had positive effects on teacher practices for a subsample of teachers, specifically on increased delivery of research-based instruction to teach science content as rated on a rubric by external reviewers (ES = +1.12). LISTO appeared to improve instructional practices for a sample of teachers who implemented the program for two years with complete data but did not positively impact student or teacher outcomes more broadly. However, results should be cautiously interpreted due to limitations of delayed and incomplete implementation in the first year of the project due to Hurricane Harvey. Encouragingly, teachers' overall positive reactions to the program suggest its potential to improve student affect and learning, but more extensive implementation experience by teachers and multi-year exposure by students starting from early grades may be needed to yield measurable benefits. Clearly, such focuses emerge as a highly recommended topic for future research.

Learning fractions is a critical step in children's mathematical development. However, many children struggle with learning fractions, especially fraction arithmetic. In this article, we propose a general framework for integrating understanding of individual fractions and fraction arithmetic, and we use the framework to generate interventions intended to improve understanding of both individual fractions and fraction addition. The framework, Putting Fractions Together (PFT), emphasizes that both individual fractions and sums of fractions are composed of unit fractions and can be represented by concatenating them (putting them together). To illustrate, both "3/9" and "2/9 + 1/9" can be represented by concatenating three 1/9s; similarly, 2/9 + 1/8 can be represented by concatenating two 1/9s and one 1/8. Interventions based on the PFT framework were tested in 2 experiments with fourth, fifth, and sixth grade children. The interventions led to improved performance on number line estimation and magnitude comparison tasks involving individual fractions and sums of fractions with equal and unequal denominators. Especially large improvements were observed on relatively difficult unequal-denominator fraction sum problems. The findings suggest that viewing individual nonunit fractions and sums of fractions as concatenations of unit fractions provides a sound conceptual foundation for improving children's knowledge of both. We discuss implications of the research for teaching and learning fractions, children's numerical development, and mathematics education in general.

Learning fractions is a critical step in children's mathematical development. However, many children struggle with learning fractions, especially fraction arithmetic. In this article, we propose a general framework for integrating understanding of individual fractions and fraction arithmetic, and we use the framework to generate interventions intended to improve understanding of both individual fractions and fraction addition. The framework, Putting Fractions Together (PFT), emphasizes that both individual fractions and sums of fractions are composed of unit fractions and can be represented by concatenating them (putting them together). To illustrate, both "3/9" and "2/9 + 1/9" can be represented by concatenating three 1/9s; similarly, 2/9 + 1/8 can be represented by concatenating two 1/9s and one 1/8. Interventions based on the PFT framework were tested in 2 experiments with fourth, fifth, and sixth grade children. The interventions led to improved performance on number line estimation and magnitude comparison tasks involving individual fractions and sums of fractions with equal and unequal denominators. Especially large improvements were observed on relatively difficult unequal-denominator fraction sum problems. The findings suggest that viewing individual nonunit fractions and sums of fractions as concatenations of unit fractions provides a sound conceptual foundation for improving children's knowledge of both. We discuss implications of the research for teaching and learning fractions, children's numerical development, and mathematics education in general. [The article was published in "Journal of Educational Psychology" (EJ1291033).]

We assessed the effects of a whole-school equity intervention implemented within a school-wide positive behavioral interventions and supports (PBIS) framework on racial inequities in school discipline in eight elementary schools with inequitable referrals for Black students. The intervention involved assessing patterns of racial disparities in school discipline decisions and providing professional development on adapting school-wide behavior systems to improve cultural responsiveness through concrete strategies targeting the patterns. After consent and matching on existing levels of racial inequities, half of the schools were randomly assigned to receive the intervention. Analyses showed that schools receiving the intervention had significant decreases in racial disparities in school discipline and rates of office discipline referrals (ODRs) for Black students, while control schools had minimal change. Results are discussed in terms of improving equity in school discipline within multitiered systems of support.

Research indicates that students with emotional and behavioral disorders (EBD) may engage in severe disruptions and off-task behaviors in the classroom setting that adversely impact the learning environment. This leads to many students identified as having EBD being placed in alternative education settings, such as restrictive schools or residential facilities. Due to placement in more restrictive environments and high rates of disciplinary actions, it is especially critical to decrease disruptive behaviors for students diagnosed with EBD. In addition, classroom teachers report disruptive behaviors and conduct problems as a major barrier to teaching their students. An ABC multiple baseline across classes design was used in an alternative school setting to evaluate the effects of explicit social skills training combined with a group contingency on class-wide levels of engagement and disruptive behavior. Participants were students in the first through sixth grade diagnosed with EBD. Through the class-wide intervention, social skills acquisition deficits were targeted through social skills instruction and social skills performance deficits were targeted through reinforcement programs. Results showed an increase in engagement and a decrease in disruptive behavior across all classrooms as a result of the intervention package.

This study examined the effects of a small group intervention targeting paraphrasing and text structure instruction on the main idea generation and reading comprehension of students with reading disabilities in Grades 4 and 5. Students (N = 62) were randomly assigned to receive the Tier 2-type intervention or business-as-usual instruction. Students in the intervention received 25, 40-minute lessons focused on paraphrasing sections of text by identifying the main topic and the most important idea about that topic. Students utilized the text structure organization to inform their main idea generation. Results yielded statistically significant, positive effects in favor of the intervention group on near-transfer and mid-transfer measures of text structure identification (g = 0.75) and main idea generation (g = 0.70), but no statistically significant effect on a far-transfer measure of reading comprehension. These findings provide initial support for utilizing this instruction to improve students' main idea generation on taught and untaught structures.

This randomized control trial examined the efficacy of an intervention aimed at improving multisyllabic word reading (MWR) skills among fourth- and fifth-grade struggling readers (n = 109, 48.6% male), as well as the relative effects of an embedded motivational beliefs training component. This study was a closely aligned replication of our earlier work. The intervention was replicated with a three-condition design: MWR only, MWR with a motivational beliefs component, and business-as-usual control. Students were tutored in small groups for 40 lessons (four 40-min lessons each week). When we combined performance of students in both MWR conditions, intervention students significantly outperformed controls on proximal measures of affix reading and MWR, as well as standardized measures of decoding, spelling, and text comprehension. Furthermore, there was a noted interaction between English learner status and treatment on spelling performance. There were no statistically significant main effects between the MWR groups on proximal or standardized measures of interest. Findings are discussed in terms of their relevance to MWR instruction for students with persistent reading difficulties and considerations for future research related to the malleability of motivation.

We examine the efficacy of an intervention to improve word reading and reading comprehension in fourth- and fifth-grade students with significant reading problems. Using a randomized control trial design, we compare the fourth- and fifth-grade reading outcomes of students with severe reading difficulties who were provided a researcher-developed treatment with reading outcomes of students in a business-as-usual (BAU) comparison condition. A total of 280 fourth- and fifth-grade students were randomly assigned within school in a 1:1 ratio to either the BAU comparison condition (n = 139) or the treatment condition (n = 141). Treatment students were provided small-group tutoring for 30 to 45 minutes for an average of 68 lessons (mean hours of instruction = 44.4, SD = 11.2). Treatment students performed statistically significantly higher than BAU students on a word reading measure (effect size [ES] = 0.58) and a measure of reading fluency (ES = 0.46). Though not statistically significant, effect sizes for students in the treatment condition were consistently higher than BAU students for decoding measures (ES = 0.06, 0.08), and mixed for comprehension (ES = -0.02, 0.14).

Objective: There are currently no empirically-supported, comprehensive school-based interventions (CSBIs) for children with autism spectrum disorder (ASD) without concomitant intellectual and language disability. This study compared outcomes for a CSBI (schoolMAX) to typical educational programming (services-as-usual [SAU]) for these children. Method: A total of 103 children (ages 6-12 years) with ASD (without intellectual and language disability) were randomly assigned by school buildings (clusters) to receive the CSBI (n=52 completed) or SAU (n=50 completed). The CSBI was implemented by trained school personnel and targeted social competence and ASD symptoms using social skills groups, emotion recognition instruction, therapeutic activities, behavioral reinforcement, and parent training. Outcome measures tested the effects of the CSBI on social competence and ASD symptoms, as well as potential collateral effects on academic achievement. Outcomes (baseline-to-follow-up) were assessed using tests of social-cognition and academic skills and behavioral observations (by masked evaluators) and parent-teacher ratings of ASD symptoms and social/social-communication skills (non-masked) [ClinicalTrials.gov, NCT03338530, https://www.clinicaltrials.gov/]. Results: The CSBI group improved significantly more than the SAU group on the test of emotion recognition skills and parent-teacher ratings of ASD symptoms (primary outcomes) and social/social-communication skills (secondary outcome). No differences between groups were detected for recess social interactions or academic skills. Conclusions: The CSBI improved several core areas of functioning for children with ASD compared to usual educational programming. Additional intervention elements may be needed to expand the efficacy of the CSBI so that the observed skills/symptom improvements generalize to recess social interactions and/or academic skills are enhanced. [This paper was published in the "Journal of Clinical Child and Adolescent Psychology" v48 n6 p922-933 Dec 2019.]

The goal of this randomized controlled trial (RCT) was to evaluate the effectiveness of a small-group intervention in fractions for fifth-graders who are performing below grade level in mathematics. The impact of the fractions intervention was assessed on fifth-grade at-risk students' understanding of foundational fractions concepts and procedural competence with fractions. For the fractions intervention, lessons from the "TransMath"® curriculum (Level 2; Woodward & Stroh, 2015) were modified to create 52 thirty-five-minute lessons focused only on fourth- and fifth-grade level fractions content that could be used in a small-group setting. In this rigorous large-scale RCT, a sample of 1,123 students from three school districts across two U.S. states were screened at the beginning of the school year using a fractions measure developed by the research team. Two hundred and five students who scored between the 15th and the 37th percentile on the screening measure and received parental consent to participate were randomly assigned to the intervention (n = 102) and comparison (n = 103) conditions. Students in the fractions intervention condition received 35-minute tutoring sessions 3-4 times a week. Fraction instruction using the 52 "TransMath" lessons was provided by trained tutors. The comparison condition (n = 103) was business as usual instruction (i.e., core classroom fractions instruction, including intervention or support traditionally provided by the school). Results from the final analytic sample of 186 students (87 in intervention, 99 in comparison) showed that the intervention group significantly outperformed the comparison group on all outcome measures, which included an array of assessments used to measure both student understanding of foundational fractions concepts as well as procedural competence with grade-level fraction material (Hedges' g = 0.66 to 1.08; p < 0.0001).

The purpose of the study was to conduct a randomized controlled trial (RCT) to demonstrate efficacy of the Class-wide Function-Related Intervention Teams (CW-FIT) program. The study was designed to replicate an initial RCT conducted by the CW-FIT developers in 1 site, with 2 additional research groups not involved in its development. The study was conducted across 3 states, in 21 culturally diverse schools, and with 83 teachers (classrooms) assigned to CW-FIT and 74 teachers (classrooms) assigned to the comparison group. The CW-FIT intervention included teaching prosocial skills and use of differential attention (teacher praise and points) for appropriate behaviors using a group contingency, class teams, goal setting, points, and rewards. Class-wide student on-task behavior improved, teacher praise and attention to appropriate behaviors increased, and reprimands decreased in the CW-FIT classes with significantly fewer changes over time for the comparison group.

This article presents findings from a randomized controlled trial (RCT) testing the impact of a novel coaching approach utilized as one element of the Double Check cultural responsivity and student engagement model. The RCT included 158 elementary and middle school teachers randomized to receive coaching or serve as comparisons; all participating teachers were exposed to school-wide professional development activities. Pre-post nonexperimental comparisons indicated improvements in self-reported culturally responsive behavior management and self-efficacy for teachers in both conditions following professional development exposure. With regard to the experimental findings, trained observers recorded significantly more proactive behavior management and anticipation of student problems by teachers, higher student cooperation, less student noncooperation, and fewer disruptive behaviors in classrooms led by coached teachers relative to comparison teachers. Taken together, the findings suggest the potential promise of coaching combined with school-wide professional development for improving classroom management practices and possibly reducing office discipline referrals among Black students.

Schools continue to strive for the use of evidenced-based interventions and policies to foster well-managed classrooms that promote improved student outcomes. The present study examined the effects of the Class-Wide Function-related Intervention Teams (CW-FIT), a group contingency intervention, on the on-task and disruptive behavior of elementary school students with or at risk for emotional behavior disorders (EBD). Seventeen elementary schools, 159 general education teachers, and 313 students participated in the randomized-control group design study. Fidelity of implementation was strong for intervention group teachers and was measured across groups and throughout baseline conditions. Results suggest that CW-FIT can be used to increase on-task behavior and reduce the disruptive behavior of students with or at risk for EBD. In addition, teachers in intervention classes increased praise and reduced reprimands to individual students and along with their students, reported high levels of consumer satisfaction.

Objectives: This study evaluated the efficacy of a novel psychosocial intervention (Collaborative Life Skills, CLS) for primary-school students with ADHD symptoms. CLS is a 12-week program consisting of integrated school, parent, and student treatments delivered by school-based mental health providers. Using a cluster randomized design, CLS was compared to usual school/community services on psychopathology and functional outcomes. Methods: Schools within a large urban public school district were randomly assigned to CLS (12 schools) or usual services (11 schools). Approximately six students participated at each school (N = 135, mean age = 8.4 years, grade range = 2nd-5th, 71% boys). Using PROC GENMOD (SAS 9.4) the difference between the means of CLS and usual services for each outcome at post-treatment was tested. To account for clustering effects by school, the Generalized Estimating Equation method was used. Results: Students from schools assigned to CLS, relative to those assigned to usual services, had significantly greater improvement on parent and teacher ratings of ADHD symptom severity and organizational functioning, teacher-rated academic performance and parent ratings of ODD symptoms and social/interpersonal skills. Conclusions: These results support the efficacy of CLS relative to typical school and community practices for reducing ADHD and ODD symptoms and improving key areas of functional impairment. They further suggest that existing school-based mental health resources can be re-deployed from non-empirically supported practices to those with documented efficacy. This model holds promise for improving access to efficient, evidence-based treatment for inattentive and disruptive behavior beyond the clinic setting. [This article was published in the "Journal of the American Academy of Child and Adolescent Psychiatry," v55 p762-770 2016.]

Chicago Public Schools initiated the Excellence in Teaching Project, a teacher evaluation program designed to increase student learning by improving classroom instruction through structured principal-teacher dialogue. The pilot began in forty-four elementary schools in 2008-09 (cohort 1) and scaled up to include an additional forty-eight elementary schools in 2009-10 (cohort 2). Leveraging the experimental design of the roll-out, cohort 1 schools performed better in reading and math than cohort 2 schools at the end of the first year, though the math effects are not statistically significant. We find the initial improvement for cohort 1 schools remains even after cohort 2 schools adopted the program. Moreover, the pilot differentially impacted schools with different characteristics. Higher-achieving and lower-poverty schools were the primary beneficiaries, suggesting the intervention was most successful in more advantaged schools. These findings are relevant for policy makers and school leaders who are implementing evaluation systems that incorporate classroom observations.

The purpose of the study was to determine the efficacy of the Class-Wide Function-Related Intervention Teams (CW-FIT) program for improving students' on-task behavior, and increasing teacher recognition of appropriate behavior. The intervention is a group contingency classroom management program consisting of teaching and reinforcing appropriate behaviors (i.e., getting the teacher's attention, following directions, and ignoring inappropriate behaviors of peers). Seventeen elementary schools, the majority in urban and culturally diverse communities, participated in a randomized trial with 86 teachers (classrooms) assigned to CW-FIT, and 73 teachers (classrooms) assigned to the comparison group. Class-wide student on-task behavior improved over baseline levels in the intervention classes. Teachers were able to implement the intervention with high fidelity overall, as observed in adherence to 96% of the fidelity criteria on average. Teacher praise and attention to appropriate behaviors increased, and reprimands decreased. These effects were replicated in new classrooms each of the 4 years of the study, and for all years combined.

The purpose of this evaluation of Scholastic's "System 44" conducted by RMC Research was to expand the existing research on students with learning disabilities by conducting a randomized study of struggling readers with approximately half of the sample comprised of students with learning disabilities. Specifically, this evaluation examined the impact of "System 44" on the reading outcomes of struggling readers and on a subsample of students with learning disabilities in Grades 4-8. The evaluation of the implementation and impact of "System 44" involved 12 elementary schools and 4 middle and K-8 schools in a district in Michigan. Scholastic's "System 44" is a foundational reading program intended for older struggling readers who have not mastered basic phonics and decoding skills. Combining researched-based phonics instruction with adaptive technology, "System 44" is designed to improve students' word reading accuracy, fluency, and comprehension. The "System 44" program delivers research-based instruction through an adaptive computer component; teacher-led small-group instruction; and individual student practice involving high-interest, leveled materials. Thus students who have not responded to classroom reading instruction may benefit from the more intensive and specific decoding instruction provided through "System 44." The evaluators selected the target sample based on student performance on the fall 2011 Michigan Educational Assessment Program (MEAP) and spring 2011 AIMSweb assessment. The Scholastic Reading Inventory (SRI) was used to screen students for "System 44" eligibility. The district administered the SRI to all students in the target sample. Those students who scored below 600 Lexiles on the SRI were administered the Scholastic Phonics Inventory (SPI). All students who scored in the Beginning or Developing reader categories on the SPI were randomly assigned (stratified by school and grade level) to either the "System 44" treatment group or the control group. RMC Research hired and trained 4 local testers to individually administer a battery of standardized reading tests to all treatment and control group students. The testers administered the tests in October 2011 to establish baseline scores and again in May 2012 to attain follow-up scores. The tests included the following: (1) Test of Silent Reading Efficiency and Comprehension (TOSREC); (2) Comprehensive Test of Phonological Processing (CTOPP) Elision subtest; (3) Test of Word Reading Efficiency (TOWRE) Sight Word Efficiency subtest; and (4) Test of Word Reading Efficiency (TOWRE) Phonetic Decoding Efficiency subtest. The evaluation of "System 44" revealed significant impacts on several tests for both the overall sample and the learning disabled sample. Additional findings revealed that impacts were stronger on several tests for middle school students than for elementary school students, particularly on SPI Nonsense Word Accuracy, TOSREC, and SRI. Although significant impacts were attained by the end of Year 1, the majority of students in the study did not complete the "System 44" program. Data collected through teacher surveys, classroom visits, and interviews provided information on teachers' implementation of "System 44" in the classroom, and software usage data were used to examine differences in students with varying program exit and topic completion patterns. [For the November 2011 report, see ED613693.]

Scholastic's "System 44" is a foundational reading program intended for older struggling readers who have not mastered basic phonics and decoding skills. Combining researched-based phonics instruction with adaptive technology, "System 44" is designed to improve students' word reading accuracy, fluency, and comprehension. The "System 44" program delivers research-based instruction through an adaptive computer component; teacher-led small group instruction; and individual student practice involving high-interest, leveled materials. Thus students who have not responded to classroom reading instruction may benefit from the more intensive and specific decoding instruction provided through "System 44." Using a randomized design, this evaluation assessed the effectiveness of "System 44" in terms of improving the foundational reading skills of struggling readers in Grades 4-8 in a large suburban school district in southern California during the 2010-2011 school year. The evaluation of the implementation and impact of "System 44" involved 7 of the 11 elementary schools and all 4 middle schools in the district. A 2-step process was used to establish student eligibility for "System 44." The Scholastic Reading Inventory (SRI) was used to screen students in Grades 4-8 who performed below the 50th percentile on the spring 2010 California Standards Test (CST) for "System 44" eligibility. Those students who scored below 600 Lexiles on the SRI were administered the Scholastic Phonics Inventory (SPI), a computer-based test used to identify students in need of additional phonics instruction. Students who scored in the Beginning or Developing reader categories on the SPI were randomly assigned (stratified by school and grade level) to either the "System 44" treatment group or the control group. Data collection activities for the "System 44" evaluation included student reading tests, teacher surveys, "System 44" classroom observations, a professional development observation, and staff interviews. RMC Research hired and trained 4 local testers to administer a battery of standardized reading tests to all treatment and control students. The testers administered the tests to each student separately over a 3-week period in September and October 2010 to establish baseline scores and again in May 2011 to attain follow-up scores. Listed in order of administration, the tests included the following: (1) Test of Silent Reading Efficiency and Comprehension (TOSREC); (2) Comprehensive Test of Phonological Processing (CTOPP) Elision subtest; (3) Woodcock-Johnson III Word Identification subtest; (4) Woodcock-Johnson III Word Attack subtest; (5) Test of Word Reading Efficiency (TOWRE) Sight Word Efficiency subtest; and (6) Test of Word Reading Efficiency (TOWRE) Phonetic Decoding Efficiency subtest. This report details the program impact findings and concludes with recommendations from the evaluation team.

The authors describe an independent evaluation of the READ 180 Enterprise intervention designed by Scholastic, Inc. Despite widespread use of the program with upper elementary through high school students, there is limited empirical evidence to support its effectiveness. In this randomized controlled trial involving 312 students enrolled in an after-school program, the authors generated intention-to-treat and treatment-on-the-treated estimates of the program's impact on several literacy outcomes of fourth, fifth, and sixth graders reading below proficiency on a state assessment at baseline. READ 180 Enterprise students outperformed control group students on vocabulary (d = 0.23) and reading comprehension (d = 0.32) but not on spelling and oral reading fluency. The authors interpret the findings in light of the theory of instruction underpinning the READ 180 Enterprise intervention. (Contains 2 figures, 7 tables, and 4 notes.)

Aimed at low-income families in six of New York City's highest-poverty communities, Family Rewards ties cash rewards to a pre-specified set of activities and outcomes thought to be critical to families' short- and long-term success in the areas of children's education, family preventive health care, and parents' employment. The purpose of this project is to experimentally evaluate the effects of this three-year innovative holistic conditional cash transfer (CCT) initiative. This paper presents initial findings from an ongoing and comprehensive evaluation of Family Rewards. It examines the program's implementation in the field and families' responses to it during the first two of its three years of operations, and early findings on the program's impacts on children's educational processes and outcomes. More specifically, this paper addresses the following questions: (1) What are the effects of ONYC-Family Rewards on family income, poverty, and financial hardship?; (2) What are the effects of ONYC-Family Rewards on use of health care and health insurance?; (3) What are the effects of ONYC-Family Rewards on parents' employment and educational attainment?; and (4) What are the effects of ONYC-Family Rewards on children's educational outcomes? Overall, this study shows that, despite an extraordinarily rapid start-up, the program was operating largely as intended by its second year. Although many families struggled with the complexity of the program, most were substantially engaged with it and received a large amount of money for meeting the conditions it established. Specifically, nearly all families (98 percent) earned at least some rewards in both program years, with payments averaging more than $6,000 during the first two program years combined. The program reduced current poverty and hardship; increased savings; increased families' continuous use of health insurance coverage and increased their receipt of medical care; and increased employment in jobs that are not covered by the unemployment insurance (UI) system but reduced employment in UI-covered jobs. The program has had mixed success in improving children's academic performance specifically. Contrary to expectations, Family Rewards did not affect school attendance or annual standardized test scores in Math and English Language Arts (ELA) for either group of youngest children, but did lead to notable gains for a group of more academically prepared high school students. The program also had important effects on several key proposed mediators of the intervention. However, these effects vary by parents with different age groups of children. Appended are: (1) References; and (2) Tables and Figures. (Contains 2 tables.)

The District of Columbia School Choice Incentive Act of 2003, passed by Congress in January 2004, established the first federally funded, private school voucher program in the United States. Since that time, more than 8,400 students have applied for what is now called the DC Opportunity Scholarship Program (OSP), and a rigorous evaluation of the Program, mandated by Congress, has been underway. This last formal report from the ongoing evaluation describes the impacts of the Program at least four years after families who applied and were given the option to move from a public school to a participating private school of their choice. The research priorities for the evaluation were shaped largely by the primary topics of interest specified in the statute. This legislative mandate led the evaluators to focus on the following research questions: (1) What is the impact of the Program on student academic achievement? (2) What is the impact of the Program on other student measures? (3) What effect does the Program have on school safety and satisfaction? (4) What is the effect of attending private versus public schools? (5) To what extent is the Program influencing public schools and expanding choice options for parents in Washington, DC? These research questions are consistent with the topics that scholars and policymakers have identified as important questions of interest surrounding private school scholarship programs. The report found that that the Program had mixed longer-term effects on participating students and their parents, including: (1) No conclusive evidence that the OSP affected student achievement overall, or for the high-priority group of students who applied from "schools in need of improvement"; (2) The Program significantly improved students' chances of graduating from high school, according to parent reports. Overall, 82 percent of students offered scholarships received a high school diploma, compared to 70 percent of those who applied but were not offered scholarships. This graduation rate improvement also held for the subgroup of OSP students who came from "schools in need of improvement."; and (3) Although parents had higher satisfaction and rated schools as safer if their child was offered or used an OSP scholarship, students reported similar ratings for satisfaction and safety regardless of whether they were offered or used a scholarship. Appendices include: (1) Research Methodology; (2) Benjamini-Hochberg Adjustments for Multiple Comparisons; (3) Sensitivity Testing; (4) Relationship Between Attending a Private School and Key Outcomes; (5) Detailed ITT Tables; (6) Exploration of Whether Parents Get What They Seek From School Choice; (7) To What Extent Are Treatment Effects of the OSP Observed Across the Outcome Test-Score Distribution? Quantile Regression Analysis of the OSP; and (8) Intermediate Outcome Measures. (Contains 99 tables, 31 figures, and 61 footnotes.)

The Knowledge Is Power Program (KIPP) is a bold effort to create a network of charter schools designed to transform and improve the educational opportunities available to low/income families. KIPP schools seek to actively engage students and parents in the educational process, expand the time and effort students devote to their studies, reinforce students' social competencies and positive behaviors, and dramatically improve their academic achievement. Ultimately, the goal of KIPP is to prepare students to enroll and succeed in college. The KIPP Foundation is guiding this effort by selecting and training school leaders, promoting the program model, and supporting the KIPP network schools. This report presents preliminary findings from a matched, longitudinal analysis designed to estimate KIPP's effect on student achievement. The author's preliminary work estimates effects in 22 KIPP middle schools--making this the first report that applies a rigorous (nonexperimental) methodological approach across a nationwide sample of KIPP schools. They selected schools for which they were able to collect longitudinal, student/level data, and that were established by the 2005/06 school year or earlier to ensure that a minimum of two entering cohorts of students per school would be observed for multiple years. They find that students entering these 22 KIPP schools typically had prior achievement levels that were lower than average achievement in their local school districts. For the vast majority of KIPP schools studied, impacts on students' state assessment scores in mathematics and reading are positive, statistically significant, and educationally substantial. Estimated impacts are frequently large enough to substantially reduce race/ and income/based achievement gaps within three years of entering KIPP. They describe these findings in more detail in this report. Appendices include: (1) Administrative Data; (2) Supplemental Tables for Chapter II; (3) Analytic Methods; (4) Alternative Specifications; and (5) Subgroup Analyses. (Contains 34 tables, 21 figures and 28 footnotes.) [This paper was submitted to KIPP Foundation. For the accompanying report, see ED511108.]

In 2007, the Chicago Public Schools (CPS) began implementing a schoolwide reform called the Teacher Advancement Program (TAP) using funds from the federal Teacher Incentive Fund (TIF) and private foundations. Under the TAP model, teachers can earn extra pay and responsibilities through promotion to mentor or master teacher as well as annual performance bonuses based on a combination of their value added to student achievement and observed performance in the classroom. The idea behind the program is that performance incentives, combined with tools for teachers to track performance and improve instruction, should help schools attract and retain talented teachers and help all teachers produce greater student achievement. This report provides evidence on the impacts of TAP during the 2008-2009 school year, the second year of the program's rollout in CPS. Appended are: (1) Propensity Score Matching; and (2) Longitudinal Analysis of Test Score Data. (Contains 18 tables, 7 figures and 14 footnotes.) [For the Year One Impact Report, see ED507502.]

Adding to the growing debate and evidence base on the effects of charter schools, this evaluation was conducted in 36 charter middle schools in 15 states. It compares the outcomes of 2,330 students who applied to these schools and were randomly assigned by lotteries to be admitted (lottery winners) or not admitted (lottery losers) to the schools. Both sets of students were tracked over two years and data on student achievement, academic progress, behavior, and attitudes were collected. The study is the first large-scale randomized trial of the effectiveness of charter schools in varied types of communities and states. Among the key findings were that, on average, charter middle schools that held lotteries were neither more nor less successful than traditional public schools in improving math or reading test scores, attendance, grade promotion, or student conduct within or outside of school. Being admitted to a study charter school did significantly improve both students' and parents' satisfaction with school. Charter middle schools' impact on student achievement varied significantly across schools. Charter middle schools in urban areas--as well as those serving higher proportions of low-income and low achieving students--were more effective (relative to their nearby traditional public schools) than were other charter schools in improving math test scores. Some operational features of charter middle schools were associated with less negative impacts on achievement. These features include smaller enrollments and the use of ability grouping in math or English classes. There was no significant relationship between achievement impacts and the charter schools' policy environment. Because the study could only include charter middle schools that held lotteries, the results do not necessarily apply to the full set of charter middle schools in the U.S. Appended are: (1) Selecting the Charter School and Student Samples; (2) Calculation of Sample Weights; (3) Outcome Measures for the Impact Analysis; (4) Analytic Methods; (5) Supplemental Materials for Chapter III; (6) Supplemental Tables for Chapter IV; and (7) Supplemental Tables for Chapter V. (Contains 78 tables, 29 figures, and 164 footnotes.) [For the study snapshot of this full report, see ED510574.]

The purpose of this study was (1) to examine the causal effects of READ 180, a mixed-methods literacy intervention, on measures of word reading efficiency, reading comprehension and vocabulary, and oral reading fluency and (2) to examine whether print exposure among children in the experimental condition explained variance in posttest reading scores. A total of 294 children in Grades 4-6 were randomly assigned to READ 180 or a district after-school program. Both programs were implemented 4 days per week over 23 weeks. Children in the READ 180 intervention participated in three 20-min literacy activities, including (1) individualized computer-assisted reading instruction with videos, leveled text, and word study activities, (2) independent and modeled reading practice with leveled books, and (3) teacher-directed reading lessons tailored to the reading level of children in small groups. Children in the district after-school program participated in a 60-min program in which teachers were able to select from 16 different enrichment activities that were designed to improve student attendance. There was no significant difference between children in READ 180 and the district after-school program on norm-referenced measures of word reading efficiency, reading comprehension, and vocabulary. Although READ 180 had a positive impact on oral reading fluency and attendance, these effects were restricted to children in Grade 4. Print exposure, as measured by the number of words children read on the READ 180 computer lessons, explained 4% of the variance in vocabulary and 2% of the variance in word reading efficiency after all pretest reading scores were partialed out.

Much research has established the contribution of summer reading setback to the reading achievement gap that is present between children from more and less economically advantaged families. Likewise, summer reading activity, or the lack of it, has been linked to summer setback. Finally, family socioeconomic status has been linked to the access children have to books in their homes and neighborhoods. Thus, in this longitudinal experimental study we tested the hypothesis that providing elementary school students from low-income families with a supply of self-selected trade books would ameliorate summer reading setback. Thus, 852 students from 17 high-poverty schools were randomly selected to receive a supply of self-selected trade books on the final day of school over a 3-year period, and 478 randomly selected students from these same schools received no books and served as the control group. No further effort was provided in this intervention study. Outcomes on the state reading assessment indicated a statistically significant effect (p = 0.015) for providing access to books for summer reading along with a significant (d = 0.14) effect size. Slightly larger effects (d = 0.21) were found when comparing the achievement of the most economically disadvantaged students in the treatment and control groups. (Contains 3 tables and 2 notes.)

At the request of the State of Pennsylvania, the School District of Philadelphia, in the summer of 2002, asked three for-profit firms to assume responsibility for 30 of its lowest-performing schools and it asked four nonprofit managers to assume the management of 16 other low-performing schools. A difference-in-differences analysis is used to estimate the impact of nonprofit and for-profit management on individual student achievement. Gains in test scores at the treated schools are estimated by comparing them with gains in other low-performing schools in the district. Students at schools under for-profit management outperformed those at schools under nonprofit management in all six years in both reading and math. Most estimations are statistically significant. Impacts of for-profit management relative to district management were positive in math, but no reading impacts could be detected. At nonprofits, students appear to have learned substantially less, especially in math, at nonprofit schools, than had their school remained under regular district management. However, impacts fell short of statistical significance. (Propensity Score Analysis is appended. Contains 21 endnotes and 9 tables.)

This study tests the hypothesis that cultural differences in group orientation predict an interaction between the student variable--ethnicity--and a learning context variable--reward structure--on math performance after group learning. One hundred and thirty-two African-American and European-American female and male fourth and fifth grade students studied math estimation in one of three group learning contexts. The learning contexts operationalized were: intergroup competitive, interpersonally competitive, and communal-no reward. ANCOVA confirmed a predicted interaction of ethnicity with learning context on post study session performance. Although there was no difference overall, African-American and European-American students performed best in the aggregate in different contexts. Independent ratings of students' group-positive behaviors mirrored the two-way interaction between learning context and ethnicity. The findings suggest that important student variables interact with the variable elements of group learning and should be studied in greater detail. They also support Boykin's (1994) contention that the cultural context of learning is a critical mediator of children's achievement. (Contains 4 tables, 3 figures and 7 footnotes.)

The "District of Columbia School Choice Incentive Act of 2003," passed by the Congress in January 2004, established the first federally funded, private school voucher program in the United States. The purpose of the new scholarship program was to provide low-income residents, particularly those whose children attend schools in need of improvement or corrective action under the "Elementary and Secondary Education Act," with "expanded opportunities to attend higher performing schools in the District of Columbia" (Sec. 303). As part of this legislation, the Congress mandated a rigorous evaluation of the impacts of the Program, now called the "DC Opportunity Scholarship Program" (OSP). This report presents findings from the evaluation on the impacts three years after families who applied were given the option to move from a public school to a participating private school of their choice. The evaluation is based on a randomized controlled trial design that compares the outcomes of eligible applicants randomly assigned to receive (treatment group) or not receive (control group) a scholarship through a series of lotteries. The main findings of the evaluation so far include: (1) After 3 years, there was a statistically significant positive impact on reading test scores, but not math test scores; (2) The OSP had a positive impact overall on parents' reports of school satisfaction and safety, but not on students' reports; (3) This same pattern of findings holds when the analysis is conducted to determine the impact of using a scholarship rather than being offered a scholarship; (4) The OSP improved reading achievement for 5 of the 10 subgroups examined; and (5) No achievement impacts were observed for five other subgroups of students, including those who entered the Program with relative academic disadvantage. Six appendices are included: (1) Research Methodology; (2) Benjamini-Hochberg Adjustments for Multiple Comparisons; (3) Sensitivity Testing; (4) Detailed ITT Tables; (5) Relationship Between Attending a Private School and Key Outcomes; and (6) Intermediate Outcome Measures.. (Contains 115 footnotes, 15 figures and 129 tables.) [For Executive Summary, see ED504784. For "Evaluation of the DC Opportunity Scholarship Program: Impacts after Two Years", see ED501696. For "Evaluation of the DC Opportunity Scholarship Program: Impacts after One Year", see ED497154.]

Many students have difficulty achieving reading fluency, and nearly half of fourth graders are not fluent readers in grade-level texts. Intensive and focused reading practice is recommended to help close the gap between students with poor fluency and their average reading peers. In this study, the "Quick Reads" fluency program was used as a supplemental fluency intervention for fourth and fifth graders with below-grade-level reading skills. "Quick Reads" prescribes a repeated reading procedure with short nonfiction texts written on grade-appropriate science and social science topics. Text characteristics are designed to promote word recognition skills. Students were randomly assigned to "Quick Reads" instruction that was implemented by trained paraeducator tutors with pairs of students for 30 minutes per day, 4 days per week, for 18 weeks. At posttest, "Quick Reads" students significantly outperformed classroom controls in vocabulary, word comprehension, and passage comprehension. Fluency rates for both treatment and control groups remained below grade level at posttest. (Contains 5 tables.)

This study examined the effects of individualized, integrated language arts as a reading approach on struggling readers' comprehension scores obtained from oral narrative, silent narrative, and silent expository passages at three levels: below-grade, on-grade, and above-grade levels. Students (N = 93) in grades four through eight, who were reading below grade level, participated in the study. Treatment group students (n = 51) received individualized, integrated language arts as a reading approach once a week in place of basal reading instruction. Comparison group students (n = 42) received basal reading instruction for the duration of the study. Multivariate analysis of covariance was used to analyze posttest Analytical Reading Inventory (ARI) comprehension scores. Several statistically significant (p less than 0.001) differences in comprehension performance were found for on-grade-level scores and for above-grade-level scores, but few differences were found between treatment and comparison groups on below-grade-level scores. All statistically significant differences favored students in the treatment group. The findings of the study strongly suggest that the use of individualized, integrated language arts as a method for teaching reading is an effective approach for improving the reading comprehension performance of struggling readers. (Contains 5 tables.)

Our research project was guided by the assumption that students who learn to understand phenomena in everyday terms prior to being taught scientific language will develop improved understanding of new concepts. We used web-based software to teach students using a "content-first" approach that allowed students to transition from everyday understanding of phenomena to the use of scientific language. This study involved 49 minority students who were randomly assigned into two groups for analysis: a treatment group (taught with everyday language prior to using scientific language) and a control group (taught with scientific language). Using a pre-post-test control group design, we assessed students' conceptual and linguistic understanding of photosynthesis. The results of this study indicated that students taught with the "content-first" approach developed significantly improved understanding when compared to students taught in traditional ways. (Contains 8 tables and 2 figures.)

The National Board for Professional Teaching Standards (NBPTS) assesses teaching practice based on videos and essays submitted by teachers. We compared the performance of classrooms of elementary students in Los Angeles randomly assigned to NBPTS applicants and to comparison teachers. We used information on whether each applicant achieved certification, along with information on each applicant's NBPTS scaled score and subscores, to test whether the NBPTS score was related to teacher impacts on student achievement. We found that students randomly assigned to highly-rated applicants performed better than students assigned to comparison teachers, while students assigned to poorly-rated applicants performed worse. Estimates were similar using data on pairs of teachers that were not randomly assigned. Our results suggest a number of changes that would improve the predictive power of the NBPTS process.

Research was conducted to ascertain if a combined repeated reading and question generation intervention was effective at improving the reading achievement of fourth through eighth grade students with learning disabilities or who were at risk for reading failure. Students were assigned to a treatment or control group via a stratified random sampling. Instructional components and training were based on best practices reported in the literature. Students receiving intervention significantly improved their reading speed and ability to answer inferential comprehension questions on passages that were reread. Compared to the control group, students in the intervention group also made significant gains in oral reading fluency on independent passages.

This study assessed the effects of Peer-Assisted Learning Strategies (PALS), a reciprocal classwide peer-tutoring strategy, on the reading performance of native Spanish-speaking students with learning disabilities (LD) and their low-, average-, and high-achieving classroom peers. Participants were 132 native Spanish-speaking English language learners (ELL) in Grades 3 through 6, along with their 12 reading teachers. Teachers were assigned randomly to PALS and contrast groups. PALS sessions were conducted 3 times a week for 15 weeks. Students were tested before and after treatment. PALS students outgrew contrast students on reading comprehension, and those effects were not mediated by student type.

Used a matched-schools design, school-level achievement, and disciplinary data to evaluate the effectiveness of the elementary-level Positive Action program on students' performance and behavior over time. Results indicated that program participation improved student behavior, school involvement, and academic achievement into high school. The program had equally strong behavioral effects in higher risk schools. There was a clear dose-response relationship for most outcomes. (SM)

Teacher residencies are surfacing as a promising model for teacher preparation. One such residency program--Collaboration and Reflection to Enhance Atlanta Teacher Effectiveness (CREATE)--seeks to raise student achievement in local high-needs schools by increasing the effectiveness and retention of both new and veteran educators. CREATE aims to achieve this by developing critically-conscious, compassionate, and skilled educators who are committed to teaching practices that prioritize racial justice and interrupt inequities. This quasi-experiment, funded by an Investing in Innovations (i3) grant, follows two staggered cohorts of study participants (CREATE and comparison teachers) for three years per cohort, starting with the first cohort in 2015-16. Confirmatory analyses found no statistically significant effects of CREATE on two Teacher Assessment on Performance Standards (TAPS) ratings for Instructional Strategies (p = 0.221) and Positive Learning Environment (p = 0.192), or on student achievement on ELA (p = 0.454), math (p = 0.569), and general achievement (p = 0.234). However, exploratory analyses (pre-registered) found very promising results showing undisrupted retention over a three-year time period (spanning graduation from Georgia State University's College of Education and Human Development, entering teaching, and retention into the second year of teaching) for the CREATE group, relative to the comparison group (p = 0.038). We also observed that the favorable impact is driven largely by higher continuous retention among Black educators in CREATE relative to those in the comparison group (p = 0.021). The percentages of teachers in CREATE, as averaged across the two study cohorts, who maintain an uninterrupted trajectory of graduating from GSU-CEHD, and taught in their first and second year are 94.8%, 87.4% and 84.6%, respectively. In the matched comparison group the corresponding values are 87.9%, 72.9%, and 68.0%. Among Black teachers in CREATE, the values are 98.6%, 96.3% and 95.5%, respectively. In the matched comparison group of Black teachers, the corresponding values are 85.7%, 68.5%, and 62.8%. These results are further corroborated by statistically significant or marginally statistically significant differential impacts favoring Black teachers on several potential mediators of impact: resilience, self-efficacy, and stress management and empathy related to teaching. The positive findings on retention, particularly for Black educators, are important given that 44% of teachers in Georgia leave the profession within the first five years, with evidence in the literature indicating that in the South, Black teachers experience higher turnover rates than non-Black teachers (Carver-Thomas & Darling-Hammond, 2017). The authors discuss a number of factors that could have led to null impacts on confirmatory outcomes. The lack of variation in teacher performance ratings, which is a known issue in Georgia and in the literature at large (Weisberg et al, 2009; Kraft & Gilmour, 2017) could have contributed to the results for the TAPS ratings. Studies of teacher residency programs also suggest that impact on student achievement might not be present or detected in earlier years of teaching. Additionally, analyses of student achievement in this study were limited by small sample sizes of teachers in tested grades and subjects. The authors hope to address these limitations and to investigate the promising outcomes on retention, especially for Black educators, in current and future studies of CREATE, for which we have secured funding for programming and research through the eighth cohort. [For the appendices, see ED611803.]

The Louisiana Scholarship Program (LSP) offers publicly funded vouchers to moderate- and low-income students in low-performing public schools to enroll in participating private schools. Established in 2008 as a pilot program in New Orleans, the LSP expanded statewide in 2012. Drawing upon the random lotteries that placed students in LSP schools, we estimate the causal impact of using an LSP voucher to enroll in a private school on student achievement on the state accountability assessments in math, English Language Arts, and science over a four-year period, as well as on the likelihood of enrolling in college. The results from our primary analytic sample indicate substantial negative achievement impacts, especially in math, that diminish after the first year but persist after four years. In contrast, when considering the likelihood of students entering college, we observe no statistically significant difference between scholarship users and their control counterparts.

The Literacy Design Collaborative (LDC) was created to support teachers in implementing college and career readiness standards in order to teach literacy skills throughout the content areas. Teachers work collaboratively with coaches to further develop their expertise and design standards-driven, literacy-rich writing assignments within their existing curriculum across all content areas. This report presents the results on implementation of LDC in the New York City Department of Education during the third year of the intervention, and the impact of the program across multiple years. As of 2018-2019, participating schools included 13 from Cohort 1, which began implementation during the 2016-2017 school year, and 23 from Cohort 2, which commenced at the beginning of the 2017-2018 school year. Our primary impact analyses, presented in this report for the first time, pool teachers from both cohorts to measure their impact after participating in LDC for 2 consecutive years (2017-2018 student outcomes for Cohort 1 and 2018-2019 student outcomes for Cohort 2). Teachers and administrators appreciated LDC and perceived positive impact on their practice and their students' learning. Quasi-experimental analyses tended to produce positive estimates for the impact of LDC on student English language arts (ELA) assessment scores, but the differences did not reach the level of statistical significance. [For the 2017-2018 evaluation report, see ED606884.]

Engaged in the evaluation of LDC tools since June 2011, UCLA's National Center for Research on Evaluation, Standards, and Student Testing (CRESST) is using multiple data sources and a quasi-experimental design to examine LDC implementation and impact in two cohorts of schools in two large, urban school districts. This report presents the results on implementation of LDC in the large urban school district on the West Coast during the third year of the intervention, and the impact of the program across multiple years. Findings from both participant surveys and analyses of student outcomes reveal positive results for the LDC intervention. Analysis of student outcomes provided evidence of the program's effectiveness and confirmation for participants' positive views. Quasi-experimental analyses demonstrated a statistically significant positive impact of LDC as practiced by middle school teachers with 2 years of program experience across two cohorts of schools and teachers. A statistically significant positive impact was also found for Cohort 2 middle schools after just one year of implementation. [For the 2017-2018 report, see ED600053.]

Purpose: The Santa Ana Unified School District received an i3 grant (Investing in Innovation; funded by the U.S. Department of Education Grant number U411C160074) to build on their existing school climate practices. Called the Enhanced Positive School Climate Model, the aim is to improve school climate, student-adult relationships, create social emotional learning programs, and provide students the needed structure to access challenging curriculum and expectations. As part of this enhanced model, School Climate Liaisons (SCLs) were hired to support and provide coaching to schools in the intervention group on PBIS [Positive Behavioral Intervention and Supports], RP [Restorative Practice] implementation, and behavioral interventions. As part of the i3 grant requirements, the district employed a rigorous cluster-randomized trial whereby half of the district's elementary schools were assigned to receive the Enhanced Positive School Climate Model and half were assigned to a waitlist control. The confirmatory research question is: Do students in grades 4 and 5 at follow-up, in schools assigned to receive support from PBIS and Restorative Practice school climate specialists and community liaisons, who receive services for two years, exhibit higher levels of self-management at the end of the second year, as compared to students in grades 4 and 5 in schools assigned to not receive such support? Additionally, there were exploratory research questions examining changes in other SEL [social-emotional learning] measures including growth mindset, self-efficacy, and social awareness. Methods: This study employed a cluster-randomized controlled design whereby half of the study schools were assigned to the treatment condition and the other half of schools were assigned to the "business as usual" control condition. In total, 35 schools (30 K-5 schools; 5 K-8 schools) were randomly assigned to either the treatment or control condition. All students within these schools were included in the evaluation. Students in the treatment schools (n = 17) were eligible to receive services through the grant. Randomization occurred in May 2017. The 2016-17 school year served as a baseline school year (i.e., no services were provided). The Enhanced Positive School Climate Model began in the 2017-18 school year and continued into the 2018-19 school year for treatment schools only. Control schools were waitlisted and began receiving services in the 2019-20 school year. Students enrolled in district schools in May 2017 were tracked using student roster information through the end of the 2018-19 school year. Only students who were in study schools continuously from the 2016-2017 to 2018-2019 school years were included in the impact analysis. The confirmatory and exploratory outcomes referenced below were conducted using extant data from the district. Data were used from routine data collection processes within the district from the annual CORE climate student survey. The primary outcome measure was the five-item self-management scale on the CORE District's student survey (Taylor, Oberle, Durlak, & Weissberg, 2017; Transforming Education, 2014; https://www.rand.org/education-and-labor/projects/assessments/tool/2014/panorama-social-emotional-learning-questionnaire-measures.html) asked of all students in grades 4-12 each year. For the confirmatory research question (and all exploratory questions), adjusted post-intervention outcomes for students in treatment schools were compared to the outcomes for their counterparts in the control schools. This involved fitting conditional multilevel regression models (i.e., hierarchical linear modeling [HLM]), with additional terms to account for the nesting of individuals within schools (see Goldstein 1987; Raudenbush & Bryk, 2002; Murray 1998). Results: Eight two-level models were estimated per grade level to address the confirmatory and exploratory research questions. Although the students in treatment schools had slightly higher self-management, growth mindset and self-efficacy scores at follow-up, only the difference in fourth grade self-efficacy scores was statistically significant. In contrast, students in control schools had very slightly higher social awareness scores; this finding was not statistically significant. Implications: Meaningful and statistically significant differences were not found between students who attended schools that received the Enhanced Positive School Climate Model compared to their peers in schools that did not receive the Enhanced Positive School Climate Model. The lack of findings may be due to the other changes in school climate practices throughout the district during the study period. Additionally, variations in the implementation of the Enhanced Positive School Climate Model may have contributed to the lack of findings. Although the findings are not significant, the direction of results is mostly consistent, indicating increases in SEL competencies for students receiving additional school climate supports. Future studies should continue to investigate the relationship between whole-school approaches to school climate and changes in SEL competencies for students.

Science education has experienced a significant transition over the last decade, catalyzed by a re-envisioning of what students should know and be able to do in science. That re-envisioning culminated in the release of the Next Generation Science Standards (NGSS) in 2013. The new standards set off a chain reaction of standards adoption and implementation across states, districts, and schools, including steps taken toward transforming science professional learning, instruction, curriculum, and assessment. It was in this dynamic context that Empirical Education conducted an impact evaluation, as part of an Investing in Innovation (i3) grant, of WestEd's Making Sense of SCIENCE project, a teacher professional learning model aimed at raising students' science achievement through improving science instruction. Under this grant, WestEd and Empirical Education also partnered with Heller Research Associates (HRA) to conduct an implementation study and a scale-up study of Making Sense of SCIENCE. The impact evaluation, which is the focus of this report, was a two-year cluster-randomized control trial (RCT) that took place in California and Wisconsin across seven school districts and 66 elementary schools in the 2016-17 and 2017-18 school years. The study randomized schools to either receive the Making Sense of SCIENCE professional learning or to the business-as-usual ("control") group, which received the professional learning (delayed-treatment) after the study ended. The study found that Making Sense of SCIENCE had a positive impact on teacher content knowledge (effect size = 0.56, p = 0.006) and a positive impact on a holistic scale of teacher pedagogical content knowledge (effect size = 0.41, p = 0.026). The study also yielded positive and significant impacts on the amount of time teachers spent on science instruction (effect size = 0.40, p = 0.015) and on the emphasis that teachers placed on NGSS-aligned instructional practices, with statistically significant effect sizes ranging from 0.40 to 0.49. This suggestive evidence that Making Sense of SCIENCE changes classroom science learning experiences in ways that align with expectations in NGSS, which is a hypothesized precursor to measuring impacts on student achievement, deserves notice. In regard to student science achievement, the study did not find statistically significant results for the full sample of students (effect size = 0.06, p = 0.494), or for the sample of students in the bottom third of incoming math and English Language Arts achievement, with effect sizes of 0.22 (p = 0.099) and 0.073 (p = 0.567), respectively. Notably, with the exception of one negative effect size, additional analyses on student achievement using different measures and samples yielded positive, but not statistically significant, effect sizes ranging from 0.02 to 0.12. Evaluators offer three potential contributors to the findings of limited impact on student science achievement. First, given the timing of the study in relation to the release of the NGSS in 2013, finding a suitable NGSS-aligned student science assessment was a challenge. Second, most study schools and districts had not yet adopted NGSS-aligned curricula and did not have access to NGSS-aligned curriculum resources. Third, the sample of teachers was unstable across the two years, with the percentage of teachers leaving the school congruous to the percentage observed at the national level. [For the appendices, see ED609254; for the research summary, see ED609256.]

Too many talented students who go to under-resourced schools do not achieve their full potential. Though they may perform very well relative to their classmates, these students do not receive the same kinds of academically challenging opportunities throughout their educational journey as do their counterparts in better-resourced public and private schools. Rather than matriculating to competitive high schools and from there to selective colleges they are qualified to attend, these students often go to less academically competitive high schools and on to colleges where graduation rates are low. Some even forgo college altogether. To address this problem, Higher Achievement offers an intensive, academically oriented program for middle school students in under-resourced schools. Starting in the summer before fifth or sixth grade, Higher Achievement offers its participants, called "scholars," 650 extra hours of academic enrichment and instruction after school and during the summers through the eighth grade. The program includes English and math instruction as well as field trips to competitive high schools and colleges, achievement test preparation, and assistance in applying for financial aid. This short report presents the results of a randomized controlled trial of Higher Achievement that started in 2005, comparing the outcomes of students who were offered the opportunity to participate in Higher Achievement (the program group) and students who were not (the control group). It presents the impacts of the program one, two, and four years after enrollment, as well as its long-term impacts on college attendance. The study found that Higher Achievement was successful at changing the educational trajectory of students through middle school and improved the academic quality of many students' high school experiences, but did not affect the colleges to which they matriculated. By Year 2, there were positive impacts on students' math and reading test scores. In Year 4, the impacts on math test scores remained statistically significant. Higher Achievement had a small impact on the types of high schools its scholars ultimately attended. Program group students were more likely than control group students to matriculate to private or parochial schools and less likely to go to nonacademically competitive charter or magnet schools. By 2019, there was no difference in college going. More than 70 percent of both program and control group students had ever attended college. There were no differences in the academic quality of the colleges Higher Achievement's scholars ultimately attended, as measured by being a two- or four-year college; a college having a lower acceptance rate; or a college whose freshmen on average had higher SAT math or reading scores. Higher Achievement's college impacts did not differ by whether a student's parent had attended college or by student characteristics. The study shows that Higher Achievement is a very effective middle school program, improving students' middle school trajectories. However, the impacts did not persist after the program through high school and college.

The three-tiered Positive Behavioral Interventions and Supports (PBIS) framework promotes the development of systems and data analysis to guide the selection and implementation of evidence based practices across multiple tiers. The current study examined the effects of universal (tier 1) or school-wide PBIS (SW-PBIS) in one state's scale-up of this tier of the framework. Annual propensity score weights were generated to examine the longitudinal effects of SW-PBIS from 2006–07 through 2011–12. School-level archival and administrative data outcomes were examined using panel models with an autoregressive structure. The sample included 1316 elementary, middle, and high schools. Elementary schools trained in SW-PBIS demonstrated statistically significantly lower suspensions during the fourth and fifth study years (i.e., small effect size) and higher reading and math proficiency rates during the first two study years as well as in one and two later years (i.e., small to large effect sizes), respectively. Secondary schools implementing SW-PBIS had statistically significantly lower suspensions and truancy rates during the second study year and higher reading and math proficiency rates during the second and third study years. These findings demonstrate medium effect sizes for all outcomes except suspensions. Given the widespread use of SW-PBIS across nearly 26,000 schools in the U.S., this study has important implications for educational practices and policies.

The study examined the effect of National Board Certified Teachers (NBCTs) in instructional leadership roles, operationalized as mentors to novice teachers, on (a) classroom practices of mentored novice teachers in Grades K-12 and (b) student achievement of mentored teachers' students in Grades 4-8. The study compared outcomes between NBCT mentors and non-NBCT mentors. The study examined the effect of NBCT mentors after one academic year and was conducted in San Francisco Unified School District. Using the Classroom Assessment Scoring System, we examined novice teachers' classroom practices on the domains of Emotional Support, Classroom Organization, Instructional Support, and across all three domains. The results did not reach statistical significance, but the effect sizes for Emotional Support, Classroom Organization, and a global measure across all domains suggest meaningful differences between classroom practices of novice teachers mentored by NBCTs and non-NBCTs. These effect sizes were 0.28, 0.28, and 0.21 standard deviations, respectively. The effect size for the domain of Instructional Support was near zero at -0.06 standard deviations. Our sample size for the analysis of classroom practices did not have sufficient power to estimate differences at a statistically significant level. We examined student achievement using the state's standardized test scores in mathematics and English language arts. Our achievement measure includes either subject: That is, we did not estimate effects separately for mathematics and English language arts. The results suggest that students taught by teachers mentored by NBCTs had a higher level of achievement than students mentored by non-NBCTs. The difference was statistically significant at a p value of 0.05, and the effect size was meaningful at 0.18 standard deviations. Small sample sizes and low statistical power prevent us from making confident conclusions about the effect of NBCTs in instructional leadership roles on classroom practices of supported teachers and student achievement. However, the evidence is encouraging and warrants additional rigorous research on the impact of NBCTs as instructional leaders.

The Good Behavior Game (GBG, Barrish, Saunders, & Wolf, 1969) and the PATHS Curriculum (Promoting Alternative Thinking Strategies; Greenberg, Kusche, Cook, & Quamma, 1995) represent 2 universal, elementary school, preventive interventions which have been shown in large-scale, randomized controlled trials to have an immediate and beneficial impact (GBG, Dolan et al., 1993; PATHS, Conduct Problems Prevention Research Group [CPPRG], 1999) on aggressive/disruptive and off-task behavior. Importantly, both risk behaviors are strong predictors of antisocial behavior, drug abuse, and low educational and occupational attainment in adolescence and young adulthood (Kellam et al., 2008). What has yet to be explored within a randomized controlled trial is whether the combination of these interventions would yield significantly greater impact on aggressive/disruptive and off-task behavior than the GBG alone. One reason for expecting additive if not synergistic effects as a result of combining the two interventions is that the GBG, by increasing attention to task and reducing disruptive behavior in the classroom, may facilitate the acquisition of the emotion regulation, social problem-solving, and conflict resolution skills taught in PATHS. To that end, a group randomized, effectiveness trial was carried out, wherein 27 schools were randomly assigned to one of 3 conditions, (a) the PAX GBG Alone (Embry, Staatemeier, Richardson, Lauger, & Mitich, 2003), (b) PATHS to PAX (that is, the PAX GBG + PATHS), or (c) a standard setting (control) condition. Classroom observations and teacher ratings of student behavior were carried out at pretest and 6 months later at posttest. Limited evidence of the superiority of the combined approach was found and potential reasons why and future directions are discussed.

The Good Behavior Game (GBG, Barrish, Saunders, & Wolf, 1969) and the PATHS Curriculum (Promoting Alternative Thinking Strategies; Greenberg, Kusche, Cook, & Quamma, 1995) represent 2 universal, elementary school, preventive interventions which have been shown in large-scale, randomized controlled trials to have an immediate and beneficial impact (GBG, Dolan et al., 1993; PATHS, Conduct Problems Prevention Research Group [CPPRG], 1999) on aggressive/disruptive and off-task behavior. Importantly, both risk behaviors are strong predictors of antisocial behavior, drug abuse, and low educational and occupational attainment in adolescence and young adulthood (Kellam et al., 2008). What has yet to be explored within a randomized controlled trial is whether the combination of these interventions would yield significantly greater impact on aggressive/disruptive and off-task behavior than the GBG alone. One reason for expecting additive if not synergistic effects as a result of combining the two interventions is that the GBG, by increasing attention to task and reducing disruptive behavior in the classroom, may facilitate the acquisition of the emotion regulation, social problem-solving, and conflict resolution skills taught in PATHS. To that end, a group randomized, effectiveness trial was carried out, wherein 27 schools were randomly assigned to one of 3 conditions, (a) the PAX GBG Alone (Embry, Staatemeier, Richardson, Lauger, & Mitich, 2003), (b) PATHS to PAX (that is, the PAX GBG + PATHS), or (c) a standard setting (control) condition. Classroom observations and teacher ratings of student behavior were carried out at pretest and 6 months later at posttest. Limited evidence of the superiority of the combined approach was found and potential reasons why and future directions are discussed.

The Parent Leadership Institute (PLI) of Children's Aid (CA), funded via a 2013 Investing in Innovation (i3) development grant operated between the 2014-15 through 2018-19 school years. Key goals of the PLI included: (1) improving the capacity of parents to effectively engage in the school community in support of their child; and (2) increasing the capacity of school staff to create and support environments which are welcoming to and supportive of the active engagement of parents as key members of the school community. Through implementation of the PLI, CA expanded its partnership with six schools located in the South Bronx community of Morrisania, an area characterized by high levels of poverty, health disparities, and crime, and low levels of academic achievement and attainment among both children and adults. This report serves as the final report on this phase of the PLI and includes an exploration of implementation during year 4 (2016-17 school year) and analyses of quantitative data on student academic performance. [This report was prepared for Children's Aid New York.]

This randomized controlled trial examined the impact of adaptive, web-based, scaffolded silent reading instruction on 426 fourth- and fifth-grade students in an urban US school district. Reading proficiency was evaluated in the fall and spring using the Group Reading Assessment Diagnostic Evaluation (GRADE) and an eye movement recording system (Visagraph). Fall GRADE scores and demographic factors were used to pair students. One member of each pair was then randomly assigned to the treatment or control condition and their pair to the alternate condition. During scheduled 25-minute supplemental literacy blocks, students in the control group received "business-as-usual" reading instruction, whereas the treatment group engaged in scaffolded silent reading instruction. Structural equation modeling indicated that scaffolded silent reading instruction produced significantly larger gains on measures of reading efficiency in grade 4 and significantly larger gains on the GRADE reading achievement measures in grade 5. Implications for practice and future research are discussed.

In contrast to prior federally mandated school reforms, the Every Student Succeeds Act (ESSA) allows states more discretion in reforming their lowest performing schools, removes requirements to disrupt the status quo, and does not allocate substantial additional funds. Using a regression discontinuity design, we evaluate a state turnaround initiative aligned with ESSA requirements. We find the effect on student test score growth was not significant in year one and -0.13 in year two. Also in year two, we find that teachers in turnaround schools were 22.5 percentage points more likely to turn over. Teacher turnover appears to have been voluntary rather than the result of strategic staffing decisions.

This study assesses the implementation and impacts of the Teacher Potential Project (TPP), a program designed by EL Education and which includes an English language arts (ELA) standards-aligned curriculum and embedded professional development for teachers. The study uses a randomized controlled trial (RCT) design to assess the impacts of TPP on the instructional practice outcomes of ELA teachers in grades 3 through 8 and the ELA achievement outcomes of their students. The RCT includes 70 elementary and middle schools (35 treatment and 35 control) in 18 relatively high-need districts that were randomly assigned to treatment and control conditions within matched pairs of schools in three cohorts that began participating in the 2014-2015, 2015-2016, and 2016-2017 school years. Treatment schools engaged in TPP for one year while control schools continued with business as usual. The study also uses a two-year quasi-experimental design (QED) study to assess the impact of extending implementation of TPP to a second year on teacher instructional practice and student ELA achievement outcomes. EL Education recruited 22 of the study schools (10 treatment and 12 control) in five districts in one cohort to participate in a second year of the study. The study team collected a variety of data for the evaluation of TPP, including teacher surveys and classroom observations administered in fall and spring each year and student administrative records. Impacts of TPP on ELA teacher instructional practices and student ELA achievement were estimated using multivariate regression methods. The implementation evaluation found that the TPP ELA curriculum was implemented in all schools, and that there was generally high school-level implementation fidelity of the TPP professional development components in the first and second years of TPP among the novice ELA teachers. The impact evaluation found positive impacts of TPP on ELA teachers' overall instructional practices after one year compared to teachers who used their district-provided curriculum and participated in their district's professional development supports. After two years of teacher participation, impacts on their students' ELA achievement were roughly equivalent to 1.4 months of typical student improvement, or moving an average student scoring at the 50th percentile to the 54th percentile. The findings be useful to districts and policymakers aiming to support teachers and students in the context of rigorous state standards such as the Common Core State Standards (CCSS). The study of TPP makes several important contributions to the literature evaluating paired curriculum and PD programs: it uses rigorous group designs, evaluates the impact of one and two years of program implementation, and examines broad outcomes on both teacher instructional practice and student ELA achievement. [This report was submitted by Mathematica to EL Education.]

Nearly two dozen states now administer online exams to deliver testing to K-12 students. These tests have real consequences: their results feed into accountability systems, which have been used for more than a decade to hold schools and districts accountable for their students’ learning. We examine the rollout of computerbased testing in Massachusetts over 2 years to investigate test mode effects. Crucial to the study design is the state administering the same exam (PARCC) in online and offline formats each year during the transitional period. We find an online test penalty of about 0.10 standard deviations in math and 0.25 standard deviations in English language arts (ELA), which partially but not fully fades out in the second year of online testing.

In 2013, the National Board for Professional Teaching Standards received a 5-year Investing in Innovation Fund Development grant from the U.S. Department of Education to develop, implement, and study Accomplished Teaching, Learning, and Schools (ATLAS). ATLAS is an online case library that contains examples of "accomplished teaching" practice delivered by National Board Certified Teachers. A purpose of the grant activities was to expose preservice and early career teachers to ATLAS content, which was hypothesized to affect their teaching practice and the achievements of their students. This final report summarizes research on the first 2 years of the program's implementation at scale (during the grant's fourth and fifth years), and the effects of ATLAS use on the outcomes of preservice and early career teachers and on the mathematics and science achievements of students in Grades 3-6. The study team determined that ATLAS was implemented with fidelity at the institution of higher education and local education agency levels during the second study year but not the first study year. Regarding the effects of ATLAS use on the outcomes of preservice teachers, early career teachers, and students, the study did not identify any observable differences between ATLAS users and non-ATLAS users or their students. [This report was funded by the National Board for Professional Teaching Standards (NBPTS) through a U.S. Department of Education Investing in Innovation Fund grant to NBPTS.]

Managing classroom behavior is an important prerequisite to effective teaching and a salient need in alternative schools. Unfortunately, students from these schools are often underrepresented in the intervention literature. The primary aim of this study was to compare the effectiveness of two different theoretical approaches to classroom management, one behavioral (i.e., the good behavior game) and the other mindfulness-based (i.e., mindfulness skills training), with a sample of fifth-grade, predominantly African American students from an urban, high-poverty alternative school. The study examined the effectiveness of the two interventions in comparison to each other and a treatment-as-usual control using a quasi-experimental group design with blocked random assignment. Results revealed that neither intervention led to significant improvements in student internalizing behavior, externalizing behavior, or wellbeing. Though, some practically meaningful treatment effects were found through examination of effect sizes. Mindfulness skills training was the only condition to yield meaningful pre-post change in student outcomes, including a moderate therapeutic effect for externalizing behavior and an iatrogenic effect with respect to student wellbeing. These findings provide preliminary evidence that mindfulness skills training might have differential effects on student mental health outcomes, compared with education as usual and a traditional classwide behavioral intervention. Additionally, study findings make clear the importance of careful deliberation when transporting evidence-based interventions to unique student populations and intervention contexts.

Managing classroom behavior is an important prerequisite to effective teaching and a salient need in alternative schools. Unfortunately, students from these schools are often underrepresented in the intervention literature. The primary aim of this study was to compare the effectiveness of two different theoretical approaches to classroom management, one behavioral (i.e., the good behavior game) and the other mindfulness-based (i.e., mindfulness skills training), with a sample of fifth-grade, predominantly African American students from an urban, high-poverty alternative school. The study examined the effectiveness of the two interventions in comparison to each other and a treatment-as-usual control using a quasi-experimental group design with blocked random assignment. Results revealed that neither intervention led to significant improvements in student internalizing behavior, externalizing behavior, or wellbeing. Though, some practically meaningful treatment effects were found through examination of effect sizes. Mindfulness skills training was the only condition to yield meaningful pre-post change in student outcomes, including a moderate therapeutic effect for externalizing behavior and an iatrogenic effect with respect to student wellbeing. These findings provide preliminary evidence that mindfulness skills training might have differential effects on student mental health outcomes, compared with education as usual and a traditional classwide behavioral intervention. Additionally, study findings make clear the importance of careful deliberation when transporting evidence-based interventions to unique student populations and intervention contexts.

The Literacy Design Collaborative (LDC) was created to support teachers in implementing college and career readiness standards in order to teach literacy skills throughout the content areas. Teachers work collaboratively with coaches to further develop their expertise and design standards-driven, literacy-rich writing assignments within their existing curriculum across all content areas. The 2016-2017 school year was the first year of implementation, following a pilot year during which the implementation plan, instruments, data collection processes, and analytical methodologies were refined. Participants across all groups reported positive attitudes toward LDC and perceive a positive impact on student outcomes. Analysis of module artifacts suggest that teachers at the elementary school level were moderately successful in the backwards design process, particularly in developing high-quality writing tasks for students. As an ongoing multiyear intervention, the LDC implementation will continue to evolve year to year as participants provide feedback and LDC program managers make refinements. Thus, we anticipate that further significant changes to the course material and the delivery system that are already in progress for Year 2 will likely result in continued and possibly increased positive feedback. [Funding for this work was provided by the Literacy Design Collaborative.]

We examined the efficacy of an afterschool multicomponent reading intervention for third- through fifth-grade students with reading difficulties. A total of 419 students were identified for participation based on a 90 standard score or below on a screening measure of the Test of Silent Reading Efficiency and Comprehension. Participating students were randomly assigned to a business as usual comparison condition or one of two reading treatments. All treatment students received 30 min of computer-based instruction plus 30 min of small-group tutoring for four to five times per week. No statistically significant reading comprehension posttest group differences were identified (p > 0.05). The limitations of this study included high attrition and absenteeism. These findings extend those from a small sample of experimental studies examining afterschool reading interventions and provide initial evidence that more instruction, after school, may not yield the desired outcome of improved comprehension.

Disruptive student behavior, a common concern for teachers, presents particular challenges for those who teach art. Class-Wide Function-Related Intervention Teams (CW-FIT) is a multitiered intervention for implementing effective classroom management strategies aligned with schoolwide positive behavior interventions and supports. CW-FIT has proven effective in general education classrooms, with its emphasis on social skills instruction, teacher praise, group contingency, and positive reinforcement. This first study of CW-FIT implementation in elementary art classrooms examined its effects on student on-task behavior. The researchers used a single-subject (AB) design in one classroom and reversal designs (ABAB) in two classrooms. Results indicated student on-task behavior significantly improved, and the teacher was able to implement CW-FIT with fidelity as well as increase her praise-to-reprimand ratios. Both teacher and students found the intervention to be socially valid. Study implications and limitations are discussed.

"INSPIRE" is an Investing in Innovation (i3) development grant funded by the Office of Innovation and Improvement, U.S. Department of Education. "INSPIRE" provides an innovative integrated K-12 STEM pipeline approach focused on STEM course content and instructional redesign. The INSPIRE model was implemented in Cabarrus County Schools (CCS), which is among the largest school systems in North Carolina, serving nearly 30,000 students in 39 schools. The impact evaluation included two studies that examined the effect of INSPIRE on mathematics and science achievement as measured by North Carolina standardized End-of-Grades assessments. The elementary study (Study 1) used a three-year, longitudinal, single-cohort quasi-experimental design (QED) to assess the impact of INSPIRE on math achievement at the end of 5th grade after two years of program exposure. The secondary study (Study 2) used an individual-level, longitudinal, randomized controlled trial (RCT) with blocking by school level and cohort to assess the effects of INSPIRE on math and science achievement at the end of 7th and 10th grades after two years of program exposure. For both studies, we compared the outcomes of INSPIRE students with similar students from schools that did not offer a STEM program. For the elementary study, propensity score matching (PSM) was used to match INSPIRE elementary students and comparison student samples at baseline (on pre-test math achievement scores, gender, minority status, and economically disadvantaged status) and baseline equivalence was established all pre-test assessment measures; this study met What Works Clearinghouse (WWC) Group Design Standards with Reservations. For the secondary study, the overall and differential attrition rates were low based on the WWC attrition standards (WWC, 2017); this study met WWC Group Design Standards without Reservations. The results of the elementary study indicated a statistically significant difference between the "INSPIRE" treatment group and the business-as-usual comparison group on the math achievement outcome. Comparison students reported a statistically significant higher increase in math achievement than "INSPIRE" students. Results of the secondary study indicated no statistically significant difference between the "INSPIRE" treatment group and the business-as-usual comparison group on the math and science achievement outcome. The duration of students' exposure to INSPIRE, fidelity of implementation, alignment between PBL instruction and NC standardized assessments, and contextual factors that might have weakened the intervention strength relative to business-as-usual conditions are discussed as possible factors that account for these findings. The report concludes with suggestions for future research and implications for education policy.

This study explores preliminary results from a pedagogical intervention designed to improve instruction for all students, particularly emergent bilinguals in the United States (or English language learners). The study is part of a larger efficacy randomized controlled trial (RCT) of the Instructional Conversation (IC) pedagogy for improving the school achievement of upper elementary grade students. Standardized achievement student data were gathered from (N = 74) randomized teachers' classrooms. Preliminary ordinary least squares analyses of the intervention appear promising for English language arts in general. Limitations in baseline equivalency for students after teacher randomization are discussed along with strategies to overcome them and implications concerned with the education of all students, notably those whose parents speak languages other than English at home.

The purpose of this study was to examine the effects of a school-wide attendance and truancy intervention and universal procedures (ATI-UP) on student attendance. Student attendance was measured through average daily attendance and the percentage of students who would be considered chronically absent, i.e., missing 10% or more of school. The sample included 27 elementary schools in Oregon implementing school-wide positive behavior intervention and supports (SWPBIS) with varying levels of fidelity. Results indicate that schools can have a moderate effect on increasing average daily attendance (ADA) and a small effect on decreasing chronic absenteeism, although these results were not statistically significant. SWPBIS implementation did not act as a statistically significant moderator on the ATI-UP effects, although the treatment effect on ADA decreased with higher SWPBIS implementation. [The dissertation citations contained here are published with the permission of ProQuest LLC. Further reproduction is prohibited without permission. Copies of dissertations may be obtained by Telephone (800) 1-800-521-0600. Web page: http://www.proquest.com/en-US/products/dissertations/individuals.shtml.]

The present study is a wait-list controlled, randomized study investigating a teacher coaching approach that emphasizes formative assessment and visual performance feedback to enhance elementary school teachers' classroom practices. The coaching model targeted instructional and behavioral management practices as measured by the Classroom Strategies Assessment System (CSAS) Observer and Teacher Forms. The sample included 89 general education teachers, stratified by grade level, and randomly assigned to 1 of 2 conditions: (a) immediate coaching, or (b) waitlist control. Results indicated that, relative to the waitlist control, teachers in immediate coaching demonstrated significantly greater improvements in observations of behavior management strategy use but not for observations of instructional strategy use. Observer- and teacher-completed ratings of behavioral management strategy use at postassessment were significantly improved by both raters; ratings of instructional strategy use were significantly improved for teacher but not observer ratings. A brief coaching intervention improved teachers' use of observed behavior management strategies and self-reported use of behavior management and instructional strategies.

The goal of this pilot study was to evaluate the effectiveness of a multi-component consultation package in improving teachers' classroom management skills, particularly among teachers with lower baseline levels of knowledge, skills, and intervention-supportive beliefs. Participants were 58 elementary school teachers (93% female; 50% Non-Hispanic White) who received up to eight biweekly consultation sessions focused on general classroom management strategies and implementation of a daily report card (DRC) intervention with one target student with or at-risk for ADHD. Teachers were randomly assigned to either a comparison consultation condition designed to mirror current best practices (Frank & Kratochwill, 2014; Noell & Gansle, 2014) or a multi-component condition designed to simultaneously address teacher knowledge, skills, and beliefs as possible barriers to implementation of classroom interventions. Teachers in both conditions showed significant improvements in labeled praise, appropriate response to student rule violations, and general competence in classroom management. In support of the hypotheses, teachers with lower baseline levels of knowledge, skills, and intervention-supportive beliefs demonstrated more improvement in key outcomes in response to multi-component consultation, as compared to the comparison consultation (Cohen's "d" ranged from 0.33 to 1.12). Implications for research and practice in school consultation are discussed. [This paper was published in "School Mental Health" v9 p218-234 2017.]

Understanding teachers' stress is of critical importance to address the challenges in today's educational climate. Growing numbers of teachers are reporting high levels of occupational stress, and high levels of teacher turnover are having a negative impact on education quality. Cultivating Awareness and Resilience in Education (CARE for Teachers) is a mindfulness-based professional development program designed to promote teachers' social and emotional competence and improve the quality of classroom interactions. The efficacy of the program was assessed using a cluster randomized trial design involving 36 urban elementary schools and 224 teachers. The CARE for Teachers program involved 30 hr of in-person training in addition to intersession phone coaching. At both pre- and postintervention, teachers completed self-report measures and assessments of their participating students. Teachers' classrooms were observed and coded using the Classroom Assessment Scoring System (CLASS). Analyses showed that CARE for Teachers had statistically significant direct positive effects on adaptive emotion regulation, mindfulness, psychological distress, and time urgency. CARE for Teachers also had a statistically significant positive effect on the emotional support domain of the CLASS. The present findings indicate that CARE for Teachers is an effective professional development both for promoting teachers' social and emotional competence and increasing the quality of their classroom interactions.

Students with deficits in social skills have been found to experience both short- and long-term problems, including interpersonal conflicts and academic difficulties. These problems are compounded for students with emotional and behavioral disorders (EBD). Class-wide function-related intervention teams (CW-FIT), a multi-tiered classroom management program, has been shown to be effective in increasing on-task behavior and decreasing disruptive behavior of students at risk for EBD. The present study examined the effects of CW-FIT on teachers' ratings of students' social skills, problem behaviors, and academic competence. A randomized control trial was completed with 160 elementary school teachers located in 19 schools across three states. Teachers completed rating scales on 350 students identified as at risk for EBD, for whom consent had been obtained. After being randomly assigned to treatment or control conditions, CW-FIT was implemented for approximately four months in treatment classrooms, after which teachers completed post-test ratings on all students. CW-FIT implementation was associated with significantly improved teacher ratings of social skills and academic competence for students at risk for EBD, but no significant changes in teacher ratings of student problem behaviors were found. Higher fidelity of CW-FIT implementation was associated with improved outcomes. Implications, limitations, and areas for future research are addressed. [This paper was published in "Journal of Positive Behavior Interventions."]

Small-group, text-based discussions are a prominent and effective instructional practice, but the literature on the effects of different group composition methods (i.e., homogeneous vs. heterogeneous ability grouping) has been inconclusive with few direct comparisons of the two grouping methods. A yearlong classroom-based intervention was conducted to examine the ways in which group composition influenced students' discourse and comprehension. Fourth- and fifth-grade students (N = 62) were randomly assigned to either a homogeneous or heterogeneous ability small-group discussion. All students engaged in Quality Talk, a theoretically- and empirically-supported intervention using small-group discussion to promote high-level comprehension. Multilevel modeling revealed that, on average, students displayed positive, statistically and practically significant gains in both basic and high-level comprehension performance over the course of Quality Talk. Further, our findings indicated heterogeneous ability grouping was more beneficial than homogeneous ability grouping for high-level comprehension, on average, with low-ability students struggling more in homogeneous grouping. With respect to student discourse, additional quantitative and qualitative analyses revealed group composition differences in terms of the frequency, duration, and quality of student questions and responses, as well as the types of discourse low-ability students enacted in homogeneous groups. This study expands upon the extant literature and informs future research and practice on group composition methods. [This paper was published in "Contemporary Educational Psychology" v51 p336-355 2017.]

In 2011, the University of Alaska Fairbanks (UAF) received an Investing in Innovation (i3) Grant through the U.S. Department of Education. UAF applied for the grant to expand the predominantly rural-serving Alaska Statewide Mentor Project (ASMP) to urban settings. ASMP is a professional development initiative that supplies fully released, highly trained mentors to early career teachers (ECTs). UAF's i3 grant, The Urban Growth Opportunity (UGO), included five districts: Anchorage, Fairbanks North Star Borough, Kenai Peninsula Borough, Matanuska-Susitna Borough, and Sitka. This is the final report for the grant conducted over four years (2011 2012 to 2014 2015). The research team randomly assigned 556 ECTs to treatment (UGO) and business as usual (BAU) groups. UGO ECTs received an ASMP mentor for two years; BAU ECTs received their districts' business as usual support that varied by district and included content coaches without mentoring support and non-ASMP instructional mentoring support. Researchers conducted impact, implementation, and intervention studies. The impact study included seven outcomes: teacher retention; teacher instructional practice as measured by the three Classroom Assessment Scoring System (CLASS®) domains (Emotional Support, Classroom Organization, and Instructional Support); and student achievement in reading, writing, and mathematics as measured by the state assessment. While UGO ECTs were retained as teachers in Alaska public schools at higher rates than BAU ECTs, the difference was not statistically significant. There were no statistically significant differences between UGO and BAU ECTs on instructional practices as measured by CLASS®. Finally, student achievement was generally higher for students of UGO ECTs, but differences in achievement were statistically significant only for some student groups: primary reading students and secondary math students who were White, Hispanic, Alaskan Native, or two or more races. Results from the implementation study, conducted over three of the four years of implementation, found ASMP implemented UGO with fidelity across all components: mentor recruitment and assignment, mentor participation in professional development, mentor interaction with their ECTs, and mentors' use of formative assessment tools. Results from the intervention study identified two types of mentor-mentee dyads: Gliders and Sliders, with gliders engaging in longer conversations, focused more explicitly on instruction and students, responding to each other more often, and engaging as peers more frequently than the slider dyads.

Upper elementary school students who have reading problems may have difficulty in one or more areas of reading, each requiring specific types of interventions. This study evaluated a short-term reading intervention for 46 fifth-grade students with poor reading comprehension. Students were randomly assigned to an intervention or no treatment control condition. The 40 session (20 hr) intervention targeted reading comprehension strategy instruction in the context of informational science texts. Analyses showed statistically significant effects favoring the intervention on two proximal measures (i.e., measures closely related to the intervention content). The effects for the outcomes were moderate (gs = 0.61 and 0.72). There were no statistically significant differences on distal measures (i.e., measures less closely aligned with the intervention). The findings provide support for the efficacy of a reading comprehension intervention that may inform short-term interventions within a Response to Intervention framework.

Strong correlational evidence suggests that involvement in the arts improves students' academic outcomes and memory of learning events (e.g., Peppler et al., 2014; Robinson, 2013; Scripps & Paradis, 2014). It is unclear, however, whether the improved outcomes are the result of general exposure to the arts, arts integrated into content instruction, the use of effective instructional practices, or a combination of these factors. Moreover, as a growing number of studies suggest that arts-integrated pedagogy enhances learning, few empirical studies have explicitly examined the direct effect of an arts-integrated curriculum on learning and specifically on students' memory for non-arts academic content. Thus, this study sought to determine the effects of arts-integrated lessons on long-term memory for science content. We hypothesized that embedding arts-based activities into conventionally taught lessons would produce learning outcomes as good as or better than traditional instruction. This paper describes the results of a randomized control trial that measured retention of science content using arts-integrated science units and matched units employing convention science instruction. The study was conducted in 16 fifth-grade classrooms in an urban mid-Atlantic school district.

Homework is transforming at a rapid rate with continuous advances in educational technology. Computer-based homework, in particular, is gaining popularity across a range of schools, with little empirical evidence on how to optimize student learning. The current aim was to test the effects of different types of feedback on computer-based homework. In the study, middle school students completed a computer-based pretest, homework assignment, and posttest containing challenging algebraic problems. On the homework assignment, students were assigned to different feedback conditions. In Experiment 1 (N = 103), students received no feedback or correct-answer feedback after each problem. In Experiment 2 (N = 143), students received (1) no feedback, (2) correct-answer feedback, (3) try-again feedback, or (4) explanation feedback after each problem. For students with low prior knowledge, feedback resulted in better posttest performance than no feedback. However, students with high prior knowledge learned just as much whether they received feedback or not. Results suggest the provision of basic feedback on computer-based homework can benefit novice students' mathematics learning.

This "Math Snacks" intervention measured 741 fifth grade students' gains in conceptual understanding of core math concepts after game-based learning activities. Teachers integrated four "Math Snacks" games and related activities into instruction on ratios, coordinate plane, number systems, fractions and decimals. Using a randomized, controlled, quasi-experimental design, classrooms were randomly assigned to one of two conditions in a delayed treatment model. First Group A, and then Group B, received 5 weeks of "Math Snacks" intervention in addition to the regular district mathematics curriculum. Using a carefully refined test containing multiple choice and open-ended items, both groups were assessed three times: prior to any interventions, at the end of Phase 1 (when only Group A had received the intervention), and at the end of Phase 2 (when both groups had received the intervention). Students' mean gains over 5 weeks were significantly higher while receiving the "Math Snacks" intervention as compared to the group not receiving the intervention.

Intelligent Tutoring Systems (ITSs) are beneficial for individual students learning in several domains, including mathematics where they have been used to support both secondary and elementary students. Collaborative learning may be beneficial to include in ITSs, particularly for conceptual knowledge. There is little work on collaborative ITSs, and it has mostly focused on older students. We aim to extend this work to elementary school students, by extending an ITS for fractions so it supports collaborative learning. We also build upon our previous work to further investigate the complementary strengths of collaborative and individual learning. In our study, 189 elementary school students worked with a conceptual or a procedural fractions ITS, and either individually or collaboratively. Students in both ITS conditions learned, but there were no differences in learning between individual and collaboration. However, the students working collaboratively spent less time on the tutor, indicating potential benefits of collaborative learning on efficiency in this setting.

Data-based instructional programs have proliferated in American schools despite limited evidence of their effectiveness in improving educator practice and raising student achievement. We report results from a two-year school-randomized evaluation of the Achievement Network (ANet), a program providing schools with standards-aligned interim assessments and intensive supports for instructional data use. Survey data show that ANet increased teacher satisfaction with the timeliness and clarity of the data they receive and available supports for instructional data-use and caused them to review and use interim assessment data more often. ANet did not, however, affect their confidence in data use or how frequently they differentiated instruction. Student impact estimates show no overall effect on student achievement in English language arts or mathematics. Despite the lack program effects on student achievement, we find that achievement is positively correlated with our survey-based measures of teacher perceptions and practices around instructional data use. Exploratory analyses suggest that the success of ANet in improving teacher practice and student achievement varies with the pre-existing capacity of schools to engage in data-based instruction. Schools rated by program staff as having a high level of readiness to implement the intervention prior to random assignment experienced positive impacts on student achievement, while those rated as a having a low level of readiness experienced negative impacts. The following are appended: (1) School Screener Scoring Rubric; (2) Year 2 School Leader and Teacher Survey Scale Items; and (3) School Leader and Teacher Survey Impact Tables.

In August 2010, the Smithsonian Science Education Center (SSEC) received a grant of more than $25 million from the U.S. Department of Education's Investing in Innovation (i3) program for a five-year study to validate its Leadership Assistance for Science Education Reform (LASER) model in three very diverse regions of the United States: rural North Carolina, northern New Mexico, and the Houston Independent School District (HISD). This current report focuses on the confirmatory and exploratory research questions submitted to i3 for the two studies conducted for the LASER i3 validation grant, providing clarifying detail related to methodology and instrumentation. The studies were conducted to answer two confirmatory research questions and two exploratory research questions.

In 2013-14, the Wake County Public School System (WCPSS) launched Achieve3000 as a randomized controlled trial in 16 elementary schools. Achieve3000 is an early literacy program that differentiates non-fiction reading passages based on individual students' Lexile scores. Twoyear results show that Achieve3000 did not have a significant impact on student outcomes. However, both intent-to-treat and treatment-on-treated estimates show that in 2015, the second year of implementation, students in the treatment group outperformed their control-group counterparts by 0.13 standard deviation units (SD) on the year-end Achieve3000 LevelSet Lexile test. This effect size is consistent with mean empirical effect sizes reported by Lipsey et al. (2012). Yet in neither the pooled nor annual results did Achieve3000 significantly impact student performance on additional Lexile outcomes (EOG or DIBELS ORF). Both implementation and impact results for Achieve3000 suggest that the ability of this particular technology-based literacy solution to improve student performance beyond that of a control group fell short of vendor-defined and empirical expectations.

The purpose of this study was to assess the impact of the Arts for Learning (A4L) Lessons Project on the literacy and life skills of students in grades 3, 4, and 5. A4L Lessons is a supplementary literacy curriculum designed to blend the creativity and discipline of the arts with learning science to raise student achievement in reading and writing, as well as to develop literacy and life skills. A cluster-randomized trial was employed, randomly assigning 32 elementary schools in the Beaverton School District in Oregon to receive the A4L intervention or the status-quo control condition. Participants included approximately 5,700 students in the 16 intervention schools and approximately 6,100 students in the 16 control schools. Nearly 40% of the participants qualified for free/reduced-price lunch, approximately 17% were English language learners, and nearly 50% were racial/ethnic minorities. Achievement on the Oregon Assessment of Knowledge and Skills (OAKS) Reading/Literature test (i.e., the state reading test) were compared for the two groups. Achievement on the Comprehensive Cross Unit (CCU) Assessments (i.e., tests designed specifically to measure the impact of the A4L Lessons Project on literacy and life skills) were compared for a subset of six intervention and six control schools. Results from confirmatory analyses revealed no statistically significant impacts of the A4L Lessons Project on students' achievement on the OAKS Reading/Literature test. The effect sizes based on differences between the treatment and control students on the OAKS Reading/Literature test after one, two, and three years of program participation were very small, ranging from -0.03 to 0.05. Results from exploratory analyses revealed that treatment students in grade 4 scored significantly higher than control students on the CCU Assessment, indicating a positive impact of the A4L Lessons Project on student literacy and life skills. The effect sizes indexing the differences ranged from 0.30 to 0.36 across study years. Results from exploratory analyses using the CCU Assessments with students in grades 3 and 5 did not reach statistical significance, indicating that the A4L Lessons Project did not produce a positive impact on student literacy and life skills in these grades. Further research relying on more dependently sensitive assessments may be needed to better determine the impact of the A4L Lessons on students' literacy achievement. Tables are appended.

A multi-cohort cluster randomized trial was conducted to estimate effects of rich vocabulary classroom instruction on vocabulary and reading comprehension. A total of 1,232 fourth- and fifth-grade students from 61 classrooms in 24 schools completed the study. Students received instruction in 140 Tier Two vocabulary words featured in two grade-level novels. Teachers were randomly assigned to either rich vocabulary (treatment) or to business as usual (control). Teachers in the treatment condition allotted 30 minutes per day to the intervention for 14 weeks. Hierarchical linear modeling revealed positive, significant treatment effects on distal and proximal measures of vocabulary and comprehension. However, average distal treatment effects were small (approximate d =0.15) compared with proximal effects (approximate d = 1.24). Observations of teachers' language arts instruction indicated that treatment teachers spent significantly more time on vocabulary and less time on comprehension instruction than did teachers in the control condition. Results support the intensity and depth of the instruction for learning the taught corpus of words, and modest transfer to global vocabulary and comprehension.

In 2011 Baltimore City Schools submitted a successful proposal for an Investing in Innovations (i3) grant to offer a three year (2012-2014) summer program designed to expose rising sixth through eighth grade students to VEX robotics. The i3-funded Middle School Science, Technology, Engineering and Mathematics (STEM) Summer Learning Program was part of a larger Baltimore City STEM summer learning program entitled "Create the Solution" in 2012 and "22nd Century Pioneers" in 2013 and 2014. The five-week summer program offered in 2012, 2013, and 2014 consisted of a half-day of instruction in mathematics and science and a half-day of enrichment activities. The robotics workshop taught students the fundamentals of building robots and provided time for teams to build their own robots and participate in competitions. The larger program offered different enrichment activities such as sports or arts. This report addresses research questions regarding the program's: (1) implementation fidelity; (2) performance goals; (3) impact on student attendance and mathematics achievement outcomes; (4) impact on student aspirations for college, studying STEM subjects in college, and pursuing STEM careers; and (5) impact on measures of teacher effectiveness. The following includes a summary for each: (1) Implementation Fidelity: Instruction in mathematics and robotics was implemented with fidelity all three program years. Implementation fidelity was lower for the professional development in robotics and mathematics components of the program because teacher attendance rates did not meet the thresholds set by City Schools; (2) Enrollment Goals: Most program enrollment goals were not met. Enrollment in the i3-funded program was 193 students in 2012 (goal 400), 384 in 2013 (goal 500), and 386 in 2014 (goal 600). The program sought to enroll 80% low-performing students in mathematics each year, but fell significantly short of this goal despite the district's efforts to reach out to these students. In addition, the program goal of enrolling at least 50% female participants was not met. The program also sought to have at least 80% of students attend at least 70% of the time (17 of the 24 program days), but only 55% of students attended at that rate. The program did meet its goals for recruiting minority (at least 95%) and high poverty students (at least 80%) each year; (3) Program Impacts on Attendance: Found a significant program effect on attendance in the year following the 2012 program. Program students had average attendance rates of 1.4 percentage points higher than the comparison group the year following the program (97.0% vs. 95.6%). An even larger significant program effect for low-achieving students' attendance was found in the year following the 2012 program (96.4% vs. 93.8%). The 2013 program students had slightly but not significantly higher attendance rates than their matched comparison students in the year following the program. The authors also also examined whether there was still a program effect on attendance a year later (2013-14) for the Summer 2012 participants. Program participants had average attendance rates of 1.5 percentage points higher than comparison students (95.2% vs. 93.7%). Among the low-achieving students the attendance difference was 2.4 percentage points (93.6% for program students vs. 91.2% for comparison students). These effects were not statistically significant; (4) Program Impacts on Mathematics Achievement: There were no program effects on mathematics achievement for either the 2012 or 2013 programs; (5) Program Impacts on Student Aspirations: There was no evidence from student survey data that the robotics program had a positive effect on student aspirations to attend college, study STEM subjects in college, or pursue a STEM career for either the 2013 or 2014 programs; and (6) Program Impacts on Teacher Effectiveness: Analyses based on mean instructional effectiveness scores from Spring 2013 and Fall 2013 on the nine components of the district's teacher evaluation tool examined whether teachers who received the summer professional development in 2013 made gains in instructional effectiveness. The difference between program teachers' effectiveness scores before and after the professional development was not statistically significant. Data were not available to examine differences between program teachers and a comparable group of teachers who did not receive the summer professional development. The following are appended: (1) Implementation Fidelity; (2) Performance Goals; and (3) Methodology.

This study uses a randomized design to assess the impact of the Balanced Leadership program on principal leadership, instructional climate, principal efficacy, staff turnover, and student achievement in a sample of rural northern Michigan schools. Participating principals report feeling more efficacious, using more effective leadership practices, and having a better instructional climate than control group principals. However, teacher reports indicate that the instructional climate of the schools did not change. Furthermore, we find no impact of the program on student achievement. There was an impact of the program on staff turnover, with principals and teachers in treatment schools significantly more likely to remain in the same school over the 3 years of the study than staff in control schools.

TAP™: The System for Teacher and Student Advancement was launched in 1999 as a comprehensive educator effectiveness model to offer career advancement and leadership opportunities for educators, a fair and transparent evaluation process linked to job-embedded professional development and performance-based compensation, which culminate in improved instructional practices and student achievement. This study illustrates the impact of the TAP System in 66 Louisiana schools. These are primarily high-need schools, with average free/reduced price lunch eligibility of 86%, impacting more than 32,000 students each year. The authors report evidence of a positive effect of the TAP System on student achievement using two complementary analysis strategies: (1) They found a significant positive effect of TAP on 2012-13 K-8 Assessment Index scores, controlling for previous achievement, percentage of students receiving free or reduced price lunch, school configuration, school size (number of students), and percentage of English language learners. The 66 TAP schools scored 3.7 points higher on average than non-TAP schools statewide; and (2) They also found that the TAP schools had significantly greater 2012-13 Assessment Index scores than a group of matched control schools. The TAP schools scored 5.5 points higher on average than their matched controls.

Background: In the field of intelligence research, it has been shown that some people conceive intelligence as a fixed trait that cannot be changed (entity beliefs), whereas others conceive it as a malleable trait that can be developed (incremental beliefs). What about writing? Do people hold similar implicit theories about the nature of their writing ability? Furthermore, are these beliefs likely to influence students' response to a writing intervention? Aims: We aimed to develop a scale to measure students' implicit theories of writing (pilot study) and to test whether these beliefs influence strategy-instruction effectiveness (intervention study). Sample: In the pilot and intervention studies participated, respectively, 128 and 192 students (Grades 5-6). Method: Based on existing instruments that measure self-theories of intelligence, we developed the Implicit Theories of Writing (ITW) scale that was tested with the pilot sample. In the intervention study, 109 students received planning instruction based on the self-regulated strategy development model, whereas 83 students received standard writing instruction. Students were evaluated before, in the middle, and after instruction. Results: ITW's validity was supported by piloting results and their successful cross-validation in the intervention study. In this, intervention students wrote longer and better texts than control students. Moreover, latent growth curve modelling showed that the more the intervention students conceived writing as a malleable skill, the more the quality of their texts improved. Conclusion: This research is of educational relevance because it provides a measure to evaluate students' implicit theories of writing and shows their impact on response to intervention.

The authors' purpose was to determine the effects of computer-based practice and conceptual interventions on computational fluency and word-problem solving of fourth- and fifth-grade students with mathematics difficulties. A randomized pretest-posttest control group design found that students assigned to the computer-based practice intervention group outperformed students in the comparison group on the retention measure. Students assigned to the conceptual intervention did not outperform the comparison group on any of the outcome variables. Implications for instruction and interventions are discussed.

The authors' purpose was to determine the effects of computer-based practice and conceptual interventions on computational fluency and word-problem solving of fourth- and fifth-grade students with mathematics difficulties. A randomized pretest-posttest control group design found that students assigned to the computer-based practice intervention group outperformed students in the comparison group on the retention measure. Students assigned to the conceptual intervention did not outperform the comparison group on any of the outcome variables. Implications for instruction and interventions are discussed.

The authors' purpose was to determine the effects of computer-based practice and conceptual interventions on computational fluency and word-problem solving of fourth- and fifth-grade students with mathematics difficulties. A randomized pretest-posttest control group design found that students assigned to the computer-based practice intervention group outperformed students in the comparison group on the retention measure. Students assigned to the conceptual intervention did not outperform the comparison group on any of the outcome variables. Implications for instruction and interventions are discussed.

Previous research has linked inquiry-based science instruction (i.e., science instruction that engages students in doing science rather than just learning about science) with greater gains in student learning than text-book based methods (Vanosdall, Klentschy, Hedges & Weisbaum, 2007; Banilower, 2007; Ferguson 2009; Bredderman, 1983; Shymansky, Hedges, & Woodworth, 1990). The LASER model, being validated in the current study, has already been the subject of a number of case studies (RMC Research Corporation, 2010; Horizon Research, 2010; Vanosdall et al., 2007). However, experimental studies of the type that might establish a causal link between program implementation, student science learning, and other valued outcomes have yet to be conducted. Only a handful of studies have involved random assignment, and most of these have involved random assignment of students in a relatively small number of classrooms (see Furtak et al. 2009). With support from the U.S. Department of Education's Investing in Innovation Fund (i3), the current validation study of the LASER Model encompasses approximately 60,000 students, 1,900 teachers, and over 140 district administrators and principals. The efficacy of the LASER program has important implications for both research and practice when working with high-poverty schools and districts, who have limited resources and time available for science interventions. LASER's initial success with early learners also demonstrates its potential for reducing the development of chronic, long-term deficiencies and academic problems. One table and one figure are appended.

This study explored the effects of a web-based decision support system ("Tutorial") for writing standards-based Individualized Education Programs (IEPs). A total of 35 teachers and 154 students participated across two academic years. Participants were assigned to one of three intervention groups based on level of "Tutorial" access: Full, Partial, or Comparison. Direct effects of the intervention on procedural and substantive elements of IEPs revealed that, although all groups had initial IEPs of similar quality, the Full Intervention group's post-"Tutorial" IEPs had a significantly higher proportion of substantive items rated as adequate than did the IEPs of other groups. The intervention's indirect effects were examined using student scores on the State Reading Assessment. The Full Intervention group demonstrated a higher rate of reading score gain than the other two groups during the academic year in which the IEP prepared with access to the "Tutorial" was implemented. Implications for educational practices and future research directions are discussed.

This study highlights the connections between two facets of teachers' skills--those supporting teachers' mathematical instructional interactions and those underlying social interactions within the classroom. The impact of the Responsive Classroom (RC) approach and use of RC practices on the use of standards-based mathematics teaching practices was investigated in third-grade classrooms. Eighty-eight third-grade teachers from 24 elementary schools in a large suburban district were selected from a sample of teachers participating in a larger randomized-control study. Results showed that teachers at schools assigned randomly to receive training in the RC approach showed higher use of standards-based mathematics teaching practices than teachers in control schools. These findings were supported by analyses using fidelity of implementation: greater adherence to the intervention predicted the use of more standards-based mathematics teaching practices. Findings support the use of the RC approach for creating classroom social environments that facilitate standards-based mathematical practices. (Contains 3 tables and 1 note.)

Stanford University's Education Program for Gifted Youth (EPGY) conducted a randomized-treatment experiment during the 2006-2007 school year to test the efficacy, for Title I students, of the technological and individualized EPGY Kindergarten through Grade 5 Mathematics Course Sequence, modified for the Title I schools. Restricting attention to students who were in the top half of the distribution of correct first-exercise attempts (a measure of work and engagement), we found substantial and statistically significant improvements in the 2007 California Standard Math Tests (CST07) scores compared to those of matched control students. Gains in second grade were larger than those in Grades 3 to 5. Less able students, as measured by their 2006 CST mathematics scores, also had, on average, larger gains.

Background: School-based social-emotional and character development (SECD) programs can influence not only SECD but also academic-related outcomes. This study evaluated the impact of one SECD program, Positive Action (PA), on educational outcomes among low-income, urban youth. Methods: The longitudinal study used a matched-pair, cluster-randomized controlled design. Student-reported disaffection with learning and academic grades, and teacher ratings of academic ability and motivation were assessed for a cohort followed from grades 3 to 8. Aggregate school records were used to assess standardized test performance (for entire school, cohort, and demographic subgroups) and absenteeism (entire school). Multilevel growth-curve analyses tested program effects. Results: PA significantly improved growth in academic motivation and mitigated disaffection with learning. There was a positive impact of PA on absenteeism and marginally significant impact on math performance of all students. There were favorable program effects on reading for African American boys and cohort students transitioning between grades 7 and 8, and on math for girls and low-income students. Conclusions: A school-based SECD program was found to influence academic outcomes among students living in low-income, urban communities. Future research should examine mechanisms by which changes in SECD influence changes in academic outcomes.

Interim assessments are increasingly common in U.S. schools. We use high-quality data from a large-scale school-level cluster randomized experiment to examine the impact of two well-known commercial interim assessment programs on mathematics and reading achievement in Indiana. Results indicate that the treatment effects are positive but not consistently significant. The treatment effects are smaller in lower grades (i.e., kindergarten to second grade) and larger in upper grades (i.e., third to eighth grade). Significant treatment effects are detected in Grades 3 to 8, especially in third- and fourth-grade reading and in fifth- and sixth-grade mathematics.

The New York City Leadership Academy represents a unique experiment by a large urban school district to train and develop its own school leaders. Its 14-month Aspiring Principals Program (APP) selects and prepares aspiring principals to lead low-performing schools. This study provides the first systematic evaluation of achievement in APP-staffed schools after 3 or more years. We examine differences between APP principals and those advancing through other routes, the extent to which APP graduates serve and remain in schools, and their relative performance in mathematics and English language arts. On balance, we find that APP principals performed about as well as other new principals. If anything, they narrowed the gap with comparison schools in English language arts but lagged behind in mathematics. (Contains 2 figures, 9 tables, and 23 notes.)

Researchers have demonstrated that cognitive-behavioral intervention strategies--such as social problem solving--provided in school settings can help ameliorate the developmental risk for emotional and behavioral difficulties. In this study, we report the results of a randomized controlled trial of Tools for Getting Along (TFGA), a social problem-solving universally delivered curriculum designed to reduce the developmental risk for serious emotional or behavioral problems among upper elementary grade students. We analyzed pre-intervention and post-intervention teacher-report and student self-report data from 14 schools, 87 classrooms, and a total of 1296 students using multilevel modeling. Results (effect sizes calculated using Hedges' g) indicated that students who were taught TFGA had a more positive approach to problem solving (g = 0.11) and a more rational problem-solving style (g = 0.16). Treated students with relatively poor baseline scores benefited from TFGA on (a) problem-solving knowledge (g = 1.54); (b) teacher-rated executive functioning (g = 0.35 for Behavior Regulation and 0.32 for Metacognition), and proactive aggression (g = 0.20); and (c) self-reported trait anger (g = 0.17) and anger expression (g = 0.21). Thus, TFGA may reduce risk for emotional and behavioral difficulties by improving students' cognitive and emotional self-regulation and increasing their pro-social choices. (Contains 4 tables.)

Recess periods often lack the structure needed to support physical activity and positive social development (Robert Wood Johnson Foundation 2010). The Playworks program places full-time coaches in low-income schools to provide opportunities for organized play during recess and throughout the school day. Playworks activities are designed to engage students in physical activity, foster social skills related to cooperation and conflict resolution, improve students' ability to focus on class work, decrease behavioral problems and improve school climate. The Robert Wood Johnson Foundation (RWJF) contracted with Mathematica Policy Research and its subcontractor, the John W. Gardner Center for Youth and Their Communities (JGC) at Stanford University, to conduct a rigorous evaluation of Playworks. Twenty-five schools interested in implementing Playworks were randomly assigned to a treatment group that received Playworks in the 2010-2011 school year or to a control group that was not eligible to implement Playworks until the following year. The authors collected data from students, teachers and school staff in spring 2011 to document the implementation of Playworks and assess the impact of the program on key outcomes in six domains: (1) school climate, (2) conflict resolution and aggression, (3) learning and academic performance, (4) recess experience, (5) youth development and (6) student behavior. Ultimately, four additional schools will be added to the study and further analyses will be released. A description of study design and data sources. (Contains 4 exhibits, 15 tables and 2 endnotes.)

In the first study, using a randomized experiment to measure the impact of school vouchers on college enrollment, Matthew Chingos and Paul Peterson, professor of government at Harvard University, examine the college-going behavior through 2011 of students who participated in a voucher experiment as elementary school students in the late 1990s. They find no overall impacts on college enrollment but do find large, statistically significant positive impacts on the college going of African-American students who participated in the study. Their estimates indicate that using a voucher to attend private school increased the overall college enrollment rate among African Americans by 24 percent. The original data for the analysis come from an experimental evaluation of the privately funded New York School Choice Scholarships Foundation Program, which in the spring of 1997 offered three-year scholarships worth up to a maximum of $1,400 annually to as many as 1,000 low-income families. Chingos and Peterson obtained student information that allowed them to identify over 99 percent of the students who participated in the original experiment so that their college enrollment status could be ascertained by means of the college enrollment database maintained by the National Student Clearinghouse for institutions of higher education that serve 96 percent of all students in the United States. In addition to finding impacts on overall college-going for African Americans, the authors report significant increases in full-time college attendance, enrollment in private four-year colleges, and enrollment in selective four-year colleges for this group of students. Observational and Quasi-Experimental Research are appended. (Contains 7 tables and 19 endnotes.)

This study was conducted by the Central Region Educational Laboratory (REL Central) administered by Mid-continent Research for Education and Learning to provide educators and policymakers with rigorous evidence about the potential of Classroom Assessment for Student Learning (CASL) to improve student achievement. CASL is a widely used professional development program in classroom and formative assessment published by the Assessment Training Institute of Pearson Education. Schools were recruited from across Colorado to participate in the study. Colorado was chosen as the target state primarily because it has one of the largest populations in the Central Region from which to recruit schools and because its statewide achievement test is vertically scaled. This cluster randomized trial of the CASL professional development program had sufficient statistical power to detect an impact of at least 0.25 standard deviation on student achievement. An intent-to-treat analysis was conducted to estimate the impact of CASL on student achievement; all schools were included in the analysis and were analyzed as randomized regardless of the level of implementation fidelity. Analysis did not reveal a statistically significant impact of CASL on the school-level average mathematics achievement of grade 4 and grade 5 students. Results from sensitivity analyses revealed that the impact estimates on student achievement were robust to decisions regarding the inclusion of covariates, estimation method, and the treatment of missing data. In other words, design and analysis decisions made by the research team did not change whether the impact results would have been statistically significant. Appendices include: (1) Power analysis; (2) Response rates by data collection wave, instrument, and experimental group; (3) Data collection instruments; (4) Development, reliability, and validity of teacher outcomes; (5) Teacher Assessment Work Sample; (6) Impact analysis models; (7) Calculation of effect sizes; (8) Treatment of missing data; (9) Variance components estimates and intraclass correlations; (10) Raw means and standard deviations; and (11) Complete mixed model results. (Contains 1 box, 4 figures and 56 tables.

Students with high-incidence disabilities struggle with reading comprehension due to difficulties in background knowledge and metacognitive skills, including use of self-monitoring and other strategies. In the United States, these students typically receive the majority of their instruction in general education settings. However, there is little research comparing reading comprehension interventions with the typical basal curricula used in these classrooms. We compared the effects of an explicit reading comprehension intervention to those of a typical language-arts curriculum on upper elementary and middle school students' (n = 38) retells of passages and understanding of main ideas. A 2 x 4 repeated measures multivariate analysis of variance (MANOVA) revealed significant differences between instructional groups. These results indicate systematic and explicit reading comprehension instruction can be delivered successfully to students with high-incidence disabilities in general education settings. (Contains 3 figures and 4 tables.)

Analyzing mathematics and reading achievement outcomes from a district-level random assignment study fielded in over 500 schools within 59 school districts and seven states, the authors estimate the 1-year impacts of a data-driven reform initiative implemented by the Johns Hopkins Center for Data-Driven Reform in Education (CDDRE). CDDRE consultants work with districts to implement quarterly student benchmark assessments and provide district and school leaders with extensive training on interpreting and using the data to guide reform. Relative to a control condition, in which districts operated as usual without CDDRE services, the data-driven reform initiative caused statistically significant districtwide improvements in student mathematics achievement. The CDDRE intervention also had a positive effect on reading achievement, but the estimates fell short of conventional levels of statistical significance. (Contains 1 figure, 3 tables, and 16 notes.)

Collaborative Strategic Reading (CSR) is a set of instructional strategies designed to improve the reading comprehension of students with diverse abilities (Klingner and Vaughn 1996). Teachers implement CSR at the classroom level using scaffolded instruction to guide students in the independent use of four comprehension strategies; students apply the strategies to informational text while working in small cooperative learning groups. The current study is a randomized controlled trial (RCT) examining the effect of CSR on student reading comprehension. Within each participating linguistically diverse school, grade 5 social studies classrooms were randomly assigned to either the CSR condition (using CSR when delivering social studies curricula) or to the control condition (a business-as-usual condition). The implementation period was one school year. This study focused on the following confirmatory research question: In linguistically diverse schools, do grade 5 students in CSR classrooms have higher average reading comprehension posttest scores on the Group Reading Assessment and Diagnostic Evaluation (GRADE) than students in control classrooms? In addition, the study examined three exploratory research questions about CSR's effect on two subgroups of students: (1) Do grade 5 former and current English language learner (FC-ELL) students in CSR classrooms have higher average reading comprehension posttest scores on the GRADE than FC-ELL students in control classrooms?; (2) Do grade 5 non-ELL students in CSR classrooms have higher average reading comprehension posttest scores on the GRADE than non-ELL students in control classrooms?; and (3) Does CSR have a differential impact on GRADE reading comprehension posttest scores for grade 5 FC-ELL and non-ELL students? The intent of these exploratory analyses was to examine whether there is an effect for each subgroup separately, as well as whether there is a differential effect between the subgroups. The primary finding of this study is that CSR did not have a statistically significant impact on student reading comprehension. Nine sensitivity analyses--including alternative statistical approaches, an alternative approach for handling missing data, and different sample specifications--showed that the findings were robust to different analytic approaches. Three exploratory analyses were also conducted to examine the effects of CSR on FC-ELL and non-ELL students. Statistically significant effects on student reading comprehension were not identified for either subgroup, and no statistically significant differential impacts were identified. It is often the case that RCTs, because of their greater rigor, do not support the findings of prior quasi-experiments (Glazerman, Levy, and Myers 2002, 2003). With all other design features held constant, randomization yields stronger evidence about program impacts than do quasi-experiments (Boruch 1997; Shadish, Cook, and Campbell 2002). The current investigation evaluated the impact of CSR in an effectiveness trial designed to approximate a district's implementation of CSR. Data on the fidelity of implementation suggest that professional development was generally delivered according to plan. Data on teacher fidelity of CSR implementation showed that 78.8 percent of teachers reported using CSR two or more times a week, as instructed. However, the single observation conducted for each classroom found that 21.6 percent of CSR teachers were using all five core teacher strategies, which the study defined as full procedural fidelity; 56.8 percent of teachers were observed using three or fewer strategies. Appendices include: (1) Identification and exit criteria for English language learner students in Oklahoma and Texas; (2) Assumptions used to determine statistical power and observed power; (3) Random assignment; (4) Analysis of consent rate at baseline; (5) Estimation methods; (6) Frequently asked questions about contamination; (7) Attrition analyses; (8) Response rates for demographic data; (9) Fall and spring teacher surveys; (10) Fall coaching observation form; (11) Multiple imputation; (12) Assigning students to cooperative learning groups; (13) Critical procedural behaviors for Collaborative Strategic Reading strategies; (14) Observer training for the subscale Expository Reading Comprehension observation instrument and interrater reliability; (15) Descriptive statistics on Group Reading Assessment and Diagnostic Evaluation scores; (16) Baseline equivalence results for multiply imputed analytic dataset; and (17) Full analytic output tables. A glossary is included. (Contains 52 tables, 3 figures and 46 footnotes.

In the study, we investigated effects of 2 different versions of a web-based tutoring system to provide 5th-grade students with strategy instruction about text structure, which was an intervention to improve reading comprehension. The design feature assessed varied in individualization of instruction (individualized or standard). The more individually tailored version was developed to provide remediation or enrichment lessons matched to the individual needs of each student. Stratified random assignment was used to compare the effects of 2 versions of the 6-month web-based intervention. Students in the individualized condition made greater improvements from pretest to posttest on a standardized reading comprehension test (d = 0.55) than did students in the standard condition (d = 0.30). Students receiving more individualized instruction demonstrated higher mastery achievement goals when working in the lessons than did students receiving the standard instruction (d = 0.53). Students receiving more individualized instruction showed greater improvement in using signaling, better work in lessons, and more positive posttest attitudes toward computers than did students receiving standard instruction. Students in both conditions improved their recall of ideas from texts and their use of the text structure strategy and comparison signaling words. (Contains 3 footnotes, 16 tables, and 3 figures.)

In the study, we investigated effects of 2 different versions of a web-based tutoring system to provide 5th-grade students with strategy instruction about text structure, which was an intervention to improve reading comprehension. The design feature assessed varied in individualization of instruction (individualized or standard). The more individually tailored version was developed to provide remediation or enrichment lessons matched to the individual needs of each student. Stratified random assignment was used to compare the effects of 2 versions of the 6-month web-based intervention. Students in the individualized condition made greater improvements from pretest to posttest on a standardized reading comprehension test (d = 0.55) than did students in the standard condition (d = 0.30). Students receiving more individualized instruction demonstrated higher mastery achievement goals when working in the lessons than did students receiving the standard instruction (d = 0.53). Students receiving more individualized instruction showed greater improvement in using signaling, better work in lessons, and more positive posttest attitudes toward computers than did students receiving standard instruction. Students in both conditions improved their recall of ideas from texts and their use of the text structure strategy and comparison signaling words. (Contains 3 footnotes, 16 tables, and 3 figures.)

Are teachers' impacts on students' test scores ("value-added") a good measure of their quality? This question has sparked debate largely because of disagreement about (1) whether value-added (VA) provides unbiased estimates of teachers' impacts on student achievement and (2) whether high-VA teachers improve students' long-term outcomes. We address these two issues by analyzing school district data from grades 3-8 for 2.5 million children linked to tax records on parent characteristics and adult outcomes. We find no evidence of bias in VA estimates using previously unobserved parent characteristics and a quasi-experimental research design based on changes in teaching staff. Students assigned to high-VA teachers are more likely to attend college, attend higher-ranked colleges, earn higher salaries, live in higher SES neighborhoods, and save more for retirement. They are also less likely to have children as teenagers. Teachers have large impacts in all grades from 4 to 8. On average, a one standard deviation improvement in teacher VA in a single grade raises earnings by about 1% at age 28. Replacing a teacher whose VA is in the bottom 5% with an average teacher would increase students' lifetime income by more than $250,000 for the average classroom in our sample. We conclude that good teachers create substantial economic value and that test score impacts are helpful in identifying such teachers.

Financial incentives for teachers to increase student performance is an increasingly popular education policy around the world. This paper describes a school-based randomized trial in over two-hundred New York City public schools designed to better understand the impact of teacher incentives on student achievement. I find no evidence that teacher incentives increase student performance, attendance, or graduation, nor do I find any evidence that the incentives change student or teacher behavior. If anything, teacher incentives may decrease student achievement, especially in larger schools. The paper concludes with a speculative discussion of theories that may explain these stark results.

In the 2007-2008 school year, the New York City Department of Education and the United Federation of Teachers jointly implemented the Schoolwide Performance Bonus Program in a random sample of the city's high-needs public schools. The program lasted for three school years, and its broad objective was to improve student performance through school-based financial incentives. The question, of course, was whether it was doing so. To examine its implementation and effects, the department tasked a RAND Corporation-led partnership with the National Center on Performance Incentives at Vanderbilt University to conduct a two-year study of the program that would offer an independent assessment. This report describes the results of our analyses for all three years of the program, from 2007-2008 through 2009-2010. This work built on past research and was guided by a theory of action articulated by program leaders. Researchers examined student test scores; teacher, school staff, and administrator surveys; and interviews with administrators, staff members, program sponsors, and union and district officials. The researchers found that the program did not, by itself, improve student achievement, perhaps in part because conditions needed to motivate staff were not achieved (e.g., understanding, buy-in for the bonus criteria) and because of the high level of accountability pressure all the schools already faced. Individual chapters contain footnotes. (Contains 12 figures and 66 tables.) [Additional funding for this paper was provided by the New York City Fund for Public Schools. For "What New York City's Experiment with Schoolwide Performance Bonuses Tells Us about Pay for Performance. Research Brief," see ED521918.]

This article reports the effects of a comprehensive elementary school-based social-emotional and character education program on school-level achievement, absenteeism, and disciplinary outcomes utilizing a matched-pair, cluster-randomized, controlled design. The "Positive Action" Hawai'i trial included 20 racially/ethnically diverse schools (M enrollment = 544) and was conducted from the 2002-03 through the 2005-06 academic years. Using school-level archival data, analyses comparing change from baseline (2002) to 1-year posttrial (2007) revealed that intervention schools scored 9.8% better on the TerraNova (2nd ed.) test for reading and 8.8% on math, that 20.7% better in Hawai'i Content and Performance Standards scores for reading and 51.4% better in math, and that intervention schools reported 15.2% lower absenteeism and fewer suspensions (72.6%) and retentions (72.7%). Overall, effect sizes were moderate to large (range = 0.5-1.1) for all of the examined outcomes. Sensitivity analyses using permutation models and random-intercept growth curve models substantiated results. The results provide evidence that a comprehensive school-based program, specifically developed to target student behavior and character, can positively influence school-level achievement, attendance, and disciplinary outcomes concurrently. (Contains 6 tables and 2 figures.)

In 2004, the U.S. Department of Education's Institute of Education Sciences contracted with Mathematica Policy Research to conduct a large-scale evaluation of comprehensive teacher induction. The purpose of the study was to determine whether augmenting the set of services districts usually provide to support beginning teachers with a more comprehensive program improves teacher and student outcomes. This is the study's third and final report on the program's impacts. This report compares retention, achievement, and classroom practices of teachers who were offered comprehensive induction services to teachers who were offered the support normally offered by the school. Teachers assigned to receive comprehensive induction for either one or two years were supported by a full-time mentor who received ongoing training and materials to support the teachers' development. The teachers also were offered monthly professional development sessions and opportunities to observe veteran teachers. The teachers were followed for three years. Data was collected from 1,009 beginning teachers in 418 schools in 17 districts. Districts included in the study were not already offering comprehensive induction services, including paying for full-time mentors. Novice teachers in approximately half of the schools were assigned by lottery to receive comprehensive induction services. In 10 of the districts, these teachers were provided one year of comprehensive induction services; in the remaining 7 districts, the teachers were provided two years of services. Teachers in the schools not assigned to receive comprehensive induction services were provided the support normally offered to novice teachers by the school. Teacher practices were measured via classroom observations conducted in the spring of 2006. Data on teacher retention were collected via surveys administered in the fall of 2006, 2007, and 2008. Student test scores were collected from district administrative records for the 2005-06, 2006-07, and 2007-08 school years. Key findings include: (1) During the comprehensive induction program, treatment teachers received more support than control teachers; (2) The extra induction support for treatment teachers did not translate into impacts on classroom practices in the first year; (3) For teachers who received one year of comprehensive induction, there was no impact on student achievement; (4) For teachers who received two years of comprehensive induction, there was no impact on student achievement in the first two years. In the third year, there was a positive and statistically significant impact on student achievement; and (5) Neither exposure to one year nor exposure to two years of comprehensive induction had a positive impact on retention or other teacher workforce outcomes. The following are appended: (1) Supplemental Information for Chapters II and III; (2) Supplemental Information for Chapter IV; (3) Sensitivity Analyses and Supplemental Information for Chapter V; and (4) Sensitivity Analyses and Supplemental Information for Chapter VI.

Teacher compensation schemes are often criticized for lacking a performance-based component. Proponents of merit pay argue that linking teacher salaries to student achievement will incentivize teachers to focus on raising student achievement and stimulate innovation across the school system as a whole. In this paper, we utilize a policy experiment conducted in the New York City public school system to explore the effects of one performance-based bonus scheme. We investigate potential impacts of group-based incentive pay over two academic years (2007-2008 and 2008-2009) on a range of outcomes including: teacher effort, student performance in math and reading, and classroom activities, measured through environmental surveys of teachers and students. We also explore impacts on the market for teachers by examining teacher turnover and the qualifications of newly hired teachers. Overall, we find the bonus program had little impact on any of these outcomes. We argue that the lack of bonus program impacts can be explained by the structure of the bonus program. Group bonuses led to free-riding, which significantly reduced the program's incentives. Once we account for free-riding, we find evidence that the program led teachers to increase their effort through a significant reduction in absenteeism. When considering the effectiveness of performance-based teacher pay, the structure of incentives matter. (Contains 11 tables, 3 figures and 24 footnotes.)

Disproportionality has been a persistent problem in special education for decades. Despite mandates outlined in the Individuals with Disabilities Education Improvement Act (IDEA, 2004), African American students continue to be disproportionately represented in the Emotional Disturbance (ED) category in special education (e.g., Skiba, Poloni-Staudinger, Simmons, Feggins-Azziz, & Chung, 2005). Additionally, African Americans represent the highest percentages of students identified as at risk (Gay, 2000) and receive a disproportionate number of referrals for disciplinary actions (Cartledge & Dukes, 2008) among racial groups. Even though many hypothesized reasons for such disproportionate rates have been researched (e.g., poverty, inherently bad behavior, cultural bias, ineffective behavioral management), the findings are conflicting. Disproportionality among this population continues, and successful educational outcomes are far too infrequent. One promising intervention that can decrease exclusionary practices imposed on African American students and address disproportionality in both special education and disciplinary action is to use functional behavioral assessments and function-based interventions. The effectiveness of FBAs and function-based interventions for students with ED and those at risk for developing ED have been well documented (e.g., Heckaman, Conroy, Fox, & Chait, 2000; Reid & Nelson, 2002). However, only two studies have involved African American students as participants in FBA implementation (i.e., Kamps, Wendland, & Culpepper, 2006; Lo & Cartledge, 2006) and only one included African Americans as a means to address disproportionality (i.e., Lo & Cartledge). Additionally, professional development on FBA has largely been limited to special education personnel only. In order for FBAs to be effective in preventing problem behavior of African American students before they are referred to special education, research on FBA and professional development targeted to general education teachers is critical. This study examined the comparative effects of function-based versus nonfunction-based interventions on the off-task and replacement behavior of African American students at risk for ED and the extent to which general education teachers could implement FBAs with high fidelity. Findings indicated that function-based interventions resulted in higher decreases of off-task behavior than nonfunction-based interventions. Additionally, descriptive results showed that both general education teachers were able to implement FBAs and function-based interventions with high levels of fidelity. Finally, social validity data suggested that teachers felt that FBAs and function-based interventions were of social importance. Teachers' perceptions also changed on the extent to which students had continued needs for disciplinary action and special education services in the ED category. Specifically, teachers felt students were no long in need of special education services or disciplinary action as a result of the function-based interventions. Limitations of the study, suggestions for future research, and implications for practice are also discussed. [The dissertation citations contained here are published with the permission of ProQuest LLC. Further reproduction is prohibited without permission. Copies of dissertations may be obtained by Telephone (800) 1-800-521-0600. Web page: http://www.proquest.com/en-US/products/dissertations/individuals.shtml.]

This study investigated the effects of different versions of Web-based instruction focused on text structure on fifth- and seventh-grade students' reading comprehension. Stratified random assignment was employed in a two-factor experiment embedded within a pretest and multiple posttests design (immediate and four-month delayed posttests). The two factors were type of feedback provided by the Web-based tutor (elaborated vs. simple feedback) and the motivational factor of choice of text topics in practice lessons (student choice of texts vs. no choice). These factors were examined to learn how they affected performance after the six-month, 90-minutes/week intervention. Students who received elaborated feedback performed better on a standardized test of reading comprehension than students who received simple feedback. Learning how to attend to errors from the elaborated feedback tutor yielded large gains in test performance. Simple feedback did not help the least skilled third of readers move from complete lack of competency to competency using the structure strategy with problem-and-solution text. Choice between two topics for practice lessons did not increase reading comprehension. Substantial effects sizes were found from pretest to posttest on various measures of reading comprehension: recall, strategy competence, and standardized reading comprehension test scores. Maintenance of performance over summer break was found for most measures. The study informs research and teaching about Web-based reading tutors, feedback, comprehension, and top-level text structure. (Contains 16 tables, 8 figures and 2 notes.)

This is the third-year report in a five-year evaluation of the Milwaukee Parental Choice Program (MPCP). The MPCP, which began in 1990, provides government-funded vouchers for low-income children to attend private schools in the City of Milwaukee. The general purposes of the evaluation are to analyze the effectiveness of the MPCP in terms of longitudinal student achievement growth and educational attainment as measured by high school graduation rates. The former will be primarily accomplished by measuring and estimating student growth in achievement as measured by the Wisconsin Knowledge and Concepts Examinations (WKCE) in math and reading in 2006-07, grades 3 through 8 over a five-year period. The latter will be accomplished by following the 2006-07 8th and 9th grade cohorts over a five-year period or longer. The general research design consists of a comparison between a random sample of MPCP students and a matched sample of Milwaukee Public School (MPS) students. This third year report presents results from the November 2008 WKCE tests as second year student achievement growth in MPCP relative to the matched MPS sample. We provide varying descriptive statistics comparing test score means and distributions for math and reading for 2006-07 (baseline year) and 2008-09 (second outcome year) for each sample. The report also analyzes achievement growth using several multivariate techniques and models. The primary finding in all these comparisons is that, in general, there are few statistically significant differences between levels of MPCP and MPS student achievement growth in either math or reading two years after they were carefully matched to each other. In one of the ways of estimating these results, focusing only on those students who have remained in the public or private sector for all three years, private, voucher students are slightly behind MPS students in mathematics achievement growth. The report offers several cautions in interpreting this result against the overwhelming set of results that indicate no difference in achievement growth. Appended are additional tables and study attrition. (Contains 9 tables, 2 figures, and 7 footnotes.) [Additional funding for this project was provided by the Robertson Foundation.]

Children with attention deficit hyperactivity disorder (ADHD) make up a considerable proportion of students who receive special education services in schools. The present study aimed to enhance the outcomes of students with ADHD in special education settings by using a daily report card (DRC). Thirty-three children with ADHD in special education placements were randomly assigned to an intervention condition wherein behavioral consultants worked with the teacher and parent to construct and implement a DRC based on the child's individualized education plan goals and objectives. These children were compared to 30 children in a business as usual control condition. Results indicated positive effects of the DRC on observations of classroom functioning, individualized education plan goal attainment, and teacher ratings of academic productivity and disruptive behavior in the classroom. Further, a greater percentage of children with ADHD in the DRC group were normalized on measures of disruptive behavior and impairment. The intervention did not result in incremental improvement in academic achievement, teacher ratings of ADHD symptoms or impairment, or the student-teacher relationship. The implications of these results for working with children with ADHD in special education settings are discussed. (Contains 5 tables and 1 figure.)

This study was conducted to explore the effects of a two-way immersion bilingual program on maintenance/acquisition of Spanish-language proficiency and on reading and mathematics achievement in English over a period of 4 academic years. The researchers used Hierarchical Linear Modeling (HLM) techniques to compare the effects of two different program models on Spanish-language proficiency of participating students from Spanish- and non-Spanish-language backgrounds. In addition, they employed multivariate matching algorithms to construct a comparison group of schools and students that matched program students academically and demographically and then used HLM methods to compare academic achievement in reading and mathematics of students in program and comparison groups. The researchers found that students in the program model that offered Spanish instruction in language arts and one content area performed better in reading comprehension in Spanish than students in the program model that offered only Spanish language arts instruction. The researchers also found that program students exhibited achievement levels in reading and mathematics that were on par with or higher than those of demographically and academically similar students not in the program. In addition, the researchers determined and that average annual learning rates in both academic disciplines were similar for program and comparison students. (Contains 5 figures, 2 footnotes, and 3 tables.)

This study was conducted to explore the effects of a two-way immersion bilingual program on maintenance/acquisition of Spanish-language proficiency and on reading and mathematics achievement in English over a period of 4 academic years. The researchers used Hierarchical Linear Modeling (HLM) techniques to compare the effects of two different program models on Spanish-language proficiency of participating students from Spanish- and non-Spanish-language backgrounds. In addition, they employed multivariate matching algorithms to construct a comparison group of schools and students that matched program students academically and demographically and then used HLM methods to compare academic achievement in reading and mathematics of students in program and comparison groups. The researchers found that students in the program model that offered Spanish instruction in language arts and one content area performed better in reading comprehension in Spanish than students in the program model that offered only Spanish language arts instruction. The researchers also found that program students exhibited achievement levels in reading and mathematics that were on par with or higher than those of demographically and academically similar students not in the program. In addition, the researchers determined and that average annual learning rates in both academic disciplines were similar for program and comparison students. (Contains 5 figures, 2 footnotes, and 3 tables.)

This study examined an important but rarely investigated aspect of the dissemination process: the intensity of training provided to practitioners. Counselors in 57 schools were randomly assigned to 1 of 3 conditions: Coping Power-training plus feedback (CP-TF), Coping Power-basic training (CP-BT), or a comparison condition. CP-TF counselors produced reductions in children's externalizing behavior problems and improvements in children's social and academic skills in comparison to results for target children in both the comparison and the CP-BT conditions. Training intensity was critical for successful dissemination, although the implementation mechanism underlying this effect remains unclear, as condition effects were not significant for completion of session objectives but were significant for the quality of counselors' engagement with children. (Contains 3 tables and 3 footnotes.)

This document reports on the impacts on student achievement for four supplemental reading curricula that use similar overlapping instructional strategies designed to improve reading comprehension in social studies and science text. Fifth-grade reading comprehension for each of three commercially-available curricula (Project CRISS, ReadAbout, and Read for Real) was not significantly different from the control group. The fourth curriculum, Reading for Knowledge, was adapted from Success for All for this study, and had a statistically-significant negative impact on fifth-grade reading comprehension. The study is based on a rigorous experimental design and a large sample that includes 10 districts, 89 schools, 268 teachers, and 6,350 students. During the first year of the study, it was found that over 90 percent (91 to 100 percent) of treatment teachers were trained to use the assigned curriculum, and more than half (56 to 80 percent) reported that they were very well prepared by the training to implement it. Over 80 percent (81 to 91 percent) of teachers reported using their assigned curriculum. Classroom observation data showed that teachers implemented 55 to 78 percent of the behaviors deemed important by the developers for implementing each curriculum. Scores on the three reading comprehension assessments were not statistically significantly higher in schools using the selected reading comprehension curricula. Impacts were correlated with some subgroups defined by student, teacher, and school characteristics. Appendixes include: (1) Random Assignment; (2) Flow of Schools and Students through the Study; (3) Obtaining Parent Consent; (4) Implementation Timeline; (5) Sample Sizes and Response Rates; (6) Creation and Reliability of Classroom Observation and Teacher Survey Measures; (7) Estimating Impacts; (8) Assessing Robustness of the Impacts; (9) Key Descriptive Statistics for Classroom Observation and Fidelity Data; (10) Study Instruments; and (11) Unadjusted Means. (Contains 91 tables, 8 figures, and 78 footnotes.)

This study addresses two questions related to teacher preparation and certification: (1) What are the relative effects on student achievement of teachers who chose to be trained through different routes to certification and how do observed teacher practices vary by chosen route to certification?; and (2) What aspects of certification programs (such as the amount of coursework, the timing of coursework relative to being the lead teacher in the classroom, the core coursework content) are associated with teacher effectiveness? In 63 study schools, every grade that contained at least one eligible alternatively certified (AC) and one eligible traditionally certified (TC) teacher was included. Students in these study grades were randomly assigned to be in the class of an AC or a TC teacher. Students were tested at the beginning of the school year as a baseline measure and at the end of the year as an outcome. Classroom instruction was observed at one point during the year as an outcome. Reported findings include: (1) Both the AC and the TC programs with teachers in the study were diverse in the total instruction they required for their candidates; (2) While teachers trained in TC programs receive all their instruction (and participate in student teaching) prior to becoming regular full-time teachers, AC teachers do not necessarily begin teaching without having received any formal instruction; (3) There were no statistically significant differences between the AC and TC teachers in this study in their average scores on college entrance exams, the selectivity of the college that awarded their bachelor's degree, or their level of educational attainment; (4) There was no statistically significant difference in performance between students of AC teachers and those of TC teachers; (5) There is no evidence from this study that greater levels of teacher training coursework were associated with the effectiveness of AC teachers in the classroom; and (6) There is no evidence that the content of coursework is correlated with teacher effectiveness. Supplementary Technical Information on Data Collection, Response Rates, and Analyses is appended. (Contains 90 footnotes and 28 exhibits.)

In practice, teacher induction is common, but induction that is intensive, comprehensive, structured, and sequentially delivered in response to teachers' emerging pedagogical needs is less so. Congressional interest in formal, comprehensive teacher induction has grown in recent years. The National Center for Education Evaluation and Regional Assistance within the U.S. Department of Education's (ED) Institute of Education Sciences (IES) contracted with Mathematica Policy Research, Inc. (MPR), to evaluate the impact of structured and intensive teacher induction programs. The study examines whether comprehensive teacher induction programs lead to higher teacher retention rates and other positive teacher and student outcomes as compared to prevailing, generally less comprehensive approaches to supporting new teachers. More specifically, the study is designed to address five research questions on the impacts of teacher induction services: (1) What is the effect of comprehensive teacher induction on the types and intensity of induction services teachers receive compared to the services they receive from the districts' current induction programs?; (2) What are the impacts on teachers' classroom practices?; (3) What are the impacts on student achievement?; (4) What are the impacts on teacher retention?; and (5) What is the impact on the composition of the district's teaching workforce? Statistically significant differences between the treatment and control groups were identified in the amount, types, and content of induction support teachers reported having received, both in the fall and the spring of the intervention year. Although treatment teachers reported receiving more mentoring than did control teachers; were more likely than control teachers to report participating in specific induction activities; and spent more time in certain professional activities than did control teachers during the three months prior to the spring survey, summarized comparisons between treatment and control groups found: (1) No impacts on teacher practices; (2) No positive impacts on student test scores; (3) No impacts on teacher retention; and (4) No positive impacts on composition of district teaching workforce. This report focused on the first year of findings only. The research team is conducting longer term follow-up to include additional collection of test score and teacher mobility data. Eight appendices are included: (1) National Data on Teacher Induction; (2) Analysis Weights; (3) Impact Estimation Methods; (4) Classroom Observation Methods; (5) Reference Tables for Chapter II; (6) Supplemental Tables for Chapter IV; (7) Supplemental Tables for Chapter V; and (8) Supplemental Figures. (Contains 43 footnotes, 15 figures and 101 tables.)

High schools have recently become a popular source of mentors for school-based mentoring (SBM) programs. The high school Bigs program of Big Brothers Big Sisters of America, for example, currently involves close to 50,000 high-school-aged mentors across the country. While the use of these young mentors has several potential advantages, their age raises questions about their capacity to be consistent, positive role models, and, in turn, their potential to yield strong impacts for the youth they mentor. With support from The Atlantic Philanthropies and in collaboration with Big Brothers Big Sisters of America, Public/Private Ventures set out to address these questions using data from our large-scale random assignment impact study of Big Brothers Big Sisters SBM (Herrera, et al. 2007). We found that, on average, high school students were much less effective than adults at yielding impacts for the youth they mentor. However, our research identified several program practices that were linked with longer, stronger and more effective high school mentor relationships. High School Students as Mentors stresses the need for programs with high school volunteers to use the inherent strengths of these volunteers and, at the same time, meet their distinct needs. Big Brothers Big Sisters of America is already initiating most of the changes suggested in the study in its high school Bigs program; it has convened a group of six of its strongest Big Brothers Big Sisters agencies to review these and other findings and share their own experiences and strategies in an effort to strengthen their model. (Contains 41 endnotes, 3 figures and 2 tables.)

We examined the extent to which use of a technology-enhanced continuous progress monitoring system would enhance the results of math instruction, examined variability in teacher implementation of the program, and compared math results in classrooms in which teachers did and did not use the system. Classrooms were randomly assigned to within-school experimental and control groups. Participating students were pre- and post-tested using two standardized, nationally normed tests of math achievement. When teachers implemented the continuous progress monitoring system as intended, and when they used the data from the system to manage and differentiate instruction, students gained significantly more than those for whom implementation was limited or nil. Failure to take into account intervention integrity would have made it look like continuous progress monitoring did not enhance math results. (Contains 5 tables.)

This chapter examines how a particular strategy for analyzing evaluation data, intent-to-treat (ITT) analyses, may underestimate the true effects of interventions. Such underestimation of intervention effects can profoundly influence policies for prevention and treatment of children's mental health problems, which can in turn lead to negative consequences for children's healthy development. However, evaluating treatment is a complicated issue because poorer outcomes for some may be due to characteristics of the participants, such as low motivation or chaotic family conditions, rather than qualities of the intervention. ITT analyses purposely ignore these nonrandom sources of variance. Using ITT analyses, evaluations of programs to reduce oppositional defiant disorders and conduct disorders in children and adolescents have consistently revealed that cognitive-behavioral interventions have the most promise and clearest evidence for efficacy, with effect sizes on outcome analyses in the moderate to large range (from 0.3 to over 1.0). These interventions usually involve behavioral parent training but also can include social problem-solving skills training, anger management training, and social skills training with the children. Using analyses of the effects of an intervention designed to reduce children's externalizing behavior problems and thus their risk for later delinquency and substance use as an example, the authors compare how propensity analyses and three types of complier average causal effect (CACE) analyses fare in comparison to traditional ITT analyses and often-used as-treated analyses. Although these techniques have been presented as an alternative and possible improvement, analyses of compliance have not considered the consequences of how the criteria for compliance are determined for a particular intervention, nor do they account for whether the compliance analyses produce different effects at different levels of compliance. Therefore, the present example also compares two levels of compliance, one representing a criterion of at least minimal compliance with the intervention and a second representing a high level of attendance and compliance. The general conclusion as a result of comparing these multiple strategies is that how one specifies parents' compliance in an evaluation design for a preventive intervention affects the interpretation of findings of program efficacy. The authors suggest that future research should aggressively pursue methods for setting optimal thresholds in analytic approaches that extend beyond ITT. (Contains 1 table.)

According to the National Assessment of Educational Progress, nearly 4 in 10 fourth graders read below the basic level. These literacy problems get worse as students advance through school and are exposed to progressively more complex concepts and courses. The purpose of this study was to assess the effectiveness of four remedial reading programs in improving the reading skills of 3rd and 5th graders, whether the impacts of the programs vary across students with difference baseline characteristics, and to what extent can this instruction close the reading gap and bring struggling readers within the normal range--relative to the instruction normally provided by their schools. The study took place in elementary schools in 27 districts of the Allegheny Intermediate Unit outside Pittsburgh, PA during the 2003-04 school year. Within each of 50 schools, 3rd and 5th grade students were identified as struggling readers by their teachers. These students were tested and were eligible for the study if they scored at or below the 30th percentile on a word-level reading test and at or above the 5th percentile on a vocabulary test. The final sample contains a total of 742 students. There are 335 3rd graders ? 208 treatment and 127 control students. There are 407 5th graders ? 228 treatment and 179 control students. Four existing programs were used: Spell Read P.A.T., Corrective Reading, Wilson Reading, and Failure Free Reading. Corrective Reading and Wilson Reading were modified to focus only on word-level skills. Spell Read P.A.T. and Failure Free Reading were intended to focus equally on word-level skills and reading comprehension/vocabulary. Teachers received 70 hours of professional development and support during the year. Instruction was delivered in small groups of 3 students, 5 days a week, for a total of 90 hours. Seven measures of reading skill were administered at the beginning and end of the school year to assess student progress: Word Attack, Word Identification Comprehension (Woodcock Reading Mastery Test); Phonemic Decoding Efficiency and Sight Word Efficiency (Test of Word Reading Efficiency); Oral Reading Fluency (Edformation); and Passage Comprehension (Group Reading Assessment and Diagnostic Evaluation). After one year of instruction, there were significant impacts on phonemic decoding, word reading accuracy and fluency, and comprehension for 3rd graders, but not for 5th graders. For third graders in the reading programs, the gap in word attach skills between struggling readers and average readers was reduced by about two-thirds. It was found that reading skills of 3rd graders can be significantly improved through instruction in word-level skills, but not the reading skills of 5th graders. The following are appended: (1) Details of Study Design and Implementation; (2) Data Collection; (3) Weighting Adjustment and Missing Data; (4) Details of Statistical Methods; (5) Intervention Impacts on Spelling and Calculation; (6) Instructional Group Clustering; (7) Parent Survey; (8) Teacher Survey and Behavioral Rating Forms; (9) Instructional Group Clustering; (10) Videotape Coding Guidelines for Each Reading Program; (11) Supporting Tables; (12) Sample Test Items; (13) Impact Estimate Standard Errors and P-Values; (14) Association between Instructional Group Heterogeneity and The Outcome; (15) Teacher Rating Form; (16) School Survey; and (17) Scientific Advisory Board. [This report was produced by the Corporation for the Advancement of Policy Evaluation. Additional support provided by the Barksdale Reading Institute, and the Haan Foundation for Children.]

According to the National Assessment of Educational Progress, nearly 4 in 10 fourth graders read below the basic level. These literacy problems get worse as students advance through school and are exposed to progressively more complex concepts and courses. The purpose of this study was to assess the effectiveness of four remedial reading programs in improving the reading skills of 3rd and 5th graders, whether the impacts of the programs vary across students with difference baseline characteristics, and to what extent can this instruction close the reading gap and bring struggling readers within the normal range--relative to the instruction normally provided by their schools. The study took place in elementary schools in 27 districts of the Allegheny Intermediate Unit outside Pittsburgh, PA during the 2003-04 school year. Within each of 50 schools, 3rd and 5th grade students were identified as struggling readers by their teachers. These students were tested and were eligible for the study if they scored at or below the 30th percentile on a word-level reading test and at or above the 5th percentile on a vocabulary test. The final sample contains a total of 742 students. There are 335 3rd graders ? 208 treatment and 127 control students. There are 407 5th graders ? 228 treatment and 179 control students. Four existing programs were used: Spell Read P.A.T., Corrective Reading, Wilson Reading, and Failure Free Reading. Corrective Reading and Wilson Reading were modified to focus only on word-level skills. Spell Read P.A.T. and Failure Free Reading were intended to focus equally on word-level skills and reading comprehension/vocabulary. Teachers received 70 hours of professional development and support during the year. Instruction was delivered in small groups of 3 students, 5 days a week, for a total of 90 hours. Seven measures of reading skill were administered at the beginning and end of the school year to assess student progress: Word Attack, Word Identification Comprehension (Woodcock Reading Mastery Test); Phonemic Decoding Efficiency and Sight Word Efficiency (Test of Word Reading Efficiency); Oral Reading Fluency (Edformation); and Passage Comprehension (Group Reading Assessment and Diagnostic Evaluation). After one year of instruction, there were significant impacts on phonemic decoding, word reading accuracy and fluency, and comprehension for 3rd graders, but not for 5th graders. For third graders in the reading programs, the gap in word attach skills between struggling readers and average readers was reduced by about two-thirds. It was found that reading skills of 3rd graders can be significantly improved through instruction in word-level skills, but not the reading skills of 5th graders. The following are appended: (1) Details of Study Design and Implementation; (2) Data Collection; (3) Weighting Adjustment and Missing Data; (4) Details of Statistical Methods; (5) Intervention Impacts on Spelling and Calculation; (6) Instructional Group Clustering; (7) Parent Survey; (8) Teacher Survey and Behavioral Rating Forms; (9) Instructional Group Clustering; (10) Videotape Coding Guidelines for Each Reading Program; (11) Supporting Tables; (12) Sample Test Items; (13) Impact Estimate Standard Errors and P-Values; (14) Association between Instructional Group Heterogeneity and The Outcome; (15) Teacher Rating Form; (16) School Survey; and (17) Scientific Advisory Board. [This report was produced by the Corporation for the Advancement of Policy Evaluation. Additional support provided by the Barksdale Reading Institute, and the Haan Foundation for Children.]

According to the National Assessment of Educational Progress, nearly 4 in 10 fourth graders read below the basic level. These literacy problems get worse as students advance through school and are exposed to progressively more complex concepts and courses. The purpose of this study was to assess the effectiveness of four remedial reading programs in improving the reading skills of 3rd and 5th graders, whether the impacts of the programs vary across students with difference baseline characteristics, and to what extent can this instruction close the reading gap and bring struggling readers within the normal range--relative to the instruction normally provided by their schools. The study took place in elementary schools in 27 districts of the Allegheny Intermediate Unit outside Pittsburgh, PA during the 2003-04 school year. Within each of 50 schools, 3rd and 5th grade students were identified as struggling readers by their teachers. These students were tested and were eligible for the study if they scored at or below the 30th percentile on a word-level reading test and at or above the 5th percentile on a vocabulary test. The final sample contains a total of 742 students. There are 335 3rd graders ? 208 treatment and 127 control students. There are 407 5th graders ? 228 treatment and 179 control students. Four existing programs were used: Spell Read P.A.T., Corrective Reading, Wilson Reading, and Failure Free Reading. Corrective Reading and Wilson Reading were modified to focus only on word-level skills. Spell Read P.A.T. and Failure Free Reading were intended to focus equally on word-level skills and reading comprehension/vocabulary. Teachers received 70 hours of professional development and support during the year. Instruction was delivered in small groups of 3 students, 5 days a week, for a total of 90 hours. Seven measures of reading skill were administered at the beginning and end of the school year to assess student progress: Word Attack, Word Identification Comprehension (Woodcock Reading Mastery Test); Phonemic Decoding Efficiency and Sight Word Efficiency (Test of Word Reading Efficiency); Oral Reading Fluency (Edformation); and Passage Comprehension (Group Reading Assessment and Diagnostic Evaluation). After one year of instruction, there were significant impacts on phonemic decoding, word reading accuracy and fluency, and comprehension for 3rd graders, but not for 5th graders. For third graders in the reading programs, the gap in word attach skills between struggling readers and average readers was reduced by about two-thirds. It was found that reading skills of 3rd graders can be significantly improved through instruction in word-level skills, but not the reading skills of 5th graders. The following are appended: (1) Details of Study Design and Implementation; (2) Data Collection; (3) Weighting Adjustment and Missing Data; (4) Details of Statistical Methods; (5) Intervention Impacts on Spelling and Calculation; (6) Instructional Group Clustering; (7) Parent Survey; (8) Teacher Survey and Behavioral Rating Forms; (9) Instructional Group Clustering; (10) Videotape Coding Guidelines for Each Reading Program; (11) Supporting Tables; (12) Sample Test Items; (13) Impact Estimate Standard Errors and P-Values; (14) Association between Instructional Group Heterogeneity and The Outcome; (15) Teacher Rating Form; (16) School Survey; and (17) Scientific Advisory Board. [This report was produced by the Corporation for the Advancement of Policy Evaluation. Additional support provided by the Barksdale Reading Institute, and the Haan Foundation for Children.]

According to the National Assessment of Educational Progress, nearly 4 in 10 fourth graders read below the basic level. These literacy problems get worse as students advance through school and are exposed to progressively more complex concepts and courses. The purpose of this study was to assess the effectiveness of four remedial reading programs in improving the reading skills of 3rd and 5th graders, whether the impacts of the programs vary across students with difference baseline characteristics, and to what extent can this instruction close the reading gap and bring struggling readers within the normal range--relative to the instruction normally provided by their schools. The study took place in elementary schools in 27 districts of the Allegheny Intermediate Unit outside Pittsburgh, PA during the 2003-04 school year. Within each of 50 schools, 3rd and 5th grade students were identified as struggling readers by their teachers. These students were tested and were eligible for the study if they scored at or below the 30th percentile on a word-level reading test and at or above the 5th percentile on a vocabulary test. The final sample contains a total of 742 students. There are 335 3rd graders ? 208 treatment and 127 control students. There are 407 5th graders ? 228 treatment and 179 control students. Four existing programs were used: Spell Read P.A.T., Corrective Reading, Wilson Reading, and Failure Free Reading. Corrective Reading and Wilson Reading were modified to focus only on word-level skills. Spell Read P.A.T. and Failure Free Reading were intended to focus equally on word-level skills and reading comprehension/vocabulary. Teachers received 70 hours of professional development and support during the year. Instruction was delivered in small groups of 3 students, 5 days a week, for a total of 90 hours. Seven measures of reading skill were administered at the beginning and end of the school year to assess student progress: Word Attack, Word Identification Comprehension (Woodcock Reading Mastery Test); Phonemic Decoding Efficiency and Sight Word Efficiency (Test of Word Reading Efficiency); Oral Reading Fluency (Edformation); and Passage Comprehension (Group Reading Assessment and Diagnostic Evaluation). After one year of instruction, there were significant impacts on phonemic decoding, word reading accuracy and fluency, and comprehension for 3rd graders, but not for 5th graders. For third graders in the reading programs, the gap in word attach skills between struggling readers and average readers was reduced by about two-thirds. It was found that reading skills of 3rd graders can be significantly improved through instruction in word-level skills, but not the reading skills of 5th graders. The following are appended: (1) Details of Study Design and Implementation; (2) Data Collection; (3) Weighting Adjustment and Missing Data; (4) Details of Statistical Methods; (5) Intervention Impacts on Spelling and Calculation; (6) Instructional Group Clustering; (7) Parent Survey; (8) Teacher Survey and Behavioral Rating Forms; (9) Instructional Group Clustering; (10) Videotape Coding Guidelines for Each Reading Program; (11) Supporting Tables; (12) Sample Test Items; (13) Impact Estimate Standard Errors and P-Values; (14) Association between Instructional Group Heterogeneity and The Outcome; (15) Teacher Rating Form; (16) School Survey; and (17) Scientific Advisory Board. [This report was produced by the Corporation for the Advancement of Policy Evaluation. Additional support provided by the Barksdale Reading Institute, and the Haan Foundation for Children.]

According to the National Assessment of Educational Progress, nearly 4 in 10 fourth graders read below the basic level. These literacy problems get worse as students advance through school and are exposed to progressively more complex concepts and courses. The purpose of this study was to assess the effectiveness of four remedial reading programs in improving the reading skills of 3rd and 5th graders, whether the impacts of the programs vary across students with difference baseline characteristics, and to what extent can this instruction close the reading gap and bring struggling readers within the normal range--relative to the instruction normally provided by their schools. The study took place in elementary schools in 27 districts of the Allegheny Intermediate Unit outside Pittsburgh, PA during the 2003-04 school year. Within each of 50 schools, 3rd and 5th grade students were identified as struggling readers by their teachers. These students were tested and were eligible for the study if they scored at or below the 30th percentile on a word-level reading test and at or above the 5th percentile on a vocabulary test. The final sample contains a total of 742 students. There are 335 3rd graders ? 208 treatment and 127 control students. There are 407 5th graders ? 228 treatment and 179 control students. Four existing programs were used: Spell Read P.A.T., Corrective Reading, Wilson Reading, and Failure Free Reading. Corrective Reading and Wilson Reading were modified to focus only on word-level skills. Spell Read P.A.T. and Failure Free Reading were intended to focus equally on word-level skills and reading comprehension/vocabulary. Teachers received 70 hours of professional development and support during the year. Instruction was delivered in small groups of 3 students, 5 days a week, for a total of 90 hours. Seven measures of reading skill were administered at the beginning and end of the school year to assess student progress: Word Attack, Word Identification Comprehension (Woodcock Reading Mastery Test); Phonemic Decoding Efficiency and Sight Word Efficiency (Test of Word Reading Efficiency); Oral Reading Fluency (Edformation); and Passage Comprehension (Group Reading Assessment and Diagnostic Evaluation). After one year of instruction, there were significant impacts on phonemic decoding, word reading accuracy and fluency, and comprehension for 3rd graders, but not for 5th graders. For third graders in the reading programs, the gap in word attach skills between struggling readers and average readers was reduced by about two-thirds. It was found that reading skills of 3rd graders can be significantly improved through instruction in word-level skills, but not the reading skills of 5th graders. The following are appended: (1) Details of Study Design and Implementation; (2) Data Collection; (3) Weighting Adjustment and Missing Data; (4) Details of Statistical Methods; (5) Intervention Impacts on Spelling and Calculation; (6) Instructional Group Clustering; (7) Parent Survey; (8) Teacher Survey and Behavioral Rating Forms; (9) Instructional Group Clustering; (10) Videotape Coding Guidelines for Each Reading Program; (11) Supporting Tables; (12) Sample Test Items; (13) Impact Estimate Standard Errors and P-Values; (14) Association between Instructional Group Heterogeneity and The Outcome; (15) Teacher Rating Form; (16) School Survey; and (17) Scientific Advisory Board. [This report was produced by the Corporation for the Advancement of Policy Evaluation. Additional support provided by the Barksdale Reading Institute, and the Haan Foundation for Children.]

According to the National Assessment of Educational Progress, nearly 4 in 10 fourth graders read below the basic level. These literacy problems get worse as students advance through school and are exposed to progressively more complex concepts and courses. The purpose of this study was to assess the effectiveness of four remedial reading programs in improving the reading skills of 3rd and 5th graders, whether the impacts of the programs vary across students with difference baseline characteristics, and to what extent can this instruction close the reading gap and bring struggling readers within the normal range--relative to the instruction normally provided by their schools. The study took place in elementary schools in 27 districts of the Allegheny Intermediate Unit outside Pittsburgh, PA during the 2003-04 school year. Within each of 50 schools, 3rd and 5th grade students were identified as struggling readers by their teachers. These students were tested and were eligible for the study if they scored at or below the 30th percentile on a word-level reading test and at or above the 5th percentile on a vocabulary test. The final sample contains a total of 742 students. There are 335 3rd graders ? 208 treatment and 127 control students. There are 407 5th graders ? 228 treatment and 179 control students. Four existing programs were used: Spell Read P.A.T., Corrective Reading, Wilson Reading, and Failure Free Reading. Corrective Reading and Wilson Reading were modified to focus only on word-level skills. Spell Read P.A.T. and Failure Free Reading were intended to focus equally on word-level skills and reading comprehension/vocabulary. Teachers received 70 hours of professional development and support during the year. Instruction was delivered in small groups of 3 students, 5 days a week, for a total of 90 hours. Seven measures of reading skill were administered at the beginning and end of the school year to assess student progress: Word Attack, Word Identification Comprehension (Woodcock Reading Mastery Test); Phonemic Decoding Efficiency and Sight Word Efficiency (Test of Word Reading Efficiency); Oral Reading Fluency (Edformation); and Passage Comprehension (Group Reading Assessment and Diagnostic Evaluation). After one year of instruction, there were significant impacts on phonemic decoding, word reading accuracy and fluency, and comprehension for 3rd graders, but not for 5th graders. For third graders in the reading programs, the gap in word attach skills between struggling readers and average readers was reduced by about two-thirds. It was found that reading skills of 3rd graders can be significantly improved through instruction in word-level skills, but not the reading skills of 5th graders. The following are appended: (1) Details of Study Design and Implementation; (2) Data Collection; (3) Weighting Adjustment and Missing Data; (4) Details of Statistical Methods; (5) Intervention Impacts on Spelling and Calculation; (6) Instructional Group Clustering; (7) Parent Survey; (8) Teacher Survey and Behavioral Rating Forms; (9) Instructional Group Clustering; (10) Videotape Coding Guidelines for Each Reading Program; (11) Supporting Tables; (12) Sample Test Items; (13) Impact Estimate Standard Errors and P-Values; (14) Association between Instructional Group Heterogeneity and The Outcome; (15) Teacher Rating Form; (16) School Survey; and (17) Scientific Advisory Board. [This report was produced by the Corporation for the Advancement of Policy Evaluation. Additional support provided by the Barksdale Reading Institute, and the Haan Foundation for Children.]

Far more has been written about the possible outcomes of cross-age mentoring than about actual outcomes and the processes that lead to change. This study examined the effect of mentors' attendance on their mentees' outcomes after six months of developmental mentoring. Developmental mentoring is a structured, cross-age peer mentoring program designed to promote children's development by facilitating connectedness. In this randomized study of 73 Caucasian, rural youth, multiple analyses of covariance revealed that connectedness to school and parents at posttest were significantly greater for mentees than for the comparison group. Regression analyses revealed that changes in self-esteem, social skills, and behavioral competence were highly related to mentors' attendance, suggesting relational processes accounted for more change than did exposure to program curricula. However, the relationship between mentors' inconsistent attendance and mentees' decline in self-esteem and behavioral competence suggests that absent mentors may do more harm than good. (Contains 4 tables.)

This study compared the use of two supplemental balanced and strategic reading interventions that targeted the decoding, fluency, and reading comprehension of upper-elementary and middle school students with reading disabilities (RD). All students had significant delays in decoding, fluency, comprehension, and language processing. Two comparable, intensive tutorial treatments differed only in the degree of explicitness of the comprehension strategy instruction. Overall, there was meaningful progress in students' reading decoding, fluency, and comprehension. Gains in formal measures of word attack and reading fluency after five weeks of intervention translated into grade-equivalent gains of approximately half a school year. Analysis of the trends in the daily informal fluency probes translated into a weekly gain of 1.28 correct words per minute. The more explicit comprehension strategy instruction was more effective than the less explicit treatment. Findings are discussed in light of the question of how to maximize the effects of reading interventions for older children with RD.

In this paper, we describe the results a study assessing the relationship between the certification of teachers by the National Board for Professional Teaching Standards (NBPTS) and elementary level student achievement. We examine whether NBPTS assesses the most effective applicants, whether certification by NBPTS serves as a signal of teacher quality, and whether completing the NBPTS assessment process serves as catalyst for increasing teacher effectiveness. We find consistent evidence that NBPTS is identifying the more effective teacher applicants and that National Board Certified Teachers are generally more effective than teachers who never applied to the program. The statistical significance and magnitude of the "NBPTS effect," however, differs significantly by grade level and student type. We do not find evidence that the NBPTS certification process itself does anything to increase teacher effectiveness. Data tables are appended. (Contains 7 tables, 1 figure, and 49 endnotes.)

Spanish-dominant bilingual students in grades 2-5 were tutored 3 times per week for 40 minutes over 10 weeks, using 2 English reading interventions. Tutoring took place from February through April of 1 school year. One, Read Well, combined systematic phonics instruction with practice in decodable text, and the other, a revised version of Read Naturally, consisted of repeated reading, with contextualized vocabulary and comprehension instruction. The progress of tutored students (n = 51) was compared to that of nontutored classmates (n = 42) using subtests of the Woodcock Reading Mastery Tests-Revised. Students who received systematic phonics instruction made significant progress in word identification but not in word attack or passage comprehension. There were no significant effects for students in the repeated reading condition.

This study evaluated the efficacy of the computer-assisted intervention program known as Fast ForWord Language? in a sample of migrant students in Grades 1 through 6 who were native Spanish speakers. Fast ForWord Language? combines intensive training in multiple receptive English language skills with adaptive acoustic waveform lengthening and amplification to purportedly accelerate the English language learning skills of children who are nonnative English language speakers. Students either were randomly assigned to a treatment or no-contact control condition or were matched on grade, English language proficiency, and nonverbal IQ. All students were assessed in five domains before and immediately after the 4- to 8-week intervention: (a) spoken English language proficiency; (b) oral language competency; (c) phonological awareness; (d) basic reading skills; and (e) classroom behavior. Except for performance on a measure of sight-word recognition, on which children in the treatment group achieved a significantly greater gain than those in the control group, changes in test scores from pretest to posttest were equivalent for the two groups. However, when students who were least fluent in spoken English in each group were compared, the children in the treatment group demonstrated superior gains in expressive language, sight-word recognition, and pseudoword decoding. Thus, Fast ForWord Language? had a substantial, albeit limited impact on the oral language skills and reading performance of migrant children in this study. However, due to methodological weaknesses and limited treatment fidelity, the study results must be interpreted cautiously.

Gaps in reading performance between Anglo and Latino children are associated with gaps in vocabulary knowledge. An intervention was designed to enhance fifth graders' academic vocabulary. The meanings of academically useful words were taught together with strategies for using information from context, from morphology, from knowledge about multiple meanings, and from cognates to infer word meaning. Among the principles underlying the intervention were that new words should be encountered in meaningful text, that native Spanish speakers should have access to the text's meaning through Spanish, that words should be encountered in varying contexts, and that word knowledge involves spelling, pronunciation, morphology, and syntax as well as depth of meaning. Fifth graders in the intervention group showed greater growth than the comparison group on knowledge of the words taught, on depth of vocabulary knowledge, on understanding multiple meanings, and on reading comprehension. The intervention effects were as large for the English-language learners (ELLs) as for the English-only speakers (EOs), though the ELLs scored lower on all pre- and posttest measures. The results show the feasibility of improving comprehension outcomes for students in mixed ELLEO classes, by teaching word analysis and vocabulary learning strategies.

This study evaluates the effects of the Coping Power Program with at-risk preadolescent boys at the time of transition from elementary school to middle school. Aggressive boys were randomly assigned to receive only the Coping Power child component, the full Coping Power Program with parent and child components, or a control condition. Results indicated that the Coping Power intervention produced lower rates of covert delinquent behavior and of parent-rated substance use at the 1-year follow-up than did the control cell, and these intervention effects were most apparent for the full Coping Power Program with parent and child components. Boys also displayed teacher-rated behavioral improvements in school during the follow-up year, and these effects appeared to be primarily influenced by the Coping Power child component.

Although schools across the country are investing heavily in computers in the classroom, there is surprisingly little evidence that they actually improve student achievement. In this paper, we present results from a randomized study of a well-defined use of computers in schools: a popular instructional computer program, known as Fast ForWord, which is designed to improve language and reading skills. We assess the impact of the program on students having difficulty learning to read using four different measures of language and reading ability. Our estimates suggest that while use of the computer program may improve some aspects of students' language skills, it does not appear that these gains translate into a broader measure of language acquisition or into actual readings skills.