Search Results

This practice guide provides four evidence-based recommendations that teachers can use to deliver reading interventions to meet the needs of their students.

This practice guide provides evidence-based practices that can help teachers tailor their instructional approaches and/or their mathematics intervention programs to meet the needs of their students.

This practice guide provides school educators and administrators with four evidence-based recommendations for reducing dropout rates in middle and high schools and improving high school graduation rates. Each recommendation provides specific, actionable strategies; examples of how to implement the recommended practices in schools; advice on how to overcome potential obstacles; and a description of the supporting evidence.

This practice guide presents three evidence-based recommendations for helping students in grades 6–12 develop effective writing skills. Each recommendation includes specific, actionable guidance for educators on implementing practices in their classrooms. The guide also summarizes and rates the evidence supporting each recommendation, describes examples to use in class, and offers the panel’s advice on how to overcome potential implementation obstacles. This guide is geared towards administrators and teachers in all disciplines who want to help improve their students’ writing.

This practice guide provides four recommendations that address what works for English learners during reading and content area instruction. Each recommendation includes extensive examples of activities that can be used to support students as they build the language and literacy skills needed to be successful in school. The recommendations also summarize and rate supporting evidence. This guide is geared toward teachers, administrators, and other educators who want to improve instruction in academic content and literacy for English learners in elementary and middle school.

This practice guide provides four recommendations for improving elementary students’ writing. Each recommendation includes implementation steps and solutions for common roadblocks. The recommendations also summarize and rate supporting evidence. This guide is geared toward teachers, literacy coaches, and other educators who want to improve the writing of their elementary students.

This practice guide provides five recommendations for improving students’ mathematical problem solving in grades 4 through 8. This guide is geared toward teachers, math coaches, other educators, and curriculum developers who want to improve the mathematical problem solving of students.

This practice guide provides three recommendations for teaching algebra to students in middle school and high school. Each recommendation includes implementation steps and solutions for common roadblocks. The recommendations also summarize and rate supporting evidence. This guide is geared toward teachers, administrators, and other educators who want to improve their students’ algebra knowledge.

This practice guide presents five recommendations intended to help educators improve students’ understanding of fractions. Recommendations include strategies to develop young children’s understanding of early fraction concepts and ideas for helping older children understand the meaning of fractions and the computations involved. The guide also highlights ways to build on students’ existing strategies to solve problems involving ratios, rates, and proportions.

Out-of-school time programs can enhance academic achievement by helping students learn outside the classroom.

Taking early action may be key to helping students struggling with mathematics.

Designed for elementary school educators and school- and district-level administrators, this guide offers prevention, implementation, and schoolwide strategies that can be used to reduce problematic behavior that interferes with the ability of students to attend to and engage fully in instructional activities.

This guide presents strategies that classroom teachers and specialists can use to increase the reading ability of adolescent students.

The objective of this guide is to provide teachers with specific recommendations that can be carried out in the classroom without requiring systemic change.

This guide includes a set of concrete actions relating to the use of instructional and study time that are applicable to subjects that demand a great deal of content learning, including social studies, science, and mathematics.

This guide identifies practices that can improve the performance of chronically low-performing schools—a process commonly referred to as creating "turnaround schools."

Good Behavior Game is a classroom management strategy that aims to improve social skills, minimize disruptive behaviors, and create a positive learning environment. Teachers place students into teams and reward them for demonstrating appropriate behaviors and following classroom rules.

Class-Wide Function-Related Intervention Teams (CW-FIT) is a classroom management strategy designed to help teachers create a positive learning environment by decreasing disruptive behavior and improving social skills and prosocial behaviors among students.

The Knowledge is Power Program (KIPP) is a nationwide network of free open-enrollment college-preparatory schools in under-resourced communities throughout the United States. KIPP schools are usually established under state charter school laws and KIPP is America’s largest network of charter schools. KIPP Aims to prepare poor and minority students to succeed in a college preparatory curriculum. It provides training for principals and offers them greater autonomy over budget and hiring decisions. KIPP schools provide about 60% more instructional time than traditional public schools—through a longer school day and additional instructional days on Saturdays and in the summer.

READ 180® is a reading program designed for struggling readers who are reading 2 or more years below grade level. It combines online and direct instruction, student assessment, and teacher professional development. READ 180® is delivered in 90-minute sessions that include whole-group instruction, three small-group rotations, and whole-class wrap-up. Small-group rotations include individualized instruction using an adaptive computer application, small-group instruction, and independent reading. READ 180® is designed for students in elementary through high school.

Teach For America (TFA) is a highly selective route to teacher certification that aims to place non-traditionally trained teachers in high-need public schools. Many TFA teachers hold bachelors’ degrees from selective colleges and universities, in fields outside of education. TFA teachers commit to teach for at least 2 years. TFA teachers receive 5–7 weeks of in-person training over the summer before they begin teaching, then continue to receive professional development and one-on-one coaching from TFA while teaching, in addition to support provided by their schools and districts. As full-time employees of the public schools where they work, TFA teachers receive the same salary and benefits as other first- or second-year teachers in their school or district.

Dual language programs are long-term instructional programs that provide content and literacy instruction to all students through two languages—English and a partner language—with the goals of promoting academic achievement, bilingualism and biliteracy, and sociocultural competence. Dual language programs can be implemented with students from one language group (in one-way programs) or with students from two language groups (in two-way programs).

The Pathway to Academic Success Project trains teachers to improve the reading and writing abilities of English learners who have an intermediate level of English proficiency by incorporating cognitive strategies into reading and writing instruction. The cognitive strategies include goal setting, tapping prior knowledge, asking questions, making predictions, articulating and revising understanding of text, and evaluating writing.

Achieve3000® is a supplemental online literacy program that provides nonfiction reading content to students in grades preK–12 and focuses on building phonemic awareness, phonics, fluency, reading comprehension, vocabulary, and writing skills. Achieve3000® is designed to help students advance their nonfiction reading skills by providing differentiated online instruction. Teachers use the program with an entire class but the assignments are tailored to each student’s reading ability level. For example, teachers assign an article and related activities to an entire class; the program then tailors the version of the article to each student by automatically increasing the difficulty of text when a student is ready for more challenging text. Achieve3000® provides lessons that follow a five-step routine: (1) respond to a Before Reading Poll, (2) read an article, (3) answer activity questions, (4) respond to an After Reading Poll, and (5) answer a Thought Question. Progress reports and student usage data, provided by the online tool, enable teachers to track both whole-class and individual student progress. The program is designed for diverse student groups, including general education students, struggling readers in need of intensive tutoring, and English learners.

Cooperative Integrated Reading and Composition^® (CIRC^®) is a comprehensive reading and writing program for students in grades 2–8. It includes story-related activities, direct instruction in reading comprehension, and integrated reading and language arts activities. Pairs of students (grouped either by or across ability levels) read to each other, predict how stories will end, summarize stories, write responses, and practice spelling, decoding, and vocabulary. Within cooperative teams of four, students work to understand the main idea of a story and work through the writing process. The CIRC^® process includes teacher instruction, team practice, peer assessment, and team/partner recognition. A Spanish version of the program was also designed for grades 2–5.

Peer-Assisted Learning Strategies is a peer-tutoring program for grades K–6 that aims to improve student proficiency in several disciplines. During the 30-35 minute peer-tutoring sessions, students take turns acting at the tutor, coaching and correcting one another as they work through problems. The designation of tutoring pairs and skill assignment is based on teacher judgement of student needs and abilities, and teachers reassign tutoring pairs regularly.  

Balanced Leadership® is a professional development program for school principals and other current and aspiring school leaders in schools serving kindergarten through grade 12. School leaders participate in professional development sessions with trained facilitators over one or two years, practice what they learn between sessions, and can receive additional coaching and online support. McREL International, the company that developed the Balanced Leadership® program, based the framework and content of the professional development on research identifying key actions and behaviors of school leaders that are associated with improved student outcomes.

Self-Regulated Strategy Development (SRSD) is an intervention designed to improve students’ academic skills through a six-step process that teaches students specific academic strategies and self-regulation skills. The practice is especially appropriate for students with learning disabilities. The intervention begins with teacher direction and ends with students independently applying the strategy, such as planning and organizing ideas before writing an essay. More specifically, the six steps involve the teacher providing background knowledge, discussing the strategy with the student, modeling the strategy, helping the student memorize the strategy, supporting the strategy, and then watching as the student independently performs the strategy. A key part of the process is teaching self-regulation skills, such as goal-setting and self-monitoring, which aim to help students apply the strategy without guidance. The steps can be combined, changed, reordered, or repeated, depending on the needs of the student. The SRSD model can be used with students in grades 2 through 12 in individual, small group, or whole classroom settings.

Functional behavioral assessment (FBA) is an individualized problem-solving process for addressing student problem behavior. An assessment is conducted to identify the purpose or function of a student's problem behavior. This assessment process involves collecting information about the environmental conditions that precede the problem behavior and the subsequent rewards that reinforce the behavior. The information that is gathered is then used to identify and implement individualized interventions aimed at reducing problem behaviors and increasing positive behaviors. Accordingly, the studies evaluating FBA examine different FBA-based interventions identified for each student. FBA-based interventions can be used to address diverse problem behaviors, such as disruptive and off-task behaviors, noncompliance, and inappropriate social interactions.

MyTeachingPartner–Secondary (MTP-S) is a professional development program that aims to increase student learning and development through improved teacher–student interactions. Through the program, middle and high school teachers access a video library featuring examples of high-quality interactions and receive individualized, web-based coaching approximately twice per month during the school year. MTP-S uses the secondary school version of the Classroom Assessment Scoring System®–Secondary (CLASS-S) to define and observe effective teaching practices.

Repeated reading is an academic practice that aims to increase oral reading fluency. Repeated reading can be used with students who have developed initial word reading skills but demonstrate inadequate reading fluency for their grade level. During repeated reading, a student sits in a quiet location with a teacher and reads a passage aloud at least three times. Typically, the teacher selects a passage of about 50 to 200 words in length. If the student misreads a word or hesitates for longer than 5 seconds, the teacher reads the word aloud, and the student repeats the word correctly. If the student requests help with a word, the teacher reads the word aloud or provides the definition. The student rereads the passage until he or she achieves a satisfactory fluency level.

Read Naturally is an elementary and middle school supplemental reading program designed to improve reading fluency using a combination of books, audiotapes, and computer software. The program has three main strategies: repeated reading of text for developing oral reading fluency, teacher modeling of story reading, and systematic monitoring of student progress by teachers and the students themselves. Students work at a reading level appropriate for their achievement level, progress through the program at their own rate, and, for the most part, work on an independent basis. Read Naturally® can be used in a variety of settings, including classrooms, resource rooms, or computer or reading labs. Although the program was not originally developed for English language learners, additional materials for these students are currently available.

SpellRead™ (formerly known as SpellRead Phonological Auditory Training®) is a literacy program for struggling readers in grade 2 or above, including special education students, English language learners, and students more than 2 years below grade level in reading. SpellRead integrates the auditory and visual aspects of the reading process and emphasizes specific skill mastery through systematic and explicit instruction. Students are taught to recognize and manipulate English sounds; to practice, apply, and transfer their skills using texts at their reading level; and to write about their reading.

Peer-Assisted Learning Strategies is a peer-tutoring program for grades K–6 that aims to improve student proficiency in several disciplines. During the 30-35 minute peer-tutoring sessions, students take turns acting at the tutor, coaching and correcting one another as they work through problems. The designation of tutoring pairs and skill assignment is based on teacher judgement of student needs and abilities, and teachers reassign tutoring pairs regularly.  

Peer-Assisted Learning Strategies is a peer-tutoring program for grades K–6 that aims to improve student proficiency in several disciplines. During the 30-35 minute peer-tutoring sessions, students take turns acting at the tutor, coaching and correcting one another as they work through problems. The designation of tutoring pairs and skill assignment is based on teacher judgement of student needs and abilities, and teachers reassign tutoring pairs regularly.  

Peer-Assisted Learning Strategies is a peer-tutoring program for grades K–6 that aims to improve student proficiency in several disciplines. During the 30-35 minute peer-tutoring sessions, students take turns acting at the tutor, coaching and correcting one another as they work through problems. The designation of tutoring pairs and skill assignment is based on teacher judgement of student needs and abilities, and teachers reassign tutoring pairs regularly.  

Reading Plus® is a web-based reading intervention that uses technology to provide individualized scaffolded silent reading practice for students in grades 3 and higher. Reading Plus® aims to develop and improve students’ silent reading fluency, comprehension, and vocabulary. Reading Plus® is designed to adjust the difficulty of the content and duration of reading activities so that students proceed at a pace that corresponds to their reading skill level. The intervention includes differentiated reading activities, computer-based reading assessments, tools to monitor student progress, ongoing implementation support, and supplemental offline activities.

Fast ForWord® is a computer-based reading program intended to help students develop and strengthen the cognitive skills necessary for successful reading and learning. The program, which is designed to be used 30 to 100 minutes a day, five days a week, for 4 to 16 weeks, includes two components.

Accelerated Reader™ is a computerized supplementary reading program that provides guided reading instruction to students in grades K–12. It aims to improve students’ reading skills through reading practice and by providing frequent feedback on students’ progress to teachers. The Accelerated Reader™ program requires students to select and read a book based on their area of interest and reading level. Upon completion of a book, students take a computerized quiz based on the book’s content and vocabulary. Quiz performance allows teachers to monitor student progress and to identify students who may need additional reading assistance.

Cooperative Integrated Reading and Composition^® (CIRC^®) is a comprehensive reading and writing program for students in grades 2–8. It includes story-related activities, direct instruction in reading comprehension, and integrated reading and language arts activities. Pairs of students (grouped either by or across ability levels) read to each other, predict how stories will end, summarize stories, write responses, and practice spelling, decoding, and vocabulary. Within cooperative teams of four, students work to understand the main idea of a story and work through the writing process. The CIRC^® process includes teacher instruction, team practice, peer assessment, and team/partner recognition. A Spanish version of the program was also designed for grades 2–5.

Read Naturally is an elementary and middle school supplemental reading program designed to improve reading fluency using a combination of books, audiotapes, and computer software. The program has three main strategies: repeated reading of text for developing oral reading fluency, teacher modeling of story reading, and systematic monitoring of student progress by teachers and the students themselves. Students work at a reading level appropriate for their achievement level, progress through the program at their own rate, and, for the most part, work on an independent basis. Read Naturally® can be used in a variety of settings, including classrooms, resource rooms, or computer or reading labs. Although the program was not originally developed for English language learners, additional materials for these students are currently available.

Project CRISS® (CReating Independence through Student-owned Strategies) is a professional development program for teachers that aims to improve reading, writing, and learning for students in grades 3–12. The implementation of Project CRISS® does not require a change in the curriculum or materials being used in the classroom, but instead calls for a change in teaching style to focus on three primary concepts derived from cognitive psychology and brain research. These three concepts include students (1) monitoring their learning to assess when they have understood content, (2) integrating new information with prior knowledge, and (3) being actively involved in the learning process through discussing, writing, organizing information, and analyzing the structure of text to help improve comprehension.

Accelerated middle schools are self-contained academic programs designed to help middle school students who are behind grade level catch up with their peers. The program aims to ensure students stay in school and graduate by encouraging them to begin high school with other students their age. The programs serve students who are one to two years behind grade level, giving students the opportunity to cover an additional year of curriculum over 1–2 years in the program. Accelerated middle schools can be structured as separate schools or as schools within a traditional middle school.

SpellRead™ (formerly known as SpellRead Phonological Auditory Training®) is a literacy program for struggling readers in grade 2 or above, including special education students, English language learners, and students more than 2 years below grade level in reading. SpellRead integrates the auditory and visual aspects of the reading process and emphasizes specific skill mastery through systematic and explicit instruction. Students are taught to recognize and manipulate English sounds; to practice, apply, and transfer their skills using texts at their reading level; and to write about their reading.

Peer Tutoring and Response Groups aims to improve the language and achievement of English learners by pairing or grouping students to work on a task. The students may be grouped by age or ability, or the groups may be mixed. Peer tutoring typically consists of two students assuming the roles of tutor and tutee, or “coach and player” roles. Peer response groups give four or five students shared responsibility for a task, such as editing a passage or reading and answering comprehension questions. Both peer tutoring pairs and peer response groups emphasize peer interaction and discussion to complete a task.

Caring School Community™ (CSC) is a modified version of a program formerly known as the Child Development Project. CSC is a multiyear school improvement program that involves all students in grades K–6. The program aims to promote core values, prosocial behavior, and a schoolwide feeling of community. The program consists of four elements originally developed for the Child Development Project: class meeting lessons, cross-age “buddies” programs, “homeside” activities, and schoolwide community. Class lessons provide teachers and students with a forum to get to know one another, discuss issues, identify and solve problems collaboratively, and make a range of decisions that affect classroom life. Cross-age buddies activities pair whole classes of older and younger students for academic and recreational activities that build caring cross-age relationships and create a schoolwide climate of trust. Homeside activities include short conversational activities that are sent home with students for them to do with parents or caregivers and then to discuss back in their classroom. The activities incorporate the families’ perspectives, cultures, and traditions, thereby promoting interpersonal understanding. Schoolwide community-building activities bring students, parents, and school staff together to create new school traditions.

Positive Action, at its core, teaches the philosophy that you feel good about yourself when you do positive actions and there is always a positive way to do everything. It is illustrated by the the Thoughts-Actions-Feelings about self Circle where positive thoughts lead to positive actions, which in turn lead to positive feelings about oneself. It also teaches the positive actions for physical, intellectual, social and emotional areas—the whole self. It is a Pre-K-12 school-based program that aims to promote good behavior while disrupting problem behaviors, improves academics, and develops social-emotional and character skills while improving mental and physical health and self-concept. Lessons are scripted and use a wide variety of strategies: classroom discussion, role-play, games, songs, journals, manipulatives and activity sheets and text booklets.

Fast ForWord® is a computer-based reading program intended to help students develop and strengthen the cognitive skills necessary for successful reading and learning. The program, which is designed to be used 30 to 100 minutes a day, five days a week, for 4 to 16 weeks, includes two components.

Too Good for Drugs™ is designed to promote elementary and middle school students’ life skills, character values, resistance skills to negative peer influence, and resistance to the use of illegal drugs, alcohol, and tobacco. The program is based on classroom discussions and structured activities that center on interactive learning and skill-building exercises. Students engage in role-play and cooperative learning games and are encouraged to apply the skills to different contexts. Too Good for Drugs™ also includes the optional elements of parental and community involvement.

Connect with Kids aims to promote prosocial attitudes and positive behavior of elementary (grades 3–5) and secondary (grades 6–12) school students by teaching core character values. Lesson plans include videos, story summaries, discussion questions, student games, and activities for both core and supplemental character traits. The classroom curriculum is reinforced by a website component and schoolwide and community outreach components. The program can be incorporated into an existing curriculum or used as a standalone program. The school or teacher decides on the number of character traits covered in each session, so the program duration may vary from one semester to an entire academic year.

The Leadership and Assistance for Science Education Reform (LASER) program is intended to build capacity for implementing inquiry-based science curricula in schools and districts. When participating in LASER, school or district teams attend leadership development institutes to plan the implementation of inquiry-based science curricula. These school or district teams receive support for key aspects of implementation such as professional development for teachers, access to instructional materials, and support for selecting appropriate assessments. LASER also helps schools and districts partner with scientists, science educators, and local business and community leaders who can promote and further support the implementation of inquiry-based science instruction.

University of Chicago School Mathematics Project (UCSMP) is a core mathematics curriculum that includes materials and a routinized instructional approach with an option for teacher training. The curriculum uses an inquiry-based approach with a focus on active learning where students frequently engage in hands-on activities and small-group activities. Pre-Transition Mathematics teaches arithmetic, algebra, geometry, probability, and statistics. Transition Mathematics teaches more advanced arithmetic, algebra, and geometry, and connects these areas to measurement, probability, and statistics.

Literacy Design Collaborative provides professional development, coaching, and resources to support teachers to work collaboratively in their schools to design and use high-quality, standards-aligned literacy instruction materials aimed at building students’ reading, research, and writing skills. Literacy Design Collaborative guides teachers to implement literacy modules they can use to teach students the content and literacy skills needed to complete a culminating writing task. Teachers implement existing modules and design new ones. Teachers across content areas—including English language arts, social studies, and science—can use the Literacy Design Collaborative program.

Word Generation is a supplemental program that aims to improve students’ reading comprehension by building students’ vocabulary, academic language, and perspective-taking skills through classroom discussion and debate. Word Generation was developed for all students; however, English learners in particular could benefit from its focus on academic language. Word Generation consists of a series of interdisciplinary units with daily lessons focused on a high-interest issue to increase student engagement. Each unit targets a small number of academic vocabulary words that are integrated into texts, activities, writing tasks, debates, and discussions across content areas. Several Word Generation programs exist. In the Word Generation Weekly (WordGen Weekly) and Word Generation Elementary (WordGen Elementary) programs, units are intended to be used across English language arts, math, science, and social studies in grades 6–8 and grades 4 and 5, respectively. In the Science Generation (SciGen) and Social Studies Generation (SoGen) programs, units can supplement or be used in place of regular science and social studies curriculum units in grades 6–8. The different Word Generation programs can be implemented separately or together.

Passport Reading Journeys is a supplemental literacy curriculum designed to help improve reading comprehension, vocabulary, word study, and writing skills of struggling readers in grades 6–12. Lessons incorporate both teacher-led instruction and technology, including whole-class and small-group instruction, independent reading, video segments, and independent computer-based practice. The curriculum includes a series of two-week, ten-lesson instructional sequences on topics in science, math, fine art, literature, and social studies. Each sequence is themed as an expedition or journey for students.

The National Board for Professional Teaching Standards (NBPTS) establishes standards for accomplished teachers and awards professional certification to teachers who can demonstrate that their teaching practices meet those standards. Educators and experts in child development and related fields established the organization, and these experts work to develop and refine the standards for accomplished teaching based on the knowledge and skills that effective teachers demonstrate. The standards reflect five core propositions: (1) effective teachers are committed to students and their learning, (2) effective teachers know the subjects they teach and how to teach those subjects to students, (3) effective teachers manage and monitor student learning, (4) effective teachers think systematically about their practice and learn from experience, and (5) effective teachers are members of learning communities. Those seeking certification from the NBPTS must complete a computer-based assessment and three portfolio entries. The certification process can take 1 to 5 years.

Achieve3000® is a supplemental online literacy program that provides nonfiction reading content to students in grades preK–12 and focuses on building phonemic awareness, phonics, fluency, reading comprehension, vocabulary, and writing skills. Achieve3000® is designed to help students advance their nonfiction reading skills by providing differentiated online instruction. Teachers use the program with an entire class but the assignments are tailored to each student’s reading ability level. For example, teachers assign an article and related activities to an entire class; the program then tailors the version of the article to each student by automatically increasing the difficulty of text when a student is ready for more challenging text. Achieve3000® provides lessons that follow a five-step routine: (1) respond to a Before Reading Poll, (2) read an article, (3) answer activity questions, (4) respond to an After Reading Poll, and (5) answer a Thought Question. Progress reports and student usage data, provided by the online tool, enable teachers to track both whole-class and individual student progress. The program is designed for diverse student groups, including general education students, struggling readers in need of intensive tutoring, and English learners.

Accelerated Math®, published by Renaissance Learning, is a software tool that provides practice problems for students in grades K–12 and provides teachers with reports to monitor student progress. Accelerated Math® creates individualized student assignments, scores the assignments, and generates reports on student progress. The software is typically used with the math curriculum being used in the classroom to add practice for students and help teachers differentiate instruction through the program’s progress-monitoring data.

Accelerated Math®, published by Renaissance Learning, is a software tool that provides practice problems for students in grades K–12 and provides teachers with reports to monitor student progress. Accelerated Math® creates individualized student assignments, scores the assignments, and generates reports on student progress. The software is typically used with the math curriculum being used in the classroom to add practice for students and help teachers differentiate instruction through the program’s progress-monitoring data.

TNTP Teaching Fellows is a highly selective route to teacher certification that aims to prepare people to teach in high-need public schools. The program recruits professionals seeking to change careers and recent college graduates who are not certified teachers. TNTP Teaching Fellows expects its participants to teach for many years, but does not require them to make a minimum time commitment to teaching. Program participants complete online coursework and receive 5–7 weeks of in-person training focused on foundational teaching skills during the summer before they begin teaching. They must demonstrate mastery of these core skills to be eligible to teach. They receive continued professional development and coaching from TNTP Teaching Fellows during their first year of teaching, and additional support provided by their schools and districts. As full-time employees of the public schools in which they work, new TNTP Teaching Fellows teachers receive the same salary and benefits as other beginning teachers in their school district.

Saxon Math is a curriculum for students in grades K–12. The amount of new math content students receive each day is limited and students practice concepts every day. New concepts are developed, reviewed, and practiced cumulatively rather than in discrete chapters or units.

Connected Mathematics Project (CMP) is a math curriculum for students in grades 6–8. It uses interactive problems and everyday situations to explore mathematical ideas, with a goal of fostering a problem-centered, inquiry-based learning environment. At each grade level, the curriculum covers numbers, algebra, geometry/measurement, probability, and statistics.

Accelerated Reader™ is a computerized supplementary reading program that provides guided reading instruction to students in grades K–12. It aims to improve students’ reading skills through reading practice and by providing frequent feedback on students’ progress to teachers. The Accelerated Reader™ program requires students to select and read a book based on their area of interest and reading level. Upon completion of a book, students take a computerized quiz based on the book’s content and vocabulary. Quiz performance allows teachers to monitor student progress and to identify students who may need additional reading assistance.

Saxon Math is a textbook series covering grades K–12 based on incremental development and continual review of mathematical concepts to give students time to learn and practice concepts throughout the year. The program is built on the premise that students learn best when instruction is incremental and explicit, previously learned concepts are continually reviewed, and assessment is frequent and cumulative. At each grade level, math concepts are introduced, reviewed, and practiced over time in order to move students from understanding to fluency.

The New Teacher Center (NTC) Induction Model is a comprehensive and systemic approach to support beginning teachers (i.e., teachers new to the profession). The induction model aims to accelerate the effectiveness of beginning teachers at increasing student learning by providing one-on-one mentoring and professional development in a supportive school environment. The NTC works with school districts and state departments of education to design, develop, and implement induction programs that are aligned with both district priorities and NTC standards.

TAP™ (formerly known as the Teacher Advancement Program) is a comprehensive educator effectiveness program that aims to improve student achievement through supports and incentives that attract, retain, develop, and motivate effective teachers. The program provides teachers with leadership opportunities and associated salary increases; ongoing, school-based professional development; rigorous evaluations; and annual performance bonuses based on a combination of teacher value added to student achievement and observations of their classroom teaching.

Reciprocal teaching is an interactive instructional practice that aims to improve students’ reading comprehension by teaching strategies to obtain meaning from a text. The teacher and students take turns leading a dialogue regarding segments of the text. Students discuss with their teacher how to apply four comprehension strategies—generating questions, summarizing, clarifying, and predicting—to passages of text. During the early stages of reciprocal teaching, the teacher assumes primary responsibility for modeling how to use these strategies. As students become more familiar with the strategies, there is a gradual shift toward student responsibility for talking through the application of the strategies to the text.

Read Naturally is an elementary and middle school supplemental reading program designed to improve reading fluency using a combination of books, audiotapes, and computer software. The program has three main strategies: repeated reading of text for developing oral reading fluency, teacher modeling of story reading, and systematic monitoring of student progress by teachers and the students themselves. Students work at a reading level appropriate for their achievement level, progress through the program at their own rate, and, for the most part, work on an independent basis. Read Naturally® can be used in a variety of settings, including classrooms, resource rooms, or computer or reading labs. Although the program was not originally developed for English language learners, additional materials for these students are currently available.

Fast ForWord® is a computer-based reading program intended to help students develop and strengthen the cognitive skills necessary for successful reading and learning. The program, which is designed to be used 30 to 100 minutes a day, five days a week, for 4 to 16 weeks, includes two components.

Peer-Assisted Learning Strategies is a peer-tutoring program for grades K–6 that aims to improve student proficiency in several disciplines. During the 30-35 minute peer-tutoring sessions, students take turns acting at the tutor, coaching and correcting one another as they work through problems. The designation of tutoring pairs and skill assignment is based on teacher judgement of student needs and abilities, and teachers reassign tutoring pairs regularly.  

ARIES: Exploring Motion and Forces is a physical science curriculum for students in grades 5–8 that employs 18 inquiry-centered, hands-on lessons called “explorations.” The curriculum draws upon students’ curiosity to explore phenomena, allowing for a discovery-based learning process. Group-centered lab work is designed to help students build an understanding of inertia, friction, gravity, speed, and acceleration. Students examine their prior ideas about the phenomena, formulate questions, build and use an apparatus to observe natural phenomena, make predictions, and gather data through structured experiments. Exploring Motion and Forces is part of the ARIES sequence of eight physical science units. The ARIES sequences can be used together for an overall curriculum or independently.

Student team reading and writing refers to two cooperative learning programs for secondary students: (1) Student Team Reading and Writing and (2) Student Team Reading. The Student Team Reading and Writing program is an integrated approach to reading and language arts for early adolescents. Student Team Reading comprises the reading part of Student Team Reading and Writing and consists of two principal elements: (1) literature-related activities (including partner reading, treasure hunts, word mastery, story retelling, story-related writing, and quizzes) and (2) direct instruction in reading comprehension strategies (such as identifying main ideas and themes, drawing conclusions, making predictions, and understanding figurative language).

Repeated reading is an academic practice that aims to increase oral reading fluency. Repeated reading can be used with students who have developed initial word reading skills but demonstrate inadequate reading fluency for their grade level. During repeated reading, a student sits in a quiet location with a teacher and reads a passage aloud at least three times. Typically, the teacher selects a passage of about 50 to 200 words in length. If the student misreads a word or hesitates for longer than 5 seconds, the teacher reads the word aloud, and the student repeats the word correctly. If the student requests help with a word, the teacher reads the word aloud or provides the definition. The student rereads the passage until he or she achieves a satisfactory fluency level.

Reciprocal teaching is an interactive instructional practice that aims to improve students’ reading comprehension by teaching strategies to obtain meaning from a text. The teacher and students take turns leading a dialogue regarding segments of the text. Students discuss with their teacher how to apply four comprehension strategies—generating questions, summarizing, clarifying, and predicting—to passages of text. During the early stages of reciprocal teaching, the teacher assumes primary responsibility for modeling how to use these strategies. As students become more familiar with the strategies, there is a gradual shift toward student responsibility for talking through the application of the strategies to the text.

READ 180® is a reading program designed for struggling readers who are reading 2 or more years below grade level. It combines online and direct instruction, student assessment, and teacher professional development. READ 180® is delivered in 90-minute sessions that include whole-group instruction, three small-group rotations, and whole-class wrap-up. Small-group rotations include individualized instruction using an adaptive computer application, small-group instruction, and independent reading. READ 180® is designed for students in elementary through high school.

Read Naturally is an elementary and middle school supplemental reading program designed to improve reading fluency using a combination of books, audiotapes, and computer software. The program has three main strategies: repeated reading of text for developing oral reading fluency, teacher modeling of story reading, and systematic monitoring of student progress by teachers and the students themselves. Students work at a reading level appropriate for their achievement level, progress through the program at their own rate, and, for the most part, work on an independent basis. Read Naturally® can be used in a variety of settings, including classrooms, resource rooms, or computer or reading labs. Although the program was not originally developed for English language learners, additional materials for these students are currently available.

PLATO® Achieve Now is a software-based curriculum for the elementary and middle school grades that focuses on pre-algebraic concepts and includes content pertaining to rational numbers in related organizational patterns, proportion and percent, integers, probability, statistics, problem solving, geometry, measurement, and the foundational concepts of algebra I. Instructional content is delivered via the PlayStation Portable (PSP®) system, allowing students to access learning materials in various settings. Software-based assessments are used to customize individual instruction, allowing students to learn at their own pace with content appropriate for their skill level.

Accelerated Reader™ is a computerized supplementary reading program that provides guided reading instruction to students in grades K–12. It aims to improve students’ reading skills through reading practice and by providing frequent feedback on students’ progress to teachers. The Accelerated Reader™ program requires students to select and read a book based on their area of interest and reading level. Upon completion of a book, students take a computerized quiz based on the book’s content and vocabulary. Quiz performance allows teachers to monitor student progress and to identify students who may need additional reading assistance.

An Ethics Curriculum for Children, a read-aloud literature-based curriculum, aims to teach elementary school students seven universal attributes of good character. Lessons and home assignments are organized around multicultural stories. The program activities are designed to connect the experiences of characters in the stories to students’ own lives. Optional parts of the Heartwood Ethics Curriculum for Children also include integration of character education themes across curricular topics and parental notification and involvement.

Voices Literature and Character Education Program (Voices LACE; formerly known as Voices of Love and Freedom and Literacy and Values) is a K–12 program that aims to promote positive character and citizenship values, literacy skills, and social skills. The program curriculum can be used over any length of time. During classroom lessons, students read books about issues such as ethnic discrimination, fighting, or bullying, and elaborate on central themes through role-playing and discussions practiced in school and at home. Emphasis is given to promoting caring relationships between teachers and students and among students, and to connecting the values taught to students’ personal stories. Voices LACE may also be implemented as a schoolwide improvement program. Optional components of the program include schoolwide events and restructuring of school organization and practices (establishing student assemblies and creating small learning communities), parental involvement (home visits and family nights), and community support (joint campaigns with supporting organizations and business).

Lions Quest Skills for Adolescence is a schoolwide program for middle school students (grades 6–8). The program is designed to promote good citizenship skills, core character values, social-emotional skills, and discourage the use of drugs, alcohol, and violence. The program includes a classroom curriculum, schoolwide practices to create a positive school climate, parent and family involvement, and community involvement. The curriculum may vary in scope and intensity, lasting from 9 weeks to 3 years. The lessons use cooperative group learning exercises and classroom management techniques to improve classroom climate.

Principals are the second-largest school-based contributor to K-12 students' academic progress. However, there is little research evaluating whether efforts to develop principals' skills improve school effectiveness. We conducted randomized controlled trial studies of the impacts of a professional development program called the Executive Development Program (EDP) and of the incremental effects of coaching to help principals implement the EDP curriculum. We find that the EDP alone influenced principals' practices, but not student achievement, within 3 years. Coaching had a small positive effect on students' English Language Arts achievement, but no effect on math achievement or on principals' practices. Coaching had the largest effects in disadvantaged schools. We hypothesize that coaching enhanced the quality of implementation of recommended practices.

Teachers, like the students they serve, never stop learning. In-service teacher professional development (PD) gives educators opportunities over the course of the year to learn more about pedagogy and improve their own instruction methods to boost students' academic and social and emotional outcomes. On average, teachers participate in ten days of inservice PD during the school year. In this research, the authors evaluate the Chicago Collaborative, a teacher PD program that is aligned to Common Core State Standards (CCSS) and implemented by Leading Educators. The research took place during the 2018-2019 and 2019-2020 school years in 40 schools across three school districts in the Chicago area. The authors sought answers to two interrelated questions: (1) How is the Chicago Collaborative PD program implemented?; and (2) Did the Chicago Collaborative PD program impact student achievement? The research found that the Leading Educators Chicago Collaborative was implemented overall as intended and had a statistically significant positive effect on student achievement.

There is a need for rigorous experimental research on restorative practices in schools as a means to reduce exclusionary discipline and the disproportionate sanctioning of Black students, male students, and students with disabilities. The current study addressed this need in its evaluation of Morningside Center for Teaching Social Responsibility's Whole School Restorative Practices (RP) Project. The study was conducted in a large Northeastern city using a cluster randomized control experimental design in 18 elementary, middle, and high schools. The RP Project was a 2-year initiative which was interrupted in its second year of implementation given the global health pandemic and the shift to remote schooling. After two years, it was anticipated that the nine RP project schools, relative to nine comparison schools, would have lower discipline incidents and narrowed discipline disparities across subgroups. Given the pandemic disruption, the effects of one year of implementation were examined despite that change was anticipated after two years. The 5,878 student sample was drawn from discipline incident record data provided by the public school district. After only one year of implementation, the study found that overall, students in the RP Project schools were less likely to receive a discipline incident record (11.1%) compared to students in the comparison schools (18.2%). In the single year of the two-year project, no differential effects of the intervention were noted based on student race, gender, or disability status. Given the project anticipated change after two years, the reduction in discipline incidents was striking. Future research will need to examine whether reducing incidents in year one of implementation sets the stage for narrowed discipline disparities in year two.

Many talented students in under-resourced schools do not reach their full potential. Research shows that by sixth grade, children born into poverty have likely spent 6,000 fewer hours learning than their middle-class counterparts. Higher Achievement, an intensive summer and after-school program, aims to close that learning gap. It offers participants more than 500 hours of academic enrichment activities a year to help them meet the high academic standards expected of college-bound students. Known as "scholars"; Higher Achievement students enter the program during the summer before either fifth or sixth grade and commit to attending through eighth grade. The summer program consists of six weeks of morning classes in English Language Arts (ELA), math, science, and, in some centers, social studies, followed by enrichment activities in the afternoon, including chess, cooking, art, and soccer. During the school year, in addition to the program's regular study hall and enrichment activities, a cadre of mostly young professionals volunteer one day a week, delivering 75-minute ELA or math lessons to small groups of scholars. These volunteers receive detailed lesson plans and training so they can successfully execute the program's rigorous curricula. Part of what makes Higher Achievement affordable is its use of volunteers in this way. An earlier experimental evaluation of Metro DC, Higher Achievement's flagship affiliate in Washington, DC, and Alexandria, Virginia, found that the program was effective in improving academic performance two years after students applied. Since then, Higher Achievement has expanded to three new cities: Baltimore, Maryland; Richmond, Virginia; and Pittsburgh, Pennsylvania. Keenly aware that many effective flagship programs fail to be effective in new locations, the federal government funded an experimental validation study to examine the impacts at these expansion sites. Eligible students were randomly assigned either to a program group that could participate in Higher Achievement, or to a control group that could not enroll in the program. Comparing the two groups' outcomes provided an estimate of the program's impacts. The study found that the expansion sites experienced many of the implementation challenges common to school-based, out-of-school-time programs (for example, staff turnover, coordination with the host school, and lower-than-hoped-for attendance by middle school students), as well as those often seen in new programs (such as a lack of strong relationships with key partners and difficulty recruiting volunteers). Even so, Higher Achievement was found to be at least adequately implemented in all three cities. The study found that the program's detailed lesson plans, with scripted questions and student instructions, enabled the volunteers to deliver rigorous academic lessons. This report addresses the following questions: (1) How did the Higher Achievement centers operate during the study and what lessons are there for similar programs?; (2) Did scholars receive more academic enrichment over the two-year study period than they would have received without Higher Achievement?; and (3) How did Higher Achievement impact scholars' grades and test scores over the two years since they applied?

Mission HydroSci (MHS) is a 3D game-based learning environment and curriculum that supports middle school student learning of water systems science and scientific argumentation. MHS is a rigorous, coherent and engaging 6 to 8-day curriculum with all learning activities and social interactions taking place in the virtual world and with teachers observing and supporting students through an online support system enhanced by analytics. MHS was evaluated in comparison to a high- quality alternative intervention developed by the Biological Sciences Curriculum Study (BSCS) using a stratified randomized block experimental design where 'classroom' was the unit of random assignment, stratified by teacher. The comparison curriculum is called Earth's Water Systems (EWS) and is provided online using the Canvas learning management platform. Three measurable outcomes: (1) content knowledge, (2) competency in scientific argumentation, and (3) affect for science and technology were used in the pre- post-comparison of MHS with EWS. The findings of this randomized experiment showed that MHS achieved roughly equivalent water systems learning outcomes and significantly higher development of argumentation competencies when compared to the EWS curriculum. The impacts of both MHS and the EWS curriculum on affect for science and technology were equivalent and slightly negative. A secondary exploratory quasi-experimental design (QED) analysis was conducted that found significant positive effects for MHS in comparison to EWS on water systems understandings and stronger detected effects for students' argumentation.

The period of early adolescence is characterized by dramatic changes, simultaneously affecting physiological, psychological, social, and cognitive development. The physical transition from elementary to middle school can exacerbate the stress and adversity experienced during this critical life stage. Middle school students often struggle to find social and emotional support, and many students experience a decreased sense of belonging in school, diverting students from promising academic and career trajectories. Drawing on psychological insights for promoting belonging, we fielded a brief intervention designed to help students reappraise concerns about fitting in at the start of middle school as both temporary and normal. We conducted the first district-wide double-blind experimental study of this approach with middle-school students (N=1,304). Compared to the control condition activities, the intervention reduced sixth-grade disciplinary incidents across the district by 34%, increased attendance by 12%, and reduced the number of failing grades by 18%. Differences in benefits across demographic groups were not statistically significant but some impacts were descriptively larger for historically underserved minority students and boys. A mediational analysis suggested 80% of long-term intervention effects on students' GPA were accounted for by changes in students' attitudes and behaviors. These results demonstrate the long-term benefits of psychologically reappraising stressful experiences during critical transitions and the psychological and behavioral mechanisms that support them. Furthermore, this brief intervention is a highly cost-effective and scalable approach that schools may use to help address the troubling decline in positive attitudes and academic outcomes typically accompanying adolescence and the middle school transition. [This paper was published in "Proceeedings of the National Academy of Sciences" v116 p16286-16291 2019.]

Evidence-based interventions exist for improving multiple fundamental math competencies, but delivering interventions with fidelity and within a data-driven, tiered framework is a practical challenge faced by most schools. The current study evaluated a math intervention program delivered with community-based resources via AmeriCorps. At the beginning of the school year, students in Grades 4-8 (n = 550) were randomly assigned to receive math support via the program or to a waitlist control group. Outcomes were measured with a broad-based assessment of math achievement in the winter. Results from intent-to-treat analyses showed a significant and positive effect (d = 0.17) for the program that increased slightly under optimal dosage conditions (d = 0.24). The observed results extend existing literature on math interventions in schools by illustrating the potential for partnerships between community-based organizations and schools to improve outcomes for at-risk students.

The recent wave of test-based accountability reforms has negatively impacted the provision of K-12 arts educational experiences. Advocates contend that, in addition to providing intrinsic benefits, the arts can positively influence academic and social development. However, the empirical evidence to support such claims is limited. We conducted a randomized controlled trial with 10,548 3rd-8th grade students who were enrolled in 42 schools that were assigned by lottery to receive substantial influxes of arts education experiences provided through school-community partnerships with local arts organizations, cultural institutions, and teaching-artists. We find that these increases in arts educational experiences significantly reduce the proportion of students receiving disciplinary infractions by 3.6 percentage points, improve STAAR writing achievement by 0.13 of a standard deviation, and increase students' compassion for others by 0.08 of a standard deviation. For students in elementary schools, which comprise 86 percent of the sample, we find that these arts educational experiences also significantly improve school engagement, college aspirations, and arts-facilitated empathy. These findings provide strong evidence that arts educational experiences can produce significant positive impacts on student academic and social development. Policymakers should consider these multifaceted educational benefits when assessing the role and value of the arts in K-12 schools.

This report presents the findings from an efficacy trial and process evaluation of the Parent Engagement Programme (PEP). The PEP was a school-level intervention designed to improve pupil outcomes by engaging parents in their children's learning. The programme was developed collaboratively by research teams from the University of Bristol and Harvard University and was delivered between September 2014 and July 2015. The study was conducted by the Centre for Effective Education, Queen's University Belfast between February 2014 and February 2016. The trial involved 15,697 students in Years 7, 9, and 11 from 36 English secondary schools, with schools sending an average of 30 texts to each parent over the period of the trial. The developers of the intervention managed its delivery to ensure optimal implementation. It was a cluster randomised controlled trial with randomisation at the Key Stage level, designed to determine the impact of the intervention on the academic outcomes of students in English, maths, and science, and the impact on absenteeism. A process evaluation used focus groups, telephone surveys, interviews, and an online survey to provide data on implementation and to capture the perceptions and experiences of participating parents, pupils, and teachers. Key conclusions include: (1) Children who had the intervention experienced about one month of additional progress in maths compared to other children. This positive result is unlikely to have occurred by chance; (2) Children who had the intervention had reduced absenteeism compared to other children. This positive result is unlikely to have occurred by chance; (3) Children who had the intervention appeared to experience about one month of additional progress in English compared to other children. However, analysis suggests that this finding might have been affected by bias introduced by missing data, so evaluators cannot reliably draw this conclusion. There is no evidence to suggest that the intervention had an impact on science attainment; (4) Schools embraced the programme and liked its immediacy and low cost. Many respondents felt that the presence of a dedicated coordinator would be valuable to monitor the accuracy and frequency of texts. Schools should consider whether they would be able to provide this additional resource; and (5) The vast majority of parents were accepting of the programme, including the content, frequency, and timing of texts. [Note: The post-reporting appendix was added in June 2017.]

This study examined the efficacy of a supplemental, multicomponent adolescent reading intervention for middle school students who scored below proficient on a state literacy assessment. Using a within-school experimental design, the authors randomly assigned 483 students in grades 6-8 to a business-as-usual control condition or to the Strategic Adolescent Reading Intervention (STARI), a supplemental reading program involving instruction to support word-reading skills, fluency, vocabulary, and comprehension, and peer talk to promote reading engagement and comprehension. The authors assessed behavioral engagement by measuring how much of the STARI curricular activities students completed during an academic school year, and collected intervention teachers' ratings of their students' reading engagement. STARI students outperformed control students on measures of word recognition (Cohen's d = 0.20), efficiency of basic reading comprehension (Cohen's d = 0.21), and morphological awareness (Cohen's d = 0.18). Reading engagement in its behavioral form, as measured by students' participation and involvement in the STARI curriculum, mediated the treatment effects on each of these three posttest outcomes. Intervention teachers' ratings of their students' emotional and cognitive engagement explained unique variance on reading posttests. Findings from this study support the hypothesis that (a) behavioral engagement fosters struggling adolescents' reading growth, and (b) teachers' perceptions of their students' emotional and cognitive engagement further contribute to reading competence.

Using data from seven cohorts of language immersion lottery applicants in a large, urban school district, we estimate the causal effects of immersion programs on students' test scores in reading, mathematics, and science, and on English learners' (EL) reclassification. We estimate positive intent-to-treat (ITT) effects on reading performance in fifth and eighth grades, ranging from 13 to 22 percent of a standard deviation, reflecting 7 to 9 months of learning. We find little benefit in terms of mathematics and science performance, but also no detriment. By sixth and seventh grade, lottery winners' probabilities of remaining classified as EL are three to four percentage points lower than those of their counterparts. This effect is stronger for ELs whose native language matches the partner language. [This article was published in: "American Educational Research Journal" v54 n1 suppl p282S-306S Apr 2017 (EJ1155308).]

KIPP (Knowledge is Power Program) is a national network of public charter schools whose stated mission is to help underserved students enroll in and graduate from college. Prior studies (see Tuttle et al. 2013) have consistently found that attending a KIPP middle school positively affects student achievement, but few have addressed longer-term outcomes and no rigorous research exists on impacts of KIPP schools at levels other than middle school. In this first high-quality study to rigorously examine the impacts of the network of KIPP public charter schools at all elementary and secondary grade levels, Mathematica found that KIPP schools have positive impacts on student achievement, particularly at the elementary and middle school levels. In addition, the study found positive impacts on student achievement for new entrants to the KIPP network in high school. For students continuing from a KIPP middle school, KIPP high schools' impacts on student achievement are not statistically significant, on average (in comparison to students who did not have the option to attend a KIPP high school and instead attended a mix of other non-KIPP charter, private, and traditional public high schools). Among these continuing students, KIPP high schools have positive impacts on several aspects of college preparation, including more discussions about college, increased likelihood of applying to college, and more advanced coursetaking. This report provides detailed findings and also includes the following appendices: (1) List of KIPP Schools In Network; (2) Detail on Survey Outcomes; (3) Cumulative Middle and High School Results; (4) Detailed Analytic Methods: Elementary School (Lottery-Based Analyses); (5) Detailed Analytic Methods: Middle School (Lottery-Based Analyses); (6) Understanding the Effects of KIPP As It Scales Mathematica Policy Research; (7) Detailed Analytic Methods: Middle School (Matched-Student Analyses); (8) Detailed Analytic Methods: High School (Matched-Student Analyses); (9) Detailed Analytic Methods: High School (Matched-School Analyses); and (10) Detailed Tables For What Works Clearinghouse Review. [For the executive summary, see ED560080; for the focus brief, see ED560043.]

One of the most important questions in education research is whether the gains from interventions for which perceived short-term success can be sustained. The possibility of short-lived impacts is especially relevant for research on charter schools, where charter operators who face high-stakes assessments have an incentive to "teach to the test." The fact that charters are subject to intense scrutiny and evaluation may even create incentives for cheating (Jacob and Levitt, 2003), strategic instruction (Jacob, 2007), and a focus on small groups of students that are pivotal for official accountability measures (Neal and Schanzenbach, 2010). The purpose of this paper is to assess the impact of attendance at Boston's charter high schools on outcomes where the link with human capital and future earnings seems likely to be sustained and strong. Specifically, the authors focus on outcomes that are either essential to or facilitate post-secondary schooling: high school graduation, the attainment of state competency thresholds, scholarship qualification, Advanced Placement (AP) and SAT scores, college enrollment, and college persistence. Importantly, most of these outcomes are less subject to strategic manipulation than are the state's test-based assessments. As in earlier work, the research design implemented here exploits randomized enrollment lotteries at oversubscribed charter schools. The resulting estimates are likely to provide reliable measures of average causal effects for charter applicants. Six tables are appended.

A large-scale randomized controlled trial tested the effects of researcher-developed learning games on a transfer measure of fractions knowledge. The measure contained items similar to standardized assessments. Thirty treatment and 29 control classrooms (~1500 students, 9 districts, 26 schools) participated in the study. Students in treatment classrooms played fractions games and students in the control classrooms played solving equations games. Multilevel multidimensional item response theory modeling of the outcome measure produced scaled scores that were more sensitive to the instructional treatment than standard measurement approaches. Hierarchical linear modeling of the scaled scores showed that the treatment condition performed significantly higher on the outcome measure than the control condition. The effect (d = 0.58) was medium to large (Cohen, 1992). Two appendices are included: (1) Descriptive Statistics of Pretest and Posttest Scores by Schools and Conditions; and (2) Summary of Efficacy Trial Procedures.

Teach For America (TFA) and the Teaching Fellows programs are an important and growing source of teachers of hard-to-staff subjects in high-poverty schools, but comprehensive evidence of their effectiveness has been limited. This report presents findings from the first large-scale random assignment study of secondary math teachers from these programs. The study separately examined the effectiveness of TFA and Teaching Fellows teachers, comparing secondary math teachers from each program with other secondary math teachers teaching the same math courses in the same schools. The study focused on secondary math because this is a subject in which schools face particular staffing difficulties.The study had two main findings, one for each program studied: (1) TFA teachers were more effective than the teachers with whom they were compared. On average, students assigned to TFA teachers scored 0.07 standard deviations higher on end-of-year math assessments than students assigned to comparison teachers, a statistically significant difference. This impact is equivalent to an additional 2.6 months of school for the average student nationwide; and (2) Teaching Fellows were neither more nor less effective than the teachers with whom they were compared. On average, students of Teaching Fellows and students of comparison teachers had similar scores on end-of-year math assessments. By providing rigorous evidence on the effectiveness of secondary math teachers from TFA and the Teaching Fellows programs, the study can shed light on potential approaches for improving teacher effectiveness in hard-to-staff schools and subjects. The study findings can provide guidance to school principals faced with the choice of hiring teachers who have entered the profession via different routes to certification. The findings can also aid policymakers and funders of teacher preparation programs by providing information on the effectiveness of teachers from various routes to certification that use different methods to identify, attract, train, and support their teachers. Seven appendixes present: (1) Supplementary Technical Information on Study Design and Data Collection; (2) Supplementary Information on Analytic Methods; (3) Supplementary Information on Teach For America and Teaching Fellows Programs; (4) Teach For America and Teaching Fellows Teachers Compared with Comparison Teachers by Entry Route (Alternative or Traditional); (5) Supplementary Information on Teach For America and Teaching Fellows Teachers Compared with Comparison Teachers; (6) Supplementary Analyses of the Impacts of Teach For America and Teaching Fellows Teachers; and (7) Supplementary Findings on Factors Associated with Teacher Effectiveness. (Contains 96 tables, 21 figures, and 30 footnotes.)

The Knowledge Is Power Program (KIPP) is a rapidly expanding network of public charter schools whose mission is to improve the education of low-income children. As of the 2012-2013 school year, 125 KIPP schools are in operation in 20 different states and the District of Columbia (DC). Ultimately, KIPP's goal is to prepare students to enroll and succeed in college. Prior research has suggested that KIPP schools have positive impacts on student achievement, but most of the studies have included only a few KIPP schools or have had methodological limitations. This is the second report of a national evaluation of KIPP middle schools being conducted by Mathematica Policy Research. The evaluation uses experimental and quasi-experimental methods to produce rigorous and comprehensive evidence on the effects of KIPP middle schools across the country. The study's first report, released in 2010, described strong positive achievement impacts in math and reading for the 22 KIPP middle schools for which data were available at the time. For this phase of the study, the authors nearly doubled the size of the sample, to 43 KIPP middle schools, including all KIPP middle schools that were open at the start of the study in 2010 for which they were able to acquire relevant data from local districts or states. The average impact of KIPP on student achievement is positive, statistically significant, and educationally substantial. KIPP impact estimates are consistently positive across the four academic subjects examined, in each of the first four years after enrollment in a KIPP school, and for all measurable student subgroups. A large majority of the individual KIPP schools in the study show positive impacts on student achievement as measured by scores on state-mandated assessments. KIPP produces similar positive impacts on the norm-referenced test, which includes items assessing higher-order thinking. Estimated impacts on measures of student attitudes and behavior are less frequently positive, but the authors found evidence that KIPP leads students to spend significantly more time on homework, and that KIPP increases levels of student and parent satisfaction with school. On the negative side, the findings suggest that enrollment in a KIPP school leads to an increase in the likelihood that students report engaging in undesirable behavior such as lying to or arguing with parents. These findings are described in this report. The following appendixes are included: (1) Sample selection and baseline characteristics; (2) Constructing survey outcomes; (3) Schools attended by lottery winners and lottery non-winners; (4) Analytic methods for the matched comparison group analysis; (5) Analytic methods for lottery-based analysis; and (6) Validation of matching methods using lottery-based impact estimates. (Contains 46 tables, 78 footnotes, and 16 figures.) [For "What Works Clearinghouse Quick Review: 'KIPP Middle Schools: Impacts on Achievement and Other Outcomes, Final Report,'" see ED540896.]

One crucial decision that middle schoolers (and their families) make is where they will attend high school. Many districts employ school choice systems designed to allow students to pick a high school that will meet their needs and interests. Yet most students prefer high schools that are close to home, and for youth in low-income neighborhoods, this often means attending a more disadvantaged, lower performing school (Nathanson et al. 2013). Youth who defy these odds and choose a competitive high school instead have much to gain. Cullen et al. (2005), for instance, found that Chicago public middle school students who chose to attend a higher-achieving high school were substantially more likely to graduate. However, even as eighth graders, these students already differed in many ways from their peers who chose a neighborhood school--they had better self-reported grades and higher expectations for the future, felt more prepared for high school, and were more likely to have spoken with their parents about what school to attend. These findings raise the question of how we can prepare more disadvantaged students to take the many steps necessary-throughout the middle school years-to successfully transition to a competitive, high-quality high school that can ultimately launch them toward college and careers. The Washington, DC-based Higher Achievement program is taking on this challenge. Higher Achievement targets rising fifth and sixth graders from "at-risk communities" and serves them throughout the middle school years. Its goal is to strengthen participants' academic skills, attitudes and behaviors, reinforce high aspirations and help students and their families navigate the process of applying to and selecting a high-quality high school. In 2006, the authors began a comprehensive multi-year evaluation of Higher Achievement to test its impact on participants' academic performance, attitudes and behaviors and on their high school enrollment. The evaluation used random assignment-the most rigorous design available to researchers-to assess program impacts. This brief summarizes the study's findings. Findings suggest that the program does appear to expand the options available to its students by making them more likely to apply to and attend private schools and less likely to apply to and attend weaker public magnet and charter schools. This, in turn, may position youth for better outcomes in high school and beyond. [This research was made possible by grants from The Atlantic Philanthropies, Bank of America, the Smith Richardson Foundation, the Spencer Foundation, The Wallace Foundation and the William T. Grant Foundation.]

One way to improve struggling schools' access to effective teachers is to use selective transfer incentives. Such incentives offer bonuses for the highest-performing teachers to move into schools serving the most disadvantaged students. In this report, we provide evidence from a randomized experiment that tested whether such a policy intervention can improve student test scores and other outcomes in low-achieving schools. The intervention, known to participants as the Talent Transfer Initiative (TTI), was implemented in 10 school districts in seven states. The highest-performing teachers in each district--those who ranked in roughly the top 20 percent within their subject and grade span in terms of raising student achievement year after year (an approach known as value added)--were identified. These teachers were offered $20,000, paid in installments over a two-year period, if they transferred into and remained in designated schools that had low average test scores. The main findings from the study include: (1) The transfer incentive successfully attracted high value-added teachers to fill targeted vacancies; (2) The transfer incentive had a positive impact on test scores (math and reading) in targeted elementary classrooms; and (3) The transfer incentive had a positive impact on teacher-retention rates during the payout period; retention of the high-performing teachers who transferred was similar to their counterparts in the fall immediately after the last payout. Seven appendixes are included: (1) Supplemental Materials for Chapters I and II; (2) Value-Added Analysis to Identify Highest-Performing Teachers; (3) Supplemental Materials for Chapter III; (4) Identification of Focal Teachers; (5) Supplemental Materials for Chapter IV; (6) Supplemental Materials for Chapter V; and (7) Supplemental Materials for Chapter VI. (Contains 114 footnotes, 61 figures, and 92 tables.) [For the executive summary, see ED544268.]

This report presents the results of an experiment conducted in Alabama beginning in the 2006/07 school year, to determine the effectiveness of the Alabama Math, Science, and Technology Initiative (AMSTI), which aims to improve mathematics and science achievement in the state's K-12 schools. This study is the first randomized controlled trial testing the effectiveness of AMSTI in improving mathematics problem solving and science achievement in upper-elementary and middle schools. AMSTI is an initiative specific to Alabama and was developed and supported through state resources. An important finding is the positive and statistically significant effect of AMSTI on mathematics achievement as measured by the SAT 10 mathematics problem solving assessment administered by the state to students in grades 4-8. After one year in the program, student mathematics scores were higher than those of a control group that did not receive AMSTI by 0.05 standard deviation, equivalent to 2 percentile points. Nine of the 10 sensitivity analyses yielded effect estimates that were statistically significant at the 0.025 level, consistent with the main finding. The estimated effect of AMSTI on science achievement measured after one year was not statistically significant. Based on the SAT 10 science test administered by the state to students in grades 5 and 7, no difference between AMSTI and control schools could be discerned after one year. Changes in classroom instructional strategies, especially an emphasis on more active-learning strategies, are important to the AMSTI theory of action. Therefore, a secondary investigation of classroom practices was conducted, based on data from survey responses from teachers. For both mathematics and science, statistically significant differences were found between AMSTI and control teachers in the average reported time spent using the strategies. The effect of AMSTI on these instructional strategies was 0.47 standard deviation in mathematics and 0.32 standard deviation in science. Two years of AMSTI appeared to have a positive and statistically significant effect on achievement in mathematics problem solving, compared to no AMSTI. Two years of AMSTI appeared to have a positive and statistically significant effect on achievement in science. AMSTI appeared to have a positive and statistically significant effect on reading achievement as measured by the SAT 10 test of reading administered by the state to students in grades 4-8. AMSTI did not appear to have a statistically significant effect on teacher-reported content knowledge in mathematics or science after one year. AMSTI did not appear to have statistically significant differential effects on student achievement in mathematics problem solving or science based on racial/ethnic minority status, enrollment in the free or reduced-price lunch program, gender, or pretest level. Appended are: (1) Explanation of primary and secondary confirmatory outcome measures; (2) Explanation of exploratory research questions; (3) Selection and random assignment of schools; (4) Statistical power analysis; (5) Data collection procedures and timeline; (6) Description of program implementation data collected but not used in report; (7) Alabama Math, Science, and Technology Initiative (AMSTI) teacher survey #3; (8) Data cleaning and data file construction; (9) Attrition through study stages for samples used in the confirmatory analysis; (10) Description of degree rank; (11) Equivalence of Year 1 baseline and analyzed samples for confirmatory student-level and classroom practice outcomes; (12) Internal consistency and validity of active learning measures; (13) Number of students and teachers in schools in analytic samples used to analyze Year 1 confirmatory questions; (14) Attrition through study stages for samples used in Year 1 exploratory analysis; (15) Tests of equivalence for baseline and analytic samples for Year 1 exploratory outcomes; (16) Statistical power analyses for moderator analyses; (17) Derivation and motivation of the Bell-Bradley estimator when measuring estimated two-year effect of the Alabama Math, Science, and Technology Initiative (AMSTI); (18) Attrition through study stages for samples contributing to estimation of two-year effects; (19) Examination of equivalence in baseline and analytic samples used in the estimation of two-year effects; (20) Estimation model for two-year effects of the Alabama Math, Science, and Technology Initiative (AMSTI); (21) Topics and instructional methods used at the Alabama Math, Science, and Technology Initiative (AMSTI) summer institute; (22) Parameter estimates on probability scale for odds-ratio tests of differences between Alabama Math, Science, and Technology Initiative (AMSTI) and control conditions in Year 1 (associated with summer professional development and in-school support outcomes); (23) Descriptive statistics for variables that change to a binary scale used in the Alabama Math, Science, and Technology Initiative (AMSTI) and control conditions in Year 1; (24) Comparison of assumed parameter values and observed sample statistics for statistical power analysis after one year; (25) Parameter estimates for Stanford Achievement Test Tenth Edition (SAT 10) mathematics problem solving after one year; (26) Parameter estimates for Stanford Achievement Test Tenth Edition (SAT 10) science after one year; (27) Parameter estimates for active learning in mathematics after one year; (28) Parameter estimates for active learning in science after one year; (29) Sensitivity analyses of effect of the Alabama Math, Science, and Technology Initiative (AMSTI) on Stanford Achievement Test Tenth Edition (SAT 10) mathematics problem solving achievement after one year; (30) Sensitivity analyses of effect of the Alabama Math, Science, and Technology Initiative (AMSTI) on Stanford Achievement Test Tenth Edition (SAT 10) science achievement after one year; (31) Sensitivity analyses of effect of the Alabama Math, Science, and Technology Initiative (AMSTI) on active learning instructional strategies in mathematics classrooms after one year; (32) Sensitivity analyses of effect of the Alabama Math, Science, and Technology Initiative (AMSTI) on active learning instructional strategies in science classrooms after one year; (33) Tests for violations of factors associated with assumption of equal first year effects on students in Alabama Math, Science, and Technology Initiative (AMSTI) and control schools; (34) Post hoc adjustment to standard error for estimate of two-year effect of the Alabama Math, Science, and Technology Initiative (AMSTI) on mathematics achievement after two years; (35) Parameter estimates for effect of the Alabama Math, Science, and Technology Initiative (AMSTI) after two years; (36) Parameter estimates for effect of the Alabama Math, Science, and Technology Initiative (AMSTI) on student reading achievement after one year; (37) Parameter estimates for teacher content and student engagement after one year; (38) Estimates of effects for terms involving the indicator of treatment status in the analysis of the moderating effect of the three-level pretest variable; (39) Parameter estimates for the analysis of the moderating effect of racial/ethnic minority status on the impact of the Alabama Math, Science, and Technology Initiative (AMSTI) on reading after one year; (40) Parameter estimates for analysis of average effect of the Alabama Math, Science, and Technology Initiative (AMSTI) on reading by racial/ethnic minority students after one year; and (41) Parameter estimates for effect of the Alabama Math, Science, and Technology Initiative (AMSTI) on reading for White students after one year. (Contains 26 figures, 136 tables, 1 box and 130 footnotes.)

The Louisiana Striving Readers evaluation assessed the implementation and effectiveness of the Voyager "Passport Reading Journeys" (PRJ), a widely used supplemental literacy intervention for struggling adolescent readers that reflects the research-based practices recommended by the National Reading Panel (2000) and other more recent syntheses (Biancarosa & Snow, 2004; Edmonds, et al., 2009; Kamil, et al., 2008; Scammacca et al., 2007; Torgesen et al., 2007). To date, PRJ has been adopted in 45 states across the country in almost 470 districts and over 2,200 schools, and has served over 268,000 students. PRJ offers four levels of instruction appropriate for middle and high school students. The PRJ curriculum uses direct, explicit instruction in reading comprehension, vocabulary, and word study for adolescents who struggle with reading using age-appropriate fiction and non-fiction texts. The Louisiana Striving Readers Program, funded by the Louisiana Department of Education (LDOE) through a grant from the U.S. Department of Education, targeted over 1,200 struggling readers in grades 6-7 from ten middle schools across the state of Louisiana. The grant required a rigorous, independent experimental evaluation, conducted by SEDL, addressing fidelity of program implementation and program impacts on student motivation and reading achievement. The study reported here had two specific aims: (1) determine the fidelity of implementation, or the extent to which the program was delivered as the grant indicated it should be implemented; and (2) determine the impacts of PRJ on student reading and other related outcomes (i.e., student motivation and engagement in reading) and how the effects may have varied by student subgroups. This report details the intervention, the implementation study design and results, and the impact study design and results.

This study estimates the effect of one year of Fusion Reading implementation, a multistrategy intervention, builds on the work of the Strategic Instruction Model's Learning Strategies Curriculum and Xtreme Reading by integrating some of the same strategies (e.g., paraphrasing, visual imagery, and self-questioning for information acquisition; mnemonics for information study; and writing and error monitoring for information expression), focusing on reading, and extending the time frame from 1 to 2 years in duration. Specifically, the study addressed the following: (1) What are the intent-to-treat impacts of the Fusion Reading intervention on the reading outcomes and motivation to read of struggling readers after receipt of 1 year of the intervention?; (2) For which students are the interventions most and least effective?; and (3) In what ways are implementation factors associated with impacts (or lack of impacts) on reading and motivation outcomes? The authors conducted a randomized controlled trial to estimate the effect of Fusion Reading on struggling readers in grades 6 through 10. Students in the intervention condition received the Fusion Reading intervention as a supplemental reading intervention in the 2010-11 school year, whereas students in the control condition engaged in nonliteracy, "business-as-usual" activities. After one year of implementation of a two year intervention, the authors learned that when vocabulary, paraphrasing and word study strategies are explicitly taught by following a specific instructional routine supported by motivation strategies (e.g., setting goals and reading text relevant for the age group), word reading outcomes will significantly improve compared to control middle and high school students. Future research is needed to fully understand whether the intended two year intervention will improve struggling adolescent's reading comprehension outcomes. Appended are: (1) References; and (2) Tables and Figures. (Contains 2 figures and 5 tables.)

American Institutes for Research (AIR) conducted an evaluation of the effect on struggling readers of implementing the READ 180 reading intervention in five participating schools in Milwaukee Public Schools (MPS) under a Striving Readers grant from the U.S. Department of Education. The evaluation used an experimental design in order to produce a rigorous estimate of the impact of the READ 180 intervention on measures of reading achievement for struggling students. The evaluation also explored implementation fidelity and the contexts and conditions of implementation that may extend or limit the intervention's effects. To measure program impact on students' academic performance in reading, AIR analyzed student achievement data collected from the Northwest Evaluation Association (NWEA) Measures of Academic Progress (MAP) benchmark assessment. AIR also administered a student survey to assess the impact on student engagement and self-efficacy for reading. This report asked the following research questions: (1) Does the READ 180 reading intervention improve students' academic performance in reading?; (2) With what fidelity did the program implement the professional development model and what factors mediated the level of implementation?; and (3) With what fidelity did classroom intervention teachers implement READ 180 and what factors mediated the level of implementation?

Domestic attempts to use financial incentives for teachers to increase student achievement have been ineffective. In this paper, we demonstrate that exploiting the power of loss aversion--teachers are paid in advance and asked to give back the money if their students do not improve sufficiently--increases math test scores between 0.201 (0.076) and 0.398 (0.129) standard deviations. This is equivalent to increasing teacher quality by more than one standard deviation. A second treatment arm, identical to the loss aversion treatment but implemented in the standard fashion, yields smaller and statistically insignificant results. This suggests it is loss aversion, rather than other features of the design or population sampled, that leads to the stark differences between our findings and past research.

This study reports Year 1 findings from a multisite cluster randomized controlled trial of a cognitive strategies approach to teaching text-based analytical writing for mainstreamed Latino English language learners (ELLs) in 9 middle schools and 6 high schools. There were 103 English teachers stratified by school and grade and then randomly assigned to the Pathway Project professional development intervention or control group. The Pathway Project trains teachers to use a pretest on-demand writing assessment to improve text-based analytical writing instruction for mainstreamed Latino ELLs who are able to participate in regular English classes. The intervention draws on well-documented instructional frameworks for teaching mainstreamed ELLs. Such frameworks emphasize the merits of a cognitive strategies approach that supports these learners' English language development. Pathway teachers participated in 46 hrs of training and learned how to apply cognitive strategies by using an on-demand writing assessment to help students understand, interpret, and write analytical essays about literature. Multilevel models revealed significant effects on an on-demand writing assessment (d = 0.35) and the California Standards Test in English language arts (d = 0.07). (Contains 1 figure, 7 tables and 4 footnotes.)

This report summarizes the findings from a national evaluation of mentoring programs funded under the U.S. Department of Education's Student Mentoring Program. The impact evaluation used an experimental design in which students were randomly assigned to a treatment or control group. Thirty-two purposively selected School Mentoring Programs and 2,573 students took part in the evaluation, which estimated the impact of the programs over one school year on a range of student outcomes. The evaluation also describes the characteristics of the program and the mentors, and provides information about program delivery. The Student Mentoring Program is designed to fund grantees to enable them to provide mentoring to at-risk students in grades 4-8. The ultimate goal of the program is to improve student academic and behavioral outcomes through the guidance and encouragement of a volunteer mentor. Seventeen total impacts in the domains of academic achievement/engagement, interpersonal relationships/personal responsibility, and high-risk/delinquent behavior were measured. The main finding of the Impact Study was that there were no statistically significant impacts of the Student Mentoring Program for the sample as a whole on this array of student outcomes. However, there was some scattered evidence that impacts were heterogeneous across types of students. In particular, impacts on girls were statistically significantly different from impacts on boys for two self-reported scales: Scholastic Efficacy and School Bonding, and Pro-social Behaviors. For boys, the impact on Prosocial Behaviors was negative and statistically significant. For girls, the impact on Scholastic Efficacy and School Bonding was positive and statistically significant. The impact on truancy was negative and statistically significant for students below age 12. There were negative associations between program supervision of mentors and site-level impacts on three of the seventeen individual outcome measures: Pro-social Behaviors, grades in math and social studies, and a positive relationship with the outcome of school-reported delinquency. The report also presented results demonstrating that the Student Mentoring Program represented a fairly low level of intensity in terms of service: although grantees, on average, adhered to the general intents of the legislation and program guidance, they were simultaneously constrained by the limits of the school calendar and the population from which to draw mentors. Thirty-five percent of the control group students reported receiving mentoring either from the program or elsewhere in the community; this finding, coupled with the fact that not all treatment group students met with a mentor, reduced the treatment contrast and may have led to some dilution of the impacts on students compared to expectations. Seven appendices are included; (1) Sampling Design and Methodology; (2) Survey Instruments; (3) Construction of Student Outcome Measures; (4) Impact Analysis Results on Original Student Survey Scales and Measures; (5) Sensitivity Tests; (6) Standard Errors and Confidence Intervals of Main Effects; and (7) Site-Level Predictors and Impacts. (Contains 109 footnotes and 122 exhibits.) ["Impact Evaluation of the U.S. Department of Education's Student Mentoring Program. Final Report" was written with the assistance of Christine Dyous, Michelle Klausner, Nancy McGarry, Rachel Luck and William Rhodes.]

This project entailed a three-year efficacy evaluation of the Computer and Team Assisted Mathematical Acceleration (CATAMA) Lab developed by the Center for Social Organization of Schools at Johns Hopkins University. The CATAMA Lab was proposed as an immediate and practical approach to addressing the different types of math deficits held by students at urban high-poverty schools. The Lab required only 1 teacher per school reducing staff and professional development requirements. It used multiple instructional techniques (including individualized computer instruction, direct instruction, pair and team learning, and individual instruction) to teach math concepts and skills. By taking the place of an elective it allowed students to continue with their on-grade math class. For a more detailed description of the Lab see Appendix 2. The original goal of the project was to establish the Lab at three urban schools serving high-poverty high-minority middle grade students (grades 5-8). Students underperforming in mathematics (as established by district standardized tests) were to take a trimester course of study in the Lab to increase their knowledge of math concepts and skills taught by a regular math teacher receiving extensive ongoing professional development. Students were to take the Lab as an elective course while continuing with their regular math class. From each school's pool of students eligible to participate, students were to be randomly assigned to take the Lab. An implementation analysis was to measure the teaching of the concepts and skills to be taught in the Lab. To evaluate the impact of the intervention, students' math achievement, as measured by standardized math tests, was to be compared to eligible students not assigned to the Lab. This report discusses the project in three sections: (1) A comparison of the actual project with the planned project; (2) The descriptive results from the project; (a) Description of the sample; (b) Description of implementation of the CATAMA Lab; and (3) The evaluative results from the project.

This cluster randomized controlled trial evaluated the efficacy of the CHAMPS classroom management program on the social behavioral and academic outcomes of a large diverse sample of middle school students within an urban context. Participants included 102 teachers and 1,450 students in sixth to eighth grade. Two-level hierarchical linear models (HLM) were conducted to examine the overall treatment effects on student behavior and academic outcomes. In addition, mediation analyses examined a hypothesized putative mechanism for observed academic outcomes. Findings indicated that CHAMPS improved teacher ratings of student concentration problems (d = -0.18) and classwork completion (d = 0.18), observed student time-on-task (d = 0.16), and student scores on broad English (d = 0.14), and math problem solving (d = 0.17) academic achievement tests. Null effects were observed for student prosocial and disruptive behaviors and self-regulation skills as well as reading comprehension and broad math achievement performance. Main effects on the English achievement test scores were partially mediated by student improvements in observed time-on-task. Practical significance of the findings and implications for schools and policymakers are discussed.

"G[superscript 2]ROW STEM" is an Investing in Innovation (i3) development grant funded by the Office of Innovation and Improvement, U.S. Department of Education. "G[superscript 2]ROW STEM" targets high-need middle school students, particularly females and minorities, that tend to be underrepresented in STEM careers. "G[superscript 2]ROW STEM" focuses on providing students with engaging, hands-on, project-based, extended-learning experiences to inspire interest in STEM and improve achievement. The impact evaluation used a quasi-experimental design (QED) to examine the effect of "G[superscript 2]ROW STEM" on academic achievement in science and math. "G[superscript 2]ROW STEM" student enrollment began during the 2016-17 school year and students were followed for three years, through the 2018-19 school year. Academic achievement outcomes for "G[superscript 2]ROW STEM" students were compared to a matched sample of students within the same grade in the same schools who participated in business-as-usual, traditional academic instruction with no extended learning experiences. Academic achievement for comparison students was also tracked over a three-year period. Results showed statistically significant differences between treatment and comparison groups in achievement test scores across both math and science. Overall, treatment students gained seven NCE score points more than the comparison group students did after up to three years in the "G[superscript 2]ROW STEM" program. This is roughly equivalent to one-third of a standard deviation. Significant differences were also noted for student subgroups with non-minority students realizing slightly higher gains in NCE scores than minority students by the end of the program (over all analyses a difference of 2.25 NCE points).

In 2013, the NYC Leadership Academy (NYCLA) developed a leadership intervention--the Targeted Intensive School Support (TISS) program--in collaboration with the New York City Department of Education (NYC DOE) to support schools that were facing particular challenges. NYCLA asked the RAND Corporation to provide an independent evaluation of the program's implementation and effects, and those findings are detailed in this report. The TISS program consisted of five key components: (1) teaming and collaborative training in aligned preservice preparation programs for a principal and assistant principal (AP); (2) coplacement of a principal and AP into an NYC DOE school; (3) team-based coaching to support the principal and AP; (4) 328 hours of extended coaching over the first three years after placement; and (5) use of a diagnostic process to guide goal setting and coaching according to school needs. Implementation findings suggest that only two of the five key components were implemented with fidelity. A propensity weighting approach was used to compare schools with TISS principals to other schools with new principals trained through residency-based preservice programs who did not participate in TISS. Findings suggest no statistically significant differences between TISS schools and comparison schools on measures of student achievement, school culture, and principal retention. TISS schools underperformed relative to comparison schools on the measure of chronic student absenteeism. [Sponsored by NYC Leadership Academy through a subgrant from the U.S. Department of Education.]

With the launch of the New York City Community Schools Initiative (NYC-CS) in 2014, the New York City Department of Education (NYCDOE) has increased its focus on the implementation of a holistic strategy of education reform to address the social consequences of poverty as a means to improving student outcomes. NYC-CS is a strategy to organize resources in schools and share leadership among stakeholders so that academics, health and wellness, youth development, and family engagement are integrated into the fabric of each school. New York City is implementing this strategy at a scale unmatched nationally. In this study, the authors assessed the impact of the NYC-CS through the 2017-2018 school year. The authors assessed the effects along seven outcome domains and explored the extent to which there is heterogeneity in programmatic impact based on student- and school-level characteristics. The authors leveraged innovative quasi-experimental methodology to determine whether students in the community schools are performing better than they would be had their schools not been designated as Community Schools. The findings of this report will contribute to the emerging evidence base on the efficacy of the community school strategy and will be useful for other school district- and state-level policymakers interested in developing or refining similar interventions that support students' and communities' academic, social, and emotional well-being. [The research described in this report was prepared for the New York City Mayor's Office for Economic Opportunity (NYC Opportunity).]

A growing body of research points to the ways in which principals influence teachers, classrooms, and, ultimately, student achievement. New Leaders aims to prepare transformational school leaders by partnering with districts and charter schools to offer rigorous, research-based training for aspiring principals. The Aspiring Principals program is New Leaders' signature program and has three core features: selective recruitment and admission, training and endorsement, and support for principals early in their tenure. This report is a follow-up to the 2014 evaluation of New Leaders' Aspiring Principals program. Focusing on the revised program, which was first implemented in 2012, the authors present evidence of the effectiveness of the revised Aspiring Principals program and share lessons that can inform principal-preparation policy and practice. To assess the effect of New Leaders' Aspiring Principals program, researchers analyzed whether schools and students led by graduates of the program outperformed comparison schools and students in the same district, focusing on student achievement and principal retention. They also examined program graduate placement and satisfaction with the Aspiring Principals program. [For the appendixes, see ED605724.]

The three-tiered Positive Behavioral Interventions and Supports (PBIS) framework promotes the development of systems and data analysis to guide the selection and implementation of evidence-based practices across multiple tiers. The current study examined the effects of universal (tier 1) or school-wide PBIS (SW-PBIS) in one state's scale-up of this tier of the framework. Annual propensity score weights were generated to examine the longitudinal effects of SW-PBIS from 2006-07 through 2011-12. School-level archival and administrative data outcomes were examined using panel models with an autoregressive structure. The sample included 1,316 elementary, middle, and high schools. Elementary schools trained in SW-PBIS demonstrated statistically significantly lower suspensions during the fourth and fifth study years (i.e., small effect size) and higher reading and math proficiency rates during the first two study years as well as in one and two later years (i.e., small to large effect sizes), respectively. Secondary schools implementing SW-PBIS had statistically significantly lower suspensions and truancy rates during the second study year and higher reading and math proficiency rates during the second and third study years. These findings demonstrate medium effect sizes for all outcomes except suspensions. Given the widespread use of SW-PBIS across nearly 26,000 schools in the U.S., this study has important implications for educational practices and policies. [This paper was published in the "Journal of School Psychology" v73 p41-55 Apr 2019 (ISSN 0022-4405).]

Across the country, school districts, their stakeholders, and policymakers have become increasingly concerned about suspensions, particularly about suspending students from elementary school and disproportionately suspending ethnic/racial minority students. Suspended students are less likely to graduate, possibly because they miss the instructional time they need to advance academically. Restorative practices have gained buy-in in the education community as a strategy to reduce suspension rates. Proactively improving relationships among students and staff and building a sense of community in classrooms and schools may make students less inclined to misbehave. And addressing severe misbehavior through a restorative approach may help students realize the impacts of their actions and make them less likely to offend again. This study of the implementation of restorative practices in the Pittsburgh Public Schools district (PPS) in school years 2015-16 and 2016-17 represents one of the first randomized controlled trials of the effects of restorative practices on classroom and school climates and suspension rates. The authors examined a specific restorative practices program -- the International Institute for Restorative Practices' SaferSanerSchools™ Whole-School Change program -- implemented in a selected group of PPS schools under a program called Pursuing Equitable and Restorative Communities, or PERC. The researchers found that PERC achieved several positive effects, including an improvement in overall school climates (as rated by teachers), a reduction in overall suspension rates, and a reduction in the disparities in suspension rates between African American and white students and between low- and higher-income students. Key Findings: Effects of the Pursuing Equitable and Restorative Communities (PERC) program in Pittsburgh Public Schools: (1) Implementation of restorative practices through PERC improved overall school climates, as rated by teachers; (2) Implementation of restorative practices reduced the average suspension rate: During the study period, average suspension rates decreased in both PERC and non-PERC schools, but rates decreased more in PERC schools; (3) Suspension rates of African American students and of those from low-income families also went down in PERC schools, shrinking the disparities in suspension rates between African American and white students and between low- and higher-income students; (4) Academic outcomes did not improve in PERC schools, and actually worsened for grades 6-8; and (5) Arrest rates among PERC schools did not decrease. Recommendations: (1) Given the constraints on teachers' time, emphasize restorative practices that can be woven into the school day; (2) Ensure that school leaders understand and can model restorative practices, including by providing mandatory professional development, books and other materials, and coaching on restorative practices; (3) Establish a mechanism for school staff to meet at least once per month as a professional learning community on restorative practices; (4) Ensure that leaders at the district level can coordinate this work; (5) Set, and update, clear expectations regarding the use of restorative practices; and (6) Implement data collection systems to collect accurate information on all types of behavioral incidents and remedies.

Although several studies have documented the effects of statewide private school choice programs on student test scores, this report is the first to examine the effects of one of these programs on college enrollment and graduation. Using data from the Florida Tax Credit (FTC) Scholarship program, we find that low-income Florida students who attended private schools using an FTC scholarship enrolled in and graduated from Florida colleges at a higher rate than their public school counterparts. [Additional support for this study was provided by the Bill and Susan Oberndorf Foundation and Kate and Bill Duhamel.]

Playground Physics is a technology-based application and accompanying curriculum designed by New York Hall of Science (NYSCI) to support middle school students' science engagement and learning of force, energy, and motion. The program includes professional development, the Playground Physics app, and a curriculum aligned with New York State Learning Standards, Common Core State Standards, and Next Generation Science Standards. The iOS app allows students to record and review videos through three "lenses": (1) motion; (2) force (Newton's third law); and (3) energy, and the curriculum integrates informal and formal, inquiry-based learning strategies to promote greater student knowledge and understanding of physics. The program was designed to be implemented in a formal school setting during the regular school day. This report describes the results of an experimental study of the Playground Physics program's impact on learning of physics concepts, student engagement, and science-related attitudes. Sixty New York City middle grade teachers were randomly assigned to treatment or control conditions. Treatment teachers were asked to participate in Playground Physics professional development and use Playground Physics as part of their physics instruction during the 2015-16 academic year; control teachers were asked to use their regular instruction. In total, 15 teachers left the study. The final sample included student data from 24 treatment teachers and 21 control teachers. The following are appended: (1) Playground Physics Curriculum Activities; (2) Student Outcome Measures; (3) Teacher Survey; (4) Impact Analysis Technical Approach; (5) Output from Statistical Models; (6) Knowledge Assessment Responses and Standards Alignment; (7) 2014-15 Fidelity of Implementation Analysis; and (8) Supplemental Analysis.

We study the effectiveness of teachers certified by the National Board for Professional Teaching Standards (NBPTS) in Washington State, which has one of the largest populations of National Board-Certified Teachers (NBCTs) in the nation. Based on value-added models in math and reading, we find that NBPTS-certified teachers are about 0.01-0.05 student standard deviations more effective than non-NBCTS with similar levels of experience. Certification effects vary by subject, grade level, and certification type, with greater effects for middle school math certificates. We find mixed evidence that teachers who pass the assessment are more effective than those who fail, but that the underlying NBPTS assessment score predicts student achievement.

Behavioral trajectories during middle childhood are predictive of consequential outcomes later in life (e.g., substance abuse, violence). Social and emotional learning (SEL) programs are designed to promote trajectories that reflect both growth in positive behaviors and inhibited development of negative behaviors. The current study used growth mixture models to examine effects of the "Positive Action" program (PA) on behavioral trajectories of social-emotional and character development (SECD) and misconduct using data from a cluster-randomized trial that involved 14 schools and a sample of predominately low-income, urban youth followed from 3rd through 8th grade. For SECD, findings indicated that PA was similarly effective at improving trajectories within latent classes characterized as "High/declining" and "Low/stable". Favorable program effects were likewise evident to a comparable degree for misconduct across observed latent classes that reflected "Low/rising" and "High/rising" trajectories. These findings suggest that PA and perhaps other school-based universal SEL programs have the potential to yield comparable benefits across subgroups of youth with differing trajectories of positive and negative behaviors, making them promising strategies for achieving the intended goal of school-wide improvements in student outcomes. [This paper was published in "Prevention Science" v18 p214-224 2017.]

My Teaching Partner-Secondary (MTP-S) is a web-mediated coaching intervention, which an initial randomized trial, primarily in middle schools, found to improve teacher-student interactions and student achievement. Given the dearth of validated teacher development interventions showing consistent effects, we sought to both replicate and extend these findings with a modified version of the program in a predominantly high school population, and in a more urban, sociodemographically diverse school district. MTP-S produced substantial gains in student achievement across 86 secondary school classrooms involving 1,194 students. Gains were robust across subject areas and equivalent to moving the average student from the 50th to the 59th percentile in achievement scores. Results suggest that MTP-S can enhance student outcomes across diverse settings and implementation modalities.

The purpose of this study was to evaluate the impact of Achieve3000, a differentiated online literacy curriculum, on students' scores on the California State Test (CST). In the 2011-12 school year, 1,957 students in Chula Vista began using Achieve3000's solutions in 3rd through 8th grade. Using a form of propensity score matching called Inverse Probability-of-Treatment Weighting (IPTW), the researchers assigned weights for the likelihood that students in the non-user comparison group (N = 7,598) could have been in the Achieve3000 treatment group. A Weighted Least Squares (WLS) regression model with IPTW weights estimated the average treatment effect. The researchers found that, overall, the students assigned to Achieve3000 performed statistically significantly higher on the CST, by 2.4 points, than students who were not using these solutions. This suggests the program is effective in improving student learning over conventional classroom activities in the first year of use, however more data is needed to determine the long term impact of usage. Five appendices contain supplemental tables and figures.

KIPP (Knowledge is Power Program) is a national network of public charter schools whose stated mission is to help underserved students enroll in and graduate from college. Prior studies (see Tuttle et al. 2013) have consistently found that attending a KIPP middle school positively affects student achievement, but few have addressed longer-term outcomes and no rigorous research exists on impacts of KIPP schools at levels other than middle school. In this first high-quality study to rigorously examine the impacts of the network of KIPP public charter schools at all elementary and secondary grade levels, Mathematica found that KIPP schools have positive impacts on student achievement, particularly at the elementary and middle school levels. In addition, the study found positive impacts on student achievement for new entrants to the KIPP network in high school. For students continuing from a KIPP middle school, KIPP high schools' impacts on student achievement are not statistically significant, on average (in comparison to students who did not have the option to attend a KIPP high school and instead attended a mix of other non-KIPP charter, private, and traditional public high schools). Among these continuing students, KIPP high schools have positive impacts on several aspects of college preparation, including more discussions about college, increased likelihood of applying to college, and more advanced coursetaking. This report provides detailed findings and also includes the following appendices: (1) List of KIPP Schools In Network; (2) Detail on Survey Outcomes; (3) Cumulative Middle and High School Results; (4) Detailed Analytic Methods: Elementary School (Lottery-Based Analyses); (5) Detailed Analytic Methods: Middle School (Lottery-Based Analyses); (6) Understanding the Effects of KIPP As It Scales Mathematica Policy Research; (7) Detailed Analytic Methods: Middle School (Matched-Student Analyses); (8) Detailed Analytic Methods: High School (Matched-Student Analyses); (9) Detailed Analytic Methods: High School (Matched-School Analyses); and (10) Detailed Tables For What Works Clearinghouse Review. [For the executive summary, see ED560080; for the focus brief, see ED560043.]

New Leaders is a nonprofit organization with a mission to ensure high academic achievement for all students by developing outstanding school leaders to serve in urban schools. Its premise is that a combination of preparation and improved working conditions for principals, especially greater autonomy, would lead to improved student outcomes. Its approach involves both preparing principals and partnering with school districts and charter management organizations (CMOs) to improve the conditions in which its highly trained principals work. As part of the partnerships, New Leaders agrees to provide carefully selected and trained principals who can be placed in schools that need principals and to provide coaching and other support after those principals are placed. The districts and CMOs agree to establish working conditions that support, rather than hinder, the principals' efforts to improve student outcomes. This report describes how the New Leaders program was implemented in partner districts, and it provides evidence of the effect that New Leaders has on student achievement. [The research in this report was produced within RAND Education. For the appendices that accompany this report, see ED561154. For the research brief, "Principal Preparation Matters: How Leadership Development Affects Student Achievement. Research Brief," see ED561155.]

The current teacher workforce is younger, less experienced, more likely to turnover, and more diverse in preparation experiences than the workforce of two decades ago. Research shows that inexperienced teachers are less effective, but we know little about the effectiveness of teachers with different types of preparation. In this study, we classify North Carolina public school teachers into "portals"--fixed and mutually exclusive categories that capture teachers' formal preparation and qualifications upon first entering the profession--and estimate the adjusted average test score gains of students taught by teachers from each portal. Compared with undergraduate-prepared teachers from in-state public universities, (a) out-of-state undergraduate-prepared teachers are less effective in elementary grades and high school, (b) alternative entry teachers are less effective in high school, and (c) Teach For America corps members are more effective in STEM subjects and secondary grades.

Expeditionary Learning (EL) is a growing provider of curriculum and professional development services to teachers and school leaders. The EL model combines an interdisciplinary instructional approach with ongoing training and coaching for teachers and school leaders. The EL curriculum uses an experiential approach in which students conduct research projects to share with outside audiences. Learning expeditions--case-studies of academic topics--often bring together teachers from different subjects to coordinate shared projects; this curriculum includes several elements that are closely aligned with the Common Core standards for English-language arts and literacy. As of the 2010-2011 school year, EL's network included a total of 161 schools in 30 states. This report presents findings from the first rigorous study of the impacts of EL schools. This research aims to use the best available quasi-experimental methods to estimate the impacts of five urban EL middle schools on students' reading and math test scores. Using the study's data on student characteristics, the report also provides additional descriptive information on the types of students who enroll in EL schools. [The report was submitted to Expeditionary Learning.]

This is the final report in a five-year evaluation of the Milwaukee Parental Choice Program (MPCP). This report features analyses of student achievement growth four years after the authors carefully assembled longitudinal study panels of MPCP and Milwaukee Public Schools (MPS) students in 2006-07. The MPCP, which began in 1990, provides government-funded vouchers for low-income children to attend private schools in the City of Milwaukee. The maximum voucher amount in 2010-11 was $6,442, and 20,996 children used a voucher to attend either secular or religious private schools. The MPCP is the oldest and largest urban school voucher program in the United States. This evaluation was authorized by 2005 Wisconsin Act 125, which was enacted in 2006. The primary purpose of the evaluation is twofold: 1) to analyze the effectiveness of the MPCP in promoting growth in student achievement as compared to MPS; and 2) to examine the educational attainment--measured by high school graduation and college enrollment rates--of MPCP and MPS students. The first purpose is accomplished by gauging growth in student achievement--as measured by the Wisconsin Knowledge and Concepts Examinations (WKCE) in math and reading in grades 3 through 8 and grade 10--over a five-year period for a sample of MPCP students and a carefully matched group of MPS students. The second purpose is accomplished by following the 2006-07 8th and 9th grade MPCP and matched MPS cohorts over a five-year period during which they would have had the opportunity to graduate from high school and enroll in college. Appended are: (1) Descriptive Statistics; (2) Attrition Study; and (3) Stability of the Sample. (Contains 4 figures, 12 tables and 14 footnotes.) [For the "MPCP Longitudinal Educational Growth Study: Fourth Year Report. SCDP Milwaukee Evaluation. Report # 23", see ED518597. Additional support for this report was provided by the Robertson Foundation.]

In 2007, using funds from the federal Teacher Incentive Fund (TIF) and private foundations, the Chicago Public Schools (CPS) began piloting its version of a schoolwide reform model called the Teacher Advancement Program (TAP). Under the TAP model, teachers can earn extra pay and take on increased responsibilities through promotion (to mentor teacher or master teacher), and they become eligible for annual performance bonuses based on a combination of their contribution to student achievement (known as "value added") and observed performance in the classroom. The model calls for weekly meetings of teachers and mentors ("cluster groups"), and regular classroom observations by a school leadership team to help teachers meet their performance goals. The idea behind TAP is that giving teachers performance incentives, along with tools to track their performance and improve instruction, will help schools attract and retain talented teachers and help all teachers raise student achievement. This report is the last in a series of reports providing evidence on the impacts of CPS' version of TAP, called "Chicago TAP." It presents findings from the four-year implementation period, with special emphasis on the 2009-2010 and 2010-2011 school years, the third and fourth years of the program's rollout in Chicago. Earlier reports (Glazerman et al. 2009; Glazerman and Seifullah 2010) provide detailed data on each of the first two years of the program, respectively. CPS implemented Chicago TAP as a pilot program intended for 40 high-need schools. The program began in 10 schools in the first year (cohort 1) with a rollout plan to add 10 more Chicago TAP schools (cohorts 2, 3, and 4) in each year of the TIF grant's four-year implementation period. The authors address three research questions regarding Chicago TAP: (1) How was the program implemented?; (2) What impact did the program have on student achievement?; and (3) What impact did the program have on teacher retention within schools? To assess the first year under Chicago TAP for schools that began the program in fall 2009 (cohort 3), the authors looked at how teacher development and compensation practices in Chicago TAP schools differ from practices normally implemented in CPS schools. The authors found that teachers in Chicago TAP schools reported receiving significantly more mentoring support than teachers in similar non-TAP (control) schools. This finding reflects the fact that under the Chicago TAP model, teachers are guided by mentor teachers, and cluster groups meet weekly. They also found that veteran teachers in Chicago TAP schools were more likely than their control group counterparts to provide mentoring support to their colleagues; this finding is consistent with the fact that under Chicago TAP, teachers have the opportunity to assume leadership roles and responsibilities as Chicago TAP mentor or lead teachers. Teachers in Chicago TAP schools (veteran and novice) were aware of their eligibility for performance-based compensation. The authors found that the amount of compensation they expected approached the amount that was eventually paid out; that is, the average expectation was about $900, and the actual amount paid out in bonuses to this group was an average of about $1,100 per teacher. They generally did not find evidence of an impact of Chicago TAP on teacher attitudes or school climate. While the introduction of Chicago TAP led to real changes inside the schools, the program did not consistently raise student achievement as measured by growth in Illinois Standards Achievement Test (ISAT) scores. The authors found evidence of both positive and negative test score impacts in selected subjects, years, and cohorts of schools, but overall there was no detectable impact on math, reading, or science achievement that was robust to different methods of estimation. For example, impacts on science scores overall (across years and cohorts) were positive, but not statistically significant unless they used one particular matching method that excluded some Chicago TAP schools from the analysis. The authors did find evidence suggesting that Chicago TAP increased schools' retention of teachers, although the impacts were not uniform or universal across years, cohorts, and subgroups of teachers. They found that teachers who were working in Chicago TAP schools in 2007 returned in each of the following three years at higher rates than teachers in comparable non-TAP schools. For example, the authors found that 67 percent of classroom teachers in cohort 1 schools in fall 2007 returned to their same school in fall 2010 compared to about 56 percent of teachers in non-TAP schools, an impact of nearly 12 percentage points. In other words, teachers in Chicago TAP schools in fall 2007 were about 20% more likely than teachers in comparison schools to be in those same schools three years later. When the authors looked at teachers who were working in schools that started Chicago TAP in later years, some of the impact estimates were not statistically significant. The authors also found some evidence of impacts on retention for subgroups of teachers, such as those with less experience, but the pattern of findings was not consistent. When they considered retention of teachers in the district, the authors did not find consistent evidence of a measurable impact. Given that Chicago TAP is a school-specific program, their main focus was on school-level retention, as opposed to retention in the district. Appended are: (1) Propensity Score Matching; and (2) Supplemental Tables. (Contains 32 tables, 6 figures and 27 footnotes.) [For related reports, see "An Evaluation of the Teacher Advancement Program (TAP) in Chicago: Year One Impact Report. Final Report" (ED507502) and "An Evaluation of the Teacher Advancement Program (TAP) in Chicago: Year Two Impact Report" (ED510712).]

Improving teaching quality is widely recognized as critical to addressing deficiencies in secondary school education, yet the field has struggled to identify rigorously evaluated teacher-development approaches that can produce reliable gains in student achievement. A randomized controlled trial of My Teaching Partner-Secondary--a Web-mediated approach focused on improving teacher-student interactions in the classroom--examined the efficacy of the approach in improving teacher quality and student achievement with 78 secondary school teachers and 2237 students. The intervention produced substantial gains in measured student achievement in the year following its completion, equivalent to moving the average student from the 50th to the 59th percentile in achievement test scores. Gains appeared to be mediated by changes in teacher-student interaction qualities targeted by the intervention. [For a related What Works Clearinghouse Intervention Report, see ED557783.]

School leaders are increasingly being asked, whether by rhetoric or policy, to measurably improve student achievement. The resultant need to assist school leaders in their ability to improve teaching and learning for all students in their schools led to the establishment of the National Institute of School Leadership's (NISL's) Executive Development Program. The NISL program emphasizes the role of principals as strategic thinkers, instructional leaders, and creators of a just, fair, and caring culture in which all students meet high standards. The current national focus on the importance of effective, instructional leadership has, in turn, led to calls for principal evaluation to be tied directly to student achievement (Davis, Kearney, Sanders, Thomas, and Leon, 2011). Within this milieu, effective and proven principal leadership development programs are crucial. (Contains 3 tables and 2 figures.) [This report was produced by the Center for Educational Partnerships, Old Dominion University.]

This study was conducted by members of a site of the California Writing Project in partnership with a large, urban, low-SES school district where 93% of the students speak English as a second language and 69% are designated Limited English Proficient. Over an eight-year period, a relatively stable group of 55 secondary teachers engaged in ongoing professional development implemented a cognitive strategies approach to reading and writing instruction, making visible for approximately 2000 students per year the thinking tools experienced readers and writers access in the process of meaning construction. The purpose of the study was to assess the impact of this approach on the reading and writing abilities of English language learners (ELLs) in all 13 secondary schools in the district. Students receiving cognitive strategies instruction significantly out-gained peers on holistically scored assessments of academic writing for seven consecutive years. Treatment-group students also performed significantly better than control-group students on GPA, standardized tests, and high-stakes writing assessments. Findings reinforce the importance of having high expectations for ELLs; exposing them to a rigorous language arts curriculum;explicitly teaching, modeling and providing guided practice in a variety of strategies to help students read and write about challenging texts; and involving students as partners in a community of learners. What distinguishes the project is its integrity with respect to its fidelity to three core dimensions: Teachers and students were exposed to an extensive set of cognitive strategies and a wide array of curricular approaches to strategy use (comprehensiveness) in a manner designed to cultivate deep knowledge and application of those strategies in reading and writing (density) over an extended period of time (duration). The consistency of positive outcomes on multiple measures strongly points to the efficacy of using this approach with ELLs. Appended are: (1) Great Expectations Writing Prompt; and (2) Student Models. (Contains 1 note, 5 tables, and 6 figures.)

We explored how a progress monitoring and instructional management system can be used to help educators differentiate instruction and meet the wide-ranging learning needs of their increasingly diverse classrooms. We compared classrooms in 24 states that used a curriculum-based progress monitoring and instructional management system, Accelerated Math, to same school control classrooms that did not use it. Among the major findings were the following: (1) At every grade level there were large differences in grade equivalent score and percentile gains for students in the experimental and control classrooms; (2) Gains were experienced across the achievement spectrum. An analysis of low-, middle-, and high-achieving students showed consistent rates of gain for each math objective mastered; (3) Intervention integrity had a significant effect on student achievement; (4) Teachers using the progress monitoring and instructional management system spent more time providing individual versus group instruction and felt better able to meet the individual needs of their students; and (5) Significantly more students who were in classrooms where teachers used the progress monitoring and instructional management system reported that they like math, help each other with math, and like math better this year than last year. Addition of a progress monitoring and instructional management system to ongoing mathematics instruction improves mathematics outcomes for students. The effects of the program clearly are a function of intervention integrity; when progress monitoring and instructional management practices are implemented with high fidelity or integrity, the mathematics performance of all students is significantly enhanced. Implications for practice are discussed.

Investigates the value of a tiered model of staff development for five districts using "teacher consultants" drawn from a parent district with a long writing project history. Evaluates preconditions, processes and outcomes. Discusses results in terms of student achievement and classroom practices. (SR)

Two studies evaluated the use of the Student Team Reading (STR) and Student Team Writing (STW) program in urban middle schools. The first study investigated the use of STR in 20 experimental sixth-grade classes in three schools matched with 39 classes in three control schools. The second study investigated the use of STR and STW in sixth, seventh, and eighth grades in two urban middle schools in Maryland matched with three control schools. In the first study, experimental students achieved significantly higher on a standardized measure of reading comprehension. The reading comprehension achievement of academically handicapped students, analyzed separately, was highly significant in favor of the experimental group. In the second study, the STR and STW students had significantly higher achievement on measures of reading vocabulary, reading comprehension, and language expression. (Two tables of data are included in the first study, and one table of data is included in the second study; 25 references are attached to the first study, and 22 references are attached to the second study.) (Author/RS)

An ABAB design was used to analyze the effects of positive peer reporting plus a randomized dependent group contingency (PPR + DGC). This intervention package was implemented across three classrooms in an alternative school setting for students diagnosed with emotional and behavioral disorders. The DGC consisted of the teacher randomly choosing a student to watch throughout the 45-min class period to determine if that student was following classroom rules. If so, the entire class earned a randomly selected reward at the end of class period. The intervention package also included two opportunities, one at the start and one at the end of class, for students to engage in positive reporting sessions. Results indicated an increase in engagement and a decrease in off-task and disruptive behavior while the intervention was implemented. The effects on positive and negative peer statements were ultimately minimal throughout all classrooms and phases. Social validity data indicated that teachers found the intervention package to be easy to include in their daily routine and stated that they would continue using this intervention package in the future. Discussion focuses on implications for practice and the need for additional research examining the effects of positive peer reports on student behavior.

To explore the impact of the True Goals (TG) school counseling curriculum on important constructs related to school success for students, we conducted two studies: one with elementary and middle school students and the other with high school students. In this, the first of the two studies, 43 students in Grades 4 through 7 participated in the intervention delivered by two school counselor trainees, across two schools in one school district in the Southwest region of the United States. The study used a waitlist control design with a randomized assignment to intervention and control groups to assess the impact of the TG small-group intervention on (a) students' goal-setting skills; (b) students' academic self-regulation; and (c) teachers' rating of students' motivation, self-knowledge, self-direction, and relationships. Results indicated that students in the treatment group showed significantly higher scores in motivation, self-knowledge, self-direction, and relationship skills than students in the control group, with a large effect size. Please refer to the second study for information on the impact of TG on a high school population.

Learning fractions is a critical step in children's mathematical development. However, many children struggle with learning fractions, especially fraction arithmetic. In this article, we propose a general framework for integrating understanding of individual fractions and fraction arithmetic, and we use the framework to generate interventions intended to improve understanding of both individual fractions and fraction addition. The framework, Putting Fractions Together (PFT), emphasizes that both individual fractions and sums of fractions are composed of unit fractions and can be represented by concatenating them (putting them together). To illustrate, both "3/9" and "2/9 + 1/9" can be represented by concatenating three 1/9s; similarly, 2/9 + 1/8 can be represented by concatenating two 1/9s and one 1/8. Interventions based on the PFT framework were tested in 2 experiments with fourth, fifth, and sixth grade children. The interventions led to improved performance on number line estimation and magnitude comparison tasks involving individual fractions and sums of fractions with equal and unequal denominators. Especially large improvements were observed on relatively difficult unequal-denominator fraction sum problems. The findings suggest that viewing individual nonunit fractions and sums of fractions as concatenations of unit fractions provides a sound conceptual foundation for improving children's knowledge of both. We discuss implications of the research for teaching and learning fractions, children's numerical development, and mathematics education in general.

Positive behavior interventions and supports (PBIS) improve student behavior. Yet, teachers may not receive adequate training to implement PBIS at the classroom level. This study evaluated class-wide function-related intervention teams (CW-FIT) as a classroom-level behavior management system to determine whether the behavior of middle school students would improve with teacher implementation of CW-FIT. A multiple-baseline across conditions design was used to evaluate changes in on-task behavior of adolescent students in sixth and seventh grade from a socioeconomically and ethnically diverse middle school. In addition, the effects on teacher behavior-specific praise statements and teacher reprimands were assessed. Consistent with previous evaluations of CW-FIT, findings indicated a functional relation between the intervention and increases in on-task student behavior. In addition, the findings also showed improvements to teacher behavior with increases in behavior-specific praise statements; however, no effect was observed with teacher reprimands. Social validity measures indicated students and teachers found the intervention favorable. Implications, limitations, and areas for future inquiry are discussed.

Inference skill is one of the most important predictors of reading comprehension. Still, there is little rigorous research investigating the effects of inference instruction on reading comprehension. There is no research investigating the effects of inference instruction on reading comprehension for English learners with reading comprehension difficulties. The current study investigated the effects of small-group inference instruction on the inference generation and reading comprehension of sixth- and seventh-grade students who were below-average readers (M = 86.7, SD = 8.1). Seventy-seven percent of student participants were designated limited English proficient. Participants were randomly assigned to 24, 40-min sessions of the inference instruction intervention (n = 39) or to business-as-usual English language arts instruction (n = 39). Membership in the treatment condition statistically significantly predicted higher outcome score on the "Gates-MacGinitie Reading Test" Reading Comprehension subtest (d = 0.60, 95% confidence interval [CI] [0.16, 1.03]), but not on the other measures of inference skill.

Research indicates that students with emotional and behavioral disorders (EBD) may engage in severe disruptions and off-task behaviors in the classroom setting that adversely impact the learning environment. This leads to many students identified as having EBD being placed in alternative education settings, such as restrictive schools or residential facilities. Due to placement in more restrictive environments and high rates of disciplinary actions, it is especially critical to decrease disruptive behaviors for students diagnosed with EBD. In addition, classroom teachers report disruptive behaviors and conduct problems as a major barrier to teaching their students. An ABC multiple baseline across classes design was used in an alternative school setting to evaluate the effects of explicit social skills training combined with a group contingency on class-wide levels of engagement and disruptive behavior. Participants were students in the first through sixth grade diagnosed with EBD. Through the class-wide intervention, social skills acquisition deficits were targeted through social skills instruction and social skills performance deficits were targeted through reinforcement programs. Results showed an increase in engagement and a decrease in disruptive behavior across all classrooms as a result of the intervention package.

During the transition from the elementary to middle grades, young adolescents may become increasingly vulnerable for emotional and behavioral problems. Class-Wide Function-Related Intervention Teams for middle level school (CW-FIT MS), the independent variable examined in this study, was developed to improve teaching and learning by fostering student engagement. The study's purpose was to examine the feasibility and effects of CW-FIT MS Tier 1 implementation in nine middle level school classes using a single-subject ABAB withdrawal design. Participants were 234 students in grades 6-8, including 23 identified as at risk for emotional behavioral disorders. Results of CW-FIT MS Tier 1 implementation showed significant improvement in on-task behavior for groups as well as individual target students, increased teacher praise-to-reprimand ratios, and decreased target student disruptions. Outcomes of social validity surveys were consistent with earlier studies. Study findings extend previous results by demonstrating positive intervention effects in novel settings with a greater number of participants. Study limitations and areas for future research are discussed.

The effectiveness of an experimental middle school fraction intervention was evaluated. The intervention was centered on the number line and incorporated key principles from the science of learning. Sixth graders (N = 51) who struggled with fraction concepts were randomly assigned at the student level to the experimental intervention (n = 28) or to a business-as-usual control who received their school's intervention (n = 23). The experimental intervention occurred over 6 weeks (27 lessons). Fraction number line estimation, magnitude comparisons, concepts, and arithmetic were assessed at pretest, posttest, and delayed posttest. The experimental group demonstrated significantly more learning than the control group from pretest to posttest, with meaningful effect sizes on measures of fraction concepts (g = 1.09), number line estimation as measured by percent absolute error (g = -0.85), and magnitude comparisons (g = 0.82). These improvements held at delayed posttest 7 weeks later. Exploratory analyses showed a significant interaction between classroom attentive behavior and intervention group on fraction concepts at posttest, suggesting a buffering effect of the experimental intervention on the normally negative impact of low attentive behavior on learning. A number line-centered approach to teaching fractions that also incorporates research-based learning strategies helps struggling learners to make durable gains in their conceptual understanding of fractions. [This paper will be published in the "Journal of Educational Psychology."]

This article presents findings from an intervention across sixth and seventh grades to teach academic words to middle school students. The goals included investigating a progression of outcomes from word knowledge to comprehension and investigating the processes students use in establishing word meaning. Participants in Year 1 were two sixth-grade reading teachers and 105 students (treatment n = 62; control n = 43) and in Year 2, one seventh-grade reading teacher and 87 students (treatment n = 44; control n = 43) from the same public school. In both years, results favored instructed students in word knowledge, lexical access, and morphological awareness on researcher-designed measures. In Year 2, small advances were also found for comprehension. Transcripts of lessons shed light on processes of developing representations of unfamiliar words.

The efficacy of a research-based fraction sense intervention for sixth graders with or at risk for mathematics difficulties (N = 52) was examined. The intervention aimed to build understanding of fraction magnitudes on the number line. Key concepts were taught with a narrow range of denominators to develop deep understanding. The intervention was centered on a visual number line in the meaningful context of a color run race. Students were randomly assigned to the fraction sense intervention (n = 25) or a business-as-usual control group (n = 27). Students in the intervention condition received 21 lessons in small groups (45 min each) during their regular mathematics intervention period. Students in the intervention group performed significantly better than those in the control group on a measure of fraction number line estimation and a more general measure of fraction concepts, both at immediate posttest and delayed posttest, with large effect sizes; lesser effects were shown for fraction arithmetic. [This paper will be published in "Remedial and Special Education."]

The purpose of the study was to conduct a randomized controlled trial (RCT) to demonstrate efficacy of the Class-wide Function-Related Intervention Teams (CW-FIT) program. The study was designed to replicate an initial RCT conducted by the CW-FIT developers in 1 site, with 2 additional research groups not involved in its development. The study was conducted across 3 states, in 21 culturally diverse schools, and with 83 teachers (classrooms) assigned to CW-FIT and 74 teachers (classrooms) assigned to the comparison group. The CW-FIT intervention included teaching prosocial skills and use of differential attention (teacher praise and points) for appropriate behaviors using a group contingency, class teams, goal setting, points, and rewards. Class-wide student on-task behavior improved, teacher praise and attention to appropriate behaviors increased, and reprimands decreased in the CW-FIT classes with significantly fewer changes over time for the comparison group.

This article presents findings from a randomized controlled trial (RCT) testing the impact of a novel coaching approach utilized as one element of the Double Check cultural responsivity and student engagement model. The RCT included 158 elementary and middle school teachers randomized to receive coaching or serve as comparisons; all participating teachers were exposed to school-wide professional development activities. Pre-post nonexperimental comparisons indicated improvements in self-reported culturally responsive behavior management and self-efficacy for teachers in both conditions following professional development exposure. With regard to the experimental findings, trained observers recorded significantly more proactive behavior management and anticipation of student problems by teachers, higher student cooperation, less student noncooperation, and fewer disruptive behaviors in classrooms led by coached teachers relative to comparison teachers. Taken together, the findings suggest the potential promise of coaching combined with school-wide professional development for improving classroom management practices and possibly reducing office discipline referrals among Black students.

Objective: To evaluate the effectiveness of 2 brief school-based interventions targeting the homework problems of adolescents with attention-deficit/hyperactivity disorder (ADHD)--the Homework, Organization, and Planning Skills (HOPS) intervention and the Completing Homework by Improving Efficiency and Focus (CHIEF) intervention, as implemented by school mental health providers during the school day. A secondary goal was to use moderator analyses to identify student characteristics that may differentially predict intervention response. Method: Two-hundred and eighty middle school students with ADHD were randomized to the HOPS or CHIEF interventions or to waitlist, and parent and teacher ratings were collected pre, post, and at a 6-month follow-up. Results: Both interventions were implemented with fidelity by school mental health providers. Participants were pulled from elective periods and sessions averaged less than 20 min. Participants in HOPS and CHIEF demonstrated significantly greater improvements in comparison with waitlist on parent ratings of homework problems and organizational skills and effect sizes were large. HOPS participants also demonstrated moderate effect size improvements on materials management and organized action behaviors according to teachers. HOPS participants made significantly greater improvements in parent- and teacher-rated use of organized actions in comparison with CHIEF, but not on measures of homework problems. Moderation analyses revealed that participants with more severe psychopathology and behavioral dysregulation did significantly better with the HOPS intervention as compared to the CHIEF intervention. Conclusions: Brief school-based interventions implemented by school providers can be effective. This type of service delivery model may facilitate overcoming the oft cited research-to-practice gap. [At the time of submission to ERIC, this article was in press with "Journal of Consulting and Clinical Psychology."]

Reading achievement scores for adolescents with disabilities are markedly lower than the scores of adolescents without disabilities. For example, 62% of students with disabilities read "below" the basic level on the NAEP Reading assessment, compared to 19% of their nondisabled peers. This achievement gap has been a continuing challenge for more than 35 years. In this article, we report on the promise of a comprehensive 2-year reading program called Fusion Reading. Fusion Reading is designed to significantly narrow the reading achievement gap of middle school students with reading disabilities. Using a quasi-experimental design with matched groups of middle school students with reading disabilities, statistically significant differences were found between the experimental and comparison conditions on multiple measures of reading achievement with scores favoring the experimental condition. The effect size of the differences were Hedges's g = 1.66 to g = 1.04 on standardized measures of reading achievement.

Purpose: We examined the effects of a text-processing reading comprehension intervention emphasizing listening comprehension and expressive language practices with middle school students with reading difficulties. Method: A total of 134 struggling readers in grades 6-8 were randomly assigned to treatment (n = 83) and control conditions (n = 51) using a 2:1 ratio (two students randomized to treatment for every one student randomized to control). Students in the treatment condition received 40 min of daily instruction in small groups of four to six students for approximately 17 hr. Results: One-way analysis of covariance models on outcome measures with the respective pretest scores as a covariate revealed significant gains on proximal measures of vocabulary and key word and main idea formulation. No significant differences were found on standardized measures of listening and reading comprehension. Discussion: Results provide preliminary support for integrating listening comprehension and expressive language practices within a text-processing reading comprehension intervention framework for middle-grade struggling readers.

Schools continue to strive for the use of evidenced-based interventions and policies to foster well-managed classrooms that promote improved student outcomes. The present study examined the effects of the Class-Wide Function-related Intervention Teams (CW-FIT), a group contingency intervention, on the on-task and disruptive behavior of elementary school students with or at risk for emotional behavior disorders (EBD). Seventeen elementary schools, 159 general education teachers, and 313 students participated in the randomized-control group design study. Fidelity of implementation was strong for intervention group teachers and was measured across groups and throughout baseline conditions. Results suggest that CW-FIT can be used to increase on-task behavior and reduce the disruptive behavior of students with or at risk for EBD. In addition, teachers in intervention classes increased praise and reduced reprimands to individual students and along with their students, reported high levels of consumer satisfaction.

The Common Core State Standards for Mathematics will place more pressure on special education and math teachers to raise the skill levels of all students, especially those with disabilities in math (MD). The purpose of this study was to assess the effects of enhanced anchored instruction (EAI) on students with and without MD in co-taught general education classrooms. Results showed that students in the EAI condition improved their performance on math skills contained in several of the standards. Effect sizes were especially large for students with MD when the special education teacher more actively participated in the instructional activities with the math teacher. Classroom observations provided examples of how teachers can work together to benefit students in inclusive math settings.

Chicago Public Schools initiated the Excellence in Teaching Project, a teacher evaluation program designed to increase student learning by improving classroom instruction through structured principal-teacher dialogue. The pilot began in forty-four elementary schools in 2008-09 (cohort 1) and scaled up to include an additional forty-eight elementary schools in 2009-10 (cohort 2). Leveraging the experimental design of the roll-out, cohort 1 schools performed better in reading and math than cohort 2 schools at the end of the first year, though the math effects are not statistically significant. We find the initial improvement for cohort 1 schools remains even after cohort 2 schools adopted the program. Moreover, the pilot differentially impacted schools with different characteristics. Higher-achieving and lower-poverty schools were the primary beneficiaries, suggesting the intervention was most successful in more advantaged schools. These findings are relevant for policy makers and school leaders who are implementing evaluation systems that incorporate classroom observations.

This chapter concerns a year-long, United States federally-funded evaluation of Educate Online, an online, at home, 1:1 tutoring program aimed at improving reading performance for middle school students who are below grade level. Participating students receive after-school instruction from teachers in real-time over Voice over Internet Protocol (VoIP) connections. The researcher discusses study findings, the methodological challenges of conducting research on online tutoring, the multiple perspectives for understanding the effectiveness of a tutoring program, and areas for additional research. The chapter examines a key aspect of the evaluation, a delayed treatment control group design study to determine the effect that involvement in the tutoring program has upon student academic achievement in reading. [This chapter was published in: F. J. García-Peñalvo, A. M. Seoane Pardo (Eds.), "Online Tutor 2.0: Methodologies and Case Studies for Successful Learning," (pp. 264-279). Hershey, PA: IGI Global, 2014. (978-1-4666-5832-5 / 2326-8905).]

The purpose of this evaluation of Scholastic's "System 44" conducted by RMC Research was to expand the existing research on students with learning disabilities by conducting a randomized study of struggling readers with approximately half of the sample comprised of students with learning disabilities. Specifically, this evaluation examined the impact of "System 44" on the reading outcomes of struggling readers and on a subsample of students with learning disabilities in Grades 4-8. The evaluation of the implementation and impact of "System 44" involved 12 elementary schools and 4 middle and K-8 schools in a district in Michigan. Scholastic's "System 44" is a foundational reading program intended for older struggling readers who have not mastered basic phonics and decoding skills. Combining researched-based phonics instruction with adaptive technology, "System 44" is designed to improve students' word reading accuracy, fluency, and comprehension. The "System 44" program delivers research-based instruction through an adaptive computer component; teacher-led small-group instruction; and individual student practice involving high-interest, leveled materials. Thus students who have not responded to classroom reading instruction may benefit from the more intensive and specific decoding instruction provided through "System 44." The evaluators selected the target sample based on student performance on the fall 2011 Michigan Educational Assessment Program (MEAP) and spring 2011 AIMSweb assessment. The Scholastic Reading Inventory (SRI) was used to screen students for "System 44" eligibility. The district administered the SRI to all students in the target sample. Those students who scored below 600 Lexiles on the SRI were administered the Scholastic Phonics Inventory (SPI). All students who scored in the Beginning or Developing reader categories on the SPI were randomly assigned (stratified by school and grade level) to either the "System 44" treatment group or the control group. RMC Research hired and trained 4 local testers to individually administer a battery of standardized reading tests to all treatment and control group students. The testers administered the tests in October 2011 to establish baseline scores and again in May 2012 to attain follow-up scores. The tests included the following: (1) Test of Silent Reading Efficiency and Comprehension (TOSREC); (2) Comprehensive Test of Phonological Processing (CTOPP) Elision subtest; (3) Test of Word Reading Efficiency (TOWRE) Sight Word Efficiency subtest; and (4) Test of Word Reading Efficiency (TOWRE) Phonetic Decoding Efficiency subtest. The evaluation of "System 44" revealed significant impacts on several tests for both the overall sample and the learning disabled sample. Additional findings revealed that impacts were stronger on several tests for middle school students than for elementary school students, particularly on SPI Nonsense Word Accuracy, TOSREC, and SRI. Although significant impacts were attained by the end of Year 1, the majority of students in the study did not complete the "System 44" program. Data collected through teacher surveys, classroom visits, and interviews provided information on teachers' implementation of "System 44" in the classroom, and software usage data were used to examine differences in students with varying program exit and topic completion patterns. [For the November 2011 report, see ED613693.]

Scholastic's "System 44" is a foundational reading program intended for older struggling readers who have not mastered basic phonics and decoding skills. Combining researched-based phonics instruction with adaptive technology, "System 44" is designed to improve students' word reading accuracy, fluency, and comprehension. The "System 44" program delivers research-based instruction through an adaptive computer component; teacher-led small group instruction; and individual student practice involving high-interest, leveled materials. Thus students who have not responded to classroom reading instruction may benefit from the more intensive and specific decoding instruction provided through "System 44." Using a randomized design, this evaluation assessed the effectiveness of "System 44" in terms of improving the foundational reading skills of struggling readers in Grades 4-8 in a large suburban school district in southern California during the 2010-2011 school year. The evaluation of the implementation and impact of "System 44" involved 7 of the 11 elementary schools and all 4 middle schools in the district. A 2-step process was used to establish student eligibility for "System 44." The Scholastic Reading Inventory (SRI) was used to screen students in Grades 4-8 who performed below the 50th percentile on the spring 2010 California Standards Test (CST) for "System 44" eligibility. Those students who scored below 600 Lexiles on the SRI were administered the Scholastic Phonics Inventory (SPI), a computer-based test used to identify students in need of additional phonics instruction. Students who scored in the Beginning or Developing reader categories on the SPI were randomly assigned (stratified by school and grade level) to either the "System 44" treatment group or the control group. Data collection activities for the "System 44" evaluation included student reading tests, teacher surveys, "System 44" classroom observations, a professional development observation, and staff interviews. RMC Research hired and trained 4 local testers to administer a battery of standardized reading tests to all treatment and control students. The testers administered the tests to each student separately over a 3-week period in September and October 2010 to establish baseline scores and again in May 2011 to attain follow-up scores. Listed in order of administration, the tests included the following: (1) Test of Silent Reading Efficiency and Comprehension (TOSREC); (2) Comprehensive Test of Phonological Processing (CTOPP) Elision subtest; (3) Woodcock-Johnson III Word Identification subtest; (4) Woodcock-Johnson III Word Attack subtest; (5) Test of Word Reading Efficiency (TOWRE) Sight Word Efficiency subtest; and (6) Test of Word Reading Efficiency (TOWRE) Phonetic Decoding Efficiency subtest. This report details the program impact findings and concludes with recommendations from the evaluation team.

The authors describe an independent evaluation of the READ 180 Enterprise intervention designed by Scholastic, Inc. Despite widespread use of the program with upper elementary through high school students, there is limited empirical evidence to support its effectiveness. In this randomized controlled trial involving 312 students enrolled in an after-school program, the authors generated intention-to-treat and treatment-on-the-treated estimates of the program's impact on several literacy outcomes of fourth, fifth, and sixth graders reading below proficiency on a state assessment at baseline. READ 180 Enterprise students outperformed control group students on vocabulary (d = 0.23) and reading comprehension (d = 0.32) but not on spelling and oral reading fluency. The authors interpret the findings in light of the theory of instruction underpinning the READ 180 Enterprise intervention. (Contains 2 figures, 7 tables, and 4 notes.)

This experimental study reports findings on the effects from a year-long reading intervention providing daily 50-min sessions to middle school students with identified learning disabilities (n = 65) compared with similar students who did not receive the reading intervention (n = 55). All students continued to receive their special education services as provided by the school. Statistically significant results favored the treatment group for sight word reading fluency following intervention. Small effects were found for phonemic decoding fluency and passage comprehension. No other statistically significant differences were noted between groups. The findings suggest that although gains on word reading fluency resulted from the additional reading treatment, accelerating the reading performance of students identified with learning disabilities may be unlikely to result from a 1-year daily intervention provided in groups of 10 to 15 students. (Contains 2 tables.)

Aimed at low-income families in six of New York City's highest-poverty communities, Family Rewards ties cash rewards to a pre-specified set of activities and outcomes thought to be critical to families' short- and long-term success in the areas of children's education, family preventive health care, and parents' employment. The purpose of this project is to experimentally evaluate the effects of this three-year innovative holistic conditional cash transfer (CCT) initiative. This paper presents initial findings from an ongoing and comprehensive evaluation of Family Rewards. It examines the program's implementation in the field and families' responses to it during the first two of its three years of operations, and early findings on the program's impacts on children's educational processes and outcomes. More specifically, this paper addresses the following questions: (1) What are the effects of ONYC-Family Rewards on family income, poverty, and financial hardship?; (2) What are the effects of ONYC-Family Rewards on use of health care and health insurance?; (3) What are the effects of ONYC-Family Rewards on parents' employment and educational attainment?; and (4) What are the effects of ONYC-Family Rewards on children's educational outcomes? Overall, this study shows that, despite an extraordinarily rapid start-up, the program was operating largely as intended by its second year. Although many families struggled with the complexity of the program, most were substantially engaged with it and received a large amount of money for meeting the conditions it established. Specifically, nearly all families (98 percent) earned at least some rewards in both program years, with payments averaging more than $6,000 during the first two program years combined. The program reduced current poverty and hardship; increased savings; increased families' continuous use of health insurance coverage and increased their receipt of medical care; and increased employment in jobs that are not covered by the unemployment insurance (UI) system but reduced employment in UI-covered jobs. The program has had mixed success in improving children's academic performance specifically. Contrary to expectations, Family Rewards did not affect school attendance or annual standardized test scores in Math and English Language Arts (ELA) for either group of youngest children, but did lead to notable gains for a group of more academically prepared high school students. The program also had important effects on several key proposed mediators of the intervention. However, these effects vary by parents with different age groups of children. Appended are: (1) References; and (2) Tables and Figures. (Contains 2 tables.)

The District of Columbia School Choice Incentive Act of 2003, passed by Congress in January 2004, established the first federally funded, private school voucher program in the United States. Since that time, more than 8,400 students have applied for what is now called the DC Opportunity Scholarship Program (OSP), and a rigorous evaluation of the Program, mandated by Congress, has been underway. This last formal report from the ongoing evaluation describes the impacts of the Program at least four years after families who applied and were given the option to move from a public school to a participating private school of their choice. The research priorities for the evaluation were shaped largely by the primary topics of interest specified in the statute. This legislative mandate led the evaluators to focus on the following research questions: (1) What is the impact of the Program on student academic achievement? (2) What is the impact of the Program on other student measures? (3) What effect does the Program have on school safety and satisfaction? (4) What is the effect of attending private versus public schools? (5) To what extent is the Program influencing public schools and expanding choice options for parents in Washington, DC? These research questions are consistent with the topics that scholars and policymakers have identified as important questions of interest surrounding private school scholarship programs. The report found that that the Program had mixed longer-term effects on participating students and their parents, including: (1) No conclusive evidence that the OSP affected student achievement overall, or for the high-priority group of students who applied from "schools in need of improvement"; (2) The Program significantly improved students' chances of graduating from high school, according to parent reports. Overall, 82 percent of students offered scholarships received a high school diploma, compared to 70 percent of those who applied but were not offered scholarships. This graduation rate improvement also held for the subgroup of OSP students who came from "schools in need of improvement."; and (3) Although parents had higher satisfaction and rated schools as safer if their child was offered or used an OSP scholarship, students reported similar ratings for satisfaction and safety regardless of whether they were offered or used a scholarship. Appendices include: (1) Research Methodology; (2) Benjamini-Hochberg Adjustments for Multiple Comparisons; (3) Sensitivity Testing; (4) Relationship Between Attending a Private School and Key Outcomes; (5) Detailed ITT Tables; (6) Exploration of Whether Parents Get What They Seek From School Choice; (7) To What Extent Are Treatment Effects of the OSP Observed Across the Outcome Test-Score Distribution? Quantile Regression Analysis of the OSP; and (8) Intermediate Outcome Measures. (Contains 99 tables, 31 figures, and 61 footnotes.)

The primary purpose of this study was to explore if there could be a more beneficial method in organizing the individual instructional reading components (phonological decoding, spelling, fluency, and reading comprehension) within a remedial reading program to increase sensitivity to instruction for middle school students with reading disabilities (RD). Three different modules (Alternating, Integrated, and Additive) of the Reading Achievement Multi-Modular Program were implemented with 90 middle school (sixth to eighth grades) students with reading disabilities. Instruction occurred 45 min a day, 5 days a week, for 26 weeks, for approximately 97 h of remedial reading instruction. To assess gains, reading subtests of the Woodcock Johnson-III, the Gray Silent Reading Test, and Oral Reading Fluency passages were administered. Results showed that students in the Additive module outperformed students in the Alternating and Integrated modules on phonological decoding and spelling and students in the Integrated module on comprehension skills. Findings for the two oral reading fluency measures demonstrated a differential pattern of results across modules. Results are discussed in regards to the effect of the organization of each module on the responsiveness of middle school students with RD to instruction.

This study examined the effectiveness of a yearlong, researcher-provided, Tier 2 (secondary) intervention with a group of sixth-graders. The intervention emphasized word recognition, vocabulary, fluency, and comprehension. Participants scored below a proficiency level on their state accountability test and were compared to a similar group of struggling readers receiving school-provided instruction. All students received the benefits of content area teachers who participated in researcher-provided professional development designed to integrate vocabulary and comprehension practices throughout the school day (Tier 1). Students who participated in the Tier 2 intervention showed gains on measures of decoding, fluency, and comprehension, but differences relative to students in the comparison group were small (median d = +0.16). Students who received the researcher-provided intervention scored significantly higher than students who received comparison intervention on measures of word attack, spelling, the state accountability measure, passage comprehension, and phonemic decoding efficiency, although most often in particular subgroups. (Contains 2 tables.)

Adding to the growing debate and evidence base on the effects of charter schools, this evaluation was conducted in 36 charter middle schools in 15 states. It compares the outcomes of 2,330 students who applied to these schools and were randomly assigned by lotteries to be admitted (lottery winners) or not admitted (lottery losers) to the schools. Both sets of students were tracked over two years and data on student achievement, academic progress, behavior, and attitudes were collected. The study is the first large-scale randomized trial of the effectiveness of charter schools in varied types of communities and states. Among the key findings were that, on average, charter middle schools that held lotteries were neither more nor less successful than traditional public schools in improving math or reading test scores, attendance, grade promotion, or student conduct within or outside of school. Being admitted to a study charter school did significantly improve both students' and parents' satisfaction with school. Charter middle schools' impact on student achievement varied significantly across schools. Charter middle schools in urban areas--as well as those serving higher proportions of low-income and low achieving students--were more effective (relative to their nearby traditional public schools) than were other charter schools in improving math test scores. Some operational features of charter middle schools were associated with less negative impacts on achievement. These features include smaller enrollments and the use of ability grouping in math or English classes. There was no significant relationship between achievement impacts and the charter schools' policy environment. Because the study could only include charter middle schools that held lotteries, the results do not necessarily apply to the full set of charter middle schools in the U.S. Appended are: (1) Selecting the Charter School and Student Samples; (2) Calculation of Sample Weights; (3) Outcome Measures for the Impact Analysis; (4) Analytic Methods; (5) Supplemental Materials for Chapter III; (6) Supplemental Tables for Chapter IV; and (7) Supplemental Tables for Chapter V. (Contains 78 tables, 29 figures, and 164 footnotes.) [For the study snapshot of this full report, see ED510574.]

The purpose of this study was (1) to examine the causal effects of READ 180, a mixed-methods literacy intervention, on measures of word reading efficiency, reading comprehension and vocabulary, and oral reading fluency and (2) to examine whether print exposure among children in the experimental condition explained variance in posttest reading scores. A total of 294 children in Grades 4-6 were randomly assigned to READ 180 or a district after-school program. Both programs were implemented 4 days per week over 23 weeks. Children in the READ 180 intervention participated in three 20-min literacy activities, including (1) individualized computer-assisted reading instruction with videos, leveled text, and word study activities, (2) independent and modeled reading practice with leveled books, and (3) teacher-directed reading lessons tailored to the reading level of children in small groups. Children in the district after-school program participated in a 60-min program in which teachers were able to select from 16 different enrichment activities that were designed to improve student attendance. There was no significant difference between children in READ 180 and the district after-school program on norm-referenced measures of word reading efficiency, reading comprehension, and vocabulary. Although READ 180 had a positive impact on oral reading fluency and attendance, these effects were restricted to children in Grade 4. Print exposure, as measured by the number of words children read on the READ 180 computer lessons, explained 4% of the variance in vocabulary and 2% of the variance in word reading efficiency after all pretest reading scores were partialed out.

In 2007, the Chicago Public Schools (CPS) began implementing a schoolwide reform called the Teacher Advancement Program (TAP) using funds from the federal Teacher Incentive Fund (TIF) and private foundations. Under the TAP model, teachers can earn extra pay and responsibilities through promotion to mentor or master teacher as well as annual performance bonuses based on a combination of their value added to student achievement and observed performance in the classroom. The idea behind the program is that performance incentives, combined with tools for teachers to track performance and improve instruction, should help schools attract and retain talented teachers and help all teachers produce greater student achievement. This report provides evidence on the impacts of TAP during the 2008-2009 school year, the second year of the program's rollout in CPS. Appended are: (1) Propensity Score Matching; and (2) Longitudinal Analysis of Test Score Data. (Contains 18 tables, 7 figures and 14 footnotes.) [For the Year One Impact Report, see ED507502.]

The Knowledge Is Power Program (KIPP) is a bold effort to create a network of charter schools designed to transform and improve the educational opportunities available to low/income families. KIPP schools seek to actively engage students and parents in the educational process, expand the time and effort students devote to their studies, reinforce students' social competencies and positive behaviors, and dramatically improve their academic achievement. Ultimately, the goal of KIPP is to prepare students to enroll and succeed in college. The KIPP Foundation is guiding this effort by selecting and training school leaders, promoting the program model, and supporting the KIPP network schools. This report presents preliminary findings from a matched, longitudinal analysis designed to estimate KIPP's effect on student achievement. The author's preliminary work estimates effects in 22 KIPP middle schools--making this the first report that applies a rigorous (nonexperimental) methodological approach across a nationwide sample of KIPP schools. They selected schools for which they were able to collect longitudinal, student/level data, and that were established by the 2005/06 school year or earlier to ensure that a minimum of two entering cohorts of students per school would be observed for multiple years. They find that students entering these 22 KIPP schools typically had prior achievement levels that were lower than average achievement in their local school districts. For the vast majority of KIPP schools studied, impacts on students' state assessment scores in mathematics and reading are positive, statistically significant, and educationally substantial. Estimated impacts are frequently large enough to substantially reduce race/ and income/based achievement gaps within three years of entering KIPP. They describe these findings in more detail in this report. Appendices include: (1) Administrative Data; (2) Supplemental Tables for Chapter II; (3) Analytic Methods; (4) Alternative Specifications; and (5) Subgroup Analyses. (Contains 34 tables, 21 figures and 28 footnotes.) [This paper was submitted to KIPP Foundation. For the accompanying report, see ED511108.]

This paper describes a series of school-based randomized trials in over 250 urban schools designed to test the impact of financial incentives on student achievement. In stark contrast to simple economic models, our results suggest that student incentives increase achievement when the rewards are given for inputs to the educational production function, but incentives tied to output are not effective. Relative to popular education reforms of the past few decades, student incentives based on inputs produce similar gains in achievement at lower costs. Qualitative data suggest that incentives for inputs may be more effective because students do not know the educational production function, and thus have little clue how to turn their excitement about rewards into achievement. Several other models, including lack of self-control, complementary inputs in production, or the unpredictability of outputs, are also consistent with the experimental data.

At the request of the State of Pennsylvania, the School District of Philadelphia, in the summer of 2002, asked three for-profit firms to assume responsibility for 30 of its lowest-performing schools and it asked four nonprofit managers to assume the management of 16 other low-performing schools. A difference-in-differences analysis is used to estimate the impact of nonprofit and for-profit management on individual student achievement. Gains in test scores at the treated schools are estimated by comparing them with gains in other low-performing schools in the district. Students at schools under for-profit management outperformed those at schools under nonprofit management in all six years in both reading and math. Most estimations are statistically significant. Impacts of for-profit management relative to district management were positive in math, but no reading impacts could be detected. At nonprofits, students appear to have learned substantially less, especially in math, at nonprofit schools, than had their school remained under regular district management. However, impacts fell short of statistical significance. (Propensity Score Analysis is appended. Contains 21 endnotes and 9 tables.)

In the No Child Left Behind Act (NCLB), Congress called for the U.S. Department of Education (ED) to conduct a rigorous study of the conditions and practices under which educational technology is effective in increasing student academic achievement. A 2007 report presenting study findings for the 2004-2005 school year, indicated that, after one school year, differences in student test scores were not statistically significant between classrooms that were randomly assigned to use software products and those that were randomly assigned not to use products. School and teacher characteristics generally were not related to whether products were effective. The second year of the study examined whether an additional year of teaching experience using the software products increased the estimated effects of software products on student test scores. The evidence for this hypothesis is mixed. For reading, there were no statistically significant differences between the effects that products had on standardized student test scores in the first year and the second year. For sixth grade math, product effects on student test scores were statistically significantly lower (more negative) in the second year than in the first year, and for algebra I, effects on student test scores were statistically significantly higher in the second year than in the first year. The study also tested whether using any of the 10 software products increased student test scores. One product had a positive and statistically significant effect. Nine did not have statistically significant effects on test scores. Five of the insignificant effects were negative and four were positive. Study findings should be interpreted in the context of design and objectives. The study examined a range of reading and math software products in a range of diverse school districts and schools. But it did not study many forms of educational technology and it did not include many types of software products. How much information the findings provide about the effectiveness of products that are not in the study is an open question. Products in the study also were implemented in a specific set of districts and schools, and other districts and schools may have different experiences with the products. The findings should be viewed as one element within a larger set of research studies that have explored the effectiveness of software products. Three appendixes are included: (1) Second-Year Data Collection and Response Rates; (2) Description of Sample for the 10 Products; and (3) Details of Estimation Methods. (Contains 29 footnotes, 4 figures and 24 tables.

Harlem Children's Zone (HCZ), which combines community investments with reform minded charter schools, is one of the most ambitious social experiments to alleviate poverty of our time. We provide the first empirical test of the causal impact of HCZ on educational outcomes, with an eye toward informing the long-standing debate whether schools alone can eliminate the achievement gap or whether the issues that poor children bring to school are too much for educators alone to overcome. Both lottery and instrumental variable identification strategies lead us to the same story: Harlem Children's Zone is effective at increasing the achievement of the poorest minority children. Taken at face value, the effects in middle school are enough to close the black-white achievement gap in mathematics and reduce it by nearly half in English Language Arts. The effects in elementary school close the racial achievement gap in both subjects. We conclude by presenting four pieces of evidence that high-quality schools or high-quality schools coupled with community investments generate the achievement gains. Community investments alone cannot explain the results.

Direct, explicit, and systematic instruction of critical skills has been a hallmark of effective teaching for many years. In this study, we implemented a quasi-experimental pre-/post-test design with nonequivalent groups to determine the effectiveness of syllable skills instruction on reading achievement. Classes were randomly assigned to control or treatment groups. Participants included middle-school students with high incidence disabilities, including attention deficit hyperactivity disorder (ADHD) and their peers at risk for reading failure. The syllable skills intervention included instruction in syllable patterns, syllabication steps and rules, and accenting patterns. Students practiced skills by decoding and encoding nonsense and low-frequency mono- and multisyllabic words. Statistically significant differences were evident between pre-test and post-test scores for three dependent measures: (a) word identification, (b) word attack, and (c) reading comprehension. The treatment group demonstrated greater increase from pre-test to post-test on word identification, word attack, and reading comprehension; and the gap in fluency performance between the groups decreased. We discuss these outcomes with regard to their implications for practice and future research. (Contains 4 tables and 1 figure.)

The "District of Columbia School Choice Incentive Act of 2003," passed by the Congress in January 2004, established the first federally funded, private school voucher program in the United States. The purpose of the new scholarship program was to provide low-income residents, particularly those whose children attend schools in need of improvement or corrective action under the "Elementary and Secondary Education Act," with "expanded opportunities to attend higher performing schools in the District of Columbia" (Sec. 303). As part of this legislation, the Congress mandated a rigorous evaluation of the impacts of the Program, now called the "DC Opportunity Scholarship Program" (OSP). This report presents findings from the evaluation on the impacts three years after families who applied were given the option to move from a public school to a participating private school of their choice. The evaluation is based on a randomized controlled trial design that compares the outcomes of eligible applicants randomly assigned to receive (treatment group) or not receive (control group) a scholarship through a series of lotteries. The main findings of the evaluation so far include: (1) After 3 years, there was a statistically significant positive impact on reading test scores, but not math test scores; (2) The OSP had a positive impact overall on parents' reports of school satisfaction and safety, but not on students' reports; (3) This same pattern of findings holds when the analysis is conducted to determine the impact of using a scholarship rather than being offered a scholarship; (4) The OSP improved reading achievement for 5 of the 10 subgroups examined; and (5) No achievement impacts were observed for five other subgroups of students, including those who entered the Program with relative academic disadvantage. Six appendices are included: (1) Research Methodology; (2) Benjamini-Hochberg Adjustments for Multiple Comparisons; (3) Sensitivity Testing; (4) Detailed ITT Tables; (5) Relationship Between Attending a Private School and Key Outcomes; and (6) Intermediate Outcome Measures.. (Contains 115 footnotes, 15 figures and 129 tables.) [For Executive Summary, see ED504784. For "Evaluation of the DC Opportunity Scholarship Program: Impacts after Two Years", see ED501696. For "Evaluation of the DC Opportunity Scholarship Program: Impacts after One Year", see ED497154.]

A key learning outcome in problem-solving domains is the development of flexible knowledge, where learners know multiple strategies and adaptively choose efficient strategies. Two interventions hypothesized to improve flexibility in problem solving were experimentally evaluated: prompts to discover multiple strategies and direct instruction on multiple strategies. Participants were 132 sixth-grade students who solved linear equations for three hours. Both interventions improved students' flexibility in problem solving and did not replace, nor interfere with, one another. Overall, the study provides causal evidence that exposure to multiple strategies leads to improved flexibility in problem solving and that discovery learning and direct instruction are compatible instructional approaches. (Contains 6 tables.)

This study examined the effects of individualized, integrated language arts as a reading approach on struggling readers' comprehension scores obtained from oral narrative, silent narrative, and silent expository passages at three levels: below-grade, on-grade, and above-grade levels. Students (N = 93) in grades four through eight, who were reading below grade level, participated in the study. Treatment group students (n = 51) received individualized, integrated language arts as a reading approach once a week in place of basal reading instruction. Comparison group students (n = 42) received basal reading instruction for the duration of the study. Multivariate analysis of covariance was used to analyze posttest Analytical Reading Inventory (ARI) comprehension scores. Several statistically significant (p less than 0.001) differences in comprehension performance were found for on-grade-level scores and for above-grade-level scores, but few differences were found between treatment and comparison groups on below-grade-level scores. All statistically significant differences favored students in the treatment group. The findings of the study strongly suggest that the use of individualized, integrated language arts as a method for teaching reading is an effective approach for improving the reading comprehension performance of struggling readers. (Contains 5 tables.)

This study examined the efficacy of an after-school program, the Challenging Horizons Program (CHP), that met four days a week and focused on improving organization, academic skills, and classroom behavior. The CHP was compared with a community control that included involvement in a district-run after-school program that met one to three days a week and focused on preparation for standardized testing. Participants were 48 middle-school youth, referred as experiencing a combination of learning and behavior problems, randomly assigned to either the CHP or the control. Parent and teacher ratings of behavioral and academic functioning were collected at the beginning of the academic year and again after one semester of intervention. Relative to the control, participants in the CHP made significant improvements in parent rated academic progress, self-esteem, and overall severity of problem. While teacher ratings did not reach significance, CHP participants made medium effect size improvements in academic progress and small improvements in overall severity. Core class grades and discipline records were also examined to provide a broad picture of functioning beyond rating scale data.

This study investigated the differential effects of two problem-solving instructional approaches--schema-based instruction (SBI) and general strategy instruction (GSI)--on the mathematical word problem-solving performance of 22 middle school students who had learning disabilities or were at risk for mathematics failure. Results indicated that the SBI group significantly outperformed the GSI group on immediate and delayed posttests as well as the transfer test. Implications of the study are discussed within the context of the new IDEA amendment and access to the general education curriculum.

This study assessed the effects of Peer-Assisted Learning Strategies (PALS), a reciprocal classwide peer-tutoring strategy, on the reading performance of native Spanish-speaking students with learning disabilities (LD) and their low-, average-, and high-achieving classroom peers. Participants were 132 native Spanish-speaking English language learners (ELL) in Grades 3 through 6, along with their 12 reading teachers. Teachers were assigned randomly to PALS and contrast groups. PALS sessions were conducted 3 times a week for 15 weeks. Students were tested before and after treatment. PALS students outgrew contrast students on reading comprehension, and those effects were not mediated by student type.

Used a matched-schools design, school-level achievement, and disciplinary data to evaluate the effectiveness of the elementary-level Positive Action program on students' performance and behavior over time. Results indicated that program participation improved student behavior, school involvement, and academic achievement into high school. The program had equally strong behavioral effects in higher risk schools. There was a clear dose-response relationship for most outcomes. (SM)

This study evaluated the effectiveness of a phonologically based reading program delivered to first- through sixth-grade impaired readers (N=115) in small groups. Post-tests after program completion found the program resulted in significantly better phonological awareness, decoding, reading accuracy, comprehension, and spelling. Improved skills were evident regardless of original level of deficiency and were not limited to specific grades. (Contains references.) (Author/DB)

Reports the results of an evaluation of a popular literature-based character education program using a sample of first to sixth grade students (n=965). Finds that the curriculum had a positive effect on cognitive outcomes and that an emphasis of character throughout the curriculum contributed to achieving character outcomes. Includes references. (CMK)

A classwide peer tutoring program in reading, implemented at 12 elementary and middle schools in three contiguous districts in the middle of a southern state, was evaluated for its effectiveness with three learner types: low achievers with disabilities, low achievers without disabilities, and learners of average achievement. Twenty teachers implemented the Peer Assisted Learning Strategies (PALS) program for 15 weeks, and 20 teachers who did not implement it served as controls. The PALS program involves having pairs of students engage in three strategic reading activities: partner reading with retell, paragraph summary, and prediction relay. In each of the 40 classrooms, data were collected systematically on three students representing the three learner types. Pre- and post-treatment reading achievement data were collected on three measures of the Comprehensive Reading Assessment Battery. Findings indicated that, irrespective of type of measure and type of learner, students in peer tutoring classrooms demonstrated greater reading progress than control students. (Contains approximately 120 references.) (DB)

The cooperative elementary school model uses cooperation, particularly cooperative learning, as a philosophy for educational change. A 2-year study of the cooperative elementary school model in 2 treatment and 3 comparison schools involving 1,012 students demonstrates positive effects on academic achievement and social relations. (SLD)

The purpose of this research was to design and evaluate a computer based adaptive strategy for teaching mathematics. Results indicated preference for materials with personalized examples for motivation and meaningful learning of problem solving procedures. Practical advantages of the computer-based model for adapting instruction are also considered. (Author/JAZ)

A study of the effects of peer-pairing and integrative motivation on both formal language performance and actual language behavior with Korean immigrant children is presented. The formal language learning was measured by tests of oral production and listening comprehension, and actual language behavior was measured by observations in a natural school environment. Both oral production and listening comprehension posttests were administered four-and-a-half months after pretest administration. Thirty elementary school children (11 boys and 19 girls) were randomly assigned to two groups, resulting in 14 children (8 girls and 6 boys) in the peer-paired group and 16 (11 girls and 5 boys) in the no-paired group. Stepwise multiple regression analyses indicated that (1) peer-pairing was a significant predictor for listening comprehension and the actual language behavior, and (2) prior language knowledge was the best predictor of formal language learning. The theoretical implications are that peer-pairing not only facilitates formal listening comprehension and actual language behavior, but also enhances social relationships between second-language learners and the target-language speakers. (MSE)

This study examined the initial efficacy of World Generation (WorldGen), a Tier I social studies instructional approach for emergent bilingual (EB) students and their native English-speaking (non-EB) peers in Grades 6 and 7. WorldGen builds on prior research on instructional practices that have been associated with improved content knowledge and literacy outcomes for EBs in classes of students with varying English proficiency. Using a within-teacher design, middle grades world history teachers' classes were randomly assigned to WorldGen treatment (17) or comparison conditions (16) for three to four approximately two-week units. The student sample included 42% EBs. Students in the treatment condition (n = 373) scored higher, on average, on world history content (Hedges' g = 0.47) and vocabulary knowledge (Hedges' g = 0.41) than students in the comparison condition (n = 343) but no statistically significant findings were yielded regarding disciplinary literacy skills at the end of WorldGen instruction. Of primary interest, the statistically significant main effects indicated that world history content knowledge and vocabulary learning was similar for both current EB and non-EB students in the treatment condition. The findings provide initial support for the use of the WorldGen instructional practices for improving content acquisition and vocabulary in general education social studies classes with students with a range of English proficiency. Furthermore, teachers perceived the WorldGen instructional practices and materials as providing the information and learning experiences necessary to support students in meeting grade-level expectations.

Scholars and practitioners have called for personalized and widely accessible professional development (PD) for teachers. Yet, a long-standing tension between customizing support and increasing access to such support has hindered the scale-up of high-quality PD for individual teachers. This study addresses this challenge by developing a computerized program for middle school mathematics teachers that provides frequent opportunities for teachers to interact with and obtain personalized and real-time feedback from a virtual facilitator based on natural language processing. Based on the data collected from 1727 middle school students in an experiment in which the teachers of these students were randomly assigned to the program or the business-as-usual condition (i.e., the control group), we found that the program had a statistically significant impact on students' mathematics performance. These results demonstrate the potential of incorporating an automated, interactive feedback tool supported by artificial intelligence to create effective, scalable teacher PD.

Principals are the second-largest school-based contributor to K-12 students' academic progress. However, there is little research evaluating whether efforts to develop principals' skills improve school effectiveness. We conducted randomized controlled trial studies of the impacts of a professional development program called the Executive Development Program (EDP) and of the incremental effects of coaching to help principals implement the EDP curriculum. We find that the EDP alone influenced principals' practices, but not student achievement, within 3 years. Coaching had a small positive effect on students' English Language Arts achievement, but no effect on math achievement or on principals' practices. Coaching had the largest effects in disadvantaged schools. We hypothesize that coaching enhanced the quality of implementation of recommended practices.

Principals are the second-largest school-based contributor to K-12 students' academic progress. However, there is little research evaluating whether efforts to develop principals' skills improve school effectiveness. We conducted randomized controlled trial studies of the impacts of a professional development program called the Executive Development Program (EDP) and of the incremental effects of coaching to help principals implement the EDP curriculum. We find that the EDP alone influenced principals' practices, but not student achievement, within 3 years. Coaching had a small positive effect on students' English Language Arts achievement, but no effect on math achievement or on principals' practices. Coaching had the largest effects in disadvantaged schools. We hypothesize that coaching enhanced the quality of implementation of recommended practices.

Teacher residencies are surfacing as a promising model for teacher preparation. One such residency program--Collaboration and Reflection to Enhance Atlanta Teacher Effectiveness (CREATE)--seeks to raise student achievement in local high-needs schools by increasing the effectiveness and retention of both new and veteran educators. CREATE aims to achieve this by developing critically-conscious, compassionate, and skilled educators who are committed to teaching practices that prioritize racial justice and interrupt inequities. This quasi-experiment, funded by an Investing in Innovations (i3) grant, follows two staggered cohorts of study participants (CREATE and comparison teachers) for three years per cohort, starting with the first cohort in 2015-16. Confirmatory analyses found no statistically significant effects of CREATE on two Teacher Assessment on Performance Standards (TAPS) ratings for Instructional Strategies (p = 0.221) and Positive Learning Environment (p = 0.192), or on student achievement on ELA (p = 0.454), math (p = 0.569), and general achievement (p = 0.234). However, exploratory analyses (pre-registered) found very promising results showing undisrupted retention over a three-year time period (spanning graduation from Georgia State University's College of Education and Human Development, entering teaching, and retention into the second year of teaching) for the CREATE group, relative to the comparison group (p = 0.038). We also observed that the favorable impact is driven largely by higher continuous retention among Black educators in CREATE relative to those in the comparison group (p = 0.021). The percentages of teachers in CREATE, as averaged across the two study cohorts, who maintain an uninterrupted trajectory of graduating from GSU-CEHD, and taught in their first and second year are 94.8%, 87.4% and 84.6%, respectively. In the matched comparison group the corresponding values are 87.9%, 72.9%, and 68.0%. Among Black teachers in CREATE, the values are 98.6%, 96.3% and 95.5%, respectively. In the matched comparison group of Black teachers, the corresponding values are 85.7%, 68.5%, and 62.8%. These results are further corroborated by statistically significant or marginally statistically significant differential impacts favoring Black teachers on several potential mediators of impact: resilience, self-efficacy, and stress management and empathy related to teaching. The positive findings on retention, particularly for Black educators, are important given that 44% of teachers in Georgia leave the profession within the first five years, with evidence in the literature indicating that in the South, Black teachers experience higher turnover rates than non-Black teachers (Carver-Thomas & Darling-Hammond, 2017). The authors discuss a number of factors that could have led to null impacts on confirmatory outcomes. The lack of variation in teacher performance ratings, which is a known issue in Georgia and in the literature at large (Weisberg et al, 2009; Kraft & Gilmour, 2017) could have contributed to the results for the TAPS ratings. Studies of teacher residency programs also suggest that impact on student achievement might not be present or detected in earlier years of teaching. Additionally, analyses of student achievement in this study were limited by small sample sizes of teachers in tested grades and subjects. The authors hope to address these limitations and to investigate the promising outcomes on retention, especially for Black educators, in current and future studies of CREATE, for which we have secured funding for programming and research through the eighth cohort. [For the appendices, see ED611803.]

Engaged in the evaluation of LDC tools since June 2011, UCLA's National Center for Research on Evaluation, Standards, and Student Testing (CRESST) is using multiple data sources and a quasi-experimental design to examine LDC implementation and impact in two cohorts of schools in two large, urban school districts. This report presents the results on implementation of LDC in the large urban school district on the West Coast during the third year of the intervention, and the impact of the program across multiple years. Findings from both participant surveys and analyses of student outcomes reveal positive results for the LDC intervention. Analysis of student outcomes provided evidence of the program's effectiveness and confirmation for participants' positive views. Quasi-experimental analyses demonstrated a statistically significant positive impact of LDC as practiced by middle school teachers with 2 years of program experience across two cohorts of schools and teachers. A statistically significant positive impact was also found for Cohort 2 middle schools after just one year of implementation. [For the 2017-2018 report, see ED600053.]

In contrast to prior federally mandated school reforms, the Every Student Succeeds Act (ESSA) allows states more discretion in reforming their lowest performing schools, removes requirements to disrupt the status quo, and does not allocate substantial additional funds. Using a regression discontinuity design, we evaluate a state turnaround initiative aligned with ESSA requirements. We find the effect on student achievement was not significant in year one and -0.13 in year two. Also, in year two, we find that teachers in turnaround schools were 22.5 percentage points more likely to turn over. While the increased teacher turnover in NCT schools in 2017 opens the possibility that reform schools were intentionally replacing less effective teachers with more effective ones, our analysis does not support that strategic staffing occurred. The negative effects on student achievement appear related to variable timing of implementation of one of the few required components for serving low-performing schools under ESSA--a comprehensive needs assessment which leads to comprehensive school improvement plans. These findings may serve as a cautionary tale for states planning low-performing school reforms under ESSA.

Too many talented students who go to under-resourced schools do not achieve their full potential. Though they may perform very well relative to their classmates, these students do not receive the same kinds of academically challenging opportunities throughout their educational journey as do their counterparts in better-resourced public and private schools. Rather than matriculating to competitive high schools and from there to selective colleges they are qualified to attend, these students often go to less academically competitive high schools and on to colleges where graduation rates are low. Some even forgo college altogether. To address this problem, Higher Achievement offers an intensive, academically oriented program for middle school students in under-resourced schools. Starting in the summer before fifth or sixth grade, Higher Achievement offers its participants, called "scholars," 650 extra hours of academic enrichment and instruction after school and during the summers through the eighth grade. The program includes English and math instruction as well as field trips to competitive high schools and colleges, achievement test preparation, and assistance in applying for financial aid. This short report presents the results of a randomized controlled trial of Higher Achievement that started in 2005, comparing the outcomes of students who were offered the opportunity to participate in Higher Achievement (the program group) and students who were not (the control group). It presents the impacts of the program one, two, and four years after enrollment, as well as its long-term impacts on college attendance. The study found that Higher Achievement was successful at changing the educational trajectory of students through middle school and improved the academic quality of many students' high school experiences, but did not affect the colleges to which they matriculated. By Year 2, there were positive impacts on students' math and reading test scores. In Year 4, the impacts on math test scores remained statistically significant. Higher Achievement had a small impact on the types of high schools its scholars ultimately attended. Program group students were more likely than control group students to matriculate to private or parochial schools and less likely to go to nonacademically competitive charter or magnet schools. By 2019, there was no difference in college going. More than 70 percent of both program and control group students had ever attended college. There were no differences in the academic quality of the colleges Higher Achievement's scholars ultimately attended, as measured by being a two- or four-year college; a college having a lower acceptance rate; or a college whose freshmen on average had higher SAT math or reading scores. Higher Achievement's college impacts did not differ by whether a student's parent had attended college or by student characteristics. The study shows that Higher Achievement is a very effective middle school program, improving students' middle school trajectories. However, the impacts did not persist after the program through high school and college.

The purpose of this study was to evaluate the National Institute for School Leadership's (NISL's) Executive Development Program (EDP) and paired leadership coaching as implemented in three states, with funding from the U.S. Department of Education's Investing in Innovation (i3) grant program. NISL's Executive Development Program (EDP) is a year-long professional development program that has served thousands of principals in 23 states since 2014. The study was a randomized control trial study spanning 332 schools and 118 school districts. It evaluated the effects of the offer of and of participation in the EDP and coaching. Take up rates of the program were relatively low, and the study found no significant effects of the EDP and coaching on student achievement in English language arts or mathematics, on student attendance rates, or on student grade progression rates within three years of the start of the program. There were, however, effects of participation in the EDP and coaching in two areas of leadership practice as reported by principals on surveys conducted more than two years after the start of the intervention. We hypothesize that local buy-in and capacity to fully participate in the intensive professional development program most likely influenced the degree to which the intervention was successful. [Criterion Education sponsored this report, with funding from NISL through the i3 grant from the U.S. Department of Education. For the first report of this series, "Putting Professional Learning to Work: What Principals Do with Their Executive Development Program Learning," see ED606171.]

The Literacy Design Collaborative (LDC) was created to support teachers in implementing college and career readiness standards in order to teach literacy skills throughout the content areas. Teachers work collaboratively with coaches to further develop their expertise and design standards-driven, literacy-rich writing assignments within their existing curriculum across all content areas. This report presents the results on implementation of LDC in the New York City Department of Education during the third year of the intervention, and the impact of the program across multiple years. As of 2018-2019, participating schools included 13 from Cohort 1, which began implementation during the 2016-2017 school year, and 23 from Cohort 2, which commenced at the beginning of the 2017-2018 school year. Our primary impact analyses, presented in this report for the first time, pool teachers from both cohorts to measure their impact after participating in LDC for 2 consecutive years (2017-2018 student outcomes for Cohort 1 and 2018-2019 student outcomes for Cohort 2). Teachers and administrators appreciated LDC and perceived positive impact on their practice and their students' learning. Quasi-experimental analyses tended to produce positive estimates for the impact of LDC on student English language arts (ELA) assessment scores, but the differences did not reach the level of statistical significance. [For the 2017-2018 evaluation report, see ED606884.]

The purpose of this research study was to evaluate iPersonalize, a gamified instructional approach developed by Fullerton School District (FSD) in California to encourage student engagement and promote achievement. An instructional approach is considered gamified when it incorporates computer game elements to augment existing classroom, instructional, and assessment processes (Bedwell, Pavlas, Heyne, Lazzara, & Salas, 2012; Landers, 2015). The study employed a randomized controlled trial designed to support causal inferences about the effectiveness of iPersonalize for impacting sixth-grade student engagement and achievement in English language arts (ELA). The study included 1,295 students from 42 classrooms in 15 schools. All students were enrolled in sixth grade in FSD during the 2017/18 school year. Students in 24 of these classrooms were assigned to ELA instruction using iPersonalize. Students in the remaining 18 classrooms were assigned to business-as-usual instruction. Teachers in both groups were expected to teach the same ELA unit. Teachers in the iPersonalize group were expected to incorporate elements of gamification, while the teachers in the control group were expected to not incorporate elements of gamification. Key findings from the study were as follows: (1) On both reading and writing assessments, the difference between the treatment group and the control group was small and not statistically significant, indicating that the two groups performed similarly; (2) Students in both groups reported similar levels of engagement in school; (3) Gender did not significantly moderate the impact of iPersonalize on student achievement or student engagement; (4) The impact of the program on reading and writing assessments was close to zero, regardless of the extent to which students interacted with the online learning management system; and (5) There was some evidence to suggest that the program had a stronger impact on engagement for students who were already the most engaged in school.

Nearly two dozen states now administer online exams to deliver testing to K-12 students. These tests have real consequences: their results feed into accountability systems, which have been used for more than a decade to hold schools and districts accountable for their students' learning. We examine the rollout of computer-based testing in Massachusetts over 2 years to investigate test mode effects. Crucial to the study design is the state administering the same exam (PARCC) in online and offline formats each year during the transitional period. We find an online test penalty of about 0.10 standard deviations in math and 0.25 standard deviations in English language arts (ELA), which partially but not fully fades out in the second year of online testing.

This study assesses the implementation and impacts of the Teacher Potential Project (TPP), a program designed by EL Education and which includes an English language arts (ELA) standards-aligned curriculum and embedded professional development for teachers. The study uses a randomized controlled trial (RCT) design to assess the impacts of TPP on the instructional practice outcomes of ELA teachers in grades 3 through 8 and the ELA achievement outcomes of their students. The RCT includes 70 elementary and middle schools (35 treatment and 35 control) in 18 relatively high-need districts that were randomly assigned to treatment and control conditions within matched pairs of schools in three cohorts that began participating in the 2014-2015, 2015-2016, and 2016-2017 school years. Treatment schools engaged in TPP for one year while control schools continued with business as usual. The study also uses a two-year quasi-experimental design (QED) study to assess the impact of extending implementation of TPP to a second year on teacher instructional practice and student ELA achievement outcomes. EL Education recruited 22 of the study schools (10 treatment and 12 control) in five districts in one cohort to participate in a second year of the study. The study team collected a variety of data for the evaluation of TPP, including teacher surveys and classroom observations administered in fall and spring each year and student administrative records. Impacts of TPP on ELA teacher instructional practices and student ELA achievement were estimated using multivariate regression methods. The implementation evaluation found that the TPP ELA curriculum was implemented in all schools, and that there was generally high school-level implementation fidelity of the TPP professional development components in the first and second years of TPP among the novice ELA teachers. The impact evaluation found positive impacts of TPP on ELA teachers' overall instructional practices after one year compared to teachers who used their district-provided curriculum and participated in their district's professional development supports. After two years of teacher participation, impacts on their students' ELA achievement were roughly equivalent to 1.4 months of typical student improvement, or moving an average student scoring at the 50th percentile to the 54th percentile. The findings be useful to districts and policymakers aiming to support teachers and students in the context of rigorous state standards such as the Common Core State Standards (CCSS). The study of TPP makes several important contributions to the literature evaluating paired curriculum and PD programs: it uses rigorous group designs, evaluates the impact of one and two years of program implementation, and examines broad outcomes on both teacher instructional practice and student ELA achievement. [This report was submitted by Mathematica to EL Education.]

The Literacy Design Collaborative (LDC) was created to support teachers in implementing college and career readiness standards in order to teach literacy skills throughout the content areas. Teachers work collaboratively with coaches to further develop their expertise and design standards-driven, literacy-rich writing assignments within their existing curriculum across all content areas. This annual report reflects the second year of implementation in 18 Cohort 1 schools, which began implementation in the 2016-2017, and the first year of implementation for 35 Cohort 2 schools, which commenced at the beginning of 2017-2018. Teacher, teacher leader, and administrator participants reported positive attitudes toward LDC. All measures of satisfaction or improvement were rated positively by more than half of the respondents. Participants across all groups perceived a positive impact on student outcomes. Approximately three-quarters of teachers agreed that LDC helped improve students'reading skills, literacy-performance, writing, and content knowledge. Analysis of student outcomes indicated that there were positive impacts of LDC on student learning, but the differences were not statistically significant.

The Parent Leadership Institute (PLI) of Children's Aid (CA), funded via a 2013 Investing in Innovation (i3) development grant operated between the 2014-15 through 2018-19 school years. Key goals of the PLI included: (1) improving the capacity of parents to effectively engage in the school community in support of their child; and (2) increasing the capacity of school staff to create and support environments which are welcoming to and supportive of the active engagement of parents as key members of the school community. Through implementation of the PLI, CA expanded its partnership with six schools located in the South Bronx community of Morrisania, an area characterized by high levels of poverty, health disparities, and crime, and low levels of academic achievement and attainment among both children and adults. This report serves as the final report on this phase of the PLI and includes an exploration of implementation during year 4 (2016-17 school year) and analyses of quantitative data on student academic performance. [This report was prepared for Children's Aid New York.]

The study examined the effect of National Board Certified Teachers (NBCTs) in instructional leadership roles, operationalized as mentors to novice teachers, on (a) classroom practices of mentored novice teachers in Grades K-12 and (b) student achievement of mentored teachers' students in Grades 4-8. The study compared outcomes between NBCT mentors and non-NBCT mentors. The study examined the effect of NBCT mentors after one academic year and was conducted in San Francisco Unified School District. Using the Classroom Assessment Scoring System, we examined novice teachers' classroom practices on the domains of Emotional Support, Classroom Organization, Instructional Support, and across all three domains. The results did not reach statistical significance, but the effect sizes for Emotional Support, Classroom Organization, and a global measure across all domains suggest meaningful differences between classroom practices of novice teachers mentored by NBCTs and non-NBCTs. These effect sizes were 0.28, 0.28, and 0.21 standard deviations, respectively. The effect size for the domain of Instructional Support was near zero at -0.06 standard deviations. Our sample size for the analysis of classroom practices did not have sufficient power to estimate differences at a statistically significant level. We examined student achievement using the state's standardized test scores in mathematics and English language arts. Our achievement measure includes either subject: That is, we did not estimate effects separately for mathematics and English language arts. The results suggest that students taught by teachers mentored by NBCTs had a higher level of achievement than students mentored by non-NBCTs. The difference was statistically significant at a p value of 0.05, and the effect size was meaningful at 0.18 standard deviations. Small sample sizes and low statistical power prevent us from making confident conclusions about the effect of NBCTs in instructional leadership roles on classroom practices of supported teachers and student achievement. However, the evidence is encouraging and warrants additional rigorous research on the impact of NBCTs as instructional leaders.

The three-tiered Positive Behavioral Interventions and Supports (PBIS) framework promotes the development of systems and data analysis to guide the selection and implementation of evidence-based practices across multiple tiers. The current study examined the effects of universal (tier 1) or school-wide PBIS (SW-PBIS) in one state's scale-up of this tier of the framework. Annual propensity score weights were generated to examine the longitudinal effects of SW-PBIS from 2006-07 through 2011-12. School-level archival and administrative data outcomes were examined using panel models with an autoregressive structure. The sample included 1,316 elementary, middle, and high schools. Elementary schools trained in SW-PBIS demonstrated statistically significantly lower suspensions during the fourth and fifth study years (i.e., small effect size) and higher reading and math proficiency rates during the first two study years as well as in one and two later years (i.e., small to large effect sizes), respectively. Secondary schools implementing SW-PBIS had statistically significantly lower suspensions and truancy rates during the second study year and higher reading and math proficiency rates during the second and third study years. These findings demonstrate medium effect sizes for all outcomes except suspensions. Given the widespread use of SW-PBIS across nearly 26,000 schools in the U.S., this study has important implications for educational practices and policies. [This paper was published in the "Journal of School Psychology" v73 p41-55 Apr 2019 (ISSN 0022-4405).]

The Middle-Grades Leadership Development (MLD) Project was designed to develop principal leaders and leadership teams who create high-performing middle-grades schools. Designed by the National Forum to Accelerate Middle-Grades Reform, the four-year project was funded from 2013 to 2017 by a U.S. Department of Education Investing in Innovation (i3) development grant. The project was implemented in 12 middle-grades schools in rural and small town areas of Kentucky and Michigan. Schools received an extensive set of school improvement supports, including: creating a vision using the Forum's Schools to Watch (STW) criteria; engaging in an assessment and planning process for improvement; STW leadership coach; principal mentor; STW mentor schools; leadership team; networking opportunities; and focused professional development. The evaluation of the MLD Project used a quasi-experimental design (QED) with matched comparison schools (12 treatment schools and 38 comparison schools) to examine the impact of the project on intermediate outcomes such as culture, collaboration, work climate, and teaching efficacy, as well as the long term outcomes of principal effectiveness and student achievement. Results showed that MLD treatment schools significantly improved their collaboration practices, teaching efficacy, middle-grades instructional practices, and their implementation of the STW criteria for high performance. There was significant improvement in the long-term outcome of principal effectiveness among treatment principals, with nine of the twelve principals improving their leadership skills and behaviors to the proficient or distinguished levels by the end of the grant. Although there was no overall intervention effect on ELA/reading or math student achievement, seven treatment schools displayed larger growth than the state average for some groups of students. The results provide unique insight into a middle-grades program focused on principal leaders and collaborative leadership. A roadmap that depicts the key supports, activities, and practices implemented at MLD schools that were the most impactful on building middle-grades leadership effectiveness were articulated. These include school-level practices (i.e., guiding vision, continuous improvement practices, reflective practices), principal-level practices (i.e., knowledge of young adolescents, commitment to developmentally appropriate practices, instructional leadership), collaborative leadership practices (i.e., developing teacher leaders, shared capacity), and teaching practices (i.e., student centered, high expectations, rigorous instruction) that combined, result in middle-grades leadership that is more effective. [The report was prepared by the Center for Prevention Research and Development.]

The purpose of this study was to examine the effects of a school-wide attendance and truancy intervention and universal procedures (ATI-UP) on student attendance. Student attendance was measured through average daily attendance and the percentage of students who would be considered chronically absent, i.e., missing 10% or more of school. The sample included 27 elementary schools in Oregon implementing school-wide positive behavior intervention and supports (SWPBIS) with varying levels of fidelity. Results indicate that schools can have a moderate effect on increasing average daily attendance (ADA) and a small effect on decreasing chronic absenteeism, although these results were not statistically significant. SWPBIS implementation did not act as a statistically significant moderator on the ATI-UP effects, although the treatment effect on ADA decreased with higher SWPBIS implementation. [The dissertation citations contained here are published with the permission of ProQuest LLC. Further reproduction is prohibited without permission. Copies of dissertations may be obtained by Telephone (800) 1-800-521-0600. Web page: http://www.proquest.com/en-US/products/dissertations/individuals.shtml.]

The Literacy Design Collaborative (LDC) was created to support teachers in implementing college and career readiness standards in order to teach literacy skills throughout the content areas. Teachers work collaboratively with coaches to further develop their expertise and design standards-driven, literacy-rich writing assignments within their existing curriculum across all content areas. The 2016-2017 school year was the first year of implementation, following a pilot year during which the implementation plan, instruments, data collection processes, and analytical methodologies were refined. Participants across all groups reported positive attitudes toward LDC and perceive a positive impact on student outcomes. Analysis of module artifacts suggest that teachers at the elementary school level were moderately successful in the backwards design process, particularly in developing high-quality writing tasks for students. As an ongoing multiyear intervention, the LDC implementation will continue to evolve year to year as participants provide feedback and LDC program managers make refinements. Thus, we anticipate that further significant changes to the course material and the delivery system that are already in progress for Year 2 will likely result in continued and possibly increased positive feedback. [Funding for this work was provided by the Literacy Design Collaborative.]

In 2013, the National Board for Professional Teaching Standards received a 5-year Investing in Innovation Fund Development grant from the U.S. Department of Education to develop, implement, and study Accomplished Teaching, Learning, and Schools (ATLAS). ATLAS is an online case library that contains examples of "accomplished teaching" practice delivered by National Board Certified Teachers. A purpose of the grant activities was to expose preservice and early career teachers to ATLAS content, which was hypothesized to affect their teaching practice and the achievements of their students. This final report summarizes research on the first 2 years of the program's implementation at scale (during the grant's fourth and fifth years), and the effects of ATLAS use on the outcomes of preservice and early career teachers and on the mathematics and science achievements of students in Grades 3-6. The study team determined that ATLAS was implemented with fidelity at the institution of higher education and local education agency levels during the second study year but not the first study year. Regarding the effects of ATLAS use on the outcomes of preservice teachers, early career teachers, and students, the study did not identify any observable differences between ATLAS users and non-ATLAS users or their students. [This report was funded by the National Board for Professional Teaching Standards (NBPTS) through a U.S. Department of Education Investing in Innovation Fund grant to NBPTS.]

The vast majority of American students are neither prepared nor sufficiently engaged to become science, technology, engineering, and mathematics (STEM)-literate citizens or innovative STEM professionals (National Research Council, 2007; Carnegie Corporation and the Institute for Advanced Study, 2009; National Science Board [NSB], 2010; President's Council of Advisors on Science and Technology [PCAST], 2010). The Citizen Schools Expanded Learning Time (ELT) model is defined by two core components: Apprenticeships and Academic Support, both of which are built into a lengthened school day. The Apprenticeships are the cornerstone of the Citizen Schools ELT program model; they are designed to engage student interest in a broad array of subject areas and experiences by leveraging expertise and commitment from local communities. Over the past several years, Citizen Schools has endeavored to increase both the number and range of STEM-focused apprenticeships, responding to increased demand and recognizing the importance of engaging middle school students in STEM subjects through a combination of hands-on learning and exposure to enthusiastic ambassadors for professional careers in STEM fields. This study examines whether the STEM-focused apprenticeships, in particular, serve to engage students in STEM learning, and increase their interest in STEM subjects more so than apprenticeships in other topics. [The report was prepared for Citizen Schools.]

"INSPIRE" is an Investing in Innovation (i3) development grant funded by the Office of Innovation and Improvement, U.S. Department of Education. "INSPIRE" provides an innovative integrated K-12 STEM pipeline approach focused on STEM course content and instructional redesign. The INSPIRE model was implemented in Cabarrus County Schools (CCS), which is among the largest school systems in North Carolina, serving nearly 30,000 students in 39 schools. The impact evaluation included two studies that examined the effect of INSPIRE on mathematics and science achievement as measured by North Carolina standardized End-of-Grades assessments. The elementary study (Study 1) used a three-year, longitudinal, single-cohort quasi-experimental design (QED) to assess the impact of INSPIRE on math achievement at the end of 5th grade after two years of program exposure. The secondary study (Study 2) used an individual-level, longitudinal, randomized controlled trial (RCT) with blocking by school level and cohort to assess the effects of INSPIRE on math and science achievement at the end of 7th and 10th grades after two years of program exposure. For both studies, we compared the outcomes of INSPIRE students with similar students from schools that did not offer a STEM program. For the elementary study, propensity score matching (PSM) was used to match INSPIRE elementary students and comparison student samples at baseline (on pre-test math achievement scores, gender, minority status, and economically disadvantaged status) and baseline equivalence was established all pre-test assessment measures; this study met What Works Clearinghouse (WWC) Group Design Standards with Reservations. For the secondary study, the overall and differential attrition rates were low based on the WWC attrition standards (WWC, 2017); this study met WWC Group Design Standards without Reservations. The results of the elementary study indicated a statistically significant difference between the "INSPIRE" treatment group and the business-as-usual comparison group on the math achievement outcome. Comparison students reported a statistically significant higher increase in math achievement than "INSPIRE" students. Results of the secondary study indicated no statistically significant difference between the "INSPIRE" treatment group and the business-as-usual comparison group on the math and science achievement outcome. The duration of students' exposure to INSPIRE, fidelity of implementation, alignment between PBL instruction and NC standardized assessments, and contextual factors that might have weakened the intervention strength relative to business-as-usual conditions are discussed as possible factors that account for these findings. The report concludes with suggestions for future research and implications for education policy.

Classroom management is a common concern for teachers. Music teachers in particular experience unique behavior challenges because of large class sizes, uncommon pacing requirements, and performance-based outcomes. Positive behavior support is an evidence-based framework for preventing or eliminating challenging behaviors by teaching and reinforcing appropriate social skills. Class-Wide Function-Related Intervention Teams (CW-FIT), a specific positive behavior support intervention involving social skills instruction, positive reinforcement, and group contingencies, has proven effective in elementary schools but has not been evaluated specifically in music classrooms. The present study sought to investigate the effectiveness of CW-FIT in increasing on-task behavior and teacher praise-to-reprimand ratios in a sixth-grade music classroom. A single-subject reversal (ABAB) design was used. Results indicated that student on-task behavior increased when CW-FIT was implemented. Teacher praise-to-reprimand ratios also improved. Results suggest the teacher and the students found CW-FIT valuable and enjoyable. Study limitations and implications are addressed.

In 2011, the University of Alaska Fairbanks (UAF) received an Investing in Innovation (i3) Grant through the U.S. Department of Education. UAF applied for the grant to expand the predominantly rural-serving Alaska Statewide Mentor Project (ASMP) to urban settings. ASMP is a professional development initiative that supplies fully released, highly trained mentors to early career teachers (ECTs). UAF's i3 grant, The Urban Growth Opportunity (UGO), included five districts: Anchorage, Fairbanks North Star Borough, Kenai Peninsula Borough, Matanuska-Susitna Borough, and Sitka. This is the final report for the grant conducted over four years (2011 2012 to 2014 2015). The research team randomly assigned 556 ECTs to treatment (UGO) and business as usual (BAU) groups. UGO ECTs received an ASMP mentor for two years; BAU ECTs received their districts' business as usual support that varied by district and included content coaches without mentoring support and non-ASMP instructional mentoring support. Researchers conducted impact, implementation, and intervention studies. The impact study included seven outcomes: teacher retention; teacher instructional practice as measured by the three Classroom Assessment Scoring System (CLASS®) domains (Emotional Support, Classroom Organization, and Instructional Support); and student achievement in reading, writing, and mathematics as measured by the state assessment. While UGO ECTs were retained as teachers in Alaska public schools at higher rates than BAU ECTs, the difference was not statistically significant. There were no statistically significant differences between UGO and BAU ECTs on instructional practices as measured by CLASS®. Finally, student achievement was generally higher for students of UGO ECTs, but differences in achievement were statistically significant only for some student groups: primary reading students and secondary math students who were White, Hispanic, Alaskan Native, or two or more races. Results from the implementation study, conducted over three of the four years of implementation, found ASMP implemented UGO with fidelity across all components: mentor recruitment and assignment, mentor participation in professional development, mentor interaction with their ECTs, and mentors' use of formative assessment tools. Results from the intervention study identified two types of mentor-mentee dyads: Gliders and Sliders, with gliders engaging in longer conversations, focused more explicitly on instruction and students, responding to each other more often, and engaging as peers more frequently than the slider dyads.

Students with deficits in social skills have been found to experience both short- and long-term problems, including interpersonal conflicts and academic difficulties. These problems are compounded for students with emotional and behavioral disorders (EBD). Class-wide function-related intervention teams (CW-FIT), a multi-tiered classroom management program, has been shown to be effective in increasing on-task behavior and decreasing disruptive behavior of students at risk for EBD. The present study examined the effects of CW-FIT on teachers' ratings of students' social skills, problem behaviors, and academic competence. A randomized control trial was completed with 160 elementary school teachers located in 19 schools across three states. Teachers completed rating scales on 350 students identified as at risk for EBD, for whom consent had been obtained. After being randomly assigned to treatment or control conditions, CW-FIT was implemented for approximately four months in treatment classrooms, after which teachers completed post-test ratings on all students. CW-FIT implementation was associated with significantly improved teacher ratings of social skills and academic competence for students at risk for EBD, but no significant changes in teacher ratings of student problem behaviors were found. Higher fidelity of CW-FIT implementation was associated with improved outcomes. Implications, limitations, and areas for future research are addressed. [This paper was published in "Journal of Positive Behavior Interventions."]

Urban school districts often rely on alternative teacher certification programs to help address ongoing demands for recruiting and hiring qualified teachers. These programs offer pathways into teaching outside of traditional university-based teacher education programs. TNTP's Teaching Fellows program has been one of the most prominent alternative certification providers in the U.S., primarily serving urban communities. TNTP (formerly known as The New Teacher Project) recruits aspiring teachers, whom it refers to as Fellows, through a selective process and provides a summer pre-service training institute and in-service seminars and coaching in the first year of teaching. At the end of the first year of teaching, TNTP uses a performance assessment to determine whether or not Fellows will be recommend for certification. This report summarizes a multi-year evaluation of the implementation and impacts of TNTP's Teaching Fellows program in seven large urban districts, supported by an Investing in Innovation (i3) grant from the U.S. Department of Education. Primary outcomes included student achievement and classroom observation scores in the second year of teaching. We employed quasi-experimental methods to match Fellows and similar new teachers who were not trained by TNTP, and match students of these teachers, using extant de-identified data from districts. This approach allowed us to construct and analyze large samples of teachers and students across districts, including more than 20,000 students taught by approximately 1,000 teachers to examine impacts on student achievement. TNTP implemented the program with fidelity during the evaluation period, with all district sites meeting predetermined benchmarks for implementation of core program components. We found no differences in teacher instructional practice or student achievement between Fellows and matched comparison teachers, though Fellows demonstrated higher retention into the second year of teaching than other new teachers in their districts. These findings suggest that the Teaching Fellows program was able to provide the districts with additional candidates for teaching vacancies without reducing teacher quality or student academic outcomes in these districts.

Working memory (WM) is the ability to temporarily store and retrieve a limited amount of information during complex cognitive activities, especially in the face of distraction. The dual-component model describes WM as including active maintenance in primary memory (PM) and cue-dependent search and retrieval from secondary memory (SM). Previously, researchers have found that WM training (WMT) fails to enhance SM capacity, a component that mediates the relationship between WM and fluid reasoning (gF). Thus, a double-blinded, placebo-controlled, randomized trial was conducted to elucidate whether retrieval from SM could be targeted using a two-component WMT regimen versus two control conditions: adaptive one-component WMT targeting solely PM capacity and non-adaptive one-component WMT. Participants were 174 adolescents, aged 10 to 13 years, who were assessed before, after, and six-moths following training. Retrieval from SM was measured using delayed free recall tasks, far transfer to gF was assessed with matrix reasoning and verbal inference tests, and far transfer to academic performance was assessed with reading and math tests. It was predicted that solely two-component WMT would enhance retrieval from SM and result in far transfer. ANCOVAs with pre-test scores as the covariate indicated that two-component participants increased total errors over controls. There were no significant differences between the groups on recall latency, total correct, or gF measures. The non-adaptive one-component group significantly improved on reading, although a drop in the other two groups drove the effect. Additional research is needed to elucidate whether theoretically-motivated WMT can positively impact higher-level cognition through SM retrieval mechanisms. [This paper was published in "Journal of Cognitive Enhancement" v1 p455-477 2017.]

To succeed in today's economy, students need both proficiency in the "three Rs" (reading, writing and arithmetic) and strong applied skills. Communication skills, team work, and critical thinking have long been at the top of employers' lists of applied skills they seek in employees. States are responding to employers' needs by putting in place new educational standards. These standards include not only higher levels of basic academic knowledge that students are expected to master but also applied skills pertaining to presenting information, explaining one's reasoning, and effectively collaborating in groups. As a result, teachers nationwide are having students work in groups more frequently. This report examines a recent large-scale effort to expand a cooperative learning program in middle schools. The change in standard instructional practices gives schools a chance to not only teach students applied skills, but improve students' academic learning, if they can help teachers turn "group work" into "cooperative learning teams." PowerTeaching, a structured cooperative learning program, was designed to do just that. Thus, the expansion of PowerTeaching through a federal Investing in Innovation grant offers the education field a unique opportunity to learn what it takes to help teachers create cooperative learning environments in their classrooms. This report presents the lessons learned from this scale-up effort and findings from a multiyear evaluation of it. It describes how PowerTeaching was implemented over the first few years, how classrooms with the program differed from those without it, and whether students in the program performed better in math. The evaluation found that while teachers who taught with PowerTeaching learned to place their students into longstanding mixed-ability groups, which are thought to be conducive to cooperative learning, teachers did not consistently use the program's instructional techniques that transform group work into cooperative learning. In turn, students' math performance did not differ significantly between schools using the program and schools not using it. A likely cause for the weak implementation was that the ongoing professional development, which is an integral part of the PowerTeaching program, mostly did not occur or focused more on teaching the new material required by recently adopted education standards rather than on cooperative learning techniques. The evaluation thus points to the importance of focused, ongoing training and support when trying to modify teachers' instructional practices. This report was written with Deni Chen, Ashley Kennedy, and Joseph Quinn.

In this experimental study we examined the effects of a technology-mediated, multicomponent reading comprehension intervention, Comprehension Circuit Training (CCT), for middle school students, the majority of whom were struggling readers. The study was conducted in three schools, involving three teachers and 228 students. Using a within-teacher design, middle school teachers' reading classes were randomly assigned to treatment (n = 9) or business as usual (n = 7) conditions. In the CCT condition, students received, on average, 39 lessons of video-modeled instruction in word reading, vocabulary, and comprehension instruction during reading intervention classes. Results of multilevel structural equation models indicated statistically significant effects favoring the CCT condition on three measures: reading comprehension latent variable (ES = 0.14), proximal vocabulary (ES = 0.43), and silent reading efficiency (ES = 0.28). Subgroup analyses indicated that students with lower entry-level reading comprehension tended to benefit more from the CCT intervention in reading comprehension, silent reading efficiency, and state test scores.

Purpose: We examined the effectiveness of a multistrategy inference intervention designed to increase inference making and reading comprehension for middle-grade struggling readers. Method: A total of 66 middle-grade struggling readers were randomized to treatment (n = 33) and comparison (n = 33) conditions. Students in the treatment group received explicit instruction in 4 inference strategies (i.e., clarification using text clues; activating and using prior knowledge; understanding character perspectives and author's purpose; answering inferential questions). In addition, narrative and informational texts were carefully chosen and sequenced to build requisite background knowledge to form inferences. Intervention was delivered in small groups of 3 students for 10 days of instruction. Results: One-way analysis of covariance models on outcome measures with the respective pretest scores as a covariate revealed significant gains on a proximal measure of Egyptian-content knowledge (g = 1.37) and on a standardized measure of reading comprehension--i.e., Wechsler Individual Achievement Test--Third Edition Reading Comprehension (g = 0.46). Conclusion: The moderate effect on a standardized measure of reading comprehension provides preliminary evidence for the effectiveness of this multistrategy inference intervention in improving reading comprehension of middle-grade struggling readers.

Diplomas Now is a partnership of three national organizations--Talent Development Secondary, City Year, and Communities In Schools--collaborating in an effort to transform urban secondary schools so that fewer students drop out and more graduate ready for postsecondary education and work. With the goal of a continuous system of support through secondary school, the Diplomas Now model seeks to help more students graduate by improving their attendance, behavior, and course performance, particularly in English/language arts and math, during the middle grades and high school. Acting as a representative for the partnership, Johns Hopkins University, home to Talent Development Secondary, was awarded an Investing in Innovation (i3) validation grant by the U.S. Department of Education in 2010 to support the expansion of Diplomas Now from a few schools to more than 30 middle and high schools in more than 10 school districts. The grant funds also support a rigorous random assignment evaluation of the Diplomas Now model, led by MDRC. This report discusses the early impacts of the Diplomas Now model on student and school outcomes at the end of the first and second years of model implementation. It focuses in particular on students during sixth and ninth grades, critical transition years into middle and high school. Accordingly, this report presents the "first-year" impacts of a "multiyear" program. In total, 62 high-needs schools (33 middle schools and 29 high schools) from 11 large urban school districts across the country were recruited to participate in the study starting in either the 2011-2012 or the 2012-2013 school year. Thirty-two of the participating secondary schools were randomly assigned to implement the Diplomas Now model (DN schools), and 30 were assigned to continue with "business as usual" (non-DN schools), either maintaining their existing practices and structures or pursuing other types of school reform. This third report focuses on the early impacts of Diplomas Now on students' attendance, behavior, and course performance measures (the ABC outcomes), separately and in combination, during their first year in middle school or high school over the course of the first two years that the model was implemented in participating schools. Does the implementation of Diplomas Now have an impact on how many students are on a path to high school graduation by the end of their first year of middle school or high school? During that first year, what difference does Diplomas Now make for attendance rates, suspensions and expulsions, and successful course completion? This report also discusses the impact of Diplomas Now on possible precursors to the ABC outcomes, such as the climate of the school, support from parents and the community, and students' attitudes and relationships. Two appendices are included: (1) Samples, Analytic Methods, and Early Outcome Measures; and (2) Supplemental ABC Outcome Findings. [For "Laying Tracks to Graduation: The First Year of Implementing Diplomas Now," see ED546638. For "Moving down the Track: Changing School Practices during the Second Year of Diplomas Now," see ED558491.]

Homework is transforming at a rapid rate with continuous advances in educational technology. Computer-based homework, in particular, is gaining popularity across a range of schools, with little empirical evidence on how to optimize student learning. The current aim was to test the effects of different types of feedback on computer-based homework. In the study, middle school students completed a computer-based pretest, homework assignment, and posttest containing challenging algebraic problems. On the homework assignment, students were assigned to different feedback conditions. In Experiment 1 (N = 103), students received no feedback or correct-answer feedback after each problem. In Experiment 2 (N = 143), students received (1) no feedback, (2) correct-answer feedback, (3) try-again feedback, or (4) explanation feedback after each problem. For students with low prior knowledge, feedback resulted in better posttest performance than no feedback. However, students with high prior knowledge learned just as much whether they received feedback or not. Results suggest the provision of basic feedback on computer-based homework can benefit novice students' mathematics learning.

Thirty-two students enrolled in one of four sixth-grade classrooms across two elementary schools participated in this study. Students receiving supplemental and intensive instruction in math and those with math-related disabilities were participants. A treatment and control, pre/postexperimental design was used to examine the effect of preteaching using a gradual instructional sequence on students' accuracy in solving fraction computations. Prior to each unit, students were pretaught three essential prerequisite skills related to the upcoming general education core math unit. Findings indicate that the combination of preteaching using the concrete-representational-abstract instructional sequence can be effective at improving the overall fraction computations of students with or at risk for disabilities.

Data-based instructional programs have proliferated in American schools despite limited evidence of their effectiveness in improving educator practice and raising student achievement. We report results from a two-year school-randomized evaluation of the Achievement Network (ANet), a program providing schools with standards-aligned interim assessments and intensive supports for instructional data use. Survey data show that ANet increased teacher satisfaction with the timeliness and clarity of the data they receive and available supports for instructional data-use and caused them to review and use interim assessment data more often. ANet did not, however, affect their confidence in data use or how frequently they differentiated instruction. Student impact estimates show no overall effect on student achievement in English language arts or mathematics. Despite the lack program effects on student achievement, we find that achievement is positively correlated with our survey-based measures of teacher perceptions and practices around instructional data use. Exploratory analyses suggest that the success of ANet in improving teacher practice and student achievement varies with the pre-existing capacity of schools to engage in data-based instruction. Schools rated by program staff as having a high level of readiness to implement the intervention prior to random assignment experienced positive impacts on student achievement, while those rated as a having a low level of readiness experienced negative impacts. The following are appended: (1) School Screener Scoring Rubric; (2) Year 2 School Leader and Teacher Survey Scale Items; and (3) School Leader and Teacher Survey Impact Tables.

In August 2010, the Smithsonian Science Education Center (SSEC) received a grant of more than $25 million from the U.S. Department of Education's Investing in Innovation (i3) program for a five-year study to validate its Leadership Assistance for Science Education Reform (LASER) model in three very diverse regions of the United States: rural North Carolina, northern New Mexico, and the Houston Independent School District (HISD). This current report focuses on the confirmatory and exploratory research questions submitted to i3 for the two studies conducted for the LASER i3 validation grant, providing clarifying detail related to methodology and instrumentation. The studies were conducted to answer two confirmatory research questions and two exploratory research questions.

The Schools to Watch: School Transformation Network Project is a whole school reform model designed to improve the educational practices, experiences, and outcomes of low-performing middle-grades schools. Developed by the National Forum to Accelerate Middle-Grades Reform, the four-year project was funded in 2010 by a U.S. Department of Education Investing in Innovation (i3) development grant. The purpose of the study was to examine the impact of the project on intermediate outcomes such as culture, collaboration, and instructional practices as well as the long term outcome of student achievement. The study employed a quasi-experimental design where two student cohorts were tracked over four years at 34 schools (17 intervention and 17 comparison) in three states. The intervention schools were comprised of persistently low-performing middle-grades schools serving high need students. Comparison schools were selected using key demographics to match to intervention schools. Several process and measurement tools for assessing implementation and intermediate outcomes were used, including surveys, the STW criteria rating rubric, coach's logs, and focus groups. The long term outcome data for the impact study included student English and math achievement scores on annual standardized state assessments. To examine achievement scores between intervention and comparison students, a series of 2-level models (students within schools) were run to assess 8th grade achievement (i.e., after students received all three years of the intervention). Results showed that i3 STW Project schools improved their culture and climate, collaboration practices, leadership practices, STW criteria implementation, and classroom instructional practices. There was no overall intervention effect on either English or math student achievement, however, significant results were found for the highest implemented schools, those project schools that achieved STW designation during the project. The results of the study provide unique insight into the reform process for i3 STW Project schools as well as other middle-grades schools that are struggling to improve. The multiple supports provided by the project combined with the guiding vision of the STW criteria and rubric supported these high need schools to improve contextual factors (i.e., culture, collaboration, leadership, teaching and learning practices), and for a subsample of schools, student achievement. Districts and schools embarking on reform need to focus on collaborative leadership, have a guiding vision, use a continuous improvement model for instructional improvements, and value networking with other schools to gain knowledge. Two appendices are included: (1) Psychometric Properties of the Self-Study Survey Constructs; and (2) Fidelity Matrix for National Forum's STW School Transformation Network Project.

Too many students drop out and never earn their high school diploma. For students at risk of dropping out, academic, social, and other supports may help. "Communities In Schools" seeks to organize and provide these supports to at-risk students in the nation's poorest-performing schools, including through "case-managed" services. This report, the first of two from a random assignment evaluation of "Communities In Schools" case management, focuses primarily on the implementation of case management in 28 secondary schools during the 2012-2013 school year. The report also includes interim one-year findings about case management's impact on student outcomes. The report concludes with suggestions for improvement for "Communities In Schools" based mainly on the implementation findings. The next report will present two-year impact findings and more about the implementation of case management in the 2013-2014 school year. Appended to the report are: (1) Statistical Model and Statistical Power; and (2) Sample and Response Analysis.

In 2011 Baltimore City Schools submitted a successful proposal for an Investing in Innovations (i3) grant to offer a three year (2012-2014) summer program designed to expose rising sixth through eighth grade students to VEX robotics. The i3-funded Middle School Science, Technology, Engineering and Mathematics (STEM) Summer Learning Program was part of a larger Baltimore City STEM summer learning program entitled "Create the Solution" in 2012 and "22nd Century Pioneers" in 2013 and 2014. The five-week summer program offered in 2012, 2013, and 2014 consisted of a half-day of instruction in mathematics and science and a half-day of enrichment activities. The robotics workshop taught students the fundamentals of building robots and provided time for teams to build their own robots and participate in competitions. The larger program offered different enrichment activities such as sports or arts. This report addresses research questions regarding the program's: (1) implementation fidelity; (2) performance goals; (3) impact on student attendance and mathematics achievement outcomes; (4) impact on student aspirations for college, studying STEM subjects in college, and pursuing STEM careers; and (5) impact on measures of teacher effectiveness. The following includes a summary for each: (1) Implementation Fidelity: Instruction in mathematics and robotics was implemented with fidelity all three program years. Implementation fidelity was lower for the professional development in robotics and mathematics components of the program because teacher attendance rates did not meet the thresholds set by City Schools; (2) Enrollment Goals: Most program enrollment goals were not met. Enrollment in the i3-funded program was 193 students in 2012 (goal 400), 384 in 2013 (goal 500), and 386 in 2014 (goal 600). The program sought to enroll 80% low-performing students in mathematics each year, but fell significantly short of this goal despite the district's efforts to reach out to these students. In addition, the program goal of enrolling at least 50% female participants was not met. The program also sought to have at least 80% of students attend at least 70% of the time (17 of the 24 program days), but only 55% of students attended at that rate. The program did meet its goals for recruiting minority (at least 95%) and high poverty students (at least 80%) each year; (3) Program Impacts on Attendance: Found a significant program effect on attendance in the year following the 2012 program. Program students had average attendance rates of 1.4 percentage points higher than the comparison group the year following the program (97.0% vs. 95.6%). An even larger significant program effect for low-achieving students' attendance was found in the year following the 2012 program (96.4% vs. 93.8%). The 2013 program students had slightly but not significantly higher attendance rates than their matched comparison students in the year following the program. The authors also also examined whether there was still a program effect on attendance a year later (2013-14) for the Summer 2012 participants. Program participants had average attendance rates of 1.5 percentage points higher than comparison students (95.2% vs. 93.7%). Among the low-achieving students the attendance difference was 2.4 percentage points (93.6% for program students vs. 91.2% for comparison students). These effects were not statistically significant; (4) Program Impacts on Mathematics Achievement: There were no program effects on mathematics achievement for either the 2012 or 2013 programs; (5) Program Impacts on Student Aspirations: There was no evidence from student survey data that the robotics program had a positive effect on student aspirations to attend college, study STEM subjects in college, or pursue a STEM career for either the 2013 or 2014 programs; and (6) Program Impacts on Teacher Effectiveness: Analyses based on mean instructional effectiveness scores from Spring 2013 and Fall 2013 on the nine components of the district's teacher evaluation tool examined whether teachers who received the summer professional development in 2013 made gains in instructional effectiveness. The difference between program teachers' effectiveness scores before and after the professional development was not statistically significant. Data were not available to examine differences between program teachers and a comparable group of teachers who did not receive the summer professional development. The following are appended: (1) Implementation Fidelity; (2) Performance Goals; and (3) Methodology.

This study uses a randomized design to assess the impact of the Balanced Leadership program on principal leadership, instructional climate, principal efficacy, staff turnover, and student achievement in a sample of rural northern Michigan schools. Participating principals report feeling more efficacious, using more effective leadership practices, and having a better instructional climate than control group principals. However, teacher reports indicate that the instructional climate of the schools did not change. Furthermore, we find no impact of the program on student achievement. There was an impact of the program on staff turnover, with principals and teachers in treatment schools significantly more likely to remain in the same school over the 3 years of the study than staff in control schools.

TAP™: The System for Teacher and Student Advancement was launched in 1999 as a comprehensive educator effectiveness model to offer career advancement and leadership opportunities for educators, a fair and transparent evaluation process linked to job-embedded professional development and performance-based compensation, which culminate in improved instructional practices and student achievement. This study illustrates the impact of the TAP System in 66 Louisiana schools. These are primarily high-need schools, with average free/reduced price lunch eligibility of 86%, impacting more than 32,000 students each year. The authors report evidence of a positive effect of the TAP System on student achievement using two complementary analysis strategies: (1) They found a significant positive effect of TAP on 2012-13 K-8 Assessment Index scores, controlling for previous achievement, percentage of students receiving free or reduced price lunch, school configuration, school size (number of students), and percentage of English language learners. The 66 TAP schools scored 3.7 points higher on average than non-TAP schools statewide; and (2) They also found that the TAP schools had significantly greater 2012-13 Assessment Index scores than a group of matched control schools. The TAP schools scored 5.5 points higher on average than their matched controls.

Background: In the field of intelligence research, it has been shown that some people conceive intelligence as a fixed trait that cannot be changed (entity beliefs), whereas others conceive it as a malleable trait that can be developed (incremental beliefs). What about writing? Do people hold similar implicit theories about the nature of their writing ability? Furthermore, are these beliefs likely to influence students' response to a writing intervention? Aims: We aimed to develop a scale to measure students' implicit theories of writing (pilot study) and to test whether these beliefs influence strategy-instruction effectiveness (intervention study). Sample: In the pilot and intervention studies participated, respectively, 128 and 192 students (Grades 5-6). Method: Based on existing instruments that measure self-theories of intelligence, we developed the Implicit Theories of Writing (ITW) scale that was tested with the pilot sample. In the intervention study, 109 students received planning instruction based on the self-regulated strategy development model, whereas 83 students received standard writing instruction. Students were evaluated before, in the middle, and after instruction. Results: ITW's validity was supported by piloting results and their successful cross-validation in the intervention study. In this, intervention students wrote longer and better texts than control students. Moreover, latent growth curve modelling showed that the more the intervention students conceived writing as a malleable skill, the more the quality of their texts improved. Conclusion: This research is of educational relevance because it provides a measure to evaluate students' implicit theories of writing and shows their impact on response to intervention.

We conducted a randomized field trial to test an academic vocabulary intervention designed to bolster the language and literacy skills of linguistically diverse sixth-grade students (N = 2,082; n = 1,469 from a home where English is not the primary language), many demonstrating low achievement, enrolled in 14 urban middle schools. The 20-week classroom-based intervention improved students' vocabulary knowledge, morphological awareness skills, and comprehension of expository texts that included academic words taught, as well as their performance on a standardized measure of written language skills. The effects were generally larger for students whose primary home language is not English and for those students who began the intervention with underdeveloped vocabulary knowledge.

Previous research has linked inquiry-based science instruction (i.e., science instruction that engages students in doing science rather than just learning about science) with greater gains in student learning than text-book based methods (Vanosdall, Klentschy, Hedges & Weisbaum, 2007; Banilower, 2007; Ferguson 2009; Bredderman, 1983; Shymansky, Hedges, & Woodworth, 1990). The LASER model, being validated in the current study, has already been the subject of a number of case studies (RMC Research Corporation, 2010; Horizon Research, 2010; Vanosdall et al., 2007). However, experimental studies of the type that might establish a causal link between program implementation, student science learning, and other valued outcomes have yet to be conducted. Only a handful of studies have involved random assignment, and most of these have involved random assignment of students in a relatively small number of classrooms (see Furtak et al. 2009). With support from the U.S. Department of Education's Investing in Innovation Fund (i3), the current validation study of the LASER Model encompasses approximately 60,000 students, 1,900 teachers, and over 140 district administrators and principals. The efficacy of the LASER program has important implications for both research and practice when working with high-poverty schools and districts, who have limited resources and time available for science interventions. LASER's initial success with early learners also demonstrates its potential for reducing the development of chronic, long-term deficiencies and academic problems. One table and one figure are appended.

Children with emotional and behavioral disorders (E/BD) struggle to achieve social and academic outcomes. Many studies have demonstrated self-management interventions to be effective at reducing problem behavior and increasing positive social and academic behaviors. Functional behavior assessment (FBA) information may be used in designing effective self-management interventions. The purpose of this study was to link self-management procedures to hypothesized behavior function in three children with E/BD. Results demonstrated that self-monitoring (SM) alone could be enhanced using information derived from FBA and that consequences delivered by teachers were less effective than a self-management treatment package.

This study explored the effects of a web-based decision support system ("Tutorial") for writing standards-based Individualized Education Programs (IEPs). A total of 35 teachers and 154 students participated across two academic years. Participants were assigned to one of three intervention groups based on level of "Tutorial" access: Full, Partial, or Comparison. Direct effects of the intervention on procedural and substantive elements of IEPs revealed that, although all groups had initial IEPs of similar quality, the Full Intervention group's post-"Tutorial" IEPs had a significantly higher proportion of substantive items rated as adequate than did the IEPs of other groups. The intervention's indirect effects were examined using student scores on the State Reading Assessment. The Full Intervention group demonstrated a higher rate of reading score gain than the other two groups during the academic year in which the IEP prepared with access to the "Tutorial" was implemented. Implications for educational practices and future research directions are discussed.

Background: School-based social-emotional and character development (SECD) programs can influence not only SECD but also academic-related outcomes. This study evaluated the impact of one SECD program, Positive Action (PA), on educational outcomes among low-income, urban youth. Methods: The longitudinal study used a matched-pair, cluster-randomized controlled design. Student-reported disaffection with learning and academic grades, and teacher ratings of academic ability and motivation were assessed for a cohort followed from grades 3 to 8. Aggregate school records were used to assess standardized test performance (for entire school, cohort, and demographic subgroups) and absenteeism (entire school). Multilevel growth-curve analyses tested program effects. Results: PA significantly improved growth in academic motivation and mitigated disaffection with learning. There was a positive impact of PA on absenteeism and marginally significant impact on math performance of all students. There were favorable program effects on reading for African American boys and cohort students transitioning between grades 7 and 8, and on math for girls and low-income students. Conclusions: A school-based SECD program was found to influence academic outcomes among students living in low-income, urban communities. Future research should examine mechanisms by which changes in SECD influence changes in academic outcomes.

Interim assessments are increasingly common in U.S. schools. We use high-quality data from a large-scale school-level cluster randomized experiment to examine the impact of two well-known commercial interim assessment programs on mathematics and reading achievement in Indiana. Results indicate that the treatment effects are positive but not consistently significant. The treatment effects are smaller in lower grades (i.e., kindergarten to second grade) and larger in upper grades (i.e., third to eighth grade). Significant treatment effects are detected in Grades 3 to 8, especially in third- and fourth-grade reading and in fifth- and sixth-grade mathematics.

The New York City Leadership Academy represents a unique experiment by a large urban school district to train and develop its own school leaders. Its 14-month Aspiring Principals Program (APP) selects and prepares aspiring principals to lead low-performing schools. This study provides the first systematic evaluation of achievement in APP-staffed schools after 3 or more years. We examine differences between APP principals and those advancing through other routes, the extent to which APP graduates serve and remain in schools, and their relative performance in mathematics and English language arts. On balance, we find that APP principals performed about as well as other new principals. If anything, they narrowed the gap with comparison schools in English language arts but lagged behind in mathematics. (Contains 2 figures, 9 tables, and 23 notes.)

In 2009, the United States Department of Education conducted a competition for a second round of Striving Readers grants. Its dual purpose was to: (1) Raise middle and high school students' literacy levels in Title I-eligible schools with significant numbers of students reading below grade level; and (2) Build a strong, scientific research base for identifying and replicating strategies that improve adolescent literacy skills through a required experimental study design. The Office of Superintendent of Public Instruction (OSPI), Washington's state education agency, joined together with evaluators at Education Northwest to submit a proposal for the competition. Washington state was one of just eight states to be awarded Striving Readers grants in the second round. The grant originally included a planning year, followed by three years of implementation in selected schools. However, Congress eliminated the funding for the program in spring 2011, three-quarters of the way through the first year of implementation. Existing funding was sufficient to complete the first year of program implementation and data collection, but the second and third years of implementation did not take place. Therefore, this Year 1 evaluation report is the only report about the program's implementation and outcomes. Five schools from three districts in Western Washington participated in Washington Striving Readers. Across the five schools, a total of 176 students participated in the treatment condition and 182 students were in the control condition. The program offered 70 hours of professional development for teachers, and all teachers participated in at least 90 percent of these offerings. All teachers also received the intended amount of in-class support, defined as at least 12 visits from a project coach with each visit lasting at least one hour. The study examined four aspects of program implementation: teachers' receipt of the intended professional development, their receipt of in-class coaching, their delivery of the programs as intended, and the completion of all the lessons that were supposed to be covered. Researchers used three different assessments to measure impact: (1) "Gates-MacGinitie Reading Test"; (2) two subtests from the "Woodcock Reading Mastery" assessment--the word attack and word identification subtests; and (3) scores from the "Measure of Student Progress" ("MSP"). Researchers examined the overall impact of Washington Striving Readers using a fixed effects regression model that accounted for the random assignment of students within schools and groups. The findings demonstrated that it is possible to make a statistically significant difference in struggling students' overall literacy achievement in the course of one school year. Students in the Washington Striving Readers intervention performed better on the state reading assessment than did students in the control condition, who did not receive any supplemental reading support. The following are appended: (1) Washington Striving Readers Implementation Measures; (2) Baseline Equivalence of Treatment and Control Groups; and (3) Detailed Regression Analysis Results.

In this study, 72 secondary English teachers from the Santa Ana Unified School District were randomly assigned to participate in the Pathway Project, a cognitive strategies approach to teaching interpretive reading and analytical writing, or to a control condition involving typical district training focusing on teaching content from the textbook. Pathway teachers learned how to use an on-demand writing assessment to help mainstreamed English learners understand, interpret, and write analytical essays. In Year 2, treatment effects were replicated on an on-demand writing assessment (d = 0.67) and showed evidence of transfer to improved performance on a standardized writing test (d = 0.10). The results underscore the efficacy of a cognitive strategies reading/writing intervention for mainstreamed English learners (ELs) in the secondary grades. (Contains 1 note, 4 tables, and 3 figures.)

Motivational interviewing (MI) is an effective method of promoting change in adults, but research on adolescents is limited. This study tests the efficacy of MI for promoting academic achievement in middle school students. Participants were 103 6th-, 7th-, and 8th-grade students randomly assigned to either a MI (n = 50) or a waitlist control condition (n = 53). Students in the MI condition participated in a single MI session during the 7th or 8th week of the second semester. In comparison to the control group, students who received MI demonstrated significant improvements in their class participation, overall positive academic behavior, and significantly higher 4th quarter math grades. Thus, consistent with other studies finding single session effects of MI, a single MI session can have beneficial effects on academic behaviors. Pending further study and replication of these findings, MI could become an efficient and effective new counseling approach for improving academic performance. (Contains 2 tables.)

"Thinking Reader" is a software program for students in Grades 5-8 that incorporates elements commonly identified in policy reports as being key components of effective adolescent literacy instruction. This evaluation of the impact of "Thinking Reader" use by Grade 6 students focused on two confirmatory research questions about the effect of the program on two measures of students' reading achievement: (1) What is the effect of "Thinking Reader" on students' reading vocabulary?; and (2) What is the effect of "Thinking Reader" on students' reading comprehension? A statistically significant impact on either outcome measure would signal the program's success. The study also examined whether "Thinking Reader" has an effect on two ancillary, but important, measures of students' approaches to reading: (1) What is the effect of "Thinking Reader" on students' use of reading comprehension strategies?; and (2) What is the effect of "Thinking Reader" on students' motivation to read? This study also addressed four exploratory research questions. These questions investigate whether the impact of the "Thinking Reader" intervention on students' reading achievement varied across subgroups of students formed on the basis of baseline reading vocabulary, baseline reading comprehension, and baseline motivation to read measures: (1) Does the effect of "Thinking Reader" on students' reading vocabulary vary according to their baseline reading vocabulary scores?; (2) Does the effect of "Thinking Reader" on students' reading comprehension vary according to their baseline reading comprehension scores?; (3) Does the effect of "Thinking Reader" on students' reading vocabulary vary according to their baseline reading motivation scores?; (4) Does the effect of "Thinking Reader" on students' reading comprehension vary according to their baseline reading motivation scores? The impact results for the primary research questions indicate that "Thinking Reader" was no more effective than business as usual in improving students' reading vocabulary (effect size of -0.04) or reading comprehension (effect size of 0.03). Results for the ancillary research questions indicate that "Thinking Reader" was also no more effective than business as usual in improving student' use of reading comprehension strategies (effect size of 0.03) or their motivation to read (effect size of -0.03). None of these results are statistically significant. Sensitivity analyses found no changes in the direction or magnitude of the intervention effects. Appendices include: (1) Examples From the "Thinking Reader" Program; (2) Data Collection; (3) Missing Data, Baseline Equivalence of the Analytic Sample, and the Impact Model; (4) Sensitivity Analyses; and (5) Exploratory Analyses. (Contains 89 tables, 10 figures, 6 boxes, 7 exhibits and 51 footnotes.)

Are teachers' impacts on students' test scores ("value-added") a good measure of their quality? This question has sparked debate largely because of disagreement about (1) whether value-added (VA) provides unbiased estimates of teachers' impacts on student achievement and (2) whether high-VA teachers improve students' long-term outcomes. We address these two issues by analyzing school district data from grades 3-8 for 2.5 million children linked to tax records on parent characteristics and adult outcomes. We find no evidence of bias in VA estimates using previously unobserved parent characteristics and a quasi-experimental research design based on changes in teaching staff. Students assigned to high-VA teachers are more likely to attend college, attend higher-ranked colleges, earn higher salaries, live in higher SES neighborhoods, and save more for retirement. They are also less likely to have children as teenagers. Teachers have large impacts in all grades from 4 to 8. On average, a one standard deviation improvement in teacher VA in a single grade raises earnings by about 1% at age 28. Replacing a teacher whose VA is in the bottom 5% with an average teacher would increase students' lifetime income by more than $250,000 for the average classroom in our sample. We conclude that good teachers create substantial economic value and that test score impacts are helpful in identifying such teachers.

Students with high-incidence disabilities struggle with reading comprehension due to difficulties in background knowledge and metacognitive skills, including use of self-monitoring and other strategies. In the United States, these students typically receive the majority of their instruction in general education settings. However, there is little research comparing reading comprehension interventions with the typical basal curricula used in these classrooms. We compared the effects of an explicit reading comprehension intervention to those of a typical language-arts curriculum on upper elementary and middle school students' (n = 38) retells of passages and understanding of main ideas. A 2 x 4 repeated measures multivariate analysis of variance (MANOVA) revealed significant differences between instructional groups. These results indicate systematic and explicit reading comprehension instruction can be delivered successfully to students with high-incidence disabilities in general education settings. (Contains 3 figures and 4 tables.)

Analyzing mathematics and reading achievement outcomes from a district-level random assignment study fielded in over 500 schools within 59 school districts and seven states, the authors estimate the 1-year impacts of a data-driven reform initiative implemented by the Johns Hopkins Center for Data-Driven Reform in Education (CDDRE). CDDRE consultants work with districts to implement quarterly student benchmark assessments and provide district and school leaders with extensive training on interpreting and using the data to guide reform. Relative to a control condition, in which districts operated as usual without CDDRE services, the data-driven reform initiative caused statistically significant districtwide improvements in student mathematics achievement. The CDDRE intervention also had a positive effect on reading achievement, but the estimates fell short of conventional levels of statistical significance. (Contains 1 figure, 3 tables, and 16 notes.)

This report summarizes the results of the Newark, New Jersey, Striving Readers program for project Years 1, 2, 3, 4, and 5. This report updates one analysis (3 years); the remainder of the impacts and implementation findings are for Year 4. The Striving Readers Grant addresses the unmet needs of middle school students reading 2 or more years below grade level and provides professional development for teachers in all core content areas to help them learn about and use more effective literacy strategies. Nineteen middle schools in Newark are participating in the U.S. Department of Education Striving Readers study. Two components of the project are being evaluated: a targeted intervention and a whole-school intervention. [This report is the product of a collaborative effort involving numerous individuals at Westat and Newark Public Schools.]

In this article, we present the results from a longitudinal examination of the impact of a "Standards"-based or reform mathematics curriculum (called CMP) and traditional mathematics curricula (called non-CMP) on students' learning of algebra using various outcome measures. Findings include the following: (1) students did not sacrifice basic mathematical skills if they are taught using a "Standards"-based or reform mathematics curriculum like CMP; (2) African American students experienced greater gain in symbol manipulation when they used a traditional curriculum; (3) the use of either the CMP or a non-CMP curriculum improved the mathematics achievement of all students, including students of color; (4) the use of CMP contributed to significantly higher problem-solving growth for all ethnic groups; and (5) a high level of conceptual emphasis in a classroom improved the students' ability to represent problem situations. (However, the level of conceptual emphasis bears no relation to students' problem solving or symbol manipulation skills.) (Contains 12 tables and 3 figures.)

Financial incentives for teachers to increase student performance is an increasingly popular education policy around the world. This paper describes a school-based randomized trial in over two-hundred New York City public schools designed to better understand the impact of teacher incentives on student achievement. I find no evidence that teacher incentives increase student performance, attendance, or graduation, nor do I find any evidence that the incentives change student or teacher behavior. If anything, teacher incentives may decrease student achievement, especially in larger schools. The paper concludes with a speculative discussion of theories that may explain these stark results.

In the 2007-2008 school year, the New York City Department of Education and the United Federation of Teachers jointly implemented the Schoolwide Performance Bonus Program in a random sample of the city's high-needs public schools. The program lasted for three school years, and its broad objective was to improve student performance through school-based financial incentives. The question, of course, was whether it was doing so. To examine its implementation and effects, the department tasked a RAND Corporation-led partnership with the National Center on Performance Incentives at Vanderbilt University to conduct a two-year study of the program that would offer an independent assessment. This report describes the results of our analyses for all three years of the program, from 2007-2008 through 2009-2010. This work built on past research and was guided by a theory of action articulated by program leaders. Researchers examined student test scores; teacher, school staff, and administrator surveys; and interviews with administrators, staff members, program sponsors, and union and district officials. The researchers found that the program did not, by itself, improve student achievement, perhaps in part because conditions needed to motivate staff were not achieved (e.g., understanding, buy-in for the bonus criteria) and because of the high level of accountability pressure all the schools already faced. Individual chapters contain footnotes. (Contains 12 figures and 66 tables.) [Additional funding for this paper was provided by the New York City Fund for Public Schools. For "What New York City's Experiment with Schoolwide Performance Bonuses Tells Us about Pay for Performance. Research Brief," see ED521918.]

This article reports the effects of a comprehensive elementary school-based social-emotional and character education program on school-level achievement, absenteeism, and disciplinary outcomes utilizing a matched-pair, cluster-randomized, controlled design. The "Positive Action" Hawai'i trial included 20 racially/ethnically diverse schools (M enrollment = 544) and was conducted from the 2002-03 through the 2005-06 academic years. Using school-level archival data, analyses comparing change from baseline (2002) to 1-year posttrial (2007) revealed that intervention schools scored 9.8% better on the TerraNova (2nd ed.) test for reading and 8.8% on math, that 20.7% better in Hawai'i Content and Performance Standards scores for reading and 51.4% better in math, and that intervention schools reported 15.2% lower absenteeism and fewer suspensions (72.6%) and retentions (72.7%). Overall, effect sizes were moderate to large (range = 0.5-1.1) for all of the examined outcomes. Sensitivity analyses using permutation models and random-intercept growth curve models substantiated results. The results provide evidence that a comprehensive school-based program, specifically developed to target student behavior and character, can positively influence school-level achievement, attendance, and disciplinary outcomes concurrently. (Contains 6 tables and 2 figures.)

In 2004, the U.S. Department of Education's Institute of Education Sciences contracted with Mathematica Policy Research to conduct a large-scale evaluation of comprehensive teacher induction. The purpose of the study was to determine whether augmenting the set of services districts usually provide to support beginning teachers with a more comprehensive program improves teacher and student outcomes. This is the study's third and final report on the program's impacts. This report compares retention, achievement, and classroom practices of teachers who were offered comprehensive induction services to teachers who were offered the support normally offered by the school. Teachers assigned to receive comprehensive induction for either one or two years were supported by a full-time mentor who received ongoing training and materials to support the teachers' development. The teachers also were offered monthly professional development sessions and opportunities to observe veteran teachers. The teachers were followed for three years. Data was collected from 1,009 beginning teachers in 418 schools in 17 districts. Districts included in the study were not already offering comprehensive induction services, including paying for full-time mentors. Novice teachers in approximately half of the schools were assigned by lottery to receive comprehensive induction services. In 10 of the districts, these teachers were provided one year of comprehensive induction services; in the remaining 7 districts, the teachers were provided two years of services. Teachers in the schools not assigned to receive comprehensive induction services were provided the support normally offered to novice teachers by the school. Teacher practices were measured via classroom observations conducted in the spring of 2006. Data on teacher retention were collected via surveys administered in the fall of 2006, 2007, and 2008. Student test scores were collected from district administrative records for the 2005-06, 2006-07, and 2007-08 school years. Key findings include: (1) During the comprehensive induction program, treatment teachers received more support than control teachers; (2) The extra induction support for treatment teachers did not translate into impacts on classroom practices in the first year; (3) For teachers who received one year of comprehensive induction, there was no impact on student achievement; (4) For teachers who received two years of comprehensive induction, there was no impact on student achievement in the first two years. In the third year, there was a positive and statistically significant impact on student achievement; and (5) Neither exposure to one year nor exposure to two years of comprehensive induction had a positive impact on retention or other teacher workforce outcomes. The following are appended: (1) Supplemental Information for Chapters II and III; (2) Supplemental Information for Chapter IV; (3) Sensitivity Analyses and Supplemental Information for Chapter V; and (4) Sensitivity Analyses and Supplemental Information for Chapter VI.

Teacher compensation schemes are often criticized for lacking a performance-based component. Proponents of merit pay argue that linking teacher salaries to student achievement will incentivize teachers to focus on raising student achievement and stimulate innovation across the school system as a whole. In this paper, we utilize a policy experiment conducted in the New York City public school system to explore the effects of one performance-based bonus scheme. We investigate potential impacts of group-based incentive pay over two academic years (2007-2008 and 2008-2009) on a range of outcomes including: teacher effort, student performance in math and reading, and classroom activities, measured through environmental surveys of teachers and students. We also explore impacts on the market for teachers by examining teacher turnover and the qualifications of newly hired teachers. Overall, we find the bonus program had little impact on any of these outcomes. We argue that the lack of bonus program impacts can be explained by the structure of the bonus program. Group bonuses led to free-riding, which significantly reduced the program's incentives. Once we account for free-riding, we find evidence that the program led teachers to increase their effort through a significant reduction in absenteeism. When considering the effectiveness of performance-based teacher pay, the structure of incentives matter. (Contains 11 tables, 3 figures and 24 footnotes.)

The primary purpose of this study was to explore if there could be a more beneficial method in organizing the individual instructional reading components (phonological decoding, spelling, fluency, and reading comprehension) within a remedial reading program to increase sensitivity to instruction for middle school students with reading disabilities (RD). Three different modules (Alternating, Integrated, and Additive) of the Reading Achievement Multi-Modular Program were implemented with 90 middle school (sixth to eighth grades) students with reading disabilities. Instruction occurred 45 min a day, 5 days a week, for 26 weeks, for approximately 97 h of remedial reading instruction. To assess gains, reading subtests of the Woodcock Johnson-III, the Gray Silent Reading Test, and Oral Reading Fluency passages were administered. Results showed that students in the Additive module outperformed students in the Alternating and Integrated modules on phonological decoding and spelling and students in the Integrated module on comprehension skills. Findings for the two oral reading fluency measures demonstrated a differential pattern of results across modules. Results are discussed in regards to the effect of the organization of each module on the responsiveness of middle school students with RD to instruction.

The primary purpose of this study was to explore if there could be a more beneficial method in organizing the individual instructional reading components (phonological decoding, spelling, fluency, and reading comprehension) within a remedial reading program to increase sensitivity to instruction for middle school students with reading disabilities (RD). Three different modules (Alternating, Integrated, and Additive) of the Reading Achievement Multi-Modular Program were implemented with 90 middle school (sixth to eighth grades) students with reading disabilities. Instruction occurred 45 min a day, 5 days a week, for 26 weeks, for approximately 97 h of remedial reading instruction. To assess gains, reading subtests of the Woodcock Johnson-III, the Gray Silent Reading Test, and Oral Reading Fluency passages were administered. Results showed that students in the Additive module outperformed students in the Alternating and Integrated modules on phonological decoding and spelling and students in the Integrated module on comprehension skills. Findings for the two oral reading fluency measures demonstrated a differential pattern of results across modules. Results are discussed in regards to the effect of the organization of each module on the responsiveness of middle school students with RD to instruction.

Children with attention deficit hyperactivity disorder (ADHD) make up a considerable proportion of students who receive special education services in schools. The present study aimed to enhance the outcomes of students with ADHD in special education settings by using a daily report card (DRC). Thirty-three children with ADHD in special education placements were randomly assigned to an intervention condition wherein behavioral consultants worked with the teacher and parent to construct and implement a DRC based on the child's individualized education plan goals and objectives. These children were compared to 30 children in a business as usual control condition. Results indicated positive effects of the DRC on observations of classroom functioning, individualized education plan goal attainment, and teacher ratings of academic productivity and disruptive behavior in the classroom. Further, a greater percentage of children with ADHD in the DRC group were normalized on measures of disruptive behavior and impairment. The intervention did not result in incremental improvement in academic achievement, teacher ratings of ADHD symptoms or impairment, or the student-teacher relationship. The implications of these results for working with children with ADHD in special education settings are discussed. (Contains 5 tables and 1 figure.)

This is the third-year report in a five-year evaluation of the Milwaukee Parental Choice Program (MPCP). The MPCP, which began in 1990, provides government-funded vouchers for low-income children to attend private schools in the City of Milwaukee. The general purposes of the evaluation are to analyze the effectiveness of the MPCP in terms of longitudinal student achievement growth and educational attainment as measured by high school graduation rates. The former will be primarily accomplished by measuring and estimating student growth in achievement as measured by the Wisconsin Knowledge and Concepts Examinations (WKCE) in math and reading in 2006-07, grades 3 through 8 over a five-year period. The latter will be accomplished by following the 2006-07 8th and 9th grade cohorts over a five-year period or longer. The general research design consists of a comparison between a random sample of MPCP students and a matched sample of Milwaukee Public School (MPS) students. This third year report presents results from the November 2008 WKCE tests as second year student achievement growth in MPCP relative to the matched MPS sample. We provide varying descriptive statistics comparing test score means and distributions for math and reading for 2006-07 (baseline year) and 2008-09 (second outcome year) for each sample. The report also analyzes achievement growth using several multivariate techniques and models. The primary finding in all these comparisons is that, in general, there are few statistically significant differences between levels of MPCP and MPS student achievement growth in either math or reading two years after they were carefully matched to each other. In one of the ways of estimating these results, focusing only on those students who have remained in the public or private sector for all three years, private, voucher students are slightly behind MPS students in mathematics achievement growth. The report offers several cautions in interpreting this result against the overwhelming set of results that indicate no difference in achievement growth. Appended are additional tables and study attrition. (Contains 9 tables, 2 figures, and 7 footnotes.) [Additional funding for this project was provided by the Robertson Foundation.]

In the No Child Left Behind Act (NCLB), Congress called for the U.S. Department of Education (ED) to conduct a rigorous study of the conditions and practices under which educational technology is effective in increasing student academic achievement. A 2007 report presenting study findings for the 2004-2005 school year, indicated that, after one school year, differences in student test scores were not statistically significant between classrooms that were randomly assigned to use software products and those that were randomly assigned not to use products. School and teacher characteristics generally were not related to whether products were effective. The second year of the study examined whether an additional year of teaching experience using the software products increased the estimated effects of software products on student test scores. The evidence for this hypothesis is mixed. For reading, there were no statistically significant differences between the effects that products had on standardized student test scores in the first year and the second year. For sixth grade math, product effects on student test scores were statistically significantly lower (more negative) in the second year than in the first year, and for algebra I, effects on student test scores were statistically significantly higher in the second year than in the first year. The study also tested whether using any of the 10 software products increased student test scores. One product had a positive and statistically significant effect. Nine did not have statistically significant effects on test scores. Five of the insignificant effects were negative and four were positive. Study findings should be interpreted in the context of design and objectives. The study examined a range of reading and math software products in a range of diverse school districts and schools. But it did not study many forms of educational technology and it did not include many types of software products. How much information the findings provide about the effectiveness of products that are not in the study is an open question. Products in the study also were implemented in a specific set of districts and schools, and other districts and schools may have different experiences with the products. The findings should be viewed as one element within a larger set of research studies that have explored the effectiveness of software products. Three appendixes are included: (1) Second-Year Data Collection and Response Rates; (2) Description of Sample for the 10 Products; and (3) Details of Estimation Methods. (Contains 29 footnotes, 4 figures and 24 tables.

In the No Child Left Behind Act (NCLB), Congress called for the U.S. Department of Education (ED) to conduct a rigorous study of the conditions and practices under which educational technology is effective in increasing student academic achievement. A 2007 report presenting study findings for the 2004-2005 school year, indicated that, after one school year, differences in student test scores were not statistically significant between classrooms that were randomly assigned to use software products and those that were randomly assigned not to use products. School and teacher characteristics generally were not related to whether products were effective. The second year of the study examined whether an additional year of teaching experience using the software products increased the estimated effects of software products on student test scores. The evidence for this hypothesis is mixed. For reading, there were no statistically significant differences between the effects that products had on standardized student test scores in the first year and the second year. For sixth grade math, product effects on student test scores were statistically significantly lower (more negative) in the second year than in the first year, and for algebra I, effects on student test scores were statistically significantly higher in the second year than in the first year. The study also tested whether using any of the 10 software products increased student test scores. One product had a positive and statistically significant effect. Nine did not have statistically significant effects on test scores. Five of the insignificant effects were negative and four were positive. Study findings should be interpreted in the context of design and objectives. The study examined a range of reading and math software products in a range of diverse school districts and schools. But it did not study many forms of educational technology and it did not include many types of software products. How much information the findings provide about the effectiveness of products that are not in the study is an open question. Products in the study also were implemented in a specific set of districts and schools, and other districts and schools may have different experiences with the products. The findings should be viewed as one element within a larger set of research studies that have explored the effectiveness of software products. Three appendixes are included: (1) Second-Year Data Collection and Response Rates; (2) Description of Sample for the 10 Products; and (3) Details of Estimation Methods. (Contains 29 footnotes, 4 figures and 24 tables.

This report describes results from field-testing of POWERSOURCE[C] formative assessment alongside professional development and instructional resources. The researchers at the National Center for Research, on Evaluation, Standards, & Student Testing (CRESST) employed a randomized, controlled design to address the following question: Does the use of POWERSOURCE[C] strategies improve 6th-grade student performance on assessments of the key mathematical ideas relative to the performance of a comparison group? Sixth-grade teachers were recruited from 7 districts and 25 middle schools. A total of 49 POWERSOURCE[C] and 36 comparison group teachers and their students (2,338 POWERSOURCE[C], 1,753 comparison group students) were included in the study analyses. All students took a pretest of prerequisite knowledge and a transfer measure of tasks drawn from international tests at the end of the study year. Students in the POWERSOURCE[C] group used sets of formative assessment tasks. POWERSOURCE[C] teachers had exposure to professional development and instructional resources. Results indicated that students with higher pretest scores tended to benefit more from the treatment as compared to students with lower pretest scores. In addition, students in the POWERSOURCE[C] group significantly outperformed control group students on distributive property items and the effect was larger as pretest scores increased. Results, limitations and future directions are discussed. Four appendices are included: (1) Item Analysis Results of POWERSOURCE[C] pretest; (2) POWERSOURCE[C] Pretest questionnaire; (3) POWERSOURCE[C] Pretest questionnaire; and (4) Descriptive Statistics of Posttest scores by District and Treatment, School, Teacher in Between-School Design and Teacher in within-School (W-S) Design. (Contains 12 figures and 29 tables.)

Using administrative data on public school students in North Carolina, we find that sixth grade students attending middle schools are much more likely to be cited for discipline problems than those attending elementary school. That difference remains after adjusting for the socioeconomic and demographic characteristics of the students and their schools. Furthermore, the higher infraction rates recorded by sixth graders who are placed in middle school persist at least through ninth grade. An analysis of end-of-grade test scores provides complementary findings. A plausible explanation is that sixth graders are at an especially impressionable age; in middle school, the exposure to older peers and the relative freedom from supervision have deleterious consequences. These findings are relevant to the current debate over the best school configuration for incorporating the middle grades. Based on our results, we suggest that there is a strong argument for separating sixth graders from older adolescents. (Contains 4 figures, 6 tables and 14 footnotes.)

High schools have recently become a popular source of mentors for school-based mentoring (SBM) programs. The high school Bigs program of Big Brothers Big Sisters of America, for example, currently involves close to 50,000 high-school-aged mentors across the country. While the use of these young mentors has several potential advantages, their age raises questions about their capacity to be consistent, positive role models, and, in turn, their potential to yield strong impacts for the youth they mentor. With support from The Atlantic Philanthropies and in collaboration with Big Brothers Big Sisters of America, Public/Private Ventures set out to address these questions using data from our large-scale random assignment impact study of Big Brothers Big Sisters SBM (Herrera, et al. 2007). We found that, on average, high school students were much less effective than adults at yielding impacts for the youth they mentor. However, our research identified several program practices that were linked with longer, stronger and more effective high school mentor relationships. High School Students as Mentors stresses the need for programs with high school volunteers to use the inherent strengths of these volunteers and, at the same time, meet their distinct needs. Big Brothers Big Sisters of America is already initiating most of the changes suggested in the study in its high school Bigs program; it has convened a group of six of its strongest Big Brothers Big Sisters agencies to review these and other findings and share their own experiences and strategies in an effort to strengthen their model. (Contains 41 endnotes, 3 figures and 2 tables.)

This study investigated the effectiveness of a multicomponent reading intervention implemented with middle school students with severe reading difficulties, all of whom had received remedial and/or special education for several years with minimal response to intervention. Participants were 38 students in grades 6-8 who had severe deficits in word reading, reading fluency, and reading comprehension. Most were Spanish-speaking English language learners (ELLs) with identified disabilities. Nearly all demonstrated severely limited oral vocabularies in English and, for ELLs, in both English and Spanish. Students were randomly assigned to receive the research intervention (n = 20) or typical instruction provided in their school's remedial reading or special education classes (n = 18). Students in the treatment group received daily explicit and systematic small-group intervention for 40 minutes over 13 weeks, consisting of a modified version of a phonics-based remedial program augmented with English as a Second Language practices and instruction in vocabulary, fluency, and comprehension strategies. Results indicated that treatment students did not demonstrate significantly higher outcomes in word recognition, comprehension, or fluency than students who received the school's typical instruction and that neither group demonstrated significant growth over the course of the study. Significant correlations were found between scores on teachers' ratings of students' social skills and problem behaviors and posttest decoding and spelling scores, and between English oral vocabulary scores and scores in word identification and comprehension. The researchers hypothesize that middle school students with the most severe reading difficulties, particularly those who are ELLs and those with limited oral vocabularies, may require intervention of considerably greater intensity than that provided in this study. Further research directly addressing features of effective remediation for these students is needed.

In practice, teacher induction is common, but induction that is intensive, comprehensive, structured, and sequentially delivered in response to teachers' emerging pedagogical needs is less so. Congressional interest in formal, comprehensive teacher induction has grown in recent years. The National Center for Education Evaluation and Regional Assistance within the U.S. Department of Education's (ED) Institute of Education Sciences (IES) contracted with Mathematica Policy Research, Inc. (MPR), to evaluate the impact of structured and intensive teacher induction programs. The study examines whether comprehensive teacher induction programs lead to higher teacher retention rates and other positive teacher and student outcomes as compared to prevailing, generally less comprehensive approaches to supporting new teachers. More specifically, the study is designed to address five research questions on the impacts of teacher induction services: (1) What is the effect of comprehensive teacher induction on the types and intensity of induction services teachers receive compared to the services they receive from the districts' current induction programs?; (2) What are the impacts on teachers' classroom practices?; (3) What are the impacts on student achievement?; (4) What are the impacts on teacher retention?; and (5) What is the impact on the composition of the district's teaching workforce? Statistically significant differences between the treatment and control groups were identified in the amount, types, and content of induction support teachers reported having received, both in the fall and the spring of the intervention year. Although treatment teachers reported receiving more mentoring than did control teachers; were more likely than control teachers to report participating in specific induction activities; and spent more time in certain professional activities than did control teachers during the three months prior to the spring survey, summarized comparisons between treatment and control groups found: (1) No impacts on teacher practices; (2) No positive impacts on student test scores; (3) No impacts on teacher retention; and (4) No positive impacts on composition of district teaching workforce. This report focused on the first year of findings only. The research team is conducting longer term follow-up to include additional collection of test score and teacher mobility data. Eight appendices are included: (1) National Data on Teacher Induction; (2) Analysis Weights; (3) Impact Estimation Methods; (4) Classroom Observation Methods; (5) Reference Tables for Chapter II; (6) Supplemental Tables for Chapter IV; (7) Supplemental Tables for Chapter V; and (8) Supplemental Figures. (Contains 43 footnotes, 15 figures and 101 tables.)

Under the "Math Science Partnership Grant," the Maui Hawaii Educational Consortium sought scientifically based evidence for the effectiveness of Carnegie Learning's "Cognitive Tutor[R]" (CT) program as part of the adoption process for pre-Algebra program. During the 2006-2007 school year, the researchers conducted a follow-on study to a previous randomized experiment in the Maui School District of the effectiveness of "CT" in Algebra I. In this second year, the focus was on the newly developed "Bridge to Algebra" program for pre-Algebra. The question being addressed specifically by the research is whether students in classes that use "CT" materials achieve higher scores on the standardized math assessment, as measured by the Northwest Evaluation Association (NWEA) General Math Test, than they would if they had been in a control classroom using the pre-Algebra curricula the Maui schools currently have in place. The researchers found that most students in both "CT" and control groups improved overall on the NWEA General Math Test. They did not find a difference in student performance in math between groups. Their analysis of the Algebraic Operations sub-strand revealed that many students in both groups did not demonstrate the growth in this scale, again with no discernible group differences. However, for Algebraic Operations outcomes, the researchers found a significant interaction between the pre-test and "CT": student scoring low before participating in "CT" got more benefit from the program's algebraic operations instruction than students with high initial scores. (Contains 8 figures, 33 tables, and 14 footnotes.) [For "Comparative Effectiveness of Carnegie Learning's "Cognitive Tutor Bridge to Algebra" Curriculum: A Report of a Randomized Experiment in the Maui School District. Research Summary," see ED538962.]

We examined the extent to which use of a technology-enhanced continuous progress monitoring system would enhance the results of math instruction, examined variability in teacher implementation of the program, and compared math results in classrooms in which teachers did and did not use the system. Classrooms were randomly assigned to within-school experimental and control groups. Participating students were pre- and post-tested using two standardized, nationally normed tests of math achievement. When teachers implemented the continuous progress monitoring system as intended, and when they used the data from the system to manage and differentiate instruction, students gained significantly more than those for whom implementation was limited or nil. Failure to take into account intervention integrity would have made it look like continuous progress monitoring did not enhance math results. (Contains 5 tables.)

This article describes a randomized evaluation of The Reading Edge, a reading program for middle school students. The Reading Edge was designed to integrate findings of research on cooperative learning and metacognitive reading strategies into a replicable reading instructional package that could be implemented effectively in Title I middle schools. In this study, 405 sixth graders in two high-poverty, rural middle schools previously unfamiliar with the program were randomly assigned to participate in The Reading Edge or to continue with their existing reading programs. After one year of instruction, observations of classroom use of metacognitive strategies, cooperative learning, goal setting/feedback, and classroom management, showed moderate levels of implementation in Reading Edge classes but little use of metacognitive strategies, cooperative learning, or goal setting/feedback in control classes. Statistically significant differences in student scores on the Vocabulary subscale of the Gates-MacGinitie Reading Test, and marginally significant scores on the Total Achievement score, provide support for the basic reading model, but larger and longer studies are needed to establish the full effects of this approach. (Contains 1 table.)

This paper explores the development of students' knowledge of mathematical procedures. Students' tendency to develop rote knowledge of procedures has been widely commented on. An alternative, more flexible endpoint for the development of procedural knowledge is explored here, where students choose to deviate from established solving patterns on particular problems for greater efficiency. Students with no prior knowledge of formal linear equation solving techniques were taught the basic transformations of this domain. After instruction, students engaged in problem-solving sessions in two conditions. Treatment students completed the "alternative ordering task," where they were asked to re-solve a previously completed problem but using a different ordering of transformations. Those completing alternative ordering tasks demonstrated greater flexibility.

This study investigated the effects of computer-assisted comprehension practice using a researcher-developed computer program, Computer-Assisted Collaborative Strategic Reading (CACSR), with students who had disabilities. Two reading/language arts teachers and their 34 students with disabilities participated. Students in the intervention group received the CACSR intervention, which consisted of 50-min instructional sessions twice per week over 10 to 12 weeks. The results revealed a statistically significant difference between intervention and comparison groups' reading comprehension ability as measured by a researcher-developed, proximal measure (i.e., finding main ideas and question generation) and a distal, standardized measure (i.e., "Woodcock Reading Mastery Test," Passage Comprehension). Effect sizes for all dependent measures favored the CACSR group. Furthermore, a majority of students expressed positive overall perspectives of the CACSR intervention and believed that their reading had improved.

This study compared the use of two supplemental balanced and strategic reading interventions that targeted the decoding, fluency, and reading comprehension of upper-elementary and middle school students with reading disabilities (RD). All students had significant delays in decoding, fluency, comprehension, and language processing. Two comparable, intensive tutorial treatments differed only in the degree of explicitness of the comprehension strategy instruction. Overall, there was meaningful progress in students' reading decoding, fluency, and comprehension. Gains in formal measures of word attack and reading fluency after five weeks of intervention translated into grade-equivalent gains of approximately half a school year. Analysis of the trends in the daily informal fluency probes translated into a weekly gain of 1.28 correct words per minute. The more explicit comprehension strategy instruction was more effective than the less explicit treatment. Findings are discussed in light of the question of how to maximize the effects of reading interventions for older children with RD.

Although schools across the country are investing heavily in computers in the classroom, there is surprisingly little evidence that they actually improve student achievement. In this paper, we present results from a randomized study of a well-defined use of computers in schools: a popular instructional computer program, known as Fast ForWord, which is designed to improve language and reading skills. We assess the impact of the program on students having difficulty learning to read using four different measures of language and reading ability. Our estimates suggest that while use of the computer program may improve some aspects of students' language skills, it does not appear that these gains translate into a broader measure of language acquisition or into actual readings skills.

This study evaluated the efficacy of the computer-assisted intervention program known as Fast ForWord Language? in a sample of migrant students in Grades 1 through 6 who were native Spanish speakers. Fast ForWord Language? combines intensive training in multiple receptive English language skills with adaptive acoustic waveform lengthening and amplification to purportedly accelerate the English language learning skills of children who are nonnative English language speakers. Students either were randomly assigned to a treatment or no-contact control condition or were matched on grade, English language proficiency, and nonverbal IQ. All students were assessed in five domains before and immediately after the 4- to 8-week intervention: (a) spoken English language proficiency; (b) oral language competency; (c) phonological awareness; (d) basic reading skills; and (e) classroom behavior. Except for performance on a measure of sight-word recognition, on which children in the treatment group achieved a significantly greater gain than those in the control group, changes in test scores from pretest to posttest were equivalent for the two groups. However, when students who were least fluent in spoken English in each group were compared, the children in the treatment group demonstrated superior gains in expressive language, sight-word recognition, and pseudoword decoding. Thus, Fast ForWord Language? had a substantial, albeit limited impact on the oral language skills and reading performance of migrant children in this study. However, due to methodological weaknesses and limited treatment fidelity, the study results must be interpreted cautiously.

Developed and evaluated a middle school literacy program designed to meet the needs of urban early adolescents. Findings from evaluation in two schools implementing the Student Team Reading and Writing program and three comparison schools indicated higher achievement for program participants. (SLD)

Special education teachers (N=22) monitored the mathematics progress of 42 students (grades 2-8) with mild to moderate disabilities (mostly learning disabilities) for 20 weeks using curriculum-based measurement (CBM). Evaluation of instructional adjustments based on individual CBM results found that students whose instruction had been individually adjusted performed significantly better on a global achievement test than comparison students. (Contains references.) (DB)

The Self-Regulated Strategy Development model was used to assist six elementary students with learning disabilities develop a strategy for planning and writing essays, self-regulation, and positive attributions regarding effort and strategy use. Instruction had a positive effect on students' approach to writing, writing performance, and attributions for writing. (Author/CR)

Systematic curricular accommodations reduced the problem behaviors of four elementary students with behavioral disorders. Assessments identified student interests and curricular assignments associated with high levels of problem behavior. Curricular modification was then implemented. Results support adaptations that incorporate student interests to decrease undesirable and increase desirable behaviors. (Author/DB)

Four fifth and sixth grade students with learning disabilities were taught a strategy for comprehending word problems and devising appropriate solutions. Following instruction performance on mixed sets of addition and subtraction word problems improved. Although generalization to a different setting occurred, maintenance was mixed. (Author/DB)

The effects of on-going curriculum-based measurement of student growth and expert system instructional consultation on teacher planning and student achievement in mathematics operations were studied for 33 elementary teachers assigned to one control or 2 experimental groups. Each teacher worked with two learning disabled or emotionally disturbed students. (SLD)

Among 68 rural learning-disabled students in grades 5-7 having moderate decoding fluency and high decoding accuracy, a paraphrasing cognitive strategy increased reading comprehension of main ideas more effectively than repeated readings or control training. Paraphrasing plus repeated readings was no more effective than paraphrasing alone. Contains 26 references. (SV)

The study with three sixth-grade learning-disabled students found that a self-instructional strategy to facilitate the generation, framing, and planning of argumentative essays had a positive effect on the students' writing performance and self-efficacy. Effects were maintained over time and transferred to a new setting and new writing genre. (Author/DB)

A study investigated the effects of direct instruction in the process of revision on students' knowledge of the revision process, their ability to make revisions on paper, and the quality of their writing. Subjects, 30 sixth grade students, were divided into an experimental and a control group. The experimental group received instruction in the revision process while the control group read quality literature. After instruction, all subjects wrote a brief story. The next day, subjects were given an opportunity to revise their stories and to write another draft. Experimental group subjects were interviewed about potential revisions while control group subjects received no advice. The main variables analyzed were the number of areas suggested for revision, the average specificity of suggested changes, the total number of revisions made, and the quality scores obtained for the first and final draft. Results indicated that instruction did affect knowledge of the revision process and enhance revision efforts. Specifically, findings showed (1) that when compared to the control treatment, direct instruction in the process of revision did affect aspects of sixth graders' knowledge of the revision process; (2) that the instruction affected efforts to make revisions on paper, though there were no differential effects on types of revisions made; and (3) that the revision instruction affected the quality of the children's stories across drafts--judgments of quality for the experimental group increased substantially, while the same judgments for the control group remained relatively stable. (Six pages of references are included.) (JD)