This practice guide provides four evidence-based recommendations that teachers can use to deliver reading interventions to meet the needs of their students.

This practice guide provides evidence-based practices that can help teachers tailor their instructional approaches and/or their mathematics intervention programs to meet the needs of their students.

This practice guide provides four recommendations for improving elementary students’ writing. Each recommendation includes implementation steps and solutions for common roadblocks. The recommendations also summarize and rate supporting evidence. This guide is geared toward teachers, literacy coaches, and other educators who want to improve the writing of their elementary students.

This practice guide provides five recommendations for improving students’ mathematical problem solving in grades 4 through 8. This guide is geared toward teachers, math coaches, other educators, and curriculum developers who want to improve the mathematical problem solving of students.

This practice guide presents five recommendations intended to help educators improve students’ understanding of fractions. Recommendations include strategies to develop young children’s understanding of early fraction concepts and ideas for helping older children understand the meaning of fractions and the computations involved. The guide also highlights ways to build on students’ existing strategies to solve problems involving ratios, rates, and proportions.

Out-of-school time programs can enhance academic achievement by helping students learn outside the classroom.

Taking early action may be key to helping students struggling with mathematics.

Designed for elementary school educators and school- and district-level administrators, this guide offers prevention, implementation, and schoolwide strategies that can be used to reduce problematic behavior that interferes with the ability of students to attend to and engage fully in instructional activities.

The target audience for this guide is a broad spectrum of school practitioners such as administrators, curriculum specialists, coaches, staff development specialists and teachers who face the challenge of providing effective literacy instruction for English language learners in the elementary grades.

The objective of this guide is to provide teachers with specific recommendations that can be carried out in the classroom without requiring systemic change.

This guide includes a set of concrete actions relating to the use of instructional and study time that are applicable to subjects that demand a great deal of content learning, including social studies, science, and mathematics.

This guide offers five recommendations to help educators effectively use data to monitor students’ academic progress and evaluate instructional practices.

This guide identifies practices that can improve the performance of chronically low-performing schools—a process commonly referred to as creating "turnaround schools."

Class-Wide Function-Related Intervention Teams (CW-FIT) is a classroom management strategy designed to help teachers create a positive learning environment by decreasing disruptive behavior and improving social skills and prosocial behaviors among students.

Good Behavior Game is a classroom management strategy that aims to improve social skills, minimize disruptive behaviors, and create a positive learning environment. Teachers place students into teams and reward them for demonstrating appropriate behaviors and following classroom rules.

Web-Based Intelligent Tutoring for the Structure Strategy (ITSS) is a supplemental web-based program for students in grades K-8. It is intended to develop literacy skills needed to understand factual texts encountered in classrooms and everyday life. The program teaches students how to follow the logical structure of factual text and to use text structure to improve understanding and recall. In particular, ITSS highlights five main text structures that are used to (1) make comparisons; (2) present problems and solutions; (3) link causes and effects; (4) present sequences; and (5) describe things, people, creatures, places, or events. The program helps students classify the structure of a passage by identifying certain key words, such as “solution” and “in contrast,” that clue readers in to the type of arguments the text is making.

Success for All (SFA®) is a whole-school reform model (that is, a model that integrates curriculum, school culture, family, and community supports) for students in prekindergarten through grade 8. SFA® includes a literacy program, quarterly assessments of student learning, a social-emotional development program, computer-assisted tutoring tools, family support teams for students’ parents, a facilitator who works with school personnel, and extensive training for all intervention teachers. The literacy program emphasizes phonics for beginning readers and comprehension for all students. Teachers provide reading instruction to students grouped by reading ability for 90 minutes a day, 5 days a week. In addition, certified teachers or paraprofessionals provide daily tutoring to students who have difficulty reading at the same level as their classmates.

READ 180® is a reading program designed for struggling readers who are reading 2 or more years below grade level. It combines online and direct instruction, student assessment, and teacher professional development. READ 180® is delivered in 90-minute sessions that include whole-group instruction, three small-group rotations, and whole-class wrap-up. Small-group rotations include individualized instruction using an adaptive computer application, small-group instruction, and independent reading. READ 180® is designed for students in elementary through high school.

Teach For America (TFA) is a highly selective route to teacher certification that aims to place non-traditionally trained teachers in high-need public schools. Many TFA teachers hold bachelors’ degrees from selective colleges and universities, in fields outside of education. TFA teachers commit to teach for at least 2 years. TFA teachers receive 5–7 weeks of in-person training over the summer before they begin teaching, then continue to receive professional development and one-on-one coaching from TFA while teaching, in addition to support provided by their schools and districts. As full-time employees of the public schools where they work, TFA teachers receive the same salary and benefits as other first- or second-year teachers in their school or district.

Dual language programs are long-term instructional programs that provide content and literacy instruction to all students through two languages—English and a partner language—with the goals of promoting academic achievement, bilingualism and biliteracy, and sociocultural competence. Dual language programs can be implemented with students from one language group (in one-way programs) or with students from two language groups (in two-way programs).

The eMINTS Comprehensive Program aims to help teachers improve their practice and the outcomes of their students by offering structured professional development, coaching, and support for integrating technology into the classroom. The program’s goals include supporting teachers in using classroom technology to implement high-quality, inquiry-based learning, in which students develop understanding and knowledge of content matter by engaging in meaningful investigations that require reasoning, judgement, and decision making. The intervention can provide support to teachers in any subject area, including math, literacy, and science.

Achieve3000® is a supplemental online literacy program that provides nonfiction reading content to students in grades preK–12 and focuses on building phonemic awareness, phonics, fluency, reading comprehension, vocabulary, and writing skills. Achieve3000® is designed to help students advance their nonfiction reading skills by providing differentiated online instruction. Teachers use the program with an entire class but the assignments are tailored to each student’s reading ability level. For example, teachers assign an article and related activities to an entire class; the program then tailors the version of the article to each student by automatically increasing the difficulty of text when a student is ready for more challenging text. Achieve3000® provides lessons that follow a five-step routine: (1) respond to a Before Reading Poll, (2) read an article, (3) answer activity questions, (4) respond to an After Reading Poll, and (5) answer a Thought Question. Progress reports and student usage data, provided by the online tool, enable teachers to track both whole-class and individual student progress. The program is designed for diverse student groups, including general education students, struggling readers in need of intensive tutoring, and English learners.

Odyssey® Math is a web-based program developed by Compass Learning® for mathematics instruction in grades K–8. The online program includes a mathematics curriculum and formative assessments designed to support differentiated and data-driven instruction. Based on assessment results, the program generates an individualized sequence of mathematics topics and skills—a “learning path.” Odyssey® Math is often used as a prescriptive tool, where students can start by taking a diagnostic assessment aligned with local or state standards. Teachers can modify learning paths to match their lesson plans or to align them with district scopes and sequences.

Cooperative Integrated Reading and Composition^® (CIRC^®) is a comprehensive reading and writing program for students in grades 2–8. It includes story-related activities, direct instruction in reading comprehension, and integrated reading and language arts activities. Pairs of students (grouped either by or across ability levels) read to each other, predict how stories will end, summarize stories, write responses, and practice spelling, decoding, and vocabulary. Within cooperative teams of four, students work to understand the main idea of a story and work through the writing process. The CIRC^® process includes teacher instruction, team practice, peer assessment, and team/partner recognition. A Spanish version of the program was also designed for grades 2–5.

Peer-Assisted Learning Strategies is a peer-tutoring program for grades K–6 that aims to improve student proficiency in several disciplines. During the 30-35 minute peer-tutoring sessions, students take turns acting at the tutor, coaching and correcting one another as they work through problems. The designation of tutoring pairs and skill assignment is based on teacher judgement of student needs and abilities, and teachers reassign tutoring pairs regularly.  

Science Teachers Learning through Lesson Analysis (STeLLA®) is a professional development program, developed by BSCS Science Learning, that aims to improve students’ science achievement by improving teachers’ science content knowledge and their abilities to (a) explain science concepts to students, (b) clearly identify to students the science concepts used in student learning activities, and (c) engage students in thinking about science.

Fraction Face-Off! is a supplemental math program developed to support fourth-grade students who need assistance solving fraction problems. Teachers use program materials with individual students or small groups to promote understanding of the magnitude of fractions, to compare two fractions, to put three fractions in order, and to place fractions on a number line.

Balanced Leadership® is a professional development program for school principals and other current and aspiring school leaders in schools serving kindergarten through grade 12. School leaders participate in professional development sessions with trained facilitators over one or two years, practice what they learn between sessions, and can receive additional coaching and online support. McREL International, the company that developed the Balanced Leadership® program, based the framework and content of the professional development on research identifying key actions and behaviors of school leaders that are associated with improved student outcomes.

Self-Regulated Strategy Development (SRSD) is an intervention designed to improve students’ academic skills through a six-step process that teaches students specific academic strategies and self-regulation skills. The practice is especially appropriate for students with learning disabilities. The intervention begins with teacher direction and ends with students independently applying the strategy, such as planning and organizing ideas before writing an essay. More specifically, the six steps involve the teacher providing background knowledge, discussing the strategy with the student, modeling the strategy, helping the student memorize the strategy, supporting the strategy, and then watching as the student independently performs the strategy. A key part of the process is teaching self-regulation skills, such as goal-setting and self-monitoring, which aim to help students apply the strategy without guidance. The steps can be combined, changed, reordered, or repeated, depending on the needs of the student. The SRSD model can be used with students in grades 2 through 12 in individual, small group, or whole classroom settings.

Functional behavioral assessment (FBA) is an individualized problem-solving process for addressing student problem behavior. An assessment is conducted to identify the purpose or function of a student's problem behavior. This assessment process involves collecting information about the environmental conditions that precede the problem behavior and the subsequent rewards that reinforce the behavior. The information that is gathered is then used to identify and implement individualized interventions aimed at reducing problem behaviors and increasing positive behaviors. Accordingly, the studies evaluating FBA examine different FBA-based interventions identified for each student. FBA-based interventions can be used to address diverse problem behaviors, such as disruptive and off-task behaviors, noncompliance, and inappropriate social interactions.

The Lindamood Phoneme Sequencing® (LiPS®) program (formerly called the Auditory Discrimination in Depth® [ADD] program) is designed to teach students the skills they need to decode words and to identify individual sounds and blends in words. LiPS® is designed for emergent readers in kindergarten through grade 3 or for struggling, dyslexic readers. The program is individualized to meet students’ needs and is often used with students who have learning disabilities or difficulties. Initial activities engage students in discovering the lip, tongue, and mouth actions needed to produce specific sounds. After students are able to produce, label, and organize the sounds with their mouths, subsequent activities in sequencing, reading, and spelling use the oral aspects of sounds to identify and order them within words. The program also offers direct instruction in letter patterns, sight words, and context clues in reading.

Everyday Mathematics® is a core curriculum for students in prekindergarten through grade 6. At each grade level, the Everyday Mathematics® curriculum provides students with multiple opportunities to learn concepts and practice skills. Across grade levels, concepts are reviewed and extended in varying instructional contexts. The distinguishing features of Everyday Mathematics® are its focus on real-life problem solving, student communication of mathematical thinking, and appropriate use of technology. This curriculum also emphasizes balancing different types of instruction (including collaborative learning), using various methods for skills practice, and fostering parent involvement in student learning.

Open Court Reading© is a reading program for grades K–6 that is designed to teach decoding, comprehension, inquiry, and writing in a three-part progression. Part One of each unit, Preparing to Read, focuses on phonemic awareness, sounds and letters, phonics, fluency, and word knowledge. Part Two, Reading and Responding, emphasizes reading literature for understanding, comprehension, inquiry, and practical reading applications. Part Three, Language Arts, focuses on writing, spelling, grammar, usage, mechanics, and basic computer skills.

Spelling Mastery is designed to explicitly teach spelling skills to students in grades 1–6. One of several Direct Instruction curricula from McGraw-Hill that precisely specify how to teach incremental content, Spelling Mastery includes phonemic, morphemic, and whole-word strategies.

Read Naturally is an elementary and middle school supplemental reading program designed to improve reading fluency using a combination of books, audiotapes, and computer software. The program has three main strategies: repeated reading of text for developing oral reading fluency, teacher modeling of story reading, and systematic monitoring of student progress by teachers and the students themselves. Students work at a reading level appropriate for their achievement level, progress through the program at their own rate, and, for the most part, work on an independent basis. Read Naturally® can be used in a variety of settings, including classrooms, resource rooms, or computer or reading labs. Although the program was not originally developed for English language learners, additional materials for these students are currently available.

Great Explorations in Math and Science^® (GEMS^®) Space Science Sequence is an instructional curriculum for grades 3–5 that covers fundamental concepts, including planetary sizes and distance, the earth’s shape and movement, gravity, and moon phases and eclipses. Part of the GEMS^® core curriculum, GEMS^® Space Science Sequence uses the solar system as the focal point for learning. The sequence uses models, hands-on investigations, peer-to-peer discussions, reflection, and informational student readings. Students complete four units, each lasting between four and nine sessions. Each unit builds upon knowledge from previous units and can be used independently or in conjunction with one another for an overall learning progression.

Peer-Assisted Learning Strategies is a peer-tutoring program for grades K–6 that aims to improve student proficiency in several disciplines. During the 30-35 minute peer-tutoring sessions, students take turns acting at the tutor, coaching and correcting one another as they work through problems. The designation of tutoring pairs and skill assignment is based on teacher judgement of student needs and abilities, and teachers reassign tutoring pairs regularly.  

Technology Enhanced Elementary and Middle School Science (TEEMSS) is a physical science curriculum for grades 3–8 that uses computers, sensors, and interactive models to support investigations of real-world phenomena. Through 15 inquiry-based instructional units, students interact with computers, gather and analyze data, and formulate ideas for further exploration. This information is managed by software in a handheld computer and transmitted to other students and to the teacher. The program includes a web-based teacher-reporting tool that allows teachers to review student portfolios and gather student responses for assessment and class discussion.

Peer-Assisted Learning Strategies is a peer-tutoring program for grades K–6 that aims to improve student proficiency in several disciplines. During the 30-35 minute peer-tutoring sessions, students take turns acting at the tutor, coaching and correcting one another as they work through problems. The designation of tutoring pairs and skill assignment is based on teacher judgement of student needs and abilities, and teachers reassign tutoring pairs regularly.  

Peer-Assisted Learning Strategies is a peer-tutoring program for grades K–6 that aims to improve student proficiency in several disciplines. During the 30-35 minute peer-tutoring sessions, students take turns acting at the tutor, coaching and correcting one another as they work through problems. The designation of tutoring pairs and skill assignment is based on teacher judgement of student needs and abilities, and teachers reassign tutoring pairs regularly.  

Accelerated Reader™ is a computerized supplementary reading program that provides guided reading instruction to students in grades K–12. It aims to improve students’ reading skills through reading practice and by providing frequent feedback on students’ progress to teachers. The Accelerated Reader™ program requires students to select and read a book based on their area of interest and reading level. Upon completion of a book, students take a computerized quiz based on the book’s content and vocabulary. Quiz performance allows teachers to monitor student progress and to identify students who may need additional reading assistance.

Cooperative Integrated Reading and Composition^® (CIRC^®) is a comprehensive reading and writing program for students in grades 2–8. It includes story-related activities, direct instruction in reading comprehension, and integrated reading and language arts activities. Pairs of students (grouped either by or across ability levels) read to each other, predict how stories will end, summarize stories, write responses, and practice spelling, decoding, and vocabulary. Within cooperative teams of four, students work to understand the main idea of a story and work through the writing process. The CIRC^® process includes teacher instruction, team practice, peer assessment, and team/partner recognition. A Spanish version of the program was also designed for grades 2–5.

Fast ForWord® is a computer-based reading program intended to help students develop and strengthen the cognitive skills necessary for successful reading and learning. The program, which is designed to be used 30 to 100 minutes a day, five days a week, for 4 to 16 weeks, includes two components.

Reading Mastery is designed to provide systematic reading instruction to students in grades K–6. Reading Mastery can be used as an intervention program for struggling readers, as a supplement to a school’s core reading program, or as a stand-alone reading program, and is available in three versions. During the implementation of Reading Mastery, students are grouped with other students at a similar reading level, based on program placement tests. The program includes a continuous monitoring component.

Read Naturally is an elementary and middle school supplemental reading program designed to improve reading fluency using a combination of books, audiotapes, and computer software. The program has three main strategies: repeated reading of text for developing oral reading fluency, teacher modeling of story reading, and systematic monitoring of student progress by teachers and the students themselves. Students work at a reading level appropriate for their achievement level, progress through the program at their own rate, and, for the most part, work on an independent basis. Read Naturally® can be used in a variety of settings, including classrooms, resource rooms, or computer or reading labs. Although the program was not originally developed for English language learners, additional materials for these students are currently available.

Project CRISS® (CReating Independence through Student-owned Strategies) is a professional development program for teachers that aims to improve reading, writing, and learning for students in grades 3–12. The implementation of Project CRISS® does not require a change in the curriculum or materials being used in the classroom, but instead calls for a change in teaching style to focus on three primary concepts derived from cognitive psychology and brain research. These three concepts include students (1) monitoring their learning to assess when they have understood content, (2) integrating new information with prior knowledge, and (3) being actively involved in the learning process through discussing, writing, organizing information, and analyzing the structure of text to help improve comprehension.

The Lindamood Phoneme Sequencing® (LiPS®) program (formerly called the Auditory Discrimination in Depth® [ADD] program) is designed to teach students the skills they need to decode words and to identify individual sounds and blends in words. LiPS® is designed for emergent readers in kindergarten through grade 3 or for struggling, dyslexic readers. The program is individualized to meet students’ needs and is often used with students who have learning disabilities or difficulties. Initial activities engage students in discovering the lip, tongue, and mouth actions needed to produce specific sounds. After students are able to produce, label, and organize the sounds with their mouths, subsequent activities in sequencing, reading, and spelling use the oral aspects of sounds to identify and order them within words. The program also offers direct instruction in letter patterns, sight words, and context clues in reading.

READ 180® is a reading program designed for struggling readers who are reading 2 or more years below grade level. It combines online and direct instruction, student assessment, and teacher professional development. READ 180® is delivered in 90-minute sessions that include whole-group instruction, three small-group rotations, and whole-class wrap-up. Small-group rotations include individualized instruction using an adaptive computer application, small-group instruction, and independent reading. READ 180® is designed for students in elementary through high school.

Odyssey® Math is a web-based program developed by Compass Learning® for mathematics instruction in grades K–8. The online program includes a mathematics curriculum and formative assessments designed to support differentiated and data-driven instruction. Based on assessment results, the program generates an individualized sequence of mathematics topics and skills—a “learning path.” Odyssey® Math is often used as a prescriptive tool, where students can start by taking a diagnostic assessment aligned with local or state standards. Teachers can modify learning paths to match their lesson plans or to align them with district scopes and sequences.

Success for All (SFA®) is a whole-school reform model (that is, a model that integrates curriculum, school culture, family, and community supports) for students in prekindergarten through grade 8. SFA® includes a literacy program, quarterly assessments of student learning, a social-emotional development program, computer-assisted tutoring tools, family support teams for students’ parents, a facilitator who works with school personnel, and extensive training for all intervention teachers. The literacy program emphasizes phonics for beginning readers and comprehension for all students. Teachers provide reading instruction to students grouped by reading ability for 90 minutes a day, 5 days a week. In addition, certified teachers or paraprofessionals provide daily tutoring to students who have difficulty reading at the same level as their classmates.

ClassWide Peer Tutoring (CWPT) is a peer-assisted instructional strategy designed to be integrated with most existing reading curricula. This approach provides students with increased opportunities to practice reading skills by asking questions and receiving immediate feedback from a peer tutor. Pairs of students take turns tutoring each other to reinforce concepts and skills initially taught by the teacher. The teacher creates age-appropriate peer teaching materials for the peer tutors; these materials take into account tutees’ language skills and disabilities.

Peer Tutoring and Response Groups aims to improve the language and achievement of English learners by pairing or grouping students to work on a task. The students may be grouped by age or ability, or the groups may be mixed. Peer tutoring typically consists of two students assuming the roles of tutor and tutee, or “coach and player” roles. Peer response groups give four or five students shared responsibility for a task, such as editing a passage or reading and answering comprehension questions. Both peer tutoring pairs and peer response groups emphasize peer interaction and discussion to complete a task.

Caring School Community™ (CSC) is a modified version of a program formerly known as the Child Development Project. CSC is a multiyear school improvement program that involves all students in grades K–6. The program aims to promote core values, prosocial behavior, and a schoolwide feeling of community. The program consists of four elements originally developed for the Child Development Project: class meeting lessons, cross-age “buddies” programs, “homeside” activities, and schoolwide community. Class lessons provide teachers and students with a forum to get to know one another, discuss issues, identify and solve problems collaboratively, and make a range of decisions that affect classroom life. Cross-age buddies activities pair whole classes of older and younger students for academic and recreational activities that build caring cross-age relationships and create a schoolwide climate of trust. Homeside activities include short conversational activities that are sent home with students for them to do with parents or caregivers and then to discuss back in their classroom. The activities incorporate the families’ perspectives, cultures, and traditions, thereby promoting interpersonal understanding. Schoolwide community-building activities bring students, parents, and school staff together to create new school traditions.

Positive Action, at its core, teaches the philosophy that you feel good about yourself when you do positive actions and there is always a positive way to do everything. It is illustrated by the the Thoughts-Actions-Feelings about self Circle where positive thoughts lead to positive actions, which in turn lead to positive feelings about oneself. It also teaches the positive actions for physical, intellectual, social and emotional areas—the whole self. It is a Pre-K-12 school-based program that aims to promote good behavior while disrupting problem behaviors, improves academics, and develops social-emotional and character skills while improving mental and physical health and self-concept. Lessons are scripted and use a wide variety of strategies: classroom discussion, role-play, games, songs, journals, manipulatives and activity sheets and text booklets.

The goal of Instructional Conversations is to help English learners develop reading comprehension ability along with English language proficiency. Acting as facilitators, teachers engage students in discussions about stories, key concepts, and related personal experiences, allowing students to appreciate and build on each others’ experiences, knowledge, and understanding. Literature Logs require students to respond in writing to prompts or questions related to sections of stories. These responses are then shared in small groups or with a partner.

Too Good for Drugs™ is designed to promote elementary and middle school students’ life skills, character values, resistance skills to negative peer influence, and resistance to the use of illegal drugs, alcohol, and tobacco. The program is based on classroom discussions and structured activities that center on interactive learning and skill-building exercises. Students engage in role-play and cooperative learning games and are encouraged to apply the skills to different contexts. Too Good for Drugs™ also includes the optional elements of parental and community involvement.

Reading Mastery is designed to provide systematic reading instruction to students in grades K–6. Reading Mastery can be used as an intervention program for struggling readers, as a supplement to a school’s core reading program, or as a stand-alone reading program, and is available in three versions. During the implementation of Reading Mastery, students are grouped with other students at a similar reading level, based on program placement tests. The program includes a continuous monitoring component.

Fast ForWord® is a computer-based reading program intended to help students develop and strengthen the cognitive skills necessary for successful reading and learning. The program, which is designed to be used 30 to 100 minutes a day, five days a week, for 4 to 16 weeks, includes two components.

Connect with Kids aims to promote prosocial attitudes and positive behavior of elementary (grades 3–5) and secondary (grades 6–12) school students by teaching core character values. Lesson plans include videos, story summaries, discussion questions, student games, and activities for both core and supplemental character traits. The classroom curriculum is reinforced by a website component and schoolwide and community outreach components. The program can be incorporated into an existing curriculum or used as a standalone program. The school or teacher decides on the number of character traits covered in each session, so the program duration may vary from one semester to an entire academic year.

Lessons in Character is designed to promote elementary and middle school students’ knowledge about core character education values and, through that knowledge, shape children’s positive behaviors and support academic success. It consists of 24 lessons organized around weekly themes, writing activities, and class projects. Teachers introduce the theme with a story that shows a value in action; students then engage that topic with a variety of activities. The program also includes daily oral language development and weekly writing assignments, optional parts of the program’s implementation.

The Leadership and Assistance for Science Education Reform (LASER) program is intended to build capacity for implementing inquiry-based science curricula in schools and districts. When participating in LASER, school or district teams attend leadership development institutes to plan the implementation of inquiry-based science curricula. These school or district teams receive support for key aspects of implementation such as professional development for teachers, access to instructional materials, and support for selecting appropriate assessments. LASER also helps schools and districts partner with scientists, science educators, and local business and community leaders who can promote and further support the implementation of inquiry-based science instruction.

Literacy Design Collaborative provides professional development, coaching, and resources to support teachers to work collaboratively in their schools to design and use high-quality, standards-aligned literacy instruction materials aimed at building students’ reading, research, and writing skills. Literacy Design Collaborative guides teachers to implement literacy modules they can use to teach students the content and literacy skills needed to complete a culminating writing task. Teachers implement existing modules and design new ones. Teachers across content areas—including English language arts, social studies, and science—can use the Literacy Design Collaborative program.

Word Generation is a supplemental program that aims to improve students’ reading comprehension by building students’ vocabulary, academic language, and perspective-taking skills through classroom discussion and debate. Word Generation was developed for all students; however, English learners in particular could benefit from its focus on academic language. Word Generation consists of a series of interdisciplinary units with daily lessons focused on a high-interest issue to increase student engagement. Each unit targets a small number of academic vocabulary words that are integrated into texts, activities, writing tasks, debates, and discussions across content areas. Several Word Generation programs exist. In the Word Generation Weekly (WordGen Weekly) and Word Generation Elementary (WordGen Elementary) programs, units are intended to be used across English language arts, math, science, and social studies in grades 6–8 and grades 4 and 5, respectively. In the Science Generation (SciGen) and Social Studies Generation (SoGen) programs, units can supplement or be used in place of regular science and social studies curriculum units in grades 6–8. The different Word Generation programs can be implemented separately or together.

The National Board for Professional Teaching Standards (NBPTS) establishes standards for accomplished teachers and awards professional certification to teachers who can demonstrate that their teaching practices meet those standards. Educators and experts in child development and related fields established the organization, and these experts work to develop and refine the standards for accomplished teaching based on the knowledge and skills that effective teachers demonstrate. The standards reflect five core propositions: (1) effective teachers are committed to students and their learning, (2) effective teachers know the subjects they teach and how to teach those subjects to students, (3) effective teachers manage and monitor student learning, (4) effective teachers think systematically about their practice and learn from experience, and (5) effective teachers are members of learning communities. Those seeking certification from the NBPTS must complete a computer-based assessment and three portfolio entries. The certification process can take 1 to 5 years.

Achieve3000® is a supplemental online literacy program that provides nonfiction reading content to students in grades preK–12 and focuses on building phonemic awareness, phonics, fluency, reading comprehension, vocabulary, and writing skills. Achieve3000® is designed to help students advance their nonfiction reading skills by providing differentiated online instruction. Teachers use the program with an entire class but the assignments are tailored to each student’s reading ability level. For example, teachers assign an article and related activities to an entire class; the program then tailors the version of the article to each student by automatically increasing the difficulty of text when a student is ready for more challenging text. Achieve3000® provides lessons that follow a five-step routine: (1) respond to a Before Reading Poll, (2) read an article, (3) answer activity questions, (4) respond to an After Reading Poll, and (5) answer a Thought Question. Progress reports and student usage data, provided by the online tool, enable teachers to track both whole-class and individual student progress. The program is designed for diverse student groups, including general education students, struggling readers in need of intensive tutoring, and English learners.

System of Least Prompts (SLP) is a practice that involves defining and implementing a hierarchy of prompts to assist students in learning a skill. A prompt is an action by the teacher or other practitioner—such as a verbal instruction to complete a task—that helps a student respond correctly during a learning activity. To use the procedure, the teacher or other practitioner systematically delivers the prompts to students in order, starting with the prompt that provides the least amount of assistance, and providing additional prompts with increasing levels of assistance until the student can correctly perform the task independently. For example, if a student does not independently complete a task following the initial instruction, a teacher may help the student by providing the least-intrusive prompt, such as restating the instruction. If the response still does not occur, the teacher may present the next most intrusive prompt, such as rephrasing the instruction. The teacher continues with more intrusive prompts, such as modeling how to do the task, until the desired response occurs reliably or all the prompts in the sequence have been used. The last prompt, often called the controlling prompt, should result in the student responding correctly. SLP is also known as “least-to-most prompting” or “least intrusive prompts.” SLP does not have a single developer that provides guidance or materials.

Accelerated Math®, published by Renaissance Learning, is a software tool that provides practice problems for students in grades K–12 and provides teachers with reports to monitor student progress. Accelerated Math® creates individualized student assignments, scores the assignments, and generates reports on student progress. The software is typically used with the math curriculum being used in the classroom to add practice for students and help teachers differentiate instruction through the program’s progress-monitoring data.

Accelerated Math®, published by Renaissance Learning, is a software tool that provides practice problems for students in grades K–12 and provides teachers with reports to monitor student progress. Accelerated Math® creates individualized student assignments, scores the assignments, and generates reports on student progress. The software is typically used with the math curriculum being used in the classroom to add practice for students and help teachers differentiate instruction through the program’s progress-monitoring data.

Saxon Math is a curriculum for students in grades K–12. The amount of new math content students receive each day is limited and students practice concepts every day. New concepts are developed, reviewed, and practiced cumulatively rather than in discrete chapters or units.

Accelerated Reader™ is a computerized supplementary reading program that provides guided reading instruction to students in grades K–12. It aims to improve students’ reading skills through reading practice and by providing frequent feedback on students’ progress to teachers. The Accelerated Reader™ program requires students to select and read a book based on their area of interest and reading level. Upon completion of a book, students take a computerized quiz based on the book’s content and vocabulary. Quiz performance allows teachers to monitor student progress and to identify students who may need additional reading assistance.

TAP™ (formerly known as the Teacher Advancement Program) is a comprehensive educator effectiveness program that aims to improve student achievement through supports and incentives that attract, retain, develop, and motivate effective teachers. The program provides teachers with leadership opportunities and associated salary increases; ongoing, school-based professional development; rigorous evaluations; and annual performance bonuses based on a combination of teacher value added to student achievement and observations of their classroom teaching.

The New Teacher Center (NTC) Induction Model is a comprehensive and systemic approach to support beginning teachers (i.e., teachers new to the profession). The induction model aims to accelerate the effectiveness of beginning teachers at increasing student learning by providing one-on-one mentoring and professional development in a supportive school environment. The NTC works with school districts and state departments of education to design, develop, and implement induction programs that are aligned with both district priorities and NTC standards.

Reciprocal teaching is an interactive instructional practice that aims to improve students’ reading comprehension by teaching strategies to obtain meaning from a text. The teacher and students take turns leading a dialogue regarding segments of the text. Students discuss with their teacher how to apply four comprehension strategies—generating questions, summarizing, clarifying, and predicting—to passages of text. During the early stages of reciprocal teaching, the teacher assumes primary responsibility for modeling how to use these strategies. As students become more familiar with the strategies, there is a gradual shift toward student responsibility for talking through the application of the strategies to the text.

Reading Mastery is designed to provide systematic reading instruction to students in grades K–6. Reading Mastery can be used as an intervention program for struggling readers, as a supplement to a school’s core reading program, or as a stand-alone reading program, and is available in three versions. During the implementation of Reading Mastery, students are grouped with other students at a similar reading level, based on program placement tests. The program includes a continuous monitoring component.

Saxon Math is a curriculum for students in grades K–12. The amount of new math content students receive each day is limited and students practice concepts every day. New concepts are developed, reviewed, and practiced cumulatively rather than in discrete chapters or units.

Scott Foresman-Addison Wesley Elementary Mathematics is a core curriculum for students at all ability levels in kindergarten through grade 6. The program supports students’ understanding of key math concepts and skills, and it covers a range of mathematical content across grades. The curriculum focuses on questioning strategies, problem-solving skills, embedded assessment, and exercises tailored to students of different ability levels. The program provides explicit problem-solving instruction, hands-on activities, and opportunities to extend students’ mathematical understanding through reading and writing connections.

Read Naturally is an elementary and middle school supplemental reading program designed to improve reading fluency using a combination of books, audiotapes, and computer software. The program has three main strategies: repeated reading of text for developing oral reading fluency, teacher modeling of story reading, and systematic monitoring of student progress by teachers and the students themselves. Students work at a reading level appropriate for their achievement level, progress through the program at their own rate, and, for the most part, work on an independent basis. Read Naturally® can be used in a variety of settings, including classrooms, resource rooms, or computer or reading labs. Although the program was not originally developed for English language learners, additional materials for these students are currently available.

Fast ForWord® is a computer-based reading program intended to help students develop and strengthen the cognitive skills necessary for successful reading and learning. The program, which is designed to be used 30 to 100 minutes a day, five days a week, for 4 to 16 weeks, includes two components.

Investigations in Number, Data, and Space is an activity-based, K–5 mathematics curriculum designed to help students understand number and operations, geometry, data, measurement, and early algebra. Each instructional unit focuses on a particular content area and lasts for 2–5.5 weeks. The curriculum encourages students to develop their own strategies for solving problems and engage in discussion about their reasoning and ideas. The lessons are activity-based in order to facilitate increased comprehension of basic math fundamentals. The curriculum is presented through a series of resource books called ”curriculum units” that provide teachers with guidance on implementation. One or more of the units for each year has a software program associated with it. Other materials include manipulatives, flash cards, overheads, and textbooks.

Peer-Assisted Learning Strategies is a peer-tutoring program for grades K–6 that aims to improve student proficiency in several disciplines. During the 30-35 minute peer-tutoring sessions, students take turns acting at the tutor, coaching and correcting one another as they work through problems. The designation of tutoring pairs and skill assignment is based on teacher judgement of student needs and abilities, and teachers reassign tutoring pairs regularly.  

Success for All (SFA®) is a whole-school reform model (that is, a model that integrates curriculum, school culture, family, and community supports) for students in prekindergarten through grade 8. SFA® includes a literacy program, quarterly assessments of student learning, a social-emotional development program, computer-assisted tutoring tools, family support teams for students’ parents, a facilitator who works with school personnel, and extensive training for all intervention teachers. The literacy program emphasizes phonics for beginning readers and comprehension for all students. Teachers provide reading instruction to students grouped by reading ability for 90 minutes a day, 5 days a week. In addition, certified teachers or paraprofessionals provide daily tutoring to students who have difficulty reading at the same level as their classmates.

Open Court Reading© is a reading program for grades K–6 that is designed to teach decoding, comprehension, inquiry, and writing in a three-part progression. Part One of each unit, Preparing to Read, focuses on phonemic awareness, sounds and letters, phonics, fluency, and word knowledge. Part Two, Reading and Responding, emphasizes reading literature for understanding, comprehension, inquiry, and practical reading applications. Part Three, Language Arts, focuses on writing, spelling, grammar, usage, mechanics, and basic computer skills.

Reading Mastery is designed to provide systematic reading instruction to students in grades K–6. Reading Mastery can be used as an intervention program for struggling readers, as a supplement to a school’s core reading program, or as a stand-alone reading program, and is available in three versions. During the implementation of Reading Mastery, students are grouped with other students at a similar reading level, based on program placement tests. The program includes a continuous monitoring component.

Coping Power is based on the earlier Anger Coping Power program. It emphasizes social and emotional skills that are needed during the transition to middle school. The program incorporates child and parent components. The child component consists of thirty-four 50-minute group sessions and periodic individual sessions over the course of 15–18 months, although the program can be shortened to fit into a single school year. Lessons focus on goal setting, problem solving, anger management, and peer relationships. The parent component is composed of 16 group sessions and periodic individual meetings. Lessons support the child component of the program and address setting expectations, praise, discipline, managing stress, communication, and child study skills.

Accelerated Math®, published by Renaissance Learning, is a software tool that provides practice problems for students in grades K–12 and provides teachers with reports to monitor student progress. Accelerated Math® creates individualized student assignments, scores the assignments, and generates reports on student progress. The software is typically used with the math curriculum being used in the classroom to add practice for students and help teachers differentiate instruction through the program’s progress-monitoring data.

Accelerated Math®, published by Renaissance Learning, is a software tool that provides practice problems for students in grades K–12 and provides teachers with reports to monitor student progress. Accelerated Math® creates individualized student assignments, scores the assignments, and generates reports on student progress. The software is typically used with the math curriculum being used in the classroom to add practice for students and help teachers differentiate instruction through the program’s progress-monitoring data.

ClassWide Peer Tutoring (CWPT) is a peer-assisted instructional strategy designed to be integrated with most existing reading curricula. This approach provides students with increased opportunities to practice reading skills by asking questions and receiving immediate feedback from a peer tutor. Pairs of students take turns tutoring each other to reinforce concepts and skills initially taught by the teacher. The teacher creates age-appropriate peer teaching materials for the peer tutors; these materials take into account tutees’ language skills and disabilities.

Reciprocal teaching is an interactive instructional practice that aims to improve students’ reading comprehension by teaching strategies to obtain meaning from a text. The teacher and students take turns leading a dialogue regarding segments of the text. Students discuss with their teacher how to apply four comprehension strategies—generating questions, summarizing, clarifying, and predicting—to passages of text. During the early stages of reciprocal teaching, the teacher assumes primary responsibility for modeling how to use these strategies. As students become more familiar with the strategies, there is a gradual shift toward student responsibility for talking through the application of the strategies to the text.

READ 180® is a reading program designed for struggling readers who are reading 2 or more years below grade level. It combines online and direct instruction, student assessment, and teacher professional development. READ 180® is delivered in 90-minute sessions that include whole-group instruction, three small-group rotations, and whole-class wrap-up. Small-group rotations include individualized instruction using an adaptive computer application, small-group instruction, and independent reading. READ 180® is designed for students in elementary through high school.

Read Naturally is an elementary and middle school supplemental reading program designed to improve reading fluency using a combination of books, audiotapes, and computer software. The program has three main strategies: repeated reading of text for developing oral reading fluency, teacher modeling of story reading, and systematic monitoring of student progress by teachers and the students themselves. Students work at a reading level appropriate for their achievement level, progress through the program at their own rate, and, for the most part, work on an independent basis. Read Naturally® can be used in a variety of settings, including classrooms, resource rooms, or computer or reading labs. Although the program was not originally developed for English language learners, additional materials for these students are currently available.

Project Read® is a multisensory language arts curriculum designed for use in a classroom or group setting. Two main objectives of the program are to use language in all its forms, and to use responsive instruction rather than preplanned textbook lessons. The program emphasizes direct instruction, and lessons move from letter-sounds to words, sentences, and stories. Project Read® has three strands: Phonics/Linguistics, Reading Comprehension, and Written Expression, which are integrated at all grade levels, though the emphasis of the specific strands differs by grade.

Accelerated Reader™ is a computerized supplementary reading program that provides guided reading instruction to students in grades K–12. It aims to improve students’ reading skills through reading practice and by providing frequent feedback on students’ progress to teachers. The Accelerated Reader™ program requires students to select and read a book based on their area of interest and reading level. Upon completion of a book, students take a computerized quiz based on the book’s content and vocabulary. Quiz performance allows teachers to monitor student progress and to identify students who may need additional reading assistance.

Odyssey® Math is a web-based program developed by Compass Learning® for mathematics instruction in grades K–8. The online program includes a mathematics curriculum and formative assessments designed to support differentiated and data-driven instruction. Based on assessment results, the program generates an individualized sequence of mathematics topics and skills—a “learning path.” Odyssey® Math is often used as a prescriptive tool, where students can start by taking a diagnostic assessment aligned with local or state standards. Teachers can modify learning paths to match their lesson plans or to align them with district scopes and sequences.

Accelerated Math®, published by Renaissance Learning, is a software tool that provides practice problems for students in grades K–12 and provides teachers with reports to monitor student progress. Accelerated Math® creates individualized student assignments, scores the assignments, and generates reports on student progress. The software is typically used with the math curriculum being used in the classroom to add practice for students and help teachers differentiate instruction through the program’s progress-monitoring data.

Project Read® is a multisensory language arts curriculum designed for use in a classroom or group setting. Two main objectives of the program are to use language in all its forms, and to use responsive instruction rather than preplanned textbook lessons. The program emphasizes direct instruction, and lessons move from letter-sounds to words, sentences, and stories. Project Read® has three strands: Phonics/Linguistics, Reading Comprehension, and Written Expression, which are integrated at all grade levels, though the emphasis of the specific strands differs by grade.

Houghton Mifflin Mathematics is a core mathematics curriculum for students at all ability levels in kindergarten through grade 6. At each grade level, the program focuses on basic skills development, problem solving, and vocabulary expansion to help students master key math concepts. Students practice daily math lessons through instructional software, enrichment worksheets, manipulatives, and workbooks, in addition to student textbooks. The program incorporates assessments—including lesson-level interventions to meet the needs of all learners—to monitor students’ progress.

An Ethics Curriculum for Children, a read-aloud literature-based curriculum, aims to teach elementary school students seven universal attributes of good character. Lessons and home assignments are organized around multicultural stories. The program activities are designed to connect the experiences of characters in the stories to students’ own lives. Optional parts of the Heartwood Ethics Curriculum for Children also include integration of character education themes across curricular topics and parental notification and involvement.

The Lindamood Phoneme Sequencing® (LiPS®) program (formerly called the Auditory Discrimination in Depth® [ADD] program) is designed to teach students the skills they need to decode words and to identify individual sounds and blends in words. LiPS® is designed for emergent readers in kindergarten through grade 3 or for struggling, dyslexic readers. The program is individualized to meet students’ needs and is often used with students who have learning disabilities or difficulties. Initial activities engage students in discovering the lip, tongue, and mouth actions needed to produce specific sounds. After students are able to produce, label, and organize the sounds with their mouths, subsequent activities in sequencing, reading, and spelling use the oral aspects of sounds to identify and order them within words. The program also offers direct instruction in letter patterns, sight words, and context clues in reading.

Open Court Reading© is a reading program for grades K–6 that is designed to teach decoding, comprehension, inquiry, and writing in a three-part progression. Part One of each unit, Preparing to Read, focuses on phonemic awareness, sounds and letters, phonics, fluency, and word knowledge. Part Two, Reading and Responding, emphasizes reading literature for understanding, comprehension, inquiry, and practical reading applications. Part Three, Language Arts, focuses on writing, spelling, grammar, usage, mechanics, and basic computer skills.

The purpose of this study was to test the efficacy of a comprehensive program model originally developed by the National Professional Development Center on Autism Spectrum Disorder (NPDC). Sixty elementary schools with 486 participants were randomly assigned to an NPDC and services as usual condition (SAU). Significantly greater changes in program quality occurred in the inclusive NPDC programs as compared with the SAU schools. Teachers in NPDC schools reported using more evidence-based practices (EBPs) and implemented EBPs with significantly greater fidelity than teachers in SAU schools. Autistic students in NPDC schools had significantly higher total attainment of educational goals than students in SAU schools, and the two groups made equivalent progress on standardized assessment outcomes across the school year. [This is the online first version of an article published in "Journal of Autism and Developmental Disorders."]

The recent wave of test-based accountability reforms has negatively impacted the provision of K-12 arts educational experiences. Advocates contend that, in addition to providing intrinsic benefits, the arts can positively influence academic and social development. However, the empirical evidence to support such claims is limited. We conducted a randomized controlled trial with 10,548 3rd-8th grade students who were enrolled in 42 schools that were assigned by lottery to receive substantial influxes of arts education experiences provided through school-community partnerships with local arts organizations, cultural institutions, and teaching-artists. We find that these increases in arts educational experiences significantly reduce the proportion of students receiving disciplinary infractions by 3.6 percentage points, improve STAAR writing achievement by 0.13 of a standard deviation, and increase students' compassion for others by 0.08 of a standard deviation. For students in elementary schools, which comprise 86 percent of the sample, we find that these arts educational experiences also significantly improve school engagement, college aspirations, and arts-facilitated empathy. These findings provide strong evidence that arts educational experiences can produce significant positive impacts on student academic and social development. Policymakers should consider these multifaceted educational benefits when assessing the role and value of the arts in K-12 schools.

Data-based problem solving is a hallmark of research-supported practices such as positive behavioral interventions and supports. In this study, we provided members of positive behavioral interventions and supports (PBIS) teams from 38 elementary schools with professional development focused on a research-supported problem-solving model (Team-Initiated Problem Solving). We used direct observations to document procedures, practices, and outcomes before and after participating in the professional development workshop. Within the context of a randomized waitlist controlled trial, team members in the Immediate Group demonstrated greater improvement in (a) problem-solving procedures, (b) decision-making practices, and (c) meeting outcomes than did members of PBIS teams in the Waitlist Group. Our findings extend what is known about team-based problem solving and provide a framework for future research and improved practice related to decision making by school teams.

With national focus on reading and math achievement, science and social studies have received less instructional time. Yet, accumulating evidence suggests that content knowledge is an important predictor of proficient reading. Starting with a design study, we developed content-area literacy instruction (CALI) as an individualized (or personalized) instructional program for kindergarteners through 4th graders to build science and social studies knowledge. We developed CALI to be implemented in general education classrooms, over multiple iterations (n = 230 students), using principles of design-based implementation research. The aims were to develop CALI as a usable and feasible instructional program that would, potentially, improve science and social studies knowledge, and could be implemented during the literacy block without negatively affecting students' reading gains (i.e., no opportunity cost). We then evaluated the efficacy of CALI in a randomized controlled field trial with 418 students in kindergarten through 4th grade. Results reveal that CALI demonstrates promise as a usable and feasible instructional individualized general education program, and is efficacious in improving social studies (d = 2.2) and science (d = 2.1) knowledge, with some evidence of improving oral and reading comprehension skills (d = 0.125).

Using data from seven cohorts of language immersion lottery applicants in a large, urban school district, we estimate the causal effects of immersion programs on students' test scores in reading, mathematics, and science, and on English learners' (EL) reclassification. We estimate positive intent-to-treat (ITT) effects on reading performance in fifth and eighth grades, ranging from 13 to 22 percent of a standard deviation, reflecting 7 to 9 months of learning. We find little benefit in terms of mathematics and science performance, but also no detriment. By sixth and seventh grade, lottery winners' probabilities of remaining classified as EL are three to four percentage points lower than those of their counterparts. This effect is stronger for ELs whose native language matches the partner language. [This article was published in: "American Educational Research Journal" v54 n1 suppl p282S-306S Apr 2017 (EJ1155308).]

This article describes the effects of an analysis-of-practice professional development (PD) program on elementary school students' (Grades 4-6) science outcomes. The study design was a cluster-randomized trial with an analysis sample of 77 schools, 144 teachers and 2,823 students. Forty-two schools were randomly assigned to treatment, (88.5 hours) of integrated analysis-of-practice and content deepening PD (over the course of one year) while 35 schools were randomly assigned to receive an equal number of PD hours in science content deepening alone. Students' content knowledge, as measured by a project-specific test, was compared across treatment groups. The effect size for this comparison was 0.52 standard deviations in favor of students whose teachers participated in the PD that included analysis-of-practice. This effect compares favorably to that of other elementary school interventions whose effectiveness was studied with a narrowly focused outcome measure. Analysis of the demographics of the study schools suggests that the treatment effect could be relevant outside the local study context. Implications for future research include tests of mediation for teacher-level outcomes and efficacy tests of specific teaching strategies (intervention subcomponents).

Success for All (SFA), one of the best-known school reform models, aims to improve the reading skills of all children but is especially directed at schools that serve large numbers of students from low-income families. First implemented in 1987, SFA combines a challenging reading program, whole-school reform elements, and an emphasis on continuous improvement, with the goal of ensuring that every child learns to read well in the elementary grades. This is the third and final report from an independent evaluation of the scale-up demonstration of the SFA elementary school reading program. Both the demonstration and the evaluation have been funded under the U.S. Department of Education's Investing in Innovation (i3) competition. Conducted by MDRC--a nonprofit, nonpartisan education and social policy research organization--the evaluation examines SFA's implementation and impacts in five school districts over a three-year period (the 2011-2012 school year through the 2013-2014 school year). It also includes an analysis of program costs. Finally, it considers the scale-up process itself--the methods employed and the extent to which the Success for All Foundation (SFAF), the organization that developed and provides technical assistance to schools operating the program, achieved its scale-up goals. [This report was written with Emma Alterman, Herbert Collado, and Emily Pramik. For the executive summary of this report, see ED579090. For the Early Findings report, see ED545452. For the Interim Report, see ED546642.]

This study reports on an evaluation of the "Reading Partners" program, which uses community volunteers to provide one-on-one tutoring to struggling readers in underresourced elementary schools. Established in 1999 in East Menlo Park, California, the mission of "Reading Partners" is to help children become lifelong readers by empowering communities to provide individualized instruction with measurable results. This report builds on those initial findings by describing the "Reading Partners" program and its implementation in greater detail, exploring whether the program is more or less effective for particular subgroups of students, and assessing some of the potential explanations for the program's success to date. In addition, this report includes an analysis of the cost of implementing the Reading Partners program in 6 of the 19 sites. The following are appended: (1) Implementation Study Methods; (2) Impact Study Methods and Teacher Survey; (3) Tutor Background Characteristics and Additional Impact Findings; (4) Cost Study Methods; and (5) Additional Cost Findings. [This report was written with A. Brooks Bowden and Yilin Pan.]

One way to improve struggling schools' access to effective teachers is to use selective transfer incentives. Such incentives offer bonuses for the highest-performing teachers to move into schools serving the most disadvantaged students. In this report, we provide evidence from a randomized experiment that tested whether such a policy intervention can improve student test scores and other outcomes in low-achieving schools. The intervention, known to participants as the Talent Transfer Initiative (TTI), was implemented in 10 school districts in seven states. The highest-performing teachers in each district--those who ranked in roughly the top 20 percent within their subject and grade span in terms of raising student achievement year after year (an approach known as value added)--were identified. These teachers were offered $20,000, paid in installments over a two-year period, if they transferred into and remained in designated schools that had low average test scores. The main findings from the study include: (1) The transfer incentive successfully attracted high value-added teachers to fill targeted vacancies; (2) The transfer incentive had a positive impact on test scores (math and reading) in targeted elementary classrooms; and (3) The transfer incentive had a positive impact on teacher-retention rates during the payout period; retention of the high-performing teachers who transferred was similar to their counterparts in the fall immediately after the last payout. Seven appendixes are included: (1) Supplemental Materials for Chapters I and II; (2) Value-Added Analysis to Identify Highest-Performing Teachers; (3) Supplemental Materials for Chapter III; (4) Identification of Focal Teachers; (5) Supplemental Materials for Chapter IV; (6) Supplemental Materials for Chapter V; and (7) Supplemental Materials for Chapter VI. (Contains 114 footnotes, 61 figures, and 92 tables.) [For the executive summary, see ED544268.]

The purposes of this study were to investigate the effects of an intervention designed to improve at-risk 4th graders' understanding of fractions and to examine the processes by which effects occurred. The intervention focused more on the measurement interpretation of fractions; the control condition focused more on the part-whole interpretation of fractions and on procedures. Intervention was also designed to compensate for at-risk students' limitations in the domain-general abilities associated with fraction learning. At-risk students (n = 259) were randomly assigned to intervention and control. Whole-number calculation skill, domain-general abilities (working memory, attentive behavior, processing speed, listening comprehension), and fraction proficiency were pretested. Intervention occurred for 12 weeks, 3 times per week, 30 min per session, and then fraction performance was reassessed. On each conceptual and procedural fraction outcome, effects favored intervention over control (effect sizes = 0.29 to 2.50), and the gap between at-risk and low-risk students narrowed for the intervention group but not the control group. Improvement in the accuracy of children's measurement interpretation of fractions mediated intervention effects. Also, intervention effects were moderated by domain-general abilities, but not whole-number calculation skill.

To identify links among professional development, teacher knowledge, practice, and student achievement, researchers have called for study designs that allow causal inferences and that examine relationships among features of interventions and multiple outcomes. In a randomized experiment implemented in six states with over 270 elementary teachers and 7,000 students, this project compared three related but systematically varied teacher interventions--"Teaching Cases, Looking at Student Work, and Metacognitive Analysis"--along with no-treatment controls. The three courses contained identical science content components, but differed in the ways they incorporated analysis of learner thinking and of teaching, making it possible to measure effects of these features on teacher and student outcomes. Interventions were delivered by staff developers trained to lead the teacher courses in their regions. Each course improved teachers' and students' scores on selected-response science tests well beyond those of controls, and effects were maintained a year later. Student achievement also improved significantly for English language learners in both the study year and follow-up, and treatment effects did not differ based on sex or race/ethnicity. However, only Teaching Cases and Looking at Student Work courses improved the accuracy and completeness of students' written justifications of test answers in the follow-up, and only Teaching Cases had sustained effects on teachers' written justifications. Thus, the content component in common across the three courses had powerful effects on teachers' and students' ability to choose correct test answers, but their ability to explain why answers were correct only improved when the professional development incorporated analysis of student conceptual understandings and implications for instruction; metacognitive analysis of teachers' own learning did not improve student justifications either year. Findings suggest investing in professional development that integrates content learning with analysis of student learning and teaching rather than advanced content or teacher metacognition alone. (Contains 1 figure and 4 tables.)

Domestic attempts to use financial incentives for teachers to increase student achievement have been ineffective. In this paper, we demonstrate that exploiting the power of loss aversion--teachers are paid in advance and asked to give back the money if their students do not improve sufficiently--increases math test scores between 0.201 (0.076) and 0.398 (0.129) standard deviations. This is equivalent to increasing teacher quality by more than one standard deviation. A second treatment arm, identical to the loss aversion treatment but implemented in the standard fashion, yields smaller and statistically insignificant results. This suggests it is loss aversion, rather than other features of the design or population sampled, that leads to the stark differences between our findings and past research.

Reading comprehension is a challenge for K-12 learners and adults. Nonfiction texts, such as expository texts that inform and explain, are particularly challenging and vital for students' understanding because of their frequent use in formal schooling (e.g., textbooks) as well as everyday life (e.g., newspapers, magazines, and medical information). The structure strategy is explicit instruction about how to strategically use knowledge about text structures for encoding and retrieval of information from nonfiction and has consistently shown significant improvements in reading comprehension. We present the delivery of the structure strategy using a web-based intelligent tutoring system (ITSS) that has the potential to offer consistent modeling, practice tasks, assessment, and feedback to the learner. Finally, we report on statistically significant findings from a large scale randomized controlled efficacy trial with rural and suburban 4th-grade students using ITSS.

This report presents the results of an experiment conducted in Alabama beginning in the 2006/07 school year, to determine the effectiveness of the Alabama Math, Science, and Technology Initiative (AMSTI), which aims to improve mathematics and science achievement in the state's K-12 schools. This study is the first randomized controlled trial testing the effectiveness of AMSTI in improving mathematics problem solving and science achievement in upper-elementary and middle schools. AMSTI is an initiative specific to Alabama and was developed and supported through state resources. An important finding is the positive and statistically significant effect of AMSTI on mathematics achievement as measured by the SAT 10 mathematics problem solving assessment administered by the state to students in grades 4-8. After one year in the program, student mathematics scores were higher than those of a control group that did not receive AMSTI by 0.05 standard deviation, equivalent to 2 percentile points. Nine of the 10 sensitivity analyses yielded effect estimates that were statistically significant at the 0.025 level, consistent with the main finding. The estimated effect of AMSTI on science achievement measured after one year was not statistically significant. Based on the SAT 10 science test administered by the state to students in grades 5 and 7, no difference between AMSTI and control schools could be discerned after one year. Changes in classroom instructional strategies, especially an emphasis on more active-learning strategies, are important to the AMSTI theory of action. Therefore, a secondary investigation of classroom practices was conducted, based on data from survey responses from teachers. For both mathematics and science, statistically significant differences were found between AMSTI and control teachers in the average reported time spent using the strategies. The effect of AMSTI on these instructional strategies was 0.47 standard deviation in mathematics and 0.32 standard deviation in science. Two years of AMSTI appeared to have a positive and statistically significant effect on achievement in mathematics problem solving, compared to no AMSTI. Two years of AMSTI appeared to have a positive and statistically significant effect on achievement in science. AMSTI appeared to have a positive and statistically significant effect on reading achievement as measured by the SAT 10 test of reading administered by the state to students in grades 4-8. AMSTI did not appear to have a statistically significant effect on teacher-reported content knowledge in mathematics or science after one year. AMSTI did not appear to have statistically significant differential effects on student achievement in mathematics problem solving or science based on racial/ethnic minority status, enrollment in the free or reduced-price lunch program, gender, or pretest level. Appended are: (1) Explanation of primary and secondary confirmatory outcome measures; (2) Explanation of exploratory research questions; (3) Selection and random assignment of schools; (4) Statistical power analysis; (5) Data collection procedures and timeline; (6) Description of program implementation data collected but not used in report; (7) Alabama Math, Science, and Technology Initiative (AMSTI) teacher survey #3; (8) Data cleaning and data file construction; (9) Attrition through study stages for samples used in the confirmatory analysis; (10) Description of degree rank; (11) Equivalence of Year 1 baseline and analyzed samples for confirmatory student-level and classroom practice outcomes; (12) Internal consistency and validity of active learning measures; (13) Number of students and teachers in schools in analytic samples used to analyze Year 1 confirmatory questions; (14) Attrition through study stages for samples used in Year 1 exploratory analysis; (15) Tests of equivalence for baseline and analytic samples for Year 1 exploratory outcomes; (16) Statistical power analyses for moderator analyses; (17) Derivation and motivation of the Bell-Bradley estimator when measuring estimated two-year effect of the Alabama Math, Science, and Technology Initiative (AMSTI); (18) Attrition through study stages for samples contributing to estimation of two-year effects; (19) Examination of equivalence in baseline and analytic samples used in the estimation of two-year effects; (20) Estimation model for two-year effects of the Alabama Math, Science, and Technology Initiative (AMSTI); (21) Topics and instructional methods used at the Alabama Math, Science, and Technology Initiative (AMSTI) summer institute; (22) Parameter estimates on probability scale for odds-ratio tests of differences between Alabama Math, Science, and Technology Initiative (AMSTI) and control conditions in Year 1 (associated with summer professional development and in-school support outcomes); (23) Descriptive statistics for variables that change to a binary scale used in the Alabama Math, Science, and Technology Initiative (AMSTI) and control conditions in Year 1; (24) Comparison of assumed parameter values and observed sample statistics for statistical power analysis after one year; (25) Parameter estimates for Stanford Achievement Test Tenth Edition (SAT 10) mathematics problem solving after one year; (26) Parameter estimates for Stanford Achievement Test Tenth Edition (SAT 10) science after one year; (27) Parameter estimates for active learning in mathematics after one year; (28) Parameter estimates for active learning in science after one year; (29) Sensitivity analyses of effect of the Alabama Math, Science, and Technology Initiative (AMSTI) on Stanford Achievement Test Tenth Edition (SAT 10) mathematics problem solving achievement after one year; (30) Sensitivity analyses of effect of the Alabama Math, Science, and Technology Initiative (AMSTI) on Stanford Achievement Test Tenth Edition (SAT 10) science achievement after one year; (31) Sensitivity analyses of effect of the Alabama Math, Science, and Technology Initiative (AMSTI) on active learning instructional strategies in mathematics classrooms after one year; (32) Sensitivity analyses of effect of the Alabama Math, Science, and Technology Initiative (AMSTI) on active learning instructional strategies in science classrooms after one year; (33) Tests for violations of factors associated with assumption of equal first year effects on students in Alabama Math, Science, and Technology Initiative (AMSTI) and control schools; (34) Post hoc adjustment to standard error for estimate of two-year effect of the Alabama Math, Science, and Technology Initiative (AMSTI) on mathematics achievement after two years; (35) Parameter estimates for effect of the Alabama Math, Science, and Technology Initiative (AMSTI) after two years; (36) Parameter estimates for effect of the Alabama Math, Science, and Technology Initiative (AMSTI) on student reading achievement after one year; (37) Parameter estimates for teacher content and student engagement after one year; (38) Estimates of effects for terms involving the indicator of treatment status in the analysis of the moderating effect of the three-level pretest variable; (39) Parameter estimates for the analysis of the moderating effect of racial/ethnic minority status on the impact of the Alabama Math, Science, and Technology Initiative (AMSTI) on reading after one year; (40) Parameter estimates for analysis of average effect of the Alabama Math, Science, and Technology Initiative (AMSTI) on reading by racial/ethnic minority students after one year; and (41) Parameter estimates for effect of the Alabama Math, Science, and Technology Initiative (AMSTI) on reading for White students after one year. (Contains 26 figures, 136 tables, 1 box and 130 footnotes.)

Schoolwide Positive Behavioral Interventions and Supports (SWPBIS) is a universal, schoolwide prevention strategy that is currently implemented in over 9,000 schools across the nation to reduce disruptive behavior problems through the application of behavioral, social learning, and organizational behavioral principles. SWPBIS aims to alter school environments by creating improved systems and procedures that promote positive change in student behavior by targeting staff behaviors. This study uses data from a 5-year longitudinal randomized controlled effectiveness trial of SWPBIS conducted in 37 elementary schools to examine the impact of training in SWPBIS on implementation fidelity as well as student suspensions, office discipline referrals, and academic achievement. School-level longitudinal analyses indicated that the schools trained in SWPBIS implemented the model with high fidelity and experienced significant reductions in student suspensions and office discipline referrals. (Contains 1 table and 5 figures.)

Students (n = 797) from 36 4th-grade classrooms were taught the control of variables strategy for designing experiments. In the instruct condition, classes were taught in an interactive lecture format. In the manipulate condition, students worked in groups to design and run experiments to determine the effects of four variables. In the both condition, classes received the interactive lecture and also designed and ran experiments. We assessed students' understanding using a written test of their ability to distinguish valid from invalid experimental comparisons. Performance on this test improved from the pretest to the immediate posttest in all conditions, and gains were maintained at a 5-month delay. For students from both higher and lower achieving schools, gains ordered as follows: both greater than instruct greater than manipulate. However, students from higher achieving schools showed greater gains in all conditions. Item analyses showed that the interactive lecture improved students' understanding of the need to control irrelevant variables, and experimentation improved students' understanding of the need to vary the focal variable. (Contains 4 tables, 2 figures and 1 footnote.)

This report summarizes the findings from a national evaluation of mentoring programs funded under the U.S. Department of Education's Student Mentoring Program. The impact evaluation used an experimental design in which students were randomly assigned to a treatment or control group. Thirty-two purposively selected School Mentoring Programs and 2,573 students took part in the evaluation, which estimated the impact of the programs over one school year on a range of student outcomes. The evaluation also describes the characteristics of the program and the mentors, and provides information about program delivery. The Student Mentoring Program is designed to fund grantees to enable them to provide mentoring to at-risk students in grades 4-8. The ultimate goal of the program is to improve student academic and behavioral outcomes through the guidance and encouragement of a volunteer mentor. Seventeen total impacts in the domains of academic achievement/engagement, interpersonal relationships/personal responsibility, and high-risk/delinquent behavior were measured. The main finding of the Impact Study was that there were no statistically significant impacts of the Student Mentoring Program for the sample as a whole on this array of student outcomes. However, there was some scattered evidence that impacts were heterogeneous across types of students. In particular, impacts on girls were statistically significantly different from impacts on boys for two self-reported scales: Scholastic Efficacy and School Bonding, and Pro-social Behaviors. For boys, the impact on Prosocial Behaviors was negative and statistically significant. For girls, the impact on Scholastic Efficacy and School Bonding was positive and statistically significant. The impact on truancy was negative and statistically significant for students below age 12. There were negative associations between program supervision of mentors and site-level impacts on three of the seventeen individual outcome measures: Pro-social Behaviors, grades in math and social studies, and a positive relationship with the outcome of school-reported delinquency. The report also presented results demonstrating that the Student Mentoring Program represented a fairly low level of intensity in terms of service: although grantees, on average, adhered to the general intents of the legislation and program guidance, they were simultaneously constrained by the limits of the school calendar and the population from which to draw mentors. Thirty-five percent of the control group students reported receiving mentoring either from the program or elsewhere in the community; this finding, coupled with the fact that not all treatment group students met with a mentor, reduced the treatment contrast and may have led to some dilution of the impacts on students compared to expectations. Seven appendices are included; (1) Sampling Design and Methodology; (2) Survey Instruments; (3) Construction of Student Outcome Measures; (4) Impact Analysis Results on Original Student Survey Scales and Measures; (5) Sensitivity Tests; (6) Standard Errors and Confidence Intervals of Main Effects; and (7) Site-Level Predictors and Impacts. (Contains 109 footnotes and 122 exhibits.) ["Impact Evaluation of the U.S. Department of Education's Student Mentoring Program. Final Report" was written with the assistance of Christine Dyous, Michelle Klausner, Nancy McGarry, Rachel Luck and William Rhodes.]

In this article, the authors report achievement outcomes of a multisite cluster randomized field trial of Open Court Reading 2005 (OCR), a K-6 literacy curriculum published by SRA/McGraw-Hill. The participants are 49 first-grade through fifth-grade classrooms from predominantly minority and poor contexts across the nation. Blocking by grade level within schools, the trial includes 27 classrooms receiving the OCR curricular materials and professional development and 22 "business-as-usual" control classrooms. Multilevel analyses of classroom-level effects of assignment to OCR reveal statistically significant treatment effects on all three of the Comprehensive Test of Basic Skills, 5th edition, Terra Nova literacy posttests. The OCR effect sizes are d = 0.16 for the Reading Composite, d = 0.19 for Vocabulary, and d = 0.12 for Reading Comprehension. These effects achieved across 27 classrooms and 5 schools demonstrate the potential for replicating improved literacy outcomes through the scale-up of OCR. (Contains 4 tables and 1 note.)

This paper reports on a randomized experiment to study the impact of an alternative teacher preparation program, Teach for America (TFA), on student achievement and other outcomes. We found that TFA teachers had a positive impact on math achievement and no impact on reading achievement. The size of the impact on math scores was about 15 percent of a standard deviation, equivalent to about one month of instruction. The general conclusions did not differ substantially for subgroups of teachers, including novice teachers, or for subgroups of students. We found no impacts on other student outcomes such as attendance, promotion, or disciplinary incidents, but TFA teachers were more likely to report problems with student behavior than were their peers. The findings contradict claims that such programs allowing teachers to bypass the traditional route to the classroom harm students.

Teach For America (TFA) was founded in 1989 to address the educational inequities facing children in low-income communities across the United States by expanding the pool of teacher candidates available to the schools those children attend. TFA recruits seniors and recent graduates from colleges around the country, people who are willing to commit to teach for a minimum of two years in low-income schools. TFA focuses its recruitment on people with strong academic records and leadership capabilities, whether or not they have planned to teach or have taken education courses. TFA is particularly interested in candidates that have the potential to be effective in the classroom but in the absence of TFA would not consider a teaching career. Consequently, most TFA recruits do not have education-related majors in college and therefore have not received the same training that traditional teachers are expected to have. After an executive summary and introduction, this discussion paper addresses the following: (1) How TFA Works; (2) Study Design; (3) Who Teaches in the Schools Where TFA Places Teachers?; (4) What Does Our Sample of Students Look Like?; (5) Were TFA Teachers Effective in the Classroom?; and (6) Did TFA Have an Impact on Other Student Outcomes? Primary findings from the study include: from the perspective of a community or a school faced with the opportunity to hire TFA teachers, TFA offers an appealing pool of candidates; from the perspective of TFA and its funders, the organization is making progress toward its primary mission of reducing inequities in education--it supplies low-income schools with academically talented teachers who contribute positively to the academic achievement of their students; and from the perspective of policymakers who are trying to improve the educational opportunities of children in poor communities, many of the control teachers in the study were not certified or did not have formal pre-service training, highlighting the need for programs or policies that offer the potential of attracting good teachers to schools in the most disadvantaged communities--the findings show that TFA is one such program. Appended are: (1) Supplementary Tables; and (2) Estimation Approach. (Contains 17 tables and 6 figures.)

Because standardized tests in science are not given to PreK-3 students in Ohio, this report examined the longitudinal effects of learning from a teacher who had participated in the NURTURES professional development program. Specifically, it looked at the effects on students' mathematics and reading learning in grades 2-5 and science learning in 5th grade in 2017. Students who were in 5th grade at that time could have had a NURTURES-trained teacher at any time between kindergarten and 3rd grade. Thus, the study followed students up to 5 years after having a NURTURES teacher. The sample included the population of students enrolled in the 41 elementary schools in the Toledo Public School District. Students who never learned from a teacher who participated in NURTURES served as the control group. The data came from the 2017 administration of the Ohio Measure of Academic Progress (MAP) (NWEA, 2019) for mathematics and reading and the Ohio Achievement Test in Science for science (Ohio Achievement Assessment, 2015). The total number of students from these schools who took the May 2017 reading MAP was 6759 and the total number who took mathematics was 6703. The number of those students who had at least one NURTURES teacher was 2801 (41.4%) for reading and 2707 (41.6%) for mathematics. Analysis of the reading scores showed 2.14 advantage points for NURTURES students as compared to the average non-intervention student to an annual growth rate of 7.02 units (p < .001). The treatment effect size (Hedges' g) was 0.12. For mathematics there were 1.55 advantage points to an annual growth rate estimated to be 8.17 units (p < .001) as compared to the average non-intervention student. The treatment effect size (Hedges' g) was 0.09. Analysis of the 5th grade Ohio Achievement Science Subtest showed that students associated with at least one NURTURES-trained teacher was modeled to have a 5.86 advantage points as compared to the average non-intervention student. The treatment effect size (Hedges' g) was 0.08, which is to be interpreted as a treatment group having, on average, 0.08 higher scores in standard deviation units as compared to the scores of the control cohort. When compared with our earlier evaluation report (2016; revised in 2018), we see that students who had a NURTURES-trained teacher, on average, continued to show greater gains compared to students who did not. In addition, the achievement gaps between non-minority and minority students in reading and mathematics were reduced when the minority students had a NURTURES-trained teacher and the non-minority students did not. In science, the impact of the intervention roughly compensated for the attainment gap between boys and girls and partially ameliorated the gap between minority and non-minority children's scores associated with these demographic factors. [Published May 6, 2020 with minor revisions based in WWC inquiries published January 5, 2024.]

With the launch of the New York City Community Schools Initiative (NYC-CS) in 2014, the New York City Department of Education (NYCDOE) has increased its focus on the implementation of a holistic strategy of education reform to address the social consequences of poverty as a means to improving student outcomes. NYC-CS is a strategy to organize resources in schools and share leadership among stakeholders so that academics, health and wellness, youth development, and family engagement are integrated into the fabric of each school. New York City is implementing this strategy at a scale unmatched nationally. In this study, the authors assessed the impact of the NYC-CS through the 2017-2018 school year. The authors assessed the effects along seven outcome domains and explored the extent to which there is heterogeneity in programmatic impact based on student- and school-level characteristics. The authors leveraged innovative quasi-experimental methodology to determine whether students in the community schools are performing better than they would be had their schools not been designated as Community Schools. The findings of this report will contribute to the emerging evidence base on the efficacy of the community school strategy and will be useful for other school district- and state-level policymakers interested in developing or refining similar interventions that support students' and communities' academic, social, and emotional well-being. [The research described in this report was prepared for the New York City Mayor's Office for Economic Opportunity (NYC Opportunity).]

In 2013, the NYC Leadership Academy (NYCLA) developed a leadership intervention--the Targeted Intensive School Support (TISS) program--in collaboration with the New York City Department of Education (NYC DOE) to support schools that were facing particular challenges. NYCLA asked the RAND Corporation to provide an independent evaluation of the program's implementation and effects, and those findings are detailed in this report. The TISS program consisted of five key components: (1) teaming and collaborative training in aligned preservice preparation programs for a principal and assistant principal (AP); (2) coplacement of a principal and AP into an NYC DOE school; (3) team-based coaching to support the principal and AP; (4) 328 hours of extended coaching over the first three years after placement; and (5) use of a diagnostic process to guide goal setting and coaching according to school needs. Implementation findings suggest that only two of the five key components were implemented with fidelity. A propensity weighting approach was used to compare schools with TISS principals to other schools with new principals trained through residency-based preservice programs who did not participate in TISS. Findings suggest no statistically significant differences between TISS schools and comparison schools on measures of student achievement, school culture, and principal retention. TISS schools underperformed relative to comparison schools on the measure of chronic student absenteeism. [Sponsored by NYC Leadership Academy through a subgrant from the U.S. Department of Education.]

This study evaluated the efficacy of the Word Learning Strategies (WLS) supplementary program to improve elementary students' vocabulary skills and reading comprehension. The study used a multi-site cluster randomized, experimental design, which randomly assigned 92 4th grade classrooms (n=2558 students) from two cohorts to a treatment or control group. Results indicated that the program was positively associated with gains in students' vocabulary learning and knowledge as measured by the Word Learning Strategies Test and the VASE Assessment, and in students' reading comprehension as measured by the Gates-MacGrinitie Reading Test, after accounting for differences in baseline measures. The use of the WLS program also led to increases in teachers' awareness of strategies to support their students' vocabulary and reading comprehension. [This paper was published in the Proceedings of the 2019 Annual Meeting of the American Educational Research Association (AERA), Toronto, Canada.]

A growing body of research points to the ways in which principals influence teachers, classrooms, and, ultimately, student achievement. New Leaders aims to prepare transformational school leaders by partnering with districts and charter schools to offer rigorous, research-based training for aspiring principals. The Aspiring Principals program is New Leaders' signature program and has three core features: selective recruitment and admission, training and endorsement, and support for principals early in their tenure. This report is a follow-up to the 2014 evaluation of New Leaders' Aspiring Principals program. Focusing on the revised program, which was first implemented in 2012, the authors present evidence of the effectiveness of the revised Aspiring Principals program and share lessons that can inform principal-preparation policy and practice. To assess the effect of New Leaders' Aspiring Principals program, researchers analyzed whether schools and students led by graduates of the program outperformed comparison schools and students in the same district, focusing on student achievement and principal retention. They also examined program graduate placement and satisfaction with the Aspiring Principals program. [For the appendixes, see ED605724.]

The three-tiered Positive Behavioral Interventions and Supports (PBIS) framework promotes the development of systems and data analysis to guide the selection and implementation of evidence-based practices across multiple tiers. The current study examined the effects of universal (tier 1) or school-wide PBIS (SW-PBIS) in one state's scale-up of this tier of the framework. Annual propensity score weights were generated to examine the longitudinal effects of SW-PBIS from 2006-07 through 2011-12. School-level archival and administrative data outcomes were examined using panel models with an autoregressive structure. The sample included 1,316 elementary, middle, and high schools. Elementary schools trained in SW-PBIS demonstrated statistically significantly lower suspensions during the fourth and fifth study years (i.e., small effect size) and higher reading and math proficiency rates during the first two study years as well as in one and two later years (i.e., small to large effect sizes), respectively. Secondary schools implementing SW-PBIS had statistically significantly lower suspensions and truancy rates during the second study year and higher reading and math proficiency rates during the second and third study years. These findings demonstrate medium effect sizes for all outcomes except suspensions. Given the widespread use of SW-PBIS across nearly 26,000 schools in the U.S., this study has important implications for educational practices and policies. [This paper was published in the "Journal of School Psychology" v73 p41-55 Apr 2019 (ISSN 0022-4405).]

Across the country, school districts, their stakeholders, and policymakers have become increasingly concerned about suspensions, particularly about suspending students from elementary school and disproportionately suspending ethnic/racial minority students. Suspended students are less likely to graduate, possibly because they miss the instructional time they need to advance academically. Restorative practices have gained buy-in in the education community as a strategy to reduce suspension rates. Proactively improving relationships among students and staff and building a sense of community in classrooms and schools may make students less inclined to misbehave. And addressing severe misbehavior through a restorative approach may help students realize the impacts of their actions and make them less likely to offend again. This study of the implementation of restorative practices in the Pittsburgh Public Schools district (PPS) in school years 2015-16 and 2016-17 represents one of the first randomized controlled trials of the effects of restorative practices on classroom and school climates and suspension rates. The authors examined a specific restorative practices program -- the International Institute for Restorative Practices' SaferSanerSchools™ Whole-School Change program -- implemented in a selected group of PPS schools under a program called Pursuing Equitable and Restorative Communities, or PERC. The researchers found that PERC achieved several positive effects, including an improvement in overall school climates (as rated by teachers), a reduction in overall suspension rates, and a reduction in the disparities in suspension rates between African American and white students and between low- and higher-income students. Key Findings: Effects of the Pursuing Equitable and Restorative Communities (PERC) program in Pittsburgh Public Schools: (1) Implementation of restorative practices through PERC improved overall school climates, as rated by teachers; (2) Implementation of restorative practices reduced the average suspension rate: During the study period, average suspension rates decreased in both PERC and non-PERC schools, but rates decreased more in PERC schools; (3) Suspension rates of African American students and of those from low-income families also went down in PERC schools, shrinking the disparities in suspension rates between African American and white students and between low- and higher-income students; (4) Academic outcomes did not improve in PERC schools, and actually worsened for grades 6-8; and (5) Arrest rates among PERC schools did not decrease. Recommendations: (1) Given the constraints on teachers' time, emphasize restorative practices that can be woven into the school day; (2) Ensure that school leaders understand and can model restorative practices, including by providing mandatory professional development, books and other materials, and coaching on restorative practices; (3) Establish a mechanism for school staff to meet at least once per month as a professional learning community on restorative practices; (4) Ensure that leaders at the district level can coordinate this work; (5) Set, and update, clear expectations regarding the use of restorative practices; and (6) Implement data collection systems to collect accurate information on all types of behavioral incidents and remedies.

Although several studies have documented the effects of statewide private school choice programs on student test scores, this report is the first to examine the effects of one of these programs on college enrollment and graduation. Using data from the Florida Tax Credit (FTC) Scholarship program, we find that low-income Florida students who attended private schools using an FTC scholarship enrolled in and graduated from Florida colleges at a higher rate than their public school counterparts. [Additional support for this study was provided by the Bill and Susan Oberndorf Foundation and Kate and Bill Duhamel.]

We study the effectiveness of teachers certified by the National Board for Professional Teaching Standards (NBPTS) in Washington State, which has one of the largest populations of National Board-Certified Teachers (NBCTs) in the nation. Based on value-added models in math and reading, we find that NBPTS-certified teachers are about 0.01-0.05 student standard deviations more effective than non-NBCTS with similar levels of experience. Certification effects vary by subject, grade level, and certification type, with greater effects for middle school math certificates. We find mixed evidence that teachers who pass the assessment are more effective than those who fail, but that the underlying NBPTS assessment score predicts student achievement.

Behavioral trajectories during middle childhood are predictive of consequential outcomes later in life (e.g., substance abuse, violence). Social and emotional learning (SEL) programs are designed to promote trajectories that reflect both growth in positive behaviors and inhibited development of negative behaviors. The current study used growth mixture models to examine effects of the "Positive Action" program (PA) on behavioral trajectories of social-emotional and character development (SECD) and misconduct using data from a cluster-randomized trial that involved 14 schools and a sample of predominately low-income, urban youth followed from 3rd through 8th grade. For SECD, findings indicated that PA was similarly effective at improving trajectories within latent classes characterized as "High/declining" and "Low/stable". Favorable program effects were likewise evident to a comparable degree for misconduct across observed latent classes that reflected "Low/rising" and "High/rising" trajectories. These findings suggest that PA and perhaps other school-based universal SEL programs have the potential to yield comparable benefits across subgroups of youth with differing trajectories of positive and negative behaviors, making them promising strategies for achieving the intended goal of school-wide improvements in student outcomes. [This paper was published in "Prevention Science" v18 p214-224 2017.]

In 2013-14, the Wake County Public School System (WCPSS) launched Achieve3000 as a randomized controlled trial in 16 elementary schools. Achieve3000 is an early literacy program that differentiates non-fiction reading passages based on individual students' Lexile scores. Twoyear results show that Achieve3000 did not have a significant impact on student outcomes. However, both intent-to-treat and treatment-on-treated estimates show that in 2015, the second year of implementation, students in the treatment group outperformed their control-group counterparts by 0.13 standard deviation units (SD) on the year-end Achieve3000 LevelSet Lexile test. This effect size is consistent with mean empirical effect sizes reported by Lipsey et al. (2012). Yet in neither the pooled nor annual results did Achieve3000 significantly impact student performance on additional Lexile outcomes (EOG or DIBELS ORF). Both implementation and impact results for Achieve3000 suggest that the ability of this particular technology-based literacy solution to improve student performance beyond that of a control group fell short of vendor-defined and empirical expectations.

The purpose of this study was to evaluate the impact of Achieve3000, a differentiated online literacy curriculum, on students' scores on the California State Test (CST). In the 2011-12 school year, 1,957 students in Chula Vista began using Achieve3000's solutions in 3rd through 8th grade. Using a form of propensity score matching called Inverse Probability-of-Treatment Weighting (IPTW), the researchers assigned weights for the likelihood that students in the non-user comparison group (N = 7,598) could have been in the Achieve3000 treatment group. A Weighted Least Squares (WLS) regression model with IPTW weights estimated the average treatment effect. The researchers found that, overall, the students assigned to Achieve3000 performed statistically significantly higher on the CST, by 2.4 points, than students who were not using these solutions. This suggests the program is effective in improving student learning over conventional classroom activities in the first year of use, however more data is needed to determine the long term impact of usage. Five appendices contain supplemental tables and figures.

New Leaders is a nonprofit organization with a mission to ensure high academic achievement for all students by developing outstanding school leaders to serve in urban schools. Its premise is that a combination of preparation and improved working conditions for principals, especially greater autonomy, would lead to improved student outcomes. Its approach involves both preparing principals and partnering with school districts and charter management organizations (CMOs) to improve the conditions in which its highly trained principals work. As part of the partnerships, New Leaders agrees to provide carefully selected and trained principals who can be placed in schools that need principals and to provide coaching and other support after those principals are placed. The districts and CMOs agree to establish working conditions that support, rather than hinder, the principals' efforts to improve student outcomes. This report describes how the New Leaders program was implemented in partner districts, and it provides evidence of the effect that New Leaders has on student achievement. [The research in this report was produced within RAND Education. For the appendices that accompany this report, see ED561154. For the research brief, "Principal Preparation Matters: How Leadership Development Affects Student Achievement. Research Brief," see ED561155.]

The current teacher workforce is younger, less experienced, more likely to turnover, and more diverse in preparation experiences than the workforce of two decades ago. Research shows that inexperienced teachers are less effective, but we know little about the effectiveness of teachers with different types of preparation. In this study, we classify North Carolina public school teachers into "portals"--fixed and mutually exclusive categories that capture teachers' formal preparation and qualifications upon first entering the profession--and estimate the adjusted average test score gains of students taught by teachers from each portal. Compared with undergraduate-prepared teachers from in-state public universities, (a) out-of-state undergraduate-prepared teachers are less effective in elementary grades and high school, (b) alternative entry teachers are less effective in high school, and (c) Teach For America corps members are more effective in STEM subjects and secondary grades.

This is the final report in a five-year evaluation of the Milwaukee Parental Choice Program (MPCP). This report features analyses of student achievement growth four years after the authors carefully assembled longitudinal study panels of MPCP and Milwaukee Public Schools (MPS) students in 2006-07. The MPCP, which began in 1990, provides government-funded vouchers for low-income children to attend private schools in the City of Milwaukee. The maximum voucher amount in 2010-11 was $6,442, and 20,996 children used a voucher to attend either secular or religious private schools. The MPCP is the oldest and largest urban school voucher program in the United States. This evaluation was authorized by 2005 Wisconsin Act 125, which was enacted in 2006. The primary purpose of the evaluation is twofold: 1) to analyze the effectiveness of the MPCP in promoting growth in student achievement as compared to MPS; and 2) to examine the educational attainment--measured by high school graduation and college enrollment rates--of MPCP and MPS students. The first purpose is accomplished by gauging growth in student achievement--as measured by the Wisconsin Knowledge and Concepts Examinations (WKCE) in math and reading in grades 3 through 8 and grade 10--over a five-year period for a sample of MPCP students and a carefully matched group of MPS students. The second purpose is accomplished by following the 2006-07 8th and 9th grade MPCP and matched MPS cohorts over a five-year period during which they would have had the opportunity to graduate from high school and enroll in college. Appended are: (1) Descriptive Statistics; (2) Attrition Study; and (3) Stability of the Sample. (Contains 4 figures, 12 tables and 14 footnotes.) [For the "MPCP Longitudinal Educational Growth Study: Fourth Year Report. SCDP Milwaukee Evaluation. Report # 23", see ED518597. Additional support for this report was provided by the Robertson Foundation.]

In 2007, using funds from the federal Teacher Incentive Fund (TIF) and private foundations, the Chicago Public Schools (CPS) began piloting its version of a schoolwide reform model called the Teacher Advancement Program (TAP). Under the TAP model, teachers can earn extra pay and take on increased responsibilities through promotion (to mentor teacher or master teacher), and they become eligible for annual performance bonuses based on a combination of their contribution to student achievement (known as "value added") and observed performance in the classroom. The model calls for weekly meetings of teachers and mentors ("cluster groups"), and regular classroom observations by a school leadership team to help teachers meet their performance goals. The idea behind TAP is that giving teachers performance incentives, along with tools to track their performance and improve instruction, will help schools attract and retain talented teachers and help all teachers raise student achievement. This report is the last in a series of reports providing evidence on the impacts of CPS' version of TAP, called "Chicago TAP." It presents findings from the four-year implementation period, with special emphasis on the 2009-2010 and 2010-2011 school years, the third and fourth years of the program's rollout in Chicago. Earlier reports (Glazerman et al. 2009; Glazerman and Seifullah 2010) provide detailed data on each of the first two years of the program, respectively. CPS implemented Chicago TAP as a pilot program intended for 40 high-need schools. The program began in 10 schools in the first year (cohort 1) with a rollout plan to add 10 more Chicago TAP schools (cohorts 2, 3, and 4) in each year of the TIF grant's four-year implementation period. The authors address three research questions regarding Chicago TAP: (1) How was the program implemented?; (2) What impact did the program have on student achievement?; and (3) What impact did the program have on teacher retention within schools? To assess the first year under Chicago TAP for schools that began the program in fall 2009 (cohort 3), the authors looked at how teacher development and compensation practices in Chicago TAP schools differ from practices normally implemented in CPS schools. The authors found that teachers in Chicago TAP schools reported receiving significantly more mentoring support than teachers in similar non-TAP (control) schools. This finding reflects the fact that under the Chicago TAP model, teachers are guided by mentor teachers, and cluster groups meet weekly. They also found that veteran teachers in Chicago TAP schools were more likely than their control group counterparts to provide mentoring support to their colleagues; this finding is consistent with the fact that under Chicago TAP, teachers have the opportunity to assume leadership roles and responsibilities as Chicago TAP mentor or lead teachers. Teachers in Chicago TAP schools (veteran and novice) were aware of their eligibility for performance-based compensation. The authors found that the amount of compensation they expected approached the amount that was eventually paid out; that is, the average expectation was about $900, and the actual amount paid out in bonuses to this group was an average of about $1,100 per teacher. They generally did not find evidence of an impact of Chicago TAP on teacher attitudes or school climate. While the introduction of Chicago TAP led to real changes inside the schools, the program did not consistently raise student achievement as measured by growth in Illinois Standards Achievement Test (ISAT) scores. The authors found evidence of both positive and negative test score impacts in selected subjects, years, and cohorts of schools, but overall there was no detectable impact on math, reading, or science achievement that was robust to different methods of estimation. For example, impacts on science scores overall (across years and cohorts) were positive, but not statistically significant unless they used one particular matching method that excluded some Chicago TAP schools from the analysis. The authors did find evidence suggesting that Chicago TAP increased schools' retention of teachers, although the impacts were not uniform or universal across years, cohorts, and subgroups of teachers. They found that teachers who were working in Chicago TAP schools in 2007 returned in each of the following three years at higher rates than teachers in comparable non-TAP schools. For example, the authors found that 67 percent of classroom teachers in cohort 1 schools in fall 2007 returned to their same school in fall 2010 compared to about 56 percent of teachers in non-TAP schools, an impact of nearly 12 percentage points. In other words, teachers in Chicago TAP schools in fall 2007 were about 20% more likely than teachers in comparison schools to be in those same schools three years later. When the authors looked at teachers who were working in schools that started Chicago TAP in later years, some of the impact estimates were not statistically significant. The authors also found some evidence of impacts on retention for subgroups of teachers, such as those with less experience, but the pattern of findings was not consistent. When they considered retention of teachers in the district, the authors did not find consistent evidence of a measurable impact. Given that Chicago TAP is a school-specific program, their main focus was on school-level retention, as opposed to retention in the district. Appended are: (1) Propensity Score Matching; and (2) Supplemental Tables. (Contains 32 tables, 6 figures and 27 footnotes.) [For related reports, see "An Evaluation of the Teacher Advancement Program (TAP) in Chicago: Year One Impact Report. Final Report" (ED507502) and "An Evaluation of the Teacher Advancement Program (TAP) in Chicago: Year Two Impact Report" (ED510712).]

School leaders are increasingly being asked, whether by rhetoric or policy, to measurably improve student achievement. The resultant need to assist school leaders in their ability to improve teaching and learning for all students in their schools led to the establishment of the National Institute of School Leadership's (NISL's) Executive Development Program. The NISL program emphasizes the role of principals as strategic thinkers, instructional leaders, and creators of a just, fair, and caring culture in which all students meet high standards. The current national focus on the importance of effective, instructional leadership has, in turn, led to calls for principal evaluation to be tied directly to student achievement (Davis, Kearney, Sanders, Thomas, and Leon, 2011). Within this milieu, effective and proven principal leadership development programs are crucial. (Contains 3 tables and 2 figures.) [This report was produced by the Center for Educational Partnerships, Old Dominion University.]

We explored how a progress monitoring and instructional management system can be used to help educators differentiate instruction and meet the wide-ranging learning needs of their increasingly diverse classrooms. We compared classrooms in 24 states that used a curriculum-based progress monitoring and instructional management system, Accelerated Math, to same school control classrooms that did not use it. Among the major findings were the following: (1) At every grade level there were large differences in grade equivalent score and percentile gains for students in the experimental and control classrooms; (2) Gains were experienced across the achievement spectrum. An analysis of low-, middle-, and high-achieving students showed consistent rates of gain for each math objective mastered; (3) Intervention integrity had a significant effect on student achievement; (4) Teachers using the progress monitoring and instructional management system spent more time providing individual versus group instruction and felt better able to meet the individual needs of their students; and (5) Significantly more students who were in classrooms where teachers used the progress monitoring and instructional management system reported that they like math, help each other with math, and like math better this year than last year. Addition of a progress monitoring and instructional management system to ongoing mathematics instruction improves mathematics outcomes for students. The effects of the program clearly are a function of intervention integrity; when progress monitoring and instructional management practices are implemented with high fidelity or integrity, the mathematics performance of all students is significantly enhanced. Implications for practice are discussed.

Investigates the value of a tiered model of staff development for five districts using "teacher consultants" drawn from a parent district with a long writing project history. Evaluates preconditions, processes and outcomes. Discusses results in terms of student achievement and classroom practices. (SR)

Effects of variations in a schoolwide restructuring program, Success for All, in Baltimore (Maryland) on student reading achievement and other outcomes in elementary schools with large numbers of disadvantaged children are presented. Strong positive effects of the intervention are recognized, and program replication is discussed. (SLD)

An ABAB design was used to analyze the effects of positive peer reporting plus a randomized dependent group contingency (PPR + DGC). This intervention package was implemented across three classrooms in an alternative school setting for students diagnosed with emotional and behavioral disorders. The DGC consisted of the teacher randomly choosing a student to watch throughout the 45-min class period to determine if that student was following classroom rules. If so, the entire class earned a randomly selected reward at the end of class period. The intervention package also included two opportunities, one at the start and one at the end of class, for students to engage in positive reporting sessions. Results indicated an increase in engagement and a decrease in off-task and disruptive behavior while the intervention was implemented. The effects on positive and negative peer statements were ultimately minimal throughout all classrooms and phases. Social validity data indicated that teachers found the intervention package to be easy to include in their daily routine and stated that they would continue using this intervention package in the future. Discussion focuses on implications for practice and the need for additional research examining the effects of positive peer reports on student behavior.

We assessed the effects of a whole-school equity intervention implemented within a school-wide positive behavioral interventions and supports (PBIS) framework on racial inequities in school discipline in eight elementary schools with inequitable referrals for Black students. The intervention involved assessing patterns of racial disparities in school discipline decisions and providing professional development on adapting school-wide behavior systems to improve cultural responsiveness through concrete strategies targeting the patterns. After consent and matching on existing levels of racial inequities, half of the schools were randomly assigned to receive the intervention. Analyses showed that schools receiving the intervention had significant decreases in racial disparities in school discipline and rates of office discipline referrals (ODRs) for Black students, while control schools had minimal change. Results are discussed in terms of improving equity in school discipline within multitiered systems of support.

Learning fractions is a critical step in children's mathematical development. However, many children struggle with learning fractions, especially fraction arithmetic. In this article, we propose a general framework for integrating understanding of individual fractions and fraction arithmetic, and we use the framework to generate interventions intended to improve understanding of both individual fractions and fraction addition. The framework, Putting Fractions Together (PFT), emphasizes that both individual fractions and sums of fractions are composed of unit fractions and can be represented by concatenating them (putting them together). To illustrate, both "3/9" and "2/9 + 1/9" can be represented by concatenating three 1/9s; similarly, 2/9 + 1/8 can be represented by concatenating two 1/9s and one 1/8. Interventions based on the PFT framework were tested in 2 experiments with fourth, fifth, and sixth grade children. The interventions led to improved performance on number line estimation and magnitude comparison tasks involving individual fractions and sums of fractions with equal and unequal denominators. Especially large improvements were observed on relatively difficult unequal-denominator fraction sum problems. The findings suggest that viewing individual nonunit fractions and sums of fractions as concatenations of unit fractions provides a sound conceptual foundation for improving children's knowledge of both. We discuss implications of the research for teaching and learning fractions, children's numerical development, and mathematics education in general. [The article was published in "Journal of Educational Psychology" (EJ1291033).]

This study examined the effects of a small group intervention targeting paraphrasing and text structure instruction on the main idea generation and reading comprehension of students with reading disabilities in Grades 4 and 5. Students (N = 62) were randomly assigned to receive the Tier 2-type intervention or business-as-usual instruction. Students in the intervention received 25, 40-minute lessons focused on paraphrasing sections of text by identifying the main topic and the most important idea about that topic. Students utilized the text structure organization to inform their main idea generation. Results yielded statistically significant, positive effects in favor of the intervention group on near-transfer and mid-transfer measures of text structure identification (g = 0.75) and main idea generation (g = 0.70), but no statistically significant effect on a far-transfer measure of reading comprehension. These findings provide initial support for utilizing this instruction to improve students' main idea generation on taught and untaught structures.

Research indicates that students with emotional and behavioral disorders (EBD) may engage in severe disruptions and off-task behaviors in the classroom setting that adversely impact the learning environment. This leads to many students identified as having EBD being placed in alternative education settings, such as restrictive schools or residential facilities. Due to placement in more restrictive environments and high rates of disciplinary actions, it is especially critical to decrease disruptive behaviors for students diagnosed with EBD. In addition, classroom teachers report disruptive behaviors and conduct problems as a major barrier to teaching their students. An ABC multiple baseline across classes design was used in an alternative school setting to evaluate the effects of explicit social skills training combined with a group contingency on class-wide levels of engagement and disruptive behavior. Participants were students in the first through sixth grade diagnosed with EBD. Through the class-wide intervention, social skills acquisition deficits were targeted through social skills instruction and social skills performance deficits were targeted through reinforcement programs. Results showed an increase in engagement and a decrease in disruptive behavior across all classrooms as a result of the intervention package.

The purpose of this conceptual replication study was to investigate the efficacy of an early literacy intervention when it was implemented by special educators in general education classrooms with students in the class participating in the lessons. The study was conducted in 16 schools in three states. Eighty students with severe disabilities participated in the study. Students in the intervention group received Early Literacy Skills Builder (ELSB) instruction, and students in the "business-as-usual" control group received literacy instruction planned by special education teachers to address the students' individualized education program literacy goals. Literacy assessments were conducted in five waves scheduled across the school year. Results showed that students receiving ELSB instruction made greater gains in assessed literacy skills than students in the control group. These findings provide evidence that students with severe disabilities can benefit from comprehensive emergent literacy instruction when it is implemented in general education settings. [For the corresponding grantee submission, see ED601011.]

This randomized control trial examined the efficacy of an intervention aimed at improving multisyllabic word reading (MWR) skills among fourth- and fifth-grade struggling readers (n = 109, 48.6% male), as well as the relative effects of an embedded motivational beliefs training component. This study was a closely aligned replication of our earlier work. The intervention was replicated with a three-condition design: MWR only, MWR with a motivational beliefs component, and business-as-usual control. Students were tutored in small groups for 40 lessons (four 40-min lessons each week). When we combined performance of students in both MWR conditions, intervention students significantly outperformed controls on proximal measures of affix reading and MWR, as well as standardized measures of decoding, spelling, and text comprehension. Furthermore, there was a noted interaction between English learner status and treatment on spelling performance. There were no statistically significant main effects between the MWR groups on proximal or standardized measures of interest. Findings are discussed in terms of their relevance to MWR instruction for students with persistent reading difficulties and considerations for future research related to the malleability of motivation.

We examine the efficacy of an intervention to improve word reading and reading comprehension in fourth- and fifth-grade students with significant reading problems. Using a randomized control trial design, we compare the fourth- and fifth-grade reading outcomes of students with severe reading difficulties who were provided a researcher-developed treatment with reading outcomes of students in a business-as-usual (BAU) comparison condition. A total of 280 fourth- and fifth-grade students were randomly assigned within school in a 1:1 ratio to either the BAU comparison condition (n = 139) or the treatment condition (n = 141). Treatment students were provided small-group tutoring for 30 to 45 minutes for an average of 68 lessons (mean hours of instruction = 44.4, SD = 11.2). Treatment students performed statistically significantly higher than BAU students on a word reading measure (effect size [ES] = 0.58) and a measure of reading fluency (ES = 0.46). Though not statistically significant, effect sizes for students in the treatment condition were consistently higher than BAU students for decoding measures (ES = 0.06, 0.08), and mixed for comprehension (ES = -0.02, 0.14).

Effectively managing a classroom is crucial in promoting positive student outcomes. Behavior-specific praise is an empirically supported strategy to reinforce desirable student behaviors. Following a review of the literature, we identified tactile prompting and self-monitoring as effective methods to increase teachers' use of behavior-specific praise while sustaining intervention long enough until teachers contacted natural maintaining contingencies. We created electronic tactile awareness prompting with self-monitoring (eTAPS) by combining two applications on an Apple Watch. Using a multiple-baseline-across-participants design, this study primarily investigated the effects of eTAPS on special education teachers' use of behavior-specific praise. Secondarily, this study investigated the impact that behavior-specific praise would have on the on-task behaviors of targeted students with disabilities demonstrating frequent off-task behaviors. Results indicated that eTAPS was effective in increasing and maintaining behavior-specific praise rates. Furthermore, significant increases in student on-task behavior occurred. Implications of results and future research are discussed.

Objective: There are currently no empirically-supported, comprehensive school-based interventions (CSBIs) for children with autism spectrum disorder (ASD) without concomitant intellectual and language disability. This study compared outcomes for a CSBI (schoolMAX) to typical educational programming (services-as-usual [SAU]) for these children. Method: A total of 103 children (ages 6-12 years) with ASD (without intellectual and language disability) were randomly assigned by school buildings (clusters) to receive the CSBI (n=52 completed) or SAU (n=50 completed). The CSBI was implemented by trained school personnel and targeted social competence and ASD symptoms using social skills groups, emotion recognition instruction, therapeutic activities, behavioral reinforcement, and parent training. Outcome measures tested the effects of the CSBI on social competence and ASD symptoms, as well as potential collateral effects on academic achievement. Outcomes (baseline-to-follow-up) were assessed using tests of social-cognition and academic skills and behavioral observations (by masked evaluators) and parent-teacher ratings of ASD symptoms and social/social-communication skills (non-masked) [ClinicalTrials.gov, NCT03338530, https://www.clinicaltrials.gov/]. Results: The CSBI group improved significantly more than the SAU group on the test of emotion recognition skills and parent-teacher ratings of ASD symptoms (primary outcomes) and social/social-communication skills (secondary outcome). No differences between groups were detected for recess social interactions or academic skills. Conclusions: The CSBI improved several core areas of functioning for children with ASD compared to usual educational programming. Additional intervention elements may be needed to expand the efficacy of the CSBI so that the observed skills/symptom improvements generalize to recess social interactions and/or academic skills are enhanced. [This paper was published in the "Journal of Clinical Child and Adolescent Psychology" v48 n6 p922-933 Dec 2019.]

The purpose of the study was to conduct a randomized controlled trial (RCT) to demonstrate efficacy of the Class-wide Function-Related Intervention Teams (CW-FIT) program. The study was designed to replicate an initial RCT conducted by the CW-FIT developers in 1 site, with 2 additional research groups not involved in its development. The study was conducted across 3 states, in 21 culturally diverse schools, and with 83 teachers (classrooms) assigned to CW-FIT and 74 teachers (classrooms) assigned to the comparison group. The CW-FIT intervention included teaching prosocial skills and use of differential attention (teacher praise and points) for appropriate behaviors using a group contingency, class teams, goal setting, points, and rewards. Class-wide student on-task behavior improved, teacher praise and attention to appropriate behaviors increased, and reprimands decreased in the CW-FIT classes with significantly fewer changes over time for the comparison group.

This article presents findings from a randomized controlled trial (RCT) testing the impact of a novel coaching approach utilized as one element of the Double Check cultural responsivity and student engagement model. The RCT included 158 elementary and middle school teachers randomized to receive coaching or serve as comparisons; all participating teachers were exposed to school-wide professional development activities. Pre-post nonexperimental comparisons indicated improvements in self-reported culturally responsive behavior management and self-efficacy for teachers in both conditions following professional development exposure. With regard to the experimental findings, trained observers recorded significantly more proactive behavior management and anticipation of student problems by teachers, higher student cooperation, less student noncooperation, and fewer disruptive behaviors in classrooms led by coached teachers relative to comparison teachers. Taken together, the findings suggest the potential promise of coaching combined with school-wide professional development for improving classroom management practices and possibly reducing office discipline referrals among Black students.

Direct behavior rating (DBR) may be a viable assessment for documenting current areas of impaired functioning and progress monitoring students' response to a behavioral intervention. Challenging behaviors are often addressed in general education settings using interventions such as the daily report card (DRC). To best implement and monitor such interventions, effective progress monitoring tools are needed. The present study reports on the results of a multiple-baseline design across three elementary school children who had a DRC implemented to address academic engagement and social behaviors. The DRC and systematic direct observation (SDO) were compared with teacher-completed DBR to investigate the correspondence between these two measures of progress monitoring. Relative to SDO, results indicated that DBR was generally an effective means of monitoring progress for most cases and most target behaviors. The results of the present study support using DBR to monitor progress following the use of a behavioral intervention such as the DRC.

The purpose of this study was to investigate the effectiveness of a variation of the Good Behavior Game (GBG) in which teachers used ClassDojo to manage each team's progress. ClassDojo is a computer-based program that enables teachers to award students with points for demonstrating target behaviors. Dependent variables included class-wide disruptive and academically engaged behavior, teachers' ratings on the Behavior Intervention Rating Scale (BIRS), and the rate of teacher praise statements delivered in each phase. Overall, results indicated that the GBG with ClassDojo was effective at reducing disruptive behavior, increasing academically engaged behavior, and was rated as socially valid. Additionally, when the intervention was in place, increases in the amount of behavior-specific praise statements delivered were observed across all three classrooms.

Efficacy of an intensive reading intervention implemented during the nonacademic summer was evaluated in children with reading disabilities or difficulties (RD). Students (ages 6-9) were randomly assigned to receive Lindamood-Bell's "Seeing Stars" program (n = 23) as an intervention or to a waiting-list control group (n = 24). Analysis of pre- and posttesting revealed significant interactions in favor of the intervention group for untimed word and pseudoword reading, timed pseudoword reading, oral reading fluency, and symbol imagery. The interactions mostly reflected (a) significant declines in the nonintervention group from pre- to posttesting, and (2) no decline in the intervention group. The current study offers direct evidence for widening differences in reading abilities between students with RD who do and do not receive intensive summer reading instruction. Intervention implications for RD children are discussed, especially in relation to the relevance of summer intervention to prevent further decline in struggling early readers.

The achievement gaps between poor and more affluent students are persistent and chronic, as many students living in poverty are also members of more isolated communities where dialects such as African American English and Southern Vernacular English are often spoken. Non-mainstream dialect use is associated with weaker literacy achievement. The principal aims of the two experiments described in this paper were to examine whether second through fourth graders, who use home English in contexts where more formal school English is expected, can be taught to dialect shift between home and school English depending on context; and whether this leads to stronger writing and literacy outcomes. The results of two randomized controlled trials with students within classrooms randomly assigned to DAWS (Dialect Awareness, a program to explicitly teach dialect shifting), editing instruction, or a business as usual group revealed (1) that DAWS was more effective in promoting dialect shifting than instruction that did not explicitly contrast home and school English; and (2) that students in both studies who participated in DAWS were significantly more likely to use school English in contexts where it was expected on proximal and distal outcomes including narrative writing, morphosyntactic awareness, and reading comprehension. Implications for theory and practice are discussed.

Objectives: This study evaluated the efficacy of a novel psychosocial intervention (Collaborative Life Skills, CLS) for primary-school students with ADHD symptoms. CLS is a 12-week program consisting of integrated school, parent, and student treatments delivered by school-based mental health providers. Using a cluster randomized design, CLS was compared to usual school/community services on psychopathology and functional outcomes. Methods: Schools within a large urban public school district were randomly assigned to CLS (12 schools) or usual services (11 schools). Approximately six students participated at each school (N = 135, mean age = 8.4 years, grade range = 2nd-5th, 71% boys). Using PROC GENMOD (SAS 9.4) the difference between the means of CLS and usual services for each outcome at post-treatment was tested. To account for clustering effects by school, the Generalized Estimating Equation method was used. Results: Students from schools assigned to CLS, relative to those assigned to usual services, had significantly greater improvement on parent and teacher ratings of ADHD symptom severity and organizational functioning, teacher-rated academic performance and parent ratings of ODD symptoms and social/interpersonal skills. Conclusions: These results support the efficacy of CLS relative to typical school and community practices for reducing ADHD and ODD symptoms and improving key areas of functional impairment. They further suggest that existing school-based mental health resources can be re-deployed from non-empirically supported practices to those with documented efficacy. This model holds promise for improving access to efficient, evidence-based treatment for inattentive and disruptive behavior beyond the clinic setting. [This article was published in the "Journal of the American Academy of Child and Adolescent Psychiatry," v55 p762-770 2016.]

The main purposes of this study were to test the effects of teaching at-risk 4th graders to provide explanations for their mathematics work and examine whether those effects occur by compensating for limitations in cognitive processes. We randomly assigned 212 children to 3 conditions: a control group and 2 variants of a multicomponent fraction intervention. Both intervention conditions included 36 sessions, each lasting 35 min. All but 7 min of each session were identical. In the 7-min component, students were taught to provide high quality explanations when comparing fraction magnitudes or to solve fraction word problems. Children were pretested on cognitive variables and pre/posttested on fraction knowledge. On accuracy of magnitude comparisons and quality of explanations, children who received the explaining intervention outperformed those in the word-problem condition. On word problems, children who received the word-problem intervention outperformed those in the explaining condition. Moderator analyses indicated that the explaining intervention was more effective for students with weaker working memory, while the word-problem intervention was more effective for students with stronger reasoning ability.

The main purposes of this study were to test the effects of teaching at-risk 4th graders to provide explanations for their mathematics work and examine whether those effects occur by compensating for limitations in cognitive processes. We randomly assigned 212 children to 3 conditions: a control group and 2 variants of a multicomponent fraction intervention. Both intervention conditions included 36 sessions, each lasting 35 min. All but 7 min of each session were identical. In the 7-min component, students were taught to provide high quality explanations when comparing fraction magnitudes or to solve fraction word problems. Children were pretested on cognitive variables and pre/posttested on fraction knowledge. On accuracy of magnitude comparisons and quality of explanations, children who received the explaining intervention outperformed those in the word-problem condition. On word problems, children who received the word-problem intervention outperformed those in the explaining condition. Moderator analyses indicated that the explaining intervention was more effective for students with weaker working memory, while the word-problem intervention was more effective for students with stronger reasoning ability.

The main purposes of this study were to test the effects of teaching at-risk 4th graders to provide explanations for their mathematics work and examine whether those effects occur by compensating for limitations in cognitive processes. We randomly assigned 212 children to 3 conditions: a control group and 2 variants of a multicomponent fraction intervention. Both intervention conditions included 36 sessions, each lasting 35 min. All but 7 min of each session were identical. In the 7-min component, students were taught to provide high quality explanations when comparing fraction magnitudes or to solve fraction word problems. Children were pretested on cognitive variables and pre/posttested on fraction knowledge. On accuracy of magnitude comparisons and quality of explanations, children who received the explaining intervention outperformed those in the word-problem condition. On word problems, children who received the word-problem intervention outperformed those in the explaining condition. Moderator analyses indicated that the explaining intervention was more effective for students with weaker working memory, while the word-problem intervention was more effective for students with stronger reasoning ability.

The purposes of this study were to (a) investigate the efficacy of a core fraction intervention program on understanding and calculation skill and (b) isolate the effects of different forms of fraction word-problem (WP) intervention delivered as part of the larger program. At-risk 4th graders (n = 213) were randomly assigned at the individual level to receive the school's business-as-usual program or 1 of 2 variants of the core fraction intervention (each 12 weeks, 3 sessions/week). In each session of the 2 variants, 28 min were identical, focused mainly on the measurement interpretation of fractions. The other 7 min addressed fraction WPs: multiplicative WPs versus additive WPs. Children were pre- and posttested on fraction understanding, calculations, and WPs. On understanding and calculations, both intervention conditions outperformed the control group, and the effect of intervention versus control on released fraction items from the National Assessment of Education Progress were mediated by children's improvement in the measurement interpretation of fractions. On multiplicative WPs, multiplicative WP intervention was superior to the other 2 conditions, but additive WP intervention and the control group performed comparably. By contrast, on additive WPs, there was a step-down effect in which additive WP intervention was superior to multiplicative WP intervention, which was superior to control. [This paper was published in "Elementary School Journal," v116 n4 p625-661 Jun 2016 (EJ1103953).]

The purposes of this study were to (a) investigate the efficacy of a core fraction intervention program on understanding and calculation skill and (b) isolate the effects of different forms of fraction word-problem (WP) intervention. At-risk fourth graders (n = 213) were randomly assigned to the school's business-as-usual program, or one of two variants of the core fraction intervention (each 12 weeks, 36 sessions). In each session of the two variants, 28 minutes were identical, focused mainly on the measurement interpretation of fractions. The other 7 minutes addressed multiplicative WPs versus additive WPs. Children were pre-/posttested on fraction understanding, calculations, and WPs. On understanding and calculations, both intervention conditions outperformed the control group. The effect of intervention versus control on released fraction items from the National Assessment of Education Progress was mediated by children's improvement in the measurement interpretation of fractions. On multiplicative WPs, multiplicative WP intervention was superior to the other conditions, but additive WP intervention and the control group performed comparably. On additive WPs, additive WP intervention was superior to multiplicative WP intervention, which was superior to control.

Schools continue to strive for the use of evidenced-based interventions and policies to foster well-managed classrooms that promote improved student outcomes. The present study examined the effects of the Class-Wide Function-related Intervention Teams (CW-FIT), a group contingency intervention, on the on-task and disruptive behavior of elementary school students with or at risk for emotional behavior disorders (EBD). Seventeen elementary schools, 159 general education teachers, and 313 students participated in the randomized-control group design study. Fidelity of implementation was strong for intervention group teachers and was measured across groups and throughout baseline conditions. Results suggest that CW-FIT can be used to increase on-task behavior and reduce the disruptive behavior of students with or at risk for EBD. In addition, teachers in intervention classes increased praise and reduced reprimands to individual students and along with their students, reported high levels of consumer satisfaction.

The purpose of the study was to determine the efficacy of the Class-Wide Function-Related Intervention Teams (CW-FIT) program for improving students' on-task behavior, and increasing teacher recognition of appropriate behavior. The intervention is a group contingency classroom management program consisting of teaching and reinforcing appropriate behaviors (i.e., getting the teacher's attention, following directions, and ignoring inappropriate behaviors of peers). Seventeen elementary schools, the majority in urban and culturally diverse communities, participated in a randomized trial with 86 teachers (classrooms) assigned to CW-FIT, and 73 teachers (classrooms) assigned to the comparison group. Class-wide student on-task behavior improved over baseline levels in the intervention classes. Teachers were able to implement the intervention with high fidelity overall, as observed in adherence to 96% of the fidelity criteria on average. Teacher praise and attention to appropriate behaviors increased, and reprimands decreased. These effects were replicated in new classrooms each of the 4 years of the study, and for all years combined.

Chicago Public Schools initiated the Excellence in Teaching Project, a teacher evaluation program designed to increase student learning by improving classroom instruction through structured principal-teacher dialogue. The pilot began in forty-four elementary schools in 2008-09 (cohort 1) and scaled up to include an additional forty-eight elementary schools in 2009-10 (cohort 2). Leveraging the experimental design of the roll-out, cohort 1 schools performed better in reading and math than cohort 2 schools at the end of the first year, though the math effects are not statistically significant. We find the initial improvement for cohort 1 schools remains even after cohort 2 schools adopted the program. Moreover, the pilot differentially impacted schools with different characteristics. Higher-achieving and lower-poverty schools were the primary beneficiaries, suggesting the intervention was most successful in more advantaged schools. These findings are relevant for policy makers and school leaders who are implementing evaluation systems that incorporate classroom observations.

This study investigated whether individual differences in working memory (WM) moderate effects of 2 variations of intervention designed to improve at-risk 4th graders' fraction knowledge. We also examined the effects of each intervention condition against a business-as-usual control group and assessed whether children's measurement interpretation of fractions mediated those effects. At-risk students (n = 243) were randomly assigned to control and 2 intervention conditions. The interventions each lasted 12 weeks, with three 30-min sessions per week. The major focus of both intervention conditions was the measurement interpretation of fractions. Across the 2 conditions, only 5 min of each 30-min session differed. One condition completed activities to build fluency with 4 measurement interpretation topics; in the other, activities were completed to consolidate understanding on the same 4 topics. Results revealed a significant aptitude-treatment interaction, in which students with very weak WM learned better with conceptual activities but children with more adequate (but still low) WM learned better with fluency activities. Both intervention conditions outperformed the control group on all outcomes, and improvement in the measurement interpretation of fractions mediated those effects.

This study investigated whether individual differences in working memory (WM) moderate effects of 2 variations of intervention designed to improve at-risk 4th graders' fraction knowledge. We also examined the effects of each intervention condition against a business-as-usual control group and assessed whether children's measurement interpretation of fractions mediated those effects. At-risk students (n = 243) were randomly assigned to control and 2 intervention conditions. The interventions each lasted 12 weeks, with three 30-min sessions per week. The major focus of both intervention conditions was the measurement interpretation of fractions. Across the 2 conditions, only 5 min of each 30-min session differed. One condition completed activities to build fluency with 4 measurement interpretation topics; in the other, activities were completed to consolidate understanding on the same 4 topics. Results revealed a significant aptitude-treatment interaction, in which students with very weak WM learned better with conceptual activities but children with more adequate (but still low) WM learned better with fluency activities. Both intervention conditions outperformed the control group on all outcomes, and improvement in the measurement interpretation of fractions mediated those effects.

This study investigated whether individual differences in working memory (WM) moderate effects of 2 variations of intervention designed to improve at-risk 4th graders' fraction knowledge. We also examined the effects of each intervention condition against a business-as-usual control group and assessed whether children's measurement interpretation of fractions mediated those effects. At-risk students (n = 243) were randomly assigned to control and 2 intervention conditions. The interventions each lasted 12 weeks, with three 30-min sessions per week. The major focus of both intervention conditions was the measurement interpretation of fractions. Across the 2 conditions, only 5 min of each 30-min session differed. One condition completed activities to build fluency with 4 measurement interpretation topics; in the other, activities were completed to consolidate understanding on the same 4 topics. Results revealed a significant aptitude-treatment interaction, in which students with very weak WM learned better with conceptual activities but children with more adequate (but still low) WM learned better with fluency activities. Both intervention conditions outperformed the control group on all outcomes, and improvement in the measurement interpretation of fractions mediated those effects.

The purposes of this study were to investigate the effects of an intervention designed to improve at-risk 4th graders' understanding of fractions and to examine the processes by which effects occurred. The intervention focused more on the measurement interpretation of fractions; the control condition focused more on the part-whole interpretation of fractions and on procedures. Intervention was also designed to compensate for at-risk students' limitations in the domain-general abilities associated with fraction learning. At-risk students (n = 259) were randomly assigned to intervention and control. Whole-number calculation skill, domain-general abilities (working memory, attentive behavior, processing speed, listening comprehension), and fraction proficiency were pretested. Intervention occurred for 12 weeks, 3 times per week, 30 min per session, and then fraction performance was reassessed. On each conceptual and procedural fraction outcome, effects favored intervention over control (effect sizes = 0.29 to 2.50), and the gap between at-risk and low-risk students narrowed for the intervention group but not the control group. Improvement in the accuracy of children's measurement interpretation of fractions mediated intervention effects. Also, intervention effects were moderated by domain-general abilities, but not whole-number calculation skill.

The purposes of this study were to investigate the effects of an intervention designed to improve at-risk 4th graders' understanding of fractions and to examine the processes by which effects occurred. The intervention focused more on the measurement interpretation of fractions; the control condition focused more on the part-whole interpretation of fractions and on procedures. Intervention was also designed to compensate for at-risk students' limitations in the domain-general abilities associated with fraction learning. At-risk students (n = 259) were randomly assigned to intervention and control. Whole-number calculation skill, domain-general abilities (working memory, attentive behavior, processing speed, listening comprehension), and fraction proficiency were pretested. Intervention occurred for 12 weeks, 3 times per week, 30 min per session, and then fraction performance was reassessed. On each conceptual and procedural fraction outcome, effects favored intervention over control (effect sizes = 0.29 to 2.50), and the gap between at-risk and low-risk students narrowed for the intervention group but not the control group. Improvement in the accuracy of children's measurement interpretation of fractions mediated intervention effects. Also, intervention effects were moderated by domain-general abilities, but not whole-number calculation skill.

The purpose of this evaluation of Scholastic's "System 44" conducted by RMC Research was to expand the existing research on students with learning disabilities by conducting a randomized study of struggling readers with approximately half of the sample comprised of students with learning disabilities. Specifically, this evaluation examined the impact of "System 44" on the reading outcomes of struggling readers and on a subsample of students with learning disabilities in Grades 4-8. The evaluation of the implementation and impact of "System 44" involved 12 elementary schools and 4 middle and K-8 schools in a district in Michigan. Scholastic's "System 44" is a foundational reading program intended for older struggling readers who have not mastered basic phonics and decoding skills. Combining researched-based phonics instruction with adaptive technology, "System 44" is designed to improve students' word reading accuracy, fluency, and comprehension. The "System 44" program delivers research-based instruction through an adaptive computer component; teacher-led small-group instruction; and individual student practice involving high-interest, leveled materials. Thus students who have not responded to classroom reading instruction may benefit from the more intensive and specific decoding instruction provided through "System 44." The evaluators selected the target sample based on student performance on the fall 2011 Michigan Educational Assessment Program (MEAP) and spring 2011 AIMSweb assessment. The Scholastic Reading Inventory (SRI) was used to screen students for "System 44" eligibility. The district administered the SRI to all students in the target sample. Those students who scored below 600 Lexiles on the SRI were administered the Scholastic Phonics Inventory (SPI). All students who scored in the Beginning or Developing reader categories on the SPI were randomly assigned (stratified by school and grade level) to either the "System 44" treatment group or the control group. RMC Research hired and trained 4 local testers to individually administer a battery of standardized reading tests to all treatment and control group students. The testers administered the tests in October 2011 to establish baseline scores and again in May 2012 to attain follow-up scores. The tests included the following: (1) Test of Silent Reading Efficiency and Comprehension (TOSREC); (2) Comprehensive Test of Phonological Processing (CTOPP) Elision subtest; (3) Test of Word Reading Efficiency (TOWRE) Sight Word Efficiency subtest; and (4) Test of Word Reading Efficiency (TOWRE) Phonetic Decoding Efficiency subtest. The evaluation of "System 44" revealed significant impacts on several tests for both the overall sample and the learning disabled sample. Additional findings revealed that impacts were stronger on several tests for middle school students than for elementary school students, particularly on SPI Nonsense Word Accuracy, TOSREC, and SRI. Although significant impacts were attained by the end of Year 1, the majority of students in the study did not complete the "System 44" program. Data collected through teacher surveys, classroom visits, and interviews provided information on teachers' implementation of "System 44" in the classroom, and software usage data were used to examine differences in students with varying program exit and topic completion patterns. [For the November 2011 report, see ED613693.]

This study examined the effects of e-mailed daily behavior report cards (DBRC) on students' disruptive classroom behaviors. Additionally, teacher acceptability of e-mailed DBRC as an intervention was assessed. Participants included 46 elementary students (37 males and 9 females), that were assigned to one of three conditions; delayed treatment control, e-mailed DBRC, and e-mailed DBRC with performance feedback. Student behaviors were measured by direct observations and teacher ratings. Results suggest that e-mailed DBRC can decrease students' disruptive behaviors, that e-mailed DBRC with performance feedback did not produce superior outcomes, and that e-mailed DBRC was perceived as acceptable. (Contains 1 table.)

Scholastic's "System 44" is a foundational reading program intended for older struggling readers who have not mastered basic phonics and decoding skills. Combining researched-based phonics instruction with adaptive technology, "System 44" is designed to improve students' word reading accuracy, fluency, and comprehension. The "System 44" program delivers research-based instruction through an adaptive computer component; teacher-led small group instruction; and individual student practice involving high-interest, leveled materials. Thus students who have not responded to classroom reading instruction may benefit from the more intensive and specific decoding instruction provided through "System 44." Using a randomized design, this evaluation assessed the effectiveness of "System 44" in terms of improving the foundational reading skills of struggling readers in Grades 4-8 in a large suburban school district in southern California during the 2010-2011 school year. The evaluation of the implementation and impact of "System 44" involved 7 of the 11 elementary schools and all 4 middle schools in the district. A 2-step process was used to establish student eligibility for "System 44." The Scholastic Reading Inventory (SRI) was used to screen students in Grades 4-8 who performed below the 50th percentile on the spring 2010 California Standards Test (CST) for "System 44" eligibility. Those students who scored below 600 Lexiles on the SRI were administered the Scholastic Phonics Inventory (SPI), a computer-based test used to identify students in need of additional phonics instruction. Students who scored in the Beginning or Developing reader categories on the SPI were randomly assigned (stratified by school and grade level) to either the "System 44" treatment group or the control group. Data collection activities for the "System 44" evaluation included student reading tests, teacher surveys, "System 44" classroom observations, a professional development observation, and staff interviews. RMC Research hired and trained 4 local testers to administer a battery of standardized reading tests to all treatment and control students. The testers administered the tests to each student separately over a 3-week period in September and October 2010 to establish baseline scores and again in May 2011 to attain follow-up scores. Listed in order of administration, the tests included the following: (1) Test of Silent Reading Efficiency and Comprehension (TOSREC); (2) Comprehensive Test of Phonological Processing (CTOPP) Elision subtest; (3) Woodcock-Johnson III Word Identification subtest; (4) Woodcock-Johnson III Word Attack subtest; (5) Test of Word Reading Efficiency (TOWRE) Sight Word Efficiency subtest; and (6) Test of Word Reading Efficiency (TOWRE) Phonetic Decoding Efficiency subtest. This report details the program impact findings and concludes with recommendations from the evaluation team.

The authors describe an independent evaluation of the READ 180 Enterprise intervention designed by Scholastic, Inc. Despite widespread use of the program with upper elementary through high school students, there is limited empirical evidence to support its effectiveness. In this randomized controlled trial involving 312 students enrolled in an after-school program, the authors generated intention-to-treat and treatment-on-the-treated estimates of the program's impact on several literacy outcomes of fourth, fifth, and sixth graders reading below proficiency on a state assessment at baseline. READ 180 Enterprise students outperformed control group students on vocabulary (d = 0.23) and reading comprehension (d = 0.32) but not on spelling and oral reading fluency. The authors interpret the findings in light of the theory of instruction underpinning the READ 180 Enterprise intervention. (Contains 2 figures, 7 tables, and 4 notes.)

Aimed at low-income families in six of New York City's highest-poverty communities, Family Rewards ties cash rewards to a pre-specified set of activities and outcomes thought to be critical to families' short- and long-term success in the areas of children's education, family preventive health care, and parents' employment. The purpose of this project is to experimentally evaluate the effects of this three-year innovative holistic conditional cash transfer (CCT) initiative. This paper presents initial findings from an ongoing and comprehensive evaluation of Family Rewards. It examines the program's implementation in the field and families' responses to it during the first two of its three years of operations, and early findings on the program's impacts on children's educational processes and outcomes. More specifically, this paper addresses the following questions: (1) What are the effects of ONYC-Family Rewards on family income, poverty, and financial hardship?; (2) What are the effects of ONYC-Family Rewards on use of health care and health insurance?; (3) What are the effects of ONYC-Family Rewards on parents' employment and educational attainment?; and (4) What are the effects of ONYC-Family Rewards on children's educational outcomes? Overall, this study shows that, despite an extraordinarily rapid start-up, the program was operating largely as intended by its second year. Although many families struggled with the complexity of the program, most were substantially engaged with it and received a large amount of money for meeting the conditions it established. Specifically, nearly all families (98 percent) earned at least some rewards in both program years, with payments averaging more than $6,000 during the first two program years combined. The program reduced current poverty and hardship; increased savings; increased families' continuous use of health insurance coverage and increased their receipt of medical care; and increased employment in jobs that are not covered by the unemployment insurance (UI) system but reduced employment in UI-covered jobs. The program has had mixed success in improving children's academic performance specifically. Contrary to expectations, Family Rewards did not affect school attendance or annual standardized test scores in Math and English Language Arts (ELA) for either group of youngest children, but did lead to notable gains for a group of more academically prepared high school students. The program also had important effects on several key proposed mediators of the intervention. However, these effects vary by parents with different age groups of children. Appended are: (1) References; and (2) Tables and Figures. (Contains 2 tables.)

The purpose of this study was (1) to examine the causal effects of READ 180, a mixed-methods literacy intervention, on measures of word reading efficiency, reading comprehension and vocabulary, and oral reading fluency and (2) to examine whether print exposure among children in the experimental condition explained variance in posttest reading scores. A total of 294 children in Grades 4-6 were randomly assigned to READ 180 or a district after-school program. Both programs were implemented 4 days per week over 23 weeks. Children in the READ 180 intervention participated in three 20-min literacy activities, including (1) individualized computer-assisted reading instruction with videos, leveled text, and word study activities, (2) independent and modeled reading practice with leveled books, and (3) teacher-directed reading lessons tailored to the reading level of children in small groups. Children in the district after-school program participated in a 60-min program in which teachers were able to select from 16 different enrichment activities that were designed to improve student attendance. There was no significant difference between children in READ 180 and the district after-school program on norm-referenced measures of word reading efficiency, reading comprehension, and vocabulary. Although READ 180 had a positive impact on oral reading fluency and attendance, these effects were restricted to children in Grade 4. Print exposure, as measured by the number of words children read on the READ 180 computer lessons, explained 4% of the variance in vocabulary and 2% of the variance in word reading efficiency after all pretest reading scores were partialed out.

In 2007, the Chicago Public Schools (CPS) began implementing a schoolwide reform called the Teacher Advancement Program (TAP) using funds from the federal Teacher Incentive Fund (TIF) and private foundations. Under the TAP model, teachers can earn extra pay and responsibilities through promotion to mentor or master teacher as well as annual performance bonuses based on a combination of their value added to student achievement and observed performance in the classroom. The idea behind the program is that performance incentives, combined with tools for teachers to track performance and improve instruction, should help schools attract and retain talented teachers and help all teachers produce greater student achievement. This report provides evidence on the impacts of TAP during the 2008-2009 school year, the second year of the program's rollout in CPS. Appended are: (1) Propensity Score Matching; and (2) Longitudinal Analysis of Test Score Data. (Contains 18 tables, 7 figures and 14 footnotes.) [For the Year One Impact Report, see ED507502.]

Adding to the growing debate and evidence base on the effects of charter schools, this evaluation was conducted in 36 charter middle schools in 15 states. It compares the outcomes of 2,330 students who applied to these schools and were randomly assigned by lotteries to be admitted (lottery winners) or not admitted (lottery losers) to the schools. Both sets of students were tracked over two years and data on student achievement, academic progress, behavior, and attitudes were collected. The study is the first large-scale randomized trial of the effectiveness of charter schools in varied types of communities and states. Among the key findings were that, on average, charter middle schools that held lotteries were neither more nor less successful than traditional public schools in improving math or reading test scores, attendance, grade promotion, or student conduct within or outside of school. Being admitted to a study charter school did significantly improve both students' and parents' satisfaction with school. Charter middle schools' impact on student achievement varied significantly across schools. Charter middle schools in urban areas--as well as those serving higher proportions of low-income and low achieving students--were more effective (relative to their nearby traditional public schools) than were other charter schools in improving math test scores. Some operational features of charter middle schools were associated with less negative impacts on achievement. These features include smaller enrollments and the use of ability grouping in math or English classes. There was no significant relationship between achievement impacts and the charter schools' policy environment. Because the study could only include charter middle schools that held lotteries, the results do not necessarily apply to the full set of charter middle schools in the U.S. Appended are: (1) Selecting the Charter School and Student Samples; (2) Calculation of Sample Weights; (3) Outcome Measures for the Impact Analysis; (4) Analytic Methods; (5) Supplemental Materials for Chapter III; (6) Supplemental Tables for Chapter IV; and (7) Supplemental Tables for Chapter V. (Contains 78 tables, 29 figures, and 164 footnotes.) [For the study snapshot of this full report, see ED510574.]

The District of Columbia School Choice Incentive Act of 2003, passed by Congress in January 2004, established the first federally funded, private school voucher program in the United States. Since that time, more than 8,400 students have applied for what is now called the DC Opportunity Scholarship Program (OSP), and a rigorous evaluation of the Program, mandated by Congress, has been underway. This last formal report from the ongoing evaluation describes the impacts of the Program at least four years after families who applied and were given the option to move from a public school to a participating private school of their choice. The research priorities for the evaluation were shaped largely by the primary topics of interest specified in the statute. This legislative mandate led the evaluators to focus on the following research questions: (1) What is the impact of the Program on student academic achievement? (2) What is the impact of the Program on other student measures? (3) What effect does the Program have on school safety and satisfaction? (4) What is the effect of attending private versus public schools? (5) To what extent is the Program influencing public schools and expanding choice options for parents in Washington, DC? These research questions are consistent with the topics that scholars and policymakers have identified as important questions of interest surrounding private school scholarship programs. The report found that that the Program had mixed longer-term effects on participating students and their parents, including: (1) No conclusive evidence that the OSP affected student achievement overall, or for the high-priority group of students who applied from "schools in need of improvement"; (2) The Program significantly improved students' chances of graduating from high school, according to parent reports. Overall, 82 percent of students offered scholarships received a high school diploma, compared to 70 percent of those who applied but were not offered scholarships. This graduation rate improvement also held for the subgroup of OSP students who came from "schools in need of improvement."; and (3) Although parents had higher satisfaction and rated schools as safer if their child was offered or used an OSP scholarship, students reported similar ratings for satisfaction and safety regardless of whether they were offered or used a scholarship. Appendices include: (1) Research Methodology; (2) Benjamini-Hochberg Adjustments for Multiple Comparisons; (3) Sensitivity Testing; (4) Relationship Between Attending a Private School and Key Outcomes; (5) Detailed ITT Tables; (6) Exploration of Whether Parents Get What They Seek From School Choice; (7) To What Extent Are Treatment Effects of the OSP Observed Across the Outcome Test-Score Distribution? Quantile Regression Analysis of the OSP; and (8) Intermediate Outcome Measures. (Contains 99 tables, 31 figures, and 61 footnotes.)

Much research has established the contribution of summer reading setback to the reading achievement gap that is present between children from more and less economically advantaged families. Likewise, summer reading activity, or the lack of it, has been linked to summer setback. Finally, family socioeconomic status has been linked to the access children have to books in their homes and neighborhoods. Thus, in this longitudinal experimental study we tested the hypothesis that providing elementary school students from low-income families with a supply of self-selected trade books would ameliorate summer reading setback. Thus, 852 students from 17 high-poverty schools were randomly selected to receive a supply of self-selected trade books on the final day of school over a 3-year period, and 478 randomly selected students from these same schools received no books and served as the control group. No further effort was provided in this intervention study. Outcomes on the state reading assessment indicated a statistically significant effect (p = 0.015) for providing access to books for summer reading along with a significant (d = 0.14) effect size. Slightly larger effects (d = 0.21) were found when comparing the achievement of the most economically disadvantaged students in the treatment and control groups. (Contains 3 tables and 2 notes.)

This paper describes a series of school-based randomized trials in over 250 urban schools designed to test the impact of financial incentives on student achievement. In stark contrast to simple economic models, our results suggest that student incentives increase achievement when the rewards are given for inputs to the educational production function, but incentives tied to output are not effective. Relative to popular education reforms of the past few decades, student incentives based on inputs produce similar gains in achievement at lower costs. Qualitative data suggest that incentives for inputs may be more effective because students do not know the educational production function, and thus have little clue how to turn their excitement about rewards into achievement. Several other models, including lack of self-control, complementary inputs in production, or the unpredictability of outputs, are also consistent with the experimental data.

At the request of the State of Pennsylvania, the School District of Philadelphia, in the summer of 2002, asked three for-profit firms to assume responsibility for 30 of its lowest-performing schools and it asked four nonprofit managers to assume the management of 16 other low-performing schools. A difference-in-differences analysis is used to estimate the impact of nonprofit and for-profit management on individual student achievement. Gains in test scores at the treated schools are estimated by comparing them with gains in other low-performing schools in the district. Students at schools under for-profit management outperformed those at schools under nonprofit management in all six years in both reading and math. Most estimations are statistically significant. Impacts of for-profit management relative to district management were positive in math, but no reading impacts could be detected. At nonprofits, students appear to have learned substantially less, especially in math, at nonprofit schools, than had their school remained under regular district management. However, impacts fell short of statistical significance. (Propensity Score Analysis is appended. Contains 21 endnotes and 9 tables.)

This study tests the hypothesis that cultural differences in group orientation predict an interaction between the student variable--ethnicity--and a learning context variable--reward structure--on math performance after group learning. One hundred and thirty-two African-American and European-American female and male fourth and fifth grade students studied math estimation in one of three group learning contexts. The learning contexts operationalized were: intergroup competitive, interpersonally competitive, and communal-no reward. ANCOVA confirmed a predicted interaction of ethnicity with learning context on post study session performance. Although there was no difference overall, African-American and European-American students performed best in the aggregate in different contexts. Independent ratings of students' group-positive behaviors mirrored the two-way interaction between learning context and ethnicity. The findings suggest that important student variables interact with the variable elements of group learning and should be studied in greater detail. They also support Boykin's (1994) contention that the cultural context of learning is a critical mediator of children's achievement. (Contains 4 tables, 3 figures and 7 footnotes.)

In the No Child Left Behind Act (NCLB), Congress called for the U.S. Department of Education (ED) to conduct a rigorous study of the conditions and practices under which educational technology is effective in increasing student academic achievement. A 2007 report presenting study findings for the 2004-2005 school year, indicated that, after one school year, differences in student test scores were not statistically significant between classrooms that were randomly assigned to use software products and those that were randomly assigned not to use products. School and teacher characteristics generally were not related to whether products were effective. The second year of the study examined whether an additional year of teaching experience using the software products increased the estimated effects of software products on student test scores. The evidence for this hypothesis is mixed. For reading, there were no statistically significant differences between the effects that products had on standardized student test scores in the first year and the second year. For sixth grade math, product effects on student test scores were statistically significantly lower (more negative) in the second year than in the first year, and for algebra I, effects on student test scores were statistically significantly higher in the second year than in the first year. The study also tested whether using any of the 10 software products increased student test scores. One product had a positive and statistically significant effect. Nine did not have statistically significant effects on test scores. Five of the insignificant effects were negative and four were positive. Study findings should be interpreted in the context of design and objectives. The study examined a range of reading and math software products in a range of diverse school districts and schools. But it did not study many forms of educational technology and it did not include many types of software products. How much information the findings provide about the effectiveness of products that are not in the study is an open question. Products in the study also were implemented in a specific set of districts and schools, and other districts and schools may have different experiences with the products. The findings should be viewed as one element within a larger set of research studies that have explored the effectiveness of software products. Three appendixes are included: (1) Second-Year Data Collection and Response Rates; (2) Description of Sample for the 10 Products; and (3) Details of Estimation Methods. (Contains 29 footnotes, 4 figures and 24 tables.

The "District of Columbia School Choice Incentive Act of 2003," passed by the Congress in January 2004, established the first federally funded, private school voucher program in the United States. The purpose of the new scholarship program was to provide low-income residents, particularly those whose children attend schools in need of improvement or corrective action under the "Elementary and Secondary Education Act," with "expanded opportunities to attend higher performing schools in the District of Columbia" (Sec. 303). As part of this legislation, the Congress mandated a rigorous evaluation of the impacts of the Program, now called the "DC Opportunity Scholarship Program" (OSP). This report presents findings from the evaluation on the impacts three years after families who applied were given the option to move from a public school to a participating private school of their choice. The evaluation is based on a randomized controlled trial design that compares the outcomes of eligible applicants randomly assigned to receive (treatment group) or not receive (control group) a scholarship through a series of lotteries. The main findings of the evaluation so far include: (1) After 3 years, there was a statistically significant positive impact on reading test scores, but not math test scores; (2) The OSP had a positive impact overall on parents' reports of school satisfaction and safety, but not on students' reports; (3) This same pattern of findings holds when the analysis is conducted to determine the impact of using a scholarship rather than being offered a scholarship; (4) The OSP improved reading achievement for 5 of the 10 subgroups examined; and (5) No achievement impacts were observed for five other subgroups of students, including those who entered the Program with relative academic disadvantage. Six appendices are included: (1) Research Methodology; (2) Benjamini-Hochberg Adjustments for Multiple Comparisons; (3) Sensitivity Testing; (4) Detailed ITT Tables; (5) Relationship Between Attending a Private School and Key Outcomes; and (6) Intermediate Outcome Measures.. (Contains 115 footnotes, 15 figures and 129 tables.) [For Executive Summary, see ED504784. For "Evaluation of the DC Opportunity Scholarship Program: Impacts after Two Years", see ED501696. For "Evaluation of the DC Opportunity Scholarship Program: Impacts after One Year", see ED497154.]

This study examined the effects of individualized, integrated language arts as a reading approach on struggling readers' comprehension scores obtained from oral narrative, silent narrative, and silent expository passages at three levels: below-grade, on-grade, and above-grade levels. Students (N = 93) in grades four through eight, who were reading below grade level, participated in the study. Treatment group students (n = 51) received individualized, integrated language arts as a reading approach once a week in place of basal reading instruction. Comparison group students (n = 42) received basal reading instruction for the duration of the study. Multivariate analysis of covariance was used to analyze posttest Analytical Reading Inventory (ARI) comprehension scores. Several statistically significant (p less than 0.001) differences in comprehension performance were found for on-grade-level scores and for above-grade-level scores, but few differences were found between treatment and comparison groups on below-grade-level scores. All statistically significant differences favored students in the treatment group. The findings of the study strongly suggest that the use of individualized, integrated language arts as a method for teaching reading is an effective approach for improving the reading comprehension performance of struggling readers. (Contains 5 tables.)

Many students have difficulty achieving reading fluency, and nearly half of fourth graders are not fluent readers in grade-level texts. Intensive and focused reading practice is recommended to help close the gap between students with poor fluency and their average reading peers. In this study, the "Quick Reads" fluency program was used as a supplemental fluency intervention for fourth and fifth graders with below-grade-level reading skills. "Quick Reads" prescribes a repeated reading procedure with short nonfiction texts written on grade-appropriate science and social science topics. Text characteristics are designed to promote word recognition skills. Students were randomly assigned to "Quick Reads" instruction that was implemented by trained paraeducator tutors with pairs of students for 30 minutes per day, 4 days per week, for 18 weeks. At posttest, "Quick Reads" students significantly outperformed classroom controls in vocabulary, word comprehension, and passage comprehension. Fluency rates for both treatment and control groups remained below grade level at posttest. (Contains 5 tables.)

The Technology Enhanced Elementary and Middle School Science II project (TEEMSS), funded by the National Science Foundation, produced 15 inquiry-based instructional science units for teaching in grades 3-8. Each unit uses computers and probeware to support students' investigations of real-world phenomena using probes (e.g., for temperature or pressure) or, in one case, virtual environments based on mathematical models. TEEMSS units were used in more than 100 classrooms by over 60 teachers and thousands of students. This paper reports on cases in which groups of teachers taught science topics without TEEMSS materials in school year 2004-2005 and then the same teachers taught those topics using TEEMSS materials in 2005-2006. There are eight TEEMSS units for which such comparison data are available. Students showed significant learning gains for all eight. In four cases (sound and electricity, both for grades 3-4; temperature, grades 5-6; and motion, grades 7-8) there were significant differences in science learning favoring the students who used the TEEMSS materials. The effect sizes are 0.58, 0.94, 1.54, and 0.49, respectively. For the other four units there were no significant differences in science learning between TEEMSS and non-TEEMSS students. We discuss the implications of these results for science education.

The National Board for Professional Teaching Standards (NBPTS) assesses teaching practice based on videos and essays submitted by teachers. We compared the performance of classrooms of elementary students in Los Angeles randomly assigned to NBPTS applicants and to comparison teachers. We used information on whether each applicant achieved certification, along with information on each applicant's NBPTS scaled score and subscores, to test whether the NBPTS score was related to teacher impacts on student achievement. We found that students randomly assigned to highly-rated applicants performed better than students assigned to comparison teachers, while students assigned to poorly-rated applicants performed worse. Estimates were similar using data on pairs of teachers that were not randomly assigned. Our results suggest a number of changes that would improve the predictive power of the NBPTS process.

We examined the extent to which use of a technology-enhanced continuous progress monitoring system would enhance the results of math instruction, examined variability in teacher implementation of the program, and compared math results in classrooms in which teachers did and did not use the system. Classrooms were randomly assigned to within-school experimental and control groups. Participating students were pre- and post-tested using two standardized, nationally normed tests of math achievement. When teachers implemented the continuous progress monitoring system as intended, and when they used the data from the system to manage and differentiate instruction, students gained significantly more than those for whom implementation was limited or nil. Failure to take into account intervention integrity would have made it look like continuous progress monitoring did not enhance math results. (Contains 5 tables.)

Research was conducted to ascertain if a combined repeated reading and question generation intervention was effective at improving the reading achievement of fourth through eighth grade students with learning disabilities or who were at risk for reading failure. Students were assigned to a treatment or control group via a stratified random sampling. Instructional components and training were based on best practices reported in the literature. Students receiving intervention significantly improved their reading speed and ability to answer inferential comprehension questions on passages that were reread. Compared to the control group, students in the intervention group also made significant gains in oral reading fluency on independent passages.

This study assessed the effects of Peer-Assisted Learning Strategies (PALS), a reciprocal classwide peer-tutoring strategy, on the reading performance of native Spanish-speaking students with learning disabilities (LD) and their low-, average-, and high-achieving classroom peers. Participants were 132 native Spanish-speaking English language learners (ELL) in Grades 3 through 6, along with their 12 reading teachers. Teachers were assigned randomly to PALS and contrast groups. PALS sessions were conducted 3 times a week for 15 weeks. Students were tested before and after treatment. PALS students outgrew contrast students on reading comprehension, and those effects were not mediated by student type.

Used a matched-schools design, school-level achievement, and disciplinary data to evaluate the effectiveness of the elementary-level Positive Action program on students' performance and behavior over time. Results indicated that program participation improved student behavior, school involvement, and academic achievement into high school. The program had equally strong behavioral effects in higher risk schools. There was a clear dose-response relationship for most outcomes. (SM)

This study evaluated the effectiveness of a phonologically based reading program delivered to first- through sixth-grade impaired readers (N=115) in small groups. Post-tests after program completion found the program resulted in significantly better phonological awareness, decoding, reading accuracy, comprehension, and spelling. Improved skills were evident regardless of original level of deficiency and were not limited to specific grades. (Contains references.) (Author/DB)

Sixty children (ages 8-10) with severe reading disabilities received daily intensive one-to-one instruction that differed in depth and extent of instruction in phonemic awareness and phonemic decoding. Both approaches were highly effective in improving reading accuracy and comprehension although measures of reading rate showed continued severe impairment. Twenty-four children were judged to no longer need special education. (Contains references.) (Author/DB)

Compared effects of a computer-assisted remedial reading program providing speech-supported reading in context with or without explicit phonological training. Found that phonologically trained second to fifth graders gained more in phonological skills and untimed word reading than untrained children. Children with more contextual reading gained more in time-limited word reading. Lower level readers benefited more than higher level readers. (Author/KB)

Reports the results of an evaluation of a popular literature-based character education program using a sample of first to sixth grade students (n=965). Finds that the curriculum had a positive effect on cognitive outcomes and that an emphasis of character throughout the curriculum contributed to achieving character outcomes. Includes references. (CMK)

Reports on the development and evaluation of a transitional bilingual program for grades 2 through 5. Evaluation results based on achievement of 42 students and 42 comparisons show that the program is more effective than the transition program students typically receive. Discusses implications for education of English learners. (SLD)

Examined effects of instructional components for studying literature on limited-English-proficient and English-proficient students, part of an ongoing program to estimate effects of several individual components of a Spanish-to-English language-arts transition program. Found that combined effects of literature logs and instructional conversations on students' essays about a story's theme varied by language proficiency. (Author/SD)

Examined the differential effects of two instructional strategies (explicit schema-based and traditional-based) on the acquisition, maintenance, and generalization of mathematical word problem solving among elementary students at risk or with mild disabilities. Pretesting and posttesting indicated that both groups' performance increased from pretest to posttest, though students in the schema-based increased more significantly. (Author/SM)

A classwide peer tutoring program in reading, implemented at 12 elementary and middle schools in three contiguous districts in the middle of a southern state, was evaluated for its effectiveness with three learner types: low achievers with disabilities, low achievers without disabilities, and learners of average achievement. Twenty teachers implemented the Peer Assisted Learning Strategies (PALS) program for 15 weeks, and 20 teachers who did not implement it served as controls. The PALS program involves having pairs of students engage in three strategic reading activities: partner reading with retell, paragraph summary, and prediction relay. In each of the 40 classrooms, data were collected systematically on three students representing the three learner types. Pre- and post-treatment reading achievement data were collected on three measures of the Comprehensive Reading Assessment Battery. Findings indicated that, irrespective of type of measure and type of learner, students in peer tutoring classrooms demonstrated greater reading progress than control students. (Contains approximately 120 references.) (DB)

The cooperative elementary school model uses cooperation, particularly cooperative learning, as a philosophy for educational change. A 2-year study of the cooperative elementary school model in 2 treatment and 3 comparison schools involving 1,012 students demonstrates positive effects on academic achievement and social relations. (SLD)

Trial spanning grades 1-4 reported changes in classroom processes produced by ClassWide Peer Tutoring (CWPT) Program covaried with statistically and educationally significant levels of growth in at-risk students' academic achievement. Investigated follow-up outcomes at end of sixth grade. Found continued improved academic outcomes in students at risk for academic delay resulting from sustained use of CWPT in early grades. (Author/NB)

The impact of direct instruction on reading comprehension strategies and the degree to which cooperative learning processes enhanced students' learning of strategies were studied using 486 third and fourth graders in Pennsylvania. Subjects identified main ideas of passages. Pretest-posttest data highlight the significant impact of direct instruction and cooperative learning. (SLD)

Among 28 upper elementary learning-disabled students in a summer remedial program, those that were taught spelling with explicit rule-based strategies out-performed students presented with a visual imagery mnemonic on unit tests, a posttest, and a standardized spelling test. Contains 20 references. (SV)

A study of the effects of peer-pairing and integrative motivation on both formal language performance and actual language behavior with Korean immigrant children is presented. The formal language learning was measured by tests of oral production and listening comprehension, and actual language behavior was measured by observations in a natural school environment. Both oral production and listening comprehension posttests were administered four-and-a-half months after pretest administration. Thirty elementary school children (11 boys and 19 girls) were randomly assigned to two groups, resulting in 14 children (8 girls and 6 boys) in the peer-paired group and 16 (11 girls and 5 boys) in the no-paired group. Stepwise multiple regression analyses indicated that (1) peer-pairing was a significant predictor for listening comprehension and the actual language behavior, and (2) prior language knowledge was the best predictor of formal language learning. The theoretical implications are that peer-pairing not only facilitates formal listening comprehension and actual language behavior, but also enhances social relationships between second-language learners and the target-language speakers. (MSE)

An explicit strategy method developed from a composite of basal arithmetic texts was used for mathematics problem-solving instruction for a group of fourth graders. Posttest results were positive. Implications for teaching mathematics problem solving to low performing students are discussed. (Author/DF)

A two-cutoff regression discontinuity design (RDD) was used to assign 321 students in grades 1 through 6 at a Title I elementary school to two types of Tier 2 reading interventions administered by paraeducators: (a) direct instruction (DI) and (b) computer-assisted instruction (CAI). Students scoring at or below a lower cutoff pretest score were assigned to the DI reading intervention. Students scoring between the lower cutoff score and an upper cutoff score on the pretest were assigned to a CAI reading intervention. Student reading ability was reassessed in January and May. Results indicated that the DI intervention was significantly more effective than the CAI interventions at the lower cutoff (p < 0.01). No significant treatment effect was detected at the upper cutoff, but the estimation power of the design at this cutoff was limited to medium-to-large effect size. Findings suggest that the DI intervention was superior to the CAI interventions for at-risk readers. Implications for practice, including fidelity of paraeducator implementation, are discussed.

The Louisiana Scholarship Program (LSP) offers publicly funded vouchers to moderate- and low-income students in low-performing public schools to enroll in participating private schools. Established in 2008 as a pilot program in New Orleans, the LSP expanded statewide in 2012. Drawing upon the random lotteries that placed students in LSP schools, we estimate the causal impact of using an LSP voucher to enroll in a private school on student achievement on the state accountability assessments in math, English Language Arts, and science over a four-year period, as well as on the likelihood of enrolling in college. The results from our primary analytic sample indicate substantial negative achievement impacts, especially in math, that diminish after the first year but persist after four years. In contrast, when considering the likelihood of students entering college, we observe no statistically significant difference between scholarship users and their control counterparts.

Teacher residencies are surfacing as a promising model for teacher preparation. One such residency program--Collaboration and Reflection to Enhance Atlanta Teacher Effectiveness (CREATE)--seeks to raise student achievement in local high-needs schools by increasing the effectiveness and retention of both new and veteran educators. CREATE aims to achieve this by developing critically-conscious, compassionate, and skilled educators who are committed to teaching practices that prioritize racial justice and interrupt inequities. This quasi-experiment, funded by an Investing in Innovations (i3) grant, follows two staggered cohorts of study participants (CREATE and comparison teachers) for three years per cohort, starting with the first cohort in 2015-16. Confirmatory analyses found no statistically significant effects of CREATE on two Teacher Assessment on Performance Standards (TAPS) ratings for Instructional Strategies (p = 0.221) and Positive Learning Environment (p = 0.192), or on student achievement on ELA (p = 0.454), math (p = 0.569), and general achievement (p = 0.234). However, exploratory analyses (pre-registered) found very promising results showing undisrupted retention over a three-year time period (spanning graduation from Georgia State University's College of Education and Human Development, entering teaching, and retention into the second year of teaching) for the CREATE group, relative to the comparison group (p = 0.038). We also observed that the favorable impact is driven largely by higher continuous retention among Black educators in CREATE relative to those in the comparison group (p = 0.021). The percentages of teachers in CREATE, as averaged across the two study cohorts, who maintain an uninterrupted trajectory of graduating from GSU-CEHD, and taught in their first and second year are 94.8%, 87.4% and 84.6%, respectively. In the matched comparison group the corresponding values are 87.9%, 72.9%, and 68.0%. Among Black teachers in CREATE, the values are 98.6%, 96.3% and 95.5%, respectively. In the matched comparison group of Black teachers, the corresponding values are 85.7%, 68.5%, and 62.8%. These results are further corroborated by statistically significant or marginally statistically significant differential impacts favoring Black teachers on several potential mediators of impact: resilience, self-efficacy, and stress management and empathy related to teaching. The positive findings on retention, particularly for Black educators, are important given that 44% of teachers in Georgia leave the profession within the first five years, with evidence in the literature indicating that in the South, Black teachers experience higher turnover rates than non-Black teachers (Carver-Thomas & Darling-Hammond, 2017). The authors discuss a number of factors that could have led to null impacts on confirmatory outcomes. The lack of variation in teacher performance ratings, which is a known issue in Georgia and in the literature at large (Weisberg et al, 2009; Kraft & Gilmour, 2017) could have contributed to the results for the TAPS ratings. Studies of teacher residency programs also suggest that impact on student achievement might not be present or detected in earlier years of teaching. Additionally, analyses of student achievement in this study were limited by small sample sizes of teachers in tested grades and subjects. The authors hope to address these limitations and to investigate the promising outcomes on retention, especially for Black educators, in current and future studies of CREATE, for which we have secured funding for programming and research through the eighth cohort. [For the appendices, see ED611803.]

Engaged in the evaluation of LDC tools since June 2011, UCLA's National Center for Research on Evaluation, Standards, and Student Testing (CRESST) is using multiple data sources and a quasi-experimental design to examine LDC implementation and impact in two cohorts of schools in two large, urban school districts. This report presents the results on implementation of LDC in the large urban school district on the West Coast during the third year of the intervention, and the impact of the program across multiple years. Findings from both participant surveys and analyses of student outcomes reveal positive results for the LDC intervention. Analysis of student outcomes provided evidence of the program's effectiveness and confirmation for participants' positive views. Quasi-experimental analyses demonstrated a statistically significant positive impact of LDC as practiced by middle school teachers with 2 years of program experience across two cohorts of schools and teachers. A statistically significant positive impact was also found for Cohort 2 middle schools after just one year of implementation. [For the 2017-2018 report, see ED600053.]

Purpose: The Santa Ana Unified School District received an i3 grant (Investing in Innovation; funded by the U.S. Department of Education Grant number U411C160074) to build on their existing school climate practices. Called the Enhanced Positive School Climate Model, the aim is to improve school climate, student-adult relationships, create social emotional learning programs, and provide students the needed structure to access challenging curriculum and expectations. As part of this enhanced model, School Climate Liaisons (SCLs) were hired to support and provide coaching to schools in the intervention group on PBIS [Positive Behavioral Intervention and Supports], RP [Restorative Practice] implementation, and behavioral interventions. As part of the i3 grant requirements, the district employed a rigorous cluster-randomized trial whereby half of the district's elementary schools were assigned to receive the Enhanced Positive School Climate Model and half were assigned to a waitlist control. The confirmatory research question is: Do students in grades 4 and 5 at follow-up, in schools assigned to receive support from PBIS and Restorative Practice school climate specialists and community liaisons, who receive services for two years, exhibit higher levels of self-management at the end of the second year, as compared to students in grades 4 and 5 in schools assigned to not receive such support? Additionally, there were exploratory research questions examining changes in other SEL [social-emotional learning] measures including growth mindset, self-efficacy, and social awareness. Methods: This study employed a cluster-randomized controlled design whereby half of the study schools were assigned to the treatment condition and the other half of schools were assigned to the "business as usual" control condition. In total, 35 schools (30 K-5 schools; 5 K-8 schools) were randomly assigned to either the treatment or control condition. All students within these schools were included in the evaluation. Students in the treatment schools (n = 17) were eligible to receive services through the grant. Randomization occurred in May 2017. The 2016-17 school year served as a baseline school year (i.e., no services were provided). The Enhanced Positive School Climate Model began in the 2017-18 school year and continued into the 2018-19 school year for treatment schools only. Control schools were waitlisted and began receiving services in the 2019-20 school year. Students enrolled in district schools in May 2017 were tracked using student roster information through the end of the 2018-19 school year. Only students who were in study schools continuously from the 2016-2017 to 2018-2019 school years were included in the impact analysis. The confirmatory and exploratory outcomes referenced below were conducted using extant data from the district. Data were used from routine data collection processes within the district from the annual CORE climate student survey. The primary outcome measure was the five-item self-management scale on the CORE District's student survey (Taylor, Oberle, Durlak, & Weissberg, 2017; Transforming Education, 2014; https://www.rand.org/education-and-labor/projects/assessments/tool/2014/panorama-social-emotional-learning-questionnaire-measures.html) asked of all students in grades 4-12 each year. For the confirmatory research question (and all exploratory questions), adjusted post-intervention outcomes for students in treatment schools were compared to the outcomes for their counterparts in the control schools. This involved fitting conditional multilevel regression models (i.e., hierarchical linear modeling [HLM]), with additional terms to account for the nesting of individuals within schools (see Goldstein 1987; Raudenbush & Bryk, 2002; Murray 1998). Results: Eight two-level models were estimated per grade level to address the confirmatory and exploratory research questions. Although the students in treatment schools had slightly higher self-management, growth mindset and self-efficacy scores at follow-up, only the difference in fourth grade self-efficacy scores was statistically significant. In contrast, students in control schools had very slightly higher social awareness scores; this finding was not statistically significant. Implications: Meaningful and statistically significant differences were not found between students who attended schools that received the Enhanced Positive School Climate Model compared to their peers in schools that did not receive the Enhanced Positive School Climate Model. The lack of findings may be due to the other changes in school climate practices throughout the district during the study period. Additionally, variations in the implementation of the Enhanced Positive School Climate Model may have contributed to the lack of findings. Although the findings are not significant, the direction of results is mostly consistent, indicating increases in SEL competencies for students receiving additional school climate supports. Future studies should continue to investigate the relationship between whole-school approaches to school climate and changes in SEL competencies for students.

Science education has experienced a significant transition over the last decade, catalyzed by a re-envisioning of what students should know and be able to do in science. That re-envisioning culminated in the release of the Next Generation Science Standards (NGSS) in 2013. The new standards set off a chain reaction of standards adoption and implementation across states, districts, and schools, including steps taken toward transforming science professional learning, instruction, curriculum, and assessment. It was in this dynamic context that Empirical Education conducted an impact evaluation, as part of an Investing in Innovation (i3) grant, of WestEd's Making Sense of SCIENCE project, a teacher professional learning model aimed at raising students' science achievement through improving science instruction. Under this grant, WestEd and Empirical Education also partnered with Heller Research Associates (HRA) to conduct an implementation study and a scale-up study of Making Sense of SCIENCE. The impact evaluation, which is the focus of this report, was a two-year cluster-randomized control trial (RCT) that took place in California and Wisconsin across seven school districts and 66 elementary schools in the 2016-17 and 2017-18 school years. The study randomized schools to either receive the Making Sense of SCIENCE professional learning or to the business-as-usual ("control") group, which received the professional learning (delayed-treatment) after the study ended. The study found that Making Sense of SCIENCE had a positive impact on teacher content knowledge (effect size = 0.56, p = 0.006) and a positive impact on a holistic scale of teacher pedagogical content knowledge (effect size = 0.41, p = 0.026). The study also yielded positive and significant impacts on the amount of time teachers spent on science instruction (effect size = 0.40, p = 0.015) and on the emphasis that teachers placed on NGSS-aligned instructional practices, with statistically significant effect sizes ranging from 0.40 to 0.49. This suggestive evidence that Making Sense of SCIENCE changes classroom science learning experiences in ways that align with expectations in NGSS, which is a hypothesized precursor to measuring impacts on student achievement, deserves notice. In regard to student science achievement, the study did not find statistically significant results for the full sample of students (effect size = 0.06, p = 0.494), or for the sample of students in the bottom third of incoming math and English Language Arts achievement, with effect sizes of 0.22 (p = 0.099) and 0.073 (p = 0.567), respectively. Notably, with the exception of one negative effect size, additional analyses on student achievement using different measures and samples yielded positive, but not statistically significant, effect sizes ranging from 0.02 to 0.12. Evaluators offer three potential contributors to the findings of limited impact on student science achievement. First, given the timing of the study in relation to the release of the NGSS in 2013, finding a suitable NGSS-aligned student science assessment was a challenge. Second, most study schools and districts had not yet adopted NGSS-aligned curricula and did not have access to NGSS-aligned curriculum resources. Third, the sample of teachers was unstable across the two years, with the percentage of teachers leaving the school congruous to the percentage observed at the national level. [For the appendices, see ED609254; for the research summary, see ED609256.]

The Literacy Design Collaborative (LDC) was created to support teachers in implementing college and career readiness standards in order to teach literacy skills throughout the content areas. Teachers work collaboratively with coaches to further develop their expertise and design standards-driven, literacy-rich writing assignments within their existing curriculum across all content areas. This report presents the results on implementation of LDC in the New York City Department of Education during the third year of the intervention, and the impact of the program across multiple years. As of 2018-2019, participating schools included 13 from Cohort 1, which began implementation during the 2016-2017 school year, and 23 from Cohort 2, which commenced at the beginning of the 2017-2018 school year. Our primary impact analyses, presented in this report for the first time, pool teachers from both cohorts to measure their impact after participating in LDC for 2 consecutive years (2017-2018 student outcomes for Cohort 1 and 2018-2019 student outcomes for Cohort 2). Teachers and administrators appreciated LDC and perceived positive impact on their practice and their students' learning. Quasi-experimental analyses tended to produce positive estimates for the impact of LDC on student English language arts (ELA) assessment scores, but the differences did not reach the level of statistical significance. [For the 2017-2018 evaluation report, see ED606884.]

Social skill interventions are utilised by educational psychologists (EPs) to promote positive social behaviour amongst pupils. These have predominantly occurred for target populations, rather than at the whole-class level. Research into evidence-based, whole-class interventions for social skill development is warranted. The Good Behaviour Game (GBG) is a contingency management intervention for promoting positive behaviour at the whole-class level. The current study evaluates an adaptation of the GBG to target engagement in social skills in a mainstream primary school classroom setting. An ABAB reversal design was used to evaluate teacher implementation of the GBG. The GBG was shown to be effective in promoting engagement in targeted social behaviour of "positive social interactions" and "working as team". No change in behaviour was observed for the targeted social behaviour of "supporting peers". The paper discusses the implications of the findings, limitations, relevancy to EP practice and impetus for further research.

The purpose of this study was to assess whether intervention with an integrated focus on fraction and decimal magnitude provides added value in improving rational number performance over intervention focused exclusively on fractions. We randomly assigned 4th graders with poor whole-number performance to 3 conditions: a business-as-usual control group and 2 variants of a validated fraction magnitude (FM) intervention. One variant of FM intervention included an integrated component on fraction-decimal magnitude (FM+DM); the other included a fraction applications component (FM+FAPP) to more closely mirror the validated FM intervention and to control for intervention time. Cross-classified partially-nested analyses (N=225) provided the basis for 3 conclusions. First, FM intervention improves 4th-graders' fraction understanding and applications. Second, effects of FM intervention, even without a focus on decimals, transfer to decimal number line performance. Third, an intervention component integrating fraction-decimal magnitude does not provide added value over FM intervention on fraction or decimal performance, except on decimal tasks paralleling intervention tasks. [This is the in press version of an article published in "Contemporary Educational Psychology."]

The Science Notebook in a Universal Design for Learning Environment (SNUDLE) is a digital notebook that uses the Universal Design for Learning framework to support active science learning among elementary school students, particularly those who struggle with reading and writing or are unmotivated to learn science. Preliminary findings from the first of a two-year randomized control trial suggest no significant impact on motivation or academic achievement in science among the full sample of fourth graders receiving the SNUDLE intervention. Moderator analysis indicates significant positive interaction effects of the intervention on motivation in science and science content assessments among students with learning disabilities.

In contrast to prior federally mandated school reforms, the Every Student Succeeds Act (ESSA) allows states more discretion in reforming their lowest performing schools, removes requirements to disrupt the status quo, and does not allocate substantial additional funds. Using a regression discontinuity design, we evaluate a state turnaround initiative aligned with ESSA requirements. We find the effect on student test score growth was not significant in year one and -0.13 in year two. Also in year two, we find that teachers in turnaround schools were 22.5 percentage points more likely to turn over. Teacher turnover appears to have been voluntary rather than the result of strategic staffing decisions.

Important strides have been made in the science of learning to read. Yet, many students still struggle to attain reading proficiency. This calls for sustained efforts to bridge theoretical insights with applied considerations about ideal pedagogy. The current study was designed to contribute to this conversation, namely by looking at the efficacy of an online reading program. The chosen reading program, referred to as MindPlay Virtual Reading Coach (MVRC), emphasizes the mastery of basic reading skills to support the development of reading fluency. Its focus on basic skills diverges from the goal of increasing reading motivation. And its focus on reading fluency, vs. broad literacy achievement, offers an alternative to already existing reading enrichment. In order to test the efficacy of MVRC, we recruited three school districts. One district provided data from elementary schools that used the MVRC program in Grades 2 to 6 (N = 2,531 total). The other two districts participated in a quasi-experimental design: Six 2nd-grade classrooms and nine 4th-grade classrooms were randomly assigned to one of three conditions: (1) instruction as usual, (2) instruction with an alternative online reading program, and (3) instruction with MVRC. Complete data sets were available from 142 2nd-graders and 172 4th-graders. Three assessments from the MVRC screener were used: They assessed reading fluency, phonic skills, and listening vocabulary at two time points: before and after the intervention. Results show a clear advantage of MVRC on reading fluency, more so than on phonics or listening vocabulary. At the same time, teachers reported concerns with MVRC, highlighting the challenge with reading programs that emphasize basic-skills mastery over programs that seek to encourage reading.

This randomized controlled trial examined the impact of adaptive, web-based, scaffolded silent reading instruction on 426 fourth- and fifth-grade students in an urban US school district. Reading proficiency was evaluated in the fall and spring using the Group Reading Assessment Diagnostic Evaluation (GRADE) and an eye movement recording system (Visagraph). Fall GRADE scores and demographic factors were used to pair students. One member of each pair was then randomly assigned to the treatment or control condition and their pair to the alternate condition. During scheduled 25-minute supplemental literacy blocks, students in the control group received "business-as-usual" reading instruction, whereas the treatment group engaged in scaffolded silent reading instruction. Structural equation modeling indicated that scaffolded silent reading instruction produced significantly larger gains on measures of reading efficiency in grade 4 and significantly larger gains on the GRADE reading achievement measures in grade 5. Implications for practice and future research are discussed.

This study assesses the implementation and impacts of the Teacher Potential Project (TPP), a program designed by EL Education and which includes an English language arts (ELA) standards-aligned curriculum and embedded professional development for teachers. The study uses a randomized controlled trial (RCT) design to assess the impacts of TPP on the instructional practice outcomes of ELA teachers in grades 3 through 8 and the ELA achievement outcomes of their students. The RCT includes 70 elementary and middle schools (35 treatment and 35 control) in 18 relatively high-need districts that were randomly assigned to treatment and control conditions within matched pairs of schools in three cohorts that began participating in the 2014-2015, 2015-2016, and 2016-2017 school years. Treatment schools engaged in TPP for one year while control schools continued with business as usual. The study also uses a two-year quasi-experimental design (QED) study to assess the impact of extending implementation of TPP to a second year on teacher instructional practice and student ELA achievement outcomes. EL Education recruited 22 of the study schools (10 treatment and 12 control) in five districts in one cohort to participate in a second year of the study. The study team collected a variety of data for the evaluation of TPP, including teacher surveys and classroom observations administered in fall and spring each year and student administrative records. Impacts of TPP on ELA teacher instructional practices and student ELA achievement were estimated using multivariate regression methods. The implementation evaluation found that the TPP ELA curriculum was implemented in all schools, and that there was generally high school-level implementation fidelity of the TPP professional development components in the first and second years of TPP among the novice ELA teachers. The impact evaluation found positive impacts of TPP on ELA teachers' overall instructional practices after one year compared to teachers who used their district-provided curriculum and participated in their district's professional development supports. After two years of teacher participation, impacts on their students' ELA achievement were roughly equivalent to 1.4 months of typical student improvement, or moving an average student scoring at the 50th percentile to the 54th percentile. The findings be useful to districts and policymakers aiming to support teachers and students in the context of rigorous state standards such as the Common Core State Standards (CCSS). The study of TPP makes several important contributions to the literature evaluating paired curriculum and PD programs: it uses rigorous group designs, evaluates the impact of one and two years of program implementation, and examines broad outcomes on both teacher instructional practice and student ELA achievement. [This report was submitted by Mathematica to EL Education.]

The three-tiered Positive Behavioral Interventions and Supports (PBIS) framework promotes the development of systems and data analysis to guide the selection and implementation of evidence based practices across multiple tiers. The current study examined the effects of universal (tier 1) or school-wide PBIS (SW-PBIS) in one state's scale-up of this tier of the framework. Annual propensity score weights were generated to examine the longitudinal effects of SW-PBIS from 2006–07 through 2011–12. School-level archival and administrative data outcomes were examined using panel models with an autoregressive structure. The sample included 1316 elementary, middle, and high schools. Elementary schools trained in SW-PBIS demonstrated statistically significantly lower suspensions during the fourth and fifth study years (i.e., small effect size) and higher reading and math proficiency rates during the first two study years as well as in one and two later years (i.e., small to large effect sizes), respectively. Secondary schools implementing SW-PBIS had statistically significantly lower suspensions and truancy rates during the second study year and higher reading and math proficiency rates during the second and third study years. These findings demonstrate medium effect sizes for all outcomes except suspensions. Given the widespread use of SW-PBIS across nearly 26,000 schools in the U.S., this study has important implications for educational practices and policies.

The study examined the effect of National Board Certified Teachers (NBCTs) in instructional leadership roles, operationalized as mentors to novice teachers, on (a) classroom practices of mentored novice teachers in Grades K-12 and (b) student achievement of mentored teachers' students in Grades 4-8. The study compared outcomes between NBCT mentors and non-NBCT mentors. The study examined the effect of NBCT mentors after one academic year and was conducted in San Francisco Unified School District. Using the Classroom Assessment Scoring System, we examined novice teachers' classroom practices on the domains of Emotional Support, Classroom Organization, Instructional Support, and across all three domains. The results did not reach statistical significance, but the effect sizes for Emotional Support, Classroom Organization, and a global measure across all domains suggest meaningful differences between classroom practices of novice teachers mentored by NBCTs and non-NBCTs. These effect sizes were 0.28, 0.28, and 0.21 standard deviations, respectively. The effect size for the domain of Instructional Support was near zero at -0.06 standard deviations. Our sample size for the analysis of classroom practices did not have sufficient power to estimate differences at a statistically significant level. We examined student achievement using the state's standardized test scores in mathematics and English language arts. Our achievement measure includes either subject: That is, we did not estimate effects separately for mathematics and English language arts. The results suggest that students taught by teachers mentored by NBCTs had a higher level of achievement than students mentored by non-NBCTs. The difference was statistically significant at a p value of 0.05, and the effect size was meaningful at 0.18 standard deviations. Small sample sizes and low statistical power prevent us from making confident conclusions about the effect of NBCTs in instructional leadership roles on classroom practices of supported teachers and student achievement. However, the evidence is encouraging and warrants additional rigorous research on the impact of NBCTs as instructional leaders.

The Good Behavior Game (GBG, Barrish, Saunders, & Wolf, 1969) and the PATHS Curriculum (Promoting Alternative Thinking Strategies; Greenberg, Kusche, Cook, & Quamma, 1995) represent 2 universal, elementary school, preventive interventions which have been shown in large-scale, randomized controlled trials to have an immediate and beneficial impact (GBG, Dolan et al., 1993; PATHS, Conduct Problems Prevention Research Group [CPPRG], 1999) on aggressive/disruptive and off-task behavior. Importantly, both risk behaviors are strong predictors of antisocial behavior, drug abuse, and low educational and occupational attainment in adolescence and young adulthood (Kellam et al., 2008). What has yet to be explored within a randomized controlled trial is whether the combination of these interventions would yield significantly greater impact on aggressive/disruptive and off-task behavior than the GBG alone. One reason for expecting additive if not synergistic effects as a result of combining the two interventions is that the GBG, by increasing attention to task and reducing disruptive behavior in the classroom, may facilitate the acquisition of the emotion regulation, social problem-solving, and conflict resolution skills taught in PATHS. To that end, a group randomized, effectiveness trial was carried out, wherein 27 schools were randomly assigned to one of 3 conditions, (a) the PAX GBG Alone (Embry, Staatemeier, Richardson, Lauger, & Mitich, 2003), (b) PATHS to PAX (that is, the PAX GBG + PATHS), or (c) a standard setting (control) condition. Classroom observations and teacher ratings of student behavior were carried out at pretest and 6 months later at posttest. Limited evidence of the superiority of the combined approach was found and potential reasons why and future directions are discussed.

The Good Behavior Game (GBG, Barrish, Saunders, & Wolf, 1969) and the PATHS Curriculum (Promoting Alternative Thinking Strategies; Greenberg, Kusche, Cook, & Quamma, 1995) represent 2 universal, elementary school, preventive interventions which have been shown in large-scale, randomized controlled trials to have an immediate and beneficial impact (GBG, Dolan et al., 1993; PATHS, Conduct Problems Prevention Research Group [CPPRG], 1999) on aggressive/disruptive and off-task behavior. Importantly, both risk behaviors are strong predictors of antisocial behavior, drug abuse, and low educational and occupational attainment in adolescence and young adulthood (Kellam et al., 2008). What has yet to be explored within a randomized controlled trial is whether the combination of these interventions would yield significantly greater impact on aggressive/disruptive and off-task behavior than the GBG alone. One reason for expecting additive if not synergistic effects as a result of combining the two interventions is that the GBG, by increasing attention to task and reducing disruptive behavior in the classroom, may facilitate the acquisition of the emotion regulation, social problem-solving, and conflict resolution skills taught in PATHS. To that end, a group randomized, effectiveness trial was carried out, wherein 27 schools were randomly assigned to one of 3 conditions, (a) the PAX GBG Alone (Embry, Staatemeier, Richardson, Lauger, & Mitich, 2003), (b) PATHS to PAX (that is, the PAX GBG + PATHS), or (c) a standard setting (control) condition. Classroom observations and teacher ratings of student behavior were carried out at pretest and 6 months later at posttest. Limited evidence of the superiority of the combined approach was found and potential reasons why and future directions are discussed.

The Parent Leadership Institute (PLI) of Children's Aid (CA), funded via a 2013 Investing in Innovation (i3) development grant operated between the 2014-15 through 2018-19 school years. Key goals of the PLI included: (1) improving the capacity of parents to effectively engage in the school community in support of their child; and (2) increasing the capacity of school staff to create and support environments which are welcoming to and supportive of the active engagement of parents as key members of the school community. Through implementation of the PLI, CA expanded its partnership with six schools located in the South Bronx community of Morrisania, an area characterized by high levels of poverty, health disparities, and crime, and low levels of academic achievement and attainment among both children and adults. This report serves as the final report on this phase of the PLI and includes an exploration of implementation during year 4 (2016-17 school year) and analyses of quantitative data on student academic performance. [This report was prepared for Children's Aid New York.]

The purpose of this study was to examine the effects of a school-wide attendance and truancy intervention and universal procedures (ATI-UP) on student attendance. Student attendance was measured through average daily attendance and the percentage of students who would be considered chronically absent, i.e., missing 10% or more of school. The sample included 27 elementary schools in Oregon implementing school-wide positive behavior intervention and supports (SWPBIS) with varying levels of fidelity. Results indicate that schools can have a moderate effect on increasing average daily attendance (ADA) and a small effect on decreasing chronic absenteeism, although these results were not statistically significant. SWPBIS implementation did not act as a statistically significant moderator on the ATI-UP effects, although the treatment effect on ADA decreased with higher SWPBIS implementation. [The dissertation citations contained here are published with the permission of ProQuest LLC. Further reproduction is prohibited without permission. Copies of dissertations may be obtained by Telephone (800) 1-800-521-0600. Web page: http://www.proquest.com/en-US/products/dissertations/individuals.shtml.]

The present study is a wait-list controlled, randomized study investigating a teacher coaching approach that emphasizes formative assessment and visual performance feedback to enhance elementary school teachers' classroom practices. The coaching model targeted instructional and behavioral management practices as measured by the Classroom Strategies Assessment System (CSAS) Observer and Teacher Forms. The sample included 89 general education teachers, stratified by grade level, and randomly assigned to 1 of 2 conditions: (a) immediate coaching, or (b) waitlist control. Results indicated that, relative to the waitlist control, teachers in immediate coaching demonstrated significantly greater improvements in observations of behavior management strategy use but not for observations of instructional strategy use. Observer- and teacher-completed ratings of behavioral management strategy use at postassessment were significantly improved by both raters; ratings of instructional strategy use were significantly improved for teacher but not observer ratings. A brief coaching intervention improved teachers' use of observed behavior management strategies and self-reported use of behavior management and instructional strategies.

The Literacy Design Collaborative (LDC) was created to support teachers in implementing college and career readiness standards in order to teach literacy skills throughout the content areas. Teachers work collaboratively with coaches to further develop their expertise and design standards-driven, literacy-rich writing assignments within their existing curriculum across all content areas. The 2016-2017 school year was the first year of implementation, following a pilot year during which the implementation plan, instruments, data collection processes, and analytical methodologies were refined. Participants across all groups reported positive attitudes toward LDC and perceive a positive impact on student outcomes. Analysis of module artifacts suggest that teachers at the elementary school level were moderately successful in the backwards design process, particularly in developing high-quality writing tasks for students. As an ongoing multiyear intervention, the LDC implementation will continue to evolve year to year as participants provide feedback and LDC program managers make refinements. Thus, we anticipate that further significant changes to the course material and the delivery system that are already in progress for Year 2 will likely result in continued and possibly increased positive feedback. [Funding for this work was provided by the Literacy Design Collaborative.]

Testing a component model of reading comprehension in a randomized controlled trial, we evaluated the efficacy of 4 interventions that were designed to target components of language and metacognition that predict children's reading comprehension: vocabulary, listening comprehension, comprehension of literate language, academic knowledge, and comprehension monitoring. Third- and 4th-graders with language skills falling below age expectations participated (N = 645). Overall, the component interventions were only somewhat effective in improving the targeted skills, compared to a business-as-usual control (g ranged from -0.14 to 0.33), and no main effects were significant after correcting for multiple comparisons. Effects did not generalize to other language skills or to students' reading comprehension. Moreover, there were Child Characteristic × Treatment interaction effects. For example, the intervention designed to build sensorimotor mental representations was more effective for children with weaker vocabulary skills. Implications for component models of reading and interventions for children at risk of reading comprehension difficulties are discussed.

Testing a component model of reading comprehension in a randomized controlled trial, we evaluated the efficacy of 4 interventions that were designed to target components of language and metacognition that predict children's reading comprehension: vocabulary, listening comprehension, comprehension of literate language, academic knowledge, and comprehension monitoring. Third- and 4th-graders with language skills falling below age expectations participated (N = 645). Overall, the component interventions were only somewhat effective in improving the targeted skills, compared to a business-as-usual control (g ranged from -0.14 to 0.33), and no main effects were significant after correcting for multiple comparisons. Effects did not generalize to other language skills or to students' reading comprehension. Moreover, there were Child Characteristic × Treatment interaction effects. For example, the intervention designed to build sensorimotor mental representations was more effective for children with weaker vocabulary skills. Implications for component models of reading and interventions for children at risk of reading comprehension difficulties are discussed.

This article reports on a study that investigated achievement in math of third and fourth grade dual language immersion (DLI) students, building on research that has demonstrated the academic achievement of students who receive content instruction predominantly in the target language. Our study expands the scope and methodology of prior research by including one-way programs in three languages (Chinese, French and Spanish) and two-way Spanish-English programs; and by relying on propensity matching to mitigate possible effects of school and student differences. In our third grade study, we compared students' math scores in relation to their English Language Arts (ELA) achievement to control for pre-existing differences between DLI and non-DLI students. DLI students who attained the same levels in ELA, and who received math instruction in a target language, performed at the same level as their non-DLI peers in third grade math tests given in English. For the fourth grade study, we compared DLI students to a propensity-matched non-DLI group. DLI students grew more in math than their counterparts not in DLI. The results from this natural experiment indicate that students in a DLI program that has been implemented state-wide were able to succeed academically in math.

We examined the efficacy of an afterschool multicomponent reading intervention for third- through fifth-grade students with reading difficulties. A total of 419 students were identified for participation based on a 90 standard score or below on a screening measure of the Test of Silent Reading Efficiency and Comprehension. Participating students were randomly assigned to a business as usual comparison condition or one of two reading treatments. All treatment students received 30 min of computer-based instruction plus 30 min of small-group tutoring for four to five times per week. No statistically significant reading comprehension posttest group differences were identified (p > 0.05). The limitations of this study included high attrition and absenteeism. These findings extend those from a small sample of experimental studies examining afterschool reading interventions and provide initial evidence that more instruction, after school, may not yield the desired outcome of improved comprehension.

"INSPIRE" is an Investing in Innovation (i3) development grant funded by the Office of Innovation and Improvement, U.S. Department of Education. "INSPIRE" provides an innovative integrated K-12 STEM pipeline approach focused on STEM course content and instructional redesign. The INSPIRE model was implemented in Cabarrus County Schools (CCS), which is among the largest school systems in North Carolina, serving nearly 30,000 students in 39 schools. The impact evaluation included two studies that examined the effect of INSPIRE on mathematics and science achievement as measured by North Carolina standardized End-of-Grades assessments. The elementary study (Study 1) used a three-year, longitudinal, single-cohort quasi-experimental design (QED) to assess the impact of INSPIRE on math achievement at the end of 5th grade after two years of program exposure. The secondary study (Study 2) used an individual-level, longitudinal, randomized controlled trial (RCT) with blocking by school level and cohort to assess the effects of INSPIRE on math and science achievement at the end of 7th and 10th grades after two years of program exposure. For both studies, we compared the outcomes of INSPIRE students with similar students from schools that did not offer a STEM program. For the elementary study, propensity score matching (PSM) was used to match INSPIRE elementary students and comparison student samples at baseline (on pre-test math achievement scores, gender, minority status, and economically disadvantaged status) and baseline equivalence was established all pre-test assessment measures; this study met What Works Clearinghouse (WWC) Group Design Standards with Reservations. For the secondary study, the overall and differential attrition rates were low based on the WWC attrition standards (WWC, 2017); this study met WWC Group Design Standards without Reservations. The results of the elementary study indicated a statistically significant difference between the "INSPIRE" treatment group and the business-as-usual comparison group on the math achievement outcome. Comparison students reported a statistically significant higher increase in math achievement than "INSPIRE" students. Results of the secondary study indicated no statistically significant difference between the "INSPIRE" treatment group and the business-as-usual comparison group on the math and science achievement outcome. The duration of students' exposure to INSPIRE, fidelity of implementation, alignment between PBL instruction and NC standardized assessments, and contextual factors that might have weakened the intervention strength relative to business-as-usual conditions are discussed as possible factors that account for these findings. The report concludes with suggestions for future research and implications for education policy.

Research examining effective reading interventions for students with reading difficulties in the upper elementary grades is limited relative to the information available for the early elementary grades. In the current study, we examined the effects of a multicomponent reading intervention for students with reading comprehension difficulties. We employed a partially nested analysis with latent variables to adequately match the design of the study and provide the necessary precision of intervention effects. We examined the effects of the intervention on students' latent word reading, latent vocabulary, and latent reading comprehension. In addition, we examined whether these effects differed for students of varying levels of reading or English language proficiency. Findings indicated the treatment significantly outperformed the comparison on reading comprehension (ES = 0.38), but no overall group differences were noted on word reading or vocabulary. Students' initial word reading scores moderated this effect. Reading comprehension effects were similar for English learner and non-English learner students. [This article was published in "Journal of Educational Psychology" (EJ1160638).]

Research examining effective reading interventions for students with reading difficulties in the upper elementary grades is limited relative to the information available for the early elementary grades. In the current study, we examined the effects of a multicomponent reading intervention for students with reading comprehension difficulties. We used a partially nested analysis with latent variables to adequately match the design of the study and provide the necessary precision of intervention effects. We examined the effects of the intervention on students' latent word reading, latent vocabulary, and latent reading comprehension. In addition, we examined whether these effects differed for students of varying levels of reading or English language proficiency. Findings indicated the treatment significantly outperformed the comparison on reading comprehension (Effect Size = 0.38), but no overall group differences were noted on word reading or vocabulary. Students' initial word reading scores moderated this effect. Reading comprehension effects were similar for English learner and non-English learner students.

Small-group, text-based discussions are a prominent and effective instructional practice, but the literature on the effects of different group composition methods (i.e., homogeneous vs. heterogeneous ability grouping) has been inconclusive with few direct comparisons of the two grouping methods. A yearlong classroom-based intervention was conducted to examine the ways in which group composition influenced students' discourse and comprehension. Fourth- and fifth-grade students (N = 62) were randomly assigned to either a homogeneous or heterogeneous ability small-group discussion. All students engaged in Quality Talk, a theoretically- and empirically-supported intervention using small-group discussion to promote high-level comprehension. Multilevel modeling revealed that, on average, students displayed positive, statistically and practically significant gains in both basic and high-level comprehension performance over the course of Quality Talk. Further, our findings indicated heterogeneous ability grouping was more beneficial than homogeneous ability grouping for high-level comprehension, on average, with low-ability students struggling more in homogeneous grouping. With respect to student discourse, additional quantitative and qualitative analyses revealed group composition differences in terms of the frequency, duration, and quality of student questions and responses, as well as the types of discourse low-ability students enacted in homogeneous groups. This study expands upon the extant literature and informs future research and practice on group composition methods. [This paper was published in "Contemporary Educational Psychology" v51 p336-355 2017.]

In 2011, the University of Alaska Fairbanks (UAF) received an Investing in Innovation (i3) Grant through the U.S. Department of Education. UAF applied for the grant to expand the predominantly rural-serving Alaska Statewide Mentor Project (ASMP) to urban settings. ASMP is a professional development initiative that supplies fully released, highly trained mentors to early career teachers (ECTs). UAF's i3 grant, The Urban Growth Opportunity (UGO), included five districts: Anchorage, Fairbanks North Star Borough, Kenai Peninsula Borough, Matanuska-Susitna Borough, and Sitka. This is the final report for the grant conducted over four years (2011 2012 to 2014 2015). The research team randomly assigned 556 ECTs to treatment (UGO) and business as usual (BAU) groups. UGO ECTs received an ASMP mentor for two years; BAU ECTs received their districts' business as usual support that varied by district and included content coaches without mentoring support and non-ASMP instructional mentoring support. Researchers conducted impact, implementation, and intervention studies. The impact study included seven outcomes: teacher retention; teacher instructional practice as measured by the three Classroom Assessment Scoring System (CLASS®) domains (Emotional Support, Classroom Organization, and Instructional Support); and student achievement in reading, writing, and mathematics as measured by the state assessment. While UGO ECTs were retained as teachers in Alaska public schools at higher rates than BAU ECTs, the difference was not statistically significant. There were no statistically significant differences between UGO and BAU ECTs on instructional practices as measured by CLASS®. Finally, student achievement was generally higher for students of UGO ECTs, but differences in achievement were statistically significant only for some student groups: primary reading students and secondary math students who were White, Hispanic, Alaskan Native, or two or more races. Results from the implementation study, conducted over three of the four years of implementation, found ASMP implemented UGO with fidelity across all components: mentor recruitment and assignment, mentor participation in professional development, mentor interaction with their ECTs, and mentors' use of formative assessment tools. Results from the intervention study identified two types of mentor-mentee dyads: Gliders and Sliders, with gliders engaging in longer conversations, focused more explicitly on instruction and students, responding to each other more often, and engaging as peers more frequently than the slider dyads.

The goal of this pilot study was to evaluate the effectiveness of a multi-component consultation package in improving teachers' classroom management skills, particularly among teachers with lower baseline levels of knowledge, skills, and intervention-supportive beliefs. Participants were 58 elementary school teachers (93% female; 50% Non-Hispanic White) who received up to eight biweekly consultation sessions focused on general classroom management strategies and implementation of a daily report card (DRC) intervention with one target student with or at-risk for ADHD. Teachers were randomly assigned to either a comparison consultation condition designed to mirror current best practices (Frank & Kratochwill, 2014; Noell & Gansle, 2014) or a multi-component condition designed to simultaneously address teacher knowledge, skills, and beliefs as possible barriers to implementation of classroom interventions. Teachers in both conditions showed significant improvements in labeled praise, appropriate response to student rule violations, and general competence in classroom management. In support of the hypotheses, teachers with lower baseline levels of knowledge, skills, and intervention-supportive beliefs demonstrated more improvement in key outcomes in response to multi-component consultation, as compared to the comparison consultation (Cohen's "d" ranged from 0.33 to 1.12). Implications for research and practice in school consultation are discussed. [This paper was published in "School Mental Health" v9 p218-234 2017.]

Understanding teachers' stress is of critical importance to address the challenges in today's educational climate. Growing numbers of teachers are reporting high levels of occupational stress, and high levels of teacher turnover are having a negative impact on education quality. Cultivating Awareness and Resilience in Education (CARE for Teachers) is a mindfulness-based professional development program designed to promote teachers' social and emotional competence and improve the quality of classroom interactions. The efficacy of the program was assessed using a cluster randomized trial design involving 36 urban elementary schools and 224 teachers. The CARE for Teachers program involved 30 hr of in-person training in addition to intersession phone coaching. At both pre- and postintervention, teachers completed self-report measures and assessments of their participating students. Teachers' classrooms were observed and coded using the Classroom Assessment Scoring System (CLASS). Analyses showed that CARE for Teachers had statistically significant direct positive effects on adaptive emotion regulation, mindfulness, psychological distress, and time urgency. CARE for Teachers also had a statistically significant positive effect on the emotional support domain of the CLASS. The present findings indicate that CARE for Teachers is an effective professional development both for promoting teachers' social and emotional competence and increasing the quality of their classroom interactions.

This study evaluated the effects of a cross-age peer learning program targeting vocabulary and comprehension in kindergarten and fourth-grade classrooms with substantial proportions of English Learners (ELs). The study followed a quasi-experimental design with 12 classrooms (6 kindergarten and 6 fourth grade) in the intervention group and 12 classrooms (6 kindergarten and 6 fourth grade) in the comparison group. Students were assessed before and after the 14-week intervention via curriculum-aligned and norm-referenced vocabulary and comprehension assessments. Findings of analyses of researcher-developed measures showed positive and significant intervention effects on receptive and expressive vocabulary in kindergarten and fourth grade and comprehension (i.e., understanding of text and strategy use) in fourth grade. Findings of analyses of norm-referenced measures showed positive and significant intervention effects on receptive vocabulary in kindergarten. In general, the intervention had similar effects for ELs and non-ELs.

Students with deficits in social skills have been found to experience both short- and long-term problems, including interpersonal conflicts and academic difficulties. These problems are compounded for students with emotional and behavioral disorders (EBD). Class-wide function-related intervention teams (CW-FIT), a multi-tiered classroom management program, has been shown to be effective in increasing on-task behavior and decreasing disruptive behavior of students at risk for EBD. The present study examined the effects of CW-FIT on teachers' ratings of students' social skills, problem behaviors, and academic competence. A randomized control trial was completed with 160 elementary school teachers located in 19 schools across three states. Teachers completed rating scales on 350 students identified as at risk for EBD, for whom consent had been obtained. After being randomly assigned to treatment or control conditions, CW-FIT was implemented for approximately four months in treatment classrooms, after which teachers completed post-test ratings on all students. CW-FIT implementation was associated with significantly improved teacher ratings of social skills and academic competence for students at risk for EBD, but no significant changes in teacher ratings of student problem behaviors were found. Higher fidelity of CW-FIT implementation was associated with improved outcomes. Implications, limitations, and areas for future research are addressed. [This paper was published in "Journal of Positive Behavior Interventions."]

Purpose: The primary aim of the present study was to examine whether different ways of presenting narrative stimuli (i.e., live narrative stimuli versus audio-recorded narrative stimuli) influence children's performances on narrative comprehension and oral-retell quality. Method: Children in kindergarten (n = 54), second grade (n = 74), and fourth grade (n = 65) were matched on their performance on a standardized oral-language comprehension task and then were randomly assigned to 1 of the 2 conditions that differed in how narrative stimuli were presented to children: live narrative stimuli and audio-recorded narrative stimuli. Results: Kindergartners and 2nd graders in the live condition had higher mean performance on narrative comprehension, with effect sizes of 0.43 and 0.39, respectively, after accounting for age, gender, and school. No differences were found in narrative comprehension for children in 4th grade. Children's oral-retell quality did not differ as a function of condition in any grade. Conclusion: These results suggest that how narrative stimuli are presented to children (i.e., live versus audio-recorded narrative stimuli) may affect children's narrative comprehension, particularly for young children in kindergarten and Grade 2. Implications for assessment and instruction are discussed. [Published in "Language, Speech, and Hearing Services in Schools" (EJ1089445).]

Intelligent Tutoring Systems (ITSs) are beneficial for individual students learning in several domains, including mathematics where they have been used to support both secondary and elementary students. Collaborative learning may be beneficial to include in ITSs, particularly for conceptual knowledge. There is little work on collaborative ITSs, and it has mostly focused on older students. We aim to extend this work to elementary school students, by extending an ITS for fractions so it supports collaborative learning. We also build upon our previous work to further investigate the complementary strengths of collaborative and individual learning. In our study, 189 elementary school students worked with a conceptual or a procedural fractions ITS, and either individually or collaboratively. Students in both ITS conditions learned, but there were no differences in learning between individual and collaboration. However, the students working collaboratively spent less time on the tutor, indicating potential benefits of collaborative learning on efficiency in this setting.

This study examined the effectiveness of a researcher-provided intervention with fourth graders with significant reading difficulties. The intervention emphasized multisyllable word reading, fluent reading of high-frequency words and phrases, vocabulary, and comprehension. To identify the participants, 1,695 fourth-grade students were screened using the Gates-MacGinitie Reading Test, and those whose standard scores were 85 or lower were included in the study (N = 483). Participants were randomly assigned (2:1) to receive either researcher-provided intervention (n = 323) or intervention provided by school personnel (business as usual, BAU) (n = 161). Findings revealed no statistically significant differences between students in the researcher-provided intervention and BAU groups. Using effect sizes as an indicator of impact, students in the researcher-implemented treatment generally outperformed students in the school-implemented treatment (BAU). Examining growth in standard scores, both groups made significant gains in reading outcomes with standard score growth from pretest to posttest of 3 standard score points on decoding, 5 on fluency, and 2.0 to 7 standard score points on reading comprehension measures.

The present study used a randomized control trial to examine the effects of a widely used multicomponent Tier 2-type intervention, Passport to Literacy, on the reading ability of 221 fourth graders who initially scored at or below the 30th percentile in reading comprehension. Intervention was provided by research staff to groups of 4-7 students for 30 min, 4 days a week throughout the school year (M = 90.45 lessons). Tier 1 instruction was observed to be of generally high quality and intervention fidelity was strong. Findings revealed small, average effects (ES = -0.14-0.28) in favor of intervention students on standardized measures of comprehension, but no effects on word reading or fluency measures. Exploratory analyses indicated that intervention effects may differ by students' comprehension abilities. Implications for intervention implementation and directions for future research are discussed.

The present study used a randomized control trial to examine the effects of a widely-used multi-component Tier 2 type intervention, Passport to Literacy, on the reading ability of 221 fourth graders who initially scored at or below the 30th percentile in reading comprehension. Intervention was provided by research staff to groups of 4-7 students for 30 min, 4 days a week throughout the school year (M = 90.45 lessons). Tier 1 instruction was observed to be of generally high quality and intervention fidelity was strong. Findings revealed small, average effects (ES = 0.14 -0.28) in favor of intervention students on standardized measures of comprehension, but no effects on word reading or fluency measures. Exploratory analyses indicated intervention effects may differ by students' comprehension abilities. Implications for intervention implementation and directions for future research are discussed. [This paper was published in "Journal of Research on Educational Effectiveness" (EJ1115336).]

Data-based instructional programs have proliferated in American schools despite limited evidence of their effectiveness in improving educator practice and raising student achievement. We report results from a two-year school-randomized evaluation of the Achievement Network (ANet), a program providing schools with standards-aligned interim assessments and intensive supports for instructional data use. Survey data show that ANet increased teacher satisfaction with the timeliness and clarity of the data they receive and available supports for instructional data-use and caused them to review and use interim assessment data more often. ANet did not, however, affect their confidence in data use or how frequently they differentiated instruction. Student impact estimates show no overall effect on student achievement in English language arts or mathematics. Despite the lack program effects on student achievement, we find that achievement is positively correlated with our survey-based measures of teacher perceptions and practices around instructional data use. Exploratory analyses suggest that the success of ANet in improving teacher practice and student achievement varies with the pre-existing capacity of schools to engage in data-based instruction. Schools rated by program staff as having a high level of readiness to implement the intervention prior to random assignment experienced positive impacts on student achievement, while those rated as a having a low level of readiness experienced negative impacts. The following are appended: (1) School Screener Scoring Rubric; (2) Year 2 School Leader and Teacher Survey Scale Items; and (3) School Leader and Teacher Survey Impact Tables.

In August 2010, the Smithsonian Science Education Center (SSEC) received a grant of more than $25 million from the U.S. Department of Education's Investing in Innovation (i3) program for a five-year study to validate its Leadership Assistance for Science Education Reform (LASER) model in three very diverse regions of the United States: rural North Carolina, northern New Mexico, and the Houston Independent School District (HISD). This current report focuses on the confirmatory and exploratory research questions submitted to i3 for the two studies conducted for the LASER i3 validation grant, providing clarifying detail related to methodology and instrumentation. The studies were conducted to answer two confirmatory research questions and two exploratory research questions.

The purpose of this study was to assess the impact of the Arts for Learning (A4L) Lessons Project on the literacy and life skills of students in grades 3, 4, and 5. A4L Lessons is a supplementary literacy curriculum designed to blend the creativity and discipline of the arts with learning science to raise student achievement in reading and writing, as well as to develop literacy and life skills. A cluster-randomized trial was employed, randomly assigning 32 elementary schools in the Beaverton School District in Oregon to receive the A4L intervention or the status-quo control condition. Participants included approximately 5,700 students in the 16 intervention schools and approximately 6,100 students in the 16 control schools. Nearly 40% of the participants qualified for free/reduced-price lunch, approximately 17% were English language learners, and nearly 50% were racial/ethnic minorities. Achievement on the Oregon Assessment of Knowledge and Skills (OAKS) Reading/Literature test (i.e., the state reading test) were compared for the two groups. Achievement on the Comprehensive Cross Unit (CCU) Assessments (i.e., tests designed specifically to measure the impact of the A4L Lessons Project on literacy and life skills) were compared for a subset of six intervention and six control schools. Results from confirmatory analyses revealed no statistically significant impacts of the A4L Lessons Project on students' achievement on the OAKS Reading/Literature test. The effect sizes based on differences between the treatment and control students on the OAKS Reading/Literature test after one, two, and three years of program participation were very small, ranging from -0.03 to 0.05. Results from exploratory analyses revealed that treatment students in grade 4 scored significantly higher than control students on the CCU Assessment, indicating a positive impact of the A4L Lessons Project on student literacy and life skills. The effect sizes indexing the differences ranged from 0.30 to 0.36 across study years. Results from exploratory analyses using the CCU Assessments with students in grades 3 and 5 did not reach statistical significance, indicating that the A4L Lessons Project did not produce a positive impact on student literacy and life skills in these grades. Further research relying on more dependently sensitive assessments may be needed to better determine the impact of the A4L Lessons on students' literacy achievement. Tables are appended.

A multi-cohort cluster randomized trial was conducted to estimate effects of rich vocabulary classroom instruction on vocabulary and reading comprehension. A total of 1,232 fourth- and fifth-grade students from 61 classrooms in 24 schools completed the study. Students received instruction in 140 Tier Two vocabulary words featured in two grade-level novels. Teachers were randomly assigned to either rich vocabulary (treatment) or to business as usual (control). Teachers in the treatment condition allotted 30 minutes per day to the intervention for 14 weeks. Hierarchical linear modeling revealed positive, significant treatment effects on distal and proximal measures of vocabulary and comprehension. However, average distal treatment effects were small (approximate d =0.15) compared with proximal effects (approximate d = 1.24). Observations of teachers' language arts instruction indicated that treatment teachers spent significantly more time on vocabulary and less time on comprehension instruction than did teachers in the control condition. Results support the intensity and depth of the instruction for learning the taught corpus of words, and modest transfer to global vocabulary and comprehension.

This study uses a randomized design to assess the impact of the Balanced Leadership program on principal leadership, instructional climate, principal efficacy, staff turnover, and student achievement in a sample of rural northern Michigan schools. Participating principals report feeling more efficacious, using more effective leadership practices, and having a better instructional climate than control group principals. However, teacher reports indicate that the instructional climate of the schools did not change. Furthermore, we find no impact of the program on student achievement. There was an impact of the program on staff turnover, with principals and teachers in treatment schools significantly more likely to remain in the same school over the 3 years of the study than staff in control schools.

TAP™: The System for Teacher and Student Advancement was launched in 1999 as a comprehensive educator effectiveness model to offer career advancement and leadership opportunities for educators, a fair and transparent evaluation process linked to job-embedded professional development and performance-based compensation, which culminate in improved instructional practices and student achievement. This study illustrates the impact of the TAP System in 66 Louisiana schools. These are primarily high-need schools, with average free/reduced price lunch eligibility of 86%, impacting more than 32,000 students each year. The authors report evidence of a positive effect of the TAP System on student achievement using two complementary analysis strategies: (1) They found a significant positive effect of TAP on 2012-13 K-8 Assessment Index scores, controlling for previous achievement, percentage of students receiving free or reduced price lunch, school configuration, school size (number of students), and percentage of English language learners. The 66 TAP schools scored 3.7 points higher on average than non-TAP schools statewide; and (2) They also found that the TAP schools had significantly greater 2012-13 Assessment Index scores than a group of matched control schools. The TAP schools scored 5.5 points higher on average than their matched controls.

The authors' purpose was to determine the effects of computer-based practice and conceptual interventions on computational fluency and word-problem solving of fourth- and fifth-grade students with mathematics difficulties. A randomized pretest-posttest control group design found that students assigned to the computer-based practice intervention group outperformed students in the comparison group on the retention measure. Students assigned to the conceptual intervention did not outperform the comparison group on any of the outcome variables. Implications for instruction and interventions are discussed.

The authors' purpose was to determine the effects of computer-based practice and conceptual interventions on computational fluency and word-problem solving of fourth- and fifth-grade students with mathematics difficulties. A randomized pretest-posttest control group design found that students assigned to the computer-based practice intervention group outperformed students in the comparison group on the retention measure. Students assigned to the conceptual intervention did not outperform the comparison group on any of the outcome variables. Implications for instruction and interventions are discussed.

The authors' purpose was to determine the effects of computer-based practice and conceptual interventions on computational fluency and word-problem solving of fourth- and fifth-grade students with mathematics difficulties. A randomized pretest-posttest control group design found that students assigned to the computer-based practice intervention group outperformed students in the comparison group on the retention measure. Students assigned to the conceptual intervention did not outperform the comparison group on any of the outcome variables. Implications for instruction and interventions are discussed.

This study investigated whether individual differences in working memory (WM) moderate effects of 2 variations of intervention designed to improve at-risk 4th graders' fraction knowledge. We also examined the effects of each intervention condition against a business-as-usual control group and assessed whether children's measurement interpretation of fractions mediated those effects. At-risk students (n = 243) were randomly assigned to control and 2 intervention conditions. The interventions each lasted 12 weeks, with three 30-min sessions per week. The major focus of both intervention conditions was the measurement interpretation of fractions. Across the 2 conditions, only 5 min of each 30-min session differed. One condition completed activities to build fluency with 4 measurement interpretation topics; in the other, activities were completed to consolidate understanding on the same 4 topics. Results revealed a significant aptitude-treatment interaction, in which students with very weak WM learned better with conceptual activities but children with more adequate (but still low) WM learned better with fluency activities. Both intervention conditions outperformed the control group on all outcomes, and improvement in the measurement interpretation of fractions mediated those effects.

Previous research has linked inquiry-based science instruction (i.e., science instruction that engages students in doing science rather than just learning about science) with greater gains in student learning than text-book based methods (Vanosdall, Klentschy, Hedges & Weisbaum, 2007; Banilower, 2007; Ferguson 2009; Bredderman, 1983; Shymansky, Hedges, & Woodworth, 1990). The LASER model, being validated in the current study, has already been the subject of a number of case studies (RMC Research Corporation, 2010; Horizon Research, 2010; Vanosdall et al., 2007). However, experimental studies of the type that might establish a causal link between program implementation, student science learning, and other valued outcomes have yet to be conducted. Only a handful of studies have involved random assignment, and most of these have involved random assignment of students in a relatively small number of classrooms (see Furtak et al. 2009). With support from the U.S. Department of Education's Investing in Innovation Fund (i3), the current validation study of the LASER Model encompasses approximately 60,000 students, 1,900 teachers, and over 140 district administrators and principals. The efficacy of the LASER program has important implications for both research and practice when working with high-poverty schools and districts, who have limited resources and time available for science interventions. LASER's initial success with early learners also demonstrates its potential for reducing the development of chronic, long-term deficiencies and academic problems. One table and one figure are appended.

This study highlights the connections between two facets of teachers' skills--those supporting teachers' mathematical instructional interactions and those underlying social interactions within the classroom. The impact of the Responsive Classroom (RC) approach and use of RC practices on the use of standards-based mathematics teaching practices was investigated in third-grade classrooms. Eighty-eight third-grade teachers from 24 elementary schools in a large suburban district were selected from a sample of teachers participating in a larger randomized-control study. Results showed that teachers at schools assigned randomly to receive training in the RC approach showed higher use of standards-based mathematics teaching practices than teachers in control schools. These findings were supported by analyses using fidelity of implementation: greater adherence to the intervention predicted the use of more standards-based mathematics teaching practices. Findings support the use of the RC approach for creating classroom social environments that facilitate standards-based mathematical practices. (Contains 3 tables and 1 note.)

Stanford University's Education Program for Gifted Youth (EPGY) conducted a randomized-treatment experiment during the 2006-2007 school year to test the efficacy, for Title I students, of the technological and individualized EPGY Kindergarten through Grade 5 Mathematics Course Sequence, modified for the Title I schools. Restricting attention to students who were in the top half of the distribution of correct first-exercise attempts (a measure of work and engagement), we found substantial and statistically significant improvements in the 2007 California Standard Math Tests (CST07) scores compared to those of matched control students. Gains in second grade were larger than those in Grades 3 to 5. Less able students, as measured by their 2006 CST mathematics scores, also had, on average, larger gains.

This study explored the effects of a web-based decision support system ("Tutorial") for writing standards-based Individualized Education Programs (IEPs). A total of 35 teachers and 154 students participated across two academic years. Participants were assigned to one of three intervention groups based on level of "Tutorial" access: Full, Partial, or Comparison. Direct effects of the intervention on procedural and substantive elements of IEPs revealed that, although all groups had initial IEPs of similar quality, the Full Intervention group's post-"Tutorial" IEPs had a significantly higher proportion of substantive items rated as adequate than did the IEPs of other groups. The intervention's indirect effects were examined using student scores on the State Reading Assessment. The Full Intervention group demonstrated a higher rate of reading score gain than the other two groups during the academic year in which the IEP prepared with access to the "Tutorial" was implemented. Implications for educational practices and future research directions are discussed.

Background: School-based social-emotional and character development (SECD) programs can influence not only SECD but also academic-related outcomes. This study evaluated the impact of one SECD program, Positive Action (PA), on educational outcomes among low-income, urban youth. Methods: The longitudinal study used a matched-pair, cluster-randomized controlled design. Student-reported disaffection with learning and academic grades, and teacher ratings of academic ability and motivation were assessed for a cohort followed from grades 3 to 8. Aggregate school records were used to assess standardized test performance (for entire school, cohort, and demographic subgroups) and absenteeism (entire school). Multilevel growth-curve analyses tested program effects. Results: PA significantly improved growth in academic motivation and mitigated disaffection with learning. There was a positive impact of PA on absenteeism and marginally significant impact on math performance of all students. There were favorable program effects on reading for African American boys and cohort students transitioning between grades 7 and 8, and on math for girls and low-income students. Conclusions: A school-based SECD program was found to influence academic outcomes among students living in low-income, urban communities. Future research should examine mechanisms by which changes in SECD influence changes in academic outcomes.

Interim assessments are increasingly common in U.S. schools. We use high-quality data from a large-scale school-level cluster randomized experiment to examine the impact of two well-known commercial interim assessment programs on mathematics and reading achievement in Indiana. Results indicate that the treatment effects are positive but not consistently significant. The treatment effects are smaller in lower grades (i.e., kindergarten to second grade) and larger in upper grades (i.e., third to eighth grade). Significant treatment effects are detected in Grades 3 to 8, especially in third- and fourth-grade reading and in fifth- and sixth-grade mathematics.

The New York City Leadership Academy represents a unique experiment by a large urban school district to train and develop its own school leaders. Its 14-month Aspiring Principals Program (APP) selects and prepares aspiring principals to lead low-performing schools. This study provides the first systematic evaluation of achievement in APP-staffed schools after 3 or more years. We examine differences between APP principals and those advancing through other routes, the extent to which APP graduates serve and remain in schools, and their relative performance in mathematics and English language arts. On balance, we find that APP principals performed about as well as other new principals. If anything, they narrowed the gap with comparison schools in English language arts but lagged behind in mathematics. (Contains 2 figures, 9 tables, and 23 notes.)

The Good Behavior Game (GBG) is a powerful group contingency with a history of documented empirical support. The purpose of this study was to compare two interdependent group contingencies, the GBG and a positive variation, the Caught Being Good Game (CBGG), in a school implementing school-wide positive behavior support. A kindergarten and fourth-grade classroom teacher with 17 and 20 students, respectively, implemented both versions of the game in a counterbalanced fashion. Using a withdrawal design, results showed similar effects on disruptive and on-task behaviors. The CBGG is discussed as an effective variation of the GBG that is acceptable to both teachers and students. (Contains 2 figures.)

Recess periods often lack the structure needed to support physical activity and positive social development (Robert Wood Johnson Foundation 2010). The Playworks program places full-time coaches in low-income schools to provide opportunities for organized play during recess and throughout the school day. Playworks activities are designed to engage students in physical activity, foster social skills related to cooperation and conflict resolution, improve students' ability to focus on class work, decrease behavioral problems and improve school climate. The Robert Wood Johnson Foundation (RWJF) contracted with Mathematica Policy Research and its subcontractor, the John W. Gardner Center for Youth and Their Communities (JGC) at Stanford University, to conduct a rigorous evaluation of Playworks. Twenty-five schools interested in implementing Playworks were randomly assigned to a treatment group that received Playworks in the 2010-2011 school year or to a control group that was not eligible to implement Playworks until the following year. The authors collected data from students, teachers and school staff in spring 2011 to document the implementation of Playworks and assess the impact of the program on key outcomes in six domains: (1) school climate, (2) conflict resolution and aggression, (3) learning and academic performance, (4) recess experience, (5) youth development and (6) student behavior. Ultimately, four additional schools will be added to the study and further analyses will be released. A description of study design and data sources. (Contains 4 exhibits, 15 tables and 2 endnotes.)

Researchers have demonstrated that cognitive-behavioral intervention strategies--such as social problem solving--provided in school settings can help ameliorate the developmental risk for emotional and behavioral difficulties. In this study, we report the results of a randomized controlled trial of Tools for Getting Along (TFGA), a social problem-solving universally delivered curriculum designed to reduce the developmental risk for serious emotional or behavioral problems among upper elementary grade students. We analyzed pre-intervention and post-intervention teacher-report and student self-report data from 14 schools, 87 classrooms, and a total of 1296 students using multilevel modeling. Results (effect sizes calculated using Hedges' g) indicated that students who were taught TFGA had a more positive approach to problem solving (g = 0.11) and a more rational problem-solving style (g = 0.16). Treated students with relatively poor baseline scores benefited from TFGA on (a) problem-solving knowledge (g = 1.54); (b) teacher-rated executive functioning (g = 0.35 for Behavior Regulation and 0.32 for Metacognition), and proactive aggression (g = 0.20); and (c) self-reported trait anger (g = 0.17) and anger expression (g = 0.21). Thus, TFGA may reduce risk for emotional and behavioral difficulties by improving students' cognitive and emotional self-regulation and increasing their pro-social choices. (Contains 4 tables.)

Function-based support (FBS) is an intervention strategy for decreasing problem behaviors and increasing replacement behaviors through the use of functional behavioral assessment and behavior support planning. Although FBS has been demonstrated to facilitate positive outcomes for children in a variety of educational settings, it has yet to be widely adopted because many schools have limited access to personnel (i.e., school psychologist, behavior specialist) with the expertise to implement it. This series of single-subject studies reports the ongoing development and validation of a method for training general educators to successfully and independently implement FBS for at-risk students in their classrooms. These studies highlight the experiences of one teacher who participated in three training phases and implemented FBS with three at-risk students. Results suggest that training was effective as indicated by knowledge gains regarding FBS principles and procedures, successful mastery and application of FBS practices, positive student outcomes, and favorable teacher and student perceptions of social validity. The implications and limitations of these results, as well as future directions for this line of research, are also discussed. (Contains 3 tables and 4 figures.)

This study investigated the relative effects of three treatments with varying instructional emphases in reading with a comparison condition. Eighty-seven students in fourth grade with reading impairments were assigned through stratified random assignment to one of four conditions: (a) comprehension emphasis, (b) word study emphasis, (c) emphasis of either comprehension or word study based on the student's pretest reading profile, or (d) school-provided intervention comparison condition. Students in the three researcher-provided treatments received intervention in small groups with a trained tutor for 30 min daily for approximately 28 weeks. Results revealed no statistically significant main effects between conditions on measures of word reading, fluency, vocabulary, or comprehension. Students with limited English proficiency performed significantly better at posttest in all conditions than other students. Discussion addresses the challenges of successfully remediating reading problems with older students with significant reading problems. (Contains 3 tables.)

This study investigated the relative effects of three treatments with varying instructional emphases in reading with a comparison condition. Eighty-seven students in fourth grade with reading impairments were assigned through stratified random assignment to one of four conditions: (a) comprehension emphasis, (b) word study emphasis, (c) emphasis of either comprehension or word study based on the student's pretest reading profile, or (d) school-provided intervention comparison condition. Students in the three researcher-provided treatments received intervention in small groups with a trained tutor for 30 min daily for approximately 28 weeks. Results revealed no statistically significant main effects between conditions on measures of word reading, fluency, vocabulary, or comprehension. Students with limited English proficiency performed significantly better at posttest in all conditions than other students. Discussion addresses the challenges of successfully remediating reading problems with older students with significant reading problems. (Contains 3 tables.)

This study investigated the relative effects of three treatments with varying instructional emphases in reading with a comparison condition. Eighty-seven students in fourth grade with reading impairments were assigned through stratified random assignment to one of four conditions: (a) comprehension emphasis, (b) word study emphasis, (c) emphasis of either comprehension or word study based on the student's pretest reading profile, or (d) school-provided intervention comparison condition. Students in the three researcher-provided treatments received intervention in small groups with a trained tutor for 30 min daily for approximately 28 weeks. Results revealed no statistically significant main effects between conditions on measures of word reading, fluency, vocabulary, or comprehension. Students with limited English proficiency performed significantly better at posttest in all conditions than other students. Discussion addresses the challenges of successfully remediating reading problems with older students with significant reading problems. (Contains 3 tables.)

In the first study, using a randomized experiment to measure the impact of school vouchers on college enrollment, Matthew Chingos and Paul Peterson, professor of government at Harvard University, examine the college-going behavior through 2011 of students who participated in a voucher experiment as elementary school students in the late 1990s. They find no overall impacts on college enrollment but do find large, statistically significant positive impacts on the college going of African-American students who participated in the study. Their estimates indicate that using a voucher to attend private school increased the overall college enrollment rate among African Americans by 24 percent. The original data for the analysis come from an experimental evaluation of the privately funded New York School Choice Scholarships Foundation Program, which in the spring of 1997 offered three-year scholarships worth up to a maximum of $1,400 annually to as many as 1,000 low-income families. Chingos and Peterson obtained student information that allowed them to identify over 99 percent of the students who participated in the original experiment so that their college enrollment status could be ascertained by means of the college enrollment database maintained by the National Student Clearinghouse for institutions of higher education that serve 96 percent of all students in the United States. In addition to finding impacts on overall college-going for African Americans, the authors report significant increases in full-time college attendance, enrollment in private four-year colleges, and enrollment in selective four-year colleges for this group of students. Observational and Quasi-Experimental Research are appended. (Contains 7 tables and 19 endnotes.)

This study was conducted by the Central Region Educational Laboratory (REL Central) administered by Mid-continent Research for Education and Learning to provide educators and policymakers with rigorous evidence about the potential of Classroom Assessment for Student Learning (CASL) to improve student achievement. CASL is a widely used professional development program in classroom and formative assessment published by the Assessment Training Institute of Pearson Education. Schools were recruited from across Colorado to participate in the study. Colorado was chosen as the target state primarily because it has one of the largest populations in the Central Region from which to recruit schools and because its statewide achievement test is vertically scaled. This cluster randomized trial of the CASL professional development program had sufficient statistical power to detect an impact of at least 0.25 standard deviation on student achievement. An intent-to-treat analysis was conducted to estimate the impact of CASL on student achievement; all schools were included in the analysis and were analyzed as randomized regardless of the level of implementation fidelity. Analysis did not reveal a statistically significant impact of CASL on the school-level average mathematics achievement of grade 4 and grade 5 students. Results from sensitivity analyses revealed that the impact estimates on student achievement were robust to decisions regarding the inclusion of covariates, estimation method, and the treatment of missing data. In other words, design and analysis decisions made by the research team did not change whether the impact results would have been statistically significant. Appendices include: (1) Power analysis; (2) Response rates by data collection wave, instrument, and experimental group; (3) Data collection instruments; (4) Development, reliability, and validity of teacher outcomes; (5) Teacher Assessment Work Sample; (6) Impact analysis models; (7) Calculation of effect sizes; (8) Treatment of missing data; (9) Variance components estimates and intraclass correlations; (10) Raw means and standard deviations; and (11) Complete mixed model results. (Contains 1 box, 4 figures and 56 tables.

Students with high-incidence disabilities struggle with reading comprehension due to difficulties in background knowledge and metacognitive skills, including use of self-monitoring and other strategies. In the United States, these students typically receive the majority of their instruction in general education settings. However, there is little research comparing reading comprehension interventions with the typical basal curricula used in these classrooms. We compared the effects of an explicit reading comprehension intervention to those of a typical language-arts curriculum on upper elementary and middle school students' (n = 38) retells of passages and understanding of main ideas. A 2 x 4 repeated measures multivariate analysis of variance (MANOVA) revealed significant differences between instructional groups. These results indicate systematic and explicit reading comprehension instruction can be delivered successfully to students with high-incidence disabilities in general education settings. (Contains 3 figures and 4 tables.)

Analyzing mathematics and reading achievement outcomes from a district-level random assignment study fielded in over 500 schools within 59 school districts and seven states, the authors estimate the 1-year impacts of a data-driven reform initiative implemented by the Johns Hopkins Center for Data-Driven Reform in Education (CDDRE). CDDRE consultants work with districts to implement quarterly student benchmark assessments and provide district and school leaders with extensive training on interpreting and using the data to guide reform. Relative to a control condition, in which districts operated as usual without CDDRE services, the data-driven reform initiative caused statistically significant districtwide improvements in student mathematics achievement. The CDDRE intervention also had a positive effect on reading achievement, but the estimates fell short of conventional levels of statistical significance. (Contains 1 figure, 3 tables, and 16 notes.)

Financial incentives for teachers to increase student performance is an increasingly popular education policy around the world. This paper describes a school-based randomized trial in over two-hundred New York City public schools designed to better understand the impact of teacher incentives on student achievement. I find no evidence that teacher incentives increase student performance, attendance, or graduation, nor do I find any evidence that the incentives change student or teacher behavior. If anything, teacher incentives may decrease student achievement, especially in larger schools. The paper concludes with a speculative discussion of theories that may explain these stark results.

In the 2007-2008 school year, the New York City Department of Education and the United Federation of Teachers jointly implemented the Schoolwide Performance Bonus Program in a random sample of the city's high-needs public schools. The program lasted for three school years, and its broad objective was to improve student performance through school-based financial incentives. The question, of course, was whether it was doing so. To examine its implementation and effects, the department tasked a RAND Corporation-led partnership with the National Center on Performance Incentives at Vanderbilt University to conduct a two-year study of the program that would offer an independent assessment. This report describes the results of our analyses for all three years of the program, from 2007-2008 through 2009-2010. This work built on past research and was guided by a theory of action articulated by program leaders. Researchers examined student test scores; teacher, school staff, and administrator surveys; and interviews with administrators, staff members, program sponsors, and union and district officials. The researchers found that the program did not, by itself, improve student achievement, perhaps in part because conditions needed to motivate staff were not achieved (e.g., understanding, buy-in for the bonus criteria) and because of the high level of accountability pressure all the schools already faced. Individual chapters contain footnotes. (Contains 12 figures and 66 tables.) [Additional funding for this paper was provided by the New York City Fund for Public Schools. For "What New York City's Experiment with Schoolwide Performance Bonuses Tells Us about Pay for Performance. Research Brief," see ED521918.]

Are teachers' impacts on students' test scores ("value-added") a good measure of their quality? This question has sparked debate largely because of disagreement about (1) whether value-added (VA) provides unbiased estimates of teachers' impacts on student achievement and (2) whether high-VA teachers improve students' long-term outcomes. We address these two issues by analyzing school district data from grades 3-8 for 2.5 million children linked to tax records on parent characteristics and adult outcomes. We find no evidence of bias in VA estimates using previously unobserved parent characteristics and a quasi-experimental research design based on changes in teaching staff. Students assigned to high-VA teachers are more likely to attend college, attend higher-ranked colleges, earn higher salaries, live in higher SES neighborhoods, and save more for retirement. They are also less likely to have children as teenagers. Teachers have large impacts in all grades from 4 to 8. On average, a one standard deviation improvement in teacher VA in a single grade raises earnings by about 1% at age 28. Replacing a teacher whose VA is in the bottom 5% with an average teacher would increase students' lifetime income by more than $250,000 for the average classroom in our sample. We conclude that good teachers create substantial economic value and that test score impacts are helpful in identifying such teachers.

This article reports the outcomes of a multiyear study comparing the English and Spanish language and reading performance of Spanish-dominant children randomly assigned, beginning in kindergarten, to transitional bilingual education (TBE) or structured English immersion (SEI) for periods of up to 5 years. On the Peabody Picture Vocabulary Test and its Spanish equivalent (Test de Vocabulario en Imagenes Peabody) and on the English and Spanish versions of three Woodcock Reading Scales, first graders in TBE performed significantly better in Spanish and worse in English than did their SEI counterparts. Differences diminished in second and third grades, and by fourth grade, when all students in TBE had transitioned to English-only instruction, there were no significant differences on English reading measures. These findings suggest that Spanish-dominant students learn to read in English equally well in TBE and SEI and that policy should therefore focus on the quality of instruction rather than on the language of instruction for English-language learners. (Contains 1 note and 8 tables.)

This paper reports the fifth-year results of a study comparing the English and Spanish language and reading performance of Spanish-dominant children randomly assigned beginning in kindergarten to Transitional Bilingual Education (TBE) or Structured English Immersion (SEI). This is the first randomized study to compare TBE and SEI reading approaches over a period as long as five years. As expected, on the Peabody Picture Vocabulary Test (PPVT) and its Spanish equivalent (TVIP) and on English and Spanish versions of three Woodcock Reading Scales, kindergartners and first graders in TBE performed significantly better in Spanish and worse in English than their SEI counterparts, controlling for PPVT and TVIP. After transitioning to English, TBE children in grades 2-4 scored significantly lower than those in SEI on the measure of receptive vocabulary, the PPVT, but there were no significant differences on most English reading measures. On the Spanish language (TVIP) and reading measures, TBE students scored significantly higher than SEI in grades K-3, but not grade 4. Both groups gained substantially in English receptive language skills over the years. These findings suggest that Spanish-dominant students learn to read in English (as well as Spanish) equally well in TBE and SEI. (Contains 4 tables.)

This article reports the effects of a comprehensive elementary school-based social-emotional and character education program on school-level achievement, absenteeism, and disciplinary outcomes utilizing a matched-pair, cluster-randomized, controlled design. The "Positive Action" Hawai'i trial included 20 racially/ethnically diverse schools (M enrollment = 544) and was conducted from the 2002-03 through the 2005-06 academic years. Using school-level archival data, analyses comparing change from baseline (2002) to 1-year posttrial (2007) revealed that intervention schools scored 9.8% better on the TerraNova (2nd ed.) test for reading and 8.8% on math, that 20.7% better in Hawai'i Content and Performance Standards scores for reading and 51.4% better in math, and that intervention schools reported 15.2% lower absenteeism and fewer suspensions (72.6%) and retentions (72.7%). Overall, effect sizes were moderate to large (range = 0.5-1.1) for all of the examined outcomes. Sensitivity analyses using permutation models and random-intercept growth curve models substantiated results. The results provide evidence that a comprehensive school-based program, specifically developed to target student behavior and character, can positively influence school-level achievement, attendance, and disciplinary outcomes concurrently. (Contains 6 tables and 2 figures.)

In 2004, the U.S. Department of Education's Institute of Education Sciences contracted with Mathematica Policy Research to conduct a large-scale evaluation of comprehensive teacher induction. The purpose of the study was to determine whether augmenting the set of services districts usually provide to support beginning teachers with a more comprehensive program improves teacher and student outcomes. This is the study's third and final report on the program's impacts. This report compares retention, achievement, and classroom practices of teachers who were offered comprehensive induction services to teachers who were offered the support normally offered by the school. Teachers assigned to receive comprehensive induction for either one or two years were supported by a full-time mentor who received ongoing training and materials to support the teachers' development. The teachers also were offered monthly professional development sessions and opportunities to observe veteran teachers. The teachers were followed for three years. Data was collected from 1,009 beginning teachers in 418 schools in 17 districts. Districts included in the study were not already offering comprehensive induction services, including paying for full-time mentors. Novice teachers in approximately half of the schools were assigned by lottery to receive comprehensive induction services. In 10 of the districts, these teachers were provided one year of comprehensive induction services; in the remaining 7 districts, the teachers were provided two years of services. Teachers in the schools not assigned to receive comprehensive induction services were provided the support normally offered to novice teachers by the school. Teacher practices were measured via classroom observations conducted in the spring of 2006. Data on teacher retention were collected via surveys administered in the fall of 2006, 2007, and 2008. Student test scores were collected from district administrative records for the 2005-06, 2006-07, and 2007-08 school years. Key findings include: (1) During the comprehensive induction program, treatment teachers received more support than control teachers; (2) The extra induction support for treatment teachers did not translate into impacts on classroom practices in the first year; (3) For teachers who received one year of comprehensive induction, there was no impact on student achievement; (4) For teachers who received two years of comprehensive induction, there was no impact on student achievement in the first two years. In the third year, there was a positive and statistically significant impact on student achievement; and (5) Neither exposure to one year nor exposure to two years of comprehensive induction had a positive impact on retention or other teacher workforce outcomes. The following are appended: (1) Supplemental Information for Chapters II and III; (2) Supplemental Information for Chapter IV; (3) Sensitivity Analyses and Supplemental Information for Chapter V; and (4) Sensitivity Analyses and Supplemental Information for Chapter VI.

Teacher compensation schemes are often criticized for lacking a performance-based component. Proponents of merit pay argue that linking teacher salaries to student achievement will incentivize teachers to focus on raising student achievement and stimulate innovation across the school system as a whole. In this paper, we utilize a policy experiment conducted in the New York City public school system to explore the effects of one performance-based bonus scheme. We investigate potential impacts of group-based incentive pay over two academic years (2007-2008 and 2008-2009) on a range of outcomes including: teacher effort, student performance in math and reading, and classroom activities, measured through environmental surveys of teachers and students. We also explore impacts on the market for teachers by examining teacher turnover and the qualifications of newly hired teachers. Overall, we find the bonus program had little impact on any of these outcomes. We argue that the lack of bonus program impacts can be explained by the structure of the bonus program. Group bonuses led to free-riding, which significantly reduced the program's incentives. Once we account for free-riding, we find evidence that the program led teachers to increase their effort through a significant reduction in absenteeism. When considering the effectiveness of performance-based teacher pay, the structure of incentives matter. (Contains 11 tables, 3 figures and 24 footnotes.)

This is the third-year report in a five-year evaluation of the Milwaukee Parental Choice Program (MPCP). The MPCP, which began in 1990, provides government-funded vouchers for low-income children to attend private schools in the City of Milwaukee. The general purposes of the evaluation are to analyze the effectiveness of the MPCP in terms of longitudinal student achievement growth and educational attainment as measured by high school graduation rates. The former will be primarily accomplished by measuring and estimating student growth in achievement as measured by the Wisconsin Knowledge and Concepts Examinations (WKCE) in math and reading in 2006-07, grades 3 through 8 over a five-year period. The latter will be accomplished by following the 2006-07 8th and 9th grade cohorts over a five-year period or longer. The general research design consists of a comparison between a random sample of MPCP students and a matched sample of Milwaukee Public School (MPS) students. This third year report presents results from the November 2008 WKCE tests as second year student achievement growth in MPCP relative to the matched MPS sample. We provide varying descriptive statistics comparing test score means and distributions for math and reading for 2006-07 (baseline year) and 2008-09 (second outcome year) for each sample. The report also analyzes achievement growth using several multivariate techniques and models. The primary finding in all these comparisons is that, in general, there are few statistically significant differences between levels of MPCP and MPS student achievement growth in either math or reading two years after they were carefully matched to each other. In one of the ways of estimating these results, focusing only on those students who have remained in the public or private sector for all three years, private, voucher students are slightly behind MPS students in mathematics achievement growth. The report offers several cautions in interpreting this result against the overwhelming set of results that indicate no difference in achievement growth. Appended are additional tables and study attrition. (Contains 9 tables, 2 figures, and 7 footnotes.) [Additional funding for this project was provided by the Robertson Foundation.]

Children with attention deficit hyperactivity disorder (ADHD) make up a considerable proportion of students who receive special education services in schools. The present study aimed to enhance the outcomes of students with ADHD in special education settings by using a daily report card (DRC). Thirty-three children with ADHD in special education placements were randomly assigned to an intervention condition wherein behavioral consultants worked with the teacher and parent to construct and implement a DRC based on the child's individualized education plan goals and objectives. These children were compared to 30 children in a business as usual control condition. Results indicated positive effects of the DRC on observations of classroom functioning, individualized education plan goal attainment, and teacher ratings of academic productivity and disruptive behavior in the classroom. Further, a greater percentage of children with ADHD in the DRC group were normalized on measures of disruptive behavior and impairment. The intervention did not result in incremental improvement in academic achievement, teacher ratings of ADHD symptoms or impairment, or the student-teacher relationship. The implications of these results for working with children with ADHD in special education settings are discussed. (Contains 5 tables and 1 figure.)

Difficulty learning how to read is a risk factor for school failure, low grades, behavior problems, juvenile delinquency, truancy, unemployment, jail time, and substance abuse. Reading difficulties are common in the educational setting, afflicting anywhere from 20-40 percent of students. Read Naturally is a computer-based reading program which targets the third "big idea" (i.e., accuracy and fluency with reading). The current study assessed the efficacy of the Read Naturally program in second through fourth grade elementary students in a public elementary school. Additionally, this study assessed whether improving reading abilities resulted in changes in classroom behavior problems or self-esteem. Eighty-two students from a small, public elementary school who were in need of additional reading support, according to the DIBELS Benchmark Assessments, participated in the current study. Students were matched on DIBELS scores, grade, race, and gender and then randomly assigned to either the Read Naturally condition or the Education as Usual condition. Students used the Read Naturally program for 30-45 minutes each day, five days a week, for eight weeks. Results suggested that, throughout the 16 weeks of intervention, significant improvements were generally seen on all of the reading measures over time, regardless of the condition to which students were assigned, although small effect sizes generally favored the Read Naturally intervention. Additionally, students in higher grades generally demonstrated more improvement on the WJ-III Summary Scores, WJ-III Passage Comprehension subscale, and the WJ-III Word Attack subscale, regardless of the condition to which they were assigned. Student measures suggest that Read Naturally does not result in increased self-esteem, even with improvements in academic performance. Behavior measures were inconclusive. Generally, the effects of the Read Naturally intervention appear discernible, but not incremental, suggesting that Read Naturally may not be more efficacious than typical education, but may have benefits in terms of targeting larger groups of students, being individualized to each student, and may allow another way for teachers to target the third "big idea." Future research is warranted. [The dissertation citations contained here are published with the permission of ProQuest LLC. Further reproduction is prohibited without permission. Copies of dissertations may be obtained by Telephone (800) 1-800-521-0600. Web page: http://www.proquest.com/en-US/products/dissertations/individuals.shtml.]

In an effort to identify instructional methods that might improve mathematics learning at the grade 4 level when used in a variety of educational settings under typical conditions, the REL Mid-Atlantic research team looked for promising, replicable practices that were being used broadly by teachers in U.S. schools, for which research showed promising results but had not been conducted using methodologies that can establish causal relationships. CompassLearning's Odyssey[R] Math product met all of these criteria. Odyssey Math is a computer-based math curriculum developed by CompassLearning, Inc., to improve math learning for K-12 students. The software consists of a web-accessed series of learning activities, assessments, and math tools. These components constitute the basic framework of the software. CompassLearning professional development trainers presented the learning activities, math tools, and assessments as available options to intervention teachers during the summer professional development session. This study was the first randomized controlled trial to assess the impact of Odyssey Math on student achievement. The study had the statistical power needed to detect a 0.20 effect size and was well designed in that comparable groups were created at baseline and maintained through posttesting. Implementation during the school year was documented and shown to be consistent with typical implementation of the Odyssey Math software. The results from the multilevel model with pretest covariates also indicate that Odyssey Math did not yield a statistically significant impact on end-of-year student achievement. This study generated a statistically unbiased estimate of the effect of Odyssey Math on student achievement when implemented in typical school settings with typical teacher and student use. However, the findings apply only to participating schools, teachers, and students because the study used a volunteer sample. Twelve appendices include: (1) Detailed Professional Development Agenda Sessions; (2) Statistical Power Analysis; (3) Probability of Assignment to Study Conditions; (4) Sample Size from Random Assignment to Data Analysis; (5) Teacher Survey, Fall 2007; (6) Observation Protocols; (7) Odyssey Math Sample Screens; (8) Fidelity Observation Comparisons; (9) Model Variance and Intraclass Correlations; (10) Complete Multilevel Model Results for Research Question 1; (11) Comparison of Assumed Population Parameters for Statistical Power (During Planning Phase) with Corresponding Sample Statistics (During Analysis Phase); and (12) Equations for Multilevel Model Analyses. (Contains 3 figures, 22 tables, 10 exhibits, and 23 footnotes.) [This report was prepared for the National Center for Education Evaluation and Regional Assistance, Institute of Education Sciences under contract with Regional Educational Laboratory Mid-Atlantic administered by Pennsylvania State University.]

In the No Child Left Behind Act (NCLB), Congress called for the U.S. Department of Education (ED) to conduct a rigorous study of the conditions and practices under which educational technology is effective in increasing student academic achievement. A 2007 report presenting study findings for the 2004-2005 school year, indicated that, after one school year, differences in student test scores were not statistically significant between classrooms that were randomly assigned to use software products and those that were randomly assigned not to use products. School and teacher characteristics generally were not related to whether products were effective. The second year of the study examined whether an additional year of teaching experience using the software products increased the estimated effects of software products on student test scores. The evidence for this hypothesis is mixed. For reading, there were no statistically significant differences between the effects that products had on standardized student test scores in the first year and the second year. For sixth grade math, product effects on student test scores were statistically significantly lower (more negative) in the second year than in the first year, and for algebra I, effects on student test scores were statistically significantly higher in the second year than in the first year. The study also tested whether using any of the 10 software products increased student test scores. One product had a positive and statistically significant effect. Nine did not have statistically significant effects on test scores. Five of the insignificant effects were negative and four were positive. Study findings should be interpreted in the context of design and objectives. The study examined a range of reading and math software products in a range of diverse school districts and schools. But it did not study many forms of educational technology and it did not include many types of software products. How much information the findings provide about the effectiveness of products that are not in the study is an open question. Products in the study also were implemented in a specific set of districts and schools, and other districts and schools may have different experiences with the products. The findings should be viewed as one element within a larger set of research studies that have explored the effectiveness of software products. Three appendixes are included: (1) Second-Year Data Collection and Response Rates; (2) Description of Sample for the 10 Products; and (3) Details of Estimation Methods. (Contains 29 footnotes, 4 figures and 24 tables.

In the No Child Left Behind Act (NCLB), Congress called for the U.S. Department of Education (ED) to conduct a rigorous study of the conditions and practices under which educational technology is effective in increasing student academic achievement. A 2007 report presenting study findings for the 2004-2005 school year, indicated that, after one school year, differences in student test scores were not statistically significant between classrooms that were randomly assigned to use software products and those that were randomly assigned not to use products. School and teacher characteristics generally were not related to whether products were effective. The second year of the study examined whether an additional year of teaching experience using the software products increased the estimated effects of software products on student test scores. The evidence for this hypothesis is mixed. For reading, there were no statistically significant differences between the effects that products had on standardized student test scores in the first year and the second year. For sixth grade math, product effects on student test scores were statistically significantly lower (more negative) in the second year than in the first year, and for algebra I, effects on student test scores were statistically significantly higher in the second year than in the first year. The study also tested whether using any of the 10 software products increased student test scores. One product had a positive and statistically significant effect. Nine did not have statistically significant effects on test scores. Five of the insignificant effects were negative and four were positive. Study findings should be interpreted in the context of design and objectives. The study examined a range of reading and math software products in a range of diverse school districts and schools. But it did not study many forms of educational technology and it did not include many types of software products. How much information the findings provide about the effectiveness of products that are not in the study is an open question. Products in the study also were implemented in a specific set of districts and schools, and other districts and schools may have different experiences with the products. The findings should be viewed as one element within a larger set of research studies that have explored the effectiveness of software products. Three appendixes are included: (1) Second-Year Data Collection and Response Rates; (2) Description of Sample for the 10 Products; and (3) Details of Estimation Methods. (Contains 29 footnotes, 4 figures and 24 tables.

This study examined an important but rarely investigated aspect of the dissemination process: the intensity of training provided to practitioners. Counselors in 57 schools were randomly assigned to 1 of 3 conditions: Coping Power-training plus feedback (CP-TF), Coping Power-basic training (CP-BT), or a comparison condition. CP-TF counselors produced reductions in children's externalizing behavior problems and improvements in children's social and academic skills in comparison to results for target children in both the comparison and the CP-BT conditions. Training intensity was critical for successful dissemination, although the implementation mechanism underlying this effect remains unclear, as condition effects were not significant for completion of session objectives but were significant for the quality of counselors' engagement with children. (Contains 3 tables and 3 footnotes.)

This study addresses two questions related to teacher preparation and certification: (1) What are the relative effects on student achievement of teachers who chose to be trained through different routes to certification and how do observed teacher practices vary by chosen route to certification?; and (2) What aspects of certification programs (such as the amount of coursework, the timing of coursework relative to being the lead teacher in the classroom, the core coursework content) are associated with teacher effectiveness? In 63 study schools, every grade that contained at least one eligible alternatively certified (AC) and one eligible traditionally certified (TC) teacher was included. Students in these study grades were randomly assigned to be in the class of an AC or a TC teacher. Students were tested at the beginning of the school year as a baseline measure and at the end of the year as an outcome. Classroom instruction was observed at one point during the year as an outcome. Reported findings include: (1) Both the AC and the TC programs with teachers in the study were diverse in the total instruction they required for their candidates; (2) While teachers trained in TC programs receive all their instruction (and participate in student teaching) prior to becoming regular full-time teachers, AC teachers do not necessarily begin teaching without having received any formal instruction; (3) There were no statistically significant differences between the AC and TC teachers in this study in their average scores on college entrance exams, the selectivity of the college that awarded their bachelor's degree, or their level of educational attainment; (4) There was no statistically significant difference in performance between students of AC teachers and those of TC teachers; (5) There is no evidence from this study that greater levels of teacher training coursework were associated with the effectiveness of AC teachers in the classroom; and (6) There is no evidence that the content of coursework is correlated with teacher effectiveness. Supplementary Technical Information on Data Collection, Response Rates, and Analyses is appended. (Contains 90 footnotes and 28 exhibits.)

This study evaluated the impact of a curriculum called the Early Literacy Skills Builder on the language and early literacy skills of students with significant developmental disabilities. Students in the control group received the ongoing sight word and picture instruction prescribed by their individualized education programs. Results indicate statistically significant interaction effects for the treatment group for two research team-designed measures of early literacy (the Nonverbal Literacy Assessment and a pretest/posttest for the experimental curriculum). Significant interaction effects were also found for two standardized measures (Peabody Picture Vocabulary Test III and Memory for Sentences of the Woodcock Language Proficiency Battery). Implications and future research needs are provided.

In practice, teacher induction is common, but induction that is intensive, comprehensive, structured, and sequentially delivered in response to teachers' emerging pedagogical needs is less so. Congressional interest in formal, comprehensive teacher induction has grown in recent years. The National Center for Education Evaluation and Regional Assistance within the U.S. Department of Education's (ED) Institute of Education Sciences (IES) contracted with Mathematica Policy Research, Inc. (MPR), to evaluate the impact of structured and intensive teacher induction programs. The study examines whether comprehensive teacher induction programs lead to higher teacher retention rates and other positive teacher and student outcomes as compared to prevailing, generally less comprehensive approaches to supporting new teachers. More specifically, the study is designed to address five research questions on the impacts of teacher induction services: (1) What is the effect of comprehensive teacher induction on the types and intensity of induction services teachers receive compared to the services they receive from the districts' current induction programs?; (2) What are the impacts on teachers' classroom practices?; (3) What are the impacts on student achievement?; (4) What are the impacts on teacher retention?; and (5) What is the impact on the composition of the district's teaching workforce? Statistically significant differences between the treatment and control groups were identified in the amount, types, and content of induction support teachers reported having received, both in the fall and the spring of the intervention year. Although treatment teachers reported receiving more mentoring than did control teachers; were more likely than control teachers to report participating in specific induction activities; and spent more time in certain professional activities than did control teachers during the three months prior to the spring survey, summarized comparisons between treatment and control groups found: (1) No impacts on teacher practices; (2) No positive impacts on student test scores; (3) No impacts on teacher retention; and (4) No positive impacts on composition of district teaching workforce. This report focused on the first year of findings only. The research team is conducting longer term follow-up to include additional collection of test score and teacher mobility data. Eight appendices are included: (1) National Data on Teacher Induction; (2) Analysis Weights; (3) Impact Estimation Methods; (4) Classroom Observation Methods; (5) Reference Tables for Chapter II; (6) Supplemental Tables for Chapter IV; (7) Supplemental Tables for Chapter V; and (8) Supplemental Figures. (Contains 43 footnotes, 15 figures and 101 tables.)

High schools have recently become a popular source of mentors for school-based mentoring (SBM) programs. The high school Bigs program of Big Brothers Big Sisters of America, for example, currently involves close to 50,000 high-school-aged mentors across the country. While the use of these young mentors has several potential advantages, their age raises questions about their capacity to be consistent, positive role models, and, in turn, their potential to yield strong impacts for the youth they mentor. With support from The Atlantic Philanthropies and in collaboration with Big Brothers Big Sisters of America, Public/Private Ventures set out to address these questions using data from our large-scale random assignment impact study of Big Brothers Big Sisters SBM (Herrera, et al. 2007). We found that, on average, high school students were much less effective than adults at yielding impacts for the youth they mentor. However, our research identified several program practices that were linked with longer, stronger and more effective high school mentor relationships. High School Students as Mentors stresses the need for programs with high school volunteers to use the inherent strengths of these volunteers and, at the same time, meet their distinct needs. Big Brothers Big Sisters of America is already initiating most of the changes suggested in the study in its high school Bigs program; it has convened a group of six of its strongest Big Brothers Big Sisters agencies to review these and other findings and share their own experiences and strategies in an effort to strengthen their model. (Contains 41 endnotes, 3 figures and 2 tables.)

Using the telephone to contact others can be an important skill in maintaining friendships with peers. This investigation used a system of least prompts (SLP) procedures to teach two telephone skills to 3 elementary students with cognitive disabilities: (a) placing phone calls and (b) leaving recorded voicemail messages. The SLP procedure was effective in teaching both skills to all 3 students. Results for maintenance and generalization, however, were mixed.

The process of functional assessment has emerged as an essential component for intervention development. Applications across divergent types of problem behavior, however, remain limited. This study evaluated the applicability of this promising approach to students with selective mutism. Two middle school students served as participants. The functional assessment included indirect and direct methods as well as a specially designed student interview that did not require speech. Individualized interventions were developed and experimentally evaluated. Results indicated that the assessment-based interventions effectively increased speaking in school contexts. (Contains 2 figures.)

This study compared two instructional methods for teaching spelling to elementary students with learning disabilities (LD). Forty-two elementary students with LD were randomly assigned to one of two instructional groups to teach spelling words: (a) a rule-based strategy group that focused on teaching students spelling rules (based on the "Spelling Mastery Level D" program) and (b) a traditional instruction group that provided an array of spelling activities (i.e., introducing the words in the context of story, defining the meaning of the words, sentence writing, and dictionary skill training) to teach spelling words. Daily instructional sessions lasting 30 minutes were conducted for 4 consecutive weeks. Four different word types (i.e., regular, morphological, spelling rule, and irregular) were introduced as instruction progressed. After receiving instruction in one of the instructional groups, the students were compared on scores from unit tests, a standardized test, a sentence-writing test, a transfer test, and a maintenance test. Overall results indicated that the rule-based strategy group using "Spelling Mastery Level D" was more effective in increasing student-spelling performance, particularly for the regular, morphological, and spelling-rule words. The instructional implications of these findings are discussed. (Contains 7 tables.)

This study compared the use of two supplemental balanced and strategic reading interventions that targeted the decoding, fluency, and reading comprehension of upper-elementary and middle school students with reading disabilities (RD). All students had significant delays in decoding, fluency, comprehension, and language processing. Two comparable, intensive tutorial treatments differed only in the degree of explicitness of the comprehension strategy instruction. Overall, there was meaningful progress in students' reading decoding, fluency, and comprehension. Gains in formal measures of word attack and reading fluency after five weeks of intervention translated into grade-equivalent gains of approximately half a school year. Analysis of the trends in the daily informal fluency probes translated into a weekly gain of 1.28 correct words per minute. The more explicit comprehension strategy instruction was more effective than the less explicit treatment. Findings are discussed in light of the question of how to maximize the effects of reading interventions for older children with RD.

Far more has been written about the possible outcomes of cross-age mentoring than about actual outcomes and the processes that lead to change. This study examined the effect of mentors' attendance on their mentees' outcomes after six months of developmental mentoring. Developmental mentoring is a structured, cross-age peer mentoring program designed to promote children's development by facilitating connectedness. In this randomized study of 73 Caucasian, rural youth, multiple analyses of covariance revealed that connectedness to school and parents at posttest were significantly greater for mentees than for the comparison group. Regression analyses revealed that changes in self-esteem, social skills, and behavioral competence were highly related to mentors' attendance, suggesting relational processes accounted for more change than did exposure to program curricula. However, the relationship between mentors' inconsistent attendance and mentees' decline in self-esteem and behavioral competence suggests that absent mentors may do more harm than good. (Contains 4 tables.)

In this paper, we describe the results a study assessing the relationship between the certification of teachers by the National Board for Professional Teaching Standards (NBPTS) and elementary level student achievement. We examine whether NBPTS assesses the most effective applicants, whether certification by NBPTS serves as a signal of teacher quality, and whether completing the NBPTS assessment process serves as catalyst for increasing teacher effectiveness. We find consistent evidence that NBPTS is identifying the more effective teacher applicants and that National Board Certified Teachers are generally more effective than teachers who never applied to the program. The statistical significance and magnitude of the "NBPTS effect," however, differs significantly by grade level and student type. We do not find evidence that the NBPTS certification process itself does anything to increase teacher effectiveness. Data tables are appended. (Contains 7 tables, 1 figure, and 49 endnotes.)

Although schools across the country are investing heavily in computers in the classroom, there is surprisingly little evidence that they actually improve student achievement. In this paper, we present results from a randomized study of a well-defined use of computers in schools: a popular instructional computer program, known as Fast ForWord, which is designed to improve language and reading skills. We assess the impact of the program on students having difficulty learning to read using four different measures of language and reading ability. Our estimates suggest that while use of the computer program may improve some aspects of students' language skills, it does not appear that these gains translate into a broader measure of language acquisition or into actual readings skills.

Spanish-dominant bilingual students in grades 2-5 were tutored 3 times per week for 40 minutes over 10 weeks, using 2 English reading interventions. Tutoring took place from February through April of 1 school year. One, Read Well, combined systematic phonics instruction with practice in decodable text, and the other, a revised version of Read Naturally, consisted of repeated reading, with contextualized vocabulary and comprehension instruction. The progress of tutored students (n = 51) was compared to that of nontutored classmates (n = 42) using subtests of the Woodcock Reading Mastery Tests-Revised. Students who received systematic phonics instruction made significant progress in word identification but not in word attack or passage comprehension. There were no significant effects for students in the repeated reading condition.

This study evaluated the efficacy of the computer-assisted intervention program known as Fast ForWord Language? in a sample of migrant students in Grades 1 through 6 who were native Spanish speakers. Fast ForWord Language? combines intensive training in multiple receptive English language skills with adaptive acoustic waveform lengthening and amplification to purportedly accelerate the English language learning skills of children who are nonnative English language speakers. Students either were randomly assigned to a treatment or no-contact control condition or were matched on grade, English language proficiency, and nonverbal IQ. All students were assessed in five domains before and immediately after the 4- to 8-week intervention: (a) spoken English language proficiency; (b) oral language competency; (c) phonological awareness; (d) basic reading skills; and (e) classroom behavior. Except for performance on a measure of sight-word recognition, on which children in the treatment group achieved a significantly greater gain than those in the control group, changes in test scores from pretest to posttest were equivalent for the two groups. However, when students who were least fluent in spoken English in each group were compared, the children in the treatment group demonstrated superior gains in expressive language, sight-word recognition, and pseudoword decoding. Thus, Fast ForWord Language? had a substantial, albeit limited impact on the oral language skills and reading performance of migrant children in this study. However, due to methodological weaknesses and limited treatment fidelity, the study results must be interpreted cautiously.

This study examined the reading gains of students with mild disabilities who were taught with one of two programs: "Horizons Fast Track A-B" (Engelmann, Engelmann, & Seitz-Davis, 1997) or "Reading Mastery Fast Cycle" (Engelmann & Bruner, 1995). A quasi-experimental design with preexisting groups was used to examine changes from pretest to posttest. Results revealed a pattern of small differences favoring "Reading Mastery Fast Cycle" on measures of decoding; however, these differences were not statistically significant. Both programs were effective in producing statistically significant improvements in word attack, comprehension, letter and word identification, phonemic awareness, and print awareness skills. Participating teachers agreed that both programs were effective; however, anecdotal information from teacher interviews suggested that all participating teachers preferred "Horizons Fast Track." (Contains 4 tables.)

This study evaluates the effects of the Coping Power Program with at-risk preadolescent boys at the time of transition from elementary school to middle school. Aggressive boys were randomly assigned to receive only the Coping Power child component, the full Coping Power Program with parent and child components, or a control condition. Results indicated that the Coping Power intervention produced lower rates of covert delinquent behavior and of parent-rated substance use at the 1-year follow-up than did the control cell, and these intervention effects were most apparent for the full Coping Power Program with parent and child components. Boys also displayed teacher-rated behavioral improvements in school during the follow-up year, and these effects appeared to be primarily influenced by the Coping Power child component.

Special education teachers (N=22) monitored the mathematics progress of 42 students (grades 2-8) with mild to moderate disabilities (mostly learning disabilities) for 20 weeks using curriculum-based measurement (CBM). Evaluation of instructional adjustments based on individual CBM results found that students whose instruction had been individually adjusted performed significantly better on a global achievement test than comparison students. (Contains references.) (DB)

Starting with the 1997-1998 school year, the Direct Instruction Reading/Language Arts Program was implemented in three elementary schools in a northwest urban public school system as a 3-year pilot study to improve the academic performance of at-risk students. Direct Instruction (DI) is aimed at providing effective learning for low-achieving elementary school students from disadvantaged backgrounds. DI was first implemented in 1968 at the University of Oregon in Eugene as part of Project Follow Through. Although the national evaluation of Project Follow Through favors the DI model in terms of both short- and long-term program effects, the findings from DI programs implemented across the United States are not always consistent. This study examines DI program effects on the reading ability of urban elementary school students at three grade levels who had been in the program for 2 consecutive years. Subjects were 93 fourth graders, 71 fifth graders, and 81 sixth graders. The evaluation reveals mixed findings. Performance of sixth grade DI schools was lower than that of sixth graders in control schools. (Contains 4 tables, 3 figures, and 22 references.) (SLD)

Examines the effects of classwide peer-assisted learning strategies (PALS) in mathematics incorporating the use of curriculum-based measurement on acquisition and transfer learning of three types of students (average-achieving student, low-achieving students, and students with a learning disability). Analysis of variance indicates superior mathematics growth for students in PALS condition. (Author/JDM)

Effects of heterogeneous peer response groups (heterogeneous for language proficiency and ability) on the writing of limited-English-proficient (LEP) students was investigated in fourth-grade language arts classes. After one month, significant improvements on two measures of fluency were found for LEP students assigned to peer response groups, but overall quality of compositions produced did not differ. (TD)

Examines the effectiveness of imbedding strategy instruction in the context of a process approach to writing. Finds that the strategy instructional procedures had a positive effect on the fourth- and fifth-grade students' writing, for both students with and without a learning disability. Shows that, overall, improvements in story quality were maintained and generalized by all of the students. (SR)

The effects of on-going curriculum-based measurement of student growth and expert system instructional consultation on teacher planning and student achievement in mathematics operations were studied for 33 elementary teachers assigned to one control or 2 experimental groups. Each teacher worked with two learning disabled or emotionally disturbed students. (SLD)

This study compared the effectiveness of 3 procedures for teaching 62 elementary students with learning disabilities to identify the correct algorithm in solving addition and subtraction word problems. The group receiving strategy teaching and sequencing practice problems and the group receiving strategy teaching only scored higher than sequencing-only students. (Author/JDD)

Students in fourth and seventh grade who were poor comprehenders were taught prediction, clarification, question generation, and summarization using scaffolding instruction. Performance on a standardized comprehension test improved for the students who received the instruction. (PCB)