Keyword

Filters
Publication Date
2
61
156
327
Topic
190
138
44
58
8
8
Populations
45
41
Product Type
13
75
237
10
Grade Level
327
327
Evidence Tier
45
45
61
2
201
Locale
52
50
139

Search Results

325 Results filtered by:
Product Type Grade Level Highest Evidence Tier Name (Release Date)
Practice Guide 4-9 1
Providing Reading Interventions for Students in Grades 4–9 (March 2022)
This practice guide provides four evidence-based recommendations that teachers can use to deliver reading interventions to meet the needs of their students.
Practice Guide K-6 1
Assisting Students Struggling with Mathematics: Intervention in the Elementary Grades (March 2021)
This practice guide provides evidence-based practices that can help teachers tailor their instructional approaches and/or their mathematics intervention programs to meet the needs of their students.
Practice Guide 1-6 1
Teaching Elementary School Students to Be Effective Writers (June 2012)
This practice guide provides four recommendations for improving elementary students’ writing. Each recommendation includes implementation steps and solutions for common roadblocks. The recommendations also summarize and rate supporting evidence. This guide is geared toward teachers, literacy coaches, and other educators who want to improve the writing of their elementary students.
Practice Guide 4-8 1
Improving Mathematical Problem Solving in Grades 4 Through 8 (May 2012)
This practice guide provides five recommendations for improving students’ mathematical problem solving in grades 4 through 8. This guide is geared toward teachers, math coaches, other educators, and curriculum developers who want to improve the mathematical problem solving of students.
Practice Guide K-8 3
Developing Effective Fractions Instruction for Kindergarten Through 8th Grade (September 2010)
This practice guide presents five recommendations intended to help educators improve students’ understanding of fractions. Recommendations include strategies to develop young children’s understanding of early fraction concepts and ideas for helping older children understand the meaning of fractions and the computations involved. The guide also highlights ways to build on students’ existing strategies to solve problems involving ratios, rates, and proportions.
Practice Guide K-12 3
Structuring Out-of-School Time to Improve Academic Achievement (July 2009)
Out-of-school time programs can enhance academic achievement by helping students learn outside the classroom.
Practice Guide 1-8 3
Assisting Students Struggling with Mathematics: Response to Intervention (RtI) for Elementary and Middle Schools (April 2009)
Taking early action may be key to helping students struggling with mathematics.
Practice Guide K-6 3
Reducing Behavior Problems in the Elementary School Classroom (September 2008)
Designed for elementary school educators and school- and district-level administrators, this guide offers prevention, implementation, and schoolwide strategies that can be used to reduce problematic behavior that interferes with the ability of students to attend to and engage fully in instructional activities.
Practice Guide K-5 3
Effective Literacy and English Language Instruction for English Learners in the Elementary Grades (December 2007)
The target audience for this guide is a broad spectrum of school practitioners such as administrators, curriculum specialists, coaches, staff development specialists and teachers who face the challenge of providing effective literacy instruction for English language learners in the elementary grades.
Practice Guide K-PS 3
Encouraging Girls in Math and Science (September 2007)
The objective of this guide is to provide teachers with specific recommendations that can be carried out in the classroom without requiring systemic change.
Practice Guide K-PS 3
Organizing Instruction and Study to Improve Student Learning (September 2007)
This guide includes a set of concrete actions relating to the use of instructional and study time that are applicable to subjects that demand a great deal of content learning, including social studies, science, and mathematics.
Practice Guide 2-12 4
Using Student Achievement Data to Support Instructional Decision Making (September 2009)
This guide offers five recommendations to help educators effectively use data to monitor students’ academic progress and evaluate instructional practices.
Practice Guide K-12 4
Turning Around Chronically Low-Performing Schools (May 2008)
This guide identifies practices that can improve the performance of chronically low-performing schools—a process commonly referred to as creating "turnaround schools."
Intervention Report 4-7 1
Intelligent Tutoring for Structure Strategy (ITSS) (Adolescent Literacy) (April 2020)
Web-Based Intelligent Tutoring for the Structure Strategy (ITSS) is a supplemental web-based program for students in grades K-8. It is intended to develop literacy skills needed to understand factual texts encountered in classrooms and everyday life. The program teaches students how to follow the logical structure of factual text and to use text structure to improve understanding and recall. In particular, ITSS highlights five main text structures that are used to (1) make comparisons; (2) present problems and solutions; (3) link causes and effects; (4) present sequences; and (5) describe things, people, creatures, places, or events. The program helps students classify the structure of a passage by identifying certain key words, such as “solution” and “in contrast,” that clue readers in to the type of arguments the text is making.
Intervention Report K-4 1
Success for All® (Beginning Reading) (March 2017)
Success for All (SFA®) is a whole-school reform model (that is, a model that integrates curriculum, school culture, family, and community supports) for students in prekindergarten through grade 8. SFA® includes a literacy program, quarterly assessments of student learning, a social-emotional development program, computer-assisted tutoring tools, family support teams for students’ parents, a facilitator who works with school personnel, and extensive training for all intervention teachers. The literacy program emphasizes phonics for beginning readers and comprehension for all students. Teachers provide reading instruction to students grouped by reading ability for 90 minutes a day, 5 days a week. In addition, certified teachers or paraprofessionals provide daily tutoring to students who have difficulty reading at the same level as their classmates.
Intervention Report 4-10 1
READ 180® (Adolescent Literacy) (November 2016)
READ 180® is a reading program designed for struggling readers who are reading 2 or more years below grade level. It combines online and direct instruction, student assessment, and teacher professional development. READ 180® is delivered in 90-minute sessions that include whole-group instruction, three small-group rotations, and whole-class wrap-up. Small-group rotations include individualized instruction using an adaptive computer application, small-group instruction, and independent reading. READ 180® is designed for students in elementary through high school.
Intervention Report K-12 1
Teach for America (Teacher Training, Evaluation, and Compensation) (August 2016)
Teach For America (TFA) is a highly selective route to teacher certification that aims to place non-traditionally trained teachers in high-need public schools. Many TFA teachers hold bachelors’ degrees from selective colleges and universities, in fields outside of education. TFA teachers commit to teach for at least 2 years. TFA teachers receive 5–7 weeks of in-person training over the summer before they begin teaching, then continue to receive professional development and one-on-one coaching from TFA while teaching, in addition to support provided by their schools and districts. As full-time employees of the public schools where they work, TFA teachers receive the same salary and benefits as other first- or second-year teachers in their school or district.
Intervention Report K-8 2
Dual Language Programs (Systematic Review Protocol for English Language Arts Interventions) (December 2022)
Dual language programs are long-term instructional programs that provide content and literacy instruction to all students through two languages—English and a partner language—with the goals of promoting academic achievement, bilingualism and biliteracy, and sociocultural competence. Dual language programs can be implemented with students from one language group (in one-way programs) or with students from two language groups (in two-way programs).
Intervention Report 4-8 2
eMINTS Comprehensive Program (Teacher Excellence Review Protocol ) (April 2020)
The eMINTS Comprehensive Program aims to help teachers improve their practice and the outcomes of their students by offering structured professional development, coaching, and support for integrating technology into the classroom. The program’s goals include supporting teachers in using classroom technology to implement high-quality, inquiry-based learning, in which students develop understanding and knowledge of content matter by engaging in meaningful investigations that require reasoning, judgement, and decision making. The intervention can provide support to teachers in any subject area, including math, literacy, and science.
Intervention Report 2-9 2
Achieve3000 (Adolescent Literacy) (February 2018)
Achieve3000® is a supplemental online literacy program that provides nonfiction reading content to students in grades preK–12 and focuses on building phonemic awareness, phonics, fluency, reading comprehension, vocabulary, and writing skills. Achieve3000® is designed to help students advance their nonfiction reading skills by providing differentiated online instruction. Teachers use the program with an entire class but the assignments are tailored to each student’s reading ability level. For example, teachers assign an article and related activities to an entire class; the program then tailors the version of the article to each student by automatically increasing the difficulty of text when a student is ready for more challenging text. Achieve3000® provides lessons that follow a five-step routine: (1) respond to a Before Reading Poll, (2) read an article, (3) answer activity questions, (4) respond to an After Reading Poll, and (5) answer a Thought Question. Progress reports and student usage data, provided by the online tool, enable teachers to track both whole-class and individual student progress. The program is designed for diverse student groups, including general education students, struggling readers in need of intensive tutoring, and English learners.
Intervention Report 4-8 2
Odyssey® Math (Primary Mathematics) (January 2017)
Odyssey® Math is a web-based program developed by Compass Learning® for mathematics instruction in grades K–8. The online program includes a mathematics curriculum and formative assessments designed to support differentiated and data-driven instruction. Based on assessment results, the program generates an individualized sequence of mathematics topics and skills—a “learning path.” Odyssey® Math is often used as a prescriptive tool, where students can start by taking a diagnostic assessment aligned with local or state standards. Teachers can modify learning paths to match their lesson plans or to align them with district scopes and sequences.
Intervention Report 2-6 2
Cooperative Integrated Reading and Composition® (CIRC®) (Beginning Reading) (June 2012)
Cooperative Integrated Reading and Composition® (CIRC®) is a comprehensive reading and writing program for students in grades 2–8. It includes story-related activities, direct instruction in reading comprehension, and integrated reading and language arts activities. Pairs of students (grouped either by or across ability levels) read to each other, predict how stories will end, summarize stories, write responses, and practice spelling, decoding, and vocabulary. Within cooperative teams of four, students work to understand the main idea of a story and work through the writing process. The CIRC® process includes teacher instruction, team practice, peer assessment, and team/partner recognition. A Spanish version of the program was also designed for grades 2–5.
Intervention Report K-6 2
Peer-Assisted Learning Strategies (Beginning Reading) (May 2012)
Peer-Assisted Learning Strategies is a peer-tutoring program for grades K–6 that aims to improve student proficiency in several disciplines. During the 30-35 minute peer-tutoring sessions, students take turns acting at the tutor, coaching and correcting one another as they work through problems. The designation of tutoring pairs and skill assignment is based on teacher judgement of student needs and abilities, and teachers reassign tutoring pairs regularly.  
Intervention Report 4-5 3
Science Teachers Learning through Lesson Analysis (STeLLA) Professional Development (Science) (May 2021)
Science Teachers Learning through Lesson Analysis (STeLLA®) is a professional development program, developed by BSCS Science Learning, that aims to improve students’ science achievement by improving teachers’ science content knowledge and their abilities to (a) explain science concepts to students, (b) clearly identify to students the science concepts used in student learning activities, and (c) engage students in thinking about science.
Intervention Report K-12 3
McREL Balanced Leadership (School Leadership Review Protocol ) (March 2020)
Balanced Leadership® is a professional development program for school principals and other current and aspiring school leaders in schools serving kindergarten through grade 12. School leaders participate in professional development sessions with trained facilitators over one or two years, practice what they learn between sessions, and can receive additional coaching and online support. McREL International, the company that developed the Balanced Leadership® program, based the framework and content of the professional development on research identifying key actions and behaviors of school leaders that are associated with improved student outcomes.
Intervention Report 4 3
Fraction Face-Off! (Primary Mathematics) (March 2020)
Fraction Face-Off! is a supplemental math program developed to support fourth-grade students who need assistance solving fraction problems. Teachers use program materials with individual students or small groups to promote understanding of the magnitude of fractions, to compare two fractions, to put three fractions in order, and to place fractions on a number line.
Intervention Report 2-10 3
Self-Regulated Strategy Development (Students with a Specific Learning Disability) (November 2017)
Self-Regulated Strategy Development (SRSD) is an intervention designed to improve students’ academic skills through a six-step process that teaches students specific academic strategies and self-regulation skills. The practice is especially appropriate for students with learning disabilities. The intervention begins with teacher direction and ends with students independently applying the strategy, such as planning and organizing ideas before writing an essay. More specifically, the six steps involve the teacher providing background knowledge, discussing the strategy with the student, modeling the strategy, helping the student memorize the strategy, supporting the strategy, and then watching as the student independently performs the strategy. A key part of the process is teaching self-regulation skills, such as goal-setting and self-monitoring, which aim to help students apply the strategy without guidance. The steps can be combined, changed, reordered, or repeated, depending on the needs of the student. The SRSD model can be used with students in grades 2 through 12 in individual, small group, or whole classroom settings.
Intervention Report K-12 3
Functional Behavioral Assessment-based Interventions (December 2016)
Functional behavioral assessment (FBA) is an individualized problem-solving process for addressing student problem behavior. An assessment is conducted to identify the purpose or function of a student's problem behavior. This assessment process involves collecting information about the environmental conditions that precede the problem behavior and the subsequent rewards that reinforce the behavior. The information that is gathered is then used to identify and implement individualized interventions aimed at reducing problem behaviors and increasing positive behaviors. Accordingly, the studies evaluating FBA examine different FBA-based interventions identified for each student. FBA-based interventions can be used to address diverse problem behaviors, such as disruptive and off-task behaviors, noncompliance, and inappropriate social interactions.
Intervention Report 1-4 3
Lindamood Phoneme Sequencing® (LiPS®) (Beginning Reading) (November 2015)
The Lindamood Phoneme Sequencing® (LiPS®) program (formerly called the Auditory Discrimination in Depth® [ADD] program) is designed to teach students the skills they need to decode words and to identify individual sounds and blends in words. LiPS® is designed for emergent readers in kindergarten through grade 3 or for struggling, dyslexic readers. The program is individualized to meet students’ needs and is often used with students who have learning disabilities or difficulties. Initial activities engage students in discovering the lip, tongue, and mouth actions needed to produce specific sounds. After students are able to produce, label, and organize the sounds with their mouths, subsequent activities in sequencing, reading, and spelling use the oral aspects of sounds to identify and order them within words. The program also offers direct instruction in letter patterns, sight words, and context clues in reading.
Intervention Report 3-5 3
Everyday Mathematics® (Primary Mathematics) (November 2015)
Everyday Mathematics® is a core curriculum for students in prekindergarten through grade 6. At each grade level, the Everyday Mathematics® curriculum provides students with multiple opportunities to learn concepts and practice skills. Across grade levels, concepts are reviewed and extended in varying instructional contexts. The distinguishing features of Everyday Mathematics® are its focus on real-life problem solving, student communication of mathematical thinking, and appropriate use of technology. This curriculum also emphasizes balancing different types of instruction (including collaborative learning), using various methods for skills practice, and fostering parent involvement in student learning.
Intervention Report 1-5 3
Open Court Reading© (Beginning Reading) (October 2014)
Open Court Reading© is a reading program for grades K–6 that is designed to teach decoding, comprehension, inquiry, and writing in a three-part progression. Part One of each unit, Preparing to Read, focuses on phonemic awareness, sounds and letters, phonics, fluency, and word knowledge. Part Two, Reading and Responding, emphasizes reading literature for understanding, comprehension, inquiry, and practical reading applications. Part Three, Language Arts, focuses on writing, spelling, grammar, usage, mechanics, and basic computer skills.
Intervention Report 2-4 3
Spelling Mastery (Students with Learning Disabilities) (January 2014)
Spelling Mastery is designed to explicitly teach spelling skills to students in grades 1–6. One of several Direct Instruction curricula from McGraw-Hill that precisely specify how to teach incremental content, Spelling Mastery includes phonemic, morphemic, and whole-word strategies.
Intervention Report 2-6 3
Read Naturally® (Beginning Reading) (July 2013)
Read Naturally® is an elementary and middle school supplemental reading program designed to improve reading fluency using a combination of books, audiotapes, and computer software. The program has three main strategies: repeated reading of text for developing oral reading fluency, teacher modeling of story reading, and systematic monitoring of student progress by teachers and the students themselves. Students work at a reading level appropriate for their achievement level, progress through the program at their own rate, and, for the most part, work on an independent basis. Read Naturally® can be used in a variety of settings, including classrooms, resource rooms, or computer or reading labs. Although the program was not originally developed for English language learners, additional materials for these students are currently available.
Intervention Report 4-5 3
Great Explorations in Math and Science® (GEMS®) Space Science Sequence (Science) (June 2012)
Great Explorations in Math and Science® (GEMS®) Space Science Sequence is an instructional curriculum for grades 3–5 that covers fundamental concepts, including planetary sizes and distance, the earth’s shape and movement, gravity, and moon phases and eclipses. Part of the GEMS® core curriculum, GEMS® Space Science Sequence uses the solar system as the focal point for learning. The sequence uses models, hands-on investigations, peer-to-peer discussions, reflection, and informational student readings. Students complete four units, each lasting between four and nine sessions. Each unit builds upon knowledge from previous units and can be used independently or in conjunction with one another for an overall learning progression.
Intervention Report K-6 3
Peer-Assisted Learning Strategies (Students with Learning Disabilities) (June 2012)
Peer-Assisted Learning Strategies is a peer-tutoring program for grades K–6 that aims to improve student proficiency in several disciplines. During the 30-35 minute peer-tutoring sessions, students take turns acting at the tutor, coaching and correcting one another as they work through problems. The designation of tutoring pairs and skill assignment is based on teacher judgement of student needs and abilities, and teachers reassign tutoring pairs regularly.  
Intervention Report 3-4 3
Technology Enhanced Elementary and Middle School Science (TEEMSS) (Science) (May 2012)
Technology Enhanced Elementary and Middle School Science (TEEMSS) is a physical science curriculum for grades 3–8 that uses computers, sensors, and interactive models to support investigations of real-world phenomena. Through 15 inquiry-based instructional units, students interact with computers, gather and analyze data, and formulate ideas for further exploration. This information is managed by software in a handheld computer and transmitted to other students and to the teacher. The program includes a web-based teacher-reporting tool that allows teachers to review student portfolios and gather student responses for assessment and class discussion.
Intervention Report K-6 3
Peer-Assisted Learning Strategies (Adolescent Literacy) (January 2012)
Peer-Assisted Learning Strategies is a peer-tutoring program for grades K–6 that aims to improve student proficiency in several disciplines. During the 30-35 minute peer-tutoring sessions, students take turns acting at the tutor, coaching and correcting one another as they work through problems. The designation of tutoring pairs and skill assignment is based on teacher judgement of student needs and abilities, and teachers reassign tutoring pairs regularly.  
Intervention Report K-6 3
Peer-Assisted Learning Strategies (English Language Learners) (September 2010)
Peer-Assisted Learning Strategies is a peer-tutoring program for grades K–6 that aims to improve student proficiency in several disciplines. During the 30-35 minute peer-tutoring sessions, students take turns acting at the tutor, coaching and correcting one another as they work through problems. The designation of tutoring pairs and skill assignment is based on teacher judgement of student needs and abilities, and teachers reassign tutoring pairs regularly.  
Intervention Report K-8 3
Accelerated Reader (Adolescent Literacy) (August 2010)
Accelerated Reader™ is a computerized supplementary reading program that provides guided reading instruction to students in grades K–12. It aims to improve students’ reading skills through reading practice and by providing frequent feedback on students’ progress to teachers. The Accelerated Reader™ program requires students to select and read a book based on their area of interest and reading level. Upon completion of a book, students take a computerized quiz based on the book’s content and vocabulary. Quiz performance allows teachers to monitor student progress and to identify students who may need additional reading assistance.
Intervention Report K-5 3
Reading Mastery (Adolescent Literacy) (August 2010)
Reading Mastery is designed to provide systematic reading instruction to students in grades K–6. Reading Mastery can be used as an intervention program for struggling readers, as a supplement to a school’s core reading program, or as a stand-alone reading program, and is available in three versions. During the implementation of Reading Mastery, students are grouped with other students at a similar reading level, based on program placement tests. The program includes a continuous monitoring component.
Intervention Report K-10 3
Fast ForWord® (Adolescent Literacy) (August 2010)
Fast ForWord® is a computer-based reading program intended to help students develop and strengthen the cognitive skills necessary for successful reading and learning. The program, which is designed to be used 30 to 100 minutes a day, five days a week, for 4 to 16 weeks, includes two components.
Intervention Report 2-6 3
Cooperative Integrated Reading and Composition® (CIRC®) (Adolescent Literacy) (August 2010)
Cooperative Integrated Reading and Composition® (CIRC®) is a comprehensive reading and writing program for students in grades 2–8. It includes story-related activities, direct instruction in reading comprehension, and integrated reading and language arts activities. Pairs of students (grouped either by or across ability levels) read to each other, predict how stories will end, summarize stories, write responses, and practice spelling, decoding, and vocabulary. Within cooperative teams of four, students work to understand the main idea of a story and work through the writing process. The CIRC® process includes teacher instruction, team practice, peer assessment, and team/partner recognition. A Spanish version of the program was also designed for grades 2–5.
Intervention Report 2-6 3
Read Naturally® (Students with Learning Disabilities) (July 2010)
Read Naturally® is an elementary and middle school supplemental reading program designed to improve reading fluency using a combination of books, audiotapes, and computer software. The program has three main strategies: repeated reading of text for developing oral reading fluency, teacher modeling of story reading, and systematic monitoring of student progress by teachers and the students themselves. Students work at a reading level appropriate for their achievement level, progress through the program at their own rate, and, for the most part, work on an independent basis. Read Naturally® can be used in a variety of settings, including classrooms, resource rooms, or computer or reading labs. Although the program was not originally developed for English language learners, additional materials for these students are currently available.
Intervention Report 4-6 3
Project CRISS® (Adolescent Literacy) (June 2010)
Project CRISS® (CReating Independence through Student-owned Strategies) is a professional development program for teachers that aims to improve reading, writing, and learning for students in grades 3–12. The implementation of Project CRISS® does not require a change in the curriculum or materials being used in the classroom, but instead calls for a change in teaching style to focus on three primary concepts derived from cognitive psychology and brain research. These three concepts include students (1) monitoring their learning to assess when they have understood content, (2) integrating new information with prior knowledge, and (3) being actively involved in the learning process through discussing, writing, organizing information, and analyzing the structure of text to help improve comprehension.
Intervention Report 1-4 3
Lindamood Phoneme Sequencing® (LiPS®) (Students with Learning Disabilities) (March 2010)
The Lindamood Phoneme Sequencing® (LiPS®) program (formerly called the Auditory Discrimination in Depth® [ADD] program) is designed to teach students the skills they need to decode words and to identify individual sounds and blends in words. LiPS® is designed for emergent readers in kindergarten through grade 3 or for struggling, dyslexic readers. The program is individualized to meet students’ needs and is often used with students who have learning disabilities or difficulties. Initial activities engage students in discovering the lip, tongue, and mouth actions needed to produce specific sounds. After students are able to produce, label, and organize the sounds with their mouths, subsequent activities in sequencing, reading, and spelling use the oral aspects of sounds to identify and order them within words. The program also offers direct instruction in letter patterns, sight words, and context clues in reading.
Intervention Report 1-4 3
ClassWide Peer Tutoring (Beginning Reading) (July 2007)
ClassWide Peer Tutoring (CWPT) is a peer-assisted instructional strategy designed to be integrated with most existing reading curricula. This approach provides students with increased opportunities to practice reading skills by asking questions and receiving immediate feedback from a peer tutor. Pairs of students take turns tutoring each other to reinforce concepts and skills initially taught by the teacher. The teacher creates age-appropriate peer teaching materials for the peer tutors; these materials take into account tutees’ language skills and disabilities.
Intervention Report 1-6 3
Peer Tutoring and Response Groups (English Language Learners) (July 2007)
Peer Tutoring and Response Groups aims to improve the language and achievement of English learners by pairing or grouping students to work on a task. The students may be grouped by age or ability, or the groups may be mixed. Peer tutoring typically consists of two students assuming the roles of tutor and tutee, or “coach and player” roles. Peer response groups give four or five students shared responsibility for a task, such as editing a passage or reading and answering comprehension questions. Both peer tutoring pairs and peer response groups emphasize peer interaction and discussion to complete a task.
Intervention Report K-6 3
Caring School Community (CSC) (Character Education) (April 2007)
Caring School Community™ (CSC) is a modified version of a program formerly known as the Child Development Project. CSC is a multiyear school improvement program that involves all students in grades K–6. The program aims to promote core values, prosocial behavior, and a schoolwide feeling of community. The program consists of four elements originally developed for the Child Development Project: class meeting lessons, cross-age “buddies” programs, “homeside” activities, and schoolwide community. Class lessons provide teachers and students with a forum to get to know one another, discuss issues, identify and solve problems collaboratively, and make a range of decisions that affect classroom life. Cross-age buddies activities pair whole classes of older and younger students for academic and recreational activities that build caring cross-age relationships and create a schoolwide climate of trust. Homeside activities include short conversational activities that are sent home with students for them to do with parents or caregivers and then to discuss back in their classroom. The activities incorporate the families’ perspectives, cultures, and traditions, thereby promoting interpersonal understanding. Schoolwide community-building activities bring students, parents, and school staff together to create new school traditions.
Intervention Report K-6 3
Positive Action (Character Education) (April 2007)
Positive Action, at its core, teaches the philosophy that you feel good about yourself when you do positive actions and there is always a positive way to do everything. It is illustrated by the the Thoughts-Actions-Feelings about self Circle where positive thoughts lead to positive actions, which in turn lead to positive feelings about oneself. It also teaches the positive actions for physical, intellectual, social and emotional areas—the whole self. It is a Pre-K-12 school-based program that aims to promote good behavior while disrupting problem behaviors, improves academics, and develops social-emotional and character skills while improving mental and physical health and self-concept. Lessons are scripted and use a wide variety of strategies: classroom discussion, role-play, games, songs, journals, manipulatives and activity sheets and text booklets.
Intervention Report 2-5 3
Instructional Conversations and Literature Logs (English Language Learners) (October 2006)
The goal of Instructional Conversations is to help English learners develop reading comprehension ability along with English language proficiency. Acting as facilitators, teachers engage students in discussions about stories, key concepts, and related personal experiences, allowing students to appreciate and build on each others’ experiences, knowledge, and understanding. Literature Logs require students to respond in writing to prompts or questions related to sections of stories. These responses are then shared in small groups or with a partner.
Intervention Report 3-12 3
Connect with Kids (Character Education) (September 2006)
Connect with Kids aims to promote prosocial attitudes and positive behavior of elementary (grades 3–5) and secondary (grades 6–12) school students by teaching core character values. Lesson plans include videos, story summaries, discussion questions, student games, and activities for both core and supplemental character traits. The classroom curriculum is reinforced by a website component and schoolwide and community outreach components. The program can be incorporated into an existing curriculum or used as a standalone program. The school or teacher decides on the number of character traits covered in each session, so the program duration may vary from one semester to an entire academic year.
Intervention Report 3-6 3
Too Good for Drugs (TGFD) (Character Education) (September 2006)
Too Good for Drugs™ is designed to promote elementary and middle school students’ life skills, character values, resistance skills to negative peer influence, and resistance to the use of illegal drugs, alcohol, and tobacco. The program is based on classroom discussions and structured activities that center on interactive learning and skill-building exercises. Students engage in role-play and cooperative learning games and are encouraged to apply the skills to different contexts. Too Good for Drugs™ also includes the optional elements of parental and community involvement.
Intervention Report K-5 3
Reading Mastery (English Language Learners) (September 2006)
Reading Mastery is designed to provide systematic reading instruction to students in grades K–6. Reading Mastery can be used as an intervention program for struggling readers, as a supplement to a school’s core reading program, or as a stand-alone reading program, and is available in three versions. During the implementation of Reading Mastery, students are grouped with other students at a similar reading level, based on program placement tests. The program includes a continuous monitoring component.
Intervention Report 4-5 3
Lessons in Character (Character Education) (September 2006)
Lessons in Character is designed to promote elementary and middle school students’ knowledge about core character education values and, through that knowledge, shape children’s positive behaviors and support academic success. It consists of 24 lessons organized around weekly themes, writing activities, and class projects. Teachers introduce the theme with a story that shows a value in action; students then engage that topic with a variety of activities. The program also includes daily oral language development and weekly writing assignments, optional parts of the program’s implementation.
Intervention Report K-10 3
Fast ForWord® (English Language Learners) (September 2006)
Fast ForWord® is a computer-based reading program intended to help students develop and strengthen the cognitive skills necessary for successful reading and learning. The program, which is designed to be used 30 to 100 minutes a day, five days a week, for 4 to 16 weeks, includes two components.
Intervention Report 3-8 -1
Leadership and Assistance for Science Education Reform (LASER) (Science) (September 2021)
The Leadership and Assistance for Science Education Reform (LASER) program is intended to build capacity for implementing inquiry-based science curricula in schools and districts. When participating in LASER, school or district teams attend leadership development institutes to plan the implementation of inquiry-based science curricula. These school or district teams receive support for key aspects of implementation such as professional development for teachers, access to instructional materials, and support for selecting appropriate assessments. LASER also helps schools and districts partner with scientists, science educators, and local business and community leaders who can promote and further support the implementation of inquiry-based science instruction.
Intervention Report 4-8 -1
Literacy Design Collaborative (Teacher Training, Evaluation, and Compensation) (March 2021)
Literacy Design Collaborative aims to help teachers improve their effectiveness in the classroom with a focus on supporting their literacy instruction. Literacy Design Collaborative provides professional development, coaching, and resources to support teachers to work collaboratively in their schools to create and use high-quality literacy instruction materials aimed at improving students’ reading, research, and writing skills. Teachers across content areas—including English language arts, social studies, and science—can use the Literacy Design Collaborative program.
Intervention Report 4-7 -1
Word Generation (English Learner (EL)) (April 2020)
Word Generation is a supplemental program that aims to improve students’ reading comprehension by building students’ vocabulary, academic language, and perspective-taking skills through classroom discussion and debate. Word Generation was developed for all students; however, English learners in particular could benefit from its focus on academic language. Word Generation consists of a series of interdisciplinary units with daily lessons focused on a high-interest issue to increase student engagement. Each unit targets a small number of academic vocabulary words that are integrated into texts, activities, writing tasks, debates, and discussions across content areas. Several Word Generation programs exist. In the Word Generation Weekly (WordGen Weekly) and Word Generation Elementary (WordGen Elementary) programs, units are intended to be used across English language arts, math, science, and social studies in grades 6–8 and grades 4 and 5, respectively. In the Science Generation (SciGen) and Social Studies Generation (SoGen) programs, units can supplement or be used in place of regular science and social studies curriculum units in grades 6–8. The different Word Generation programs can be implemented separately or together.
Intervention Report 3-8 -1
National Board for Professional Teaching Standards (NBPTS) Certification (Teacher Training, Evaluation, and Compensation) (February 2018)
The National Board for Professional Teaching Standards (NBPTS) establishes standards for accomplished teachers and awards professional certification to teachers who can demonstrate that their teaching practices meet those standards. Educators and experts in child development and related fields established the organization, and these experts work to develop and refine the standards for accomplished teaching based on the knowledge and skills that effective teachers demonstrate. The standards reflect five core propositions: (1) effective teachers are committed to students and their learning, (2) effective teachers know the subjects they teach and how to teach those subjects to students, (3) effective teachers manage and monitor student learning, (4) effective teachers think systematically about their practice and learn from experience, and (5) effective teachers are members of learning communities. Those seeking certification from the NBPTS must complete a computer-based assessment and three portfolio entries. The certification process can take 1 to 5 years.
Intervention Report 2-9 -1
Achieve3000 (Beginning Reading) (February 2018)
Achieve3000® is a supplemental online literacy program that provides nonfiction reading content to students in grades preK–12 and focuses on building phonemic awareness, phonics, fluency, reading comprehension, vocabulary, and writing skills. Achieve3000® is designed to help students advance their nonfiction reading skills by providing differentiated online instruction. Teachers use the program with an entire class but the assignments are tailored to each student’s reading ability level. For example, teachers assign an article and related activities to an entire class; the program then tailors the version of the article to each student by automatically increasing the difficulty of text when a student is ready for more challenging text. Achieve3000® provides lessons that follow a five-step routine: (1) respond to a Before Reading Poll, (2) read an article, (3) answer activity questions, (4) respond to an After Reading Poll, and (5) answer a Thought Question. Progress reports and student usage data, provided by the online tool, enable teachers to track both whole-class and individual student progress. The program is designed for diverse student groups, including general education students, struggling readers in need of intensive tutoring, and English learners.
Intervention Report 4 -1
System of Least Prompts (Children and Students with Intellectual Disability) (January 2018)
System of Least Prompts (SLP) is a practice that involves defining and implementing a hierarchy of prompts to assist students in learning a skill. A prompt is an action by the teacher or other practitioner—such as a verbal instruction to complete a task—that helps a student respond correctly during a learning activity. To use the procedure, the teacher or other practitioner systematically delivers the prompts to students in order, starting with the prompt that provides the least amount of assistance, and providing additional prompts with increasing levels of assistance until the student can correctly perform the task independently. For example, if a student does not independently complete a task following the initial instruction, a teacher may help the student by providing the least-intrusive prompt, such as restating the instruction. If the response still does not occur, the teacher may present the next most intrusive prompt, such as rephrasing the instruction. The teacher continues with more intrusive prompts, such as modeling how to do the task, until the desired response occurs reliably or all the prompts in the sequence have been used. The last prompt, often called the controlling prompt, should result in the student responding correctly. SLP is also known as “least-to-most prompting” or “least intrusive prompts.” SLP does not have a single developer that provides guidance or materials.
Intervention Report 2-9 -1
Accelerated Math® (Primary Mathematics) (December 2017)
Accelerated Math®, published by Renaissance Learning, is a software tool that provides practice problems for students in grades K–12 and provides teachers with reports to monitor student progress. Accelerated Math® creates individualized student assignments, scores the assignments, and generates reports on student progress. The software is typically used with the math curriculum being used in the classroom to add practice for students and help teachers differentiate instruction through the program’s progress-monitoring data.
Intervention Report 2-9 -1
Accelerated Math® (Secondary Mathematics) (December 2017)
Accelerated Math®, published by Renaissance Learning, is a software tool that provides practice problems for students in grades K–12 and provides teachers with reports to monitor student progress. Accelerated Math® creates individualized student assignments, scores the assignments, and generates reports on student progress. The software is typically used with the math curriculum being used in the classroom to add practice for students and help teachers differentiate instruction through the program’s progress-monitoring data.
Intervention Report K-8 -1
Accelerated Reader (Beginning Reading) (June 2016)
Accelerated Reader™ is a computerized supplementary reading program that provides guided reading instruction to students in grades K–12. It aims to improve students’ reading skills through reading practice and by providing frequent feedback on students’ progress to teachers. The Accelerated Reader™ program requires students to select and read a book based on their area of interest and reading level. Upon completion of a book, students take a computerized quiz based on the book’s content and vocabulary. Quiz performance allows teachers to monitor student progress and to identify students who may need additional reading assistance.
Intervention Report PK-12 -1
TAP: The System for Teacher and Student Advancement (Teacher Training, Evaluation, and Compensation) (July 2015)
TAP™ (formerly known as the Teacher Advancement Program) is a comprehensive educator effectiveness program that aims to improve student achievement through supports and incentives that attract, retain, develop, and motivate effective teachers. The program provides teachers with leadership opportunities and associated salary increases; ongoing, school-based professional development; rigorous evaluations; and annual performance bonuses based on a combination of teacher value added to student achievement and observations of their classroom teaching.
Intervention Report K-6 -1
New Teacher Center Induction Model (Teacher Training, Evaluation, and Compensation) (July 2015)
The New Teacher Center (NTC) Induction Model is a comprehensive and systemic approach to support beginning teachers (i.e., teachers new to the profession). The induction model aims to accelerate the effectiveness of beginning teachers at increasing student learning by providing one-on-one mentoring and professional development in a supportive school environment. The NTC works with school districts and state departments of education to design, develop, and implement induction programs that are aligned with both district priorities and NTC standards.
Intervention Report K-5 -1
Reading Mastery (Beginning Reading) (November 2013)
Reading Mastery is designed to provide systematic reading instruction to students in grades K–6. Reading Mastery can be used as an intervention program for struggling readers, as a supplement to a school’s core reading program, or as a stand-alone reading program, and is available in three versions. During the implementation of Reading Mastery, students are grouped with other students at a similar reading level, based on program placement tests. The program includes a continuous monitoring component.
Intervention Report 4-12 -1
Reciprocal Teaching (Students with Learning Disabilities) (November 2013)
Reciprocal teaching is an interactive instructional practice that aims to improve students’ reading comprehension by teaching strategies to obtain meaning from a text. The teacher and students take turns leading a dialogue regarding segments of the text. Students discuss with their teacher how to apply four comprehension strategies—generating questions, summarizing, clarifying, and predicting—to passages of text. During the early stages of reciprocal teaching, the teacher assumes primary responsibility for modeling how to use these strategies. As students become more familiar with the strategies, there is a gradual shift toward student responsibility for talking through the application of the strategies to the text.
Intervention Report 1-5 -1
Scott Foresman-Addison Wesley Elementary Mathematics (Elementary School Mathematics) (May 2013)
Scott Foresman-Addison Wesley Elementary Mathematics is a core curriculum for students at all ability levels in kindergarten through grade 6. The program supports students’ understanding of key math concepts and skills, and it covers a range of mathematical content across grades. The curriculum focuses on questioning strategies, problem-solving skills, embedded assessment, and exercises tailored to students of different ability levels. The program provides explicit problem-solving instruction, hands-on activities, and opportunities to extend students’ mathematical understanding through reading and writing connections.
Intervention Report 2-6 -1
Read Naturally® (Adolescent Literacy) (March 2013)
Read Naturally® is an elementary and middle school supplemental reading program designed to improve reading fluency using a combination of books, audiotapes, and computer software. The program has three main strategies: repeated reading of text for developing oral reading fluency, teacher modeling of story reading, and systematic monitoring of student progress by teachers and the students themselves. Students work at a reading level appropriate for their achievement level, progress through the program at their own rate, and, for the most part, work on an independent basis. Read Naturally® can be used in a variety of settings, including classrooms, resource rooms, or computer or reading labs. Although the program was not originally developed for English language learners, additional materials for these students are currently available.
Intervention Report K-10 -1
Fast ForWord® (Beginning Reading) (March 2013)
Fast ForWord® is a computer-based reading program intended to help students develop and strengthen the cognitive skills necessary for successful reading and learning. The program, which is designed to be used 30 to 100 minutes a day, five days a week, for 4 to 16 weeks, includes two components.
Intervention Report 1-5 -1
Investigations in Number, Data, and Space® (Elementary School Mathematics) (February 2013)
Investigations in Number, Data, and Space is an activity-based, K–5 mathematics curriculum designed to help students understand number and operations, geometry, data, measurement, and early algebra. Each instructional unit focuses on a particular content area and lasts for 2–5.5 weeks. The curriculum encourages students to develop their own strategies for solving problems and engage in discussion about their reasoning and ideas. The lessons are activity-based in order to facilitate increased comprehension of basic math fundamentals. The curriculum is presented through a series of resource books called ”curriculum units” that provide teachers with guidance on implementation. One or more of the units for each year has a software program associated with it. Other materials include manipulatives, flash cards, overheads, and textbooks.
Intervention Report K-6 -1
Peer-Assisted Learning Strategies (Elementary School Mathematics) (January 2013)
Peer-Assisted Learning Strategies is a peer-tutoring program for grades K–6 that aims to improve student proficiency in several disciplines. During the 30-35 minute peer-tutoring sessions, students take turns acting at the tutor, coaching and correcting one another as they work through problems. The designation of tutoring pairs and skill assignment is based on teacher judgement of student needs and abilities, and teachers reassign tutoring pairs regularly.  
Intervention Report K-4 -1
Success for All® (English Language Learners) (October 2012)
Success for All (SFA®) is a whole-school reform model (that is, a model that integrates curriculum, school culture, family, and community supports) for students in prekindergarten through grade 8. SFA® includes a literacy program, quarterly assessments of student learning, a social-emotional development program, computer-assisted tutoring tools, family support teams for students’ parents, a facilitator who works with school personnel, and extensive training for all intervention teachers. The literacy program emphasizes phonics for beginning readers and comprehension for all students. Teachers provide reading instruction to students grouped by reading ability for 90 minutes a day, 5 days a week. In addition, certified teachers or paraprofessionals provide daily tutoring to students who have difficulty reading at the same level as their classmates.
Intervention Report 1-5 -1
Open Court Reading© (Adolescent Literacy) (August 2012)
Open Court Reading© is a reading program for grades K–6 that is designed to teach decoding, comprehension, inquiry, and writing in a three-part progression. Part One of each unit, Preparing to Read, focuses on phonemic awareness, sounds and letters, phonics, fluency, and word knowledge. Part Two, Reading and Responding, emphasizes reading literature for understanding, comprehension, inquiry, and practical reading applications. Part Three, Language Arts, focuses on writing, spelling, grammar, usage, mechanics, and basic computer skills.
Intervention Report K-5 -1
Reading Mastery (Students with Learning Disabilities) (July 2012)
Reading Mastery is designed to provide systematic reading instruction to students in grades K–6. Reading Mastery can be used as an intervention program for struggling readers, as a supplement to a school’s core reading program, or as a stand-alone reading program, and is available in three versions. During the implementation of Reading Mastery, students are grouped with other students at a similar reading level, based on program placement tests. The program includes a continuous monitoring component.
Intervention Report 4-5 -1
Coping Power (Children Identified With or at Risk for an Emotional Disturbance) (October 2011)
Coping Power is based on the earlier Anger Coping Power program. It emphasizes social and emotional skills that are needed during the transition to middle school. The program incorporates child and parent components. The child component consists of thirty-four 50-minute group sessions and periodic individual sessions over the course of 15–18 months, although the program can be shortened to fit into a single school year. Lessons focus on goal setting, problem solving, anger management, and peer relationships. The parent component is composed of 16 group sessions and periodic individual meetings. Lessons support the child component of the program and address setting expectations, praise, discipline, managing stress, communication, and child study skills.
Intervention Report 4-12 -1
Reciprocal Teaching (Adolescent Literacy) (September 2010)
Reciprocal teaching is an interactive instructional practice that aims to improve students’ reading comprehension by teaching strategies to obtain meaning from a text. The teacher and students take turns leading a dialogue regarding segments of the text. Students discuss with their teacher how to apply four comprehension strategies—generating questions, summarizing, clarifying, and predicting—to passages of text. During the early stages of reciprocal teaching, the teacher assumes primary responsibility for modeling how to use these strategies. As students become more familiar with the strategies, there is a gradual shift toward student responsibility for talking through the application of the strategies to the text.
Intervention Report 1-4 -1
ClassWide Peer Tutoring (English Language Learners) (September 2010)
ClassWide Peer Tutoring (CWPT) is a peer-assisted instructional strategy designed to be integrated with most existing reading curricula. This approach provides students with increased opportunities to practice reading skills by asking questions and receiving immediate feedback from a peer tutor. Pairs of students take turns tutoring each other to reinforce concepts and skills initially taught by the teacher. The teacher creates age-appropriate peer teaching materials for the peer tutors; these materials take into account tutees’ language skills and disabilities.
Intervention Report 2-6 -1
Read Naturally® (English Language Learners) (July 2010)
Read Naturally® is an elementary and middle school supplemental reading program designed to improve reading fluency using a combination of books, audiotapes, and computer software. The program has three main strategies: repeated reading of text for developing oral reading fluency, teacher modeling of story reading, and systematic monitoring of student progress by teachers and the students themselves. Students work at a reading level appropriate for their achievement level, progress through the program at their own rate, and, for the most part, work on an independent basis. Read Naturally® can be used in a variety of settings, including classrooms, resource rooms, or computer or reading labs. Although the program was not originally developed for English language learners, additional materials for these students are currently available.
Intervention Report 4-10 -1
Read 180® (Students with Learning Disabilities) (July 2010)
READ 180® is a reading program designed for struggling readers who are reading 2 or more years below grade level. It combines online and direct instruction, student assessment, and teacher professional development. READ 180® is delivered in 90-minute sessions that include whole-group instruction, three small-group rotations, and whole-class wrap-up. Small-group rotations include individualized instruction using an adaptive computer application, small-group instruction, and independent reading. READ 180® is designed for students in elementary through high school.
Intervention Report K-5 -1
Project Read® Phonology (Students with Learning Disabilities) (July 2010)
Project Read® is a multisensory language arts curriculum designed for use in a classroom or group setting. Two main objectives of the program are to use language in all its forms, and to use responsive instruction rather than preplanned textbook lessons. The program emphasizes direct instruction, and lessons move from letter-sounds to words, sentences, and stories. Project Read® has three strands: Phonics/Linguistics, Reading Comprehension, and Written Expression, which are integrated at all grade levels, though the emphasis of the specific strands differs by grade.
Intervention Report K-8 -1
Accelerated Reader (English Language Learners) (December 2009)
Accelerated Reader™ is a computerized supplementary reading program that provides guided reading instruction to students in grades K–12. It aims to improve students’ reading skills through reading practice and by providing frequent feedback on students’ progress to teachers. The Accelerated Reader™ program requires students to select and read a book based on their area of interest and reading level. Upon completion of a book, students take a computerized quiz based on the book’s content and vocabulary. Quiz performance allows teachers to monitor student progress and to identify students who may need additional reading assistance.
Intervention Report K-5 -1
Project Read® Phonology (Beginning Reading) (July 2007)
Project Read® is a multisensory language arts curriculum designed for use in a classroom or group setting. Two main objectives of the program are to use language in all its forms, and to use responsive instruction rather than preplanned textbook lessons. The program emphasizes direct instruction, and lessons move from letter-sounds to words, sentences, and stories. Project Read® has three strands: Phonics/Linguistics, Reading Comprehension, and Written Expression, which are integrated at all grade levels, though the emphasis of the specific strands differs by grade.
Intervention Report 2-5 -1
Houghton Mifflin Mathematics (Elementary School Mathematics) (April 2007)
Houghton Mifflin Mathematics is a core mathematics curriculum for students at all ability levels in kindergarten through grade 6. At each grade level, the program focuses on basic skills development, problem solving, and vocabulary expansion to help students master key math concepts. Students practice daily math lessons through instructional software, enrichment worksheets, manipulatives, and workbooks, in addition to student textbooks. The program incorporates assessments—including lesson-level interventions to meet the needs of all learners—to monitor students’ progress.
Intervention Report 1-6 -1
Heartwood Ethics Curriculum/An Ethics Curriculum for Children (Character Education) (September 2006)
An Ethics Curriculum for Children, a read-aloud literature-based curriculum, aims to teach elementary school students seven universal attributes of good character. Lessons and home assignments are organized around multicultural stories. The program activities are designed to connect the experiences of characters in the stories to students’ own lives. Optional parts of the Heartwood Ethics Curriculum for Children also include integration of character education themes across curricular topics and parental notification and involvement.
Intervention Report 1-4 -1
Lindamood Phoneme Sequencing® (LiPS®) (Early Childhood Education) (December 2005)
The Lindamood Phoneme Sequencing® (LiPS®) program (formerly called the Auditory Discrimination in Depth® [ADD] program) is designed to teach students the skills they need to decode words and to identify individual sounds and blends in words. LiPS® is designed for emergent readers in kindergarten through grade 3 or for struggling, dyslexic readers. The program is individualized to meet students’ needs and is often used with students who have learning disabilities or difficulties. Initial activities engage students in discovering the lip, tongue, and mouth actions needed to produce specific sounds. After students are able to produce, label, and organize the sounds with their mouths, subsequent activities in sequencing, reading, and spelling use the oral aspects of sounds to identify and order them within words. The program also offers direct instruction in letter patterns, sight words, and context clues in reading.
Intervention Report 1-5 -1
Open Court Reading© (Early Childhood Education) (December 2005)
Open Court Reading© is a reading program for grades K–6 that is designed to teach decoding, comprehension, inquiry, and writing in a three-part progression. Part One of each unit, Preparing to Read, focuses on phonemic awareness, sounds and letters, phonics, fluency, and word knowledge. Part Two, Reading and Responding, emphasizes reading literature for understanding, comprehension, inquiry, and practical reading applications. Part Three, Language Arts, focuses on writing, spelling, grammar, usage, mechanics, and basic computer skills.
Reviews of Individual Studies K-5 1
Employing Evidence-Based Practices for Children with Autism in Elementary Schools (2020)
The purpose of this study was to test the efficacy of a comprehensive program model originally developed by the National Professional Development Center on Autism Spectrum Disorder (NPDC). Sixty elementary schools with 486 participants were randomly assigned to an NPDC and services as usual condition (SAU). Significantly greater changes in program quality occurred in the inclusive NPDC programs as compared with the SAU schools. Teachers in NPDC schools reported using more evidence-based practices (EBPs) and implemented EBPs with significantly greater fidelity than teachers in SAU schools. Autistic students in NPDC schools had significantly higher total attainment of educational goals than students in SAU schools, and the two groups made equivalent progress on standardized assessment outcomes across the school year. [This is the online first version of an article published in "Journal of Autism and Developmental Disorders."]
Reviews of Individual Studies 3-8 1
Investigating Causal Effects of Arts Education Experiences: Experimental Evidence from Houston's Arts Access Initiative (2019)
The recent wave of test-based accountability reforms has negatively impacted the provision of K-12 arts educational experiences. Advocates contend that, in addition to providing intrinsic benefits, the arts can positively influence academic and social development. However, the empirical evidence to support such claims is limited. We conducted a randomized controlled trial with 10,548 3rd-8th grade students who were enrolled in 42 schools that were assigned by lottery to receive substantial influxes of arts education experiences provided through school-community partnerships with local arts organizations, cultural institutions, and teaching-artists. We find that these increases in arts educational experiences significantly reduce the proportion of students receiving disciplinary infractions by 3.6 percentage points, improve STAAR writing achievement by 0.13 of a standard deviation, and increase students' compassion for others by 0.08 of a standard deviation. For students in elementary schools, which comprise 86 percent of the sample, we find that these arts educational experiences also significantly improve school engagement, college aspirations, and arts-facilitated empathy. These findings provide strong evidence that arts educational experiences can produce significant positive impacts on student academic and social development. Policymakers should consider these multifaceted educational benefits when assessing the role and value of the arts in K-12 schools.
Reviews of Individual Studies 4 1
Does an integrated focus on fractions and decimals improve at-risk students’ rational number magnitude performance? (2019)
Reviews of Individual Studies 4 1
Does an integrated focus on fractions and decimals improve at-risk students’ rational number magnitude performance? (2019)
Reviews of Individual Studies K-5 1
A randomized waitlist controlled analysis of Team-Initiated Problem Solving professional development and use (2018)
Data-based problem solving is a hallmark of research-supported practices such as positive behavioral interventions and supports. In this study, we provided members of positive behavioral interventions and supports (PBIS) teams from 38 elementary schools with professional development focused on a research-supported problem-solving model (Team-Initiated Problem Solving). We used direct observations to document procedures, practices, and outcomes before and after participating in the professional development workshop. Within the context of a randomized waitlist controlled trial, team members in the Immediate Group demonstrated greater improvement in (a) problem-solving procedures, (b) decision-making practices, and (c) meeting outcomes than did members of PBIS teams in the Waitlist Group. Our findings extend what is known about team-based problem solving and provide a framework for future research and improved practice related to decision making by school teams.
Reviews of Individual Studies K-8 1
Effects of dual-language immersion programs on student achievement: Evidence from lottery data. (2017)
Effectively educating the large English learner population requires policymakers to ensure developmentally appropriate settings and services throughout the time students are learning English, as well as during their transition to fluent English proficient status--a process termed "reclassification." Using longitudinal student-level data from two U.S. states (N = 107,549), the authors implemented recent advances in multi-site regression discontinuity designs to assess the effects of reclassification policies across districts. They found that reclassification decisions are heavily influenced by state criteria; however, there is considerable variability across districts in the extent of state-level influence. The authors also found robust evidence of between-district heterogeneity in the effects of reclassification on subsequent achievement and graduation. They discuss the implications of these findings for reclassification policies and future research on the topic. Looking toward the next century of education research, the authors discuss ways that multi-site regression discontinuity designs can be combined with qualitative research to enable policymakers and practitioners to better understand variation in effects of policies across contexts as well as the mechanisms underlying those effects.
Reviews of Individual Studies 4-5 1
The effect of an analysis-of-practice, video case-based, teacher professional development program on elementary students' science and achievement. (2017)
This article describes the effects of an analysis-of-practice professional development (PD) program on elementary school students' (Grades 4-6) science outcomes. The study design was a cluster-randomized trial with an analysis sample of 77 schools, 144 teachers and 2,823 students. Forty-two schools were randomly assigned to treatment, (88.5 hours) of integrated analysis-of-practice and content deepening PD (over the course of one year) while 35 schools were randomly assigned to receive an equal number of PD hours in science content deepening alone. Students' content knowledge, as measured by a project-specific test, was compared across treatment groups. The effect size for this comparison was 0.52 standard deviations in favor of students whose teachers participated in the PD that included analysis-of-practice. This effect compares favorably to that of other elementary school interventions whose effectiveness was studied with a narrowly focused outcome measure. Analysis of the demographics of the study schools suggests that the treatment effect could be relevant outside the local study context. Implications for future research include tests of mediation for teacher-level outcomes and efficacy tests of specific teaching strategies (intervention subcomponents).
Reviews of Individual Studies K-4 1
Acquiring science and social studies knowledge in kindergarten through fourth grade: Conceptualization, design, implementation, and efficacy testing of content-area literacy instruction (CALI) (2017)
With national focus on reading and math achievement, science and social studies have received less instructional time. Yet, accumulating evidence suggests that content knowledge is an important predictor of proficient reading. Starting with a design study, we developed content-area literacy instruction (CALI) as an individualized (or personalized) instructional program for kindergarteners through 4th graders to build science and social studies knowledge. We developed CALI to be implemented in general education classrooms, over multiple iterations (n = 230 students), using principles of design-based implementation research. The aims were to develop CALI as a usable and feasible instructional program that would, potentially, improve science and social studies knowledge, and could be implemented during the literacy block without negatively affecting students' reading gains (i.e., no opportunity cost). We then evaluated the efficacy of CALI in a randomized controlled field trial with 418 students in kindergarten through 4th grade. Results reveal that CALI demonstrates promise as a usable and feasible instructional individualized general education program, and is efficacious in improving social studies (d = 2.2) and science (d = 2.1) knowledge, with some evidence of improving oral and reading comprehension skills (d = 0.125).
Reviews of Individual Studies 2-4 1
The Effects of Dialect Awareness Instruction on Non-Mainstream American English Speakers (2017)
Reviews of Individual Studies 2-4 1
The Effects of Dialect Awareness Instruction on Non-Mainstream American English Speakers (2017)
The achievement gaps between poor and more affluent students are persistent and chronic, as many students living in poverty are also members of more isolated communities where dialects such as African American English and Southern Vernacular English are often spoken. Non-mainstream dialect use is associated with weaker literacy achievement. The principal aims of the two experiments described in this paper were to examine whether second through fourth graders, who use home English in contexts where more formal school English is expected, can be taught to dialect shift between home and school English depending on context; and whether this leads to stronger writing and literacy outcomes. The results of two randomized controlled trials with students within classrooms randomly assigned to DAWS (Dialect Awareness, a program to explicitly teach dialect shifting), editing instruction, or a business as usual group revealed (1) that DAWS was more effective in promoting dialect shifting than instruction that did not explicitly contrast home and school English; and (2) that students in both studies who participated in DAWS were significantly more likely to use school English in contexts where it was expected on proximal and distal outcomes including narrative writing, morphosyntactic awareness, and reading comprehension. Implications for theory and practice are discussed.
Reviews of Individual Studies 4 1
Effects of intervention to improve at-risk fourth graders' understanding, calculations, and word problems with fractions (2016)
Reviews of Individual Studies 4 1
Effects of Intervention to Improve At-Risk Fourth Graders' Understanding, Calculations, and Word Problems with Fractions (2016)
The purposes of this study were to (a) investigate the efficacy of a core fraction intervention program on understanding and calculation skill and (b) isolate the effects of different forms of fraction word-problem (WP) intervention. At-risk fourth graders (n = 213) were randomly assigned to the school's business-as-usual program, or one of two variants of the core fraction intervention (each 12 weeks, 36 sessions). In each session of the two variants, 28 minutes were identical, focused mainly on the measurement interpretation of fractions. The other 7 minutes addressed multiplicative WPs versus additive WPs. Children were pre-/posttested on fraction understanding, calculations, and WPs. On understanding and calculations, both intervention conditions outperformed the control group. The effect of intervention versus control on released fraction items from the National Assessment of Education Progress was mediated by children's improvement in the measurement interpretation of fractions. On multiplicative WPs, multiplicative WP intervention was superior to the other conditions, but additive WP intervention and the control group performed comparably. On additive WPs, additive WP intervention was superior to multiplicative WP intervention, which was superior to control.
Reviews of Individual Studies 4 1
Supported self-explaining during fraction intervention (2016)
Reviews of Individual Studies 4 1
Supported self-explaining during fraction intervention (2016)
The main purposes of this study were to test the effects of teaching at-risk 4th graders to provide explanations for their mathematics work and examine whether those effects occur by compensating for limitations in cognitive processes. We randomly assigned 212 children to 3 conditions: a control group and 2 variants of a multicomponent fraction intervention. Both intervention conditions included 36 sessions, each lasting 35 min. All but 7 min of each session were identical. In the 7-min component, students were taught to provide high quality explanations when comparing fraction magnitudes or to solve fraction word problems. Children were pretested on cognitive variables and pre/posttested on fraction knowledge. On accuracy of magnitude comparisons and quality of explanations, children who received the explaining intervention outperformed those in the word-problem condition. On word problems, children who received the word-problem intervention outperformed those in the explaining condition. Moderator analyses indicated that the explaining intervention was more effective for students with weaker working memory, while the word-problem intervention was more effective for students with stronger reasoning ability. © 2015 American Psychological Association.
Reviews of Individual Studies K-6 1
Student and teacher outcomes of the Class-Wide Function-Related Intervention Team efficacy trial. (2016)
Schools continue to strive for the use of evidenced-based interventions and policies to foster well-managed classrooms that promote improved student outcomes. The present study examined the effects of the Class-Wide Function-related Intervention Teams (CW-FIT), a group contingency intervention, on the on-task and disruptive behavior of elementary school students with or at risk for emotional behavior disorders (EBD). Seventeen elementary schools, 159 general education teachers, and 313 students participated in the randomized-control group design study. Fidelity of implementation was strong for intervention group teachers and was measured across groups and throughout baseline conditions. Results suggest that CW-FIT can be used to increase on-task behavior and reduce the disruptive behavior of students with or at risk for EBD. In addition, teachers in intervention classes increased praise and reduced reprimands to individual students and along with their students, reported high levels of consumer satisfaction.
Reviews of Individual Studies K-4 1
Scaling up the Success for All model of school reform: Final report from the Investing in Innovation (i3) evaluation. (2015)
Success for All (SFA), one of the best-known school reform models, aims to improve the reading skills of all children but is especially directed at schools that serve large numbers of students from low-income families. First implemented in 1987, SFA combines a challenging reading program, whole-school reform elements, and an emphasis on continuous improvement, with the goal of ensuring that every child learns to read well in the elementary grades. This is the third and final report from an independent evaluation of the scale-up demonstration of the SFA elementary school reading program. Both the demonstration and the evaluation have been funded under the U.S. Department of Education's Investing in Innovation (i3) competition. Conducted by MDRC--a nonprofit, nonpartisan education and social policy research organization--the evaluation examines SFA's implementation and impacts in five school districts over a three-year period (the 2011-2012 school year through the 2013-2014 school year). It also includes an analysis of program costs. Finally, it considers the scale-up process itself--the methods employed and the extent to which the Success for All Foundation (SFAF), the organization that developed and provides technical assistance to schools operating the program, achieved its scale-up goals. [This report was written with Emma Alterman, Herbert Collado, and Emily Pramik. For the executive summary of this report, see ED579090. For the Early Findings report, see ED545452. For the Interim Report, see ED546642.]
Reviews of Individual Studies K-5 1
Class-wide function-related intervention teams “CW-FIT” efficacy trial outcomes. (2015)
The purpose of the study was to determine the efficacy of the Class-Wide Function-Related Intervention Teams (CW-FIT) program for improving students' on-task behavior, and increasing teacher recognition of appropriate behavior. The intervention is a group contingency classroom management program consisting of teaching and reinforcing appropriate behaviors (i.e., getting the teacher's attention, following directions, and ignoring inappropriate behaviors of peers). Seventeen elementary schools, the majority in urban and culturally diverse communities, participated in a randomized trial with 86 teachers (classrooms) assigned to CW-FIT, and 73 teachers (classrooms) assigned to the comparison group. Class-wide student on-task behavior improved over baseline levels in the intervention classes. Teachers were able to implement the intervention with high fidelity overall, as observed in adherence to 96% of the fidelity criteria on average. Teacher praise and attention to appropriate behaviors increased, and reprimands decreased. These effects were replicated in new classrooms each of the 4 years of the study, and for all years combined.
Reviews of Individual Studies 2-5 1
Mobilizing volunteer tutors to improve student literacy: Implementation, impacts, and costs of the Reading Partners program. (2015)
This study reports on an evaluation of the "Reading Partners" program, which uses community volunteers to provide one-on-one tutoring to struggling readers in underresourced elementary schools. Established in 1999 in East Menlo Park, California, the mission of "Reading Partners" is to help children become lifelong readers by empowering communities to provide individualized instruction with measurable results. This report builds on those initial findings by describing the "Reading Partners" program and its implementation in greater detail, exploring whether the program is more or less effective for particular subgroups of students, and assessing some of the potential explanations for the program's success to date. In addition, this report includes an analysis of the cost of implementing the Reading Partners program in 6 of the 19 sites. The following are appended: (1) Implementation Study Methods; (2) Impact Study Methods and Teacher Survey; (3) Tutor Background Characteristics and Additional Impact Findings; (4) Cost Study Methods; and (5) Additional Cost Findings. [This report was written with A. Brooks Bowden and Yilin Pan.]
Reviews of Individual Studies 4 1
Does Working Memory Moderate the Effects of Fraction Intervention? An Aptitude-Treatment Interaction (2014)
This study investigated whether individual differences in working memory (WM) moderate effects of 2 variations of intervention designed to improve at-risk 4th graders' fraction knowledge. We also examined the effects of each intervention condition against a business-as-usual control group and assessed whether children's measurement interpretation of fractions mediated those effects. At-risk students (n = 243) were randomly assigned to control and 2 intervention conditions. The interventions each lasted 12 weeks, with three 30-min sessions per week. The major focus of both intervention conditions was the measurement interpretation of fractions. Across the 2 conditions, only 5 min of each 30-min session differed. One condition completed activities to build fluency with 4 measurement interpretation topics; in the other, activities were completed to consolidate understanding on the same 4 topics. Results revealed a significant aptitude-treatment interaction, in which students with very weak WM learned better with conceptual activities but children with more adequate (but still low) WM learned better with fluency activities. Both intervention conditions outperformed the control group on all outcomes, and improvement in the measurement interpretation of fractions mediated those effects.
Reviews of Individual Studies 4 1
Does working memory moderate the effects of fraction intervention? An aptitude-treatment interaction. (2013)
This study investigated whether individual differences in working memory (WM) moderate effects of 2 variations of intervention designed to improve at-risk 4th graders' fraction knowledge. We also examined the effects of each intervention condition against a business-as-usual control group and assessed whether children's measurement interpretation of fractions mediated those effects. At-risk students (n = 243) were randomly assigned to control and 2 intervention conditions. The interventions each lasted 12 weeks, with three 30-min sessions per week. The major focus of both intervention conditions was the measurement interpretation of fractions. Across the 2 conditions, only 5 min of each 30-min session differed. One condition completed activities to build fluency with 4 measurement interpretation topics; in the other, activities were completed to consolidate understanding on the same 4 topics. Results revealed a significant aptitude-treatment interaction, in which students with very weak WM learned better with conceptual activities but children with more adequate (but still low) WM learned better with fluency activities. Both intervention conditions outperformed the control group on all outcomes, and improvement in the measurement interpretation of fractions mediated those effects.
Reviews of Individual Studies 4 1
Improving At-Risk Learners' Understanding of Fractions (2013)
The purposes of this study were to investigate the effects of an intervention designed to improve at-risk 4th graders' understanding of fractions and to examine the processes by which effects occurred. The intervention focused more on the measurement interpretation of fractions; the control condition focused more on the part-whole interpretation of fractions and on procedures. Intervention was also designed to compensate for at-risk students' limitations in the domain-general abilities associated with fraction learning. At-risk students (n = 259) were randomly assigned to intervention and control. Whole-number calculation skill, domain-general abilities (working memory, attentive behavior, processing speed, listening comprehension), and fraction proficiency were pretested. Intervention occurred for 12 weeks, 3 times per week, 30 min per session, and then fraction performance was reassessed. On each conceptual and procedural fraction outcome, effects favored intervention over control (effect sizes = 0.29 to 2.50), and the gap between at-risk and low-risk students narrowed for the intervention group but not the control group. Improvement in the accuracy of children's measurement interpretation of fractions mediated intervention effects. Also, intervention effects were moderated by domain-general abilities, but not whole-number calculation skill.
Reviews of Individual Studies 4 1
Improving at-risk learners' understanding of fractions (2013)
The purposes of this study were to investigate the effects of an intervention designed to improve at-risk 4th graders' understanding of fractions and to examine the processes by which effects occurred. The intervention focused more on the measurement interpretation of fractions; the control condition focused more on the part-whole interpretation of fractions and on procedures. Intervention was also designed to compensate for at-risk students' limitations in the domain-general abilities associated with fraction learning. At-risk students (n = 259) were randomly assigned to intervention and control. Whole-number calculation skill, domaingeneral abilities (working memory, attentive behavior, processing speed, listening comprehension), and fraction proficiency were pretested. Intervention occurred for 12 weeks, 3 times per week, 30 min per session, and then fraction performance was reassessed. On each conceptual and procedural fraction outcome, effects favored intervention over control (effect sizes = 0.29 to 2.50), and the gap between at-risk and low-risk students narrowed for the intervention group but not the control group. Improvement in the accuracy of children's measurement interpretation of fractions mediated intervention effects. Also, intervention effects were moderated by domain-general abilities, but not whole-number calculation skill.
Reviews of Individual Studies 3-8 1
Transfer incentives for high-performing teachers: Final results from a multisite randomized experiment (NCEE 2014-4003). (2013)
One way to improve struggling schools' access to effective teachers is to use selective transfer incentives. Such incentives offer bonuses for the highest-performing teachers to move into schools serving the most disadvantaged students. In this report, we provide evidence from a randomized experiment that tested whether such a policy intervention can improve student test scores and other outcomes in low-achieving schools. The intervention, known to participants as the Talent Transfer Initiative (TTI), was implemented in 10 school districts in seven states. The highest-performing teachers in each district--those who ranked in roughly the top 20 percent within their subject and grade span in terms of raising student achievement year after year (an approach known as value added)--were identified. These teachers were offered $20,000, paid in installments over a two-year period, if they transferred into and remained in designated schools that had low average test scores. The main findings from the study include: (1) The transfer incentive successfully attracted high value-added teachers to fill targeted vacancies; (2) The transfer incentive had a positive impact on test scores (math and reading) in targeted elementary classrooms; and (3) The transfer incentive had a positive impact on teacher-retention rates during the payout period; retention of the high-performing teachers who transferred was similar to their counterparts in the fall immediately after the last payout. Seven appendixes are included: (1) Supplemental Materials for Chapters I and II; (2) Value-Added Analysis to Identify Highest-Performing Teachers; (3) Supplemental Materials for Chapter III; (4) Identification of Focal Teachers; (5) Supplemental Materials for Chapter IV; (6) Supplemental Materials for Chapter V; and (7) Supplemental Materials for Chapter VI. (Contains 114 footnotes, 61 figures, and 92 tables.) [For the executive summary, see ED544268.]
Reviews of Individual Studies 4 1
Differential effects of three professional development models on teacher knowledge and student achievement in elementary science. (2012)
To identify links among professional development, teacher knowledge, practice, and student achievement, researchers have called for study designs that allow causal inferences and that examine relationships among features of interventions and multiple outcomes. In a randomized experiment implemented in six states with over 270 elementary teachers and 7,000 students, this project compared three related but systematically varied teacher interventions--"Teaching Cases, Looking at Student Work, and Metacognitive Analysis"--along with no-treatment controls. The three courses contained identical science content components, but differed in the ways they incorporated analysis of learner thinking and of teaching, making it possible to measure effects of these features on teacher and student outcomes. Interventions were delivered by staff developers trained to lead the teacher courses in their regions. Each course improved teachers' and students' scores on selected-response science tests well beyond those of controls, and effects were maintained a year later. Student achievement also improved significantly for English language learners in both the study year and follow-up, and treatment effects did not differ based on sex or race/ethnicity. However, only Teaching Cases and Looking at Student Work courses improved the accuracy and completeness of students' written justifications of test answers in the follow-up, and only Teaching Cases had sustained effects on teachers' written justifications. Thus, the content component in common across the three courses had powerful effects on teachers' and students' ability to choose correct test answers, but their ability to explain why answers were correct only improved when the professional development incorporated analysis of student conceptual understandings and implications for instruction; metacognitive analysis of teachers' own learning did not improve student justifications either year. Findings suggest investing in professional development that integrates content learning with analysis of student learning and teaching rather than advanced content or teacher metacognition alone. (Contains 1 figure and 4 tables.)
Reviews of Individual Studies 4-8 1
Evaluation of "System 44." Final Report [2012] (2012)
The purpose of this evaluation of Scholastic's "System 44" conducted by RMC Research was to expand the existing research on students with learning disabilities by conducting a randomized study of struggling readers with approximately half of the sample comprised of students with learning disabilities. Specifically, this evaluation examined the impact of "System 44" on the reading outcomes of struggling readers and on a subsample of students with learning disabilities in Grades 4-8. The evaluation of the implementation and impact of "System 44" involved 12 elementary schools and 4 middle and K-8 schools in a district in Michigan. Scholastic's "System 44" is a foundational reading program intended for older struggling readers who have not mastered basic phonics and decoding skills. Combining researched-based phonics instruction with adaptive technology, "System 44" is designed to improve students' word reading accuracy, fluency, and comprehension. The "System 44" program delivers research-based instruction through an adaptive computer component; teacher-led small-group instruction; and individual student practice involving high-interest, leveled materials. Thus students who have not responded to classroom reading instruction may benefit from the more intensive and specific decoding instruction provided through "System 44." The evaluators selected the target sample based on student performance on the fall 2011 Michigan Educational Assessment Program (MEAP) and spring 2011 AIMSweb assessment. The Scholastic Reading Inventory (SRI) was used to screen students for "System 44" eligibility. The district administered the SRI to all students in the target sample. Those students who scored below 600 Lexiles on the SRI were administered the Scholastic Phonics Inventory (SPI). All students who scored in the Beginning or Developing reader categories on the SPI were randomly assigned (stratified by school and grade level) to either the "System 44" treatment group or the control group. RMC Research hired and trained 4 local testers to individually administer a battery of standardized reading tests to all treatment and control group students. The testers administered the tests in October 2011 to establish baseline scores and again in May 2012 to attain follow-up scores. The tests included the following: (1) Test of Silent Reading Efficiency and Comprehension (TOSREC); (2) Comprehensive Test of Phonological Processing (CTOPP) Elision subtest; (3) Test of Word Reading Efficiency (TOWRE) Sight Word Efficiency subtest; and (4) Test of Word Reading Efficiency (TOWRE) Phonetic Decoding Efficiency subtest. The evaluation of "System 44" revealed significant impacts on several tests for both the overall sample and the learning disabled sample. Additional findings revealed that impacts were stronger on several tests for middle school students than for elementary school students, particularly on SPI Nonsense Word Accuracy, TOSREC, and SRI. Although significant impacts were attained by the end of Year 1, the majority of students in the study did not complete the "System 44" program. Data collected through teacher surveys, classroom visits, and interviews provided information on teachers' implementation of "System 44" in the classroom, and software usage data were used to examine differences in students with varying program exit and topic completion patterns. [For the November 2011 report, see ED613693.]
Reviews of Individual Studies 4-8 1
Evaluation of the effectiveness of the Alabama Math, Science, and Technology Initiative (AMSTI) (NCEE 2012–4008). (2012)
This report presents the results of an experiment conducted in Alabama beginning in the 2006/07 school year, to determine the effectiveness of the Alabama Math, Science, and Technology Initiative (AMSTI), which aims to improve mathematics and science achievement in the state's K-12 schools. This study is the first randomized controlled trial testing the effectiveness of AMSTI in improving mathematics problem solving and science achievement in upper-elementary and middle schools. AMSTI is an initiative specific to Alabama and was developed and supported through state resources. An important finding is the positive and statistically significant effect of AMSTI on mathematics achievement as measured by the SAT 10 mathematics problem solving assessment administered by the state to students in grades 4-8. After one year in the program, student mathematics scores were higher than those of a control group that did not receive AMSTI by 0.05 standard deviation, equivalent to 2 percentile points. Nine of the 10 sensitivity analyses yielded effect estimates that were statistically significant at the 0.025 level, consistent with the main finding. The estimated effect of AMSTI on science achievement measured after one year was not statistically significant. Based on the SAT 10 science test administered by the state to students in grades 5 and 7, no difference between AMSTI and control schools could be discerned after one year. Changes in classroom instructional strategies, especially an emphasis on more active-learning strategies, are important to the AMSTI theory of action. Therefore, a secondary investigation of classroom practices was conducted, based on data from survey responses from teachers. For both mathematics and science, statistically significant differences were found between AMSTI and control teachers in the average reported time spent using the strategies. The effect of AMSTI on these instructional strategies was 0.47 standard deviation in mathematics and 0.32 standard deviation in science. Two years of AMSTI appeared to have a positive and statistically significant effect on achievement in mathematics problem solving, compared to no AMSTI. Two years of AMSTI appeared to have a positive and statistically significant effect on achievement in science. AMSTI appeared to have a positive and statistically significant effect on reading achievement as measured by the SAT 10 test of reading administered by the state to students in grades 4-8. AMSTI did not appear to have a statistically significant effect on teacher-reported content knowledge in mathematics or science after one year. AMSTI did not appear to have statistically significant differential effects on student achievement in mathematics problem solving or science based on racial/ethnic minority status, enrollment in the free or reduced-price lunch program, gender, or pretest level. Appended are: (1) Explanation of primary and secondary confirmatory outcome measures; (2) Explanation of exploratory research questions; (3) Selection and random assignment of schools; (4) Statistical power analysis; (5) Data collection procedures and timeline; (6) Description of program implementation data collected but not used in report; (7) Alabama Math, Science, and Technology Initiative (AMSTI) teacher survey #3; (8) Data cleaning and data file construction; (9) Attrition through study stages for samples used in the confirmatory analysis; (10) Description of degree rank; (11) Equivalence of Year 1 baseline and analyzed samples for confirmatory student-level and classroom practice outcomes; (12) Internal consistency and validity of active learning measures; (13) Number of students and teachers in schools in analytic samples used to analyze Year 1 confirmatory questions; (14) Attrition through study stages for samples used in Year 1 exploratory analysis; (15) Tests of equivalence for baseline and analytic samples for Year 1 exploratory outcomes; (16) Statistical power analyses for moderator analyses; (17) Derivation and motivation of the Bell-Bradley estimator when measuring estimated two-year effect of the Alabama Math, Science, and Technology Initiative (AMSTI); (18) Attrition through study stages for samples contributing to estimation of two-year effects; (19) Examination of equivalence in baseline and analytic samples used in the estimation of two-year effects; (20) Estimation model for two-year effects of the Alabama Math, Science, and Technology Initiative (AMSTI); (21) Topics and instructional methods used at the Alabama Math, Science, and Technology Initiative (AMSTI) summer institute; (22) Parameter estimates on probability scale for odds-ratio tests of differences between Alabama Math, Science, and Technology Initiative (AMSTI) and control conditions in Year 1 (associated with summer professional development and in-school support outcomes); (23) Descriptive statistics for variables that change to a binary scale used in the Alabama Math, Science, and Technology Initiative (AMSTI) and control conditions in Year 1; (24) Comparison of assumed parameter values and observed sample statistics for statistical power analysis after one year; (25) Parameter estimates for Stanford Achievement Test Tenth Edition (SAT 10) mathematics problem solving after one year; (26) Parameter estimates for Stanford Achievement Test Tenth Edition (SAT 10) science after one year; (27) Parameter estimates for active learning in mathematics after one year; (28) Parameter estimates for active learning in science after one year; (29) Sensitivity analyses of effect of the Alabama Math, Science, and Technology Initiative (AMSTI) on Stanford Achievement Test Tenth Edition (SAT 10) mathematics problem solving achievement after one year; (30) Sensitivity analyses of effect of the Alabama Math, Science, and Technology Initiative (AMSTI) on Stanford Achievement Test Tenth Edition (SAT 10) science achievement after one year; (31) Sensitivity analyses of effect of the Alabama Math, Science, and Technology Initiative (AMSTI) on active learning instructional strategies in mathematics classrooms after one year; (32) Sensitivity analyses of effect of the Alabama Math, Science, and Technology Initiative (AMSTI) on active learning instructional strategies in science classrooms after one year; (33) Tests for violations of factors associated with assumption of equal first year effects on students in Alabama Math, Science, and Technology Initiative (AMSTI) and control schools; (34) Post hoc adjustment to standard error for estimate of two-year effect of the Alabama Math, Science, and Technology Initiative (AMSTI) on mathematics achievement after two years; (35) Parameter estimates for effect of the Alabama Math, Science, and Technology Initiative (AMSTI) after two years; (36) Parameter estimates for effect of the Alabama Math, Science, and Technology Initiative (AMSTI) on student reading achievement after one year; (37) Parameter estimates for teacher content and student engagement after one year; (38) Estimates of effects for terms involving the indicator of treatment status in the analysis of the moderating effect of the three-level pretest variable; (39) Parameter estimates for the analysis of the moderating effect of racial/ethnic minority status on the impact of the Alabama Math, Science, and Technology Initiative (AMSTI) on reading after one year; (40) Parameter estimates for analysis of average effect of the Alabama Math, Science, and Technology Initiative (AMSTI) on reading by racial/ethnic minority students after one year; and (41) Parameter estimates for effect of the Alabama Math, Science, and Technology Initiative (AMSTI) on reading for White students after one year. (Contains 26 figures, 136 tables, 1 box and 130 footnotes.)
Reviews of Individual Studies 4-5 1
Large-scale randomized controlled trial with 4th graders using intelligent tutoring of the structure strategy to improve nonfiction reading comprehension. (2012)
Reading comprehension is a challenge for K-12 learners and adults. Nonfiction texts, such as expository texts that inform and explain, are particularly challenging and vital for students' understanding because of their frequent use in formal schooling (e.g., textbooks) as well as everyday life (e.g., newspapers, magazines, and medical information). The structure strategy is explicit instruction about how to strategically use knowledge about text structures for encoding and retrieval of information from nonfiction and has consistently shown significant improvements in reading comprehension. We present the delivery of the structure strategy using a web-based intelligent tutoring system (ITSS) that has the potential to offer consistent modeling, practice tasks, assessment, and feedback to the learner. Finally, we report on statistically significant findings from a large scale randomized controlled efficacy trial with rural and suburban 4th-grade students using ITSS.
Reviews of Individual Studies K-8 1
Enhancing the efficacy of teacher incentives through loss aversion: A field experiment. (2012)
Domestic attempts to use financial incentives for teachers to increase student achievement have been ineffective. In this paper, we demonstrate that exploiting the power of loss aversion--teachers are paid in advance and asked to give back the money if their students do not improve sufficiently--increases math test scores between 0.201 (0.076) and 0.398 (0.129) standard deviations. This is equivalent to increasing teacher quality by more than one standard deviation. A second treatment arm, identical to the loss aversion treatment but implemented in the standard fashion, yields smaller and statistically insignificant results. This suggests it is loss aversion, rather than other features of the design or population sampled, that leads to the stark differences between our findings and past research.
Reviews of Individual Studies 4-8 1
Evaluation of "System 44." Final Report [2011] (2011)
Scholastic's "System 44" is a foundational reading program intended for older struggling readers who have not mastered basic phonics and decoding skills. Combining researched-based phonics instruction with adaptive technology, "System 44" is designed to improve students' word reading accuracy, fluency, and comprehension. The "System 44" program delivers research-based instruction through an adaptive computer component; teacher-led small group instruction; and individual student practice involving high-interest, leveled materials. Thus students who have not responded to classroom reading instruction may benefit from the more intensive and specific decoding instruction provided through "System 44." Using a randomized design, this evaluation assessed the effectiveness of "System 44" in terms of improving the foundational reading skills of struggling readers in Grades 4-8 in a large suburban school district in southern California during the 2010-2011 school year. The evaluation of the implementation and impact of "System 44" involved 7 of the 11 elementary schools and all 4 middle schools in the district. A 2-step process was used to establish student eligibility for "System 44." The Scholastic Reading Inventory (SRI) was used to screen students in Grades 4-8 who performed below the 50th percentile on the spring 2010 California Standards Test (CST) for "System 44" eligibility. Those students who scored below 600 Lexiles on the SRI were administered the Scholastic Phonics Inventory (SPI), a computer-based test used to identify students in need of additional phonics instruction. Students who scored in the Beginning or Developing reader categories on the SPI were randomly assigned (stratified by school and grade level) to either the "System 44" treatment group or the control group. Data collection activities for the "System 44" evaluation included student reading tests, teacher surveys, "System 44" classroom observations, a professional development observation, and staff interviews. RMC Research hired and trained 4 local testers to administer a battery of standardized reading tests to all treatment and control students. The testers administered the tests to each student separately over a 3-week period in September and October 2010 to establish baseline scores and again in May 2011 to attain follow-up scores. Listed in order of administration, the tests included the following: (1) Test of Silent Reading Efficiency and Comprehension (TOSREC); (2) Comprehensive Test of Phonological Processing (CTOPP) Elision subtest; (3) Woodcock-Johnson III Word Identification subtest; (4) Woodcock-Johnson III Word Attack subtest; (5) Test of Word Reading Efficiency (TOWRE) Sight Word Efficiency subtest; and (6) Test of Word Reading Efficiency (TOWRE) Phonetic Decoding Efficiency subtest. This report details the program impact findings and concludes with recommendations from the evaluation team.
Reviews of Individual Studies 4-5 1
Large scale, randomized cluster design study of the relative effectiveness of reform-based and traditional/verification curricula in supporting student science learning. (2010, March)
Reviews of Individual Studies 4 1
Learning the control of variables strategy in higher and lower achieving classrooms: Contributions of explicit instruction and experimentation. (2010)
Students (n = 797) from 36 4th-grade classrooms were taught the control of variables strategy for designing experiments. In the instruct condition, classes were taught in an interactive lecture format. In the manipulate condition, students worked in groups to design and run experiments to determine the effects of four variables. In the both condition, classes received the interactive lecture and also designed and ran experiments. We assessed students' understanding using a written test of their ability to distinguish valid from invalid experimental comparisons. Performance on this test improved from the pretest to the immediate posttest in all conditions, and gains were maintained at a 5-month delay. For students from both higher and lower achieving schools, gains ordered as follows: both greater than instruct greater than manipulate. However, students from higher achieving schools showed greater gains in all conditions. Item analyses showed that the interactive lecture improved students' understanding of the need to control irrelevant variables, and experimentation improved students' understanding of the need to vary the focal variable. (Contains 4 tables, 2 figures and 1 footnote.)
Reviews of Individual Studies K-5 1
Examining the Effects of Schoolwide Positive Behavioral Interventions and Supports on Student Outcomes: Results from a Randomized Controlled Effectiveness Trial in Elementary Schools (2010)
Schoolwide Positive Behavioral Interventions and Supports (SWPBIS) is a universal, schoolwide prevention strategy that is currently implemented in over 9,000 schools across the nation to reduce disruptive behavior problems through the application of behavioral, social learning, and organizational behavioral principles. SWPBIS aims to alter school environments by creating improved systems and procedures that promote positive change in student behavior by targeting staff behaviors. This study uses data from a 5-year longitudinal randomized controlled effectiveness trial of SWPBIS conducted in 37 elementary schools to examine the impact of training in SWPBIS on implementation fidelity as well as student suspensions, office discipline referrals, and academic achievement. School-level longitudinal analyses indicated that the schools trained in SWPBIS implemented the model with high fidelity and experienced significant reductions in student suspensions and office discipline referrals. (Contains 1 table and 5 figures.)
Reviews of Individual Studies 4-8 1
Impact evaluation of the U.S. Department of Education’s Student Mentoring Program. Final report (NCEE 2009-4047). (2009)
This report summarizes the findings from a national evaluation of mentoring programs funded under the U.S. Department of Education's Student Mentoring Program. The impact evaluation used an experimental design in which students were randomly assigned to a treatment or control group. Thirty-two purposively selected School Mentoring Programs and 2,573 students took part in the evaluation, which estimated the impact of the programs over one school year on a range of student outcomes. The evaluation also describes the characteristics of the program and the mentors, and provides information about program delivery. The Student Mentoring Program is designed to fund grantees to enable them to provide mentoring to at-risk students in grades 4-8. The ultimate goal of the program is to improve student academic and behavioral outcomes through the guidance and encouragement of a volunteer mentor. Seventeen total impacts in the domains of academic achievement/engagement, interpersonal relationships/personal responsibility, and high-risk/delinquent behavior were measured. The main finding of the Impact Study was that there were no statistically significant impacts of the Student Mentoring Program for the sample as a whole on this array of student outcomes. However, there was some scattered evidence that impacts were heterogeneous across types of students. In particular, impacts on girls were statistically significantly different from impacts on boys for two self-reported scales: Scholastic Efficacy and School Bonding, and Pro-social Behaviors. For boys, the impact on Prosocial Behaviors was negative and statistically significant. For girls, the impact on Scholastic Efficacy and School Bonding was positive and statistically significant. The impact on truancy was negative and statistically significant for students below age 12. There were negative associations between program supervision of mentors and site-level impacts on three of the seventeen individual outcome measures: Pro-social Behaviors, grades in math and social studies, and a positive relationship with the outcome of school-reported delinquency. The report also presented results demonstrating that the Student Mentoring Program represented a fairly low level of intensity in terms of service: although grantees, on average, adhered to the general intents of the legislation and program guidance, they were simultaneously constrained by the limits of the school calendar and the population from which to draw mentors. Thirty-five percent of the control group students reported receiving mentoring either from the program or elsewhere in the community; this finding, coupled with the fact that not all treatment group students met with a mentor, reduced the treatment contrast and may have led to some dilution of the impacts on students compared to expectations. Seven appendices are included; (1) Sampling Design and Methodology; (2) Survey Instruments; (3) Construction of Student Outcome Measures; (4) Impact Analysis Results on Original Student Survey Scales and Measures; (5) Sensitivity Tests; (6) Standard Errors and Confidence Intervals of Main Effects; and (7) Site-Level Predictors and Impacts. (Contains 109 footnotes and 122 exhibits.) ["Impact Evaluation of the U.S. Department of Education's Student Mentoring Program. Final Report" was written with the assistance of Christine Dyous, Michelle Klausner, Nancy McGarry, Rachel Luck and William Rhodes.]
Reviews of Individual Studies 1-5 1
A multisite cluster randomized field trial of Open Court Reading. (2008)
In this article, the authors report achievement outcomes of a multisite cluster randomized field trial of Open Court Reading 2005 (OCR), a K-6 literacy curriculum published by SRA/McGraw-Hill. The participants are 49 first-grade through fifth-grade classrooms from predominantly minority and poor contexts across the nation. Blocking by grade level within schools, the trial includes 27 classrooms receiving the OCR curricular materials and professional development and 22 "business-as-usual" control classrooms. Multilevel analyses of classroom-level effects of assignment to OCR reveal statistically significant treatment effects on all three of the Comprehensive Test of Basic Skills, 5th edition, Terra Nova literacy posttests. The OCR effect sizes are d = 0.16 for the Reading Composite, d = 0.19 for Vocabulary, and d = 0.12 for Reading Comprehension. These effects achieved across 27 classrooms and 5 schools demonstrate the potential for replicating improved literacy outcomes through the scale-up of OCR. (Contains 4 tables and 1 note.)
Reviews of Individual Studies 1-5 1
Alternative routes to teaching: The impacts of Teach for America on student achievement and other outcomes. (2006)
This paper reports on a randomized experiment to study the impact of an alternative teacher preparation program, Teach for America (TFA), on student achievement and other outcomes. We found that TFA teachers had a positive impact on math achievement and no impact on reading achievement. The size of the impact on math scores was about 15 percent of a standard deviation, equivalent to about one month of instruction. The general conclusions did not differ substantially for subgroups of teachers, including novice teachers, or for subgroups of students. We found no impacts on other student outcomes such as attendance, promotion, or disciplinary incidents, but TFA teachers were more likely to report problems with student behavior than were their peers. The findings contradict claims that such programs allowing teachers to bypass the traditional route to the classroom harm students.
Reviews of Individual Studies 1-5 1
The effects of Teach for America on students: Findings from a national evaluation. (2004)
Teach For America (TFA) was founded in 1989 to address the educational inequities facing children in low-income communities across the United States by expanding the pool of teacher candidates available to the schools those children attend. TFA recruits seniors and recent graduates from colleges around the country, people who are willing to commit to teach for a minimum of two years in low-income schools. TFA focuses its recruitment on people with strong academic records and leadership capabilities, whether or not they have planned to teach or have taken education courses. TFA is particularly interested in candidates that have the potential to be effective in the classroom but in the absence of TFA would not consider a teaching career. Consequently, most TFA recruits do not have education-related majors in college and therefore have not received the same training that traditional teachers are expected to have. After an executive summary and introduction, this discussion paper addresses the following: (1) How TFA Works; (2) Study Design; (3) Who Teaches in the Schools Where TFA Places Teachers?; (4) What Does Our Sample of Students Look Like?; (5) Were TFA Teachers Effective in the Classroom?; and (6) Did TFA Have an Impact on Other Student Outcomes? Primary findings from the study include: from the perspective of a community or a school faced with the opportunity to hire TFA teachers, TFA offers an appealing pool of candidates; from the perspective of TFA and its funders, the organization is making progress toward its primary mission of reducing inequities in education--it supplies low-income schools with academically talented teachers who contribute positively to the academic achievement of their students; and from the perspective of policymakers who are trying to improve the educational opportunities of children in poor communities, many of the control teachers in the study were not certified or did not have formal pre-service training, highlighting the need for programs or policies that offer the potential of attracting good teachers to schools in the most disadvantaged communities--the findings show that TFA is one such program. Appended are: (1) Supplementary Tables; and (2) Estimation Approach. (Contains 17 tables and 6 figures.)
Reviews of Individual Studies K-5 1
Improved language skills by children with low reading performance who used Fast ForWord Language. (2004)
Reviews of Individual Studies 3-12 2
A Team-Based Leadership Intervention in New York City Schools: An Evaluation of the Targeted Intensive School Support Program (2020)
In 2013, the NYC Leadership Academy (NYCLA) developed a leadership intervention--the Targeted Intensive School Support (TISS) program--in collaboration with the New York City Department of Education (NYC DOE) to support schools that were facing particular challenges. NYCLA asked the RAND Corporation to provide an independent evaluation of the program's implementation and effects, and those findings are detailed in this report. The TISS program consisted of five key components: (1) teaming and collaborative training in aligned preservice preparation programs for a principal and assistant principal (AP); (2) coplacement of a principal and AP into an NYC DOE school; (3) team-based coaching to support the principal and AP; (4) 328 hours of extended coaching over the first three years after placement; and (5) use of a diagnostic process to guide goal setting and coaching according to school needs. Implementation findings suggest that only two of the five key components were implemented with fidelity. A propensity weighting approach was used to compare schools with TISS principals to other schools with new principals trained through residency-based preservice programs who did not participate in TISS. Findings suggest no statistically significant differences between TISS schools and comparison schools on measures of student achievement, school culture, and principal retention. TISS schools underperformed relative to comparison schools on the measure of chronic student absenteeism. [Sponsored by NYC Leadership Academy through a subgrant from the U.S. Department of Education.]
Reviews of Individual Studies 3-12 2
Illustrating the Promise of Community Schools: An Assessment of the Impact of the New York City Community Schools Initiative. (2020)
Reviews of Individual Studies 4-5 2
Effects of Fourth- and Fifth-Grade Super Solvers Intervention on Fraction Magnitude Understanding and Calculation Skill (2019)
Reviews of Individual Studies 4-5 2
Effects of Fourth- and Fifth-Grade Super Solvers Intervention on Fraction Magnitude Understanding and Calculation Skill (2019)
Reviews of Individual Studies K-8 2
Preparing School Leaders for Success: Evaluation of New Leaders' Aspiring Principals Program, 2012-2017 (2019)
A growing body of research points to the ways in which principals influence teachers, classrooms, and, ultimately, student achievement. New Leaders aims to prepare transformational school leaders by partnering with districts and charter schools to offer rigorous, research-based training for aspiring principals. The Aspiring Principals program is New Leaders' signature program and has three core features: selective recruitment and admission, training and endorsement, and support for principals early in their tenure. This report is a follow-up to the 2014 evaluation of New Leaders' Aspiring Principals program. Focusing on the revised program, which was first implemented in 2012, the authors present evidence of the effectiveness of the revised Aspiring Principals program and share lessons that can inform principal-preparation policy and practice. To assess the effect of New Leaders' Aspiring Principals program, researchers analyzed whether schools and students led by graduates of the program outperformed comparison schools and students in the same district, focusing on student achievement and principal retention. They also examined program graduate placement and satisfaction with the Aspiring Principals program. [For the appendixes, see ED605724.]
Reviews of Individual Studies K-8 2
A state-wide quasi-experimental effectiveness study of the scale-up of School-Wide Positive Behavioral Interventions and Supports (2019)
The three-tiered Positive Behavioral Interventions and Supports (PBIS) framework promotes the development of systems and data analysis to guide the selection and implementation of evidence-based practices across multiple tiers. The current study examined the effects of universal (tier 1) or school-wide PBIS (SW-PBIS) in one state's scale-up of this tier of the framework. Annual propensity score weights were generated to examine the longitudinal effects of SW-PBIS from 2006-07 through 2011-12. School-level archival and administrative data outcomes were examined using panel models with an autoregressive structure. The sample included 1,316 elementary, middle, and high schools. Elementary schools trained in SW-PBIS demonstrated statistically significantly lower suspensions during the fourth and fifth study years (i.e., small effect size) and higher reading and math proficiency rates during the first two study years as well as in one and two later years (i.e., small to large effect sizes), respectively. Secondary schools implementing SW-PBIS had statistically significantly lower suspensions and truancy rates during the second study year and higher reading and math proficiency rates during the second and third study years. These findings demonstrate medium effect sizes for all outcomes except suspensions. Given the widespread use of SW-PBIS across nearly 26,000 schools in the U.S., this study has important implications for educational practices and policies. [This paper was published in the "Journal of School Psychology" v73 p41-55 Apr 2019 (ISSN 0022-4405).]
Reviews of Individual Studies K-4 2
HEROES i3 Development Grant: External Evaluation Report. (2018)
Reviews of Individual Studies 4-8 2
A year-long state-wide RCT of the Minnesota Math Corps: Final report to Laura and John Arnold Foundation (2018)
Reviews of Individual Studies 3-5 2
Effects of the first year of a three-year CGI teacher professional development program on grades 3–5 student achievement: A multisite cluster-randomized trial. (Research Report No. 2018-25) (2018)
Reviews of Individual Studies 2-12 2
Can Restorative Practices Improve School Climate and Curb Suspensions? An Evaluation of the Impact of Restorative Practices in a Mid-Sized Urban School District. Research Report. RR-2840-DOJ. (2018)
Across the country, school districts, their stakeholders, and policymakers have become increasingly concerned about suspensions, particularly about suspending students from elementary school and disproportionately suspending ethnic/racial minority students. Suspended students are less likely to graduate, possibly because they miss the instructional time they need to advance academically. Restorative practices have gained buy-in in the education community as a strategy to reduce suspension rates. Proactively improving relationships among students and staff and building a sense of community in classrooms and schools may make students less inclined to misbehave. And addressing severe misbehavior through a restorative approach may help students realize the impacts of their actions and make them less likely to offend again. This study of the implementation of restorative practices in the Pittsburgh Public Schools district (PPS) in school years 2015-16 and 2016-17 represents one of the first randomized controlled trials of the effects of restorative practices on classroom and school climates and suspension rates. The authors examined a specific restorative practices program -- the International Institute for Restorative Practices' SaferSanerSchools™ Whole-School Change program -- implemented in a selected group of PPS schools under a program called Pursuing Equitable and Restorative Communities, or PERC. The researchers found that PERC achieved several positive effects, including an improvement in overall school climates (as rated by teachers), a reduction in overall suspension rates, and a reduction in the disparities in suspension rates between African American and white students and between low- and higher-income students. Key Findings: Effects of the Pursuing Equitable and Restorative Communities (PERC) program in Pittsburgh Public Schools: (1) Implementation of restorative practices through PERC improved overall school climates, as rated by teachers; (2) Implementation of restorative practices reduced the average suspension rate: During the study period, average suspension rates decreased in both PERC and non-PERC schools, but rates decreased more in PERC schools; (3) Suspension rates of African American students and of those from low-income families also went down in PERC schools, shrinking the disparities in suspension rates between African American and white students and between low- and higher-income students; (4) Academic outcomes did not improve in PERC schools, and actually worsened for grades 6-8; and (5) Arrest rates among PERC schools did not decrease. Recommendations: (1) Given the constraints on teachers' time, emphasize restorative practices that can be woven into the school day; (2) Ensure that school leaders understand and can model restorative practices, including by providing mandatory professional development, books and other materials, and coaching on restorative practices; (3) Establish a mechanism for school staff to meet at least once per month as a professional learning community on restorative practices; (4) Ensure that leaders at the district level can coordinate this work; (5) Set, and update, clear expectations regarding the use of restorative practices; and (6) Implement data collection systems to collect accurate information on all types of behavioral incidents and remedies.
Reviews of Individual Studies 3-8 2
Can Universal SEL Programs Benefit Universally? Effects of the Positive Action Program on Multiple Trajectories of Social-Emotional and Misconduct Behaviors. (2017)
Behavioral trajectories during middle childhood are predictive of consequential outcomes later in life (e.g., substance abuse, violence). Social and emotional learning (SEL) programs are designed to promote trajectories that reflect both growth in positive behaviors and inhibited development of negative behaviors. The current study used growth mixture models to examine effects of the "Positive Action" program (PA) on behavioral trajectories of social-emotional and character development (SECD) and misconduct using data from a cluster-randomized trial that involved 14 schools and a sample of predominately low-income, urban youth followed from 3rd through 8th grade. For SECD, findings indicated that PA was similarly effective at improving trajectories within latent classes characterized as "High/declining" and "Low/stable". Favorable program effects were likewise evident to a comparable degree for misconduct across observed latent classes that reflected "Low/rising" and "High/rising" trajectories. These findings suggest that PA and perhaps other school-based universal SEL programs have the potential to yield comparable benefits across subgroups of youth with differing trajectories of positive and negative behaviors, making them promising strategies for achieving the intended goal of school-wide improvements in student outcomes. [This paper was published in "Prevention Science" v18 p214-224 2017.]
Reviews of Individual Studies 4-11 2
The effects of statewide private school choice on college enrollment and graduation (2017)
Although several studies have documented the effects of statewide private school choice programs on student test scores, this report is the first to examine the effects of one of these programs on college enrollment and graduation. Using data from the Florida Tax Credit (FTC) Scholarship program, we find that low-income Florida students who attended private schools using an FTC scholarship enrolled in and graduated from Florida colleges at a higher rate than their public school counterparts. [Additional support for this study was provided by the Bill and Susan Oberndorf Foundation and Kate and Bill Duhamel.]
Reviews of Individual Studies K-8 2
A comprehensive model of teacher induction: Implementation and impact on teachers and students. Evaluation of the New Teacher Center’s i3 Validation Grant, Final Report (2017)
Reviews of Individual Studies 3-8 2
National Board certification and teacher effectiveness: Evidence from Washington state. (2016)
We study the effectiveness of teachers certified by the National Board for Professional Teaching Standards (NBPTS) in Washington State, which has one of the largest populations of National Board-Certified Teachers (NBCTs) in the nation. Based on value-added models in math and reading, we find that NBPTS-certified teachers are about 0.01-0.05 student standard deviations more effective than non-NBCTS with similar levels of experience. Certification effects vary by subject, grade level, and certification type, with greater effects for middle school math certificates. We find mixed evidence that teachers who pass the assessment are more effective than those who fail, but that the underlying NBPTS assessment score predicts student achievement.
Reviews of Individual Studies 3-12 2
The effects of teacher entry portals on student achievement (2014)
The current teacher workforce is younger, less experienced, more likely to turnover, and more diverse in preparation experiences than the workforce of two decades ago. Research shows that inexperienced teachers are less effective, but we know little about the effectiveness of teachers with different types of preparation. In this study, we classify North Carolina public school teachers into "portals"--fixed and mutually exclusive categories that capture teachers' formal preparation and qualifications upon first entering the profession--and estimate the adjusted average test score gains of students taught by teachers from each portal. Compared with undergraduate-prepared teachers from in-state public universities, (a) out-of-state undergraduate-prepared teachers are less effective in elementary grades and high school, (b) alternative entry teachers are less effective in high school, and (c) Teach For America corps members are more effective in STEM subjects and secondary grades.
Reviews of Individual Studies K-12 2
Preparing principals to raise student achievement: Implementation and effects of the New Leaders Program in ten districts. (2014)
New Leaders is a nonprofit organization with a mission to ensure high academic achievement for all students by developing outstanding school leaders to serve in urban schools. Its premise is that a combination of preparation and improved working conditions for principals, especially greater autonomy, would lead to improved student outcomes. Its approach involves both preparing principals and partnering with school districts and charter management organizations (CMOs) to improve the conditions in which its highly trained principals work. As part of the partnerships, New Leaders agrees to provide carefully selected and trained principals who can be placed in schools that need principals and to provide coaching and other support after those principals are placed. The districts and CMOs agree to establish working conditions that support, rather than hinder, the principals' efforts to improve student outcomes. This report describes how the New Leaders program was implemented in partner districts, and it provides evidence of the effect that New Leaders has on student achievement. [The research in this report was produced within RAND Education. For the appendices that accompany this report, see ED561154. For the research brief, "Principal Preparation Matters: How Leadership Development Affects Student Achievement. Research Brief," see ED561155.]
Reviews of Individual Studies K-12 2
Early progress: Interim research on personalized learning. (2014)
Reviews of Individual Studies 2-5 2
Alignment of game design features and state mathematics standards: Do results reflect intentions? (2014)
Reviews of Individual Studies 3-10 2
MPCP Longitudinal Educational Growth Study Fifth Year Report. (2012)
This is the final report in a five-year evaluation of the Milwaukee Parental Choice Program (MPCP). This report features analyses of student achievement growth four years after the authors carefully assembled longitudinal study panels of MPCP and Milwaukee Public Schools (MPS) students in 2006-07. The MPCP, which began in 1990, provides government-funded vouchers for low-income children to attend private schools in the City of Milwaukee. The maximum voucher amount in 2010-11 was $6,442, and 20,996 children used a voucher to attend either secular or religious private schools. The MPCP is the oldest and largest urban school voucher program in the United States. This evaluation was authorized by 2005 Wisconsin Act 125, which was enacted in 2006. The primary purpose of the evaluation is twofold: 1) to analyze the effectiveness of the MPCP in promoting growth in student achievement as compared to MPS; and 2) to examine the educational attainment--measured by high school graduation and college enrollment rates--of MPCP and MPS students. The first purpose is accomplished by gauging growth in student achievement--as measured by the Wisconsin Knowledge and Concepts Examinations (WKCE) in math and reading in grades 3 through 8 and grade 10--over a five-year period for a sample of MPCP students and a carefully matched group of MPS students. The second purpose is accomplished by following the 2006-07 8th and 9th grade MPCP and matched MPS cohorts over a five-year period during which they would have had the opportunity to graduate from high school and enroll in college. Appended are: (1) Descriptive Statistics; (2) Attrition Study; and (3) Stability of the Sample. (Contains 4 figures, 12 tables and 14 footnotes.) [For the "MPCP Longitudinal Educational Growth Study: Fourth Year Report. SCDP Milwaukee Evaluation. Report # 23", see ED518597. Additional support for this report was provided by the Robertson Foundation.]
Reviews of Individual Studies 4-8 2
An evaluation of the Chicago Teacher Advancement Program (Chicago TAP) after four years. (2012)
In 2007, using funds from the federal Teacher Incentive Fund (TIF) and private foundations, the Chicago Public Schools (CPS) began piloting its version of a schoolwide reform model called the Teacher Advancement Program (TAP). Under the TAP model, teachers can earn extra pay and take on increased responsibilities through promotion (to mentor teacher or master teacher), and they become eligible for annual performance bonuses based on a combination of their contribution to student achievement (known as "value added") and observed performance in the classroom. The model calls for weekly meetings of teachers and mentors ("cluster groups"), and regular classroom observations by a school leadership team to help teachers meet their performance goals. The idea behind TAP is that giving teachers performance incentives, along with tools to track their performance and improve instruction, will help schools attract and retain talented teachers and help all teachers raise student achievement. This report is the last in a series of reports providing evidence on the impacts of CPS' version of TAP, called "Chicago TAP." It presents findings from the four-year implementation period, with special emphasis on the 2009-2010 and 2010-2011 school years, the third and fourth years of the program's rollout in Chicago. Earlier reports (Glazerman et al. 2009; Glazerman and Seifullah 2010) provide detailed data on each of the first two years of the program, respectively. CPS implemented Chicago TAP as a pilot program intended for 40 high-need schools. The program began in 10 schools in the first year (cohort 1) with a rollout plan to add 10 more Chicago TAP schools (cohorts 2, 3, and 4) in each year of the TIF grant's four-year implementation period. The authors address three research questions regarding Chicago TAP: (1) How was the program implemented?; (2) What impact did the program have on student achievement?; and (3) What impact did the program have on teacher retention within schools? To assess the first year under Chicago TAP for schools that began the program in fall 2009 (cohort 3), the authors looked at how teacher development and compensation practices in Chicago TAP schools differ from practices normally implemented in CPS schools. The authors found that teachers in Chicago TAP schools reported receiving significantly more mentoring support than teachers in similar non-TAP (control) schools. This finding reflects the fact that under the Chicago TAP model, teachers are guided by mentor teachers, and cluster groups meet weekly. They also found that veteran teachers in Chicago TAP schools were more likely than their control group counterparts to provide mentoring support to their colleagues; this finding is consistent with the fact that under Chicago TAP, teachers have the opportunity to assume leadership roles and responsibilities as Chicago TAP mentor or lead teachers. Teachers in Chicago TAP schools (veteran and novice) were aware of their eligibility for performance-based compensation. The authors found that the amount of compensation they expected approached the amount that was eventually paid out; that is, the average expectation was about $900, and the actual amount paid out in bonuses to this group was an average of about $1,100 per teacher. They generally did not find evidence of an impact of Chicago TAP on teacher attitudes or school climate. While the introduction of Chicago TAP led to real changes inside the schools, the program did not consistently raise student achievement as measured by growth in Illinois Standards Achievement Test (ISAT) scores. The authors found evidence of both positive and negative test score impacts in selected subjects, years, and cohorts of schools, but overall there was no detectable impact on math, reading, or science achievement that was robust to different methods of estimation. For example, impacts on science scores overall (across years and cohorts) were positive, but not statistically significant unless they used one particular matching method that excluded some Chicago TAP schools from the analysis. The authors did find evidence suggesting that Chicago TAP increased schools' retention of teachers, although the impacts were not uniform or universal across years, cohorts, and subgroups of teachers. They found that teachers who were working in Chicago TAP schools in 2007 returned in each of the following three years at higher rates than teachers in comparable non-TAP schools. For example, the authors found that 67 percent of classroom teachers in cohort 1 schools in fall 2007 returned to their same school in fall 2010 compared to about 56 percent of teachers in non-TAP schools, an impact of nearly 12 percentage points. In other words, teachers in Chicago TAP schools in fall 2007 were about 20% more likely than teachers in comparison schools to be in those same schools three years later. When the authors looked at teachers who were working in schools that started Chicago TAP in later years, some of the impact estimates were not statistically significant. The authors also found some evidence of impacts on retention for subgroups of teachers, such as those with less experience, but the pattern of findings was not consistent. When they considered retention of teachers in the district, the authors did not find consistent evidence of a measurable impact. Given that Chicago TAP is a school-specific program, their main focus was on school-level retention, as opposed to retention in the district. Appended are: (1) Propensity Score Matching; and (2) Supplemental Tables. (Contains 32 tables, 6 figures and 27 footnotes.) [For related reports, see "An Evaluation of the Teacher Advancement Program (TAP) in Chicago: Year One Impact Report. Final Report" (ED507502) and "An Evaluation of the Teacher Advancement Program (TAP) in Chicago: Year Two Impact Report" (ED510712).]
Reviews of Individual Studies 4-8 2
Evaluation of Teach For America in Texas schools. (2012)
Reviews of Individual Studies 3-8 2
Charter school performance in New Jersey. (2012)
Reviews of Individual Studies 3-8 2
The impact of the NISL Executive Development Program on school performance in Massachusetts: Cohort 2 results. (2011)
School leaders are increasingly being asked, whether by rhetoric or policy, to measurably improve student achievement. The resultant need to assist school leaders in their ability to improve teaching and learning for all students in their schools led to the establishment of the National Institute of School Leadership's (NISL's) Executive Development Program. The NISL program emphasizes the role of principals as strategic thinkers, instructional leaders, and creators of a just, fair, and caring culture in which all students meet high standards. The current national focus on the importance of effective, instructional leadership has, in turn, led to calls for principal evaluation to be tied directly to student achievement (Davis, Kearney, Sanders, Thomas, and Leon, 2011). Within this milieu, effective and proven principal leadership development programs are crucial. (Contains 3 tables and 2 figures.) [This report was produced by the Center for Educational Partnerships, Old Dominion University.]
Reviews of Individual Studies 4-6 2
Can a mixed-method literacy intervention improve the reading achievement of low-performing elementary school students in an after-school program? Results from a randomized controlled trial of READ 180 enterprise. (2011)
The authors describe an independent evaluation of the READ 180 Enterprise intervention designed by Scholastic, Inc. Despite widespread use of the program with upper elementary through high school students, there is limited empirical evidence to support its effectiveness. In this randomized controlled trial involving 312 students enrolled in an after-school program, the authors generated intention-to-treat and treatment-on-the-treated estimates of the program's impact on several literacy outcomes of fourth, fifth, and sixth graders reading below proficiency on a state assessment at baseline. READ 180 Enterprise students outperformed control group students on vocabulary (d = 0.23) and reading comprehension (d = 0.32) but not on spelling and oral reading fluency. The authors interpret the findings in light of the theory of instruction underpinning the READ 180 Enterprise intervention. (Contains 2 figures, 7 tables, and 4 notes.)
Reviews of Individual Studies 4-6 2
What works in afterschool programs: The impact of a reading intervention on student achievement in the Brockton Public Schools (phase II). (2008)
Reviews of Individual Studies 3-8 2
Use of a progress monitoring system to enable teachers to differentiate mathematics instruction. (2007)
We explored how a progress monitoring and instructional management system can be used to help educators differentiate instruction and meet the wide-ranging learning needs of their increasingly diverse classrooms. We compared classrooms in 24 states that used a curriculum-based progress monitoring and instructional management system, Accelerated Math, to same school control classrooms that did not use it. Among the major findings were the following: (1) At every grade level there were large differences in grade equivalent score and percentile gains for students in the experimental and control classrooms; (2) Gains were experienced across the achievement spectrum. An analysis of low-, middle-, and high-achieving students showed consistent rates of gain for each math objective mastered; (3) Intervention integrity had a significant effect on student achievement; (4) Teachers using the progress monitoring and instructional management system spent more time providing individual versus group instruction and felt better able to meet the individual needs of their students; and (5) Significantly more students who were in classrooms where teachers used the progress monitoring and instructional management system reported that they like math, help each other with math, and like math better this year than last year. Addition of a progress monitoring and instructional management system to ongoing mathematics instruction improves mathematics outcomes for students. The effects of the program clearly are a function of intervention integrity; when progress monitoring and instructional management practices are implemented with high fidelity or integrity, the mathematics performance of all students is significantly enhanced. Implications for practice are discussed.
Reviews of Individual Studies 4-5 3
The effects of a paraphrasing and text structure intervention on the main idea generation and reading comprehension of students with reading disabilities in grades 4 and 5. (2020)
This study examined the effects of a small group intervention targeting paraphrasing and text structure instruction on the main idea generation and reading comprehension of students with reading disabilities in Grades 4 and 5. Students (N = 62) were randomly assigned to receive the Tier 2-type intervention or business-as-usual instruction. Students in the intervention received 25, 40-minute lessons focused on paraphrasing sections of text by identifying the main topic and the most important idea about that topic. Students utilized the text structure organization to inform their main idea generation. Results yielded statistically significant, positive effects in favor of the intervention group on near-transfer and mid-transfer measures of text structure identification (g = 0.75) and main idea generation (g = 0.70), but no statistically significant effect on a far-transfer measure of reading comprehension. These findings provide initial support for utilizing this instruction to improve students' main idea generation on taught and untaught structures.
Reviews of Individual Studies 4-5 3
Replication of an experimental study investigating the efficacy of a multisyllabic word reading intervention with and without motivational beliefs training for struggling readers. (2019)
This randomized control trial examined the efficacy of an intervention aimed at improving multisyllabic word reading (MWR) skills among fourth- and fifth-grade struggling readers (n = 109, 48.6% male), as well as the relative effects of an embedded motivational beliefs training component. This study was a closely aligned replication of our earlier work. The intervention was replicated with a three-condition design: MWR only, MWR with a motivational beliefs component, and business-as-usual control. Students were tutored in small groups for 40 lessons (four 40-min lessons each week). When we combined performance of students in both MWR conditions, intervention students significantly outperformed controls on proximal measures of affix reading and MWR, as well as standardized measures of decoding, spelling, and text comprehension. Furthermore, there was a noted interaction between English learner status and treatment on spelling performance. There were no statistically significant main effects between the MWR groups on proximal or standardized measures of interest. Findings are discussed in terms of their relevance to MWR instruction for students with persistent reading difficulties and considerations for future research related to the malleability of motivation.
Reviews of Individual Studies 4-5 3
Efficacy of a word- and text-based intervention for students with significant reading difficulties. (2019)
We examine the efficacy of an intervention to improve word reading and reading comprehension in fourth- and fifth-grade students with significant reading problems. Using a randomized control trial design, we compare the fourth- and fifth-grade reading outcomes of students with severe reading difficulties who were provided a researcher-developed treatment with reading outcomes of students in a business-as-usual (BAU) comparison condition. A total of 280 fourth- and fifth-grade students were randomly assigned within school in a 1:1 ratio to either the BAU comparison condition (n = 139) or the treatment condition (n = 141). Treatment students were provided small-group tutoring for 30 to 45 minutes for an average of 68 lessons (mean hours of instruction = 44.4, SD = 11.2). Treatment students performed statistically significantly higher than BAU students on a word reading measure (effect size [ES] = 0.58) and a measure of reading fluency (ES = 0.46). Though not statistically significant, effect sizes for students in the treatment condition were consistently higher than BAU students for decoding measures (ES = 0.06, 0.08), and mixed for comprehension (ES = -0.02, 0.14).
Reviews of Individual Studies K-8 3
Promoting cultural responsivity and student engagement through double check coaching of classroom teachers: An efficacy study (2018)
This article presents findings from a randomized controlled trial (RCT) testing the impact of a novel coaching approach utilized as one element of the Double Check cultural responsivity and student engagement model. The RCT included 158 elementary and middle school teachers randomized to receive coaching or serve as comparisons; all participating teachers were exposed to school-wide professional development activities. Pre-post nonexperimental comparisons indicated improvements in self-reported culturally responsive behavior management and self-efficacy for teachers in both conditions following professional development exposure. With regard to the experimental findings, trained observers recorded significantly more proactive behavior management and anticipation of student problems by teachers, higher student cooperation, less student noncooperation, and fewer disruptive behaviors in classrooms led by coached teachers relative to comparison teachers. Taken together, the findings suggest the potential promise of coaching combined with school-wide professional development for improving classroom management practices and possibly reducing office discipline referrals among Black students.
Reviews of Individual Studies K-6 3
Class-Wide Function-Related Intervention Teams "CW-FIT": Outcomes from a Multi-Site Randomized Replication Trial (2017)
The purpose of the study was to conduct a randomized controlled trial (RCT) to demonstrate efficacy of the Class-wide Function-Related Intervention Teams (CW-FIT) program. The study was designed to replicate an initial RCT conducted by the CW-FIT developers in 1 site, with 2 additional research groups not involved in its development. The study was conducted across 3 states, in 21 culturally diverse schools, and with 83 teachers (classrooms) assigned to CW-FIT and 74 teachers (classrooms) assigned to the comparison group. The CW-FIT intervention included teaching prosocial skills and use of differential attention (teacher praise and points) for appropriate behaviors using a group contingency, class teams, goal setting, points, and rewards. Class-wide student on-task behavior improved, teacher praise and attention to appropriate behaviors increased, and reprimands decreased in the CW-FIT classes with significantly fewer changes over time for the comparison group.
Reviews of Individual Studies 2-5 3
A Randomized Controlled Trial of a School-Implemented School–Home Intervention for Attention-Deficit/Hyperactivity Disorder Symptoms and Impairment (2016)
Objectives: This study evaluated the efficacy of a novel psychosocial intervention (Collaborative Life Skills, CLS) for primary-school students with ADHD symptoms. CLS is a 12-week program consisting of integrated school, parent, and student treatments delivered by school-based mental health providers. Using a cluster randomized design, CLS was compared to usual school/community services on psychopathology and functional outcomes. Methods: Schools within a large urban public school district were randomly assigned to CLS (12 schools) or usual services (11 schools). Approximately six students participated at each school (N = 135, mean age = 8.4 years, grade range = 2nd-5th, 71% boys). Using PROC GENMOD (SAS 9.4) the difference between the means of CLS and usual services for each outcome at post-treatment was tested. To account for clustering effects by school, the Generalized Estimating Equation method was used. Results: Students from schools assigned to CLS, relative to those assigned to usual services, had significantly greater improvement on parent and teacher ratings of ADHD symptom severity and organizational functioning, teacher-rated academic performance and parent ratings of ODD symptoms and social/interpersonal skills. Conclusions: These results support the efficacy of CLS relative to typical school and community practices for reducing ADHD and ODD symptoms and improving key areas of functional impairment. They further suggest that existing school-based mental health resources can be re-deployed from non-empirically supported practices to those with documented efficacy. This model holds promise for improving access to efficient, evidence-based treatment for inattentive and disruptive behavior beyond the clinic setting. [This article was published in the "Journal of the American Academy of Child and Adolescent Psychiatry," v55 p762-770 2016.]
Reviews of Individual Studies 3-8 3
Does teacher evaluation improve school performance? Experimental evidence from Chicago’s Excellence in Teaching Project (2015)
Chicago Public Schools initiated the Excellence in Teaching Project, a teacher evaluation program designed to increase student learning by improving classroom instruction through structured principal-teacher dialogue. The pilot began in forty-four elementary schools in 2008-09 (cohort 1) and scaled up to include an additional forty-eight elementary schools in 2009-10 (cohort 2). Leveraging the experimental design of the roll-out, cohort 1 schools performed better in reading and math than cohort 2 schools at the end of the first year, though the math effects are not statistically significant. We find the initial improvement for cohort 1 schools remains even after cohort 2 schools adopted the program. Moreover, the pilot differentially impacted schools with different characteristics. Higher-achieving and lower-poverty schools were the primary beneficiaries, suggesting the intervention was most successful in more advantaged schools. These findings are relevant for policy makers and school leaders who are implementing evaluation systems that incorporate classroom observations.
Reviews of Individual Studies 4-6 3
A randomized experiment of a mixed-methods literacy intervention for struggling readers in grades 4–6: Effects on word reading efficiency, reading comprehension and vocabulary, and oral reading fluency. (2010)
The purpose of this study was (1) to examine the causal effects of READ 180, a mixed-methods literacy intervention, on measures of word reading efficiency, reading comprehension and vocabulary, and oral reading fluency and (2) to examine whether print exposure among children in the experimental condition explained variance in posttest reading scores. A total of 294 children in Grades 4-6 were randomly assigned to READ 180 or a district after-school program. Both programs were implemented 4 days per week over 23 weeks. Children in the READ 180 intervention participated in three 20-min literacy activities, including (1) individualized computer-assisted reading instruction with videos, leveled text, and word study activities, (2) independent and modeled reading practice with leveled books, and (3) teacher-directed reading lessons tailored to the reading level of children in small groups. Children in the district after-school program participated in a 60-min program in which teachers were able to select from 16 different enrichment activities that were designed to improve student attendance. There was no significant difference between children in READ 180 and the district after-school program on norm-referenced measures of word reading efficiency, reading comprehension, and vocabulary. Although READ 180 had a positive impact on oral reading fluency and attendance, these effects were restricted to children in Grade 4. Print exposure, as measured by the number of words children read on the READ 180 computer lessons, explained 4% of the variance in vocabulary and 2% of the variance in word reading efficiency after all pretest reading scores were partialed out.
Reviews of Individual Studies 1-4 3
A final report for the evaluation of Renaissance Learning’s Accelerated Reader Program. (2010)
Reviews of Individual Studies 4-5 3
Benefits of repeated reading intervention for low-achieving fourth- and fifth-grade students. (2008)
Many students have difficulty achieving reading fluency, and nearly half of fourth graders are not fluent readers in grade-level texts. Intensive and focused reading practice is recommended to help close the gap between students with poor fluency and their average reading peers. In this study, the "Quick Reads" fluency program was used as a supplemental fluency intervention for fourth and fifth graders with below-grade-level reading skills. "Quick Reads" prescribes a repeated reading procedure with short nonfiction texts written on grade-appropriate science and social science topics. Text characteristics are designed to promote word recognition skills. Students were randomly assigned to "Quick Reads" instruction that was implemented by trained paraeducator tutors with pairs of students for 30 minutes per day, 4 days per week, for 18 weeks. At posttest, "Quick Reads" students significantly outperformed classroom controls in vocabulary, word comprehension, and passage comprehension. Fluency rates for both treatment and control groups remained below grade level at posttest. (Contains 5 tables.)
Reviews of Individual Studies 4-8 3
Reading comprehension: Effects of individualized, integrated language arts as a reading approach with struggling readers (2008)
This study examined the effects of individualized, integrated language arts as a reading approach on struggling readers' comprehension scores obtained from oral narrative, silent narrative, and silent expository passages at three levels: below-grade, on-grade, and above-grade levels. Students (N = 93) in grades four through eight, who were reading below grade level, participated in the study. Treatment group students (n = 51) received individualized, integrated language arts as a reading approach once a week in place of basal reading instruction. Comparison group students (n = 42) received basal reading instruction for the duration of the study. Multivariate analysis of covariance was used to analyze posttest Analytical Reading Inventory (ARI) comprehension scores. Several statistically significant (p less than 0.001) differences in comprehension performance were found for on-grade-level scores and for above-grade-level scores, but few differences were found between treatment and comparison groups on below-grade-level scores. All statistically significant differences favored students in the treatment group. The findings of the study strongly suggest that the use of individualized, integrated language arts as a method for teaching reading is an effective approach for improving the reading comprehension performance of struggling readers. (Contains 5 tables.)
Reviews of Individual Studies 3-4 3
Learning science in grades 3–8 using probeware and computers: Findings from the TEEMSS II project. (2008)
The Technology Enhanced Elementary and Middle School Science II project (TEEMSS), funded by the National Science Foundation, produced 15 inquiry-based instructional science units for teaching in grades 3-8. Each unit uses computers and probeware to support students' investigations of real-world phenomena using probes (e.g., for temperature or pressure) or, in one case, virtual environments based on mathematical models. TEEMSS units were used in more than 100 classrooms by over 60 teachers and thousands of students. This paper reports on cases in which groups of teachers taught science topics without TEEMSS materials in school year 2004-2005 and then the same teachers taught those topics using TEEMSS materials in 2005-2006. There are eight TEEMSS units for which such comparison data are available. Students showed significant learning gains for all eight. In four cases (sound and electricity, both for grades 3-4; temperature, grades 5-6; and motion, grades 7-8) there were significant differences in science learning favoring the students who used the TEEMSS materials. The effect sizes are 0.58, 0.94, 1.54, and 0.49, respectively. For the other four units there were no significant differences in science learning between TEEMSS and non-TEEMSS students. We discuss the implications of these results for science education.
Reviews of Individual Studies 4-8 3
Effect of a combined repeated reading and question generation intervention on reading achievement. (2006)
Research was conducted to ascertain if a combined repeated reading and question generation intervention was effective at improving the reading achievement of fourth through eighth grade students with learning disabilities or who were at risk for reading failure. Students were assigned to a treatment or control group via a stratified random sampling. Instructional components and training were based on best practices reported in the literature. Students receiving intervention significantly improved their reading speed and ability to answer inferential comprehension questions on passages that were reread. Compared to the control group, students in the intervention group also made significant gains in oral reading fluency on independent passages.
Reviews of Individual Studies K-4 3
Progress report of the randomized trial of Positive Action in Hawaii: End of third year of intervention. (2006)
Reviews of Individual Studies K-8 3
The Teacher Advancement Program report two: Year three results from Arizona and year one results from South Carolina TAP schools. (2004)
Reviews of Individual Studies 3-5 3
The impact of a computer-based training system on strengthening phonemic awareness and increasing reading ability level (Doctoral dissertation). (2003)
Reviews of Individual Studies 1-6 3
Long-Term Effects of the Positive Action Program. (2003)
Used a matched-schools design, school-level achievement, and disciplinary data to evaluate the effectiveness of the elementary-level Positive Action program on students' performance and behavior over time. Results indicated that program participation improved student behavior, school involvement, and academic achievement into high school. The program had equally strong behavioral effects in higher risk schools. There was a clear dose-response relationship for most outcomes. (SM)
Reviews of Individual Studies 4-11 -1
Unconditional Education Year 1 Evaluation Report. (n.d.)
Reviews of Individual Studies 1-12 -1
Multiple choice: Charter school performance in 16 states. (June 2009)
Reviews of Individual Studies 3-8 -1
The New York City Aspiring Principals Program: A school-level evaluation. (August 2009)
Reviews of Individual Studies 4-8 -1
Final Report of the i3 Evaluation of the Collaboration and Reflection to Enhance Atlanta Teacher Effectiveness (CREATE) Teacher Residency Program (2021)
Reviews of Individual Studies 1-12 -1
The effects of the Louisiana Scholarship Program on student achievement and college entrance. (2021)
The Louisiana Scholarship Program (LSP) offers publicly funded vouchers to moderate- and low-income students in low-performing public schools to enroll in participating private schools. Established in 2008 as a pilot program in New Orleans, the LSP expanded statewide in 2012. Drawing upon the random lotteries that placed students in LSP schools, we estimate the causal impact of using an LSP voucher to enroll in a private school on student achievement on the state accountability assessments in math, English Language Arts, and science over a four-year period, as well as on the likelihood of enrolling in college. The results from our primary analytic sample indicate substantial negative achievement impacts, especially in math, that diminish after the first year but persist after four years. In contrast, when considering the likelihood of students entering college, we observe no statistically significant difference between scholarship users and their control counterparts.
Reviews of Individual Studies 1-4 -1
Comparing Technology-Based Reading Intervention Programs in Rural Settings (2021)
Reviews of Individual Studies 1-8 -1
Literacy Design Collaborative 2018-2019 Evaluation Report for New York City Department of Education (2020)
The Literacy Design Collaborative (LDC) was created to support teachers in implementing college and career readiness standards in order to teach literacy skills throughout the content areas. Teachers work collaboratively with coaches to further develop their expertise and design standards-driven, literacy-rich writing assignments within their existing curriculum across all content areas. This report presents the results on implementation of LDC in the New York City Department of Education during the third year of the intervention, and the impact of the program across multiple years. As of 2018-2019, participating schools included 13 from Cohort 1, which began implementation during the 2016-2017 school year, and 23 from Cohort 2, which commenced at the beginning of the 2017-2018 school year. Our primary impact analyses, presented in this report for the first time, pool teachers from both cohorts to measure their impact after participating in LDC for 2 consecutive years (2017-2018 student outcomes for Cohort 1 and 2018-2019 student outcomes for Cohort 2). Teachers and administrators appreciated LDC and perceived positive impact on their practice and their students' learning. Quasi-experimental analyses tended to produce positive estimates for the impact of LDC on student English language arts (ELA) assessment scores, but the differences did not reach the level of statistical significance. [For the 2017-2018 evaluation report, see ED606884.]
Reviews of Individual Studies 4-8 -1
Literacy Design Collaborative 2018-2019 evaluation report (CRESST Report 867). (2020)
Engaged in the evaluation of LDC tools since June 2011, UCLA's National Center for Research on Evaluation, Standards, and Student Testing (CRESST) is using multiple data sources and a quasi-experimental design to examine LDC implementation and impact in two cohorts of schools in two large, urban school districts. This report presents the results on implementation of LDC in the large urban school district on the West Coast during the third year of the intervention, and the impact of the program across multiple years. Findings from both participant surveys and analyses of student outcomes reveal positive results for the LDC intervention. Analysis of student outcomes provided evidence of the program's effectiveness and confirmation for participants' positive views. Quasi-experimental analyses demonstrated a statistically significant positive impact of LDC as practiced by middle school teachers with 2 years of program experience across two cohorts of schools and teachers. A statistically significant positive impact was also found for Cohort 2 middle schools after just one year of implementation. [For the 2017-2018 report, see ED600053.]
Reviews of Individual Studies 4-5 -1
Final Report of the i3 Impact Study of Making Sense of SCIENCE, 2016-17 through 2017-18 (2020)
Science education has experienced a significant transition over the last decade, catalyzed by a re-envisioning of what students should know and be able to do in science. That re-envisioning culminated in the release of the Next Generation Science Standards (NGSS) in 2013. The new standards set off a chain reaction of standards adoption and implementation across states, districts, and schools, including steps taken toward transforming science professional learning, instruction, curriculum, and assessment. It was in this dynamic context that Empirical Education conducted an impact evaluation, as part of an Investing in Innovation (i3) grant, of WestEd's Making Sense of SCIENCE project, a teacher professional learning model aimed at raising students' science achievement through improving science instruction. Under this grant, WestEd and Empirical Education also partnered with Heller Research Associates (HRA) to conduct an implementation study and a scale-up study of Making Sense of SCIENCE. The impact evaluation, which is the focus of this report, was a two-year cluster-randomized control trial (RCT) that took place in California and Wisconsin across seven school districts and 66 elementary schools in the 2016-17 and 2017-18 school years. The study randomized schools to either receive the Making Sense of SCIENCE professional learning or to the business-as-usual ("control") group, which received the professional learning (delayed-treatment) after the study ended. The study found that Making Sense of SCIENCE had a positive impact on teacher content knowledge (effect size = 0.56, p = 0.006) and a positive impact on a holistic scale of teacher pedagogical content knowledge (effect size = 0.41, p = 0.026). The study also yielded positive and significant impacts on the amount of time teachers spent on science instruction (effect size = 0.40, p = 0.015) and on the emphasis that teachers placed on NGSS-aligned instructional practices, with statistically significant effect sizes ranging from 0.40 to 0.49. This suggestive evidence that Making Sense of SCIENCE changes classroom science learning experiences in ways that align with expectations in NGSS, which is a hypothesized precursor to measuring impacts on student achievement, deserves notice. In regard to student science achievement, the study did not find statistically significant results for the full sample of students (effect size = 0.06, p = 0.494), or for the sample of students in the bottom third of incoming math and English Language Arts achievement, with effect sizes of 0.22 (p = 0.099) and 0.073 (p = 0.567), respectively. Notably, with the exception of one negative effect size, additional analyses on student achievement using different measures and samples yielded positive, but not statistically significant, effect sizes ranging from 0.02 to 0.12. Evaluators offer three potential contributors to the findings of limited impact on student science achievement. First, given the timing of the study in relation to the release of the NGSS in 2013, finding a suitable NGSS-aligned student science assessment was a challenge. Second, most study schools and districts had not yet adopted NGSS-aligned curricula and did not have access to NGSS-aligned curriculum resources. Third, the sample of teachers was unstable across the two years, with the percentage of teachers leaving the school congruous to the percentage observed at the national level. [For the appendices, see ED609254; for the research summary, see ED609256.]
Reviews of Individual Studies 4-5 -1
The Evaluation of the Enhanced Positive School Climate Model (2020)
Purpose: The Santa Ana Unified School District received an i3 grant (Investing in Innovation; funded by the U.S. Department of Education Grant number U411C160074) to build on their existing school climate practices. Called the Enhanced Positive School Climate Model, the aim is to improve school climate, student-adult relationships, create social emotional learning programs, and provide students the needed structure to access challenging curriculum and expectations. As part of this enhanced model, School Climate Liaisons (SCLs) were hired to support and provide coaching to schools in the intervention group on PBIS [Positive Behavioral Intervention and Supports], RP [Restorative Practice] implementation, and behavioral interventions. As part of the i3 grant requirements, the district employed a rigorous cluster-randomized trial whereby half of the district's elementary schools were assigned to receive the Enhanced Positive School Climate Model and half were assigned to a waitlist control. The confirmatory research question is: Do students in grades 4 and 5 at follow-up, in schools assigned to receive support from PBIS and Restorative Practice school climate specialists and community liaisons, who receive services for two years, exhibit higher levels of self-management at the end of the second year, as compared to students in grades 4 and 5 in schools assigned to not receive such support? Additionally, there were exploratory research questions examining changes in other SEL [social-emotional learning] measures including growth mindset, self-efficacy, and social awareness. Methods: This study employed a cluster-randomized controlled design whereby half of the study schools were assigned to the treatment condition and the other half of schools were assigned to the "business as usual" control condition. In total, 35 schools (30 K-5 schools; 5 K-8 schools) were randomly assigned to either the treatment or control condition. All students within these schools were included in the evaluation. Students in the treatment schools (n = 17) were eligible to receive services through the grant. Randomization occurred in May 2017. The 2016-17 school year served as a baseline school year (i.e., no services were provided). The Enhanced Positive School Climate Model began in the 2017-18 school year and continued into the 2018-19 school year for treatment schools only. Control schools were waitlisted and began receiving services in the 2019-20 school year. Students enrolled in district schools in May 2017 were tracked using student roster information through the end of the 2018-19 school year. Only students who were in study schools continuously from the 2016-2017 to 2018-2019 school years were included in the impact analysis. The confirmatory and exploratory outcomes referenced below were conducted using extant data from the district. Data were used from routine data collection processes within the district from the annual CORE climate student survey. The primary outcome measure was the five-item self-management scale on the CORE District's student survey (Taylor, Oberle, Durlak, & Weissberg, 2017; Transforming Education, 2014; https://www.rand.org/education-and-labor/projects/assessments/tool/2014/panorama-social-emotional-learning-questionnaire-measures.html) asked of all students in grades 4-12 each year. For the confirmatory research question (and all exploratory questions), adjusted post-intervention outcomes for students in treatment schools were compared to the outcomes for their counterparts in the control schools. This involved fitting conditional multilevel regression models (i.e., hierarchical linear modeling [HLM]), with additional terms to account for the nesting of individuals within schools (see Goldstein 1987; Raudenbush & Bryk, 2002; Murray 1998). Results: Eight two-level models were estimated per grade level to address the confirmatory and exploratory research questions. Although the students in treatment schools had slightly higher self-management, growth mindset and self-efficacy scores at follow-up, only the difference in fourth grade self-efficacy scores was statistically significant. In contrast, students in control schools had very slightly higher social awareness scores; this finding was not statistically significant. Implications: Meaningful and statistically significant differences were not found between students who attended schools that received the Enhanced Positive School Climate Model compared to their peers in schools that did not receive the Enhanced Positive School Climate Model. The lack of findings may be due to the other changes in school climate practices throughout the district during the study period. Additionally, variations in the implementation of the Enhanced Positive School Climate Model may have contributed to the lack of findings. Although the findings are not significant, the direction of results is mostly consistent, indicating increases in SEL competencies for students receiving additional school climate supports. Future studies should continue to investigate the relationship between whole-school approaches to school climate and changes in SEL competencies for students.
Reviews of Individual Studies 4-5 -1
The Impact of Adaptive, Web-Based, Scaffolded Silent Reading Instruction on the Reading Achievement of Students in Grades 4 and 5 (2019)
This randomized controlled trial examined the impact of adaptive, web-based, scaffolded silent reading instruction on 426 fourth- and fifth-grade students in an urban US school district. Reading proficiency was evaluated in the fall and spring using the Group Reading Assessment Diagnostic Evaluation (GRADE) and an eye movement recording system (Visagraph). Fall GRADE scores and demographic factors were used to pair students. One member of each pair was then randomly assigned to the treatment or control condition and their pair to the alternate condition. During scheduled 25-minute supplemental literacy blocks, students in the control group received "business-as-usual" reading instruction, whereas the treatment group engaged in scaffolded silent reading instruction. Structural equation modeling indicated that scaffolded silent reading instruction produced significantly larger gains on measures of reading efficiency in grade 4 and significantly larger gains on the GRADE reading achievement measures in grade 5. Implications for practice and future research are discussed.
Reviews of Individual Studies 4-7 -1
Evaluation of the Teacher Potential Project (2019)
This study assesses the implementation and impacts of the Teacher Potential Project (TPP), a program designed by EL Education and which includes an English language arts (ELA) standards-aligned curriculum and embedded professional development for teachers. The study uses a randomized controlled trial (RCT) design to assess the impacts of TPP on the instructional practice outcomes of ELA teachers in grades 3 through 8 and the ELA achievement outcomes of their students. The RCT includes 70 elementary and middle schools (35 treatment and 35 control) in 18 relatively high-need districts that were randomly assigned to treatment and control conditions within matched pairs of schools in three cohorts that began participating in the 2014-2015, 2015-2016, and 2016-2017 school years. Treatment schools engaged in TPP for one year while control schools continued with business as usual. The study also uses a two-year quasi-experimental design (QED) study to assess the impact of extending implementation of TPP to a second year on teacher instructional practice and student ELA achievement outcomes. EL Education recruited 22 of the study schools (10 treatment and 12 control) in five districts in one cohort to participate in a second year of the study. The study team collected a variety of data for the evaluation of TPP, including teacher surveys and classroom observations administered in fall and spring each year and student administrative records. Impacts of TPP on ELA teacher instructional practices and student ELA achievement were estimated using multivariate regression methods. The implementation evaluation found that the TPP ELA curriculum was implemented in all schools, and that there was generally high school-level implementation fidelity of the TPP professional development components in the first and second years of TPP among the novice ELA teachers. The impact evaluation found positive impacts of TPP on ELA teachers' overall instructional practices after one year compared to teachers who used their district-provided curriculum and participated in their district's professional development supports. After two years of teacher participation, impacts on their students' ELA achievement were roughly equivalent to 1.4 months of typical student improvement, or moving an average student scoring at the 50th percentile to the 54th percentile. The findings be useful to districts and policymakers aiming to support teachers and students in the context of rigorous state standards such as the Common Core State Standards (CCSS). The study of TPP makes several important contributions to the literature evaluating paired curriculum and PD programs: it uses rigorous group designs, evaluates the impact of one and two years of program implementation, and examines broad outcomes on both teacher instructional practice and student ELA achievement. [This report was submitted by Mathematica to EL Education.]
Reviews of Individual Studies K-12 -1
A state-wide quasi-experimental effectiveness study of the scale-up of school-wide Positive Behavioral Interventions and Supports (2019)
The three-tiered Positive Behavioral Interventions and Supports (PBIS) framework promotes the development of systems and data analysis to guide the selection and implementation of evidence based practices across multiple tiers. The current study examined the effects of universal (tier 1) or school-wide PBIS (SW-PBIS) in one state's scale-up of this tier of the framework. Annual propensity score weights were generated to examine the longitudinal effects of SW-PBIS from 2006–07 through 2011–12. School-level archival and administrative data outcomes were examined using panel models with an autoregressive structure. The sample included 1316 elementary, middle, and high schools. Elementary schools trained in SW-PBIS demonstrated statistically significantly lower suspensions during the fourth and fifth study years (i.e., small effect size) and higher reading and math proficiency rates during the first two study years as well as in one and two later years (i.e., small to large effect sizes), respectively. Secondary schools implementing SW-PBIS had statistically significantly lower suspensions and truancy rates during the second study year and higher reading and math proficiency rates during the second and third study years. These findings demonstrate medium effect sizes for all outcomes except suspensions. Given the widespread use of SW-PBIS across nearly 26,000 schools in the U.S., this study has important implications for educational practices and policies.
Reviews of Individual Studies 4-8 -1
Literacy Design Collaborative 2017–2018 evaluation report for New York City Department of Education (2019)
Reviews of Individual Studies 4-11 -1
The Next Generation of State Reforms to Improve their Lowest Performing Schools: An Evaluation of North Carolina's School Transformation Initiative (2019)
In contrast to prior federally mandated school reforms, the Every Student Succeeds Act (ESSA) allows states more discretion in reforming their lowest performing schools, removes requirements to disrupt the status quo, and does not allocate substantial additional funds. Using a regression discontinuity design, we evaluate a state turnaround initiative aligned with ESSA requirements. We find the effect on student test score growth was not significant in year one and -0.13 in year two. Also in year two, we find that teachers in turnaround schools were 22.5 percentage points more likely to turn over. Teacher turnover appears to have been voluntary rather than the result of strategic staffing decisions.
Reviews of Individual Studies 4 -1
Efficacy Study of the Science Notebook in a Universal Design for Learning Environment: Preliminary Findings (2019)
The Science Notebook in a Universal Design for Learning Environment (SNUDLE) is a digital notebook that uses the Universal Design for Learning framework to support active science learning among elementary school students, particularly those who struggle with reading and writing or are unmotivated to learn science. Preliminary findings from the first of a two-year randomized control trial suggest no significant impact on motivation or academic achievement in science among the full sample of fourth graders receiving the SNUDLE intervention. Moderator analysis indicates significant positive interaction effects of the intervention on motivation in science and science content assessments among students with learning disabilities.
Reviews of Individual Studies 2-4 -1
MindPlay Virtual Reading Coach: Does It Affect Reading Fluency in Elementary School? (2019)
Important strides have been made in the science of learning to read. Yet, many students still struggle to attain reading proficiency. This calls for sustained efforts to bridge theoretical insights with applied considerations about ideal pedagogy. The current study was designed to contribute to this conversation, namely by looking at the efficacy of an online reading program. The chosen reading program, referred to as MindPlay Virtual Reading Coach (MVRC), emphasizes the mastery of basic reading skills to support the development of reading fluency. Its focus on basic skills diverges from the goal of increasing reading motivation. And its focus on reading fluency, vs. broad literacy achievement, offers an alternative to already existing reading enrichment. In order to test the efficacy of MVRC, we recruited three school districts. One district provided data from elementary schools that used the MVRC program in Grades 2 to 6 (N = 2,531 total). The other two districts participated in a quasi-experimental design: Six 2nd-grade classrooms and nine 4th-grade classrooms were randomly assigned to one of three conditions: (1) instruction as usual, (2) instruction with an alternative online reading program, and (3) instruction with MVRC. Complete data sets were available from 142 2nd-graders and 172 4th-graders. Three assessments from the MVRC screener were used: They assessed reading fluency, phonic skills, and listening vocabulary at two time points: before and after the intervention. Results show a clear advantage of MVRC on reading fluency, more so than on phonics or listening vocabulary. At the same time, teachers reported concerns with MVRC, highlighting the challenge with reading programs that emphasize basic-skills mastery over programs that seek to encourage reading.
Reviews of Individual Studies PK-12 -1
Parents at the Center: Final Parent Leadership Institute Evaluation Report (2019)
The Parent Leadership Institute (PLI) of Children's Aid (CA), funded via a 2013 Investing in Innovation (i3) development grant operated between the 2014-15 through 2018-19 school years. Key goals of the PLI included: (1) improving the capacity of parents to effectively engage in the school community in support of their child; and (2) increasing the capacity of school staff to create and support environments which are welcoming to and supportive of the active engagement of parents as key members of the school community. Through implementation of the PLI, CA expanded its partnership with six schools located in the South Bronx community of Morrisania, an area characterized by high levels of poverty, health disparities, and crime, and low levels of academic achievement and attainment among both children and adults. This report serves as the final report on this phase of the PLI and includes an exploration of implementation during year 4 (2016-17 school year) and analyses of quantitative data on student academic performance. [This report was prepared for Children's Aid New York.]
Reviews of Individual Studies K-8 -1
Can we increase attendance and decrease chronic absenteeism with a universal prevention program? A randomized control study of attendance and truancy universal procedures and interventions (2018)
The purpose of this study was to examine the effects of a school-wide attendance and truancy intervention and universal procedures (ATI-UP) on student attendance. Student attendance was measured through average daily attendance and the percentage of students who would be considered chronically absent, i.e., missing 10% or more of school. The sample included 27 elementary schools in Oregon implementing school-wide positive behavior intervention and supports (SWPBIS) with varying levels of fidelity. Results indicate that schools can have a moderate effect on increasing average daily attendance (ADA) and a small effect on decreasing chronic absenteeism, although these results were not statistically significant. SWPBIS implementation did not act as a statistically significant moderator on the ATI-UP effects, although the treatment effect on ADA decreased with higher SWPBIS implementation. [The dissertation citations contained here are published with the permission of ProQuest LLC. Further reproduction is prohibited without permission. Copies of dissertations may be obtained by Telephone (800) 1-800-521-0600. Web page: http://www.proquest.com/en-US/products/dissertations/individuals.shtml.]
Reviews of Individual Studies K-5 -1
Teacher coaching supported by formative assessment for improving classroom practices (2018)
The present study is a wait-list controlled, randomized study investigating a teacher coaching approach that emphasizes formative assessment and visual performance feedback to enhance elementary school teachers' classroom practices. The coaching model targeted instructional and behavioral management practices as measured by the Classroom Strategies Assessment System (CSAS) Observer and Teacher Forms. The sample included 89 general education teachers, stratified by grade level, and randomly assigned to 1 of 2 conditions: (a) immediate coaching, or (b) waitlist control. Results indicated that, relative to the waitlist control, teachers in immediate coaching demonstrated significantly greater improvements in observations of behavior management strategy use but not for observations of instructional strategy use. Observer- and teacher-completed ratings of behavioral management strategy use at postassessment were significantly improved by both raters; ratings of instructional strategy use were significantly improved for teacher but not observer ratings. A brief coaching intervention improved teachers' use of observed behavior management strategies and self-reported use of behavior management and instructional strategies.
Reviews of Individual Studies 3-10 -1
Impact Evaluation of "INSPIRE: Infusing Innovative STEM Practices into Rigorous Education" (2018)
"INSPIRE" is an Investing in Innovation (i3) development grant funded by the Office of Innovation and Improvement, U.S. Department of Education. "INSPIRE" provides an innovative integrated K-12 STEM pipeline approach focused on STEM course content and instructional redesign. The INSPIRE model was implemented in Cabarrus County Schools (CCS), which is among the largest school systems in North Carolina, serving nearly 30,000 students in 39 schools. The impact evaluation included two studies that examined the effect of INSPIRE on mathematics and science achievement as measured by North Carolina standardized End-of-Grades assessments. The elementary study (Study 1) used a three-year, longitudinal, single-cohort quasi-experimental design (QED) to assess the impact of INSPIRE on math achievement at the end of 5th grade after two years of program exposure. The secondary study (Study 2) used an individual-level, longitudinal, randomized controlled trial (RCT) with blocking by school level and cohort to assess the effects of INSPIRE on math and science achievement at the end of 7th and 10th grades after two years of program exposure. For both studies, we compared the outcomes of INSPIRE students with similar students from schools that did not offer a STEM program. For the elementary study, propensity score matching (PSM) was used to match INSPIRE elementary students and comparison student samples at baseline (on pre-test math achievement scores, gender, minority status, and economically disadvantaged status) and baseline equivalence was established all pre-test assessment measures; this study met What Works Clearinghouse (WWC) Group Design Standards with Reservations. For the secondary study, the overall and differential attrition rates were low based on the WWC attrition standards (WWC, 2017); this study met WWC Group Design Standards without Reservations. The results of the elementary study indicated a statistically significant difference between the "INSPIRE" treatment group and the business-as-usual comparison group on the math achievement outcome. Comparison students reported a statistically significant higher increase in math achievement than "INSPIRE" students. Results of the secondary study indicated no statistically significant difference between the "INSPIRE" treatment group and the business-as-usual comparison group on the math and science achievement outcome. The duration of students' exposure to INSPIRE, fidelity of implementation, alignment between PBL instruction and NC standardized assessments, and contextual factors that might have weakened the intervention strength relative to business-as-usual conditions are discussed as possible factors that account for these findings. The report concludes with suggestions for future research and implications for education policy.
Reviews of Individual Studies 2-5 -1
Promoting afterschool quality and positive youth development: Cluster randomized trial of the PAX Good Behavior Game. (2018)
Reviews of Individual Studies 4 -1
Examining the efficacy of targeted component interventions on language and literacy for third and fourth graders who are at risk of comprehension difficulties (2018)
Testing a component model of reading comprehension in a randomized controlled trial, we evaluated the efficacy of 4 interventions that were designed to target components of language and metacognition that predict children's reading comprehension: vocabulary, listening comprehension, comprehension of literate language, academic knowledge, and comprehension monitoring. Third- and 4th-graders with language skills falling below age expectations participated (N = 645). Overall, the component interventions were only somewhat effective in improving the targeted skills, compared to a business-as-usual control (g ranged from -0.14 to 0.33), and no main effects were significant after correcting for multiple comparisons. Effects did not generalize to other language skills or to students' reading comprehension. Moreover, there were Child Characteristic × Treatment interaction effects. For example, the intervention designed to build sensorimotor mental representations was more effective for children with weaker vocabulary skills. Implications for component models of reading and interventions for children at risk of reading comprehension difficulties are discussed.
Reviews of Individual Studies 4 -1
Examining the efficacy of targeted component interventions on language and literacy for third and fourth graders who are at risk of comprehension difficulties. (2018)
Testing a component model of reading comprehension in a randomized controlled trial, we evaluated the efficacy of 4 interventions that were designed to target components of language and metacognition that predict children's reading comprehension: vocabulary, listening comprehension, comprehension of literate language, academic knowledge, and comprehension monitoring. Third- and 4th-graders with language skills falling below age expectations participated (N†= 645). Overall, the component interventions were only somewhat effective in improving the targeted skills, compared to a business-as-usual control (g ranged from -0.14 to 0.33), and no main effects were significant after correcting for multiple comparisons. Effects did not generalize to other language skills or to students' reading comprehension. Moreover, there were Child Characteristic ? Treatment interaction effects. For example, the intervention designed to build sensorimotor mental representations was more effective for children with weaker vocabulary skills. Implications for component models of reading and interventions for children at risk of reading comprehension difficulties are discussed.
Reviews of Individual Studies 4-5 -1
Assessing the impact of the Math for All professional development program on elementary school teachers and their students (2018)
Reviews of Individual Studies 4 -1
Academic Achievement of Students in Dual Language Immersion (2018)
This article reports on a study that investigated achievement in math of third and fourth grade dual language immersion (DLI) students, building on research that has demonstrated the academic achievement of students who receive content instruction predominantly in the target language. Our study expands the scope and methodology of prior research by including one-way programs in three languages (Chinese, French and Spanish) and two-way Spanish-English programs; and by relying on propensity matching to mitigate possible effects of school and student differences. In our third grade study, we compared students' math scores in relation to their English Language Arts (ELA) achievement to control for pre-existing differences between DLI and non-DLI students. DLI students who attained the same levels in ELA, and who received math instruction in a target language, performed at the same level as their non-DLI peers in third grade math tests given in English. For the fourth grade study, we compared DLI students to a propensity-matched non-DLI group. DLI students grew more in math than their counterparts not in DLI. The results from this natural experiment indicate that students in a DLI program that has been implemented state-wide were able to succeed academically in math.
Reviews of Individual Studies 3-5 -1
Examining the effects of afterschool reading interventions for upper elementary struggling readers. (2018)
We examined the efficacy of an afterschool multicomponent reading intervention for third- through fifth-grade students with reading difficulties. A total of 419 students were identified for participation based on a 90 standard score or below on a screening measure of the Test of Silent Reading Efficiency and Comprehension. Participating students were randomly assigned to a business as usual comparison condition or one of two reading treatments. All treatment students received 30 min of computer-based instruction plus 30 min of small-group tutoring for four to five times per week. No statistically significant reading comprehension posttest group differences were identified (p > 0.05). The limitations of this study included high attrition and absenteeism. These findings extend those from a small sample of experimental studies examining afterschool reading interventions and provide initial evidence that more instruction, after school, may not yield the desired outcome of improved comprehension.
Reviews of Individual Studies 4-8 -1
Literacy Design Collaborative 2016–2017 evaluation report for the New York City Department of Education (CRESST Report 856) (2018)
The Literacy Design Collaborative (LDC) was created to support teachers in implementing college and career readiness standards in order to teach literacy skills throughout the content areas. Teachers work collaboratively with coaches to further develop their expertise and design standards-driven, literacy-rich writing assignments within their existing curriculum across all content areas. The 2016-2017 school year was the first year of implementation, following a pilot year during which the implementation plan, instruments, data collection processes, and analytical methodologies were refined. Participants across all groups reported positive attitudes toward LDC and perceive a positive impact on student outcomes. Analysis of module artifacts suggest that teachers at the elementary school level were moderately successful in the backwards design process, particularly in developing high-quality writing tasks for students. As an ongoing multiyear intervention, the LDC implementation will continue to evolve year to year as participants provide feedback and LDC program managers make refinements. Thus, we anticipate that further significant changes to the course material and the delivery system that are already in progress for Year 2 will likely result in continued and possibly increased positive feedback. [Funding for this work was provided by the Literacy Design Collaborative.]
Reviews of Individual Studies 4-6 -1
Evaluation of Leading with Learning i3 development initiative: Final report. (2018)
Reviews of Individual Studies 4-7 -1
Reducing academic inequalities for English language learners: variation in experimental effects of word generation in high-poverty schools (2018)
Reviews of Individual Studies 4-5 -1
Exploring the Influence of Homogeneous versus Heterogeneous Grouping on Students' Text-Based Discussions and Comprehension (2017)
Reviews of Individual Studies 4-Not reported -1
Mentoring Early Career Teachers in Urban Alaska: Impact Findings from the Investing in Innovation (i3) Evaluation of the Alaska Statewide Mentor Project Urban Growth Opportunity (2017)
In 2011, the University of Alaska Fairbanks (UAF) received an Investing in Innovation (i3) Grant through the U.S. Department of Education. UAF applied for the grant to expand the predominantly rural-serving Alaska Statewide Mentor Project (ASMP) to urban settings. ASMP is a professional development initiative that supplies fully released, highly trained mentors to early career teachers (ECTs). UAF's i3 grant, The Urban Growth Opportunity (UGO), included five districts: Anchorage, Fairbanks North Star Borough, Kenai Peninsula Borough, Matanuska-Susitna Borough, and Sitka. This is the final report for the grant conducted over four years (2011 2012 to 2014 2015). The research team randomly assigned 556 ECTs to treatment (UGO) and business as usual (BAU) groups. UGO ECTs received an ASMP mentor for two years; BAU ECTs received their districts' business as usual support that varied by district and included content coaches without mentoring support and non-ASMP instructional mentoring support. Researchers conducted impact, implementation, and intervention studies. The impact study included seven outcomes: teacher retention; teacher instructional practice as measured by the three Classroom Assessment Scoring System (CLASS®) domains (Emotional Support, Classroom Organization, and Instructional Support); and student achievement in reading, writing, and mathematics as measured by the state assessment. While UGO ECTs were retained as teachers in Alaska public schools at higher rates than BAU ECTs, the difference was not statistically significant. There were no statistically significant differences between UGO and BAU ECTs on instructional practices as measured by CLASS®. Finally, student achievement was generally higher for students of UGO ECTs, but differences in achievement were statistically significant only for some student groups: primary reading students and secondary math students who were White, Hispanic, Alaskan Native, or two or more races. Results from the implementation study, conducted over three of the four years of implementation, found ASMP implemented UGO with fidelity across all components: mentor recruitment and assignment, mentor participation in professional development, mentor interaction with their ECTs, and mentors' use of formative assessment tools. Results from the intervention study identified two types of mentor-mentee dyads: Gliders and Sliders, with gliders engaging in longer conversations, focused more explicitly on instruction and students, responding to each other more often, and engaging as peers more frequently than the slider dyads.
Reviews of Individual Studies 4-12 -1
Impact of TNTP’s Teaching Fellows in urban school districts (2017)
Reviews of Individual Studies 4 -1
Effects of a year long supplemental reading intervention for students with reading difficulties in fourth grade (2017)
Research examining effective reading interventions for students with reading difficulties in the upper elementary grades is limited relative to the information available for the early elementary grades. In the current study, we examined the effects of a multicomponent reading intervention for students with reading comprehension difficulties. We employed a partially nested analysis with latent variables to adequately match the design of the study and provide the necessary precision of intervention effects. We examined the effects of the intervention on students' latent word reading, latent vocabulary, and latent reading comprehension. In addition, we examined whether these effects differed for students of varying levels of reading or English language proficiency. Findings indicated the treatment significantly outperformed the comparison on reading comprehension (ES = 0.38), but no overall group differences were noted on word reading or vocabulary. Students' initial word reading scores moderated this effect. Reading comprehension effects were similar for English learner and non-English learner students. [This article was published in "Journal of Educational Psychology" (EJ1160638).]
Reviews of Individual Studies 4 -1
Effects of a year long supplemental reading intervention for students with reading difficulties in fourth grade. (2017)
Research examining effective reading interventions for students with reading difficulties in the upper elementary grades is limited relative to the information available for the early elementary grades. In the current study, we examined the effects of a multicomponent reading intervention for students with reading comprehension difficulties. We used a partially nested analysis with latent variables to adequately match the design of the study and provide the necessary precision of intervention effects. We examined the effects of the intervention on students' latent word reading, latent vocabulary, and latent reading comprehension. In addition, we examined whether these effects differed for students of varying levels of reading or English language proficiency. Findings indicated the treatment significantly outperformed the comparison on reading comprehension (Effect Size = 0.38), but no overall group differences were noted on word reading or vocabulary. Students' initial word reading scores moderated this effect. Reading comprehension effects were similar for English learner and non-English learner students.
Reviews of Individual Studies 2-4 -1
The Effects of Dialect Awareness Instruction on Non-Mainstream American English Speakers (2017)
Reviews of Individual Studies 1-7 -1
The effect of mentoring on school attendance and academic outcomes: A randomized evaluation of the Check & Connect program (Working Paper WP-16-18) (2017)
Reviews of Individual Studies 1-5 -1
Impacts of the Retired Mentors for New Teachers program (REL 2017-225) (2017)
Reviews of Individual Studies K-5 -1
Using multi-component consultation to increase the integrity with which teachers implement behavioral classroom interventions: A pilot study (2017)
Reviews of Individual Studies K-Not reported -1
Effects of a Cross-Age Peer Learning Program on the Vocabulary and Comprehension of English Learners and Non-English Learners in Elementary School (2017)
This study evaluated the effects of a cross-age peer learning program targeting vocabulary and comprehension in kindergarten and fourth-grade classrooms with substantial proportions of English Learners (ELs). The study followed a quasi-experimental design with 12 classrooms (6 kindergarten and 6 fourth grade) in the intervention group and 12 classrooms (6 kindergarten and 6 fourth grade) in the comparison group. Students were assessed before and after the 14-week intervention via curriculum-aligned and norm-referenced vocabulary and comprehension assessments. Findings of analyses of researcher-developed measures showed positive and significant intervention effects on receptive and expressive vocabulary in kindergarten and fourth grade and comprehension (i.e., understanding of text and strategy use) in fourth grade. Findings of analyses of norm-referenced measures showed positive and significant intervention effects on receptive vocabulary in kindergarten. In general, the intervention had similar effects for ELs and non-ELs.
Reviews of Individual Studies 2-5 -1
The impact of Achieve3000 on elementary literacy outcomes: Randomized control trial evidence, 2013-14 to 2014-15 (DRA Report No. 16.02). (2016)
In 2013-14, the Wake County Public School System (WCPSS) launched Achieve3000 as a randomized controlled trial in 16 elementary schools. Achieve3000 is an early literacy program that differentiates non-fiction reading passages based on individual students' Lexile scores. Twoyear results show that Achieve3000 did not have a significant impact on student outcomes. However, both intent-to-treat and treatment-on-treated estimates show that in 2015, the second year of implementation, students in the treatment group outperformed their control-group counterparts by 0.13 standard deviation units (SD) on the year-end Achieve3000 LevelSet Lexile test. This effect size is consistent with mean empirical effect sizes reported by Lipsey et al. (2012). Yet in neither the pooled nor annual results did Achieve3000 significantly impact student performance on additional Lexile outcomes (EOG or DIBELS ORF). Both implementation and impact results for Achieve3000 suggest that the ability of this particular technology-based literacy solution to improve student performance beyond that of a control group fell short of vendor-defined and empirical expectations.
Reviews of Individual Studies 4 -1
Impact of achievement of a five-year intensive professional development program in elementary science. (2016)
Reviews of Individual Studies 4 -1
Examining the average and local effects of a standardized treatment for fourth graders with reading difficulties. (2016)
The present study used a randomized control trial to examine the effects of a widely used multicomponent Tier 2-type intervention, Passport to Literacy, on the reading ability of 221 fourth graders who initially scored at or below the 30th percentile in reading comprehension. Intervention was provided by research staff to groups of 4-7 students for 30 min, 4 days a week throughout the school year (M = 90.45 lessons). Tier 1 instruction was observed to be of generally high quality and intervention fidelity was strong. Findings revealed small, average effects (ES = -0.14-0.28) in favor of intervention students on standardized measures of comprehension, but no effects on word reading or fluency measures. Exploratory analyses indicated that intervention effects may differ by students' comprehension abilities. Implications for intervention implementation and directions for future research are discussed.
Reviews of Individual Studies 4 -1
Examining the average and local effects of a standardized treatment for fourth graders with reading difficulties. (2016)
The present study used a randomized control trial to examine the effects of a widely-used multi-component Tier 2 type intervention, Passport to Literacy, on the reading ability of 221 fourth graders who initially scored at or below the 30th percentile in reading comprehension. Intervention was provided by research staff to groups of 4-7 students for 30 min, 4 days a week throughout the school year (M = 90.45 lessons). Tier 1 instruction was observed to be of generally high quality and intervention fidelity was strong. Findings revealed small, average effects (ES = 0.14 -0.28) in favor of intervention students on standardized measures of comprehension, but no effects on word reading or fluency measures. Exploratory analyses indicated intervention effects may differ by students' comprehension abilities. Implications for intervention implementation and directions for future research are discussed. [This paper was published in "Journal of Research on Educational Effectiveness" (EJ1115336).]
Reviews of Individual Studies 4 -1
Effects from a randomized control trial comparing researcher and school-implemented treatments with fourth graders with significant reading difficulties. (2016)
This study examined the effectiveness of a researcher-provided intervention with fourth graders with significant reading difficulties. The intervention emphasized multisyllable word reading, fluent reading of high-frequency words and phrases, vocabulary, and comprehension. To identify the participants, 1,695 fourth-grade students were screened using the Gates-MacGinitie Reading Test, and those whose standard scores were 85 or lower were included in the study (N = 483). Participants were randomly assigned (2:1) to receive either researcher-provided intervention (n = 323) or intervention provided by school personnel (business as usual, BAU) (n = 161). Findings revealed no statistically significant differences between students in the researcher-provided intervention and BAU groups. Using effect sizes as an indicator of impact, students in the researcher-implemented treatment generally outperformed students in the school-implemented treatment (BAU). Examining growth in standard scores, both groups made significant gains in reading outcomes with standard score growth from pretest to posttest of 3 standard score points on decoding, 5 on fluency, and 2.0 to 7 standard score points on reading comprehension measures.
Reviews of Individual Studies 3-8 -1
Achievement Network's Investing in Innovation Expansion: Impacts on educator practice and student achievement. (2016)
Data-based instructional programs have proliferated in American schools despite limited evidence of their effectiveness in improving educator practice and raising student achievement. We report results from a two-year school-randomized evaluation of the Achievement Network (ANet), a program providing schools with standards-aligned interim assessments and intensive supports for instructional data use. Survey data show that ANet increased teacher satisfaction with the timeliness and clarity of the data they receive and available supports for instructional data-use and caused them to review and use interim assessment data more often. ANet did not, however, affect their confidence in data use or how frequently they differentiated instruction. Student impact estimates show no overall effect on student achievement in English language arts or mathematics. Despite the lack program effects on student achievement, we find that achievement is positively correlated with our survey-based measures of teacher perceptions and practices around instructional data use. Exploratory analyses suggest that the success of ANet in improving teacher practice and student achievement varies with the pre-existing capacity of schools to engage in data-based instruction. Schools rated by program staff as having a high level of readiness to implement the intervention prior to random assignment experienced positive impacts on student achievement, while those rated as a having a low level of readiness experienced negative impacts. The following are appended: (1) School Screener Scoring Rubric; (2) Year 2 School Leader and Teacher Survey Scale Items; and (3) School Leader and Teacher Survey Impact Tables.
Reviews of Individual Studies 3-8 -1
The LASER model: A systematic and sustainable approach for achieving high standards in science education: SSEC i3 Validation Final Report of Confirmatory and Exploratory Analyses [Elementary Schools]. (2016)
Previous research has linked inquiry-based science instruction (i.e., science instruction that engages students in doing science rather than just learning about science) with greater gains in student learning than text-book based methods (Vanosdall, Klentschy, Hedges & Weisbaum, 2007; Banilower, 2007; Ferguson 2009; Bredderman, 1983; Shymansky, Hedges, & Woodworth, 1990). The LASER model, being validated in the current study, has already been the subject of a number of case studies (RMC Research Corporation, 2010; Horizon Research, 2010; Vanosdall et al., 2007). However, experimental studies of the type that might establish a causal link between program implementation, student science learning, and other valued outcomes have yet to be conducted. Only a handful of studies have involved random assignment, and most of these have involved random assignment of students in a relatively small number of classrooms (see Furtak et al. 2009). With support from the U.S. Department of Education's Investing in Innovation Fund (i3), the current validation study of the LASER Model encompasses approximately 60,000 students, 1,900 teachers, and over 140 district administrators and principals. The efficacy of the LASER program has important implications for both research and practice when working with high-poverty schools and districts, who have limited resources and time available for science interventions. LASER's initial success with early learners also demonstrates its potential for reducing the development of chronic, long-term deficiencies and academic problems. One table and one figure are appended.
Reviews of Individual Studies 3-8 -1
The LASER Model: A Systemic and Sustainable Approach for Achieving High Standards in Science Education (2016)
Reviews of Individual Studies 4-5 -1
District 75, New York City Department of Education impact evaluation. (2016)
Reviews of Individual Studies 4-5 -1
Investigating Effects of Embedding Collaboration in an Intelligent Tutoring System for Elementary School Students (2016)
Intelligent Tutoring Systems (ITSs) are beneficial for individual students learning in several domains, including mathematics where they have been used to support both secondary and elementary students. Collaborative learning may be beneficial to include in ITSs, particularly for conceptual knowledge. There is little work on collaborative ITSs, and it has mostly focused on older students. We aim to extend this work to elementary school students, by extending an ITS for fractions so it supports collaborative learning. We also build upon our previous work to further investigate the complementary strengths of collaborative and individual learning. In our study, 189 elementary school students worked with a conceptual or a procedural fractions ITS, and either individually or collaboratively. Students in both ITS conditions learned, but there were no differences in learning between individual and collaboration. However, the students working collaboratively spent less time on the tutor, indicating potential benefits of collaborative learning on efficiency in this setting.
Reviews of Individual Studies 4-5 -1
Efficacy of rich vocabulary instruction in fourth- and fifth-grade classrooms. (2015)
A multi-cohort cluster randomized trial was conducted to estimate effects of rich vocabulary classroom instruction on vocabulary and reading comprehension. A total of 1,232 fourth- and fifth-grade students from 61 classrooms in 24 schools completed the study. Students received instruction in 140 Tier Two vocabulary words featured in two grade-level novels. Teachers were randomly assigned to either rich vocabulary (treatment) or to business as usual (control). Teachers in the treatment condition allotted 30 minutes per day to the intervention for 14 weeks. Hierarchical linear modeling revealed positive, significant treatment effects on distal and proximal measures of vocabulary and comprehension. However, average distal treatment effects were small (approximate d =0.15) compared with proximal effects (approximate d = 1.24). Observations of teachers' language arts instruction indicated that treatment teachers spent significantly more time on vocabulary and less time on comprehension instruction than did teachers in the control condition. Results support the intensity and depth of the instruction for learning the taught corpus of words, and modest transfer to global vocabulary and comprehension.
Reviews of Individual Studies 4-8 -1
The district-wide effectiveness of the Achieve3000 program: A quasi-experimental study. (2015)
The purpose of this study was to evaluate the impact of Achieve3000, a differentiated online literacy curriculum, on students' scores on the California State Test (CST). In the 2011-12 school year, 1,957 students in Chula Vista began using Achieve3000's solutions in 3rd through 8th grade. Using a form of propensity score matching called Inverse Probability-of-Treatment Weighting (IPTW), the researchers assigned weights for the likelihood that students in the non-user comparison group (N = 7,598) could have been in the Achieve3000 treatment group. A Weighted Least Squares (WLS) regression model with IPTW weights estimated the average treatment effect. The researchers found that, overall, the students assigned to Achieve3000 performed statistically significantly higher on the CST, by 2.4 points, than students who were not using these solutions. This suggests the program is effective in improving student learning over conventional classroom activities in the first year of use, however more data is needed to determine the long term impact of usage. Five appendices contain supplemental tables and figures.
Reviews of Individual Studies K-12 -1
Exploring the causal impact of the McREL Balanced Leadership Program on leadership, principal efficacy, instructional climate, educator turnover, and student achievement. (2015)
This study uses a randomized design to assess the impact of the Balanced Leadership program on principal leadership, instructional climate, principal efficacy, staff turnover, and student achievement in a sample of rural northern Michigan schools. Participating principals report feeling more efficacious, using more effective leadership practices, and having a better instructional climate than control group principals. However, teacher reports indicate that the instructional climate of the schools did not change. Furthermore, we find no impact of the program on student achievement. There was an impact of the program on staff turnover, with principals and teachers in treatment schools significantly more likely to remain in the same school over the 3 years of the study than staff in control schools.
Reviews of Individual Studies 4-8 -1
Developing educators throughout their careers: Evaluation of the Rio Grande Valley Center for Teaching and Leading Excellence. (2015)
Reviews of Individual Studies 3-5 -1
The Beaverton School District Arts for Learning (A4L) lessons project: An Investing in Innovation (i3) development grant. (2015)
The purpose of this study was to assess the impact of the Arts for Learning (A4L) Lessons Project on the literacy and life skills of students in grades 3, 4, and 5. A4L Lessons is a supplementary literacy curriculum designed to blend the creativity and discipline of the arts with learning science to raise student achievement in reading and writing, as well as to develop literacy and life skills. A cluster-randomized trial was employed, randomly assigning 32 elementary schools in the Beaverton School District in Oregon to receive the A4L intervention or the status-quo control condition. Participants included approximately 5,700 students in the 16 intervention schools and approximately 6,100 students in the 16 control schools. Nearly 40% of the participants qualified for free/reduced-price lunch, approximately 17% were English language learners, and nearly 50% were racial/ethnic minorities. Achievement on the Oregon Assessment of Knowledge and Skills (OAKS) Reading/Literature test (i.e., the state reading test) were compared for the two groups. Achievement on the Comprehensive Cross Unit (CCU) Assessments (i.e., tests designed specifically to measure the impact of the A4L Lessons Project on literacy and life skills) were compared for a subset of six intervention and six control schools. Results from confirmatory analyses revealed no statistically significant impacts of the A4L Lessons Project on students' achievement on the OAKS Reading/Literature test. The effect sizes based on differences between the treatment and control students on the OAKS Reading/Literature test after one, two, and three years of program participation were very small, ranging from -0.03 to 0.05. Results from exploratory analyses revealed that treatment students in grade 4 scored significantly higher than control students on the CCU Assessment, indicating a positive impact of the A4L Lessons Project on student literacy and life skills. The effect sizes indexing the differences ranged from 0.30 to 0.36 across study years. Results from exploratory analyses using the CCU Assessments with students in grades 3 and 5 did not reach statistical significance, indicating that the A4L Lessons Project did not produce a positive impact on student literacy and life skills in these grades. Further research relying on more dependently sensitive assessments may be needed to better determine the impact of the A4L Lessons on students' literacy achievement. Tables are appended.
Reviews of Individual Studies 3-5 -1
Using a narrative-and play-based activity to promote low-income preschoolers’ oral language, emergent literacy, and social competence. (2015)
Reviews of Individual Studies 4-10 -1
Final impact analysis report WriteUp! (Dev12-13). (2015)
Reviews of Individual Studies 3-11 -1
The Data-Driven School Transformation Partnership: A project of the Bay State Reading Institute (BSRI) and 17 Massachusetts elementary schools. (2015)
Reviews of Individual Studies PK-5 -1
Impacts of the Teach for America Investing in Innovation scale-up. (2015)
Reviews of Individual Studies K-8 -1
Comprehensive educator effectiveness models that work: Impact of the TAP System on student achievement in Louisiana. (2014)
TAP™: The System for Teacher and Student Advancement was launched in 1999 as a comprehensive educator effectiveness model to offer career advancement and leadership opportunities for educators, a fair and transparent evaluation process linked to job-embedded professional development and performance-based compensation, which culminate in improved instructional practices and student achievement. This study illustrates the impact of the TAP System in 66 Louisiana schools. These are primarily high-need schools, with average free/reduced price lunch eligibility of 86%, impacting more than 32,000 students each year. The authors report evidence of a positive effect of the TAP System on student achievement using two complementary analysis strategies: (1) They found a significant positive effect of TAP on 2012-13 K-8 Assessment Index scores, controlling for previous achievement, percentage of students receiving free or reduced price lunch, school configuration, school size (number of students), and percentage of English language learners. The 66 TAP schools scored 3.7 points higher on average than non-TAP schools statewide; and (2) They also found that the TAP schools had significantly greater 2012-13 Assessment Index scores than a group of matched control schools. The TAP schools scored 5.5 points higher on average than their matched controls.
Reviews of Individual Studies 2-8 -1
Effects of using a web-based individualized education program decision-making tutorial. (2014)
This study explored the effects of a web-based decision support system ("Tutorial") for writing standards-based Individualized Education Programs (IEPs). A total of 35 teachers and 154 students participated across two academic years. Participants were assigned to one of three intervention groups based on level of "Tutorial" access: Full, Partial, or Comparison. Direct effects of the intervention on procedural and substantive elements of IEPs revealed that, although all groups had initial IEPs of similar quality, the Full Intervention group's post-"Tutorial" IEPs had a significantly higher proportion of substantive items rated as adequate than did the IEPs of other groups. The intervention's indirect effects were examined using student scores on the State Reading Assessment. The Full Intervention group demonstrated a higher rate of reading score gain than the other two groups during the academic year in which the IEP prepared with access to the "Tutorial" was implemented. Implications for educational practices and future research directions are discussed.
Reviews of Individual Studies 2-4 -1
Effects of the FITKids randomized controlled trial on executive control and brain function. (2014)
Reviews of Individual Studies 2-5 -1
Effects of progress monitoring on math performance of at-risk students (Elementary school sample). (2014)
Reviews of Individual Studies 4 -1
Does Working Memory Moderate the Effects of Fraction Intervention? An Aptitude-Treatment Interaction (2014)
This study investigated whether individual differences in working memory (WM) moderate effects of 2 variations of intervention designed to improve at-risk 4th graders' fraction knowledge. We also examined the effects of each intervention condition against a business-as-usual control group and assessed whether children's measurement interpretation of fractions mediated those effects. At-risk students (n = 243) were randomly assigned to control and 2 intervention conditions. The interventions each lasted 12 weeks, with three 30-min sessions per week. The major focus of both intervention conditions was the measurement interpretation of fractions. Across the 2 conditions, only 5 min of each 30-min session differed. One condition completed activities to build fluency with 4 measurement interpretation topics; in the other, activities were completed to consolidate understanding on the same 4 topics. Results revealed a significant aptitude-treatment interaction, in which students with very weak WM learned better with conceptual activities but children with more adequate (but still low) WM learned better with fluency activities. Both intervention conditions outperformed the control group on all outcomes, and improvement in the measurement interpretation of fractions mediated those effects.
Reviews of Individual Studies 4-5 -1
Comparison of the Effects of Computer-Based Practice and Conceptual Understanding Interventions on Mathematics Fact Retention and Generalization (2014)
The authors' purpose was to determine the effects of computer-based practice and conceptual interventions on computational fluency and word-problem solving of fourth- and fifth-grade students with mathematics difficulties. A randomized pretest-posttest control group design found that students assigned to the computer-based practice intervention group outperformed students in the comparison group on the retention measure. Students assigned to the conceptual intervention did not outperform the comparison group on any of the outcome variables. Implications for instruction and interventions are discussed.
Reviews of Individual Studies 4-5 -1
Comparison of the Effects of Computer-Based Practice and Conceptual Understanding Interventions on Mathematics Fact Retention and Generalization (2014)
The authors' purpose was to determine the effects of computer-based practice and conceptual interventions on computational fluency and word-problem solving of fourth- and fifth-grade students with mathematics difficulties. A randomized pretest-posttest control group design found that students assigned to the computer-based practice intervention group outperformed students in the comparison group on the retention measure. Students assigned to the conceptual intervention did not outperform the comparison group on any of the outcome variables. Implications for instruction and interventions are discussed.
Reviews of Individual Studies 3-8 -1
Using Social-Emotional and Character Development to Improve Academic Outcomes: A Matched-Pair, Cluster-Randomized Controlled Trial in Low-Income, Urban Schools. (2013)
Background: School-based social-emotional and character development (SECD) programs can influence not only SECD but also academic-related outcomes. This study evaluated the impact of one SECD program, Positive Action (PA), on educational outcomes among low-income, urban youth. Methods: The longitudinal study used a matched-pair, cluster-randomized controlled design. Student-reported disaffection with learning and academic grades, and teacher ratings of academic ability and motivation were assessed for a cohort followed from grades 3 to 8. Aggregate school records were used to assess standardized test performance (for entire school, cohort, and demographic subgroups) and absenteeism (entire school). Multilevel growth-curve analyses tested program effects. Results: PA significantly improved growth in academic motivation and mitigated disaffection with learning. There was a positive impact of PA on absenteeism and marginally significant impact on math performance of all students. There were favorable program effects on reading for African American boys and cohort students transitioning between grades 7 and 8, and on math for girls and low-income students. Conclusions: A school-based SECD program was found to influence academic outcomes among students living in low-income, urban communities. Future research should examine mechanisms by which changes in SECD influence changes in academic outcomes.
Reviews of Individual Studies 2-5 -1
Does the Responsive Classroom approach affect the use of standards-based mathematics teaching practices?: Results from a randomized controlled trial (2013)
This study highlights the connections between two facets of teachers' skills--those supporting teachers' mathematical instructional interactions and those underlying social interactions within the classroom. The impact of the Responsive Classroom (RC) approach and use of RC practices on the use of standards-based mathematics teaching practices was investigated in third-grade classrooms. Eighty-eight third-grade teachers from 24 elementary schools in a large suburban district were selected from a sample of teachers participating in a larger randomized-control study. Results showed that teachers at schools assigned randomly to receive training in the RC approach showed higher use of standards-based mathematics teaching practices than teachers in control schools. These findings were supported by analyses using fidelity of implementation: greater adherence to the intervention predicted the use of more standards-based mathematics teaching practices. Findings support the use of the RC approach for creating classroom social environments that facilitate standards-based mathematical practices. (Contains 3 tables and 1 note.)
Reviews of Individual Studies 2-5 -1
Effectiveness of an Individualized Computer-Driven Online Math K-5 Course in Eight California Title I Elementary Schools (2013)
Stanford University's Education Program for Gifted Youth (EPGY) conducted a randomized-treatment experiment during the 2006-2007 school year to test the efficacy, for Title I students, of the technological and individualized EPGY Kindergarten through Grade 5 Mathematics Course Sequence, modified for the Title I schools. Restricting attention to students who were in the top half of the distribution of correct first-exercise attempts (a measure of work and engagement), we found substantial and statistically significant improvements in the 2007 California Standard Math Tests (CST07) scores compared to those of matched control students. Gains in second grade were larger than those in Grades 3 to 5. Less able students, as measured by their 2006 CST mathematics scores, also had, on average, larger gains.
Reviews of Individual Studies PK-12 -1
Findings from a two-year examination of teacher engagement in TAP schools across Louisiana. (2013)
Reviews of Individual Studies K-8 -1
The impact of Indianas system of interim assessments on mathematics and reading achievement. (2013)
Interim assessments are increasingly common in U.S. schools. We use high-quality data from a large-scale school-level cluster randomized experiment to examine the impact of two well-known commercial interim assessment programs on mathematics and reading achievement in Indiana. Results indicate that the treatment effects are positive but not consistently significant. The treatment effects are smaller in lower grades (i.e., kindergarten to second grade) and larger in upper grades (i.e., third to eighth grade). Significant treatment effects are detected in Grades 3 to 8, especially in third- and fourth-grade reading and in fifth- and sixth-grade mathematics.
Reviews of Individual Studies K-12 -1
The system for teacher and student advancement: An evaluation of achievement and engagement in Louisiana. (2013)
Reviews of Individual Studies K-8 -1
Training your own: The impact of New York City’s Aspiring Principals Program on student achievement. (2012)
The New York City Leadership Academy represents a unique experiment by a large urban school district to train and develop its own school leaders. Its 14-month Aspiring Principals Program (APP) selects and prepares aspiring principals to lead low-performing schools. This study provides the first systematic evaluation of achievement in APP-staffed schools after 3 or more years. We examine differences between APP principals and those advancing through other routes, the extent to which APP graduates serve and remain in schools, and their relative performance in mathematics and English language arts. On balance, we find that APP principals performed about as well as other new principals. If anything, they narrowed the gap with comparison schools in English language arts but lagged behind in mathematics. (Contains 2 figures, 9 tables, and 23 notes.)
Reviews of Individual Studies 1-5 -1
The effects of school vouchers on college enrollment: Experimental evidence from New York City. (2012)
In the first study, using a randomized experiment to measure the impact of school vouchers on college enrollment, Matthew Chingos and Paul Peterson, professor of government at Harvard University, examine the college-going behavior through 2011 of students who participated in a voucher experiment as elementary school students in the late 1990s. They find no overall impacts on college enrollment but do find large, statistically significant positive impacts on the college going of African-American students who participated in the study. Their estimates indicate that using a voucher to attend private school increased the overall college enrollment rate among African Americans by 24 percent. The original data for the analysis come from an experimental evaluation of the privately funded New York School Choice Scholarships Foundation Program, which in the spring of 1997 offered three-year scholarships worth up to a maximum of $1,400 annually to as many as 1,000 low-income families. Chingos and Peterson obtained student information that allowed them to identify over 99 percent of the students who participated in the original experiment so that their college enrollment status could be ascertained by means of the college enrollment database maintained by the National Student Clearinghouse for institutions of higher education that serve 96 percent of all students in the United States. In addition to finding impacts on overall college-going for African Americans, the authors report significant increases in full-time college attendance, enrollment in private four-year colleges, and enrollment in selective four-year colleges for this group of students. Observational and Quasi-Experimental Research are appended. (Contains 7 tables and 19 endnotes.)
Reviews of Individual Studies 4 -1
Reading interventions with varying instructional emphases for fourth graders with reading difficulties (2012)
This study investigated the relative effects of three treatments with varying instructional emphases in reading with a comparison condition. Eighty-seven students in fourth grade with reading impairments were assigned through stratified random assignment to one of four conditions: (a) comprehension emphasis, (b) word study emphasis, (c) emphasis of either comprehension or word study based on the student's pretest reading profile, or (d) school-provided intervention comparison condition. Students in the three researcher-provided treatments received intervention in small groups with a trained tutor for 30 min daily for approximately 28 weeks. Results revealed no statistically significant main effects between conditions on measures of word reading, fluency, vocabulary, or comprehension. Students with limited English proficiency performed significantly better at posttest in all conditions than other students. Discussion addresses the challenges of successfully remediating reading problems with older students with significant reading problems. (Contains 3 tables.)
Reviews of Individual Studies 4 -1
Reading interventions with varying instructional emphases for fourth graders with reading difficulties (2012)
This study investigated the relative effects of three treatments with varying instructional emphases in reading with a comparison condition. Eighty-seven students in fourth grade with reading impairments were assigned through stratified random assignment to one of four conditions: (a) comprehension emphasis, (b) word study emphasis, (c) emphasis of either comprehension or word study based on the student's pretest reading profile, or (d) school-provided intervention comparison condition. Students in the three researcher-provided treatments received intervention in small groups with a trained tutor for 30 min daily for approximately 28 weeks. Results revealed no statistically significant main effects between conditions on measures of word reading, fluency, vocabulary, or comprehension. Students with limited English proficiency performed significantly better at posttest in all conditions than other students. Discussion addresses the challenges of successfully remediating reading problems with older students with significant reading problems. (Contains 3 tables.)
Reviews of Individual Studies 4 -1
Reading interventions with varying instructional emphases for fourth graders with reading difficulties (2012)
This study investigated the relative effects of three treatments with varying instructional emphases in reading with a comparison condition. Eighty-seven students in fourth grade with reading impairments were assigned through stratified random assignment to one of four conditions: (a) comprehension emphasis, (b) word study emphasis, (c) emphasis of either comprehension or word study based on the student's pretest reading profile, or (d) school-provided intervention comparison condition. Students in the three researcher-provided treatments received intervention in small groups with a trained tutor for 30 min daily for approximately 28 weeks. Results revealed no statistically significant main effects between conditions on measures of word reading, fluency, vocabulary, or comprehension. Students with limited English proficiency performed significantly better at posttest in all conditions than other students. Discussion addresses the challenges of successfully remediating reading problems with older students with significant reading problems. (Contains 3 tables.)
Reviews of Individual Studies 4 -1
Training a general educator to use function-based support for students at risk for behavior disorders. (2012)
Function-based support (FBS) is an intervention strategy for decreasing problem behaviors and increasing replacement behaviors through the use of functional behavioral assessment and behavior support planning. Although FBS has been demonstrated to facilitate positive outcomes for children in a variety of educational settings, it has yet to be widely adopted because many schools have limited access to personnel (i.e., school psychologist, behavior specialist) with the expertise to implement it. This series of single-subject studies reports the ongoing development and validation of a method for training general educators to successfully and independently implement FBS for at-risk students in their classrooms. These studies highlight the experiences of one teacher who participated in three training phases and implemented FBS with three at-risk students. Results suggest that training was effective as indicated by knowledge gains regarding FBS principles and procedures, successful mastery and application of FBS practices, positive student outcomes, and favorable teacher and student perceptions of social validity. The implications and limitations of these results, as well as future directions for this line of research, are also discussed. (Contains 3 tables and 4 figures.)
Reviews of Individual Studies 4-5 -1
Findings from a randomized experiment of Playworks: Selected results from cohort 1. (2012)
Recess periods often lack the structure needed to support physical activity and positive social development (Robert Wood Johnson Foundation 2010). The Playworks program places full-time coaches in low-income schools to provide opportunities for organized play during recess and throughout the school day. Playworks activities are designed to engage students in physical activity, foster social skills related to cooperation and conflict resolution, improve students' ability to focus on class work, decrease behavioral problems and improve school climate. The Robert Wood Johnson Foundation (RWJF) contracted with Mathematica Policy Research and its subcontractor, the John W. Gardner Center for Youth and Their Communities (JGC) at Stanford University, to conduct a rigorous evaluation of Playworks. Twenty-five schools interested in implementing Playworks were randomly assigned to a treatment group that received Playworks in the 2010-2011 school year or to a control group that was not eligible to implement Playworks until the following year. The authors collected data from students, teachers and school staff in spring 2011 to document the implementation of Playworks and assess the impact of the program on key outcomes in six domains: (1) school climate, (2) conflict resolution and aggression, (3) learning and academic performance, (4) recess experience, (5) youth development and (6) student behavior. Ultimately, four additional schools will be added to the study and further analyses will be released. A description of study design and data sources. (Contains 4 exhibits, 15 tables and 2 endnotes.)
Reviews of Individual Studies 4-5 -1
Reducing developmental risk for emotional/behavioral problems: A randomized controlled trial examining the Tools for Getting Along curriculum. (2012)
Researchers have demonstrated that cognitive-behavioral intervention strategies--such as social problem solving--provided in school settings can help ameliorate the developmental risk for emotional and behavioral difficulties. In this study, we report the results of a randomized controlled trial of Tools for Getting Along (TFGA), a social problem-solving universally delivered curriculum designed to reduce the developmental risk for serious emotional or behavioral problems among upper elementary grade students. We analyzed pre-intervention and post-intervention teacher-report and student self-report data from 14 schools, 87 classrooms, and a total of 1296 students using multilevel modeling. Results (effect sizes calculated using Hedges' g) indicated that students who were taught TFGA had a more positive approach to problem solving (g = 0.11) and a more rational problem-solving style (g = 0.16). Treated students with relatively poor baseline scores benefited from TFGA on (a) problem-solving knowledge (g = 1.54); (b) teacher-rated executive functioning (g = 0.35 for Behavior Regulation and 0.32 for Metacognition), and proactive aggression (g = 0.20); and (c) self-reported trait anger (g = 0.17) and anger expression (g = 0.21). Thus, TFGA may reduce risk for emotional and behavioral difficulties by improving students' cognitive and emotional self-regulation and increasing their pro-social choices. (Contains 4 tables.)
Reviews of Individual Studies 4-5 -1
Classroom Assessment for Student Learning: The impact on elementary school mathematics in the Central Region (NCEE 2011-4005). (2011)
This study was conducted by the Central Region Educational Laboratory (REL Central) administered by Mid-continent Research for Education and Learning to provide educators and policymakers with rigorous evidence about the potential of Classroom Assessment for Student Learning (CASL) to improve student achievement. CASL is a widely used professional development program in classroom and formative assessment published by the Assessment Training Institute of Pearson Education. Schools were recruited from across Colorado to participate in the study. Colorado was chosen as the target state primarily because it has one of the largest populations in the Central Region from which to recruit schools and because its statewide achievement test is vertically scaled. This cluster randomized trial of the CASL professional development program had sufficient statistical power to detect an impact of at least 0.25 standard deviation on student achievement. An intent-to-treat analysis was conducted to estimate the impact of CASL on student achievement; all schools were included in the analysis and were analyzed as randomized regardless of the level of implementation fidelity. Analysis did not reveal a statistically significant impact of CASL on the school-level average mathematics achievement of grade 4 and grade 5 students. Results from sensitivity analyses revealed that the impact estimates on student achievement were robust to decisions regarding the inclusion of covariates, estimation method, and the treatment of missing data. In other words, design and analysis decisions made by the research team did not change whether the impact results would have been statistically significant. Appendices include: (1) Power analysis; (2) Response rates by data collection wave, instrument, and experimental group; (3) Data collection instruments; (4) Development, reliability, and validity of teacher outcomes; (5) Teacher Assessment Work Sample; (6) Impact analysis models; (7) Calculation of effect sizes; (8) Treatment of missing data; (9) Variance components estimates and intraclass correlations; (10) Raw means and standard deviations; and (11) Complete mixed model results. (Contains 1 box, 4 figures and 56 tables.
Reviews of Individual Studies K-12 -1
Teacher incentives and student achievement: Evidence from New York City Public Schools (NBER Working Paper No. 16850). (2011)
Financial incentives for teachers to increase student performance is an increasingly popular education policy around the world. This paper describes a school-based randomized trial in over two-hundred New York City public schools designed to better understand the impact of teacher incentives on student achievement. I find no evidence that teacher incentives increase student performance, attendance, or graduation, nor do I find any evidence that the incentives change student or teacher behavior. If anything, teacher incentives may decrease student achievement, especially in larger schools. The paper concludes with a speculative discussion of theories that may explain these stark results.
Reviews of Individual Studies 4-8 -1
The long-term impacts of teachers: Teacher value-added and student outcomes in adulthood (NBER Working Paper No. 17699). (2011)
Are teachers' impacts on students' test scores ("value-added") a good measure of their quality? This question has sparked debate largely because of disagreement about (1) whether value-added (VA) provides unbiased estimates of teachers' impacts on student achievement and (2) whether high-VA teachers improve students' long-term outcomes. We address these two issues by analyzing school district data from grades 3-8 for 2.5 million children linked to tax records on parent characteristics and adult outcomes. We find no evidence of bias in VA estimates using previously unobserved parent characteristics and a quasi-experimental research design based on changes in teaching staff. Students assigned to high-VA teachers are more likely to attend college, attend higher-ranked colleges, earn higher salaries, live in higher SES neighborhoods, and save more for retirement. They are also less likely to have children as teenagers. Teachers have large impacts in all grades from 4 to 8. On average, a one standard deviation improvement in teacher VA in a single grade raises earnings by about 1% at age 28. Replacing a teacher whose VA is in the bottom 5% with an average teacher would increase students' lifetime income by more than $250,000 for the average classroom in our sample. We conclude that good teachers create substantial economic value and that test score impacts are helpful in identifying such teachers.
Reviews of Individual Studies 4-9 -1
Charter school performance in Indiana. (2011)
Reviews of Individual Studies K-12 -1
A big apple for educators: New York City’s experiment with schoolwide performance bonuses. (2011)
In the 2007-2008 school year, the New York City Department of Education and the United Federation of Teachers jointly implemented the Schoolwide Performance Bonus Program in a random sample of the city's high-needs public schools. The program lasted for three school years, and its broad objective was to improve student performance through school-based financial incentives. The question, of course, was whether it was doing so. To examine its implementation and effects, the department tasked a RAND Corporation-led partnership with the National Center on Performance Incentives at Vanderbilt University to conduct a two-year study of the program that would offer an independent assessment. This report describes the results of our analyses for all three years of the program, from 2007-2008 through 2009-2010. This work built on past research and was guided by a theory of action articulated by program leaders. Researchers examined student test scores; teacher, school staff, and administrator surveys; and interviews with administrators, staff members, program sponsors, and union and district officials. The researchers found that the program did not, by itself, improve student achievement, perhaps in part because conditions needed to motivate staff were not achieved (e.g., understanding, buy-in for the bonus criteria) and because of the high level of accountability pressure all the schools already faced. Individual chapters contain footnotes. (Contains 12 figures and 66 tables.) [Additional funding for this paper was provided by the New York City Fund for Public Schools. For "What New York City's Experiment with Schoolwide Performance Bonuses Tells Us about Pay for Performance. Research Brief," see ED521918.]
Reviews of Individual Studies 3-7 -1
Main idea identification with students with mild intellectual disabilities and specific learning disabilities: A comparison of explicit and basal instructional approaches. (2011)
Students with high-incidence disabilities struggle with reading comprehension due to difficulties in background knowledge and metacognitive skills, including use of self-monitoring and other strategies. In the United States, these students typically receive the majority of their instruction in general education settings. However, there is little research comparing reading comprehension interventions with the typical basal curricula used in these classrooms. We compared the effects of an explicit reading comprehension intervention to those of a typical language-arts curriculum on upper elementary and middle school students' (n = 38) retells of passages and understanding of main ideas. A 2 x 4 repeated measures multivariate analysis of variance (MANOVA) revealed significant differences between instructional groups. These results indicate systematic and explicit reading comprehension instruction can be delivered successfully to students with high-incidence disabilities in general education settings. (Contains 3 figures and 4 tables.)
Reviews of Individual Studies 3-8 -1
A multistate district-level cluster randomized trial of the impact of data-driven reform on reading and mathematics achievement. (2011)
Analyzing mathematics and reading achievement outcomes from a district-level random assignment study fielded in over 500 schools within 59 school districts and seven states, the authors estimate the 1-year impacts of a data-driven reform initiative implemented by the Johns Hopkins Center for Data-Driven Reform in Education (CDDRE). CDDRE consultants work with districts to implement quarterly student benchmark assessments and provide district and school leaders with extensive training on interpreting and using the data to guide reform. Relative to a control condition, in which districts operated as usual without CDDRE services, the data-driven reform initiative caused statistically significant districtwide improvements in student mathematics achievement. The CDDRE intervention also had a positive effect on reading achievement, but the estimates fell short of conventional levels of statistical significance. (Contains 1 figure, 3 tables, and 16 notes.)
Reviews of Individual Studies 1-6 -1
Exercise improves executive function and achievement and alters brain activation in overweight children: A randomized, controlled trial. (2011)
Reviews of Individual Studies 3-11 -1
Teacher preparation programs and Teach for America research study. (2011)
Reviews of Individual Studies K-4 -1
Reading and language outcomes of a multiyear randomized evaluation of transitional bilingual education. (2011)
This article reports the outcomes of a multiyear study comparing the English and Spanish language and reading performance of Spanish-dominant children randomly assigned, beginning in kindergarten, to transitional bilingual education (TBE) or structured English immersion (SEI) for periods of up to 5 years. On the Peabody Picture Vocabulary Test and its Spanish equivalent (Test de Vocabulario en Imagenes Peabody) and on the English and Spanish versions of three Woodcock Reading Scales, first graders in TBE performed significantly better in Spanish and worse in English than did their SEI counterparts. Differences diminished in second and third grades, and by fourth grade, when all students in TBE had transitioned to English-only instruction, there were no significant differences on English reading measures. These findings suggest that Spanish-dominant students learn to read in English equally well in TBE and SEI and that policy should therefore focus on the quality of instruction rather than on the language of instruction for English-language learners. (Contains 1 note and 8 tables.)
Reviews of Individual Studies K-4 -1
Reading and language outcomes of a five-year randomized evaluation of transitional bilingual education. (2010)
This paper reports the fifth-year results of a study comparing the English and Spanish language and reading performance of Spanish-dominant children randomly assigned beginning in kindergarten to Transitional Bilingual Education (TBE) or Structured English Immersion (SEI). This is the first randomized study to compare TBE and SEI reading approaches over a period as long as five years. As expected, on the Peabody Picture Vocabulary Test (PPVT) and its Spanish equivalent (TVIP) and on English and Spanish versions of three Woodcock Reading Scales, kindergartners and first graders in TBE performed significantly better in Spanish and worse in English than their SEI counterparts, controlling for PPVT and TVIP. After transitioning to English, TBE children in grades 2-4 scored significantly lower than those in SEI on the measure of receptive vocabulary, the PPVT, but there were no significant differences on most English reading measures. On the Spanish language (TVIP) and reading measures, TBE students scored significantly higher than SEI in grades K-3, but not grade 4. Both groups gained substantially in English receptive language skills over the years. These findings suggest that Spanish-dominant students learn to read in English (as well as Spanish) equally well in TBE and SEI. (Contains 4 tables.)
Reviews of Individual Studies K-6 -1
Impact of a Social-Emotional and Character Development Program on School-Level Indicators of Academic Achievement, Absenteeism, and Disciplinary Outcomes: A Matched-Pair, Cluster-Randomized, Controlled Trial (2010)
This article reports the effects of a comprehensive elementary school-based social-emotional and character education program on school-level achievement, absenteeism, and disciplinary outcomes utilizing a matched-pair, cluster-randomized, controlled design. The "Positive Action" Hawai'i trial included 20 racially/ethnically diverse schools (M enrollment = 544) and was conducted from the 2002-03 through the 2005-06 academic years. Using school-level archival data, analyses comparing change from baseline (2002) to 1-year posttrial (2007) revealed that intervention schools scored 9.8% better on the TerraNova (2nd ed.) test for reading and 8.8% on math, that 20.7% better in Hawai'i Content and Performance Standards scores for reading and 51.4% better in math, and that intervention schools reported 15.2% lower absenteeism and fewer suspensions (72.6%) and retentions (72.7%). Overall, effect sizes were moderate to large (range = 0.5-1.1) for all of the examined outcomes. Sensitivity analyses using permutation models and random-intercept growth curve models substantiated results. The results provide evidence that a comprehensive school-based program, specifically developed to target student behavior and character, can positively influence school-level achievement, attendance, and disciplinary outcomes concurrently. (Contains 6 tables and 2 figures.)
Reviews of Individual Studies K-6 -1
Impacts of comprehensive teacher induction: Final results from a randomized controlled study (NCEE 2010-4027). (2010)
In 2004, the U.S. Department of Education's Institute of Education Sciences contracted with Mathematica Policy Research to conduct a large-scale evaluation of comprehensive teacher induction. The purpose of the study was to determine whether augmenting the set of services districts usually provide to support beginning teachers with a more comprehensive program improves teacher and student outcomes. This is the study's third and final report on the program's impacts. This report compares retention, achievement, and classroom practices of teachers who were offered comprehensive induction services to teachers who were offered the support normally offered by the school. Teachers assigned to receive comprehensive induction for either one or two years were supported by a full-time mentor who received ongoing training and materials to support the teachers' development. The teachers also were offered monthly professional development sessions and opportunities to observe veteran teachers. The teachers were followed for three years. Data was collected from 1,009 beginning teachers in 418 schools in 17 districts. Districts included in the study were not already offering comprehensive induction services, including paying for full-time mentors. Novice teachers in approximately half of the schools were assigned by lottery to receive comprehensive induction services. In 10 of the districts, these teachers were provided one year of comprehensive induction services; in the remaining 7 districts, the teachers were provided two years of services. Teachers in the schools not assigned to receive comprehensive induction services were provided the support normally offered to novice teachers by the school. Teacher practices were measured via classroom observations conducted in the spring of 2006. Data on teacher retention were collected via surveys administered in the fall of 2006, 2007, and 2008. Student test scores were collected from district administrative records for the 2005-06, 2006-07, and 2007-08 school years. Key findings include: (1) During the comprehensive induction program, treatment teachers received more support than control teachers; (2) The extra induction support for treatment teachers did not translate into impacts on classroom practices in the first year; (3) For teachers who received one year of comprehensive induction, there was no impact on student achievement; (4) For teachers who received two years of comprehensive induction, there was no impact on student achievement in the first two years. In the third year, there was a positive and statistically significant impact on student achievement; and (5) Neither exposure to one year nor exposure to two years of comprehensive induction had a positive impact on retention or other teacher workforce outcomes. The following are appended: (1) Supplemental Information for Chapters II and III; (2) Supplemental Information for Chapter IV; (3) Sensitivity Analyses and Supplemental Information for Chapter V; and (4) Sensitivity Analyses and Supplemental Information for Chapter VI.
Reviews of Individual Studies K-8 -1
Teacher incentive pay and educational outcomes: Evidence from the New York City Bonus Program. (2010)
Teacher compensation schemes are often criticized for lacking a performance-based component. Proponents of merit pay argue that linking teacher salaries to student achievement will incentivize teachers to focus on raising student achievement and stimulate innovation across the school system as a whole. In this paper, we utilize a policy experiment conducted in the New York City public school system to explore the effects of one performance-based bonus scheme. We investigate potential impacts of group-based incentive pay over two academic years (2007-2008 and 2008-2009) on a range of outcomes including: teacher effort, student performance in math and reading, and classroom activities, measured through environmental surveys of teachers and students. We also explore impacts on the market for teachers by examining teacher turnover and the qualifications of newly hired teachers. Overall, we find the bonus program had little impact on any of these outcomes. We argue that the lack of bonus program impacts can be explained by the structure of the bonus program. Group bonuses led to free-riding, which significantly reduced the program's incentives. Once we account for free-riding, we find evidence that the program led teachers to increase their effort through a significant reduction in absenteeism. When considering the effectiveness of performance-based teacher pay, the structure of incentives matter. (Contains 11 tables, 3 figures and 24 footnotes.)
Reviews of Individual Studies PK-12 -1
Toward reduced poverty across generations: Early findings from New York City's conditional cash transfer program. (2010)
Aimed at low-income families in six of New York City's highest-poverty communities, Family Rewards ties cash rewards to a pre-specified set of activities and outcomes thought to be critical to families' short- and long-term success in the areas of children's education, family preventive health care, and parents' employment. The purpose of this project is to experimentally evaluate the effects of this three-year innovative holistic conditional cash transfer (CCT) initiative. This paper presents initial findings from an ongoing and comprehensive evaluation of Family Rewards. It examines the program's implementation in the field and families' responses to it during the first two of its three years of operations, and early findings on the program's impacts on children's educational processes and outcomes. More specifically, this paper addresses the following questions: (1) What are the effects of ONYC-Family Rewards on family income, poverty, and financial hardship?; (2) What are the effects of ONYC-Family Rewards on use of health care and health insurance?; (3) What are the effects of ONYC-Family Rewards on parents' employment and educational attainment?; and (4) What are the effects of ONYC-Family Rewards on children's educational outcomes? Overall, this study shows that, despite an extraordinarily rapid start-up, the program was operating largely as intended by its second year. Although many families struggled with the complexity of the program, most were substantially engaged with it and received a large amount of money for meeting the conditions it established. Specifically, nearly all families (98 percent) earned at least some rewards in both program years, with payments averaging more than $6,000 during the first two program years combined. The program reduced current poverty and hardship; increased savings; increased families' continuous use of health insurance coverage and increased their receipt of medical care; and increased employment in jobs that are not covered by the unemployment insurance (UI) system but reduced employment in UI-covered jobs. The program has had mixed success in improving children's academic performance specifically. Contrary to expectations, Family Rewards did not affect school attendance or annual standardized test scores in Math and English Language Arts (ELA) for either group of youngest children, but did lead to notable gains for a group of more academically prepared high school students. The program also had important effects on several key proposed mediators of the intervention. However, these effects vary by parents with different age groups of children. Appended are: (1) References; and (2) Tables and Figures. (Contains 2 tables.)
Reviews of Individual Studies 2-9 -1
Financial incentives and student achievement: Evidence from randomized trials (NBER Working Paper 15898). (2010)
This paper describes a series of school-based randomized trials in over 250 urban schools designed to test the impact of financial incentives on student achievement. In stark contrast to simple economic models, our results suggest that student incentives increase achievement when the rewards are given for inputs to the educational production function, but incentives tied to output are not effective. Relative to popular education reforms of the past few decades, student incentives based on inputs produce similar gains in achievement at lower costs. Qualitative data suggest that incentives for inputs may be more effective because students do not know the educational production function, and thus have little clue how to turn their excitement about rewards into achievement. Several other models, including lack of self-control, complementary inputs in production, or the unpredictability of outputs, are also consistent with the experimental data.
Reviews of Individual Studies 2-4 -1
Improving reading fluency and comprehension in elementary students using Read Naturally. (2010)
Difficulty learning how to read is a risk factor for school failure, low grades, behavior problems, juvenile delinquency, truancy, unemployment, jail time, and substance abuse. Reading difficulties are common in the educational setting, afflicting anywhere from 20-40 percent of students. Read Naturally is a computer-based reading program which targets the third "big idea" (i.e., accuracy and fluency with reading). The current study assessed the efficacy of the Read Naturally program in second through fourth grade elementary students in a public elementary school. Additionally, this study assessed whether improving reading abilities resulted in changes in classroom behavior problems or self-esteem. Eighty-two students from a small, public elementary school who were in need of additional reading support, according to the DIBELS Benchmark Assessments, participated in the current study. Students were matched on DIBELS scores, grade, race, and gender and then randomly assigned to either the Read Naturally condition or the Education as Usual condition. Students used the Read Naturally program for 30-45 minutes each day, five days a week, for eight weeks. Results suggested that, throughout the 16 weeks of intervention, significant improvements were generally seen on all of the reading measures over time, regardless of the condition to which students were assigned, although small effect sizes generally favored the Read Naturally intervention. Additionally, students in higher grades generally demonstrated more improvement on the WJ-III Summary Scores, WJ-III Passage Comprehension subscale, and the WJ-III Word Attack subscale, regardless of the condition to which they were assigned. Student measures suggest that Read Naturally does not result in increased self-esteem, even with improvements in academic performance. Behavior measures were inconclusive. Generally, the effects of the Read Naturally intervention appear discernible, but not incremental, suggesting that Read Naturally may not be more efficacious than typical education, but may have benefits in terms of targeting larger groups of students, being individualized to each student, and may allow another way for teachers to target the third "big idea." Future research is warranted. [The dissertation citations contained here are published with the permission of ProQuest LLC. Further reproduction is prohibited without permission. Copies of dissertations may be obtained by Telephone (800) 1-800-521-0600. Web page: http://www.proquest.com/en-US/products/dissertations/individuals.shtml.]
Reviews of Individual Studies 1-6 -1
Enhancing the effectiveness of special education programming for children with attention deficit hyperactivity disorder using a daily report card. (2010)
Children with attention deficit hyperactivity disorder (ADHD) make up a considerable proportion of students who receive special education services in schools. The present study aimed to enhance the outcomes of students with ADHD in special education settings by using a daily report card (DRC). Thirty-three children with ADHD in special education placements were randomly assigned to an intervention condition wherein behavioral consultants worked with the teacher and parent to construct and implement a DRC based on the child's individualized education plan goals and objectives. These children were compared to 30 children in a business as usual control condition. Results indicated positive effects of the DRC on observations of classroom functioning, individualized education plan goal attainment, and teacher ratings of academic productivity and disruptive behavior in the classroom. Further, a greater percentage of children with ADHD in the DRC group were normalized on measures of disruptive behavior and impairment. The intervention did not result in incremental improvement in academic achievement, teacher ratings of ADHD symptoms or impairment, or the student-teacher relationship. The implications of these results for working with children with ADHD in special education settings are discussed. (Contains 5 tables and 1 figure.)
Reviews of Individual Studies 1-5 -1
Pearson Investigations in Numbers, Data, & Space efficacy study: Final report (2010)
Reviews of Individual Studies 1-5 -1
Addressing summer reading setback among economically disadvantaged elementary students. (2010)
Much research has established the contribution of summer reading setback to the reading achievement gap that is present between children from more and less economically advantaged families. Likewise, summer reading activity, or the lack of it, has been linked to summer setback. Finally, family socioeconomic status has been linked to the access children have to books in their homes and neighborhoods. Thus, in this longitudinal experimental study we tested the hypothesis that providing elementary school students from low-income families with a supply of self-selected trade books would ameliorate summer reading setback. Thus, 852 students from 17 high-poverty schools were randomly selected to receive a supply of self-selected trade books on the final day of school over a 3-year period, and 478 randomly selected students from these same schools received no books and served as the control group. No further effort was provided in this intervention study. Outcomes on the state reading assessment indicated a statistically significant effect (p = 0.015) for providing access to books for summer reading along with a significant (d = 0.14) effect size. Slightly larger effects (d = 0.21) were found when comparing the achievement of the most economically disadvantaged students in the treatment and control groups. (Contains 3 tables and 2 notes.)
Reviews of Individual Studies 3-5 -1
The effectiveness of state certified, graduate degreed, and National Board certified teachers as determined by student growth in reading (Doctoral dissertation). (2010)
Reviews of Individual Studies 4-10 -1
The MPCP Longitudinal Educational Growth Study third year report (SCDP Milwaukee Evaluation Report #15). (2010)
This is the third-year report in a five-year evaluation of the Milwaukee Parental Choice Program (MPCP). The MPCP, which began in 1990, provides government-funded vouchers for low-income children to attend private schools in the City of Milwaukee. The general purposes of the evaluation are to analyze the effectiveness of the MPCP in terms of longitudinal student achievement growth and educational attainment as measured by high school graduation rates. The former will be primarily accomplished by measuring and estimating student growth in achievement as measured by the Wisconsin Knowledge and Concepts Examinations (WKCE) in math and reading in 2006-07, grades 3 through 8 over a five-year period. The latter will be accomplished by following the 2006-07 8th and 9th grade cohorts over a five-year period or longer. The general research design consists of a comparison between a random sample of MPCP students and a matched sample of Milwaukee Public School (MPS) students. This third year report presents results from the November 2008 WKCE tests as second year student achievement growth in MPCP relative to the matched MPS sample. We provide varying descriptive statistics comparing test score means and distributions for math and reading for 2006-07 (baseline year) and 2008-09 (second outcome year) for each sample. The report also analyzes achievement growth using several multivariate techniques and models. The primary finding in all these comparisons is that, in general, there are few statistically significant differences between levels of MPCP and MPS student achievement growth in either math or reading two years after they were carefully matched to each other. In one of the ways of estimating these results, focusing only on those students who have remained in the public or private sector for all three years, private, voucher students are slightly behind MPS students in mathematics achievement growth. The report offers several cautions in interpreting this result against the overwhelming set of results that indicate no difference in achievement growth. Appended are additional tables and study attrition. (Contains 9 tables, 2 figures, and 7 footnotes.) [Additional funding for this project was provided by the Robertson Foundation.]
Reviews of Individual Studies 4 -1
Fourth graders’ growth in reading fluency: A pretest-posttest randomized control study comparing Reading Mastery and Scott Foresman Basal Reading Program. (2010)
Reviews of Individual Studies K-12 -1
Evaluation of the DC Opportunity Scholarship Program: Final report (NCEE 2010-4018). (2010)
The District of Columbia School Choice Incentive Act of 2003, passed by Congress in January 2004, established the first federally funded, private school voucher program in the United States. Since that time, more than 8,400 students have applied for what is now called the DC Opportunity Scholarship Program (OSP), and a rigorous evaluation of the Program, mandated by Congress, has been underway. This last formal report from the ongoing evaluation describes the impacts of the Program at least four years after families who applied and were given the option to move from a public school to a participating private school of their choice. The research priorities for the evaluation were shaped largely by the primary topics of interest specified in the statute. This legislative mandate led the evaluators to focus on the following research questions: (1) What is the impact of the Program on student academic achievement? (2) What is the impact of the Program on other student measures? (3) What effect does the Program have on school safety and satisfaction? (4) What is the effect of attending private versus public schools? (5) To what extent is the Program influencing public schools and expanding choice options for parents in Washington, DC? These research questions are consistent with the topics that scholars and policymakers have identified as important questions of interest surrounding private school scholarship programs. The report found that that the Program had mixed longer-term effects on participating students and their parents, including: (1) No conclusive evidence that the OSP affected student achievement overall, or for the high-priority group of students who applied from "schools in need of improvement"; (2) The Program significantly improved students' chances of graduating from high school, according to parent reports. Overall, 82 percent of students offered scholarships received a high school diploma, compared to 70 percent of those who applied but were not offered scholarships. This graduation rate improvement also held for the subgroup of OSP students who came from "schools in need of improvement."; and (3) Although parents had higher satisfaction and rated schools as safer if their child was offered or used an OSP scholarship, students reported similar ratings for satisfaction and safety regardless of whether they were offered or used a scholarship. Appendices include: (1) Research Methodology; (2) Benjamini-Hochberg Adjustments for Multiple Comparisons; (3) Sensitivity Testing; (4) Relationship Between Attending a Private School and Key Outcomes; (5) Detailed ITT Tables; (6) Exploration of Whether Parents Get What They Seek From School Choice; (7) To What Extent Are Treatment Effects of the OSP Observed Across the Outcome Test-Score Distribution? Quantile Regression Analysis of the OSP; and (8) Intermediate Outcome Measures. (Contains 99 tables, 31 figures, and 61 footnotes.)
Reviews of Individual Studies 4-8 -1
An evaluation of the Teacher Advancement Program (TAP) in Chicago: Year two impact report. (2010)
In 2007, the Chicago Public Schools (CPS) began implementing a schoolwide reform called the Teacher Advancement Program (TAP) using funds from the federal Teacher Incentive Fund (TIF) and private foundations. Under the TAP model, teachers can earn extra pay and responsibilities through promotion to mentor or master teacher as well as annual performance bonuses based on a combination of their value added to student achievement and observed performance in the classroom. The idea behind the program is that performance incentives, combined with tools for teachers to track performance and improve instruction, should help schools attract and retain talented teachers and help all teachers produce greater student achievement. This report provides evidence on the impacts of TAP during the 2008-2009 school year, the second year of the program's rollout in CPS. Appended are: (1) Propensity Score Matching; and (2) Longitudinal Analysis of Test Score Data. (Contains 18 tables, 7 figures and 14 footnotes.) [For the Year One Impact Report, see ED507502.]
Reviews of Individual Studies 4-7 -1
The evaluation of charter school impacts: Final report (NCEE 2010-4029). (2010)
Adding to the growing debate and evidence base on the effects of charter schools, this evaluation was conducted in 36 charter middle schools in 15 states. It compares the outcomes of 2,330 students who applied to these schools and were randomly assigned by lotteries to be admitted (lottery winners) or not admitted (lottery losers) to the schools. Both sets of students were tracked over two years and data on student achievement, academic progress, behavior, and attitudes were collected. The study is the first large-scale randomized trial of the effectiveness of charter schools in varied types of communities and states. Among the key findings were that, on average, charter middle schools that held lotteries were neither more nor less successful than traditional public schools in improving math or reading test scores, attendance, grade promotion, or student conduct within or outside of school. Being admitted to a study charter school did significantly improve both students' and parents' satisfaction with school. Charter middle schools' impact on student achievement varied significantly across schools. Charter middle schools in urban areas--as well as those serving higher proportions of low-income and low achieving students--were more effective (relative to their nearby traditional public schools) than were other charter schools in improving math test scores. Some operational features of charter middle schools were associated with less negative impacts on achievement. These features include smaller enrollments and the use of ability grouping in math or English classes. There was no significant relationship between achievement impacts and the charter schools' policy environment. Because the study could only include charter middle schools that held lotteries, the results do not necessarily apply to the full set of charter middle schools in the U.S. Appended are: (1) Selecting the Charter School and Student Samples; (2) Calculation of Sample Weights; (3) Outcome Measures for the Impact Analysis; (4) Analytic Methods; (5) Supplemental Materials for Chapter III; (6) Supplemental Tables for Chapter IV; and (7) Supplemental Tables for Chapter V. (Contains 78 tables, 29 figures, and 164 footnotes.) [For the study snapshot of this full report, see ED510574.]
Reviews of Individual Studies 4-5 -1
Culture and the interaction of student ethnicity with reward structure in group learning. (2009)
This study tests the hypothesis that cultural differences in group orientation predict an interaction between the student variable--ethnicity--and a learning context variable--reward structure--on math performance after group learning. One hundred and thirty-two African-American and European-American female and male fourth and fifth grade students studied math estimation in one of three group learning contexts. The learning contexts operationalized were: intergroup competitive, interpersonally competitive, and communal-no reward. ANCOVA confirmed a predicted interaction of ethnicity with learning context on post study session performance. Although there was no difference overall, African-American and European-American students performed best in the aggregate in different contexts. Independent ratings of students' group-positive behaviors mirrored the two-way interaction between learning context and ethnicity. The findings suggest that important student variables interact with the variable elements of group learning and should be studied in greater detail. They also support Boykin's (1994) contention that the cultural context of learning is a critical mediator of children's achievement. (Contains 4 tables, 3 figures and 7 footnotes.)
Reviews of Individual Studies 4-5 -1
Dissemination of the Coping Power program: Importance of intensity of counselor training. (2009)
This study examined an important but rarely investigated aspect of the dissemination process: the intensity of training provided to practitioners. Counselors in 57 schools were randomly assigned to 1 of 3 conditions: Coping Power-training plus feedback (CP-TF), Coping Power-basic training (CP-BT), or a comparison condition. CP-TF counselors produced reductions in children's externalizing behavior problems and improvements in children's social and academic skills in comparison to results for target children in both the comparison and the CP-BT conditions. Training intensity was critical for successful dissemination, although the implementation mechanism underlying this effect remains unclear, as condition effects were not significant for completion of session objectives but were significant for the quality of counselors' engagement with children. (Contains 3 tables and 3 footnotes.)
Reviews of Individual Studies 4-5 -1
eMINTS 2009 Program Evaluation Report: An analysis of the persistence of program impact on student achievement. (2009)
Reviews of Individual Studies K-12 -1
Evaluation of the DC Opportunity Scholarship Program: Impacts after three years (NCEE 2009-4050). (2009)
The "District of Columbia School Choice Incentive Act of 2003," passed by the Congress in January 2004, established the first federally funded, private school voucher program in the United States. The purpose of the new scholarship program was to provide low-income residents, particularly those whose children attend schools in need of improvement or corrective action under the "Elementary and Secondary Education Act," with "expanded opportunities to attend higher performing schools in the District of Columbia" (Sec. 303). As part of this legislation, the Congress mandated a rigorous evaluation of the impacts of the Program, now called the "DC Opportunity Scholarship Program" (OSP). This report presents findings from the evaluation on the impacts three years after families who applied were given the option to move from a public school to a participating private school of their choice. The evaluation is based on a randomized controlled trial design that compares the outcomes of eligible applicants randomly assigned to receive (treatment group) or not receive (control group) a scholarship through a series of lotteries. The main findings of the evaluation so far include: (1) After 3 years, there was a statistically significant positive impact on reading test scores, but not math test scores; (2) The OSP had a positive impact overall on parents' reports of school satisfaction and safety, but not on students' reports; (3) This same pattern of findings holds when the analysis is conducted to determine the impact of using a scholarship rather than being offered a scholarship; (4) The OSP improved reading achievement for 5 of the 10 subgroups examined; and (5) No achievement impacts were observed for five other subgroups of students, including those who entered the Program with relative academic disadvantage. Six appendices are included: (1) Research Methodology; (2) Benjamini-Hochberg Adjustments for Multiple Comparisons; (3) Sensitivity Testing; (4) Detailed ITT Tables; (5) Relationship Between Attending a Private School and Key Outcomes; and (6) Intermediate Outcome Measures.. (Contains 115 footnotes, 15 figures and 129 tables.) [For Executive Summary, see ED504784. For "Evaluation of the DC Opportunity Scholarship Program: Impacts after Two Years", see ED501696. For "Evaluation of the DC Opportunity Scholarship Program: Impacts after One Year", see ED497154.]
Reviews of Individual Studies 4 -1
Effectiveness of reading and mathematics software products [Academy of Reading]: Findings from two student cohorts (NCEE 2009-4041) (2009)
In the No Child Left Behind Act (NCLB), Congress called for the U.S. Department of Education (ED) to conduct a rigorous study of the conditions and practices under which educational technology is effective in increasing student academic achievement. A 2007 report presenting study findings for the 2004-2005 school year, indicated that, after one school year, differences in student test scores were not statistically significant between classrooms that were randomly assigned to use software products and those that were randomly assigned not to use products. School and teacher characteristics generally were not related to whether products were effective. The second year of the study examined whether an additional year of teaching experience using the software products increased the estimated effects of software products on student test scores. The evidence for this hypothesis is mixed. For reading, there were no statistically significant differences between the effects that products had on standardized student test scores in the first year and the second year. For sixth grade math, product effects on student test scores were statistically significantly lower (more negative) in the second year than in the first year, and for algebra I, effects on student test scores were statistically significantly higher in the second year than in the first year. The study also tested whether using any of the 10 software products increased student test scores. One product had a positive and statistically significant effect. Nine did not have statistically significant effects on test scores. Five of the insignificant effects were negative and four were positive. Study findings should be interpreted in the context of design and objectives. The study examined a range of reading and math software products in a range of diverse school districts and schools. But it did not study many forms of educational technology and it did not include many types of software products. How much information the findings provide about the effectiveness of products that are not in the study is an open question. Products in the study also were implemented in a specific set of districts and schools, and other districts and schools may have different experiences with the products. The findings should be viewed as one element within a larger set of research studies that have explored the effectiveness of software products. Three appendixes are included: (1) Second-Year Data Collection and Response Rates; (2) Description of Sample for the 10 Products; and (3) Details of Estimation Methods. (Contains 29 footnotes, 4 figures and 24 tables.
Reviews of Individual Studies 4 -1
Effectiveness of reading and mathematics software products [LeapTrack]: Findings from two student cohorts (NCEE 2009-4041) (2009)
In the No Child Left Behind Act (NCLB), Congress called for the U.S. Department of Education (ED) to conduct a rigorous study of the conditions and practices under which educational technology is effective in increasing student academic achievement. A 2007 report presenting study findings for the 2004-2005 school year, indicated that, after one school year, differences in student test scores were not statistically significant between classrooms that were randomly assigned to use software products and those that were randomly assigned not to use products. School and teacher characteristics generally were not related to whether products were effective. The second year of the study examined whether an additional year of teaching experience using the software products increased the estimated effects of software products on student test scores. The evidence for this hypothesis is mixed. For reading, there were no statistically significant differences between the effects that products had on standardized student test scores in the first year and the second year. For sixth grade math, product effects on student test scores were statistically significantly lower (more negative) in the second year than in the first year, and for algebra I, effects on student test scores were statistically significantly higher in the second year than in the first year. The study also tested whether using any of the 10 software products increased student test scores. One product had a positive and statistically significant effect. Nine did not have statistically significant effects on test scores. Five of the insignificant effects were negative and four were positive. Study findings should be interpreted in the context of design and objectives. The study examined a range of reading and math software products in a range of diverse school districts and schools. But it did not study many forms of educational technology and it did not include many types of software products. How much information the findings provide about the effectiveness of products that are not in the study is an open question. Products in the study also were implemented in a specific set of districts and schools, and other districts and schools may have different experiences with the products. The findings should be viewed as one element within a larger set of research studies that have explored the effectiveness of software products. Three appendixes are included: (1) Second-Year Data Collection and Response Rates; (2) Description of Sample for the 10 Products; and (3) Details of Estimation Methods. (Contains 29 footnotes, 4 figures and 24 tables.
Reviews of Individual Studies 4 -1
A multisite cluster randomized trial of the effects of Compass Learning Odyssey® Math on the math achievement of selected grade 4 students in the Mid-Atlantic region (NCEE 2009-4068). (2009)
In an effort to identify instructional methods that might improve mathematics learning at the grade 4 level when used in a variety of educational settings under typical conditions, the REL Mid-Atlantic research team looked for promising, replicable practices that were being used broadly by teachers in U.S. schools, for which research showed promising results but had not been conducted using methodologies that can establish causal relationships. CompassLearning's Odyssey[R] Math product met all of these criteria. Odyssey Math is a computer-based math curriculum developed by CompassLearning, Inc., to improve math learning for K-12 students. The software consists of a web-accessed series of learning activities, assessments, and math tools. These components constitute the basic framework of the software. CompassLearning professional development trainers presented the learning activities, math tools, and assessments as available options to intervention teachers during the summer professional development session. This study was the first randomized controlled trial to assess the impact of Odyssey Math on student achievement. The study had the statistical power needed to detect a 0.20 effect size and was well designed in that comparable groups were created at baseline and maintained through posttesting. Implementation during the school year was documented and shown to be consistent with typical implementation of the Odyssey Math software. The results from the multilevel model with pretest covariates also indicate that Odyssey Math did not yield a statistically significant impact on end-of-year student achievement. This study generated a statistically unbiased estimate of the effect of Odyssey Math on student achievement when implemented in typical school settings with typical teacher and student use. However, the findings apply only to participating schools, teachers, and students because the study used a volunteer sample. Twelve appendices include: (1) Detailed Professional Development Agenda Sessions; (2) Statistical Power Analysis; (3) Probability of Assignment to Study Conditions; (4) Sample Size from Random Assignment to Data Analysis; (5) Teacher Survey, Fall 2007; (6) Observation Protocols; (7) Odyssey Math Sample Screens; (8) Fidelity Observation Comparisons; (9) Model Variance and Intraclass Correlations; (10) Complete Multilevel Model Results for Research Question 1; (11) Comparison of Assumed Population Parameters for Statistical Power (During Planning Phase) with Corresponding Sample Statistics (During Analysis Phase); and (12) Equations for Multilevel Model Analyses. (Contains 3 figures, 22 tables, 10 exhibits, and 23 footnotes.) [This report was prepared for the National Center for Education Evaluation and Regional Assistance, Institute of Education Sciences under contract with Regional Educational Laboratory Mid-Atlantic administered by Pennsylvania State University.]
Reviews of Individual Studies 1-12 -1
Effectiveness of reading and mathematics software products: Findings from two student cohorts. (2009)
In the No Child Left Behind Act (NCLB), Congress called for the U.S. Department of Education (ED) to conduct a rigorous study of the conditions and practices under which educational technology is effective in increasing student academic achievement. A 2007 report presenting study findings for the 2004-2005 school year, indicated that, after one school year, differences in student test scores were not statistically significant between classrooms that were randomly assigned to use software products and those that were randomly assigned not to use products. School and teacher characteristics generally were not related to whether products were effective. The second year of the study examined whether an additional year of teaching experience using the software products increased the estimated effects of software products on student test scores. The evidence for this hypothesis is mixed. For reading, there were no statistically significant differences between the effects that products had on standardized student test scores in the first year and the second year. For sixth grade math, product effects on student test scores were statistically significantly lower (more negative) in the second year than in the first year, and for algebra I, effects on student test scores were statistically significantly higher in the second year than in the first year. The study also tested whether using any of the 10 software products increased student test scores. One product had a positive and statistically significant effect. Nine did not have statistically significant effects on test scores. Five of the insignificant effects were negative and four were positive. Study findings should be interpreted in the context of design and objectives. The study examined a range of reading and math software products in a range of diverse school districts and schools. But it did not study many forms of educational technology and it did not include many types of software products. How much information the findings provide about the effectiveness of products that are not in the study is an open question. Products in the study also were implemented in a specific set of districts and schools, and other districts and schools may have different experiences with the products. The findings should be viewed as one element within a larger set of research studies that have explored the effectiveness of software products. Three appendixes are included: (1) Second-Year Data Collection and Response Rates; (2) Description of Sample for the 10 Products; and (3) Details of Estimation Methods. (Contains 29 footnotes, 4 figures and 24 tables.
Reviews of Individual Studies 2-8 -1
Impact of for-profit and nonprofit management on student achievement: The Philadelphia intervention 2002-2008 (Working Paper PEPG 09-02). (2009)
At the request of the State of Pennsylvania, the School District of Philadelphia, in the summer of 2002, asked three for-profit firms to assume responsibility for 30 of its lowest-performing schools and it asked four nonprofit managers to assume the management of 16 other low-performing schools. A difference-in-differences analysis is used to estimate the impact of nonprofit and for-profit management on individual student achievement. Gains in test scores at the treated schools are estimated by comparing them with gains in other low-performing schools in the district. Students at schools under for-profit management outperformed those at schools under nonprofit management in all six years in both reading and math. Most estimations are statistically significant. Impacts of for-profit management relative to district management were positive in math, but no reading impacts could be detected. At nonprofits, students appear to have learned substantially less, especially in math, at nonprofit schools, than had their school remained under regular district management. However, impacts fell short of statistical significance. (Propensity Score Analysis is appended. Contains 21 endnotes and 9 tables.)
Reviews of Individual Studies K-5 -1
An evaluation of teachers trained through different routes to certification: Final report (NCEE 2009-4043). (2009)
This study addresses two questions related to teacher preparation and certification: (1) What are the relative effects on student achievement of teachers who chose to be trained through different routes to certification and how do observed teacher practices vary by chosen route to certification?; and (2) What aspects of certification programs (such as the amount of coursework, the timing of coursework relative to being the lead teacher in the classroom, the core coursework content) are associated with teacher effectiveness? In 63 study schools, every grade that contained at least one eligible alternatively certified (AC) and one eligible traditionally certified (TC) teacher was included. Students in these study grades were randomly assigned to be in the class of an AC or a TC teacher. Students were tested at the beginning of the school year as a baseline measure and at the end of the year as an outcome. Classroom instruction was observed at one point during the year as an outcome. Reported findings include: (1) Both the AC and the TC programs with teachers in the study were diverse in the total instruction they required for their candidates; (2) While teachers trained in TC programs receive all their instruction (and participate in student teaching) prior to becoming regular full-time teachers, AC teachers do not necessarily begin teaching without having received any formal instruction; (3) There were no statistically significant differences between the AC and TC teachers in this study in their average scores on college entrance exams, the selectivity of the college that awarded their bachelor's degree, or their level of educational attainment; (4) There was no statistically significant difference in performance between students of AC teachers and those of TC teachers; (5) There is no evidence from this study that greater levels of teacher training coursework were associated with the effectiveness of AC teachers in the classroom; and (6) There is no evidence that the content of coursework is correlated with teacher effectiveness. Supplementary Technical Information on Data Collection, Response Rates, and Analyses is appended. (Contains 90 footnotes and 28 exhibits.)
Reviews of Individual Studies K-6 -1
Impacts of comprehensive teacher induction: Results from the first year of a randomized controlled study (NCEE 2009-4034). (2008)
In practice, teacher induction is common, but induction that is intensive, comprehensive, structured, and sequentially delivered in response to teachers' emerging pedagogical needs is less so. Congressional interest in formal, comprehensive teacher induction has grown in recent years. The National Center for Education Evaluation and Regional Assistance within the U.S. Department of Education's (ED) Institute of Education Sciences (IES) contracted with Mathematica Policy Research, Inc. (MPR), to evaluate the impact of structured and intensive teacher induction programs. The study examines whether comprehensive teacher induction programs lead to higher teacher retention rates and other positive teacher and student outcomes as compared to prevailing, generally less comprehensive approaches to supporting new teachers. More specifically, the study is designed to address five research questions on the impacts of teacher induction services: (1) What is the effect of comprehensive teacher induction on the types and intensity of induction services teachers receive compared to the services they receive from the districts' current induction programs?; (2) What are the impacts on teachers' classroom practices?; (3) What are the impacts on student achievement?; (4) What are the impacts on teacher retention?; and (5) What is the impact on the composition of the district's teaching workforce? Statistically significant differences between the treatment and control groups were identified in the amount, types, and content of induction support teachers reported having received, both in the fall and the spring of the intervention year. Although treatment teachers reported receiving more mentoring than did control teachers; were more likely than control teachers to report participating in specific induction activities; and spent more time in certain professional activities than did control teachers during the three months prior to the spring survey, summarized comparisons between treatment and control groups found: (1) No impacts on teacher practices; (2) No positive impacts on student test scores; (3) No impacts on teacher retention; and (4) No positive impacts on composition of district teaching workforce. This report focused on the first year of findings only. The research team is conducting longer term follow-up to include additional collection of test score and teacher mobility data. Eight appendices are included: (1) National Data on Teacher Induction; (2) Analysis Weights; (3) Impact Estimation Methods; (4) Classroom Observation Methods; (5) Reference Tables for Chapter II; (6) Supplemental Tables for Chapter IV; (7) Supplemental Tables for Chapter V; and (8) Supplemental Figures. (Contains 43 footnotes, 15 figures and 101 tables.)
Reviews of Individual Studies 2-5 -1
National Board Certification and teacher effectiveness: Evidence from a random assignment experiment (NBER Working Paper No. 14608). (2008)
The National Board for Professional Teaching Standards (NBPTS) assesses teaching practice based on videos and essays submitted by teachers. We compared the performance of classrooms of elementary students in Los Angeles randomly assigned to NBPTS applicants and to comparison teachers. We used information on whether each applicant achieved certification, along with information on each applicant's NBPTS scaled score and subscores, to test whether the NBPTS score was related to teacher impacts on student achievement. We found that students randomly assigned to highly-rated applicants performed better than students assigned to comparison teachers, while students assigned to poorly-rated applicants performed worse. Estimates were similar using data on pairs of teachers that were not randomly assigned. Our results suggest a number of changes that would improve the predictive power of the NBPTS process.
Reviews of Individual Studies 1-6 -1
Effects of social development intervention in childhood 15 years later. (2008)
Reviews of Individual Studies 3-5 -1
The effects of Read Naturally on fluency and reading comprehension: A supplemental service intervention (four-school study) (2008)
Reviews of Individual Studies 4 -1
Using a system of least prompts procedure to teach telephone skills to elementary students with cognitive disabilities. (2008)
Using the telephone to contact others can be an important skill in maintaining friendships with peers. This investigation used a system of least prompts (SLP) procedures to teach two telephone skills to 3 elementary students with cognitive disabilities: (a) placing phone calls and (b) leaving recorded voicemail messages. The SLP procedure was effective in teaching both skills to all 3 students. Results for maintenance and generalization, however, were mixed.
Reviews of Individual Studies K-4 -1
Evaluation of the effectiveness of an early literacy program for students with significant developmental disabilities (2008)
This study evaluated the impact of a curriculum called the Early Literacy Skills Builder on the language and early literacy skills of students with significant developmental disabilities. Students in the control group received the ongoing sight word and picture instruction prescribed by their individualized education programs. Results indicate statistically significant interaction effects for the treatment group for two research team-designed measures of early literacy (the Nonverbal Literacy Assessment and a pretest/posttest for the experimental curriculum). Significant interaction effects were also found for two standardized measures (Peabody Picture Vocabulary Test III and Memory for Sentences of the Woodcock Language Proficiency Battery). Implications and future research needs are provided.
Reviews of Individual Studies 4-9 -1
High school students as mentors: Findings from the Big Brothers Big Sisters school-based mentoring impact study. (2008)
High schools have recently become a popular source of mentors for school-based mentoring (SBM) programs. The high school Bigs program of Big Brothers Big Sisters of America, for example, currently involves close to 50,000 high-school-aged mentors across the country. While the use of these young mentors has several potential advantages, their age raises questions about their capacity to be consistent, positive role models, and, in turn, their potential to yield strong impacts for the youth they mentor. With support from The Atlantic Philanthropies and in collaboration with Big Brothers Big Sisters of America, Public/Private Ventures set out to address these questions using data from our large-scale random assignment impact study of Big Brothers Big Sisters SBM (Herrera, et al. 2007). We found that, on average, high school students were much less effective than adults at yielding impacts for the youth they mentor. However, our research identified several program practices that were linked with longer, stronger and more effective high school mentor relationships. High School Students as Mentors stresses the need for programs with high school volunteers to use the inherent strengths of these volunteers and, at the same time, meet their distinct needs. Big Brothers Big Sisters of America is already initiating most of the changes suggested in the study in its high school Bigs program; it has convened a group of six of its strongest Big Brothers Big Sisters agencies to review these and other findings and share their own experiences and strategies in an effort to strengthen their model. (Contains 41 endnotes, 3 figures and 2 tables.)
Reviews of Individual Studies 4-5 -1
Improved reading skills by students in the South Madison Community School Corporation who used Fast ForWord® products. (2007b)
Reviews of Individual Studies 4-8 -1
Functional assessment-based intervention for selective mutism. (2007)
The process of functional assessment has emerged as an essential component for intervention development. Applications across divergent types of problem behavior, however, remain limited. This study evaluated the applicability of this promising approach to students with selective mutism. Two middle school students served as participants. The functional assessment included indirect and direct methods as well as a specially designed student interview that did not require speech. Individualized interventions were developed and experimentally evaluated. Results indicated that the assessment-based interventions effectively increased speaking in school contexts. (Contains 2 figures.)
Reviews of Individual Studies 3-5 -1
The National Board effect: Does the certification process influence student achievement? (Doctoral dissertation). (2007)
Reviews of Individual Studies 3-5 -1
Can teacher quality be effectively assessed? National Board Certification as a signal of effective teaching. (2007)
In this paper, we describe the results a study assessing the relationship between the certification of teachers by the National Board for Professional Teaching Standards (NBPTS) and elementary level student achievement. We examine whether NBPTS assesses the most effective applicants, whether certification by NBPTS serves as a signal of teacher quality, and whether completing the NBPTS assessment process serves as catalyst for increasing teacher effectiveness. We find consistent evidence that NBPTS is identifying the more effective teacher applicants and that National Board Certified Teachers are generally more effective than teachers who never applied to the program. The statistical significance and magnitude of the "NBPTS effect," however, differs significantly by grade level and student type. We do not find evidence that the NBPTS certification process itself does anything to increase teacher effectiveness. Data tables are appended. (Contains 7 tables, 1 figure, and 49 endnotes.)
Reviews of Individual Studies 3-8 -1
Evaluation of supplemental education services in Minneapolis Public Schools: An application of matched sample statistical design (2007)
Reviews of Individual Studies 2-8 -1
Effect of technology-enhanced continuous progress monitoring on math achievement. (2007)
We examined the extent to which use of a technology-enhanced continuous progress monitoring system would enhance the results of math instruction, examined variability in teacher implementation of the program, and compared math results in classrooms in which teachers did and did not use the system. Classrooms were randomly assigned to within-school experimental and control groups. Participating students were pre- and post-tested using two standardized, nationally normed tests of math achievement. When teachers implemented the continuous progress monitoring system as intended, and when they used the data from the system to manage and differentiate instruction, students gained significantly more than those for whom implementation was limited or nil. Failure to take into account intervention integrity would have made it look like continuous progress monitoring did not enhance math results. (Contains 5 tables.)
Reviews of Individual Studies PK-12 -1
The impact of supplemental educational services participation on student achievement: 2005-06. (2007)
Reviews of Individual Studies K-8 -1
Students in Western Australia improve language and literacy skills: Educator’s briefing. (2007)
Reviews of Individual Studies 2-4 -1
Teaching spelling to students with learning disabilities: A comparison of rule-based strategies versus traditional instruction. (2006)
This study compared two instructional methods for teaching spelling to elementary students with learning disabilities (LD). Forty-two elementary students with LD were randomly assigned to one of two instructional groups to teach spelling words: (a) a rule-based strategy group that focused on teaching students spelling rules (based on the "Spelling Mastery Level D" program) and (b) a traditional instruction group that provided an array of spelling activities (i.e., introducing the words in the context of story, defining the meaning of the words, sentence writing, and dictionary skill training) to teach spelling words. Daily instructional sessions lasting 30 minutes were conducted for 4 consecutive weeks. Four different word types (i.e., regular, morphological, spelling rule, and irregular) were introduced as instruction progressed. After receiving instruction in one of the instructional groups, the students were compared on scores from unit tests, a standardized test, a sentence-writing test, a transfer test, and a maintenance test. Overall results indicated that the rule-based strategy group using "Spelling Mastery Level D" was more effective in increasing student-spelling performance, particularly for the regular, morphological, and spelling-rule words. The instructional implications of these findings are discussed. (Contains 7 tables.)
Reviews of Individual Studies 3-5 -1
Increasing student achievement in writing through teacher inquiry: An evaluation of professional development impact. (2006)
Reviews of Individual Studies 4-6 -1
Effects of prior attention training on child dyslexics’ response to composition instruction. (2006)
Reviews of Individual Studies 4-6 -1
Accelerated Math in grades 4 through 6: evaluation of an experimental program in 15 schools in North Rhine-Westphalia. (2005)
Reviews of Individual Studies 4-8 -1
A study of the relationship between the National Board Certification status of teachers and students’ achievement: Technical report. (2005)
Reviews of Individual Studies 4-5 -1
The effects of developmental mentoring and high school mentors’ attendance on their younger mentees’ self-esteem, social skills, and connectedness. (2005)
Low-income students and students whose parents have not attended college typically are less likely than middle- and upper-income students to complete high school and attend college, and are thus less likely to reap the benefits of attending college. Lack of information, resources, and exposure to others who have navigated the college process may be substantial hurdles for these students. Federal financial aid is available through Pell Grants, college tuition tax credits, and student loan programs, but low-income students may not be taking full advantage of these sources. Even low-income students with high educational aspirations may find the financial aid and college application processes overwhelming and discouraging. The Talent Search program primarily provides information on the types of high school courses students should take to prepare for college and on the financial aid available to pay for college. The program also helps students access financial aid through applications for grants, loans, and scholarships, and orients students to different types of colleges and the college application process. After a two-year implementation study, the U.S. Department of Education's Policy and Program Studies Service selected Mathematica Policy Research Inc. (MPR) in 2000 to assess the effect of Talent Search in selected states. The study team opted to compile data from administrative records from many sources, including program, state, and federal records, to evaluate the effectiveness of federal education programs, partly as a test of whether such an evaluation was feasible. The study also yielded useful information about the effectiveness of the Talent Search program. It included an analysis of the effectiveness of the Talent Search program in Florida, Indiana, and Texas. The study team's analysis was based on administrative data compiled in these three states and a quasi-experimental design to create matched comparison groups. The findings presented in this report suggest that assisting low-income students who have college aspirations to overcome information barriers--an important objective of the Talent Search program--may be effective in helping these students achieve their aspirations. Practical information--direct guidance on how to complete applications for financial aid and admission to college and what a college campus looks and feels like--may have been one of the key services that Talent Search projects delivered. Appended are: (1) Chapter Tables; and (2) Compilation of Data Sources and Feasibility of Evaluations Based on Administrative Records. (Contains 38 tables and 15 figures.)
Reviews of Individual Studies 4-8 -1
Balanced, strategic reading instruction for upper-elementary and middle school students with reading disabilities: A comparative study of two approaches. (2005)
This study compared the use of two supplemental balanced and strategic reading interventions that targeted the decoding, fluency, and reading comprehension of upper-elementary and middle school students with reading disabilities (RD). All students had significant delays in decoding, fluency, comprehension, and language processing. Two comparable, intensive tutorial treatments differed only in the degree of explicitness of the comprehension strategy instruction. Overall, there was meaningful progress in students' reading decoding, fluency, and comprehension. Gains in formal measures of word attack and reading fluency after five weeks of intervention translated into grade-equivalent gains of approximately half a school year. Analysis of the trends in the daily informal fluency probes translated into a weekly gain of 1.28 correct words per minute. The more explicit comprehension strategy instruction was more effective than the less explicit treatment. Findings are discussed in light of the question of how to maximize the effects of reading interventions for older children with RD.
Reviews of Individual Studies 4-8 -1
Performance of District 23 students participating in Scholastic READ 180. (2005)
Reviews of Individual Studies 3-5 -1
Effects of the Accelerated Reader on reading performance of third, fourth, and fifth-grade students in one western Oregon elementary school (Doctoral dissertation). (2005)
Reviews of Individual Studies 3-6 -1
Peer-Assisted Learning Strategies for English language learners with learning disabilities. (2005)
This study assessed the effects of Peer-Assisted Learning Strategies (PALS), a reciprocal classwide peer-tutoring strategy, on the reading performance of native Spanish-speaking students with learning disabilities (LD) and their low-, average-, and high-achieving classroom peers. Participants were 132 native Spanish-speaking English language learners (ELL) in Grades 3 through 6, along with their 12 reading teachers. Teachers were assigned randomly to PALS and contrast groups. PALS sessions were conducted 3 times a week for 15 weeks. Students were tested before and after treatment. PALS students outgrew contrast students on reading comprehension, and those effects were not mediated by student type.
Reviews of Individual Studies 4 -1
Short-term effects of a literature-based character education program among fourth grade students: Report to the Young People's Press, Inc. (2005)
Reviews of Individual Studies 2-4 -1
Final report: A study on the effectiveness of the 2004 Scott Foresman–Addison Wesley Elementary Math program. (2005)
Reviews of Individual Studies 3-12 -1
Connect with Kids: 2004–2005 Study Results for Kansas and Missouri. (2005)
Reviews of Individual Studies 1-5 -1
The relationship between using Saxon Elementary and Middle School Math and student performance on Georgia statewide assessments. (2005)
Reviews of Individual Studies 4-8 -1
Improved reading achievement by students in the school district of Philadelphia who used Fast ForWord® products. (2004b)
Reviews of Individual Studies 4 -1
Improved Ohio Reading Proficiency Test scores by students in the Springfield City School District who used Fast ForWord® products. (2004a)
Reviews of Individual Studies 3-6 -1
Putting computerized instruction to the test: A randomized evaluation of a “scientifically based” reading program. (2004)
Although schools across the country are investing heavily in computers in the classroom, there is surprisingly little evidence that they actually improve student achievement. In this paper, we present results from a randomized study of a well-defined use of computers in schools: a popular instructional computer program, known as Fast ForWord, which is designed to improve language and reading skills. We assess the impact of the program on students having difficulty learning to read using four different measures of language and reading ability. Our estimates suggest that while use of the computer program may improve some aspects of students' language skills, it does not appear that these gains translate into a broader measure of language acquisition or into actual readings skills.
Reviews of Individual Studies 4-5 -1
The Coping Power program for preadolescent aggressive boys and their parents: Outcome effects at the 1-year follow-up. (2004)
This study evaluates the effects of the Coping Power Program with at-risk preadolescent boys at the time of transition from elementary school to middle school. Aggressive boys were randomly assigned to receive only the Coping Power child component, the full Coping Power Program with parent and child components, or a control condition. Results indicated that the Coping Power intervention produced lower rates of covert delinquent behavior and of parent-rated substance use at the 1-year follow-up than did the control cell, and these intervention effects were most apparent for the full Coping Power Program with parent and child components. Boys also displayed teacher-rated behavioral improvements in school during the follow-up year, and these effects appeared to be primarily influenced by the Coping Power child component.
Reviews of Individual Studies 1-6 -1
Migrant students with limited English proficiency: Can Fast ForWord® Language make a difference in their language skills and academic achievement? Remedial and Special Education, 25(6), 353–368. (2004)
This study evaluated the efficacy of the computer-assisted intervention program known as Fast ForWord Language? in a sample of migrant students in Grades 1 through 6 who were native Spanish speakers. Fast ForWord Language? combines intensive training in multiple receptive English language skills with adaptive acoustic waveform lengthening and amplification to purportedly accelerate the English language learning skills of children who are nonnative English language speakers. Students either were randomly assigned to a treatment or no-contact control condition or were matched on grade, English language proficiency, and nonverbal IQ. All students were assessed in five domains before and immediately after the 4- to 8-week intervention: (a) spoken English language proficiency; (b) oral language competency; (c) phonological awareness; (d) basic reading skills; and (e) classroom behavior. Except for performance on a measure of sight-word recognition, on which children in the treatment group achieved a significantly greater gain than those in the control group, changes in test scores from pretest to posttest were equivalent for the two groups. However, when students who were least fluent in spoken English in each group were compared, the children in the treatment group demonstrated superior gains in expressive language, sight-word recognition, and pseudoword decoding. Thus, Fast ForWord Language? had a substantial, albeit limited impact on the oral language skills and reading performance of migrant children in this study. However, due to methodological weaknesses and limited treatment fidelity, the study results must be interpreted cautiously.
Reviews of Individual Studies 2-4 -1
A comparison of Reading Mastery Fast Cycle and Horizons Fast Track A-B on the reading achievement of students with mild disabilities. (2004)
This study examined the reading gains of students with mild disabilities who were taught with one of two programs: "Horizons Fast Track A-B" (Engelmann, Engelmann, & Seitz-Davis, 1997) or "Reading Mastery Fast Cycle" (Engelmann & Bruner, 1995). A quasi-experimental design with preexisting groups was used to examine changes from pretest to posttest. Results revealed a pattern of small differences favoring "Reading Mastery Fast Cycle" on measures of decoding; however, these differences were not statistically significant. Both programs were effective in producing statistically significant improvements in word attack, comprehension, letter and word identification, phonemic awareness, and print awareness skills. Participating teachers agreed that both programs were effective; however, anecdotal information from teacher interviews suggested that all participating teachers preferred "Horizons Fast Track." (Contains 4 tables.)
Reviews of Individual Studies 2-5 -1
Effects of two tutoring programs on the English reading development of Spanish-English bilingual students. (2004)
Spanish-dominant bilingual students in grades 2-5 were tutored 3 times per week for 40 minutes over 10 weeks, using 2 English reading interventions. Tutoring took place from February through April of 1 school year. One, Read Well, combined systematic phonics instruction with practice in decodable text, and the other, a revised version of Read Naturally, consisted of repeated reading, with contextualized vocabulary and comprehension instruction. The progress of tutored students (n = 51) was compared to that of nontutored classmates (n = 42) using subtests of the Woodcock Reading Mastery Tests-Revised. Students who received systematic phonics instruction made significant progress in word identification but not in word attack or passage comprehension. There were no significant effects for students in the repeated reading condition.
Reviews of Individual Studies 2-5 -1
Large-scale evaluation of student achievement in districts using Houghton Mifflin. (2004)
Reviews of Individual Studies 2-5 -1
Technical report: Houghton Mifflin California math performance evaluation. (2003)
Reviews of Individual Studies 4-5 -1
The relationship between National Board certification for teachers and student achievement (Doctoral dissertation). (2003)
Reviews of Individual Studies 3-4 -1
Technical report: Evaluation of the Too Good for Drugs Elementary School Prevention Program. (2003)
Reviews of Individual Studies 3-8 -1
Fast ForWord® evaluation, 2002–03 (Eye on Evaluation, E&R Report No. 03. 24). (2003)

Connect With the WWC

loading
back to top