Keyword

Filters
Publication Date
1
3
59
160
299
Topic
161
143
26
53
14
21
Populations
13
19
Product Type
14
56
227
13
Grade Level
299
299
Evidence Tier
39
48
48
1
192
Locale
52
56
143

Search Results

297 Results filtered by:
Product Type Grade Level Highest Evidence Tier Name (Release Date)
Practice Guide 4-9 1
Providing Reading Interventions for Students in Grades 4–9 (March 2022)
This practice guide provides four evidence-based recommendations that teachers can use to deliver reading interventions to meet the needs of their students.
Practice Guide 6-12 1
Preventing Dropout in Secondary Schools (September 2017)
This practice guide provides school educators and administrators with four evidence-based recommendations for reducing dropout rates in middle and high schools and improving high school graduation rates. Each recommendation provides specific, actionable strategies; examples of how to implement the recommended practices in schools; advice on how to overcome potential obstacles; and a description of the supporting evidence.
Practice Guide 5-12 1
Teaching Secondary Students to Write Effectively (November 2016)
This practice guide presents three evidence-based recommendations for helping students in grades 6–12 develop effective writing skills. Each recommendation includes specific, actionable guidance for educators on implementing practices in their classrooms. The guide also summarizes and rates the evidence supporting each recommendation, describes examples to use in class, and offers the panel’s advice on how to overcome potential implementation obstacles. This guide is geared towards administrators and teachers in all disciplines who want to help improve their students’ writing.
Practice Guide K-8 1
Teaching Academic Content and Literacy to English Learners in Elementary and Middle School (April 2014)
This practice guide provides four recommendations that address what works for English learners during reading and content area instruction. Each recommendation includes extensive examples of activities that can be used to support students as they build the language and literacy skills needed to be successful in school. The recommendations also summarize and rate supporting evidence. This guide is geared toward teachers, administrators, and other educators who want to improve instruction in academic content and literacy for English learners in elementary and middle school.
Practice Guide 4-8 1
Improving Mathematical Problem Solving in Grades 4 Through 8 (May 2012)
This practice guide provides five recommendations for improving students’ mathematical problem solving in grades 4 through 8. This guide is geared toward teachers, math coaches, other educators, and curriculum developers who want to improve the mathematical problem solving of students.
Practice Guide 6-12 2
Teaching Strategies for Improving Algebra Knowledge in Middle and High School Students (April 2015)
This practice guide provides three recommendations for teaching algebra to students in middle school and high school. Each recommendation includes implementation steps and solutions for common roadblocks. The recommendations also summarize and rate supporting evidence. This guide is geared toward teachers, administrators, and other educators who want to improve their students’ algebra knowledge.
Practice Guide K-8 3
Developing Effective Fractions Instruction for Kindergarten Through 8th Grade (September 2010)
This practice guide presents five recommendations intended to help educators improve students’ understanding of fractions. Recommendations include strategies to develop young children’s understanding of early fraction concepts and ideas for helping older children understand the meaning of fractions and the computations involved. The guide also highlights ways to build on students’ existing strategies to solve problems involving ratios, rates, and proportions.
Practice Guide K-12 3
Structuring Out-of-School Time to Improve Academic Achievement (July 2009)
Out-of-school time programs can enhance academic achievement by helping students learn outside the classroom.
Practice Guide 1-8 3
Assisting Students Struggling with Mathematics: Response to Intervention (RtI) for Elementary and Middle Schools (April 2009)
Taking early action may be key to helping students struggling with mathematics.
Practice Guide 5-12 3
Improving Adolescent Literacy: Effective Classroom and Intervention Practices (August 2008)
This guide presents strategies that classroom teachers and specialists can use to increase the reading ability of adolescent students.
Practice Guide 7-12 3
Dropout Prevention (August 2008)
Geared toward educators, administrators, and policymakers, this guide provides recommendations that focus on reducing high school dropout rates.
Practice Guide K-PS 3
Encouraging Girls in Math and Science (September 2007)
The objective of this guide is to provide teachers with specific recommendations that can be carried out in the classroom without requiring systemic change.
Practice Guide K-PS 3
Organizing Instruction and Study to Improve Student Learning (September 2007)
This guide includes a set of concrete actions relating to the use of instructional and study time that are applicable to subjects that demand a great deal of content learning, including social studies, science, and mathematics.
Practice Guide K-12 4
Turning Around Chronically Low-Performing Schools (May 2008)
This guide identifies practices that can improve the performance of chronically low-performing schools—a process commonly referred to as creating "turnaround schools."
Intervention Report 4-7 1
Intelligent Tutoring for Structure Strategy (ITSS) (Adolescent Literacy) (April 2020)
Web-Based Intelligent Tutoring for the Structure Strategy (ITSS) is a supplemental web-based program for students in grades K-8. It is intended to develop literacy skills needed to understand factual texts encountered in classrooms and everyday life. The program teaches students how to follow the logical structure of factual text and to use text structure to improve understanding and recall. In particular, ITSS highlights five main text structures that are used to (1) make comparisons; (2) present problems and solutions; (3) link causes and effects; (4) present sequences; and (5) describe things, people, creatures, places, or events. The program helps students classify the structure of a passage by identifying certain key words, such as “solution” and “in contrast,” that clue readers in to the type of arguments the text is making.
Intervention Report 5-12 1
Knowledge is Power Program (KIPP) (Charter Schools) (January 2018)
The Knowledge Is Power Program (KIPP) is a nonprofit network of more than 200 public charter schools educating early childhood, elementary, middle, and high school students. Every KIPP school obtains approval to operate from a charter school authorizer. Students, parents, and teachers must sign a commitment to abide by a set of responsibilities, including high behavioral and disciplinary expectations. KIPP also has an active alumni network and set of partnerships with scholarship organizations to help guide former students through college. KIPP schools have an extended school day and an extended school year compared with traditional public schools. When demand for enrollment exceeds enrollment capacity at a KIPP school, student admission is based upon a lottery. Funding for KIPP schools comes primarily through public federal, state, and local finances, along with supplemental funding through charitable donations from foundations and individuals.
Intervention Report 4-10 1
READ 180® (Adolescent Literacy) (November 2016)
READ 180® is a reading program designed for struggling readers who are reading 2 or more years below grade level. It combines online and direct instruction, student assessment, and teacher professional development. READ 180® is delivered in 90-minute sessions that include whole-group instruction, three small-group rotations, and whole-class wrap-up. Small-group rotations include individualized instruction using an adaptive computer application, small-group instruction, and independent reading. READ 180® is designed for students in elementary through high school.
Intervention Report K-12 1
Teach for America (Teacher Training, Evaluation, and Compensation) (August 2016)
Teach For America (TFA) is a highly selective route to teacher certification that aims to place non-traditionally trained teachers in high-need public schools. Many TFA teachers hold bachelors’ degrees from selective colleges and universities, in fields outside of education. TFA teachers commit to teach for at least 2 years. TFA teachers receive 5–7 weeks of in-person training over the summer before they begin teaching, then continue to receive professional development and one-on-one coaching from TFA while teaching, in addition to support provided by their schools and districts. As full-time employees of the public schools where they work, TFA teachers receive the same salary and benefits as other first- or second-year teachers in their school or district.
Intervention Report 7-12 2
Reading Apprenticeship® (Study Review Protocol) (January 2023)
Reading Apprenticeship® is a professional development program that aims to help teachers improve their students’ literacy skills. The program also aims to improve student social-emotional learning outcomes such as belonging, social awareness, growth mindset, and self-efficacy. Reading Apprenticeship® trains teachers to model reading comprehension strategies and help students practice these strategies in their classrooms.
Intervention Report K-8 2
Dual Language Programs (Systematic Review Protocol for English Language Arts Interventions) (December 2022)
Dual language programs are long-term instructional programs that provide content and literacy instruction to all students through two languages—English and a partner language—with the goals of promoting academic achievement, bilingualism and biliteracy, and sociocultural competence. Dual language programs can be implemented with students from one language group (in one-way programs) or with students from two language groups (in two-way programs).
Intervention Report 6-12 2
Pathway to Academic Success (Pathway Project) (English Language Learners) (November 2021)
The Pathway to Academic Success Project trains teachers to improve the reading and writing abilities of English learners who have an intermediate level of English proficiency by incorporating cognitive strategies into reading and writing instruction. The cognitive strategies include goal setting, tapping prior knowledge, asking questions, making predictions, articulating and revising understanding of text, and evaluating writing.
Intervention Report 4-8 2
eMINTS Comprehensive Program (Teacher Excellence Review Protocol ) (April 2020)
The eMINTS Comprehensive Program aims to help teachers improve their practice and the outcomes of their students by offering structured professional development, coaching, and support for integrating technology into the classroom. The program’s goals include supporting teachers in using classroom technology to implement high-quality, inquiry-based learning, in which students develop understanding and knowledge of content matter by engaging in meaningful investigations that require reasoning, judgement, and decision making. The intervention can provide support to teachers in any subject area, including math, literacy, and science.
Intervention Report 2-9 2
Achieve3000 (Adolescent Literacy) (February 2018)
Achieve3000® is a supplemental online literacy program that provides nonfiction reading content to students in grades preK–12 and focuses on building phonemic awareness, phonics, fluency, reading comprehension, vocabulary, and writing skills. Achieve3000® is designed to help students advance their nonfiction reading skills by providing differentiated online instruction. Teachers use the program with an entire class but the assignments are tailored to each student’s reading ability level. For example, teachers assign an article and related activities to an entire class; the program then tailors the version of the article to each student by automatically increasing the difficulty of text when a student is ready for more challenging text. Achieve3000® provides lessons that follow a five-step routine: (1) respond to a Before Reading Poll, (2) read an article, (3) answer activity questions, (4) respond to an After Reading Poll, and (5) answer a Thought Question. Progress reports and student usage data, provided by the online tool, enable teachers to track both whole-class and individual student progress. The program is designed for diverse student groups, including general education students, struggling readers in need of intensive tutoring, and English learners.
Intervention Report 4-8 2
Odyssey® Math (Primary Mathematics) (January 2017)
Odyssey® Math is a web-based program developed by Compass Learning® for mathematics instruction in grades K–8. The online program includes a mathematics curriculum and formative assessments designed to support differentiated and data-driven instruction. Based on assessment results, the program generates an individualized sequence of mathematics topics and skills—a “learning path.” Odyssey® Math is often used as a prescriptive tool, where students can start by taking a diagnostic assessment aligned with local or state standards. Teachers can modify learning paths to match their lesson plans or to align them with district scopes and sequences.
Intervention Report K-12 3
McREL Balanced Leadership (School Leadership Review Protocol ) (March 2020)
Balanced Leadership® is a professional development program for school principals and other current and aspiring school leaders in schools serving kindergarten through grade 12. School leaders participate in professional development sessions with trained facilitators over one or two years, practice what they learn between sessions, and can receive additional coaching and online support. McREL International, the company that developed the Balanced Leadership® program, based the framework and content of the professional development on research identifying key actions and behaviors of school leaders that are associated with improved student outcomes.
Intervention Report 7-11 3
Facilitating Long-term Improvements in Graduation and Higher Education for Tomorrow (FLIGHT) (Transition to College) (April 2019)
FLIGHT is a program based on partnership of a private non-profit (Taking Stock in Children) and local educational agencies with the goal of increasing the extent to which low-income students with academic promise are prepared for, enrolled in, and successful in college. Specifically, FLIGHT provides school-based mentoring, college prep, and wrap-around services for at-risk students who show potential to be successful in postsecondary education endeavors.
Intervention Report 2-10 3
Self-Regulated Strategy Development (Students with a Specific Learning Disability) (November 2017)
Self-Regulated Strategy Development (SRSD) is an intervention designed to improve students’ academic skills through a six-step process that teaches students specific academic strategies and self-regulation skills. The practice is especially appropriate for students with learning disabilities. The intervention begins with teacher direction and ends with students independently applying the strategy, such as planning and organizing ideas before writing an essay. More specifically, the six steps involve the teacher providing background knowledge, discussing the strategy with the student, modeling the strategy, helping the student memorize the strategy, supporting the strategy, and then watching as the student independently performs the strategy. A key part of the process is teaching self-regulation skills, such as goal-setting and self-monitoring, which aim to help students apply the strategy without guidance. The steps can be combined, changed, reordered, or repeated, depending on the needs of the student. The SRSD model can be used with students in grades 2 through 12 in individual, small group, or whole classroom settings.
Intervention Report 7-10 3
University of Chicago School Mathematics Project (UCSMP) Multiple Courses (Secondary Mathematics) (May 2016)
UCSMP is a core mathematics curriculum that emphasizes problem solving, real-world applications, and the use of technology. The curriculum is based on a student-centered approach with a focus on active learning that incorporates reading and uses a flexible lesson organization.
Intervention Report 6-12 3
MyTeachingPartner–Secondary (Teacher Training, Evaluation, and Compensation) (June 2015)
MyTeachingPartner–Secondary (MTP-S) is a professional development program that aims to increase student learning and development through improved teacher–student interactions. Through the program, middle and high school teachers access a video library featuring examples of high-quality interactions and receive individualized, web-based coaching approximately twice per month during the school year. MTP-S uses the secondary school version of the Classroom Assessment Scoring System®–Secondary (CLASS-S) to define and observe effective teaching practices.
Intervention Report 5-12 3
Repeated Reading (Students with Learning Disabilities) (May 2014)
Repeated reading is an academic practice that aims to increase oral reading fluency. Repeated reading can be used with students who have developed initial word reading skills but demonstrate inadequate reading fluency for their grade level. During repeated reading, a student sits in a quiet location with a teacher and reads a passage aloud at least three times. Typically, the teacher selects a passage of about 50 to 200 words in length. If the student misreads a word or hesitates for longer than 5 seconds, the teacher reads the word aloud, and the student repeats the word correctly. If the student requests help with a word, the teacher reads the word aloud or provides the definition. The student rereads the passage until he or she achieves a satisfactory fluency level.
Intervention Report 5-9 3
Reading Plus® (Adolescent Literacy) (September 2010)
Reading Plus® is a web-based reading intervention that uses technology to provide individualized scaffolded silent reading practice for students in grades 3 and higher. Reading Plus® aims to develop and improve students’ silent reading fluency, comprehension, and vocabulary. Reading Plus® is designed to adjust the difficulty of the content and duration of reading activities so that students proceed at a pace that corresponds to their reading skill level. The intervention includes differentiated reading activities, computer-based reading assessments, tools to monitor student progress, ongoing implementation support, and supplemental offline activities.
Intervention Report K-10 3
Fast ForWord® (Adolescent Literacy) (August 2010)
Fast ForWord® is a computer-based reading program intended to help students develop and strengthen the cognitive skills necessary for successful reading and learning. The program, which is designed to be used 30 to 100 minutes a day, five days a week, for 4 to 16 weeks, includes two components.
Intervention Report K-8 3
Accelerated Reader (Adolescent Literacy) (August 2010)
Accelerated Reader™ is a computerized supplementary reading program that provides guided reading instruction to students in grades K–12. It aims to improve students’ reading skills through reading practice and by providing frequent feedback on students’ progress to teachers. The Accelerated Reader™ program requires students to select and read a book based on their area of interest and reading level. Upon completion of a book, students take a computerized quiz based on the book’s content and vocabulary. Quiz performance allows teachers to monitor student progress and to identify students who may need additional reading assistance.
Intervention Report 7-12 3
Reading Apprenticeship® (Adolescent Literacy) (July 2010)
Reading Apprenticeship® is a professional development program that aims to help teachers improve their students’ literacy skills. The program also aims to improve student social-emotional learning outcomes such as belonging, social awareness, growth mindset, and self-efficacy. Reading Apprenticeship® trains teachers to model reading comprehension strategies and help students practice these strategies in their classrooms.
Intervention Report 6-8 3
Accelerated Middle Schools (Dropout Prevention) (July 2008)
Accelerated middle schools are self-contained academic programs designed to help middle school students who are behind grade level catch up with their peers. The program aims to ensure students stay in school and graduate by encouraging them to begin high school with other students their age. The programs serve students who are one to two years behind grade level, giving students the opportunity to cover an additional year of curriculum over 1–2 years in the program. Accelerated middle schools can be structured as separate schools or as schools within a traditional middle school.
Intervention Report 7-9 3
ALAS (Dropout Prevention) (October 2006)
ALAS (Spanish for “wings”) is an intervention for middle and high school students that is designed to address student, school, family, and community factors that affect dropping out. Each student is assigned a counselor/mentor who monitors attendance, behavior, and academic achievement. The counselor/mentor provides feedback and coordinates interventions and resources to students, families, and teachers. Counselors/mentors also serve as advocates for students and intervene when problems are identified. Students are trained in problem-solving, self-control, and assertiveness skills. Parents are trained in parent-child problem solving, how to participate in school activities, and how to contact teachers and school administrators to address issues.
Intervention Report K-10 3
Fast ForWord® (English Language Learners) (September 2006)
Fast ForWord® is a computer-based reading program intended to help students develop and strengthen the cognitive skills necessary for successful reading and learning. The program, which is designed to be used 30 to 100 minutes a day, five days a week, for 4 to 16 weeks, includes two components.
Intervention Report 3-12 3
Connect with Kids (Character Education) (September 2006)
Connect with Kids aims to promote prosocial attitudes and positive behavior of elementary (grades 3–5) and secondary (grades 6–12) school students by teaching core character values. Lesson plans include videos, story summaries, discussion questions, student games, and activities for both core and supplemental character traits. The classroom curriculum is reinforced by a website component and schoolwide and community outreach components. The program can be incorporated into an existing curriculum or used as a standalone program. The school or teacher decides on the number of character traits covered in each session, so the program duration may vary from one semester to an entire academic year.
Intervention Report 3-8 -1
Leadership and Assistance for Science Education Reform (LASER) (Science) (September 2021)
The Leadership and Assistance for Science Education Reform (LASER) program is intended to build capacity for implementing inquiry-based science curricula in schools and districts. When participating in LASER, school or district teams attend leadership development institutes to plan the implementation of inquiry-based science curricula. These school or district teams receive support for key aspects of implementation such as professional development for teachers, access to instructional materials, and support for selecting appropriate assessments. LASER also helps schools and districts partner with scientists, science educators, and local business and community leaders who can promote and further support the implementation of inquiry-based science instruction.
Intervention Report 6-9 -1
University of Chicago School Mathematics Project (UCSMP) Transitions/Pre-transitions Math (Primary Mathematics) (May 2021)
University of Chicago School Mathematics Project (UCSMP) is a core mathematics curriculum that includes materials and a routinized instructional approach with an option for teacher training. The curriculum uses an inquiry-based approach with a focus on active learning where students frequently engage in hands-on activities and small-group activities. Pre-Transition Mathematics teaches arithmetic, algebra, geometry, probability, and statistics. Transition Mathematics teaches more advanced arithmetic, algebra, and geometry, and connects these areas to measurement, probability, and statistics.
Intervention Report 4-8 -1
Literacy Design Collaborative (Teacher Training, Evaluation, and Compensation) (March 2021)
Literacy Design Collaborative aims to help teachers improve their effectiveness in the classroom with a focus on supporting their literacy instruction. Literacy Design Collaborative provides professional development, coaching, and resources to support teachers to work collaboratively in their schools to create and use high-quality literacy instruction materials aimed at improving students’ reading, research, and writing skills. Teachers across content areas—including English language arts, social studies, and science—can use the Literacy Design Collaborative program.
Intervention Report 4-7 -1
Word Generation (English Learner (EL)) (April 2020)
Word Generation is a supplemental program that aims to improve students’ reading comprehension by building students’ vocabulary, academic language, and perspective-taking skills through classroom discussion and debate. Word Generation was developed for all students; however, English learners in particular could benefit from its focus on academic language. Word Generation consists of a series of interdisciplinary units with daily lessons focused on a high-interest issue to increase student engagement. Each unit targets a small number of academic vocabulary words that are integrated into texts, activities, writing tasks, debates, and discussions across content areas. Several Word Generation programs exist. In the Word Generation Weekly (WordGen Weekly) and Word Generation Elementary (WordGen Elementary) programs, units are intended to be used across English language arts, math, science, and social studies in grades 6–8 and grades 4 and 5, respectively. In the Science Generation (SciGen) and Social Studies Generation (SoGen) programs, units can supplement or be used in place of regular science and social studies curriculum units in grades 6–8. The different Word Generation programs can be implemented separately or together.
Intervention Report 6-9 -1
Passport Reading Journeys (Adolescent Literacy) (November 2019)
Passport Reading Journeys is a supplemental literacy curriculum designed to help improve reading comprehension, vocabulary, word study, and writing skills of struggling readers in grades 6–12. Lessons incorporate both teacher-led instruction and technology, including whole-class and small-group instruction, independent reading, video segments, and independent computer-based practice. The curriculum includes a series of two-week, ten-lesson instructional sequences on topics in science, math, fine art, literature, and social studies. Each sequence is themed as an expedition or journey for students.
Intervention Report 3-8 -1
National Board for Professional Teaching Standards (NBPTS) Certification (Teacher Training, Evaluation, and Compensation) (February 2018)
The National Board for Professional Teaching Standards (NBPTS) establishes standards for accomplished teachers and awards professional certification to teachers who can demonstrate that their teaching practices meet those standards. Educators and experts in child development and related fields established the organization, and these experts work to develop and refine the standards for accomplished teaching based on the knowledge and skills that effective teachers demonstrate. The standards reflect five core propositions: (1) effective teachers are committed to students and their learning, (2) effective teachers know the subjects they teach and how to teach those subjects to students, (3) effective teachers manage and monitor student learning, (4) effective teachers think systematically about their practice and learn from experience, and (5) effective teachers are members of learning communities. Those seeking certification from the NBPTS must complete a computer-based assessment and three portfolio entries. The certification process can take 1 to 5 years.
Intervention Report 2-9 -1
Achieve3000 (Beginning Reading) (February 2018)
Achieve3000® is a supplemental online literacy program that provides nonfiction reading content to students in grades preK–12 and focuses on building phonemic awareness, phonics, fluency, reading comprehension, vocabulary, and writing skills. Achieve3000® is designed to help students advance their nonfiction reading skills by providing differentiated online instruction. Teachers use the program with an entire class but the assignments are tailored to each student’s reading ability level. For example, teachers assign an article and related activities to an entire class; the program then tailors the version of the article to each student by automatically increasing the difficulty of text when a student is ready for more challenging text. Achieve3000® provides lessons that follow a five-step routine: (1) respond to a Before Reading Poll, (2) read an article, (3) answer activity questions, (4) respond to an After Reading Poll, and (5) answer a Thought Question. Progress reports and student usage data, provided by the online tool, enable teachers to track both whole-class and individual student progress. The program is designed for diverse student groups, including general education students, struggling readers in need of intensive tutoring, and English learners.
Intervention Report 2-9 -1
Accelerated Math® (Primary Mathematics) (December 2017)
Accelerated Math®, published by Renaissance Learning, is a software tool that provides practice problems for students in grades K–12 and provides teachers with reports to monitor student progress. Accelerated Math® creates individualized student assignments, scores the assignments, and generates reports on student progress. The software is typically used with the math curriculum being used in the classroom to add practice for students and help teachers differentiate instruction through the program’s progress-monitoring data.
Intervention Report 2-9 -1
Accelerated Math® (Secondary Mathematics) (December 2017)
Accelerated Math®, published by Renaissance Learning, is a software tool that provides practice problems for students in grades K–12 and provides teachers with reports to monitor student progress. Accelerated Math® creates individualized student assignments, scores the assignments, and generates reports on student progress. The software is typically used with the math curriculum being used in the classroom to add practice for students and help teachers differentiate instruction through the program’s progress-monitoring data.
Intervention Report 7-10 -1
Prentice Hall/Pearson Literature (c)2007, 2010, 2012, 2015 (Adolescent Literacy) (November 2017)
Prentice Hall/Pearson Literature© (2007–15) is an English language arts curriculum designed for students in grades 6–12 that focuses on building reading, vocabulary, literary analysis, and writing skills. It uses passages from fiction and nonfiction texts, poetry, and contemporary digital media. The curriculum is based on a textbook. The publisher also provides online components and other materials that enable teachers to provide personalized assignments, monitor students’ progress, and score writing assignments, enrich instruction, or provide additional practice to supplement the textbook.
Intervention Report 6-12 -1
TNTP Teaching Fellows (Teacher Training, Evaluation, and Compensation) (June 2017)
TNTP Teaching Fellows is a highly selective route to teacher certification that aims to prepare people to teach in high-need public schools. The program recruits professionals seeking to change careers and recent college graduates who are not certified teachers. TNTP Teaching Fellows expects its participants to teach for many years, but does not require them to make a minimum time commitment to teaching. Program participants complete online coursework and receive 5–7 weeks of in-person training focused on foundational teaching skills during the summer before they begin teaching. They must demonstrate mastery of these core skills to be eligible to teach. They receive continued professional development and coaching from TNTP Teaching Fellows during their first year of teaching, and additional support provided by their schools and districts. As full-time employees of the public schools in which they work, new TNTP Teaching Fellows teachers receive the same salary and benefits as other beginning teachers in their school district.
Intervention Report 1-8 -1
Saxon Math (Primary Mathematics) (May 2017)
Saxon Math is a curriculum for students in grades K–12. The amount of new math content students receive each day is limited and students practice concepts every day. New concepts are developed, reviewed, and practiced cumulatively rather than in discrete chapters or units.
Intervention Report 6-8 -1
Connected Mathematics Project (CMP) (Primary Mathematics) (February 2017)
Connected Mathematics Project (CMP) is a math curriculum for students in grades 6–8. It uses interactive problems and everyday situations to explore mathematical ideas, with a goal of fostering a problem-centered, inquiry-based learning environment. At each grade level, the curriculum covers numbers, algebra, geometry/measurement, probability, and statistics.
Intervention Report K-8 -1
Accelerated Reader (Beginning Reading) (June 2016)
Accelerated Reader™ is a computerized supplementary reading program that provides guided reading instruction to students in grades K–12. It aims to improve students’ reading skills through reading practice and by providing frequent feedback on students’ progress to teachers. The Accelerated Reader™ program requires students to select and read a book based on their area of interest and reading level. Upon completion of a book, students take a computerized quiz based on the book’s content and vocabulary. Quiz performance allows teachers to monitor student progress and to identify students who may need additional reading assistance.
Intervention Report 6-9 -1
Saxon Algebra I (Secondary Mathematics) (May 2016)
Saxon Math is a textbook series covering grades K–12 based on incremental development and continual review of mathematical concepts to give students time to learn and practice concepts throughout the year. The program is built on the premise that students learn best when instruction is incremental and explicit, previously learned concepts are continually reviewed, and assessment is frequent and cumulative. At each grade level, math concepts are introduced, reviewed, and practiced over time in order to move students from understanding to fluency.
Intervention Report 5-7 -1
SuccessMaker® (Adolescent Literacy) (November 2015)
The SuccessMaker program is a set of computer-based courses used to supplement regular classroom reading instruction in grades K–8. Using adaptive lessons tailored to a student’s reading level, SuccessMaker aims to improve understanding in areas such as phonological awareness, phonics, fluency, vocabulary, comprehension, and concepts of print.
Intervention Report PK-12 -1
TAP: The System for Teacher and Student Advancement (Teacher Training, Evaluation, and Compensation) (July 2015)
TAP™ (formerly known as the Teacher Advancement Program) is a comprehensive educator effectiveness program that aims to improve student achievement through supports and incentives that attract, retain, develop, and motivate effective teachers. The program provides teachers with leadership opportunities and associated salary increases; ongoing, school-based professional development; rigorous evaluations; and annual performance bonuses based on a combination of teacher value added to student achievement and observations of their classroom teaching.
Intervention Report 4-12 -1
Reciprocal Teaching (Students with Learning Disabilities) (November 2013)
Reciprocal teaching is an interactive instructional practice that aims to improve students’ reading comprehension by teaching strategies to obtain meaning from a text. The teacher and students take turns leading a dialogue regarding segments of the text. Students discuss with their teacher how to apply four comprehension strategies—generating questions, summarizing, clarifying, and predicting—to passages of text. During the early stages of reciprocal teaching, the teacher assumes primary responsibility for modeling how to use these strategies. As students become more familiar with the strategies, there is a gradual shift toward student responsibility for talking through the application of the strategies to the text.
Intervention Report K-10 -1
Fast ForWord® (Beginning Reading) (March 2013)
Fast ForWord® is a computer-based reading program intended to help students develop and strengthen the cognitive skills necessary for successful reading and learning. The program, which is designed to be used 30 to 100 minutes a day, five days a week, for 4 to 16 weeks, includes two components.
Intervention Report 7-8 -1
Talent Development Middle Grades Program (Adolescent Literacy) (January 2013)
Talent Development Middle Grades Program (TDMG) is a whole school reform approach for large middle schools that face serious problems with student attendance, discipline, and academic achievement. The program includes both structural and curriculum reforms. It calls for schools to reorganize into small ”learning communities” of 200–300 students who attend classes in distinct areas of the school and stay together throughout their time in middle school. In addition to structural changes, schools adopting the program purchase one or more curricula that are intended to be developmentally appropriate and to engage students with culturally relevant content. For students who are behind in reading and math, the program provides additional periods devoted to these subjects that include group activities and computer-based lessons. To improve implementation, each school is assigned a team of “curriculum coaches” trained by the developer to work with school staff on a weekly basis to implement the program. In addition, teachers are offered professional development training, including monthly sessions designed to familiarize them with the program and demonstrate effective instructional approaches.
Intervention Report 7 -1
Great Explorations in Math and Science® (GEMS®) The Real Reasons for Seasons (Science) (January 2013)
Great Explorations in Math and Science® (GEMS®) The Real Reasons for Seasons is a curriculum unit for grades 6–8 that focuses on the connections between the Sun and the Earth to teach students the scientific concepts behind the seasons. The unit utilizes models, hands-on investigations, peer-to-peer discussions, reflection, and informational student readings to help students understand science content and develop scientific investigation skills.
Intervention Report 6-8 -1
Student team reading and writing (Adolescent Literacy) (November 2011)
Student team reading and writing refers to two cooperative learning programs for secondary students: (1) Student Team Reading and Writing and (2) Student Team Reading. The Student Team Reading and Writing program is an integrated approach to reading and language arts for early adolescents. Student Team Reading comprises the reading part of Student Team Reading and Writing and consists of two principal elements: (1) literature-related activities (including partner reading, treasure hunts, word mastery, story retelling, story-related writing, and quizzes) and (2) direct instruction in reading comprehension strategies (such as identifying main ideas and themes, drawing conclusions, making predictions, and understanding figurative language).
Intervention Report 5-12 -1
Repeated Reading (Middle School Mathematics) (April 2011)
Repeated reading is an academic practice that aims to increase oral reading fluency. Repeated reading can be used with students who have developed initial word reading skills but demonstrate inadequate reading fluency for their grade level. During repeated reading, a student sits in a quiet location with a teacher and reads a passage aloud at least three times. Typically, the teacher selects a passage of about 50 to 200 words in length. If the student misreads a word or hesitates for longer than 5 seconds, the teacher reads the word aloud, and the student repeats the word correctly. If the student requests help with a word, the teacher reads the word aloud or provides the definition. The student rereads the passage until he or she achieves a satisfactory fluency level.
Intervention Report 4-12 -1
Reciprocal Teaching (Adolescent Literacy) (September 2010)
Reciprocal teaching is an interactive instructional practice that aims to improve students’ reading comprehension by teaching strategies to obtain meaning from a text. The teacher and students take turns leading a dialogue regarding segments of the text. Students discuss with their teacher how to apply four comprehension strategies—generating questions, summarizing, clarifying, and predicting—to passages of text. During the early stages of reciprocal teaching, the teacher assumes primary responsibility for modeling how to use these strategies. As students become more familiar with the strategies, there is a gradual shift toward student responsibility for talking through the application of the strategies to the text.
Intervention Report 4-10 -1
Read 180® (Students with Learning Disabilities) (July 2010)
READ 180® is a reading program designed for struggling readers who are reading 2 or more years below grade level. It combines online and direct instruction, student assessment, and teacher professional development. READ 180® is delivered in 90-minute sessions that include whole-group instruction, three small-group rotations, and whole-class wrap-up. Small-group rotations include individualized instruction using an adaptive computer application, small-group instruction, and independent reading. READ 180® is designed for students in elementary through high school.
Intervention Report K-8 -1
Accelerated Reader (English Language Learners) (December 2009)
Accelerated Reader™ is a computerized supplementary reading program that provides guided reading instruction to students in grades K–12. It aims to improve students’ reading skills through reading practice and by providing frequent feedback on students’ progress to teachers. The Accelerated Reader™ program requires students to select and read a book based on their area of interest and reading level. Upon completion of a book, students take a computerized quiz based on the book’s content and vocabulary. Quiz performance allows teachers to monitor student progress and to identify students who may need additional reading assistance.
Intervention Report 7-8 -1
Talent Development Middle Grades Program (Dropout Prevention) (March 2009)
Talent Development Middle Grades Program (TDMG) is a whole school reform approach for large middle schools that face serious problems with student attendance, discipline, and academic achievement. The program includes both structural and curriculum reforms. It calls for schools to reorganize into small ”learning communities” of 200–300 students who attend classes in distinct areas of the school and stay together throughout their time in middle school. In addition to structural changes, schools adopting the program purchase one or more curricula that are intended to be developmentally appropriate and to engage students with culturally relevant content. For students who are behind in reading and math, the program provides additional periods devoted to these subjects that include group activities and computer-based lessons. To improve implementation, each school is assigned a team of “curriculum coaches” trained by the developer to work with school staff on a weekly basis to implement the program. In addition, teachers are offered professional development training, including monthly sessions designed to familiarize them with the program and demonstrate effective instructional approaches.
Intervention Report 5-7 -1
SuccessMaker® (Beginning Reading) (July 2007)
The SuccessMaker program is a set of computer-based courses used to supplement regular classroom reading instruction in grades K–8. Using adaptive lessons tailored to a student’s reading level, SuccessMaker aims to improve understanding in areas such as phonological awareness, phonics, fluency, vocabulary, comprehension, and concepts of print.
Intervention Report 5-7 -1
SuccessMaker® (Elementary School Mathematics) (July 2007)
The SuccessMaker program is a set of computer-based courses used to supplement regular classroom reading instruction in grades K–8. Using adaptive lessons tailored to a student’s reading level, SuccessMaker aims to improve understanding in areas such as phonological awareness, phonics, fluency, vocabulary, comprehension, and concepts of print.
Intervention Report 7-9 -1
Transition Mathematics (Middle School Mathematics) (March 2007)
Transition Mathematics aims to increase applied arithmetic, pre-algebra, and pre-geometry skills in students in grades 7–12 . This 1-year curriculum also addresses general application to different wordings of problems, types of numbers, and contexts for problems and aims to promote mathematical reading skills. The curriculum uses the University of Chicago School Mathematics Project (UCSMP) textbook. The sequence of the topics intends to assist the transition from arithmetic to algebra and geometry.
Intervention Report 6-8 -1
Lions Quest -- Skills for Adolescence (Character Education) (September 2006)
Lions Quest Skills for Adolescence is a schoolwide program for middle school students (grades 6–8). The program is designed to promote good citizenship skills, core character values, social-emotional skills, and discourage the use of drugs, alcohol, and violence. The program includes a classroom curriculum, schoolwide practices to create a positive school climate, parent and family involvement, and community involvement. The curriculum may vary in scope and intensity, lasting from 9 weeks to 3 years. The lessons use cooperative group learning exercises and classroom management techniques to improve classroom climate.
Intervention Report 6-7 -1
Voices Literature and Character Education (Voices LACE) (Character Education) (September 2006)
Voices Literature and Character Education Program (Voices LACE; formerly known as Voices of Love and Freedom and Literacy and Values) is a K–12 program that aims to promote positive character and citizenship values, literacy skills, and social skills. The program curriculum can be used over any length of time. During classroom lessons, students read books about issues such as ethnic discrimination, fighting, or bullying, and elaborate on central themes through role-playing and discussions practiced in school and at home. Emphasis is given to promoting caring relationships between teachers and students and among students, and to connecting the values taught to students’ personal stories. Voices LACE may also be implemented as a schoolwide improvement program. Optional components of the program include schoolwide events and restructuring of school organization and practices (establishing student assemblies and creating small learning communities), parental involvement (home visits and family nights), and community support (joint campaigns with supporting organizations and business).
Reviews of Individual Studies 7-9 1
Evaluation of the College, Career, and Community Writers Program: Findings from the i3 Scale-up Grant. Technical Report. (2021)
Reviews of Individual Studies 6-8 1
Distance Learning through Game-Based 3D Virtual Learning Environments: Mission Hydro Science. Evaluation Report for Mission HydroSci (2020)
Mission HydroSci (MHS) is a 3D game-based learning environment and curriculum that supports middle school student learning of water systems science and scientific argumentation. MHS is a rigorous, coherent and engaging 6 to 8-day curriculum with all learning activities and social interactions taking place in the virtual world and with teachers observing and supporting students through an online support system enhanced by analytics. MHS was evaluated in comparison to a high- quality alternative intervention developed by the Biological Sciences Curriculum Study (BSCS) using a stratified randomized block experimental design where 'classroom' was the unit of random assignment, stratified by teacher. The comparison curriculum is called Earth's Water Systems (EWS) and is provided online using the Canvas learning management platform. Three measurable outcomes: (1) content knowledge, (2) competency in scientific argumentation, and (3) affect for science and technology were used in the pre- post-comparison of MHS with EWS. The findings of this randomized experiment showed that MHS achieved roughly equivalent water systems learning outcomes and significantly higher development of argumentation competencies when compared to the EWS curriculum. The impacts of both MHS and the EWS curriculum on affect for science and technology were equivalent and slightly negative. A secondary exploratory quasi-experimental design (QED) analysis was conducted that found significant positive effects for MHS in comparison to EWS on water systems understandings and stronger detected effects for students' argumentation.
Reviews of Individual Studies 7 1
A Randomized Controlled Trial of Interleaved Mathematics Practice (2019)
We report the results of a preregistered, cluster randomized controlled trial of a mathematics learning intervention known as interleaved practice. Whereas most mathematics assignments consist of a block of problems devoted to the same skill or concept, an interleaved assignment is arranged so that no 2 consecutive problems require the same strategy. Previous small-scale studies found that practice assignments with a greater proportion of interleaved practice produced higher test scores. In the present study, we assessed the efficacy and feasibility of interleaved practice in a naturalistic setting with a large, diverse sample. Each of 54 7th-grade mathematics classes periodically completed interleaved or blocked assignments over a period of 4 months, and then both groups completed an interleaved review assignment. One month later, students took an unannounced test, and the interleaved group outscored the blocked group, 61% versus 38%, d 0.83. Teachers were able to implement the intervention without training, and they later expressed support for interleaved practice in an anonymous survey they completed before they knew the results of the study. Although important caveats remain, the results suggest that interleaved mathematics practice is effective and feasible.
Reviews of Individual Studies 7 1
Improving Student Learning of Ratio, Proportion, and Percent: A Replication Study of Schema-Based Instruction (2019)
The purpose of this replication study was to provide replication evidence not currently available of the effects of a research-based mathematics program, schema-based instruction, on the mathematical problem-solving performance of 7th-grade students. The replication was implemented in 36 schools in 5 districts; 59 mathematics teachers and their students (N = 1,492) participated in the study. Multilevel hierarchical linear analyses revealed statistically significant differences between conditions on proximal and distal measures of mathematics problem solving, with effects sizes similar to those reported in Jitendra et al. (2015).
Reviews of Individual Studies 3-8 1
Investigating Causal Effects of Arts Education Experiences: Experimental Evidence from Houston's Arts Access Initiative (2019)
The recent wave of test-based accountability reforms has negatively impacted the provision of K-12 arts educational experiences. Advocates contend that, in addition to providing intrinsic benefits, the arts can positively influence academic and social development. However, the empirical evidence to support such claims is limited. We conducted a randomized controlled trial with 10,548 3rd-8th grade students who were enrolled in 42 schools that were assigned by lottery to receive substantial influxes of arts education experiences provided through school-community partnerships with local arts organizations, cultural institutions, and teaching-artists. We find that these increases in arts educational experiences significantly reduce the proportion of students receiving disciplinary infractions by 3.6 percentage points, improve STAAR writing achievement by 0.13 of a standard deviation, and increase students' compassion for others by 0.08 of a standard deviation. For students in elementary schools, which comprise 86 percent of the sample, we find that these arts educational experiences also significantly improve school engagement, college aspirations, and arts-facilitated empathy. These findings provide strong evidence that arts educational experiences can produce significant positive impacts on student academic and social development. Policymakers should consider these multifaceted educational benefits when assessing the role and value of the arts in K-12 schools.
Reviews of Individual Studies 7-12 1
UC Irvine Writing Project’s Pathway to Academic Success program: An Investing in Innovation (i3) validation grant evaluation. Technical report. (2017)
Reviews of Individual Studies K-8 1
Effects of dual-language immersion programs on student achievement: Evidence from lottery data. (2017)
Effectively educating the large English learner population requires policymakers to ensure developmentally appropriate settings and services throughout the time students are learning English, as well as during their transition to fluent English proficient status--a process termed "reclassification." Using longitudinal student-level data from two U.S. states (N = 107,549), the authors implemented recent advances in multi-site regression discontinuity designs to assess the effects of reclassification policies across districts. They found that reclassification decisions are heavily influenced by state criteria; however, there is considerable variability across districts in the extent of state-level influence. The authors also found robust evidence of between-district heterogeneity in the effects of reclassification on subsequent achievement and graduation. They discuss the implications of these findings for reclassification policies and future research on the topic. Looking toward the next century of education research, the authors discuss ways that multi-site regression discontinuity designs can be combined with qualitative research to enable policymakers and practitioners to better understand variation in effects of policies across contexts as well as the mechanisms underlying those effects.
Reviews of Individual Studies 6-8 1
Engaging struggling adolescent readers to improve reading skills. (2017)
This study examined the efficacy of a supplemental, multicomponent adolescent reading intervention for middle school students who scored below proficient on a state literacy assessment. Using a within-school experimental design, the authors randomly assigned 483 students in grades 6-8 to a business-as-usual control condition or to the Strategic Adolescent Reading Intervention (STARI), a supplemental reading program involving instruction to support word-reading skills, fluency, vocabulary, and comprehension, and peer talk to promote reading engagement and comprehension. The authors assessed behavioral engagement by measuring how much of the STARI curricular activities students completed during an academic school year, and collected intervention teachers' ratings of their students' reading engagement. STARI students outperformed control students on measures of word recognition (Cohen's d = 0.20), efficiency of basic reading comprehension (Cohen's d = 0.21), and morphological awareness (Cohen's d = 0.18). Reading engagement in its behavioral form, as measured by students' participation and involvement in the STARI curriculum, mediated the treatment effects on each of these three posttest outcomes. Intervention teachers' ratings of their students' emotional and cognitive engagement explained unique variance on reading posttests. Findings from this study support the hypothesis that (a) behavioral engagement fosters struggling adolescents' reading growth, and (b) teachers' perceptions of their students' emotional and cognitive engagement further contribute to reading competence.
Reviews of Individual Studies 6-11 1
Texting Parents: Evaluation report and executive summary. (2016)
This report presents the findings from an efficacy trial and process evaluation of the Parent Engagement Programme (PEP). The PEP was a school-level intervention designed to improve pupil outcomes by engaging parents in their children's learning. The programme was developed collaboratively by research teams from the University of Bristol and Harvard University and was delivered between September 2014 and July 2015. The study was conducted by the Centre for Effective Education, Queen's University Belfast between February 2014 and February 2016. The trial involved 15,697 students in Years 7, 9, and 11 from 36 English secondary schools, with schools sending an average of 30 texts to each parent over the period of the trial. The developers of the intervention managed its delivery to ensure optimal implementation. It was a cluster randomised controlled trial with randomisation at the Key Stage level, designed to determine the impact of the intervention on the academic outcomes of students in English, maths, and science, and the impact on absenteeism. A process evaluation used focus groups, telephone surveys, interviews, and an online survey to provide data on implementation and to capture the perceptions and experiences of participating parents, pupils, and teachers. Key conclusions include: (1) Children who had the intervention experienced about one month of additional progress in maths compared to other children. This positive result is unlikely to have occurred by chance; (2) Children who had the intervention had reduced absenteeism compared to other children. This positive result is unlikely to have occurred by chance; (3) Children who had the intervention appeared to experience about one month of additional progress in English compared to other children. However, analysis suggests that this finding might have been affected by bias introduced by missing data, so evaluators cannot reliably draw this conclusion. There is no evidence to suggest that the intervention had an impact on science attainment; (4) Schools embraced the programme and liked its immediacy and low cost. Many respondents felt that the presence of a dedicated coordinator would be valuable to monitor the accuracy and frequency of texts. Schools should consider whether they would be able to provide this additional resource; and (5) The vast majority of parents were accepting of the programme, including the content, frequency, and timing of texts. [Note: The post-reporting appendix was added in June 2017.]
Reviews of Individual Studies 7 1
Online mathematics homework increases student achievement (2016)
In a randomized field trial with 2,850 seventh-grade mathematics students, we evaluated whether an educational technology intervention increased mathematics learning. Assigning homework is common yet sometimes controversial. Building on prior research on formative assessment and adaptive teaching, we predicted that combining an online homework tool with teacher training could increase learning. The online tool ASSISTments (a) provides timely feedback and hints to students as they do homework and (b) gives teachers timely, organized information about students' work. To test this prediction, we analyzed data from 43 schools that participated in a random assignment experiment in Maine, a state that provides every seventh-grade student with a laptop to take home. Results showed that the intervention significantly increased student scores on an end-of-the-year standardized mathematics assessment as compared with a control group that continued with existing homework practices. Students with low prior mathematics achievement benefited most. The intervention has potential for wider adoption. [For the corresponding grantee submission, see ED575159.]
Reviews of Individual Studies 7-8 1
The impact of eMINTS professional development on teacher instruction and student achievement. Year 3 report. (2015)
Reviews of Individual Studies 6-8 1
Understanding the effect of KIPP as it scales: Volume I, Impacts on achievement and other outcomes. Final report of KIPP’s Investing in Innovation grant evaluation [Middle School; RCT]. (2015)
KIPP (Knowledge is Power Program) is a national network of public charter schools whose stated mission is to help underserved students enroll in and graduate from college. Prior studies (see Tuttle et al. 2013) have consistently found that attending a KIPP middle school positively affects student achievement, but few have addressed longer-term outcomes and no rigorous research exists on impacts of KIPP schools at levels other than middle school. In this first high-quality study to rigorously examine the impacts of the network of KIPP public charter schools at all elementary and secondary grade levels, Mathematica found that KIPP schools have positive impacts on student achievement, particularly at the elementary and middle school levels. In addition, the study found positive impacts on student achievement for new entrants to the KIPP network in high school. For students continuing from a KIPP middle school, KIPP high schools' impacts on student achievement are not statistically significant, on average (in comparison to students who did not have the option to attend a KIPP high school and instead attended a mix of other non-KIPP charter, private, and traditional public high schools). Among these continuing students, KIPP high schools have positive impacts on several aspects of college preparation, including more discussions about college, increased likelihood of applying to college, and more advanced coursetaking. This report provides detailed findings and also includes the following appendices: (1) List of KIPP Schools In Network; (2) Detail on Survey Outcomes; (3) Cumulative Middle and High School Results; (4) Detailed Analytic Methods: Elementary School (Lottery-Based Analyses); (5) Detailed Analytic Methods: Middle School (Lottery-Based Analyses); (6) Understanding the Effects of KIPP As It Scales Mathematica Policy Research; (7) Detailed Analytic Methods: Middle School (Matched-Student Analyses); (8) Detailed Analytic Methods: High School (Matched-Student Analyses); (9) Detailed Analytic Methods: High School (Matched-School Analyses); and (10) Detailed Tables For What Works Clearinghouse Review. [For the executive summary, see ED560080; for the focus brief, see ED560043.]
Reviews of Individual Studies 7 1
The benefit of interleaved mathematics practice is not limited to superficially similar kinds of problems. (2014)
Most mathematics assignments consist of a group of problems requiring the same strategy. For example, a lesson on the quadratic formula is typically followed by a block of problems requiring students to use the quadratic formula, which means that students know the appropriate strategy before they read each problem. In an alternative approach, different kinds of problems appear in an interleaved order, which requires students to choose the strategy on the basis of the problem itself. In the classroom-based experiment reported here, grade seven students (n = 140) received blocked or interleaved practice over a nine-week period, followed two weeks later by an unannounced test. Mean test scores were greater for material learned by interleaved practice rather than by blocked practice (72% vs. 38%, d = 1.05). This interleaving effect was observed even though the different kinds of problems were superficially dissimilar from each other, whereas previous interleaved mathematics studies required students to learn nearly identical kinds of problems. We conclude that interleaving improves mathematics learning not only by improving discrimination between different kinds of problems but also by strengthening the association between each kind of problem and its corresponding strategy. [This article was published in: "Psychonomic Bulletin & Review" v21 n5 p1323-1330 Oct 2014; http://dx.doi.org/ 10.3758/s13423-014-0588-3.]
Reviews of Individual Studies 7-12 1
School engagement mediates long-term prevention effects for Mexican American adolescents. (2014)
Reviews of Individual Studies 5-8 1
Staying on track: Testing Higher Achievement’s long-term impact on academic outcomes and high school choice. (2013)
One crucial decision that middle schoolers (and their families) make is where they will attend high school. Many districts employ school choice systems designed to allow students to pick a high school that will meet their needs and interests. Yet most students prefer high schools that are close to home, and for youth in low-income neighborhoods, this often means attending a more disadvantaged, lower performing school (Nathanson et al. 2013). Youth who defy these odds and choose a competitive high school instead have much to gain. Cullen et al. (2005), for instance, found that Chicago public middle school students who chose to attend a higher-achieving high school were substantially more likely to graduate. However, even as eighth graders, these students already differed in many ways from their peers who chose a neighborhood school--they had better self-reported grades and higher expectations for the future, felt more prepared for high school, and were more likely to have spoken with their parents about what school to attend. These findings raise the question of how we can prepare more disadvantaged students to take the many steps necessary-throughout the middle school years-to successfully transition to a competitive, high-quality high school that can ultimately launch them toward college and careers. The Washington, DC-based Higher Achievement program is taking on this challenge. Higher Achievement targets rising fifth and sixth graders from "at-risk communities" and serves them throughout the middle school years. Its goal is to strengthen participants' academic skills, attitudes and behaviors, reinforce high aspirations and help students and their families navigate the process of applying to and selecting a high-quality high school. In 2006, the authors began a comprehensive multi-year evaluation of Higher Achievement to test its impact on participants' academic performance, attitudes and behaviors and on their high school enrollment. The evaluation used random assignment-the most rigorous design available to researchers-to assess program impacts. This brief summarizes the study's findings. Findings suggest that the program does appear to expand the options available to its students by making them more likely to apply to and attend private schools and less likely to apply to and attend weaker public magnet and charter schools. This, in turn, may position youth for better outcomes in high school and beyond. [This research was made possible by grants from The Atlantic Philanthropies, Bank of America, the Smith Richardson Foundation, the Spencer Foundation, The Wallace Foundation and the William T. Grant Foundation.]
Reviews of Individual Studies 6-12 1
The effectiveness of secondary math teachers from Teach For America and the Teaching Fellows programs (NCEE 2013-4015). (2013)
Teach For America (TFA) and the Teaching Fellows programs are an important and growing source of teachers of hard-to-staff subjects in high-poverty schools, but comprehensive evidence of their effectiveness has been limited. This report presents findings from the first large-scale random assignment study of secondary math teachers from these programs. The study separately examined the effectiveness of TFA and Teaching Fellows teachers, comparing secondary math teachers from each program with other secondary math teachers teaching the same math courses in the same schools. The study focused on secondary math because this is a subject in which schools face particular staffing difficulties.The study had two main findings, one for each program studied: (1) TFA teachers were more effective than the teachers with whom they were compared. On average, students assigned to TFA teachers scored 0.07 standard deviations higher on end-of-year math assessments than students assigned to comparison teachers, a statistically significant difference. This impact is equivalent to an additional 2.6 months of school for the average student nationwide; and (2) Teaching Fellows were neither more nor less effective than the teachers with whom they were compared. On average, students of Teaching Fellows and students of comparison teachers had similar scores on end-of-year math assessments. By providing rigorous evidence on the effectiveness of secondary math teachers from TFA and the Teaching Fellows programs, the study can shed light on potential approaches for improving teacher effectiveness in hard-to-staff schools and subjects. The study findings can provide guidance to school principals faced with the choice of hiring teachers who have entered the profession via different routes to certification. The findings can also aid policymakers and funders of teacher preparation programs by providing information on the effectiveness of teachers from various routes to certification that use different methods to identify, attract, train, and support their teachers. Seven appendixes present: (1) Supplementary Technical Information on Study Design and Data Collection; (2) Supplementary Information on Analytic Methods; (3) Supplementary Information on Teach For America and Teaching Fellows Programs; (4) Teach For America and Teaching Fellows Teachers Compared with Comparison Teachers by Entry Route (Alternative or Traditional); (5) Supplementary Information on Teach For America and Teaching Fellows Teachers Compared with Comparison Teachers; (6) Supplementary Analyses of the Impacts of Teach For America and Teaching Fellows Teachers; and (7) Supplementary Findings on Factors Associated with Teacher Effectiveness. (Contains 96 tables, 21 figures, and 30 footnotes.)
Reviews of Individual Studies 3-8 1
Transfer incentives for high-performing teachers: Final results from a multisite randomized experiment (NCEE 2014-4003). (2013)
One way to improve struggling schools' access to effective teachers is to use selective transfer incentives. Such incentives offer bonuses for the highest-performing teachers to move into schools serving the most disadvantaged students. In this report, we provide evidence from a randomized experiment that tested whether such a policy intervention can improve student test scores and other outcomes in low-achieving schools. The intervention, known to participants as the Talent Transfer Initiative (TTI), was implemented in 10 school districts in seven states. The highest-performing teachers in each district--those who ranked in roughly the top 20 percent within their subject and grade span in terms of raising student achievement year after year (an approach known as value added)--were identified. These teachers were offered $20,000, paid in installments over a two-year period, if they transferred into and remained in designated schools that had low average test scores. The main findings from the study include: (1) The transfer incentive successfully attracted high value-added teachers to fill targeted vacancies; (2) The transfer incentive had a positive impact on test scores (math and reading) in targeted elementary classrooms; and (3) The transfer incentive had a positive impact on teacher-retention rates during the payout period; retention of the high-performing teachers who transferred was similar to their counterparts in the fall immediately after the last payout. Seven appendixes are included: (1) Supplemental Materials for Chapters I and II; (2) Value-Added Analysis to Identify Highest-Performing Teachers; (3) Supplemental Materials for Chapter III; (4) Identification of Focal Teachers; (5) Supplemental Materials for Chapter IV; (6) Supplemental Materials for Chapter V; and (7) Supplemental Materials for Chapter VI. (Contains 114 footnotes, 61 figures, and 92 tables.) [For the executive summary, see ED544268.]
Reviews of Individual Studies 4-8 1
Evaluation of "System 44." Final Report [2012] (2012)
The purpose of this evaluation of Scholastic's "System 44" conducted by RMC Research was to expand the existing research on students with learning disabilities by conducting a randomized study of struggling readers with approximately half of the sample comprised of students with learning disabilities. Specifically, this evaluation examined the impact of "System 44" on the reading outcomes of struggling readers and on a subsample of students with learning disabilities in Grades 4-8. The evaluation of the implementation and impact of "System 44" involved 12 elementary schools and 4 middle and K-8 schools in a district in Michigan. Scholastic's "System 44" is a foundational reading program intended for older struggling readers who have not mastered basic phonics and decoding skills. Combining researched-based phonics instruction with adaptive technology, "System 44" is designed to improve students' word reading accuracy, fluency, and comprehension. The "System 44" program delivers research-based instruction through an adaptive computer component; teacher-led small-group instruction; and individual student practice involving high-interest, leveled materials. Thus students who have not responded to classroom reading instruction may benefit from the more intensive and specific decoding instruction provided through "System 44." The evaluators selected the target sample based on student performance on the fall 2011 Michigan Educational Assessment Program (MEAP) and spring 2011 AIMSweb assessment. The Scholastic Reading Inventory (SRI) was used to screen students for "System 44" eligibility. The district administered the SRI to all students in the target sample. Those students who scored below 600 Lexiles on the SRI were administered the Scholastic Phonics Inventory (SPI). All students who scored in the Beginning or Developing reader categories on the SPI were randomly assigned (stratified by school and grade level) to either the "System 44" treatment group or the control group. RMC Research hired and trained 4 local testers to individually administer a battery of standardized reading tests to all treatment and control group students. The testers administered the tests in October 2011 to establish baseline scores and again in May 2012 to attain follow-up scores. The tests included the following: (1) Test of Silent Reading Efficiency and Comprehension (TOSREC); (2) Comprehensive Test of Phonological Processing (CTOPP) Elision subtest; (3) Test of Word Reading Efficiency (TOWRE) Sight Word Efficiency subtest; and (4) Test of Word Reading Efficiency (TOWRE) Phonetic Decoding Efficiency subtest. The evaluation of "System 44" revealed significant impacts on several tests for both the overall sample and the learning disabled sample. Additional findings revealed that impacts were stronger on several tests for middle school students than for elementary school students, particularly on SPI Nonsense Word Accuracy, TOSREC, and SRI. Although significant impacts were attained by the end of Year 1, the majority of students in the study did not complete the "System 44" program. Data collected through teacher surveys, classroom visits, and interviews provided information on teachers' implementation of "System 44" in the classroom, and software usage data were used to examine differences in students with varying program exit and topic completion patterns. [For the November 2011 report, see ED613693.]
Reviews of Individual Studies 4-8 1
Evaluation of the effectiveness of the Alabama Math, Science, and Technology Initiative (AMSTI) (NCEE 2012–4008). (2012)
This report presents the results of an experiment conducted in Alabama beginning in the 2006/07 school year, to determine the effectiveness of the Alabama Math, Science, and Technology Initiative (AMSTI), which aims to improve mathematics and science achievement in the state's K-12 schools. This study is the first randomized controlled trial testing the effectiveness of AMSTI in improving mathematics problem solving and science achievement in upper-elementary and middle schools. AMSTI is an initiative specific to Alabama and was developed and supported through state resources. An important finding is the positive and statistically significant effect of AMSTI on mathematics achievement as measured by the SAT 10 mathematics problem solving assessment administered by the state to students in grades 4-8. After one year in the program, student mathematics scores were higher than those of a control group that did not receive AMSTI by 0.05 standard deviation, equivalent to 2 percentile points. Nine of the 10 sensitivity analyses yielded effect estimates that were statistically significant at the 0.025 level, consistent with the main finding. The estimated effect of AMSTI on science achievement measured after one year was not statistically significant. Based on the SAT 10 science test administered by the state to students in grades 5 and 7, no difference between AMSTI and control schools could be discerned after one year. Changes in classroom instructional strategies, especially an emphasis on more active-learning strategies, are important to the AMSTI theory of action. Therefore, a secondary investigation of classroom practices was conducted, based on data from survey responses from teachers. For both mathematics and science, statistically significant differences were found between AMSTI and control teachers in the average reported time spent using the strategies. The effect of AMSTI on these instructional strategies was 0.47 standard deviation in mathematics and 0.32 standard deviation in science. Two years of AMSTI appeared to have a positive and statistically significant effect on achievement in mathematics problem solving, compared to no AMSTI. Two years of AMSTI appeared to have a positive and statistically significant effect on achievement in science. AMSTI appeared to have a positive and statistically significant effect on reading achievement as measured by the SAT 10 test of reading administered by the state to students in grades 4-8. AMSTI did not appear to have a statistically significant effect on teacher-reported content knowledge in mathematics or science after one year. AMSTI did not appear to have statistically significant differential effects on student achievement in mathematics problem solving or science based on racial/ethnic minority status, enrollment in the free or reduced-price lunch program, gender, or pretest level. Appended are: (1) Explanation of primary and secondary confirmatory outcome measures; (2) Explanation of exploratory research questions; (3) Selection and random assignment of schools; (4) Statistical power analysis; (5) Data collection procedures and timeline; (6) Description of program implementation data collected but not used in report; (7) Alabama Math, Science, and Technology Initiative (AMSTI) teacher survey #3; (8) Data cleaning and data file construction; (9) Attrition through study stages for samples used in the confirmatory analysis; (10) Description of degree rank; (11) Equivalence of Year 1 baseline and analyzed samples for confirmatory student-level and classroom practice outcomes; (12) Internal consistency and validity of active learning measures; (13) Number of students and teachers in schools in analytic samples used to analyze Year 1 confirmatory questions; (14) Attrition through study stages for samples used in Year 1 exploratory analysis; (15) Tests of equivalence for baseline and analytic samples for Year 1 exploratory outcomes; (16) Statistical power analyses for moderator analyses; (17) Derivation and motivation of the Bell-Bradley estimator when measuring estimated two-year effect of the Alabama Math, Science, and Technology Initiative (AMSTI); (18) Attrition through study stages for samples contributing to estimation of two-year effects; (19) Examination of equivalence in baseline and analytic samples used in the estimation of two-year effects; (20) Estimation model for two-year effects of the Alabama Math, Science, and Technology Initiative (AMSTI); (21) Topics and instructional methods used at the Alabama Math, Science, and Technology Initiative (AMSTI) summer institute; (22) Parameter estimates on probability scale for odds-ratio tests of differences between Alabama Math, Science, and Technology Initiative (AMSTI) and control conditions in Year 1 (associated with summer professional development and in-school support outcomes); (23) Descriptive statistics for variables that change to a binary scale used in the Alabama Math, Science, and Technology Initiative (AMSTI) and control conditions in Year 1; (24) Comparison of assumed parameter values and observed sample statistics for statistical power analysis after one year; (25) Parameter estimates for Stanford Achievement Test Tenth Edition (SAT 10) mathematics problem solving after one year; (26) Parameter estimates for Stanford Achievement Test Tenth Edition (SAT 10) science after one year; (27) Parameter estimates for active learning in mathematics after one year; (28) Parameter estimates for active learning in science after one year; (29) Sensitivity analyses of effect of the Alabama Math, Science, and Technology Initiative (AMSTI) on Stanford Achievement Test Tenth Edition (SAT 10) mathematics problem solving achievement after one year; (30) Sensitivity analyses of effect of the Alabama Math, Science, and Technology Initiative (AMSTI) on Stanford Achievement Test Tenth Edition (SAT 10) science achievement after one year; (31) Sensitivity analyses of effect of the Alabama Math, Science, and Technology Initiative (AMSTI) on active learning instructional strategies in mathematics classrooms after one year; (32) Sensitivity analyses of effect of the Alabama Math, Science, and Technology Initiative (AMSTI) on active learning instructional strategies in science classrooms after one year; (33) Tests for violations of factors associated with assumption of equal first year effects on students in Alabama Math, Science, and Technology Initiative (AMSTI) and control schools; (34) Post hoc adjustment to standard error for estimate of two-year effect of the Alabama Math, Science, and Technology Initiative (AMSTI) on mathematics achievement after two years; (35) Parameter estimates for effect of the Alabama Math, Science, and Technology Initiative (AMSTI) after two years; (36) Parameter estimates for effect of the Alabama Math, Science, and Technology Initiative (AMSTI) on student reading achievement after one year; (37) Parameter estimates for teacher content and student engagement after one year; (38) Estimates of effects for terms involving the indicator of treatment status in the analysis of the moderating effect of the three-level pretest variable; (39) Parameter estimates for the analysis of the moderating effect of racial/ethnic minority status on the impact of the Alabama Math, Science, and Technology Initiative (AMSTI) on reading after one year; (40) Parameter estimates for analysis of average effect of the Alabama Math, Science, and Technology Initiative (AMSTI) on reading by racial/ethnic minority students after one year; and (41) Parameter estimates for effect of the Alabama Math, Science, and Technology Initiative (AMSTI) on reading for White students after one year. (Contains 26 figures, 136 tables, 1 box and 130 footnotes.)
Reviews of Individual Studies 6-7 1
Louisiana Striving Readers: Final evaluation report. (2012)
The Louisiana Striving Readers evaluation assessed the implementation and effectiveness of the Voyager "Passport Reading Journeys" (PRJ), a widely used supplemental literacy intervention for struggling adolescent readers that reflects the research-based practices recommended by the National Reading Panel (2000) and other more recent syntheses (Biancarosa & Snow, 2004; Edmonds, et al., 2009; Kamil, et al., 2008; Scammacca et al., 2007; Torgesen et al., 2007). To date, PRJ has been adopted in 45 states across the country in almost 470 districts and over 2,200 schools, and has served over 268,000 students. PRJ offers four levels of instruction appropriate for middle and high school students. The PRJ curriculum uses direct, explicit instruction in reading comprehension, vocabulary, and word study for adolescents who struggle with reading using age-appropriate fiction and non-fiction texts. The Louisiana Striving Readers Program, funded by the Louisiana Department of Education (LDOE) through a grant from the U.S. Department of Education, targeted over 1,200 struggling readers in grades 6-7 from ten middle schools across the state of Louisiana. The grant required a rigorous, independent experimental evaluation, conducted by SEDL, addressing fidelity of program implementation and program impacts on student motivation and reading achievement. The study reported here had two specific aims: (1) determine the fidelity of implementation, or the extent to which the program was delivered as the grant indicated it should be implemented; and (2) determine the impacts of PRJ on student reading and other related outcomes (i.e., student motivation and engagement in reading) and how the effects may have varied by student subgroups. This report details the intervention, the implementation study design and results, and the impact study design and results.
Reviews of Individual Studies 6-10 1
Striving Readers: Impact study and project evaluation report—Wisconsin Department of Public Instruction (with Milwaukee Public Schools). (2012)
American Institutes for Research (AIR) conducted an evaluation of the effect on struggling readers of implementing the READ 180 reading intervention in five participating schools in Milwaukee Public Schools (MPS) under a Striving Readers grant from the U.S. Department of Education. The evaluation used an experimental design in order to produce a rigorous estimate of the impact of the READ 180 intervention on measures of reading achievement for struggling students. The evaluation also explored implementation fidelity and the contexts and conditions of implementation that may extend or limit the intervention's effects. To measure program impact on students' academic performance in reading, AIR analyzed student achievement data collected from the Northwest Evaluation Association (NWEA) Measures of Academic Progress (MAP) benchmark assessment. AIR also administered a student survey to assess the impact on student engagement and self-efficacy for reading. This report asked the following research questions: (1) Does the READ 180 reading intervention improve students' academic performance in reading?; (2) With what fidelity did the program implement the professional development model and what factors mediated the level of implementation?; and (3) With what fidelity did classroom intervention teachers implement READ 180 and what factors mediated the level of implementation?
Reviews of Individual Studies K-8 1
Enhancing the efficacy of teacher incentives through loss aversion: A field experiment. (2012)
Domestic attempts to use financial incentives for teachers to increase student achievement have been ineffective. In this paper, we demonstrate that exploiting the power of loss aversion--teachers are paid in advance and asked to give back the money if their students do not improve sufficiently--increases math test scores between 0.201 (0.076) and 0.398 (0.129) standard deviations. This is equivalent to increasing teacher quality by more than one standard deviation. A second treatment arm, identical to the loss aversion treatment but implemented in the standard fashion, yields smaller and statistically insignificant results. This suggests it is loss aversion, rather than other features of the design or population sampled, that leads to the stark differences between our findings and past research.
Reviews of Individual Studies 6-12 1
A randomized experiment of a cognitive strategies approach to text-based analytical writing for mainstreamed Latino English language learners in grades 6 to 12. (2011)
This study reports Year 1 findings from a multisite cluster randomized controlled trial of a cognitive strategies approach to teaching text-based analytical writing for mainstreamed Latino English language learners (ELLs) in 9 middle schools and 6 high schools. There were 103 English teachers stratified by school and grade and then randomly assigned to the Pathway Project professional development intervention or control group. The Pathway Project trains teachers to use a pretest on-demand writing assessment to improve text-based analytical writing instruction for mainstreamed Latino ELLs who are able to participate in regular English classes. The intervention draws on well-documented instructional frameworks for teaching mainstreamed ELLs. Such frameworks emphasize the merits of a cognitive strategies approach that supports these learners' English language development. Pathway teachers participated in 46 hrs of training and learned how to apply cognitive strategies by using an on-demand writing assessment to help students understand, interpret, and write analytical essays about literature. Multilevel models revealed significant effects on an on-demand writing assessment (d = 0.35) and the California Standards Test in English language arts (d = 0.07). (Contains 1 figure, 7 tables and 4 footnotes.)
Reviews of Individual Studies 4-8 1
Evaluation of "System 44." Final Report [2011] (2011)
Scholastic's "System 44" is a foundational reading program intended for older struggling readers who have not mastered basic phonics and decoding skills. Combining researched-based phonics instruction with adaptive technology, "System 44" is designed to improve students' word reading accuracy, fluency, and comprehension. The "System 44" program delivers research-based instruction through an adaptive computer component; teacher-led small group instruction; and individual student practice involving high-interest, leveled materials. Thus students who have not responded to classroom reading instruction may benefit from the more intensive and specific decoding instruction provided through "System 44." Using a randomized design, this evaluation assessed the effectiveness of "System 44" in terms of improving the foundational reading skills of struggling readers in Grades 4-8 in a large suburban school district in southern California during the 2010-2011 school year. The evaluation of the implementation and impact of "System 44" involved 7 of the 11 elementary schools and all 4 middle schools in the district. A 2-step process was used to establish student eligibility for "System 44." The Scholastic Reading Inventory (SRI) was used to screen students in Grades 4-8 who performed below the 50th percentile on the spring 2010 California Standards Test (CST) for "System 44" eligibility. Those students who scored below 600 Lexiles on the SRI were administered the Scholastic Phonics Inventory (SPI), a computer-based test used to identify students in need of additional phonics instruction. Students who scored in the Beginning or Developing reader categories on the SPI were randomly assigned (stratified by school and grade level) to either the "System 44" treatment group or the control group. Data collection activities for the "System 44" evaluation included student reading tests, teacher surveys, "System 44" classroom observations, a professional development observation, and staff interviews. RMC Research hired and trained 4 local testers to administer a battery of standardized reading tests to all treatment and control students. The testers administered the tests to each student separately over a 3-week period in September and October 2010 to establish baseline scores and again in May 2011 to attain follow-up scores. Listed in order of administration, the tests included the following: (1) Test of Silent Reading Efficiency and Comprehension (TOSREC); (2) Comprehensive Test of Phonological Processing (CTOPP) Elision subtest; (3) Woodcock-Johnson III Word Identification subtest; (4) Woodcock-Johnson III Word Attack subtest; (5) Test of Word Reading Efficiency (TOWRE) Sight Word Efficiency subtest; and (6) Test of Word Reading Efficiency (TOWRE) Phonetic Decoding Efficiency subtest. This report details the program impact findings and concludes with recommendations from the evaluation team.
Reviews of Individual Studies 7-8 1
Accommodations for English language learner students: The effect of linguistic modification of math test item sets (NCEE 2009-4079). (2010)
This study examined the effect of linguistic modification on middle school students' ability to show what they know and can do on math assessments. REL West's study on middle school math assessment accommodations found that simplifying the language--or linguistic modification--on standardized math test items made it easier for English Language learners to focus on and grasp math concepts, and thus was a more accurate assessment of their math skills. The results contribute to the body of knowledge informing assessment practices and accommodations appropriate for English language learner students. The study examined students' performance on two sets of math items--both the originally worded items and those that had been modified. Researchers analyzed results from three subgroups of students--English learners (EL), non-English language arts proficient (NEP), and English language arts proficient (EP) students. Key results include: (1) Linguistically modifying the language of mathematics test items did not change the math knowledge being assessed; (2) The effect of linguistic modification on students' math performance varied between the three student subgroups. The results also varied depending on how scores were calculated for each student; and (3) For each of the four scoring approaches analyzed, the effect of linguistic modification was greatest for EL students, followed by NEP and EP students. The report is structured as follows. Following an Executive Summary and a Study Overview, Chapter 2 describes the study design, sample selection and recruitment, item set development processes, and standardized administration procedures. Chapter 3 describes the implementation of the accommodation (linguistic modification), including discussion of considerations and methods for data analysis. Chapter 4 presents findings from data analyses. Chapter 5 summarizes and interprets key findings, describes study challenges, comments on implications of the findings, and offers recommendations for future research. Appendices include: (1) Power analysis for primary research questions; (2) Operational test administration manual; (3) Student Language Background Survey; (4) Guide for developing a linguistically modified assessment; (5) Workgroup training materials; (6) Overview and protocol for cognitive interviews; (7) Item parameter estimates for IRT models; (8) Descriptive statistics from four scoring approaches; (9) ANOVA findings across four scoring approaches; (10) Cross-approach comparisons; (11) Results of the classical item-level analyses; (12) Summary of differential item functioning findings; (13) Exploratory factor analysis results; (14) Operational item set--original; and (15) Operational item set--linguistically modified. (Contains 31 tables, 10 figures, and 45 footnotes.)
Reviews of Individual Studies 7-8 1
Integration of technology, curriculum, and professional development for advancing middle school mathematics: Three large-scale studies. (2010)
The authors present three studies (two randomized controlled experiments and one embedded quasi-experiment) designed to evaluate the impact of replacement units targeting student learning of advanced middle school mathematics. The studies evaluated the SimCalc approach, which integrates an interactive representational technology, paper curriculum, and teacher professional development. Each study addressed both replicability of findings and robustness across Texas settings, with varied teacher characteristics (backgrounds, knowledge, attitudes) and student characteristics (demographics, levels of prior mathematics knowledge). Analyses revealed statistically significant main effects, with student-level effect sizes of 0.63, 0.50, and 0.56. These consistent gains support the conclusion that SimCalc is effective in enabling a wide variety of teachers in a diversity of settings to extend student learning to more advanced mathematics. (Contains 4 tables, 5 figures, and 1 note.)
Reviews of Individual Studies 7-8 1
Compared to what? The effects of different comparisons on conceptual knowledge and procedural flexibility for equation solving. (2009)
Researchers in both cognitive science and mathematics education emphasize the importance of comparison for learning and transfer. However, surprisingly little is known about the advantages and disadvantages of what types of things are being compared. In this experimental study, 162 seventh- and eighth-grade students learned to solve equations (a) by comparing equivalent problems solved with the same solution method, (b) by comparing different problem types solved with the same solution method, or (c) by comparing different solution methods to the same problem. Students' conceptual knowledge and procedural flexibility were best supported by comparing solution methods and to a lesser extent by comparing problem types. The benefits of comparison are augmented when examples differ on relevant features, and contrasting methods may be particularly useful in mathematics learning. (Contains 3 figures, 8 tables, and 1 footnote.)
Reviews of Individual Studies 4-8 1
Impact evaluation of the U.S. Department of Education’s Student Mentoring Program. Final report (NCEE 2009-4047). (2009)
This report summarizes the findings from a national evaluation of mentoring programs funded under the U.S. Department of Education's Student Mentoring Program. The impact evaluation used an experimental design in which students were randomly assigned to a treatment or control group. Thirty-two purposively selected School Mentoring Programs and 2,573 students took part in the evaluation, which estimated the impact of the programs over one school year on a range of student outcomes. The evaluation also describes the characteristics of the program and the mentors, and provides information about program delivery. The Student Mentoring Program is designed to fund grantees to enable them to provide mentoring to at-risk students in grades 4-8. The ultimate goal of the program is to improve student academic and behavioral outcomes through the guidance and encouragement of a volunteer mentor. Seventeen total impacts in the domains of academic achievement/engagement, interpersonal relationships/personal responsibility, and high-risk/delinquent behavior were measured. The main finding of the Impact Study was that there were no statistically significant impacts of the Student Mentoring Program for the sample as a whole on this array of student outcomes. However, there was some scattered evidence that impacts were heterogeneous across types of students. In particular, impacts on girls were statistically significantly different from impacts on boys for two self-reported scales: Scholastic Efficacy and School Bonding, and Pro-social Behaviors. For boys, the impact on Prosocial Behaviors was negative and statistically significant. For girls, the impact on Scholastic Efficacy and School Bonding was positive and statistically significant. The impact on truancy was negative and statistically significant for students below age 12. There were negative associations between program supervision of mentors and site-level impacts on three of the seventeen individual outcome measures: Pro-social Behaviors, grades in math and social studies, and a positive relationship with the outcome of school-reported delinquency. The report also presented results demonstrating that the Student Mentoring Program represented a fairly low level of intensity in terms of service: although grantees, on average, adhered to the general intents of the legislation and program guidance, they were simultaneously constrained by the limits of the school calendar and the population from which to draw mentors. Thirty-five percent of the control group students reported receiving mentoring either from the program or elsewhere in the community; this finding, coupled with the fact that not all treatment group students met with a mentor, reduced the treatment contrast and may have led to some dilution of the impacts on students compared to expectations. Seven appendices are included; (1) Sampling Design and Methodology; (2) Survey Instruments; (3) Construction of Student Outcome Measures; (4) Impact Analysis Results on Original Student Survey Scales and Measures; (5) Sensitivity Tests; (6) Standard Errors and Confidence Intervals of Main Effects; and (7) Site-Level Predictors and Impacts. (Contains 109 footnotes and 122 exhibits.) ["Impact Evaluation of the U.S. Department of Education's Student Mentoring Program. Final Report" was written with the assistance of Christine Dyous, Michelle Klausner, Nancy McGarry, Rachel Luck and William Rhodes.]
Reviews of Individual Studies 7 1
Scaling up SimCalc project: Can a technology enhanced curriculum improve student learning of important mathematics? (Technical Report 01). (2007)
Reviews of Individual Studies 7 1
Does comparing solution methods facilitate conceptual and procedural knowledge? An experimental study on learning to solve equations. (2007)
Encouraging students to share and compare solution methods is a key component of reform efforts in mathematics, and comparison is emerging as a fundamental learning mechanism. To experimentally evaluate the effects of comparison for mathematics learning, the authors randomly assigned 70 seventh-grade students to learn about algebra equation solving by either (a) comparing and contrasting alternative solution methods or (b) reflecting on the same solution methods one at a time. At posttest, students in the compare group had made greater gains in procedural knowledge and flexibility and comparable gains in conceptual knowledge. These findings suggest potential mechanisms behind the benefits of comparing contrasting solutions and ways to support effective comparison in the classroom.
Reviews of Individual Studies 5-8 2
Impact Evaluation of G2ROW STEM: Girls and Guys Realizing Opportunities with STEM (2021)
Reviews of Individual Studies 3-12 2
A Team-Based Leadership Intervention in New York City Schools: An Evaluation of the Targeted Intensive School Support Program (2020)
In 2013, the NYC Leadership Academy (NYCLA) developed a leadership intervention--the Targeted Intensive School Support (TISS) program--in collaboration with the New York City Department of Education (NYC DOE) to support schools that were facing particular challenges. NYCLA asked the RAND Corporation to provide an independent evaluation of the program's implementation and effects, and those findings are detailed in this report. The TISS program consisted of five key components: (1) teaming and collaborative training in aligned preservice preparation programs for a principal and assistant principal (AP); (2) coplacement of a principal and AP into an NYC DOE school; (3) team-based coaching to support the principal and AP; (4) 328 hours of extended coaching over the first three years after placement; and (5) use of a diagnostic process to guide goal setting and coaching according to school needs. Implementation findings suggest that only two of the five key components were implemented with fidelity. A propensity weighting approach was used to compare schools with TISS principals to other schools with new principals trained through residency-based preservice programs who did not participate in TISS. Findings suggest no statistically significant differences between TISS schools and comparison schools on measures of student achievement, school culture, and principal retention. TISS schools underperformed relative to comparison schools on the measure of chronic student absenteeism. [Sponsored by NYC Leadership Academy through a subgrant from the U.S. Department of Education.]
Reviews of Individual Studies 3-12 2
Illustrating the Promise of Community Schools: An Assessment of the Impact of the New York City Community Schools Initiative. (2020)
Reviews of Individual Studies 7-8 2
Visual-Syntactic Text Format: Improving Adolescent Literacy (2019)
Seventh- and 8th-grade students in a within-teacher randomized control study read from visual-syntactic formatted text for 44 min per week over the course of 1 year. On the annual state assessment, we found small statistically significant improvements on the overall English Language Arts scaled score (ES = 0.05, p < .05) and the writing assessment (ES = 0.07, p < .01) for the treatment group compared to the control group. We found no interactions between gifted, special education, or English learner classification and treatment status on the effect on overall English Language Arts score, but our categorical and subgroup analyses showed that the use of visual-syntactic text formatting provided a modest benefit to middle school students who were near or at grade level in the prior school year.
Reviews of Individual Studies K-8 2
Preparing School Leaders for Success: Evaluation of New Leaders' Aspiring Principals Program, 2012-2017 (2019)
A growing body of research points to the ways in which principals influence teachers, classrooms, and, ultimately, student achievement. New Leaders aims to prepare transformational school leaders by partnering with districts and charter schools to offer rigorous, research-based training for aspiring principals. The Aspiring Principals program is New Leaders' signature program and has three core features: selective recruitment and admission, training and endorsement, and support for principals early in their tenure. This report is a follow-up to the 2014 evaluation of New Leaders' Aspiring Principals program. Focusing on the revised program, which was first implemented in 2012, the authors present evidence of the effectiveness of the revised Aspiring Principals program and share lessons that can inform principal-preparation policy and practice. To assess the effect of New Leaders' Aspiring Principals program, researchers analyzed whether schools and students led by graduates of the program outperformed comparison schools and students in the same district, focusing on student achievement and principal retention. They also examined program graduate placement and satisfaction with the Aspiring Principals program. [For the appendixes, see ED605724.]
Reviews of Individual Studies K-8 2
A state-wide quasi-experimental effectiveness study of the scale-up of School-Wide Positive Behavioral Interventions and Supports (2019)
The three-tiered Positive Behavioral Interventions and Supports (PBIS) framework promotes the development of systems and data analysis to guide the selection and implementation of evidence-based practices across multiple tiers. The current study examined the effects of universal (tier 1) or school-wide PBIS (SW-PBIS) in one state's scale-up of this tier of the framework. Annual propensity score weights were generated to examine the longitudinal effects of SW-PBIS from 2006-07 through 2011-12. School-level archival and administrative data outcomes were examined using panel models with an autoregressive structure. The sample included 1,316 elementary, middle, and high schools. Elementary schools trained in SW-PBIS demonstrated statistically significantly lower suspensions during the fourth and fifth study years (i.e., small effect size) and higher reading and math proficiency rates during the first two study years as well as in one and two later years (i.e., small to large effect sizes), respectively. Secondary schools implementing SW-PBIS had statistically significantly lower suspensions and truancy rates during the second study year and higher reading and math proficiency rates during the second and third study years. These findings demonstrate medium effect sizes for all outcomes except suspensions. Given the widespread use of SW-PBIS across nearly 26,000 schools in the U.S., this study has important implications for educational practices and policies. [This paper was published in the "Journal of School Psychology" v73 p41-55 Apr 2019 (ISSN 0022-4405).]
Reviews of Individual Studies 6-12 2
Evaluation of the James Madison Legacy Project: Cohort 2 Student Knowledge (2018)
Reviews of Individual Studies 2-12 2
Can Restorative Practices Improve School Climate and Curb Suspensions? An Evaluation of the Impact of Restorative Practices in a Mid-Sized Urban School District. Research Report. RR-2840-DOJ. (2018)
Across the country, school districts, their stakeholders, and policymakers have become increasingly concerned about suspensions, particularly about suspending students from elementary school and disproportionately suspending ethnic/racial minority students. Suspended students are less likely to graduate, possibly because they miss the instructional time they need to advance academically. Restorative practices have gained buy-in in the education community as a strategy to reduce suspension rates. Proactively improving relationships among students and staff and building a sense of community in classrooms and schools may make students less inclined to misbehave. And addressing severe misbehavior through a restorative approach may help students realize the impacts of their actions and make them less likely to offend again. This study of the implementation of restorative practices in the Pittsburgh Public Schools district (PPS) in school years 2015-16 and 2016-17 represents one of the first randomized controlled trials of the effects of restorative practices on classroom and school climates and suspension rates. The authors examined a specific restorative practices program -- the International Institute for Restorative Practices' SaferSanerSchools™ Whole-School Change program -- implemented in a selected group of PPS schools under a program called Pursuing Equitable and Restorative Communities, or PERC. The researchers found that PERC achieved several positive effects, including an improvement in overall school climates (as rated by teachers), a reduction in overall suspension rates, and a reduction in the disparities in suspension rates between African American and white students and between low- and higher-income students. Key Findings: Effects of the Pursuing Equitable and Restorative Communities (PERC) program in Pittsburgh Public Schools: (1) Implementation of restorative practices through PERC improved overall school climates, as rated by teachers; (2) Implementation of restorative practices reduced the average suspension rate: During the study period, average suspension rates decreased in both PERC and non-PERC schools, but rates decreased more in PERC schools; (3) Suspension rates of African American students and of those from low-income families also went down in PERC schools, shrinking the disparities in suspension rates between African American and white students and between low- and higher-income students; (4) Academic outcomes did not improve in PERC schools, and actually worsened for grades 6-8; and (5) Arrest rates among PERC schools did not decrease. Recommendations: (1) Given the constraints on teachers' time, emphasize restorative practices that can be woven into the school day; (2) Ensure that school leaders understand and can model restorative practices, including by providing mandatory professional development, books and other materials, and coaching on restorative practices; (3) Establish a mechanism for school staff to meet at least once per month as a professional learning community on restorative practices; (4) Ensure that leaders at the district level can coordinate this work; (5) Set, and update, clear expectations regarding the use of restorative practices; and (6) Implement data collection systems to collect accurate information on all types of behavioral incidents and remedies.
Reviews of Individual Studies 4-8 2
A year-long state-wide RCT of the Minnesota Math Corps: Final report to Laura and John Arnold Foundation (2018)
Reviews of Individual Studies 4-11 2
The effects of statewide private school choice on college enrollment and graduation (2017)
Although several studies have documented the effects of statewide private school choice programs on student test scores, this report is the first to examine the effects of one of these programs on college enrollment and graduation. Using data from the Florida Tax Credit (FTC) Scholarship program, we find that low-income Florida students who attended private schools using an FTC scholarship enrolled in and graduated from Florida colleges at a higher rate than their public school counterparts. [Additional support for this study was provided by the Bill and Susan Oberndorf Foundation and Kate and Bill Duhamel.]
Reviews of Individual Studies 3-8 2
Can Universal SEL Programs Benefit Universally? Effects of the Positive Action Program on Multiple Trajectories of Social-Emotional and Misconduct Behaviors. (2017)
Behavioral trajectories during middle childhood are predictive of consequential outcomes later in life (e.g., substance abuse, violence). Social and emotional learning (SEL) programs are designed to promote trajectories that reflect both growth in positive behaviors and inhibited development of negative behaviors. The current study used growth mixture models to examine effects of the "Positive Action" program (PA) on behavioral trajectories of social-emotional and character development (SECD) and misconduct using data from a cluster-randomized trial that involved 14 schools and a sample of predominately low-income, urban youth followed from 3rd through 8th grade. For SECD, findings indicated that PA was similarly effective at improving trajectories within latent classes characterized as "High/declining" and "Low/stable". Favorable program effects were likewise evident to a comparable degree for misconduct across observed latent classes that reflected "Low/rising" and "High/rising" trajectories. These findings suggest that PA and perhaps other school-based universal SEL programs have the potential to yield comparable benefits across subgroups of youth with differing trajectories of positive and negative behaviors, making them promising strategies for achieving the intended goal of school-wide improvements in student outcomes. [This paper was published in "Prevention Science" v18 p214-224 2017.]
Reviews of Individual Studies 6-8 2
The Urban Advantage: The impact of informal science collaborations on student achievement (2017)
Reviews of Individual Studies 5-8 2
Enhancing middle school science lessons with playground activities: A study of the impact of playground physics. (2017)
Playground Physics is a technology-based application and accompanying curriculum designed by New York Hall of Science (NYSCI) to support middle school students' science engagement and learning of force, energy, and motion. The program includes professional development, the Playground Physics app, and a curriculum aligned with New York State Learning Standards, Common Core State Standards, and Next Generation Science Standards. The iOS app allows students to record and review videos through three "lenses": (1) motion; (2) force (Newton's third law); and (3) energy, and the curriculum integrates informal and formal, inquiry-based learning strategies to promote greater student knowledge and understanding of physics. The program was designed to be implemented in a formal school setting during the regular school day. This report describes the results of an experimental study of the Playground Physics program's impact on learning of physics concepts, student engagement, and science-related attitudes. Sixty New York City middle grade teachers were randomly assigned to treatment or control conditions. Treatment teachers were asked to participate in Playground Physics professional development and use Playground Physics as part of their physics instruction during the 2015-16 academic year; control teachers were asked to use their regular instruction. In total, 15 teachers left the study. The final sample included student data from 24 treatment teachers and 21 control teachers. The following are appended: (1) Playground Physics Curriculum Activities; (2) Student Outcome Measures; (3) Teacher Survey; (4) Impact Analysis Technical Approach; (5) Output from Statistical Models; (6) Knowledge Assessment Responses and Standards Alignment; (7) 2014-15 Fidelity of Implementation Analysis; and (8) Supplemental Analysis.
Reviews of Individual Studies 6-12 2
Leveraging technology to engage parents at scale: Evidence from a randomized controlled trial. (2017)
Reviews of Individual Studies 7 2
Web-based text structure strategy instruction improves seventh graders' content area reading comprehension (2017)
Reading comprehension in the content areas is a challenge for many middle grade students. Text structure-based instruction has yielded positive outcomes in reading comprehension at all grade levels in small and large studies. The text structure strategy delivered via the web, called Intelligent Tutoring System for the Text Structure Strategy (ITSS), has proven successful in large-scale studies at 4th and 5th grades and a smaller study at 7th grade. Text structure-based instruction focuses on selection and encoding of strategic memory. This strategic memory proves to be an effective springboard for many comprehension-based activities such as summarizing, inferring, elaborating, and applying. This was the first large-scale randomized controlled efficacy study on the web-based delivery of the text structure strategy to 7th-grade students. 108 classrooms from rural and suburban schools were randomly assigned to ITSS or control and pretests and posttests were administered at the beginning and end of the school year. Multilevel data analyses were conducted on standardized and researcher designed measures of reading comprehension. Results showed that ITSS classrooms outperformed the control classrooms on all measures with the highest effects reported for number of ideas included in the main idea. Results have practical implications for classroom practices.
Reviews of Individual Studies K-8 2
A comprehensive model of teacher induction: Implementation and impact on teachers and students. Evaluation of the New Teacher Center’s i3 Validation Grant, Final Report (2017)
Reviews of Individual Studies 7-12 2
Reducing achievement gaps in academic writing for Latinos and English learners in grades 7–12. (2016)
This study reports 2 years of findings from a randomized controlled trial designed to replicate and demonstrate the efficacy of an existing, successful professional development program, the Pathway Project, that uses a cognitive strategies approach to text-based analytical writing. Building on an earlier randomized field trial in a large, urban, low socioeconomic status (SES) district in which 98% of the students were Latino and 88% were mainstreamed English learners (ELs) at the intermediate level of fluency, the project aimed to help secondary school students, specifically Latinos and mainstreamed ELs, in another large, urban, low-SES district to develop the academic writing skills called for in the rigorous Common Core State Standards for English Language Arts. The Pathway Project draws on well-documented instructional frameworks that support approaches that incorporate strategy instruction to enhance students' academic literacy. Ninety-five teachers in 16 secondary schools were stratified by school and grade and then randomly assigned to the Pathway or control group. Pathway teachers participated in 46 hr of training to help students write analytical essays. Difference-in-differences and regression analyses revealed significant effects on student writing outcomes in both years of the intervention (Year 1, d = 0.48; Year 2, d = 0.60). Additionally, Pathway students had higher odds than control students of passing the California High School Exit Exam in both years.
Reviews of Individual Studies 7-8 2
Impact results of the eMINTS professional development validation study (2016)
This article presents the findings of an evaluation of the eMINTS (enhancing Missouri's Instructional Networked Teaching Strategies) professional development program. eMINTS is an intensive teacher professional development program designed to promote inquiry-based learning, support high-quality lesson design, build community among students and teachers, and create technology-rich learning environments. This evaluation included 60 high-poverty rural schools across Missouri that were randomly assigned to two treatment conditions and a control condition, with approximately 200 teachers and 3,000 students in the 2011-2012 baseline academic year. The researchers conclude that after 3 years, the eMINTS treatment group and an eMINTS treatment group with an additional year of Intel support resulted in changed teacher instructional behaviors and increased student achievement in mathematics.
Reviews of Individual Studies 3-8 2
National Board certification and teacher effectiveness: Evidence from Washington state. (2016)
We study the effectiveness of teachers certified by the National Board for Professional Teaching Standards (NBPTS) in Washington State, which has one of the largest populations of National Board-Certified Teachers (NBCTs) in the nation. Based on value-added models in math and reading, we find that NBPTS-certified teachers are about 0.01-0.05 student standard deviations more effective than non-NBCTS with similar levels of experience. Certification effects vary by subject, grade level, and certification type, with greater effects for middle school math certificates. We find mixed evidence that teachers who pass the assessment are more effective than those who fail, but that the underlying NBPTS assessment score predicts student achievement.
Reviews of Individual Studies 7-10 2
Impact of the National Writing Project’s College-Ready Writers Program on teachers and students. (2015)
Reviews of Individual Studies 7 2
Effects of a Research-Based Intervention to Improve Seventh-Grade Students' Proportional Problem Solving: A Cluster Randomized Trial (2015)
This experimental study evaluated the effectiveness of a research-based intervention, schema-based instruction (SBI), on students' proportional problem solving. SBI emphasizes the underlying mathematical structure of problems, uses schematic diagrams to represent information in the problem text, provides explicit problem solving and metacognitive strategy instruction, and focuses on the flexible use of multiple solution strategies. Eighty-two teachers/classrooms with a total of 1,999 seventh-grade students across 50 school districts were randomly assigned to a treatment (SBI) or control (business-as-usual) condition. An observational measure provided evidence that the SBI intervention was implemented with fidelity. Results of multilevel modeling indicated that the SBI group scored on average significantly higher than the control group on the posttest and retention test (9 weeks later) and also showed significantly more growth in proportional problem solving. There were no treatment effects on the Process and Applications subtest of the Group Mathematics Assessment and Diagnostic Evaluation. These results demonstrate that SBI can be more effective than the control approach in improving students' proportional problem solving. [This paper was published in the "Journal of Educational Psychology," (EJ1082754).]
Reviews of Individual Studies 6-12 2
Enhancing secondary school instruction and student achievement: Replication and extension of the My Teaching Partner-Secondary intervention (2015)
My Teaching Partner-Secondary (MTP-S) is a web-mediated coaching intervention, which an initial randomized trial, primarily in middle schools, found to improve teacher-student interactions and student achievement. Given the dearth of validated teacher development interventions showing consistent effects, we sought to both replicate and extend these findings with a modified version of the program in a predominantly high school population, and in a more urban, sociodemographically diverse school district. MTP-S produced substantial gains in student achievement across 86 secondary school classrooms involving 1,194 students. Gains were robust across subject areas and equivalent to moving the average student from the 50th to the 59th percentile in achievement scores. Results suggest that MTP-S can enhance student outcomes across diverse settings and implementation modalities.
Reviews of Individual Studies 6-8 2
Understanding the effect of KIPP as it scales: Volume I, Impacts on achievement and other outcomes. Final report of KIPP’s Investing in Innovation grant evaluation [Middle School; QED]. (2015)
KIPP (Knowledge is Power Program) is a national network of public charter schools whose stated mission is to help underserved students enroll in and graduate from college. Prior studies (see Tuttle et al. 2013) have consistently found that attending a KIPP middle school positively affects student achievement, but few have addressed longer-term outcomes and no rigorous research exists on impacts of KIPP schools at levels other than middle school. In this first high-quality study to rigorously examine the impacts of the network of KIPP public charter schools at all elementary and secondary grade levels, Mathematica found that KIPP schools have positive impacts on student achievement, particularly at the elementary and middle school levels. In addition, the study found positive impacts on student achievement for new entrants to the KIPP network in high school. For students continuing from a KIPP middle school, KIPP high schools' impacts on student achievement are not statistically significant, on average (in comparison to students who did not have the option to attend a KIPP high school and instead attended a mix of other non-KIPP charter, private, and traditional public high schools). Among these continuing students, KIPP high schools have positive impacts on several aspects of college preparation, including more discussions about college, increased likelihood of applying to college, and more advanced coursetaking. This report provides detailed findings and also includes the following appendices: (1) List of KIPP Schools In Network; (2) Detail on Survey Outcomes; (3) Cumulative Middle and High School Results; (4) Detailed Analytic Methods: Elementary School (Lottery-Based Analyses); (5) Detailed Analytic Methods: Middle School (Lottery-Based Analyses); (6) Understanding the Effects of KIPP As It Scales Mathematica Policy Research; (7) Detailed Analytic Methods: Middle School (Matched-Student Analyses); (8) Detailed Analytic Methods: High School (Matched-Student Analyses); (9) Detailed Analytic Methods: High School (Matched-School Analyses); and (10) Detailed Tables For What Works Clearinghouse Review. [For the executive summary, see ED560080; for the focus brief, see ED560043.]
Reviews of Individual Studies 6-8 2
Impact of Enhanced Anchored Instruction in Inclusive Math Classrooms (2015)
The Common Core State Standards for Mathematics will place more pressure on special education and math teachers to raise the skill levels of all students, especially those with disabilities in math (MD). The purpose of this study was to assess the effects of enhanced anchored instruction (EAI) on students with and without MD in co-taught general education classrooms. Results showed that students in the EAI condition improved their performance on math skills contained in several of the standards. Effect sizes were especially large for students with MD when the special education teacher more actively participated in the instructional activities with the math teacher. Classroom observations provided examples of how teachers can work together to benefit students in inclusive math settings.
Reviews of Individual Studies 6-8 2
Effects of blended instructional models on math performance (2014)
Reviews of Individual Studies K-12 2
Early progress: Interim research on personalized learning. (2014)
Reviews of Individual Studies K-12 2
Preparing principals to raise student achievement: Implementation and effects of the New Leaders Program in ten districts. (2014)
New Leaders is a nonprofit organization with a mission to ensure high academic achievement for all students by developing outstanding school leaders to serve in urban schools. Its premise is that a combination of preparation and improved working conditions for principals, especially greater autonomy, would lead to improved student outcomes. Its approach involves both preparing principals and partnering with school districts and charter management organizations (CMOs) to improve the conditions in which its highly trained principals work. As part of the partnerships, New Leaders agrees to provide carefully selected and trained principals who can be placed in schools that need principals and to provide coaching and other support after those principals are placed. The districts and CMOs agree to establish working conditions that support, rather than hinder, the principals' efforts to improve student outcomes. This report describes how the New Leaders program was implemented in partner districts, and it provides evidence of the effect that New Leaders has on student achievement. [The research in this report was produced within RAND Education. For the appendices that accompany this report, see ED561154. For the research brief, "Principal Preparation Matters: How Leadership Development Affects Student Achievement. Research Brief," see ED561155.]
Reviews of Individual Studies 3-12 2
The effects of teacher entry portals on student achievement (2014)
The current teacher workforce is younger, less experienced, more likely to turnover, and more diverse in preparation experiences than the workforce of two decades ago. Research shows that inexperienced teachers are less effective, but we know little about the effectiveness of teachers with different types of preparation. In this study, we classify North Carolina public school teachers into "portals"--fixed and mutually exclusive categories that capture teachers' formal preparation and qualifications upon first entering the profession--and estimate the adjusted average test score gains of students taught by teachers from each portal. Compared with undergraduate-prepared teachers from in-state public universities, (a) out-of-state undergraduate-prepared teachers are less effective in elementary grades and high school, (b) alternative entry teachers are less effective in high school, and (c) Teach For America corps members are more effective in STEM subjects and secondary grades.
Reviews of Individual Studies 3-10 2
MPCP Longitudinal Educational Growth Study Fifth Year Report. (2012)
This is the final report in a five-year evaluation of the Milwaukee Parental Choice Program (MPCP). This report features analyses of student achievement growth four years after the authors carefully assembled longitudinal study panels of MPCP and Milwaukee Public Schools (MPS) students in 2006-07. The MPCP, which began in 1990, provides government-funded vouchers for low-income children to attend private schools in the City of Milwaukee. The maximum voucher amount in 2010-11 was $6,442, and 20,996 children used a voucher to attend either secular or religious private schools. The MPCP is the oldest and largest urban school voucher program in the United States. This evaluation was authorized by 2005 Wisconsin Act 125, which was enacted in 2006. The primary purpose of the evaluation is twofold: 1) to analyze the effectiveness of the MPCP in promoting growth in student achievement as compared to MPS; and 2) to examine the educational attainment--measured by high school graduation and college enrollment rates--of MPCP and MPS students. The first purpose is accomplished by gauging growth in student achievement--as measured by the Wisconsin Knowledge and Concepts Examinations (WKCE) in math and reading in grades 3 through 8 and grade 10--over a five-year period for a sample of MPCP students and a carefully matched group of MPS students. The second purpose is accomplished by following the 2006-07 8th and 9th grade MPCP and matched MPS cohorts over a five-year period during which they would have had the opportunity to graduate from high school and enroll in college. Appended are: (1) Descriptive Statistics; (2) Attrition Study; and (3) Stability of the Sample. (Contains 4 figures, 12 tables and 14 footnotes.) [For the "MPCP Longitudinal Educational Growth Study: Fourth Year Report. SCDP Milwaukee Evaluation. Report # 23", see ED518597. Additional support for this report was provided by the Robertson Foundation.]
Reviews of Individual Studies 3-8 2
Charter school performance in New Jersey. (2012)
Reviews of Individual Studies 4-8 2
An evaluation of the Chicago Teacher Advancement Program (Chicago TAP) after four years. (2012)
In 2007, using funds from the federal Teacher Incentive Fund (TIF) and private foundations, the Chicago Public Schools (CPS) began piloting its version of a schoolwide reform model called the Teacher Advancement Program (TAP). Under the TAP model, teachers can earn extra pay and take on increased responsibilities through promotion (to mentor teacher or master teacher), and they become eligible for annual performance bonuses based on a combination of their contribution to student achievement (known as "value added") and observed performance in the classroom. The model calls for weekly meetings of teachers and mentors ("cluster groups"), and regular classroom observations by a school leadership team to help teachers meet their performance goals. The idea behind TAP is that giving teachers performance incentives, along with tools to track their performance and improve instruction, will help schools attract and retain talented teachers and help all teachers raise student achievement. This report is the last in a series of reports providing evidence on the impacts of CPS' version of TAP, called "Chicago TAP." It presents findings from the four-year implementation period, with special emphasis on the 2009-2010 and 2010-2011 school years, the third and fourth years of the program's rollout in Chicago. Earlier reports (Glazerman et al. 2009; Glazerman and Seifullah 2010) provide detailed data on each of the first two years of the program, respectively. CPS implemented Chicago TAP as a pilot program intended for 40 high-need schools. The program began in 10 schools in the first year (cohort 1) with a rollout plan to add 10 more Chicago TAP schools (cohorts 2, 3, and 4) in each year of the TIF grant's four-year implementation period. The authors address three research questions regarding Chicago TAP: (1) How was the program implemented?; (2) What impact did the program have on student achievement?; and (3) What impact did the program have on teacher retention within schools? To assess the first year under Chicago TAP for schools that began the program in fall 2009 (cohort 3), the authors looked at how teacher development and compensation practices in Chicago TAP schools differ from practices normally implemented in CPS schools. The authors found that teachers in Chicago TAP schools reported receiving significantly more mentoring support than teachers in similar non-TAP (control) schools. This finding reflects the fact that under the Chicago TAP model, teachers are guided by mentor teachers, and cluster groups meet weekly. They also found that veteran teachers in Chicago TAP schools were more likely than their control group counterparts to provide mentoring support to their colleagues; this finding is consistent with the fact that under Chicago TAP, teachers have the opportunity to assume leadership roles and responsibilities as Chicago TAP mentor or lead teachers. Teachers in Chicago TAP schools (veteran and novice) were aware of their eligibility for performance-based compensation. The authors found that the amount of compensation they expected approached the amount that was eventually paid out; that is, the average expectation was about $900, and the actual amount paid out in bonuses to this group was an average of about $1,100 per teacher. They generally did not find evidence of an impact of Chicago TAP on teacher attitudes or school climate. While the introduction of Chicago TAP led to real changes inside the schools, the program did not consistently raise student achievement as measured by growth in Illinois Standards Achievement Test (ISAT) scores. The authors found evidence of both positive and negative test score impacts in selected subjects, years, and cohorts of schools, but overall there was no detectable impact on math, reading, or science achievement that was robust to different methods of estimation. For example, impacts on science scores overall (across years and cohorts) were positive, but not statistically significant unless they used one particular matching method that excluded some Chicago TAP schools from the analysis. The authors did find evidence suggesting that Chicago TAP increased schools' retention of teachers, although the impacts were not uniform or universal across years, cohorts, and subgroups of teachers. They found that teachers who were working in Chicago TAP schools in 2007 returned in each of the following three years at higher rates than teachers in comparable non-TAP schools. For example, the authors found that 67 percent of classroom teachers in cohort 1 schools in fall 2007 returned to their same school in fall 2010 compared to about 56 percent of teachers in non-TAP schools, an impact of nearly 12 percentage points. In other words, teachers in Chicago TAP schools in fall 2007 were about 20% more likely than teachers in comparison schools to be in those same schools three years later. When the authors looked at teachers who were working in schools that started Chicago TAP in later years, some of the impact estimates were not statistically significant. The authors also found some evidence of impacts on retention for subgroups of teachers, such as those with less experience, but the pattern of findings was not consistent. When they considered retention of teachers in the district, the authors did not find consistent evidence of a measurable impact. Given that Chicago TAP is a school-specific program, their main focus was on school-level retention, as opposed to retention in the district. Appended are: (1) Propensity Score Matching; and (2) Supplemental Tables. (Contains 32 tables, 6 figures and 27 footnotes.) [For related reports, see "An Evaluation of the Teacher Advancement Program (TAP) in Chicago: Year One Impact Report. Final Report" (ED507502) and "An Evaluation of the Teacher Advancement Program (TAP) in Chicago: Year Two Impact Report" (ED510712).]
Reviews of Individual Studies 4-8 2
Evaluation of Teach For America in Texas schools. (2012)
Reviews of Individual Studies 3-8 2
The impact of the NISL Executive Development Program on school performance in Massachusetts: Cohort 2 results. (2011)
School leaders are increasingly being asked, whether by rhetoric or policy, to measurably improve student achievement. The resultant need to assist school leaders in their ability to improve teaching and learning for all students in their schools led to the establishment of the National Institute of School Leadership's (NISL's) Executive Development Program. The NISL program emphasizes the role of principals as strategic thinkers, instructional leaders, and creators of a just, fair, and caring culture in which all students meet high standards. The current national focus on the importance of effective, instructional leadership has, in turn, led to calls for principal evaluation to be tied directly to student achievement (Davis, Kearney, Sanders, Thomas, and Leon, 2011). Within this milieu, effective and proven principal leadership development programs are crucial. (Contains 3 tables and 2 figures.) [This report was produced by the Center for Educational Partnerships, Old Dominion University.]
Reviews of Individual Studies 6-12 2
An interaction-based approach to enhancing secondary school instruction and student achievement. (2011)
Improving teaching quality is widely recognized as critical to addressing deficiencies in secondary school education, yet the field has struggled to identify rigorously evaluated teacher-development approaches that can produce reliable gains in student achievement. A randomized controlled trial of My Teaching Partner-Secondary--a Web-mediated approach focused on improving teacher-student interactions in the classroom--examined the efficacy of the approach in improving teacher quality and student achievement with 78 secondary school teachers and 2237 students. The intervention produced substantial gains in measured student achievement in the year following its completion, equivalent to moving the average student from the 50th to the 59th percentile in achievement test scores. Gains appeared to be mediated by changes in teacher-student interaction qualities targeted by the intervention. [For a related What Works Clearinghouse Intervention Report, see ED557783.]
Reviews of Individual Studies 5-8 2
San Francisco Bay Area KIPP schools: A study of early implementation and achievement. Final report. (2008)
Reviews of Individual Studies 6-12 2
A cognitive strategies approach to reading and writing instruction for English language learners in secondary school. (2007)
This study was conducted by members of a site of the California Writing Project in partnership with a large, urban, low-SES school district where 93% of the students speak English as a second language and 69% are designated Limited English Proficient. Over an eight-year period, a relatively stable group of 55 secondary teachers engaged in ongoing professional development implemented a cognitive strategies approach to reading and writing instruction, making visible for approximately 2000 students per year the thinking tools experienced readers and writers access in the process of meaning construction. The purpose of the study was to assess the impact of this approach on the reading and writing abilities of English language learners (ELLs) in all 13 secondary schools in the district. Students receiving cognitive strategies instruction significantly out-gained peers on holistically scored assessments of academic writing for seven consecutive years. Treatment-group students also performed significantly better than control-group students on GPA, standardized tests, and high-stakes writing assessments. Findings reinforce the importance of having high expectations for ELLs; exposing them to a rigorous language arts curriculum;explicitly teaching, modeling and providing guided practice in a variety of strategies to help students read and write about challenging texts; and involving students as partners in a community of learners. What distinguishes the project is its integrity with respect to its fidelity to three core dimensions: Teachers and students were exposed to an extensive set of cognitive strategies and a wide array of curricular approaches to strategy use (comprehensiveness) in a manner designed to cultivate deep knowledge and application of those strategies in reading and writing (density) over an extended period of time (duration). The consistency of positive outcomes on multiple measures strongly points to the efficacy of using this approach with ELLs. Appended are: (1) Great Expectations Writing Prompt; and (2) Student Models. (Contains 1 note, 5 tables, and 6 figures.)
Reviews of Individual Studies 3-8 2
Use of a progress monitoring system to enable teachers to differentiate mathematics instruction. (2007)
We explored how a progress monitoring and instructional management system can be used to help educators differentiate instruction and meet the wide-ranging learning needs of their increasingly diverse classrooms. We compared classrooms in 24 states that used a curriculum-based progress monitoring and instructional management system, Accelerated Math, to same school control classrooms that did not use it. Among the major findings were the following: (1) At every grade level there were large differences in grade equivalent score and percentile gains for students in the experimental and control classrooms; (2) Gains were experienced across the achievement spectrum. An analysis of low-, middle-, and high-achieving students showed consistent rates of gain for each math objective mastered; (3) Intervention integrity had a significant effect on student achievement; (4) Teachers using the progress monitoring and instructional management system spent more time providing individual versus group instruction and felt better able to meet the individual needs of their students; and (5) Significantly more students who were in classrooms where teachers used the progress monitoring and instructional management system reported that they like math, help each other with math, and like math better this year than last year. Addition of a progress monitoring and instructional management system to ongoing mathematics instruction improves mathematics outcomes for students. The effects of the program clearly are a function of intervention integrity; when progress monitoring and instructional management practices are implemented with high fidelity or integrity, the mathematics performance of all students is significantly enhanced. Implications for practice are discussed.
Reviews of Individual Studies 7 2
Description and evaluation of Reasoning Mind’s 2003 pilot project. (2003)
Reviews of Individual Studies 6-7 3
The effects of inference instruction on the reading comprehension of English learners with reading comprehension difficulties (2019)
Inference skill is one of the most important predictors of reading comprehension. Still, there is little rigorous research investigating the effects of inference instruction on reading comprehension. There is no research investigating the effects of inference instruction on reading comprehension for English learners with reading comprehension difficulties. The current study investigated the effects of small-group inference instruction on the inference generation and reading comprehension of sixth- and seventh-grade students who were below-average readers (M = 86.7, SD = 8.1). Seventy-seven percent of student participants were designated limited English proficient. Participants were randomly assigned to 24, 40-min sessions of the inference instruction intervention (n = 39) or to business-as-usual English language arts instruction (n = 39). Membership in the treatment condition statistically significantly predicted higher outcome score on the "Gates-MacGinitie Reading Test" Reading Comprehension subtest (d = 0.60, 95% confidence interval [CI] [0.16, 1.03]), but not on the other measures of inference skill.
Reviews of Individual Studies 6-7 3
Word Knowledge and Comprehension Effects of an Academic Vocabulary Intervention for Middle School Students (2018)
This article presents findings from an intervention across sixth and seventh grades to teach academic words to middle school students. The goals included investigating a progression of outcomes from word knowledge to comprehension and investigating the processes students use in establishing word meaning. Participants in Year 1 were two sixth-grade reading teachers and 105 students (treatment n = 62; control n = 43) and in Year 2, one seventh-grade reading teacher and 87 students (treatment n = 44; control n = 43) from the same public school. In both years, results favored instructed students in word knowledge, lexical access, and morphological awareness on researcher-designed measures. In Year 2, small advances were also found for comprehension. Transcripts of lessons shed light on processes of developing representations of unfamiliar words.
Reviews of Individual Studies K-8 3
Promoting cultural responsivity and student engagement through double check coaching of classroom teachers: An efficacy study (2018)
This article presents findings from a randomized controlled trial (RCT) testing the impact of a novel coaching approach utilized as one element of the Double Check cultural responsivity and student engagement model. The RCT included 158 elementary and middle school teachers randomized to receive coaching or serve as comparisons; all participating teachers were exposed to school-wide professional development activities. Pre-post nonexperimental comparisons indicated improvements in self-reported culturally responsive behavior management and self-efficacy for teachers in both conditions following professional development exposure. With regard to the experimental findings, trained observers recorded significantly more proactive behavior management and anticipation of student problems by teachers, higher student cooperation, less student noncooperation, and fewer disruptive behaviors in classrooms led by coached teachers relative to comparison teachers. Taken together, the findings suggest the potential promise of coaching combined with school-wide professional development for improving classroom management practices and possibly reducing office discipline referrals among Black students.
Reviews of Individual Studies 6-8 3
Overcoming the Research-to-Practice Gap: A Randomized Trial With Two Brief Homework and Organization Interventions for Students With ADHD as Implemented by School Mental Health Providers (2017)
Objective: To evaluate the effectiveness of 2 brief school-based interventions targeting the homework problems of adolescents with attention-deficit/hyperactivity disorder (ADHD)—the Homework, Organization, and Planning Skills (HOPS) intervention and the Completing Homework by Improving Efficiency and Focus (CHIEF) intervention, as implemented by school mental health providers during the school day. A secondary goal was to use moderator analyses to identify student characteristics that may differentially predict intervention response. Method: Two-hundred and eighty middle school students with ADHD were randomized to the HOPS or CHIEF interventions or to waitlist, and parent and teacher ratings were collected pre, post, and at a 6-month follow-up. Results: Both interventions were implemented with fidelity by school mental health providers. Participants were pulled from elective periods and sessions averaged less than 20 min. Participants in HOPS and CHIEF demonstrated significantly greater improvements in comparison with waitlist on parent ratings of homework problems and organizational skills and effect sizes were large. HOPS participants also demonstrated moderate effect size improvements on materials management and organized action behaviors according to teachers. HOPS participants made significantly greater improvements in parent- and teacher-rated use of organized actions in comparison with CHIEF, but not on measures of homework problems. Moderation analyses revealed that participants with more severe psychopathology and behavioral dysregulation did significantly better with the HOPS intervention as compared to the CHIEF intervention. Conclusions: Brief school-based interventions implemented by school providers can be effective. This type of service delivery model may facilitate overcoming the oft cited research-to-practice gap.
Reviews of Individual Studies 6-8 3
Effects of a text-processing comprehension intervention on struggling middle school readers (2016)
Reading comprehension, which has been defined as gaining understanding of written text through a process of translating print into meaning (RAND, 2002), is a critically important academic skill (Nash & Snowling, 2006; National Institute of Child Health and Human Development, 2000). Yet national and international studies reveal that a significant number of adolescents do not adequately understand complex texts. That, in turn, impedes their success in school, access to post-secondary learning, and opportunities for competitive employment (Biacarosa & Snow, 2004; Kamil et al., 2008). Nationally, recent NAEP data indicated that approximately 22% of middle grade readers performed below Basic levels of literacy, suggesting they are not able to connect ideas, form inferences, and make generalizations when reading grade level texts (NCES, 2013).
Reviews of Individual Studies 7 3
Interleaved Practice Improves Mathematics Learning (2015)
A typical mathematics assignment consists primarily of practice problems requiring the strategy introduced in the immediately preceding lesson (e.g., a dozen problems that are solved by using the Pythagorean Theorem). This means that students know which strategy is needed to solve each problem before they read the problem. In an alternative approach known as "interleaved practice," problems from the course are rearranged so that a portion of each assignment includes different kinds of problems in an interleaved order. Interleaved practice requires students to choose a strategy on the basis of the problem itself, as they must do when they encounter a problem during a comprehensive examination or subsequent course. In the experiment reported here, 126 seventh-grade students received the same practice problems over a three-month period, but the problems were arranged so that skills were learned by interleaved practice or by the usual blocked approach. The practice phase concluded with a review session, followed 1 or 30 days later by an unannounced test. Compared to blocked practice, interleaved practice produced higher scores on both the immediate and delayed tests (Cohen's d = 0.42 and 0.79, respectively). Two appendices include: (1) Serial Position of Each Graph and Slope Problem in the Assignments (table); and (2) Frequency of Responses of Three Teachers to Statements About Interleaved Practice (table). [Note: This article was "in press" at the time of submission. No citation information is available at this time.]
Reviews of Individual Studies 7 3
The effects of the Elevate Math summer program on math achievement and algebra readiness (REL 2015-096) (2015)
Reviews of Individual Studies 7-12 3
FLIGHT final evaluation report: Facilitating long-term improvements in graduation and higher education for tomorrow. (2015)
Reviews of Individual Studies 3-8 3
Does teacher evaluation improve school performance? Experimental evidence from Chicago’s Excellence in Teaching Project (2015)
Chicago Public Schools initiated the Excellence in Teaching Project, a teacher evaluation program designed to increase student learning by improving classroom instruction through structured principal-teacher dialogue. The pilot began in forty-four elementary schools in 2008-09 (cohort 1) and scaled up to include an additional forty-eight elementary schools in 2009-10 (cohort 2). Leveraging the experimental design of the roll-out, cohort 1 schools performed better in reading and math than cohort 2 schools at the end of the first year, though the math effects are not statistically significant. We find the initial improvement for cohort 1 schools remains even after cohort 2 schools adopted the program. Moreover, the pilot differentially impacted schools with different characteristics. Higher-achieving and lower-poverty schools were the primary beneficiaries, suggesting the intervention was most successful in more advantaged schools. These findings are relevant for policy makers and school leaders who are implementing evaluation systems that incorporate classroom observations.
Reviews of Individual Studies 7-8 3
A randomized study of literacy integrated science intervention for low SES middle school students: Findings from first year implementation. (2014)
This paper presents the findings from a randomized control trial study of reading/literacy-integrated science inquiry intervention after 1 year of implementation and the treatment effect on 5th-grade low-socio-economic African-American and Hispanic students' achievement in science and English reading. A total of 94 treatment students and 194 comparison students from four randomized intermediate schools participated in the current project. The intervention consisted of ongoing professional development and specific instructional science lessons with inquiry-based learning, direct and explicit vocabulary instruction, and integration of reading and writing. Results suggested that (a) there was a significantly positive treatment effect as reflected in students' higher performance in district-wide curriculum-based tests of science and reading and standardized tests of science, reading, and English reading fluency; (b) males and females did not differ significantly from participating in science inquiry instruction; (c) African-American students had lower chance of sufficiently mastering the science concepts and achieving above the state standards when compared with Hispanic students across gender and condition, and (d) below-poverty African-American females are the most vulnerable group in science learning. Our study confirmed that even a modest amount of literacy integration in inquiry-based science instruction can promote students' science and reading achievement. Therefore, we call for more experimental research that focus on the quality of literacy-integrated science instruction from which middle grade students, particularly low-socio-economic status students, can benefit.
Reviews of Individual Studies 6-8 3
A delayed treatment control group design study of an after-school online tutoring program in reading. (2014)
This chapter concerns a year-long, United States federally-funded evaluation of Educate Online, an online, at home, 1:1 tutoring program aimed at improving reading performance for middle school students who are below grade level. Participating students receive after-school instruction from teachers in real-time over Voice over Internet Protocol (VoIP) connections. The researcher discusses study findings, the methodological challenges of conducting research on online tutoring, the multiple perspectives for understanding the effectiveness of a tutoring program, and areas for additional research. The chapter examines a key aspect of the evaluation, a delayed treatment control group design study to determine the effect that involvement in the tutoring program has upon student academic achievement in reading. [This chapter was published in: F. J. García-Peñalvo, A. M. Seoane Pardo (Eds.), "Online Tutor 2.0: Methodologies and Case Studies for Successful Learning," (pp. 264-279). Hershey, PA: IGI Global, 2014. (978-1-4666-5832-5 / 2326-8905).]
Reviews of Individual Studies 6-8 3
Four methods of identifying change in the context of a multiple component reading intervention for struggling middle school readers (2013)
Reviews of Individual Studies 7-8 3
The effects of response to intervention on the mathematics achievement of seventh and eighth grade students (Doctoral dissertation) (2013)
The purpose of this quantitative study was to investigate the effectiveness of a system-wide Response to Intervention (RTI) program on the mathematical achievement of seventh and eighth grade students. The study consisted of five district schools with a total of 502 participants. The students were identified as belonging to one of two tiers, which differed in regard to amount of intervention. The first tier (Tier 1) of students only received the regular classroom instruction while the second tier (Tier 2/3) received an additional thirty minutes of intervention strategies. The students receiving interventions, the Tier 2/3 students, were divided into two groups. One group received primarily teacher-directed instruction (TDI) as an intervention while the other group received computer-assisted instruction (CAI) as an intervention. For the purpose of this study, the CAI intervention involved the use of the commercial program, Odyssey Math. The students were benchmark tested at the beginning and end of the 2010-2011 school year using the STAR Math assessment program and also progress monitored on a regular basis. In an attempt to determine the effectiveness of the RTI program, a gain score ANOVA was conducted using the scaled scores of the two tiers from the beginning and the end of the school year. The analysis indicated that Tier 2/3 students did demonstrate greater growth than the students in Tier 1. The gain scores of the two groups of Tier 2/3 students were also used in a gain score ANOVA to measure differences in growth. An additional analysis of their mean scores was also conducted using ANCOVA. Both analyses indicated that the CAI group demonstrated greater gains. A third analysis was conducted in order to determine how accurately the STAR Math assessment program could predict student success (reaching either a Proficient or Advanced level) on the state assessment. While the STAR Math program did not accurately predict the students' level in every case, the logistic regression analysis did indicate that the program was successful in identifying struggling students. [The dissertation citations contained here are published with the permission of ProQuest LLC. Further reproduction is prohibited without permission. Copies of dissertations may be obtained by Telephone (800) 1-800-521-0600. Web page: http://www.proquest.com/en-US/products/dissertations/individuals.shtml.]
Reviews of Individual Studies 6-8 3
Reorganizing the instructional reading components: Could there be a better way to design remedial reading programs to maximize middle school students with reading disabilities’ response to treatment? (2010)
The primary purpose of this study was to explore if there could be a more beneficial method in organizing the individual instructional reading components (phonological decoding, spelling, fluency, and reading comprehension) within a remedial reading program to increase sensitivity to instruction for middle school students with reading disabilities (RD). Three different modules (Alternating, Integrated, and Additive) of the Reading Achievement Multi-Modular Program were implemented with 90 middle school (sixth to eighth grades) students with reading disabilities. Instruction occurred 45 min a day, 5 days a week, for 26 weeks, for approximately 97 h of remedial reading instruction. To assess gains, reading subtests of the Woodcock Johnson-III, the Gray Silent Reading Test, and Oral Reading Fluency passages were administered. Results showed that students in the Additive module outperformed students in the Alternating and Integrated modules on phonological decoding and spelling and students in the Integrated module on comprehension skills. Findings for the two oral reading fluency measures demonstrated a differential pattern of results across modules. Results are discussed in regards to the effect of the organization of each module on the responsiveness of middle school students with RD to instruction.
Reviews of Individual Studies 6-8 3
Effects of teaching syllable skills instruction on reading achievement in struggling middle school readers. (2009)
Direct, explicit, and systematic instruction of critical skills has been a hallmark of effective teaching for many years. In this study, we implemented a quasi-experimental pre-/post-test design with nonequivalent groups to determine the effectiveness of syllable skills instruction on reading achievement. Classes were randomly assigned to control or treatment groups. Participants included middle-school students with high incidence disabilities, including attention deficit hyperactivity disorder (ADHD) and their peers at risk for reading failure. The syllable skills intervention included instruction in syllable patterns, syllabication steps and rules, and accenting patterns. Students practiced skills by decoding and encoding nonsense and low-frequency mono- and multisyllabic words. Statistically significant differences were evident between pre-test and post-test scores for three dependent measures: (a) word identification, (b) word attack, and (c) reading comprehension. The treatment group demonstrated greater increase from pre-test to post-test on word identification, word attack, and reading comprehension; and the gap in fluency performance between the groups decreased. We discuss these outcomes with regard to their implications for practice and future research. (Contains 4 tables and 1 figure.)
Reviews of Individual Studies 4-8 3
Reading comprehension: Effects of individualized, integrated language arts as a reading approach with struggling readers (2008)
This study examined the effects of individualized, integrated language arts as a reading approach on struggling readers' comprehension scores obtained from oral narrative, silent narrative, and silent expository passages at three levels: below-grade, on-grade, and above-grade levels. Students (N = 93) in grades four through eight, who were reading below grade level, participated in the study. Treatment group students (n = 51) received individualized, integrated language arts as a reading approach once a week in place of basal reading instruction. Comparison group students (n = 42) received basal reading instruction for the duration of the study. Multivariate analysis of covariance was used to analyze posttest Analytical Reading Inventory (ARI) comprehension scores. Several statistically significant (p less than 0.001) differences in comprehension performance were found for on-grade-level scores and for above-grade-level scores, but few differences were found between treatment and comparison groups on below-grade-level scores. All statistically significant differences favored students in the treatment group. The findings of the study strongly suggest that the use of individualized, integrated language arts as a method for teaching reading is an effective approach for improving the reading comprehension performance of struggling readers. (Contains 5 tables.)
Reviews of Individual Studies 7 3
Implicit theories of intelligence predict achievement across an adolescent transition: A longitudinal study and an intervention. (2007)
Two studies explored the role of implicit theories of intelligence in adolescents' mathematics achievement. In Study 1 with 373 7th graders, the belief that intelligence is malleable (incremental theory) predicted an upward trajectory in grades over the two years of junior high school, while a belief that intelligence is fixed (entity theory) predicted a flat trajectory. A mediational model including learning goals, positive beliefs about effort, and causal attributions and strategies was tested. In Study 2, an intervention teaching an incremental theory to 7th graders (N=48) promoted positive change in classroom motivation, compared with a control group (N=43). Simultaneously, students in the control group displayed a continuing downward trajectory in grades, while this decline was reversed for students in the experimental group.
Reviews of Individual Studies 6-7 3
A pilot evaluation of small group Challenging Horizons Program (CHP): A randomized trial. (2006)
This study examined the efficacy of an after-school program, the Challenging Horizons Program (CHP), that met four days a week and focused on improving organization, academic skills, and classroom behavior. The CHP was compared with a community control that included involvement in a district-run after-school program that met one to three days a week and focused on preparation for standardized testing. Participants were 48 middle-school youth, referred as experiencing a combination of learning and behavior problems, randomly assigned to either the CHP or the control. Parent and teacher ratings of behavioral and academic functioning were collected at the beginning of the academic year and again after one semester of intervention. Relative to the control, participants in the CHP made significant improvements in parent rated academic progress, self-esteem, and overall severity of problem. While teacher ratings did not reach significance, CHP participants made medium effect size improvements in academic progress and small improvements in overall severity. Core class grades and discipline records were also examined to provide a broad picture of functioning beyond rating scale data.
Reviews of Individual Studies 4-8 3
Effect of a combined repeated reading and question generation intervention on reading achievement. (2006)
Research was conducted to ascertain if a combined repeated reading and question generation intervention was effective at improving the reading achievement of fourth through eighth grade students with learning disabilities or who were at risk for reading failure. Students were assigned to a treatment or control group via a stratified random sampling. Instructional components and training were based on best practices reported in the literature. Students receiving intervention significantly improved their reading speed and ability to answer inferential comprehension questions on passages that were reread. Compared to the control group, students in the intervention group also made significant gains in oral reading fluency on independent passages.
Reviews of Individual Studies 6-10 3
Help with English Language Proficiency &ldquo;HELP&rdquo; program evaluation of sheltered instruction multimedia lessons. (2005)
Reviews of Individual Studies 6-8 3
Effects of mathematical word problem-solving instruction on middle school students with learning problems. (2005)
This study investigated the differential effects of two problem-solving instructional approaches--schema-based instruction (SBI) and general strategy instruction (GSI)--on the mathematical word problem-solving performance of 22 middle school students who had learning disabilities or were at risk for mathematics failure. Results indicated that the SBI group significantly outperformed the GSI group on immediate and delayed posttests as well as the transfer test. Implications of the study are discussed within the context of the new IDEA amendment and access to the general education curriculum.
Reviews of Individual Studies K-8 3
The Teacher Advancement Program report two: Year three results from Arizona and year one results from South Carolina TAP schools. (2004)
Reviews of Individual Studies 4-11 -1
Unconditional Education Year 1 Evaluation Report. (n.d.)
Reviews of Individual Studies 1-12 -1
Multiple choice: Charter school performance in 16 states. (June 2009)
Reviews of Individual Studies 7 -1
The effects of cognitive strategy instruction on math problem solving of middle school students of varying ability. (in press)
The effects of a mathematical problem-solving intervention on students' problem-solving performance and math achievement were measured in a randomized control trial with 1,059 7th-grade students. The intervention, "Solve It!," is a research-based cognitive strategy instructional intervention that was shown to improve the problem-solving performance of 8th-grade students with and without learning disabilities (LD). The purpose of the present study was to determine whether the effectiveness of the intervention could be replicated with younger students. Forty middle schools in a large urban school district were included in the study, with one 7th-grade math teacher participating at each school (after attrition, n = 34). "Solve It!" was implemented by the teachers in their inclusive math classrooms. Problem-solving performance was assessed using curriculum-based math problem-solving measures, which were administered as a pretest and then monthly over the course of the 8-month intervention. Students who received the intervention (n = 644) embedded in the district curriculum showed a significantly greater rate of growth on the curriculum-based measures than students in the comparison group (n = 415) who received the district curriculum only. Results of the Bayesian analyses indicated that the intervention effect was somewhat stronger for low-achieving students than for average-achieving students. Overall, findings from the present study as well as the previous study with 8th-grade students indicate that the intervention was effective across ability groups and is an appropriate program to use in inclusive classrooms with students of varying math ability.
Reviews of Individual Studies 3-8 -1
The New York City Aspiring Principals Program: A school-level evaluation. (August 2009)
Reviews of Individual Studies 4-8 -1
Final Report of the i3 Evaluation of the Collaboration and Reflection to Enhance Atlanta Teacher Effectiveness (CREATE) Teacher Residency Program (2021)
Reviews of Individual Studies 1-12 -1
The effects of the Louisiana Scholarship Program on student achievement and college entrance. (2021)
The Louisiana Scholarship Program (LSP) offers publicly funded vouchers to moderate- and low-income students in low-performing public schools to enroll in participating private schools. Established in 2008 as a pilot program in New Orleans, the LSP expanded statewide in 2012. Drawing upon the random lotteries that placed students in LSP schools, we estimate the causal impact of using an LSP voucher to enroll in a private school on student achievement on the state accountability assessments in math, English Language Arts, and science over a four-year period, as well as on the likelihood of enrolling in college. The results from our primary analytic sample indicate substantial negative achievement impacts, especially in math, that diminish after the first year but persist after four years. In contrast, when considering the likelihood of students entering college, we observe no statistically significant difference between scholarship users and their control counterparts.
Reviews of Individual Studies 7-12 -1
Evaluation Report: Investing in Innovation Pathways to Success (2021)
Reviews of Individual Studies 7-12 -1
The Pathway to Academic Success: Scaling Up a Text-Based Analytical Writing Intervention for Latinos and English Learners in Secondary School (2020)
This study reports findings from a multisite cluster randomized controlled trial designed to validate and scale up an existing successful professional development program that uses a cognitive strategies approach to text-based analytical writing. The Pathway to Academic Success Project worked with partner districts affiliated with 4 National Writing Project (NWP) sites in southern California. Informed by a wide body of research on the efficacy of strategy instruction to enhance students' academic literacy, the intervention aimed to help secondary school students, particularly Latinos and mainstreamed English learners, to develop the academic writing skills called for in the rigorous Common Core State Standards for English Language Arts. Two hundred thirty teachers from partner districts affiliated with the NWP sites were stratified by school and grade and then randomly assigned to the treatment or control group. Treatment teachers participated in 46 hrs of training and learned how to apply cognitive strategies by using an on-demand writing assessment to help students understand, interpret, and write analytical essays about nonfiction texts. Multilevel models revealed significant effects on a holistic measure of an on-demand writing assessment (d = 0.32) as well as on 4 analytic attributes: content (d = 0.31), structure (d = 0.29), fluency (d = 0.27), and conventions (d = 0.32). Four dimensions of scaling up--spread, reform ownership, depth, and sustainability--are also discussed.
Reviews of Individual Studies 6-8 -1
Effects of the Executive Development Program and Aligned Coaching for School Principals in Three U.S. States. Investing in Innovation Study Final Report. (2020)
The purpose of this study was to evaluate the National Institute for School Leadership's (NISL's) Executive Development Program (EDP) and paired leadership coaching as implemented in three states, with funding from the U.S. Department of Education's Investing in Innovation (i3) grant program. NISL's Executive Development Program (EDP) is a year-long professional development program that has served thousands of principals in 23 states since 2014. The study was a randomized control trial study spanning 332 schools and 118 school districts. It evaluated the effects of the offer of and of participation in the EDP and coaching. Take up rates of the program were relatively low, and the study found no significant effects of the EDP and coaching on student achievement in English language arts or mathematics, on student attendance rates, or on student grade progression rates within three years of the start of the program. There were, however, effects of participation in the EDP and coaching in two areas of leadership practice as reported by principals on surveys conducted more than two years after the start of the intervention. We hypothesize that local buy-in and capacity to fully participate in the intensive professional development program most likely influenced the degree to which the intervention was successful. [Criterion Education sponsored this report, with funding from NISL through the i3 grant from the U.S. Department of Education. For the first report of this series, "Putting Professional Learning to Work: What Principals Do with Their Executive Development Program Learning," see ED606171.]
Reviews of Individual Studies 5-8 -1
The impact of an intensive year-round middle school program on college attendance. (2020)
Too many talented students who go to under-resourced schools do not achieve their full potential. Though they may perform very well relative to their classmates, these students do not receive the same kinds of academically challenging opportunities throughout their educational journey as do their counterparts in better-resourced public and private schools. Rather than matriculating to competitive high schools and from there to selective colleges they are qualified to attend, these students often go to less academically competitive high schools and on to colleges where graduation rates are low. Some even forgo college altogether. To address this problem, Higher Achievement offers an intensive, academically oriented program for middle school students in under-resourced schools. Starting in the summer before fifth or sixth grade, Higher Achievement offers its participants, called "scholars," 650 extra hours of academic enrichment and instruction after school and during the summers through the eighth grade. The program includes English and math instruction as well as field trips to competitive high schools and colleges, achievement test preparation, and assistance in applying for financial aid. This short report presents the results of a randomized controlled trial of Higher Achievement that started in 2005, comparing the outcomes of students who were offered the opportunity to participate in Higher Achievement (the program group) and students who were not (the control group). It presents the impacts of the program one, two, and four years after enrollment, as well as its long-term impacts on college attendance. The study found that Higher Achievement was successful at changing the educational trajectory of students through middle school and improved the academic quality of many students' high school experiences, but did not affect the colleges to which they matriculated. By Year 2, there were positive impacts on students' math and reading test scores. In Year 4, the impacts on math test scores remained statistically significant. Higher Achievement had a small impact on the types of high schools its scholars ultimately attended. Program group students were more likely than control group students to matriculate to private or parochial schools and less likely to go to nonacademically competitive charter or magnet schools. By 2019, there was no difference in college going. More than 70 percent of both program and control group students had ever attended college. There were no differences in the academic quality of the colleges Higher Achievement's scholars ultimately attended, as measured by being a two- or four-year college; a college having a lower acceptance rate; or a college whose freshmen on average had higher SAT math or reading scores. Higher Achievement's college impacts did not differ by whether a student's parent had attended college or by student characteristics. The study shows that Higher Achievement is a very effective middle school program, improving students' middle school trajectories. However, the impacts did not persist after the program through high school and college.
Reviews of Individual Studies 4-8 -1
Literacy Design Collaborative 2018-2019 evaluation report (CRESST Report 867). (2020)
Engaged in the evaluation of LDC tools since June 2011, UCLA's National Center for Research on Evaluation, Standards, and Student Testing (CRESST) is using multiple data sources and a quasi-experimental design to examine LDC implementation and impact in two cohorts of schools in two large, urban school districts. This report presents the results on implementation of LDC in the large urban school district on the West Coast during the third year of the intervention, and the impact of the program across multiple years. Findings from both participant surveys and analyses of student outcomes reveal positive results for the LDC intervention. Analysis of student outcomes provided evidence of the program's effectiveness and confirmation for participants' positive views. Quasi-experimental analyses demonstrated a statistically significant positive impact of LDC as practiced by middle school teachers with 2 years of program experience across two cohorts of schools and teachers. A statistically significant positive impact was also found for Cohort 2 middle schools after just one year of implementation. [For the 2017-2018 report, see ED600053.]
Reviews of Individual Studies 1-8 -1
Literacy Design Collaborative 2018-2019 Evaluation Report for New York City Department of Education (2020)
The Literacy Design Collaborative (LDC) was created to support teachers in implementing college and career readiness standards in order to teach literacy skills throughout the content areas. Teachers work collaboratively with coaches to further develop their expertise and design standards-driven, literacy-rich writing assignments within their existing curriculum across all content areas. This report presents the results on implementation of LDC in the New York City Department of Education during the third year of the intervention, and the impact of the program across multiple years. As of 2018-2019, participating schools included 13 from Cohort 1, which began implementation during the 2016-2017 school year, and 23 from Cohort 2, which commenced at the beginning of the 2017-2018 school year. Our primary impact analyses, presented in this report for the first time, pool teachers from both cohorts to measure their impact after participating in LDC for 2 consecutive years (2017-2018 student outcomes for Cohort 1 and 2018-2019 student outcomes for Cohort 2). Teachers and administrators appreciated LDC and perceived positive impact on their practice and their students' learning. Quasi-experimental analyses tended to produce positive estimates for the impact of LDC on student English language arts (ELA) assessment scores, but the differences did not reach the level of statistical significance. [For the 2017-2018 evaluation report, see ED606884.]
Reviews of Individual Studies 4-11 -1
The Next Generation of State Reforms to Improve their Lowest Performing Schools: An Evaluation of North Carolina's School Transformation Initiative (2019)
In contrast to prior federally mandated school reforms, the Every Student Succeeds Act (ESSA) allows states more discretion in reforming their lowest performing schools, removes requirements to disrupt the status quo, and does not allocate substantial additional funds. Using a regression discontinuity design, we evaluate a state turnaround initiative aligned with ESSA requirements. We find the effect on student test score growth was not significant in year one and -0.13 in year two. Also in year two, we find that teachers in turnaround schools were 22.5 percentage points more likely to turn over. Teacher turnover appears to have been voluntary rather than the result of strategic staffing decisions.
Reviews of Individual Studies 4-8 -1
Literacy Design Collaborative 2017–2018 evaluation report for New York City Department of Education (2019)
Reviews of Individual Studies 4-7 -1
Evaluation of the Teacher Potential Project (2019)
This study assesses the implementation and impacts of the Teacher Potential Project (TPP), a program designed by EL Education and which includes an English language arts (ELA) standards-aligned curriculum and embedded professional development for teachers. The study uses a randomized controlled trial (RCT) design to assess the impacts of TPP on the instructional practice outcomes of ELA teachers in grades 3 through 8 and the ELA achievement outcomes of their students. The RCT includes 70 elementary and middle schools (35 treatment and 35 control) in 18 relatively high-need districts that were randomly assigned to treatment and control conditions within matched pairs of schools in three cohorts that began participating in the 2014-2015, 2015-2016, and 2016-2017 school years. Treatment schools engaged in TPP for one year while control schools continued with business as usual. The study also uses a two-year quasi-experimental design (QED) study to assess the impact of extending implementation of TPP to a second year on teacher instructional practice and student ELA achievement outcomes. EL Education recruited 22 of the study schools (10 treatment and 12 control) in five districts in one cohort to participate in a second year of the study. The study team collected a variety of data for the evaluation of TPP, including teacher surveys and classroom observations administered in fall and spring each year and student administrative records. Impacts of TPP on ELA teacher instructional practices and student ELA achievement were estimated using multivariate regression methods. The implementation evaluation found that the TPP ELA curriculum was implemented in all schools, and that there was generally high school-level implementation fidelity of the TPP professional development components in the first and second years of TPP among the novice ELA teachers. The impact evaluation found positive impacts of TPP on ELA teachers' overall instructional practices after one year compared to teachers who used their district-provided curriculum and participated in their district's professional development supports. After two years of teacher participation, impacts on their students' ELA achievement were roughly equivalent to 1.4 months of typical student improvement, or moving an average student scoring at the 50th percentile to the 54th percentile. The findings be useful to districts and policymakers aiming to support teachers and students in the context of rigorous state standards such as the Common Core State Standards (CCSS). The study of TPP makes several important contributions to the literature evaluating paired curriculum and PD programs: it uses rigorous group designs, evaluates the impact of one and two years of program implementation, and examines broad outcomes on both teacher instructional practice and student ELA achievement. [This report was submitted by Mathematica to EL Education.]
Reviews of Individual Studies 5-8 -1
Is the pen mightier than the keyboard? The effect of online testing on measured student achievement (2019)
Nearly two dozen states now administer online exams to deliver testing to K-12 students. These tests have real consequences: their results feed into accountability systems, which have been used for more than a decade to hold schools and districts accountable for their students’ learning. We examine the rollout of computerbased testing in Massachusetts over 2 years to investigate test mode effects. Crucial to the study design is the state administering the same exam (PARCC) in online and offline formats each year during the transitional period. We find an online test penalty of about 0.10 standard deviations in math and 0.25 standard deviations in English language arts (ELA), which partially but not fully fades out in the second year of online testing.
Reviews of Individual Studies 6-8 -1
Final impact results from the i3 implementation of Teach to One: Math (2019)
Reviews of Individual Studies 7-8 -1
Study of Physical Science and Engineering Invention Kit Curriculum for Middle School: External Evaluation of the Investing in Innovation Central Virginia Advanced Manufacturing Development Grant 78 (2019)
Reviews of Individual Studies 7-8 -1
Evaluation of Reading Apprenticeship across the Disciplines (RAAD): Effective Secondary Teaching and Learning through Literacy Leadership (2019)
Reviews of Individual Studies K-12 -1
A state-wide quasi-experimental effectiveness study of the scale-up of school-wide Positive Behavioral Interventions and Supports (2019)
The three-tiered Positive Behavioral Interventions and Supports (PBIS) framework promotes the development of systems and data analysis to guide the selection and implementation of evidence based practices across multiple tiers. The current study examined the effects of universal (tier 1) or school-wide PBIS (SW-PBIS) in one state's scale-up of this tier of the framework. Annual propensity score weights were generated to examine the longitudinal effects of SW-PBIS from 2006–07 through 2011–12. School-level archival and administrative data outcomes were examined using panel models with an autoregressive structure. The sample included 1316 elementary, middle, and high schools. Elementary schools trained in SW-PBIS demonstrated statistically significantly lower suspensions during the fourth and fifth study years (i.e., small effect size) and higher reading and math proficiency rates during the first two study years as well as in one and two later years (i.e., small to large effect sizes), respectively. Secondary schools implementing SW-PBIS had statistically significantly lower suspensions and truancy rates during the second study year and higher reading and math proficiency rates during the second and third study years. These findings demonstrate medium effect sizes for all outcomes except suspensions. Given the widespread use of SW-PBIS across nearly 26,000 schools in the U.S., this study has important implications for educational practices and policies.
Reviews of Individual Studies PK-12 -1
Parents at the Center: Final Parent Leadership Institute Evaluation Report (2019)
The Parent Leadership Institute (PLI) of Children's Aid (CA), funded via a 2013 Investing in Innovation (i3) development grant operated between the 2014-15 through 2018-19 school years. Key goals of the PLI included: (1) improving the capacity of parents to effectively engage in the school community in support of their child; and (2) increasing the capacity of school staff to create and support environments which are welcoming to and supportive of the active engagement of parents as key members of the school community. Through implementation of the PLI, CA expanded its partnership with six schools located in the South Bronx community of Morrisania, an area characterized by high levels of poverty, health disparities, and crime, and low levels of academic achievement and attainment among both children and adults. This report serves as the final report on this phase of the PLI and includes an exploration of implementation during year 4 (2016-17 school year) and analyses of quantitative data on student academic performance. [This report was prepared for Children's Aid New York.]
Reviews of Individual Studies K-8 -1
Can we increase attendance and decrease chronic absenteeism with a universal prevention program? A randomized control study of attendance and truancy universal procedures and interventions (2018)
The purpose of this study was to examine the effects of a school-wide attendance and truancy intervention and universal procedures (ATI-UP) on student attendance. Student attendance was measured through average daily attendance and the percentage of students who would be considered chronically absent, i.e., missing 10% or more of school. The sample included 27 elementary schools in Oregon implementing school-wide positive behavior intervention and supports (SWPBIS) with varying levels of fidelity. Results indicate that schools can have a moderate effect on increasing average daily attendance (ADA) and a small effect on decreasing chronic absenteeism, although these results were not statistically significant. SWPBIS implementation did not act as a statistically significant moderator on the ATI-UP effects, although the treatment effect on ADA decreased with higher SWPBIS implementation. [The dissertation citations contained here are published with the permission of ProQuest LLC. Further reproduction is prohibited without permission. Copies of dissertations may be obtained by Telephone (800) 1-800-521-0600. Web page: http://www.proquest.com/en-US/products/dissertations/individuals.shtml.]
Reviews of Individual Studies 6-8 -1
Closing inspiration and achievement gaps in STEM with volunteer-led apprenticeships (2018)
Reviews of Individual Studies 6-8 -1
Middle-Grades Leadership Development (MLD) Project: A U.S. Department of Education Investing in Innovation (i3) Development Grant Final Evaluation Report (2018)
The Middle-Grades Leadership Development (MLD) Project was designed to develop principal leaders and leadership teams who create high-performing middle-grades schools. Designed by the National Forum to Accelerate Middle-Grades Reform, the four-year project was funded from 2013 to 2017 by a U.S. Department of Education Investing in Innovation (i3) development grant. The project was implemented in 12 middle-grades schools in rural and small town areas of Kentucky and Michigan. Schools received an extensive set of school improvement supports, including: creating a vision using the Forum's Schools to Watch (STW) criteria; engaging in an assessment and planning process for improvement; STW leadership coach; principal mentor; STW mentor schools; leadership team; networking opportunities; and focused professional development. The evaluation of the MLD Project used a quasi-experimental design (QED) with matched comparison schools (12 treatment schools and 38 comparison schools) to examine the impact of the project on intermediate outcomes such as culture, collaboration, work climate, and teaching efficacy, as well as the long term outcomes of principal effectiveness and student achievement. Results showed that MLD treatment schools significantly improved their collaboration practices, teaching efficacy, middle-grades instructional practices, and their implementation of the STW criteria for high performance. There was significant improvement in the long-term outcome of principal effectiveness among treatment principals, with nine of the twelve principals improving their leadership skills and behaviors to the proficient or distinguished levels by the end of the grant. Although there was no overall intervention effect on ELA/reading or math student achievement, seven treatment schools displayed larger growth than the state average for some groups of students. The results provide unique insight into a middle-grades program focused on principal leaders and collaborative leadership. A roadmap that depicts the key supports, activities, and practices implemented at MLD schools that were the most impactful on building middle-grades leadership effectiveness were articulated. These include school-level practices (i.e., guiding vision, continuous improvement practices, reflective practices), principal-level practices (i.e., knowledge of young adolescents, commitment to developmentally appropriate practices, instructional leadership), collaborative leadership practices (i.e., developing teacher leaders, shared capacity), and teaching practices (i.e., student centered, high expectations, rigorous instruction) that combined, result in middle-grades leadership that is more effective. [The report was prepared by the Center for Prevention Research and Development.]
Reviews of Individual Studies 6-8 -1
The i3 validation of SunBay Digital Mathematics (2018)
Reviews of Individual Studies 6-12 -1
Evaluation of Education Connections: Supporting teachers with standards-based instruction for English learners in mainstream classrooms. Final report. (2018)
Reviews of Individual Studies 4-7 -1
Reducing academic inequalities for English language learners: variation in experimental effects of word generation in high-poverty schools (2018)
Reviews of Individual Studies 4-8 -1
Literacy Design Collaborative 2016–2017 evaluation report for the New York City Department of Education (CRESST Report 856) (2018)
The Literacy Design Collaborative (LDC) was created to support teachers in implementing college and career readiness standards in order to teach literacy skills throughout the content areas. Teachers work collaboratively with coaches to further develop their expertise and design standards-driven, literacy-rich writing assignments within their existing curriculum across all content areas. The 2016-2017 school year was the first year of implementation, following a pilot year during which the implementation plan, instruments, data collection processes, and analytical methodologies were refined. Participants across all groups reported positive attitudes toward LDC and perceive a positive impact on student outcomes. Analysis of module artifacts suggest that teachers at the elementary school level were moderately successful in the backwards design process, particularly in developing high-quality writing tasks for students. As an ongoing multiyear intervention, the LDC implementation will continue to evolve year to year as participants provide feedback and LDC program managers make refinements. Thus, we anticipate that further significant changes to the course material and the delivery system that are already in progress for Year 2 will likely result in continued and possibly increased positive feedback. [Funding for this work was provided by the Literacy Design Collaborative.]
Reviews of Individual Studies 3-10 -1
Impact Evaluation of "INSPIRE: Infusing Innovative STEM Practices into Rigorous Education" (2018)
"INSPIRE" is an Investing in Innovation (i3) development grant funded by the Office of Innovation and Improvement, U.S. Department of Education. "INSPIRE" provides an innovative integrated K-12 STEM pipeline approach focused on STEM course content and instructional redesign. The INSPIRE model was implemented in Cabarrus County Schools (CCS), which is among the largest school systems in North Carolina, serving nearly 30,000 students in 39 schools. The impact evaluation included two studies that examined the effect of INSPIRE on mathematics and science achievement as measured by North Carolina standardized End-of-Grades assessments. The elementary study (Study 1) used a three-year, longitudinal, single-cohort quasi-experimental design (QED) to assess the impact of INSPIRE on math achievement at the end of 5th grade after two years of program exposure. The secondary study (Study 2) used an individual-level, longitudinal, randomized controlled trial (RCT) with blocking by school level and cohort to assess the effects of INSPIRE on math and science achievement at the end of 7th and 10th grades after two years of program exposure. For both studies, we compared the outcomes of INSPIRE students with similar students from schools that did not offer a STEM program. For the elementary study, propensity score matching (PSM) was used to match INSPIRE elementary students and comparison student samples at baseline (on pre-test math achievement scores, gender, minority status, and economically disadvantaged status) and baseline equivalence was established all pre-test assessment measures; this study met What Works Clearinghouse (WWC) Group Design Standards with Reservations. For the secondary study, the overall and differential attrition rates were low based on the WWC attrition standards (WWC, 2017); this study met WWC Group Design Standards without Reservations. The results of the elementary study indicated a statistically significant difference between the "INSPIRE" treatment group and the business-as-usual comparison group on the math achievement outcome. Comparison students reported a statistically significant higher increase in math achievement than "INSPIRE" students. Results of the secondary study indicated no statistically significant difference between the "INSPIRE" treatment group and the business-as-usual comparison group on the math and science achievement outcome. The duration of students' exposure to INSPIRE, fidelity of implementation, alignment between PBL instruction and NC standardized assessments, and contextual factors that might have weakened the intervention strength relative to business-as-usual conditions are discussed as possible factors that account for these findings. The report concludes with suggestions for future research and implications for education policy.
Reviews of Individual Studies 4-Not reported -1
Mentoring Early Career Teachers in Urban Alaska: Impact Findings from the Investing in Innovation (i3) Evaluation of the Alaska Statewide Mentor Project Urban Growth Opportunity (2017)
In 2011, the University of Alaska Fairbanks (UAF) received an Investing in Innovation (i3) Grant through the U.S. Department of Education. UAF applied for the grant to expand the predominantly rural-serving Alaska Statewide Mentor Project (ASMP) to urban settings. ASMP is a professional development initiative that supplies fully released, highly trained mentors to early career teachers (ECTs). UAF's i3 grant, The Urban Growth Opportunity (UGO), included five districts: Anchorage, Fairbanks North Star Borough, Kenai Peninsula Borough, Matanuska-Susitna Borough, and Sitka. This is the final report for the grant conducted over four years (2011 2012 to 2014 2015). The research team randomly assigned 556 ECTs to treatment (UGO) and business as usual (BAU) groups. UGO ECTs received an ASMP mentor for two years; BAU ECTs received their districts' business as usual support that varied by district and included content coaches without mentoring support and non-ASMP instructional mentoring support. Researchers conducted impact, implementation, and intervention studies. The impact study included seven outcomes: teacher retention; teacher instructional practice as measured by the three Classroom Assessment Scoring System (CLASS®) domains (Emotional Support, Classroom Organization, and Instructional Support); and student achievement in reading, writing, and mathematics as measured by the state assessment. While UGO ECTs were retained as teachers in Alaska public schools at higher rates than BAU ECTs, the difference was not statistically significant. There were no statistically significant differences between UGO and BAU ECTs on instructional practices as measured by CLASS®. Finally, student achievement was generally higher for students of UGO ECTs, but differences in achievement were statistically significant only for some student groups: primary reading students and secondary math students who were White, Hispanic, Alaskan Native, or two or more races. Results from the implementation study, conducted over three of the four years of implementation, found ASMP implemented UGO with fidelity across all components: mentor recruitment and assignment, mentor participation in professional development, mentor interaction with their ECTs, and mentors' use of formative assessment tools. Results from the intervention study identified two types of mentor-mentee dyads: Gliders and Sliders, with gliders engaging in longer conversations, focused more explicitly on instruction and students, responding to each other more often, and engaging as peers more frequently than the slider dyads.
Reviews of Individual Studies 4-12 -1
Impact of TNTP’s Teaching Fellows in urban school districts (2017)
Reviews of Individual Studies 1-7 -1
The effect of mentoring on school attendance and academic outcomes: A randomized evaluation of the Check & Connect program (Working Paper WP-16-18) (2017)
Reviews of Individual Studies 6-8 -1
Group Work is Not Cooperative Learning: An Evaluation of PowerTeaching in Middle Schools. A Report from the Investing in Innovation (i3) Evaluation (2017)
To succeed in today's economy, students need both proficiency in the "three Rs" (reading, writing and arithmetic) and strong applied skills. Communication skills, team work, and critical thinking have long been at the top of employers' lists of applied skills they seek in employees. States are responding to employers' needs by putting in place new educational standards. These standards include not only higher levels of basic academic knowledge that students are expected to master but also applied skills pertaining to presenting information, explaining one's reasoning, and effectively collaborating in groups. As a result, teachers nationwide are having students work in groups more frequently. This report examines a recent large-scale effort to expand a cooperative learning program in middle schools. The change in standard instructional practices gives schools a chance to not only teach students applied skills, but improve students' academic learning, if they can help teachers turn "group work" into "cooperative learning teams." PowerTeaching, a structured cooperative learning program, was designed to do just that. Thus, the expansion of PowerTeaching through a federal Investing in Innovation grant offers the education field a unique opportunity to learn what it takes to help teachers create cooperative learning environments in their classrooms. This report presents the lessons learned from this scale-up effort and findings from a multiyear evaluation of it. It describes how PowerTeaching was implemented over the first few years, how classrooms with the program differed from those without it, and whether students in the program performed better in math. The evaluation found that while teachers who taught with PowerTeaching learned to place their students into longstanding mixed-ability groups, which are thought to be conducive to cooperative learning, teachers did not consistently use the program's instructional techniques that transform group work into cooperative learning. In turn, students' math performance did not differ significantly between schools using the program and schools not using it. A likely cause for the weak implementation was that the ongoing professional development, which is an integral part of the PowerTeaching program, mostly did not occur or focused more on teaching the new material required by recently adopted education standards rather than on cooperative learning techniques. The evaluation thus points to the importance of focused, ongoing training and support when trying to modify teachers' instructional practices. This report was written with Deni Chen, Ashley Kennedy, and Joseph Quinn.
Reviews of Individual Studies 6-8 -1
Impact of a technology-mediated reading intervention on adolescents' reading comprehension (2017)
In this experimental study we examined the effects of a technology-mediated, multicomponent reading comprehension intervention, Comprehension Circuit Training (CCT), for middle school students, the majority of whom were struggling readers. The study was conducted in three schools, involving three teachers and 228 students. Using a within-teacher design, middle school teachers' reading classes were randomly assigned to treatment (n = 9) or business as usual (n = 7) conditions. In the CCT condition, students received, on average, 39 lessons of video-modeled instruction in word reading, vocabulary, and comprehension instruction during reading intervention classes. Results of multilevel structural equation models indicated statistically significant effects favoring the CCT condition on three measures: reading comprehension latent variable (ES = 0.14), proximal vocabulary (ES = 0.43), and silent reading efficiency (ES = 0.28). Subgroup analyses indicated that students with lower entry-level reading comprehension tended to benefit more from the CCT intervention in reading comprehension, silent reading efficiency, and state test scores.
Reviews of Individual Studies 6-8 -1
Evaluating the impact of a multistrategy inference intervention for middle-grade struggling readers (2017)
Purpose: We examined the effectiveness of a multistrategy inference intervention designed to increase inference making and reading comprehension for middle-grade struggling readers. Method: A total of 66 middle-grade struggling readers were randomized to treatment (n = 33) and comparison (n = 33) conditions. Students in the treatment group received explicit instruction in 4 inference strategies (i.e., clarification using text clues; activating and using prior knowledge; understanding character perspectives and author's purpose; answering inferential questions). In addition, narrative and informational texts were carefully chosen and sequenced to build requisite background knowledge to form inferences. Intervention was delivered in small groups of 3 students for 10 days of instruction. Results: One-way analysis of covariance models on outcome measures with the respective pretest scores as a covariate revealed significant gains on a proximal measure of Egyptian-content knowledge (g = 1.37) and on a standardized measure of reading comprehension--i.e., Wechsler Individual Achievement Test--Third Edition Reading Comprehension (g = 0.46). Conclusion: The moderate effect on a standardized measure of reading comprehension provides preliminary evidence for the effectiveness of this multistrategy inference intervention in improving reading comprehension of middle-grade struggling readers.
Reviews of Individual Studies 6-8 -1
Evaluation of violence prevention approaches among early adolescents: Moderating effects of disability status and gender (2016)
Reviews of Individual Studies 6-8 -1
The LASER model: A systematic and sustainable approach for achieving high standards in science education: SSEC i3 Validation Final Report of Confirmatory and Exploratory Analyses [Middle Schools]. (2016)
Reviews of Individual Studies 6-8 -1
An evaluation of the University of Chicago School Mathematics Project: Pre-Transition Mathematics (2016)
Reviews of Individual Studies 3-8 -1
Achievement Network's Investing in Innovation Expansion: Impacts on educator practice and student achievement. (2016)
Data-based instructional programs have proliferated in American schools despite limited evidence of their effectiveness in improving educator practice and raising student achievement. We report results from a two-year school-randomized evaluation of the Achievement Network (ANet), a program providing schools with standards-aligned interim assessments and intensive supports for instructional data use. Survey data show that ANet increased teacher satisfaction with the timeliness and clarity of the data they receive and available supports for instructional data-use and caused them to review and use interim assessment data more often. ANet did not, however, affect their confidence in data use or how frequently they differentiated instruction. Student impact estimates show no overall effect on student achievement in English language arts or mathematics. Despite the lack program effects on student achievement, we find that achievement is positively correlated with our survey-based measures of teacher perceptions and practices around instructional data use. Exploratory analyses suggest that the success of ANet in improving teacher practice and student achievement varies with the pre-existing capacity of schools to engage in data-based instruction. Schools rated by program staff as having a high level of readiness to implement the intervention prior to random assignment experienced positive impacts on student achievement, while those rated as a having a low level of readiness experienced negative impacts. The following are appended: (1) School Screener Scoring Rubric; (2) Year 2 School Leader and Teacher Survey Scale Items; and (3) School Leader and Teacher Survey Impact Tables.
Reviews of Individual Studies 3-8 -1
The LASER model: A systematic and sustainable approach for achieving high standards in science education: SSEC i3 Validation Final Report of Confirmatory and Exploratory Analyses [Elementary Schools]. (2016)
Previous research has linked inquiry-based science instruction (i.e., science instruction that engages students in doing science rather than just learning about science) with greater gains in student learning than text-book based methods (Vanosdall, Klentschy, Hedges & Weisbaum, 2007; Banilower, 2007; Ferguson 2009; Bredderman, 1983; Shymansky, Hedges, & Woodworth, 1990). The LASER model, being validated in the current study, has already been the subject of a number of case studies (RMC Research Corporation, 2010; Horizon Research, 2010; Vanosdall et al., 2007). However, experimental studies of the type that might establish a causal link between program implementation, student science learning, and other valued outcomes have yet to be conducted. Only a handful of studies have involved random assignment, and most of these have involved random assignment of students in a relatively small number of classrooms (see Furtak et al. 2009). With support from the U.S. Department of Education's Investing in Innovation Fund (i3), the current validation study of the LASER Model encompasses approximately 60,000 students, 1,900 teachers, and over 140 district administrators and principals. The efficacy of the LASER program has important implications for both research and practice when working with high-poverty schools and districts, who have limited resources and time available for science interventions. LASER's initial success with early learners also demonstrates its potential for reducing the development of chronic, long-term deficiencies and academic problems. One table and one figure are appended.
Reviews of Individual Studies 3-8 -1
The LASER Model: A Systemic and Sustainable Approach for Achieving High Standards in Science Education (2016)
Reviews of Individual Studies 6-8 -1
Schools to watch: School transformation network: A U.S. Department of Education Investing in Innovation (i3) Development grant. Final evaluation report. (2015, September)
The Schools to Watch: School Transformation Network Project is a whole school reform model designed to improve the educational practices, experiences, and outcomes of low-performing middle-grades schools. Developed by the National Forum to Accelerate Middle-Grades Reform, the four-year project was funded in 2010 by a U.S. Department of Education Investing in Innovation (i3) development grant. The purpose of the study was to examine the impact of the project on intermediate outcomes such as culture, collaboration, and instructional practices as well as the long term outcome of student achievement. The study employed a quasi-experimental design where two student cohorts were tracked over four years at 34 schools (17 intervention and 17 comparison) in three states. The intervention schools were comprised of persistently low-performing middle-grades schools serving high need students. Comparison schools were selected using key demographics to match to intervention schools. Several process and measurement tools for assessing implementation and intermediate outcomes were used, including surveys, the STW criteria rating rubric, coach's logs, and focus groups. The long term outcome data for the impact study included student English and math achievement scores on annual standardized state assessments. To examine achievement scores between intervention and comparison students, a series of 2-level models (students within schools) were run to assess 8th grade achievement (i.e., after students received all three years of the intervention). Results showed that i3 STW Project schools improved their culture and climate, collaboration practices, leadership practices, STW criteria implementation, and classroom instructional practices. There was no overall intervention effect on either English or math student achievement, however, significant results were found for the highest implemented schools, those project schools that achieved STW designation during the project. The results of the study provide unique insight into the reform process for i3 STW Project schools as well as other middle-grades schools that are struggling to improve. The multiple supports provided by the project combined with the guiding vision of the STW criteria and rubric supported these high need schools to improve contextual factors (i.e., culture, collaboration, leadership, teaching and learning practices), and for a subsample of schools, student achievement. Districts and schools embarking on reform need to focus on collaborative leadership, have a guiding vision, use a continuous improvement model for instructional improvements, and value networking with other schools to gain knowledge. Two appendices are included: (1) Psychometric Properties of the Self-Study Survey Constructs; and (2) Fidelity Matrix for National Forum's STW School Transformation Network Project.
Reviews of Individual Studies 6-7 -1
Getting from here to there: Testing the effectiveness of an interactive mathematics intervention embedding perceptual learning. (2015)
Reviews of Individual Studies 6-12 -1
Case management for students at risk of dropping out: Implementation and interim impact findings from the Communities in Schools evaluation. (2015)
Too many students drop out and never earn their high school diploma. For students at risk of dropping out, academic, social, and other supports may help. "Communities In Schools" seeks to organize and provide these supports to at-risk students in the nation's poorest-performing schools, including through "case-managed" services. This report, the first of two from a random assignment evaluation of "Communities In Schools" case management, focuses primarily on the implementation of case management in 28 secondary schools during the 2012-2013 school year. The report also includes interim one-year findings about case management's impact on student outcomes. The report concludes with suggestions for improvement for "Communities In Schools" based mainly on the implementation findings. The next report will present two-year impact findings and more about the implementation of case management in the 2013-2014 school year. Appended to the report are: (1) Statistical Model and Statistical Power; and (2) Sample and Response Analysis.
Reviews of Individual Studies 6-8 -1
EngageME P.L.E.A.S.E impact study results [Middle school]. (2015)
Reviews of Individual Studies K-12 -1
Exploring the causal impact of the McREL Balanced Leadership Program on leadership, principal efficacy, instructional climate, educator turnover, and student achievement. (2015)
This study uses a randomized design to assess the impact of the Balanced Leadership program on principal leadership, instructional climate, principal efficacy, staff turnover, and student achievement in a sample of rural northern Michigan schools. Participating principals report feeling more efficacious, using more effective leadership practices, and having a better instructional climate than control group principals. However, teacher reports indicate that the instructional climate of the schools did not change. Furthermore, we find no impact of the program on student achievement. There was an impact of the program on staff turnover, with principals and teachers in treatment schools significantly more likely to remain in the same school over the 3 years of the study than staff in control schools.
Reviews of Individual Studies 7-8 -1
U.S. Department of Education Grant Performance Report (ED-524B): CSR Colorado (2015)
Reviews of Individual Studies 7-12 -1
Year 2 Findings for APTIP impacts on students’ AP performance in cohorts 1 and 2 schools. (2015)
Reviews of Individual Studies 3-11 -1
The Data-Driven School Transformation Partnership: A project of the Bay State Reading Institute (BSRI) and 17 Massachusetts elementary schools. (2015)
Reviews of Individual Studies 4-10 -1
Final impact analysis report WriteUp! (Dev12-13). (2015)
Reviews of Individual Studies 4-8 -1
Developing educators throughout their careers: Evaluation of the Rio Grande Valley Center for Teaching and Leading Excellence. (2015)
Reviews of Individual Studies 5-7 -1
The Baltimore City Schools Middle School STEM summer program with VEX Robotics. (2015)
In 2011 Baltimore City Schools submitted a successful proposal for an Investing in Innovations (i3) grant to offer a three year (2012-2014) summer program designed to expose rising sixth through eighth grade students to VEX robotics. The i3-funded Middle School Science, Technology, Engineering and Mathematics (STEM) Summer Learning Program was part of a larger Baltimore City STEM summer learning program entitled "Create the Solution" in 2012 and "22nd Century Pioneers" in 2013 and 2014. The five-week summer program offered in 2012, 2013, and 2014 consisted of a half-day of instruction in mathematics and science and a half-day of enrichment activities. The robotics workshop taught students the fundamentals of building robots and provided time for teams to build their own robots and participate in competitions. The larger program offered different enrichment activities such as sports or arts. This report addresses research questions regarding the program's: (1) implementation fidelity; (2) performance goals; (3) impact on student attendance and mathematics achievement outcomes; (4) impact on student aspirations for college, studying STEM subjects in college, and pursuing STEM careers; and (5) impact on measures of teacher effectiveness. The following includes a summary for each: (1) Implementation Fidelity: Instruction in mathematics and robotics was implemented with fidelity all three program years. Implementation fidelity was lower for the professional development in robotics and mathematics components of the program because teacher attendance rates did not meet the thresholds set by City Schools; (2) Enrollment Goals: Most program enrollment goals were not met. Enrollment in the i3-funded program was 193 students in 2012 (goal 400), 384 in 2013 (goal 500), and 386 in 2014 (goal 600). The program sought to enroll 80% low-performing students in mathematics each year, but fell significantly short of this goal despite the district's efforts to reach out to these students. In addition, the program goal of enrolling at least 50% female participants was not met. The program also sought to have at least 80% of students attend at least 70% of the time (17 of the 24 program days), but only 55% of students attended at that rate. The program did meet its goals for recruiting minority (at least 95%) and high poverty students (at least 80%) each year; (3) Program Impacts on Attendance: Found a significant program effect on attendance in the year following the 2012 program. Program students had average attendance rates of 1.4 percentage points higher than the comparison group the year following the program (97.0% vs. 95.6%). An even larger significant program effect for low-achieving students' attendance was found in the year following the 2012 program (96.4% vs. 93.8%). The 2013 program students had slightly but not significantly higher attendance rates than their matched comparison students in the year following the program. The authors also also examined whether there was still a program effect on attendance a year later (2013-14) for the Summer 2012 participants. Program participants had average attendance rates of 1.5 percentage points higher than comparison students (95.2% vs. 93.7%). Among the low-achieving students the attendance difference was 2.4 percentage points (93.6% for program students vs. 91.2% for comparison students). These effects were not statistically significant; (4) Program Impacts on Mathematics Achievement: There were no program effects on mathematics achievement for either the 2012 or 2013 programs; (5) Program Impacts on Student Aspirations: There was no evidence from student survey data that the robotics program had a positive effect on student aspirations to attend college, study STEM subjects in college, or pursue a STEM career for either the 2013 or 2014 programs; and (6) Program Impacts on Teacher Effectiveness: Analyses based on mean instructional effectiveness scores from Spring 2013 and Fall 2013 on the nine components of the district's teacher evaluation tool examined whether teachers who received the summer professional development in 2013 made gains in instructional effectiveness. The difference between program teachers' effectiveness scores before and after the professional development was not statistically significant. Data were not available to examine differences between program teachers and a comparable group of teachers who did not receive the summer professional development. The following are appended: (1) Implementation Fidelity; (2) Performance Goals; and (3) Methodology.
Reviews of Individual Studies 4-8 -1
The district-wide effectiveness of the Achieve3000 program: A quasi-experimental study. (2015)
The purpose of this study was to evaluate the impact of Achieve3000, a differentiated online literacy curriculum, on students' scores on the California State Test (CST). In the 2011-12 school year, 1,957 students in Chula Vista began using Achieve3000's solutions in 3rd through 8th grade. Using a form of propensity score matching called Inverse Probability-of-Treatment Weighting (IPTW), the researchers assigned weights for the likelihood that students in the non-user comparison group (N = 7,598) could have been in the Achieve3000 treatment group. A Weighted Least Squares (WLS) regression model with IPTW weights estimated the average treatment effect. The researchers found that, overall, the students assigned to Achieve3000 performed statistically significantly higher on the CST, by 2.4 points, than students who were not using these solutions. This suggests the program is effective in improving student learning over conventional classroom activities in the first year of use, however more data is needed to determine the long term impact of usage. Five appendices contain supplemental tables and figures.
Reviews of Individual Studies 2-8 -1
Effects of using a web-based individualized education program decision-making tutorial. (2014)
This study explored the effects of a web-based decision support system ("Tutorial") for writing standards-based Individualized Education Programs (IEPs). A total of 35 teachers and 154 students participated across two academic years. Participants were assigned to one of three intervention groups based on level of "Tutorial" access: Full, Partial, or Comparison. Direct effects of the intervention on procedural and substantive elements of IEPs revealed that, although all groups had initial IEPs of similar quality, the Full Intervention group's post-"Tutorial" IEPs had a significantly higher proportion of substantive items rated as adequate than did the IEPs of other groups. The intervention's indirect effects were examined using student scores on the State Reading Assessment. The Full Intervention group demonstrated a higher rate of reading score gain than the other two groups during the academic year in which the IEP prepared with access to the "Tutorial" was implemented. Implications for educational practices and future research directions are discussed.
Reviews of Individual Studies K-8 -1
Comprehensive educator effectiveness models that work: Impact of the TAP System on student achievement in Louisiana. (2014)
TAP™: The System for Teacher and Student Advancement was launched in 1999 as a comprehensive educator effectiveness model to offer career advancement and leadership opportunities for educators, a fair and transparent evaluation process linked to job-embedded professional development and performance-based compensation, which culminate in improved instructional practices and student achievement. This study illustrates the impact of the TAP System in 66 Louisiana schools. These are primarily high-need schools, with average free/reduced price lunch eligibility of 86%, impacting more than 32,000 students each year. The authors report evidence of a positive effect of the TAP System on student achievement using two complementary analysis strategies: (1) They found a significant positive effect of TAP on 2012-13 K-8 Assessment Index scores, controlling for previous achievement, percentage of students receiving free or reduced price lunch, school configuration, school size (number of students), and percentage of English language learners. The 66 TAP schools scored 3.7 points higher on average than non-TAP schools statewide; and (2) They also found that the TAP schools had significantly greater 2012-13 Assessment Index scores than a group of matched control schools. The TAP schools scored 5.5 points higher on average than their matched controls.
Reviews of Individual Studies K-12 -1
The system for teacher and student advancement: An evaluation of achievement and engagement in Louisiana. (2013)
Reviews of Individual Studies 7-8 -1
The impact of eMINTS professional development on teacher instruction and student achievement: Year 1 report. (2013)
Reviews of Individual Studies 7-10 -1
Preventing youth violence and dropout: A randomized field experiment. (2013)
Improving the long-term life outcomes of disadvantaged youth remains a top policy priority in the United States, although identifying successful interventions for adolescents--particularly males--has proven challenging. This paper reports results from a large randomized controlled trial of an intervention for disadvantaged male youth grades 7-10 from high-crime Chicago neighborhoods. The intervention was delivered by two local non-profits and included regular interactions with a pro-social adult, after-school programming, and--perhaps the most novel ingredient--in-school programming designed to reduce common judgment and decision-making problems related to automatic behavior and biased beliefs, or what psychologists call cognitive behavioral therapy (CBT). We randomly assigned 2,740 youth to programming or to a control group; about half those offered programming participated, with the average participant attending 13 sessions. Program participation reduced violent-crime arrests during the program year by 8.1 per 100 youth (a 44 percent reduction). It also generated sustained gains in schooling outcomes equal to 0.14 standard deviations during the program year and 0.19 standard deviations during the follow-up year, which we estimate could lead to higher graduation rates of 3-10 percentage points (7-22 percent). Depending on how one monetizes the social costs of crime, the benefit-cost ratio may be as high as 30:1 from reductions in criminal activity alone. [A full list of sponsors of this project can be found on NBER's web site: http://www.nber.org/papers/w19014.ack.]
Reviews of Individual Studies 6-8 -1
Impacts of Five Expeditionary Learning Middle Schools on Academic Achievement (2013)
Reviews of Individual Studies 3-8 -1
Using Social-Emotional and Character Development to Improve Academic Outcomes: A Matched-Pair, Cluster-Randomized Controlled Trial in Low-Income, Urban Schools. (2013)
Background: School-based social-emotional and character development (SECD) programs can influence not only SECD but also academic-related outcomes. This study evaluated the impact of one SECD program, Positive Action (PA), on educational outcomes among low-income, urban youth. Methods: The longitudinal study used a matched-pair, cluster-randomized controlled design. Student-reported disaffection with learning and academic grades, and teacher ratings of academic ability and motivation were assessed for a cohort followed from grades 3 to 8. Aggregate school records were used to assess standardized test performance (for entire school, cohort, and demographic subgroups) and absenteeism (entire school). Multilevel growth-curve analyses tested program effects. Results: PA significantly improved growth in academic motivation and mitigated disaffection with learning. There was a positive impact of PA on absenteeism and marginally significant impact on math performance of all students. There were favorable program effects on reading for African American boys and cohort students transitioning between grades 7 and 8, and on math for girls and low-income students. Conclusions: A school-based SECD program was found to influence academic outcomes among students living in low-income, urban communities. Future research should examine mechanisms by which changes in SECD influence changes in academic outcomes.
Reviews of Individual Studies K-8 -1
The impact of Indianas system of interim assessments on mathematics and reading achievement. (2013)
Interim assessments are increasingly common in U.S. schools. We use high-quality data from a large-scale school-level cluster randomized experiment to examine the impact of two well-known commercial interim assessment programs on mathematics and reading achievement in Indiana. Results indicate that the treatment effects are positive but not consistently significant. The treatment effects are smaller in lower grades (i.e., kindergarten to second grade) and larger in upper grades (i.e., third to eighth grade). Significant treatment effects are detected in Grades 3 to 8, especially in third- and fourth-grade reading and in fifth- and sixth-grade mathematics.
Reviews of Individual Studies PK-12 -1
Findings from a two-year examination of teacher engagement in TAP schools across Louisiana. (2013)
Reviews of Individual Studies K-8 -1
Training your own: The impact of New York City’s Aspiring Principals Program on student achievement. (2012)
The New York City Leadership Academy represents a unique experiment by a large urban school district to train and develop its own school leaders. Its 14-month Aspiring Principals Program (APP) selects and prepares aspiring principals to lead low-performing schools. This study provides the first systematic evaluation of achievement in APP-staffed schools after 3 or more years. We examine differences between APP principals and those advancing through other routes, the extent to which APP graduates serve and remain in schools, and their relative performance in mathematics and English language arts. On balance, we find that APP principals performed about as well as other new principals. If anything, they narrowed the gap with comparison schools in English language arts but lagged behind in mathematics. (Contains 2 figures, 9 tables, and 23 notes.)
Reviews of Individual Studies 6-8 -1
Washington Striving Readers: Year 1 evaluation report. (2012)
In 2009, the United States Department of Education conducted a competition for a second round of Striving Readers grants. Its dual purpose was to: (1) Raise middle and high school students' literacy levels in Title I-eligible schools with significant numbers of students reading below grade level; and (2) Build a strong, scientific research base for identifying and replicating strategies that improve adolescent literacy skills through a required experimental study design. The Office of Superintendent of Public Instruction (OSPI), Washington's state education agency, joined together with evaluators at Education Northwest to submit a proposal for the competition. Washington state was one of just eight states to be awarded Striving Readers grants in the second round. The grant originally included a planning year, followed by three years of implementation in selected schools. However, Congress eliminated the funding for the program in spring 2011, three-quarters of the way through the first year of implementation. Existing funding was sufficient to complete the first year of program implementation and data collection, but the second and third years of implementation did not take place. Therefore, this Year 1 evaluation report is the only report about the program's implementation and outcomes. Five schools from three districts in Western Washington participated in Washington Striving Readers. Across the five schools, a total of 176 students participated in the treatment condition and 182 students were in the control condition. The program offered 70 hours of professional development for teachers, and all teachers participated in at least 90 percent of these offerings. All teachers also received the intended amount of in-class support, defined as at least 12 visits from a project coach with each visit lasting at least one hour. The study examined four aspects of program implementation: teachers' receipt of the intended professional development, their receipt of in-class coaching, their delivery of the programs as intended, and the completion of all the lessons that were supposed to be covered. Researchers used three different assessments to measure impact: (1) "Gates-MacGinitie Reading Test"; (2) two subtests from the "Woodcock Reading Mastery" assessment--the word attack and word identification subtests; and (3) scores from the "Measure of Student Progress" ("MSP"). Researchers examined the overall impact of Washington Striving Readers using a fixed effects regression model that accounted for the random assignment of students within schools and groups. The findings demonstrated that it is possible to make a statistically significant difference in struggling students' overall literacy achievement in the course of one school year. Students in the Washington Striving Readers intervention performed better on the state reading assessment than did students in the control condition, who did not receive any supplemental reading support. The following are appended: (1) Washington Striving Readers Implementation Measures; (2) Baseline Equivalence of Treatment and Control Groups; and (3) Detailed Regression Analysis Results.
Reviews of Individual Studies 6-10 -1
A randomized controlled trial of the impact of the Fusion Reading intervention on reading achievement and motivation for adolescent struggling readers. (2012)
This study estimates the effect of one year of Fusion Reading implementation, a multistrategy intervention, builds on the work of the Strategic Instruction Model's Learning Strategies Curriculum and Xtreme Reading by integrating some of the same strategies (e.g., paraphrasing, visual imagery, and self-questioning for information acquisition; mnemonics for information study; and writing and error monitoring for information expression), focusing on reading, and extending the time frame from 1 to 2 years in duration. Specifically, the study addressed the following: (1) What are the intent-to-treat impacts of the Fusion Reading intervention on the reading outcomes and motivation to read of struggling readers after receipt of 1 year of the intervention?; (2) For which students are the interventions most and least effective?; and (3) In what ways are implementation factors associated with impacts (or lack of impacts) on reading and motivation outcomes? The authors conducted a randomized controlled trial to estimate the effect of Fusion Reading on struggling readers in grades 6 through 10. Students in the intervention condition received the Fusion Reading intervention as a supplemental reading intervention in the 2010-11 school year, whereas students in the control condition engaged in nonliteracy, "business-as-usual" activities. After one year of implementation of a two year intervention, the authors learned that when vocabulary, paraphrasing and word study strategies are explicitly taught by following a specific instructional routine supported by motivation strategies (e.g., setting goals and reading text relevant for the age group), word reading outcomes will significantly improve compared to control middle and high school students. Future research is needed to fully understand whether the intended two year intervention will improve struggling adolescent's reading comprehension outcomes. Appended are: (1) References; and (2) Tables and Figures. (Contains 2 figures and 5 tables.)
Reviews of Individual Studies 6-8 -1
A randomized trial of motivational interviewing to improve middle school students’ academic performance. (2012)
Motivational interviewing (MI) is an effective method of promoting change in adults, but research on adolescents is limited. This study tests the efficacy of MI for promoting academic achievement in middle school students. Participants were 103 6th-, 7th-, and 8th-grade students randomly assigned to either a MI (n = 50) or a waitlist control condition (n = 53). Students in the MI condition participated in a single MI session during the 7th or 8th week of the second semester. In comparison to the control group, students who received MI demonstrated significant improvements in their class participation, overall positive academic behavior, and significantly higher 4th quarter math grades. Thus, consistent with other studies finding single session effects of MI, a single MI session can have beneficial effects on academic behaviors. Pending further study and replication of these findings, MI could become an efficient and effective new counseling approach for improving academic performance. (Contains 2 tables.)
Reviews of Individual Studies 6-12 -1
Enhancing the interpretative reading and analytical writing of mainstreamed English learners in secondary school: Results from a randomized field trial using a cognitive strategies approach. (2012)
In this study, 72 secondary English teachers from the Santa Ana Unified School District were randomly assigned to participate in the Pathway Project, a cognitive strategies approach to teaching interpretive reading and analytical writing, or to a control condition involving typical district training focusing on teaching content from the textbook. Pathway teachers learned how to use an on-demand writing assessment to help mainstreamed English learners understand, interpret, and write analytical essays. In Year 2, treatment effects were replicated on an on-demand writing assessment (d = 0.67) and showed evidence of transfer to improved performance on a standardized writing test (d = 0.10). The results underscore the efficacy of a cognitive strategies reading/writing intervention for mainstreamed English learners (ELs) in the secondary grades. (Contains 1 note, 4 tables, and 3 figures.)
Reviews of Individual Studies 7-12 -1
Charter-school management organizations: Diverse strategies and diverse student impacts. (2012)
Charter schools--public schools of choice that are operated autonomously, outside the direct control of local school districts--have become more prevalent over the past two decades. There is no consensus about whether, on average, charter schools are doing better or worse than conventional public schools at promoting the achievement of their students. Nonetheless, one research finding is clear: Effects vary widely among different charter schools. Many educators, policymakers, and funders are interested in ways to identify and replicate successful charter schools and help other public schools adopt effective charter school practices. Charter-school management organizations (CMOs), which establish and operate multiple charter schools, represent one prominent attempt to bring high performance to scale. The National Study of CMO Effectiveness aims to fill the gap in systematic evidence about CMOs, providing the first rigorous nationwide examination of CMOs' effects on students' achievement and attainment. The study includes an examination of the relationships between the practices of individual CMOs and their effects on student achievement, with the aim of providing useful guidance to the field. This updated edition of the report provides key findings from the study on CMO practices, impacts, and the relationships between them. A forthcoming report will explore promising practices in greater depth. This study uses multiple data sources to describe CMOs, assess their impacts on students, and identify practices associated with positive impacts in order to address the following research questions: (1) How quickly are CMOs growing? Which students and areas do they serve and what resources do they use? What are the practices and structures of CMOs? What state policies and other factors appear to influence the location and growth of CMOs?; (2) What are the impacts of CMOs on student outcomes and to what extent do these impacts vary across CMOs?; and (3) Which CMO practices and structures are positively associated with impacts? To examine eligible CMOs and address the research questions, the authors conducted a survey of CMO central office staff, surveys of CMO principals and principals in nearby conventional public schools, a survey of CMO teachers, and site visits to 10 CMOs and 20 schools. In addition, they collected and analyzed school records with data on student characteristics and outcomes (including test scores), and they examined CMO financial records and business plans. Findings include: (1) Comprehensive behavior policies are positively associated with student impacts; (2) Intensive teacher coaching is positively associated with student impacts; (3) CMOs using TFA and teaching fellow teachers have higher impacts, but other staffing decisions are not associated with impacts; (4) CMOs categorized as "data-driven" and "time on task" have larger impacts, on average, than two other categories of CMOs; and (5) Tightness of CMO management is weakly associated with impacts. As is often the case in studies of this kind, some of the interesting findings raise other important questions. The following questions are discussed in this report: (1) To what extent do CMOs produce positive effects on longer term student outcomes?; (2) What explains why some CMOs have negative impacts on test scores?; (3) Which promising strategies should CMOs implement and how should they implement them?; (5) To what extent do CMOs add value compared to independent charter schools?; (6) Are new CMOs using the same strategies and producing the same impacts as more established CMOs?; and (7) What other factors might contribute to CMO impacts? Appended are: (1) Construction and Analysis of Measures Used in Chapter III; (2) Experimental Impacts; (3) Validation of Impact Estimation Approach; (4) Methodology for Estimating CMO and School- Level Impacts on Achievement in Middle- Schools; (5) Baseline Equivalence; (6) Method for Dealing with Grade Repetition; (7) Methodology and Results for CMO Impacts on High School Achievement and Attainment; (8) Impacts on Middle School Test Scores by CMO, Year, and Subject; (9) Comparing CMO and Independent Charter Impacts; (10) Subgroup Impacts; (11) Multiple Comparison Adjustments for Impact Analyses; (12) Methods for Correlating Impacts and CMO Characteristics; and (13) Correlational Analysis Results. Individual chapters contain footnotes. (Contains 56 tables and 49 figures.) [This document was commissioned by NewSchools Venture Fund and written with assistance from Michael Barna, Emily Caffery, Hanley Chiang, John Deke, Melissa Dugger, Emma Ernst, Alena Davidoff-Gore, Eric Grau, Thomas Decker, Mason DeCamillis, Philip Gleason, Amanda Hakanson, Jane Nelson, Antoniya Owens, Julie Redline, Davin Reed, Chris Rodger, Margaret Sullivan, Christina Tuttle, Justin Vigeant, Tiffany Waits, and Clare Wolfendale. For an earlier edition of this report, "The National Study of Charter Management Organization (CMO) Effectiveness. Charter-School Management Organizations: Diverse Strategies and Diverse Student Impacts," see ED526951.]
Reviews of Individual Studies 7 -1
Report of intent to treat estimates of program impacts on student achievement: New York State English Language Arts Examination. (2012)
Reviews of Individual Studies 7 -1
An evaluation of the third edition of the University of Chicago School Mathematics Project Transition Mathematics (2012)
Reviews of Individual Studies 7-8 -1
Evaluation report/impact study: Virginia Striving Readers Intervention Initiative (VSRII). (2012)
By the end of school year (SY) 2008-2009, Virginia Department of Education (VDOE) applied for and was awarded a four-year Striving Readers grant to implement the "Virginia Striving Readers Intervention Initiative" (VSRII). VSRII proposed to implement a supplemental reading intervention with students in seventh and eighth grades at nine public schools in three school divisions in Virginia. The school division representatives chose to implement "Passport Reading Journeys (PRJ)," an intervention that was already in use in many Virginian schools. "PRJ" had been studied previously in other school districts using quasi-experimental designs, but had not been tested with an experimental study. A total of 913 students were eligible to participate. This report presents provisional findings from the first implementation year of VSRII (SY 2010-2011) and its preliminary impact on participating students. [Written with Kristina Najera, Laura Taylor, and Trina Willard.]
Reviews of Individual Studies K-12 -1
A big apple for educators: New York City’s experiment with schoolwide performance bonuses. (2011)
In the 2007-2008 school year, the New York City Department of Education and the United Federation of Teachers jointly implemented the Schoolwide Performance Bonus Program in a random sample of the city's high-needs public schools. The program lasted for three school years, and its broad objective was to improve student performance through school-based financial incentives. The question, of course, was whether it was doing so. To examine its implementation and effects, the department tasked a RAND Corporation-led partnership with the National Center on Performance Incentives at Vanderbilt University to conduct a two-year study of the program that would offer an independent assessment. This report describes the results of our analyses for all three years of the program, from 2007-2008 through 2009-2010. This work built on past research and was guided by a theory of action articulated by program leaders. Researchers examined student test scores; teacher, school staff, and administrator surveys; and interviews with administrators, staff members, program sponsors, and union and district officials. The researchers found that the program did not, by itself, improve student achievement, perhaps in part because conditions needed to motivate staff were not achieved (e.g., understanding, buy-in for the bonus criteria) and because of the high level of accountability pressure all the schools already faced. Individual chapters contain footnotes. (Contains 12 figures and 66 tables.) [Additional funding for this paper was provided by the New York City Fund for Public Schools. For "What New York City's Experiment with Schoolwide Performance Bonuses Tells Us about Pay for Performance. Research Brief," see ED521918.]
Reviews of Individual Studies K-12 -1
Teacher incentives and student achievement: Evidence from New York City Public Schools (NBER Working Paper No. 16850). (2011)
Financial incentives for teachers to increase student performance is an increasingly popular education policy around the world. This paper describes a school-based randomized trial in over two-hundred New York City public schools designed to better understand the impact of teacher incentives on student achievement. I find no evidence that teacher incentives increase student performance, attendance, or graduation, nor do I find any evidence that the incentives change student or teacher behavior. If anything, teacher incentives may decrease student achievement, especially in larger schools. The paper concludes with a speculative discussion of theories that may explain these stark results.
Reviews of Individual Studies 7 -1
Middle school mathematics professional development impact study: Findings after the second year of implementation (NCEE 2011-4024). (2011)
This is the second and final report of the Middle School Mathematics Professional Development Impact Study, which examines the impact of providing a professional development (PD) program in rational number topics to seventh-grade mathematics teachers. An interim report (Garet et al. 2010) described the findings after one year of PD. The current report documents the impact after providing a second year of PD in a subset of the original participating districts and includes supplemental analyses that use data from both years of the study. The study produced the following core second-year results: (1) The study's PD program was implemented as intended, but teacher turnover limited the average dosage received; (2) At the end of the second year of implementation, the PD program did not have a statistically significant impact on teacher knowledge; and (3) At the end of the second year of implementation, the PD program did not have a statistically significant impact on average student achievement in rational numbers. Appended are: (1) Details of the Study Samples; (2) Details of Data Collection and Analytical Approaches; (3) Supplemental Information on the Design and Implementation of the PD Program; (4) Supporting Tables and Figures for Impact Analyses; and (5) Exploratory Analyses: Approaches and Additional Results. (Contains 6 exhibits, 6 figures, 81 tables and 124 footnotes.) [For "Middle School Mathematics Professional Development Impact Study: Findings after the Second Year of Implementation. Executive Summary. NCEE 2011-4025," see ED519923. For "Middle School Mathematics Professional Development Impact Study: Findings After the First Year of Implementation. NCEE 2010-4009," see ED509306.]
Reviews of Individual Studies 7-12 -1
Implementation and impact of the targeted and whole school interventions, summary of Year 4 (2009-2010): San Diego United School District, California. (2011)
Reviews of Individual Studies 7-10 -1
Portland Public Schools' Striving Readers Program: Year 5 Evaluation Report (2011)
Portland Public Schools (PPS), the largest school district in Oregon, serves more than 46,000 students in regular and special programs. More than 2,900 classroom teachers address the needs of a diverse student population (44% minority, 46% low income, 14% special education, 9% English language learners). A district needs assessment in fall 2005 revealed that 13 of Portland's 85 regular schools were eligible to participate in the Striving Readers program. Four of the high schools and 5 of the middle schools determined that they could meet the program's research requirements. All 9 schools had at each grade level a significant number of students who were at least 2 years behind in reading achievement; all received Title I funding; and none had achieved Adequate Yearly Progress under No Child Left Behind at the time of the Striving Readers application. School leaders expected the Striving Readers program to impact more than 6,400 students and 450 teachers in the 9 participating schools. After examining adolescent reading programs and studying the research on adolescent literacy, Portland Public Schools selected the Strategic Instruction Model Content Literacy Continuum developed by the University of Kansas' Center for Research on Learning to improve teacher instruction and student reading achievement in the participating middle and high schools. This report summarizes Year 1 (2006-2007), Year 2 (2007-2008), Year 3 (2008-2009), Year 4 (2009-2010), and Year 5 (2010-2011) of implementation of the targeted intervention for students reading at least 2 years below grade level in Grades 7-10 and the whole school intervention designed to help all students in Grades 6-12 learn the critical content in all curricular areas.
Reviews of Individual Studies 6-11 -1
Better schools, less crime? (2011)
Reviews of Individual Studies 5-7 -1
Pearson SuccessMaker reading efficacy study 2010–11 final report. (2011)
Reviews of Individual Studies 6-8 -1
Longitudinal investigation of the curricular effect: An analysis of student learning outcomes from the LieCal project in the United States. (2011)
In this article, we present the results from a longitudinal examination of the impact of a "Standards"-based or reform mathematics curriculum (called CMP) and traditional mathematics curricula (called non-CMP) on students' learning of algebra using various outcome measures. Findings include the following: (1) students did not sacrifice basic mathematical skills if they are taught using a "Standards"-based or reform mathematics curriculum like CMP; (2) African American students experienced greater gain in symbol manipulation when they used a traditional curriculum; (3) the use of either the CMP or a non-CMP curriculum improved the mathematics achievement of all students, including students of color; (4) the use of CMP contributed to significantly higher problem-solving growth for all ethnic groups; and (5) a high level of conceptual emphasis in a classroom improved the students' ability to represent problem situations. (However, the level of conceptual emphasis bears no relation to students' problem solving or symbol manipulation skills.) (Contains 12 tables and 3 figures.)
Reviews of Individual Studies 6-8 -1
Striving Readers study: Targeted & whole-school interventions - Year 5. (2011)
This report summarizes the results of the Newark, New Jersey, Striving Readers program for project Years 1, 2, 3, 4, and 5. This report updates one analysis (3 years); the remainder of the impacts and implementation findings are for Year 4. The Striving Readers Grant addresses the unmet needs of middle school students reading 2 or more years below grade level and provides professional development for teachers in all core content areas to help them learn about and use more effective literacy strategies. Nineteen middle schools in Newark are participating in the U.S. Department of Education Striving Readers study. Two components of the project are being evaluated: a targeted intervention and a whole-school intervention. [This report is the product of a collaborative effort involving numerous individuals at Westat and Newark Public Schools.]
Reviews of Individual Studies 6-8 -1
Striving Readers study: Targeted and whole-school interventions—year 5. (2011)
Reviews of Individual Studies 3-11 -1
Teacher preparation programs and Teach for America research study. (2011)
Reviews of Individual Studies 3-7 -1
Main idea identification with students with mild intellectual disabilities and specific learning disabilities: A comparison of explicit and basal instructional approaches. (2011)
Students with high-incidence disabilities struggle with reading comprehension due to difficulties in background knowledge and metacognitive skills, including use of self-monitoring and other strategies. In the United States, these students typically receive the majority of their instruction in general education settings. However, there is little research comparing reading comprehension interventions with the typical basal curricula used in these classrooms. We compared the effects of an explicit reading comprehension intervention to those of a typical language-arts curriculum on upper elementary and middle school students' (n = 38) retells of passages and understanding of main ideas. A 2 x 4 repeated measures multivariate analysis of variance (MANOVA) revealed significant differences between instructional groups. These results indicate systematic and explicit reading comprehension instruction can be delivered successfully to students with high-incidence disabilities in general education settings. (Contains 3 figures and 4 tables.)
Reviews of Individual Studies 3-8 -1
A multistate district-level cluster randomized trial of the impact of data-driven reform on reading and mathematics achievement. (2011)
Analyzing mathematics and reading achievement outcomes from a district-level random assignment study fielded in over 500 schools within 59 school districts and seven states, the authors estimate the 1-year impacts of a data-driven reform initiative implemented by the Johns Hopkins Center for Data-Driven Reform in Education (CDDRE). CDDRE consultants work with districts to implement quarterly student benchmark assessments and provide district and school leaders with extensive training on interpreting and using the data to guide reform. Relative to a control condition, in which districts operated as usual without CDDRE services, the data-driven reform initiative caused statistically significant districtwide improvements in student mathematics achievement. The CDDRE intervention also had a positive effect on reading achievement, but the estimates fell short of conventional levels of statistical significance. (Contains 1 figure, 3 tables, and 16 notes.)
Reviews of Individual Studies 4-8 -1
The long-term impacts of teachers: Teacher value-added and student outcomes in adulthood (NBER Working Paper No. 17699). (2011)
Are teachers' impacts on students' test scores ("value-added") a good measure of their quality? This question has sparked debate largely because of disagreement about (1) whether value-added (VA) provides unbiased estimates of teachers' impacts on student achievement and (2) whether high-VA teachers improve students' long-term outcomes. We address these two issues by analyzing school district data from grades 3-8 for 2.5 million children linked to tax records on parent characteristics and adult outcomes. We find no evidence of bias in VA estimates using previously unobserved parent characteristics and a quasi-experimental research design based on changes in teaching staff. Students assigned to high-VA teachers are more likely to attend college, attend higher-ranked colleges, earn higher salaries, live in higher SES neighborhoods, and save more for retirement. They are also less likely to have children as teenagers. Teachers have large impacts in all grades from 4 to 8. On average, a one standard deviation improvement in teacher VA in a single grade raises earnings by about 1% at age 28. Replacing a teacher whose VA is in the bottom 5% with an average teacher would increase students' lifetime income by more than $250,000 for the average classroom in our sample. We conclude that good teachers create substantial economic value and that test score impacts are helpful in identifying such teachers.
Reviews of Individual Studies 4-9 -1
Charter school performance in Indiana. (2011)
Reviews of Individual Studies 5-7 -1
Web-Based Tutoring of the Structure Strategy With or Without Elaborated Feedback or Choice for Fifth- and Seventh-Grade Readers (Enhanced feedback and choice of passage in Intelligent Tutoring of the Structure Strategy) (2010)
This study investigated the effects of different versions of Web-based instruction focused on text structure on fifth- and seventh-grade students' reading comprehension. Stratified random assignment was employed in a two-factor experiment embedded within a pretest and multiple posttests design (immediate and four-month delayed posttests). The two factors were type of feedback provided by the Web-based tutor (elaborated vs. simple feedback) and the motivational factor of choice of text topics in practice lessons (student choice of texts vs. no choice). These factors were examined to learn how they affected performance after the six-month, 90-minutes/week intervention. Students who received elaborated feedback performed better on a standardized test of reading comprehension than students who received simple feedback. Learning how to attend to errors from the elaborated feedback tutor yielded large gains in test performance. Simple feedback did not help the least skilled third of readers move from complete lack of competency to competency using the structure strategy with problem-and-solution text. Choice between two topics for practice lessons did not increase reading comprehension. Substantial effect sizes were found from pretest to posttest on various measures of reading comprehension: recall, strategy competence, and standardized reading comprehension test scores. Maintenance of performance over summer break was found for most measures. The study informs research and teaching about Web-based reading tutors, feedback, comprehension, and top-level text structure. ABSTRACT FROM AUTHOR]; Copyright of Reading Research Quarterly is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Reviews of Individual Studies 4-7 -1
The evaluation of charter school impacts: Final report (NCEE 2010-4029). (2010)
Adding to the growing debate and evidence base on the effects of charter schools, this evaluation was conducted in 36 charter middle schools in 15 states. It compares the outcomes of 2,330 students who applied to these schools and were randomly assigned by lotteries to be admitted (lottery winners) or not admitted (lottery losers) to the schools. Both sets of students were tracked over two years and data on student achievement, academic progress, behavior, and attitudes were collected. The study is the first large-scale randomized trial of the effectiveness of charter schools in varied types of communities and states. Among the key findings were that, on average, charter middle schools that held lotteries were neither more nor less successful than traditional public schools in improving math or reading test scores, attendance, grade promotion, or student conduct within or outside of school. Being admitted to a study charter school did significantly improve both students' and parents' satisfaction with school. Charter middle schools' impact on student achievement varied significantly across schools. Charter middle schools in urban areas--as well as those serving higher proportions of low-income and low achieving students--were more effective (relative to their nearby traditional public schools) than were other charter schools in improving math test scores. Some operational features of charter middle schools were associated with less negative impacts on achievement. These features include smaller enrollments and the use of ability grouping in math or English classes. There was no significant relationship between achievement impacts and the charter schools' policy environment. Because the study could only include charter middle schools that held lotteries, the results do not necessarily apply to the full set of charter middle schools in the U.S. Appended are: (1) Selecting the Charter School and Student Samples; (2) Calculation of Sample Weights; (3) Outcome Measures for the Impact Analysis; (4) Analytic Methods; (5) Supplemental Materials for Chapter III; (6) Supplemental Tables for Chapter IV; and (7) Supplemental Tables for Chapter V. (Contains 78 tables, 29 figures, and 164 footnotes.) [For the study snapshot of this full report, see ED510574.]
Reviews of Individual Studies 4-8 -1
An evaluation of the Teacher Advancement Program (TAP) in Chicago: Year two impact report. (2010)
In 2007, the Chicago Public Schools (CPS) began implementing a schoolwide reform called the Teacher Advancement Program (TAP) using funds from the federal Teacher Incentive Fund (TIF) and private foundations. Under the TAP model, teachers can earn extra pay and responsibilities through promotion to mentor or master teacher as well as annual performance bonuses based on a combination of their value added to student achievement and observed performance in the classroom. The idea behind the program is that performance incentives, combined with tools for teachers to track performance and improve instruction, should help schools attract and retain talented teachers and help all teachers produce greater student achievement. This report provides evidence on the impacts of TAP during the 2008-2009 school year, the second year of the program's rollout in CPS. Appended are: (1) Propensity Score Matching; and (2) Longitudinal Analysis of Test Score Data. (Contains 18 tables, 7 figures and 14 footnotes.) [For the Year One Impact Report, see ED507502.]
Reviews of Individual Studies 2-9 -1
Financial incentives and student achievement: Evidence from randomized trials (NBER Working Paper 15898). (2010)
This paper describes a series of school-based randomized trials in over 250 urban schools designed to test the impact of financial incentives on student achievement. In stark contrast to simple economic models, our results suggest that student incentives increase achievement when the rewards are given for inputs to the educational production function, but incentives tied to output are not effective. Relative to popular education reforms of the past few decades, student incentives based on inputs produce similar gains in achievement at lower costs. Qualitative data suggest that incentives for inputs may be more effective because students do not know the educational production function, and thus have little clue how to turn their excitement about rewards into achievement. Several other models, including lack of self-control, complementary inputs in production, or the unpredictability of outputs, are also consistent with the experimental data.
Reviews of Individual Studies 4-10 -1
The MPCP Longitudinal Educational Growth Study third year report (SCDP Milwaukee Evaluation Report #15). (2010)
This is the third-year report in a five-year evaluation of the Milwaukee Parental Choice Program (MPCP). The MPCP, which began in 1990, provides government-funded vouchers for low-income children to attend private schools in the City of Milwaukee. The general purposes of the evaluation are to analyze the effectiveness of the MPCP in terms of longitudinal student achievement growth and educational attainment as measured by high school graduation rates. The former will be primarily accomplished by measuring and estimating student growth in achievement as measured by the Wisconsin Knowledge and Concepts Examinations (WKCE) in math and reading in 2006-07, grades 3 through 8 over a five-year period. The latter will be accomplished by following the 2006-07 8th and 9th grade cohorts over a five-year period or longer. The general research design consists of a comparison between a random sample of MPCP students and a matched sample of Milwaukee Public School (MPS) students. This third year report presents results from the November 2008 WKCE tests as second year student achievement growth in MPCP relative to the matched MPS sample. We provide varying descriptive statistics comparing test score means and distributions for math and reading for 2006-07 (baseline year) and 2008-09 (second outcome year) for each sample. The report also analyzes achievement growth using several multivariate techniques and models. The primary finding in all these comparisons is that, in general, there are few statistically significant differences between levels of MPCP and MPS student achievement growth in either math or reading two years after they were carefully matched to each other. In one of the ways of estimating these results, focusing only on those students who have remained in the public or private sector for all three years, private, voucher students are slightly behind MPS students in mathematics achievement growth. The report offers several cautions in interpreting this result against the overwhelming set of results that indicate no difference in achievement growth. Appended are additional tables and study attrition. (Contains 9 tables, 2 figures, and 7 footnotes.) [Additional funding for this project was provided by the Robertson Foundation.]
Reviews of Individual Studies 6-8 -1
Reorganizing the instructional reading components: Could there be a better way to design remedial reading programs to maximize middle school students with reading disabilities’ response to treatment? (2010)
The primary purpose of this study was to explore if there could be a more beneficial method in organizing the individual instructional reading components (phonological decoding, spelling, fluency, and reading comprehension) within a remedial reading program to increase sensitivity to instruction for middle school students with reading disabilities (RD). Three different modules (Alternating, Integrated, and Additive) of the Reading Achievement Multi-Modular Program were implemented with 90 middle school (sixth to eighth grades) students with reading disabilities. Instruction occurred 45 min a day, 5 days a week, for 26 weeks, for approximately 97 h of remedial reading instruction. To assess gains, reading subtests of the Woodcock Johnson-III, the Gray Silent Reading Test, and Oral Reading Fluency passages were administered. Results showed that students in the Additive module outperformed students in the Alternating and Integrated modules on phonological decoding and spelling and students in the Integrated module on comprehension skills. Findings for the two oral reading fluency measures demonstrated a differential pattern of results across modules. Results are discussed in regards to the effect of the organization of each module on the responsiveness of middle school students with RD to instruction.
Reviews of Individual Studies 6-8 -1
Reorganizing the instructional reading components: Could there be a better way to design remedial reading programs to maximize middle school students with reading disabilities’ response to treatment? (2010)
The primary purpose of this study was to explore if there could be a more beneficial method in organizing the individual instructional reading components (phonological decoding, spelling, fluency, and reading comprehension) within a remedial reading program to increase sensitivity to instruction for middle school students with reading disabilities (RD). Three different modules (Alternating, Integrated, and Additive) of the Reading Achievement Multi-Modular Program were implemented with 90 middle school (sixth to eighth grades) students with reading disabilities. Instruction occurred 45 min a day, 5 days a week, for 26 weeks, for approximately 97 h of remedial reading instruction. To assess gains, reading subtests of the Woodcock Johnson-III, the Gray Silent Reading Test, and Oral Reading Fluency passages were administered. Results showed that students in the Additive module outperformed students in the Alternating and Integrated modules on phonological decoding and spelling and students in the Integrated module on comprehension skills. Findings for the two oral reading fluency measures demonstrated a differential pattern of results across modules. Results are discussed in regards to the effect of the organization of each module on the responsiveness of middle school students with RD to instruction.
Reviews of Individual Studies 5-8 -1
Student characteristics and achievement in 22 KIPP middle schools: Final report. (2010)
The Knowledge Is Power Program (KIPP) is a bold effort to create a network of charter schools designed to transform and improve the educational opportunities available to low/income families. KIPP schools seek to actively engage students and parents in the educational process, expand the time and effort students devote to their studies, reinforce students' social competencies and positive behaviors, and dramatically improve their academic achievement. Ultimately, the goal of KIPP is to prepare students to enroll and succeed in college. The KIPP Foundation is guiding this effort by selecting and training school leaders, promoting the program model, and supporting the KIPP network schools. This report presents preliminary findings from a matched, longitudinal analysis designed to estimate KIPP's effect on student achievement. The author's preliminary work estimates effects in 22 KIPP middle schools--making this the first report that applies a rigorous (nonexperimental) methodological approach across a nationwide sample of KIPP schools. They selected schools for which they were able to collect longitudinal, student/level data, and that were established by the 2005/06 school year or earlier to ensure that a minimum of two entering cohorts of students per school would be observed for multiple years. They find that students entering these 22 KIPP schools typically had prior achievement levels that were lower than average achievement in their local school districts. For the vast majority of KIPP schools studied, impacts on students' state assessment scores in mathematics and reading are positive, statistically significant, and educationally substantial. Estimated impacts are frequently large enough to substantially reduce race/ and income/based achievement gaps within three years of entering KIPP. They describe these findings in more detail in this report. Appendices include: (1) Administrative Data; (2) Supplemental Tables for Chapter II; (3) Analytic Methods; (4) Alternative Specifications; and (5) Subgroup Analyses. (Contains 34 tables, 21 figures and 28 footnotes.) [This paper was submitted to KIPP Foundation. For the accompanying report, see ED511108.]
Reviews of Individual Studies 7-10 -1
The effects of Pearson Prentice Hall Literature (2010) on student performance: Efficacy study. (2010)
Reviews of Individual Studies 7 -1
Middle School Mathematics Professional Development Impact Study: Findings after the first year of implementation (NCEE 2010-4009). (2010)
Student achievement in mathematics has been a focal concern in the United States for many years. The National Research Council's 2001 report and the recent report of the National Mathematics Advisory Panel (2008) both called attention to student achievement in mathematics, and both called for all students to learn algebra by the end of eighth grade. Reports have argued, further, that achieving this goal requires that students first successfully learn several topics in rational numbers--fractions, decimals, ratio, rate, proportion, and percent. These topics are typically covered in grades 4 through 7, yet many students continue to struggle with them beyond the seventh grade. The National Mathematics Advisory Panel wrote that--difficulty with fractions (including decimals and percent) is pervasive and is a major obstacle to further progress in mathematics, including algebra. The panel also specified that by the end of seventh grade, students should be able to solve problems involving percent, ratio, and rate, and extend this work to proportionality. The U.S. Department of Education's National Center for Educational Evaluation and Regional Assistance (NCEE)--within the Institute of Education Sciences--initiated the Middle School Mathematics Professional Development Impact Study to test the impact of a professional development (PD) program for teachers that was designed to address the problem of low student achievement in topics in rational numbers. The study focuses on seventh grade, the culminating year for teaching those topics and has three central research questions: (1) What impact did the PD program provided in this study have on teacher knowledge of rational number topics? (2) What impact did the PD program provided in this study have on teacher instructional practices? and (3) What impact did the PD program provided in this study have on student achievement in rational number topics? The study produced the following results: (1) The study's PD program was implemented as intended; (2) The PD program did not produce a statistically significant impact on teacher knowledge of rational numbers (effect size = 0.19, p-value = 0.15); (3) The PD program had a statistically significant impact on the frequency with which teachers engaged in activities that elicited student thinking, one of the three measures of instructional practice used in the study (effect size = 0.48); and (4) The PD program did not produce a statistically significant impact on student achievement (effect size = 0.04, p-value = 0.37). This report presents the study's findings after 1 year of implementing the PD in the treatment schools. A subsequent report will present findings after 2 years of implementing the PD. Chapter 1 presents an overview of the study. Chapter 2 describes the study design and its realization, including a description of the sample and tests of baseline equivalence of the treatment and control groups on observed characteristics. Chapter 3 describes the design and implementation of the PD program and the extent of service contrast between the treatment and control groups. Chapter 4 addresses the impact of the PD program on teacher knowledge, instructional practice, and student mathematics achievement. Chapter 5 provides several nonexperimental analyses that explore additional questions related to the impact findings. Appended are: (1) Data Collection; (2) Details of the Study Samples and Analytic Approaches; (3) Supplemental Information on the Design and Implementation of the PD Program; (4) Supporting Tables and Figures for Impact Analyses; and (5) Exploratory Analyses: Approaches and Additional Results. (Contains 9 exhibits, 9 figures, and 90 tables.)
Reviews of Individual Studies K-12 -1
Evaluation of the DC Opportunity Scholarship Program: Final report (NCEE 2010-4018). (2010)
The District of Columbia School Choice Incentive Act of 2003, passed by Congress in January 2004, established the first federally funded, private school voucher program in the United States. Since that time, more than 8,400 students have applied for what is now called the DC Opportunity Scholarship Program (OSP), and a rigorous evaluation of the Program, mandated by Congress, has been underway. This last formal report from the ongoing evaluation describes the impacts of the Program at least four years after families who applied and were given the option to move from a public school to a participating private school of their choice. The research priorities for the evaluation were shaped largely by the primary topics of interest specified in the statute. This legislative mandate led the evaluators to focus on the following research questions: (1) What is the impact of the Program on student academic achievement? (2) What is the impact of the Program on other student measures? (3) What effect does the Program have on school safety and satisfaction? (4) What is the effect of attending private versus public schools? (5) To what extent is the Program influencing public schools and expanding choice options for parents in Washington, DC? These research questions are consistent with the topics that scholars and policymakers have identified as important questions of interest surrounding private school scholarship programs. The report found that that the Program had mixed longer-term effects on participating students and their parents, including: (1) No conclusive evidence that the OSP affected student achievement overall, or for the high-priority group of students who applied from "schools in need of improvement"; (2) The Program significantly improved students' chances of graduating from high school, according to parent reports. Overall, 82 percent of students offered scholarships received a high school diploma, compared to 70 percent of those who applied but were not offered scholarships. This graduation rate improvement also held for the subgroup of OSP students who came from "schools in need of improvement."; and (3) Although parents had higher satisfaction and rated schools as safer if their child was offered or used an OSP scholarship, students reported similar ratings for satisfaction and safety regardless of whether they were offered or used a scholarship. Appendices include: (1) Research Methodology; (2) Benjamini-Hochberg Adjustments for Multiple Comparisons; (3) Sensitivity Testing; (4) Relationship Between Attending a Private School and Key Outcomes; (5) Detailed ITT Tables; (6) Exploration of Whether Parents Get What They Seek From School Choice; (7) To What Extent Are Treatment Effects of the OSP Observed Across the Outcome Test-Score Distribution? Quantile Regression Analysis of the OSP; and (8) Intermediate Outcome Measures. (Contains 99 tables, 31 figures, and 61 footnotes.)
Reviews of Individual Studies 7-8 -1
The relative effects of group size on reading progress of older students with reading difficulties (2010)
This study reports findings on the relative effects from a yearlong secondary intervention contrasting large-group, small-group, and school-provided interventions emphasizing word study, vocabulary development, fluency, and comprehension with seventh- and eighth-graders with reading difficulties. Findings indicate that few statistically significant results or clinically significant gains were associated with group size or intervention. Findings also indicate that a significant acceleration of reading outcomes for seventh- and eighth-graders from high-poverty schools is unlikely to result from a 50 min daily class. Instead, the findings indicate, achieving this outcome will require more comprehensive models including more extensive intervention (e.g., more time, even smaller groups), interventions that are longer in duration (multiple years), and interventions that vary in emphasis based on specific students' needs (e.g., increased focus on comprehension or word study).
Reviews of Individual Studies 7-8 -1
The relative effects of group size on reading progress of older students with reading difficulties. (2010)
This study reports findings on the relative effects from a yearlong secondary intervention contrasting large-group, small-group, and school-provided interventions emphasizing word study, vocabulary development, fluency, and comprehension with seventh- and eighth-graders with reading difficulties. Findings indicate that few statistically significant results or clinically significant gains were associated with group size or intervention. Findings also indicate that a significant acceleration of reading outcomes for seventh- and eighth-graders from high-poverty schools is unlikely to result from a 50 min daily class. Instead, the findings indicate, achieving this outcome will require more comprehensive models including more extensive intervention (e.g., more time, even smaller groups), interventions that are longer in duration (multiple years), and interventions that vary in emphasis based on specific students' needs (e.g., increased focus on comprehension or word study).
Reviews of Individual Studies K-8 -1
Teacher incentive pay and educational outcomes: Evidence from the New York City Bonus Program. (2010)
Teacher compensation schemes are often criticized for lacking a performance-based component. Proponents of merit pay argue that linking teacher salaries to student achievement will incentivize teachers to focus on raising student achievement and stimulate innovation across the school system as a whole. In this paper, we utilize a policy experiment conducted in the New York City public school system to explore the effects of one performance-based bonus scheme. We investigate potential impacts of group-based incentive pay over two academic years (2007-2008 and 2008-2009) on a range of outcomes including: teacher effort, student performance in math and reading, and classroom activities, measured through environmental surveys of teachers and students. We also explore impacts on the market for teachers by examining teacher turnover and the qualifications of newly hired teachers. Overall, we find the bonus program had little impact on any of these outcomes. We argue that the lack of bonus program impacts can be explained by the structure of the bonus program. Group bonuses led to free-riding, which significantly reduced the program's incentives. Once we account for free-riding, we find evidence that the program led teachers to increase their effort through a significant reduction in absenteeism. When considering the effectiveness of performance-based teacher pay, the structure of incentives matter. (Contains 11 tables, 3 figures and 24 footnotes.)
Reviews of Individual Studies PK-12 -1
Toward reduced poverty across generations: Early findings from New York City's conditional cash transfer program. (2010)
Aimed at low-income families in six of New York City's highest-poverty communities, Family Rewards ties cash rewards to a pre-specified set of activities and outcomes thought to be critical to families' short- and long-term success in the areas of children's education, family preventive health care, and parents' employment. The purpose of this project is to experimentally evaluate the effects of this three-year innovative holistic conditional cash transfer (CCT) initiative. This paper presents initial findings from an ongoing and comprehensive evaluation of Family Rewards. It examines the program's implementation in the field and families' responses to it during the first two of its three years of operations, and early findings on the program's impacts on children's educational processes and outcomes. More specifically, this paper addresses the following questions: (1) What are the effects of ONYC-Family Rewards on family income, poverty, and financial hardship?; (2) What are the effects of ONYC-Family Rewards on use of health care and health insurance?; (3) What are the effects of ONYC-Family Rewards on parents' employment and educational attainment?; and (4) What are the effects of ONYC-Family Rewards on children's educational outcomes? Overall, this study shows that, despite an extraordinarily rapid start-up, the program was operating largely as intended by its second year. Although many families struggled with the complexity of the program, most were substantially engaged with it and received a large amount of money for meeting the conditions it established. Specifically, nearly all families (98 percent) earned at least some rewards in both program years, with payments averaging more than $6,000 during the first two program years combined. The program reduced current poverty and hardship; increased savings; increased families' continuous use of health insurance coverage and increased their receipt of medical care; and increased employment in jobs that are not covered by the unemployment insurance (UI) system but reduced employment in UI-covered jobs. The program has had mixed success in improving children's academic performance specifically. Contrary to expectations, Family Rewards did not affect school attendance or annual standardized test scores in Math and English Language Arts (ELA) for either group of youngest children, but did lead to notable gains for a group of more academically prepared high school students. The program also had important effects on several key proposed mediators of the intervention. However, these effects vary by parents with different age groups of children. Appended are: (1) References; and (2) Tables and Figures. (Contains 2 tables.)
Reviews of Individual Studies 7-8 -1
The importance of prior knowledge when comparing examples: Influences on conceptual and procedural knowledge of equation solving. (2009)
Comparing multiple examples typically supports learning and transfer in laboratory studies and is considered a key feature of high-quality mathematics instruction. This experimental study investigated the importance of prior knowledge in learning from comparison. Seventh- and 8th-grade students (N = 236) learned to solve equations by comparing different solution methods to the same problem, comparing different problem types solved with the same solution method, or studying the examples sequentially. Unlike in past studies, many students did not begin the study with equation-solving skills, and prior knowledge of algebraic methods was an important predictor of learning. Students who did not attempt algebraic methods at pretest benefited most from studying examples sequentially or comparing problem types, rather than from comparing solution methods. Students who attempted algebraic methods at pretest learned more from comparing solution methods. Students may need sufficient prior knowledge in a domain before they benefit from comparing alternative solution methods. These findings are in line with findings on the expertise-reversal effect. (Contains 2 figures and 6 tables.)
Reviews of Individual Studies 7-9 -1
Accelerated Math evaluation report (Middle school sample). (2009)
Reviews of Individual Studies K-12 -1
Evaluation of the DC Opportunity Scholarship Program: Impacts after three years (NCEE 2009-4050). (2009)
The "District of Columbia School Choice Incentive Act of 2003," passed by the Congress in January 2004, established the first federally funded, private school voucher program in the United States. The purpose of the new scholarship program was to provide low-income residents, particularly those whose children attend schools in need of improvement or corrective action under the "Elementary and Secondary Education Act," with "expanded opportunities to attend higher performing schools in the District of Columbia" (Sec. 303). As part of this legislation, the Congress mandated a rigorous evaluation of the impacts of the Program, now called the "DC Opportunity Scholarship Program" (OSP). This report presents findings from the evaluation on the impacts three years after families who applied were given the option to move from a public school to a participating private school of their choice. The evaluation is based on a randomized controlled trial design that compares the outcomes of eligible applicants randomly assigned to receive (treatment group) or not receive (control group) a scholarship through a series of lotteries. The main findings of the evaluation so far include: (1) After 3 years, there was a statistically significant positive impact on reading test scores, but not math test scores; (2) The OSP had a positive impact overall on parents' reports of school satisfaction and safety, but not on students' reports; (3) This same pattern of findings holds when the analysis is conducted to determine the impact of using a scholarship rather than being offered a scholarship; (4) The OSP improved reading achievement for 5 of the 10 subgroups examined; and (5) No achievement impacts were observed for five other subgroups of students, including those who entered the Program with relative academic disadvantage. Six appendices are included: (1) Research Methodology; (2) Benjamini-Hochberg Adjustments for Multiple Comparisons; (3) Sensitivity Testing; (4) Detailed ITT Tables; (5) Relationship Between Attending a Private School and Key Outcomes; and (6) Intermediate Outcome Measures.. (Contains 115 footnotes, 15 figures and 129 tables.) [For Executive Summary, see ED504784. For "Evaluation of the DC Opportunity Scholarship Program: Impacts after Two Years", see ED501696. For "Evaluation of the DC Opportunity Scholarship Program: Impacts after One Year", see ED497154.]
Reviews of Individual Studies 7 -1
A randomized field trial of the Fast ForWord Language computer-based training program (2009)
This article describes an independent assessment of the Fast ForWord Language computer-based training program developed by Scientific Learning Corporation. Previous laboratory research involving children with language-based learning impairments showed strong effects on their abilities to recognize brief and fast sequences of nonspeech and speech stimuli, but generalization of these effects beyond clinical settings and student populations and to broader literacy measures remains unclear. Implementing a randomized field trial in eight urban schools, we generated impact estimates from separate intent-to-treat and treatment-on-the-treated analyses of the literacy outcomes of second- and seventh-grade students who were more generally at risk for poor reading and language outcomes. There were some problems of implementation in the field setting, and the Fast ForWord Language program did not, in general, help students in these eight schools improve their language and reading comprehension test scores.
Reviews of Individual Studies 7-12 -1
Technology’s edge: The educational benefits of computer-aided instruction. (2009)
Because a significant portion of U.S. students lacks critical mathematic skills, schools across the country are investing heavily in computerized curriculums as a way to enhance education output, even though there is surprisingly little evidence that they actually improve student achievement. In this paper we present results from a randomized study in three urban school districts of a well-defined use of computers in schools: a popular instructional computer program which is designed to teach pre-algebra and algebra. We assess the impact of the program using statewide tests that cover a range of math skills and tests designed specifically to target pre-algebra and algebra skills. We find that students randomly assigned to computer-aided instruction score at least 0.17 of a standard deviation higher on a pre-algebra/algebra test than students randomly assigned to traditional instruction. We hypothesize that the effectiveness arises from increased individualized instruction as the effects appear larger for students in larger classes and those in classes in which students are frequently absent. (Detailed data information is appended. Contains 40 footnotes and 17 tables.)
Reviews of Individual Studies 6-8 -1
Are high-quality schools enough to close the achievement gap? Evidence from a social experiment in Harlem (NBER Working Paper 15473) (2009)
Harlem Children's Zone (HCZ), which combines community investments with reform minded charter schools, is one of the most ambitious social experiments to alleviate poverty of our time. We provide the first empirical test of the causal impact of HCZ on educational outcomes, with an eye toward informing the long-standing debate whether schools alone can eliminate the achievement gap or whether the issues that poor children bring to school are too much for educators alone to overcome. Both lottery and instrumental variable identification strategies lead us to the same story: Harlem Children's Zone is effective at increasing the achievement of the poorest minority children. Taken at face value, the effects in middle school are enough to close the black-white achievement gap in mathematics and reduce it by nearly half in English Language Arts. The effects in elementary school close the racial achievement gap in both subjects. We conclude by presenting four pieces of evidence that high-quality schools or high-quality schools coupled with community investments generate the achievement gains. Community investments alone cannot explain the results.
Reviews of Individual Studies 2-8 -1
Impact of for-profit and nonprofit management on student achievement: The Philadelphia intervention 2002-2008 (Working Paper PEPG 09-02). (2009)
At the request of the State of Pennsylvania, the School District of Philadelphia, in the summer of 2002, asked three for-profit firms to assume responsibility for 30 of its lowest-performing schools and it asked four nonprofit managers to assume the management of 16 other low-performing schools. A difference-in-differences analysis is used to estimate the impact of nonprofit and for-profit management on individual student achievement. Gains in test scores at the treated schools are estimated by comparing them with gains in other low-performing schools in the district. Students at schools under for-profit management outperformed those at schools under nonprofit management in all six years in both reading and math. Most estimations are statistically significant. Impacts of for-profit management relative to district management were positive in math, but no reading impacts could be detected. At nonprofits, students appear to have learned substantially less, especially in math, at nonprofit schools, than had their school remained under regular district management. However, impacts fell short of statistical significance. (Propensity Score Analysis is appended. Contains 21 endnotes and 9 tables.)
Reviews of Individual Studies 5-12 -1
The Study of Mentoring in the Learning Environment (SMILE): A randomized evaluation of the effectiveness of school-based mentoring (2008)
Reviews of Individual Studies 4-9 -1
High school students as mentors: Findings from the Big Brothers Big Sisters school-based mentoring impact study. (2008)
High schools have recently become a popular source of mentors for school-based mentoring (SBM) programs. The high school Bigs program of Big Brothers Big Sisters of America, for example, currently involves close to 50,000 high-school-aged mentors across the country. While the use of these young mentors has several potential advantages, their age raises questions about their capacity to be consistent, positive role models, and, in turn, their potential to yield strong impacts for the youth they mentor. With support from The Atlantic Philanthropies and in collaboration with Big Brothers Big Sisters of America, Public/Private Ventures set out to address these questions using data from our large-scale random assignment impact study of Big Brothers Big Sisters SBM (Herrera, et al. 2007). We found that, on average, high school students were much less effective than adults at yielding impacts for the youth they mentor. However, our research identified several program practices that were linked with longer, stronger and more effective high school mentor relationships. High School Students as Mentors stresses the need for programs with high school volunteers to use the inherent strengths of these volunteers and, at the same time, meet their distinct needs. Big Brothers Big Sisters of America is already initiating most of the changes suggested in the study in its high school Bigs program; it has convened a group of six of its strongest Big Brothers Big Sisters agencies to review these and other findings and share their own experiences and strategies in an effort to strengthen their model. (Contains 41 endnotes, 3 figures and 2 tables.)
Reviews of Individual Studies 5-9 -1
Reading improvement report: Miami-Dade regions II and III. (2008)
Reviews of Individual Studies 6-8 -1
Intervention provided to linguistically diverse middle school students with severe reading difficulties (2008)
This study investigated the effectiveness of a multicomponent reading intervention implemented with middle school students with severe reading difficulties, all of whom had received remedial and/or special education for several years with minimal response to intervention. Participants were 38 students in grades 6-8 who had severe deficits in word reading, reading fluency, and reading comprehension. Most were Spanish-speaking English language learners (ELLs) with identified disabilities. Nearly all demonstrated severely limited oral vocabularies in English and, for ELLs, in both English and Spanish. Students were randomly assigned to receive the research intervention (n = 20) or typical instruction provided in their school's remedial reading or special education classes (n = 18). Students in the treatment group received daily explicit and systematic small-group intervention for 40 minutes over 13 weeks, consisting of a modified version of a phonics-based remedial program augmented with English as a Second Language practices and instruction in vocabulary, fluency, and comprehension strategies. Results indicated that treatment students did not demonstrate significantly higher outcomes in word recognition, comprehension, or fluency than students who received the school's typical instruction and that neither group demonstrated significant growth over the course of the study. Significant correlations were found between scores on teachers' ratings of students' social skills and problem behaviors and posttest decoding and spelling scores, and between English oral vocabulary scores and scores in word identification and comprehension. The researchers hypothesize that middle school students with the most severe reading difficulties, particularly those who are ELLs and those with limited oral vocabularies, may require intervention of considerably greater intensity than that provided in this study. Further research directly addressing features of effective remediation for these students is needed.
Reviews of Individual Studies 6-9 -1
Desert Sands Unified School District, CA. (2008)
Reviews of Individual Studies 6-PS -1
Comparative effectiveness of Carnegie Learning’s Cognitive Tutor Algebra I curriculum: A report of a randomized experiment in the Maui School District. (2007)
Under the "Math Science Partnership Grant," the Maui Hawaii Educational Consortium sought scientifically based evidence for the effectiveness of Carnegie Learning's "Cognitive Tutor[R]" (CT) program as part of the adoption process for pre-Algebra program. During the 2006-2007 school year, the researchers conducted a follow-on study to a previous randomized experiment in the Maui School District of the effectiveness of "CT" in Algebra I. In this second year, the focus was on the newly developed "Bridge to Algebra" program for pre-Algebra. The question being addressed specifically by the research is whether students in classes that use "CT" materials achieve higher scores on the standardized math assessment, as measured by the Northwest Evaluation Association (NWEA) General Math Test, than they would if they had been in a control classroom using the pre-Algebra curricula the Maui schools currently have in place. The researchers found that most students in both "CT" and control groups improved overall on the NWEA General Math Test. They did not find a difference in student performance in math between groups. Their analysis of the Algebraic Operations sub-strand revealed that many students in both groups did not demonstrate the growth in this scale, again with no discernible group differences. However, for Algebraic Operations outcomes, the researchers found a significant interaction between the pre-test and "CT": student scoring low before participating in "CT" got more benefit from the program's algebraic operations instruction than students with high initial scores. (Contains 8 figures, 33 tables, and 14 footnotes.) [For "Comparative Effectiveness of Carnegie Learning's "Cognitive Tutor Bridge to Algebra" Curriculum: A Report of a Randomized Experiment in the Maui School District. Research Summary," see ED538962.]
Reviews of Individual Studies 5-8 -1
The effects of the School Renaissance program on student achievement in reading and mathematics. (2007)
Reviews of Individual Studies 6-8 -1
An investigation of the effects of a middle school reading intervention on school dropout rates. (2007)
Reviews of Individual Studies 7-9 -1
The effects of Prentice Hall Literature (Penguin Edition) curriculum on student performance: Randomized control trial final report. (2007)
Reviews of Individual Studies K-8 -1
Students in Western Australia improve language and literacy skills: Educator’s briefing. (2007)
Reviews of Individual Studies 2-8 -1
Effect of technology-enhanced continuous progress monitoring on math achievement. (2007)
We examined the extent to which use of a technology-enhanced continuous progress monitoring system would enhance the results of math instruction, examined variability in teacher implementation of the program, and compared math results in classrooms in which teachers did and did not use the system. Classrooms were randomly assigned to within-school experimental and control groups. Participating students were pre- and post-tested using two standardized, nationally normed tests of math achievement. When teachers implemented the continuous progress monitoring system as intended, and when they used the data from the system to manage and differentiate instruction, students gained significantly more than those for whom implementation was limited or nil. Failure to take into account intervention integrity would have made it look like continuous progress monitoring did not enhance math results. (Contains 5 tables.)
Reviews of Individual Studies 3-8 -1
Evaluation of supplemental education services in Minneapolis Public Schools: An application of matched sample statistical design (2007)
Reviews of Individual Studies PK-12 -1
The impact of supplemental educational services participation on student achievement: 2005-06. (2007)
Reviews of Individual Studies 7-8 -1
Improving student literacy: READ 180 in the Austin Independent School District, 2004–05. (2006)
Reviews of Individual Studies 7 -1
Can brain research and computers improve literacy? A randomized field trial of the Fast ForWord Language computer-based training program. (2006)
Reviews of Individual Studies 6-8 -1
Improving the reading comprehension of middle school students with disabilities through computer-assisted collaborative strategic reading (CACSR) (2006)
This study investigated the effects of computer-assisted comprehension practice using a researcher-developed computer program, Computer-Assisted Collaborative Strategic Reading (CACSR), with students who had disabilities. Two reading/language arts teachers and their 34 students with disabilities participated. Students in the intervention group received the CACSR intervention, which consisted of 50-min instructional sessions twice per week over 10 to 12 weeks. The results revealed a statistically significant difference between intervention and comparison groups' reading comprehension ability as measured by a researcher-developed, proximal measure (i.e., finding main ideas and question generation) and a distal, standardized measure (i.e., "Woodcock Reading Mastery Test," Passage Comprehension). Effect sizes for all dependent measures favored the CACSR group. Furthermore, a majority of students expressed positive overall perspectives of the CACSR intervention and believed that their reading had improved.
Reviews of Individual Studies 6-8 -1
The relationship between using Saxon Middle School Math and student performance on Texas statewide assessments [Sample 1]. (2005)
Reviews of Individual Studies 7-9 -1
An evaluation of the second edition of UCSMP Transition Mathematics. (2005)
Reviews of Individual Studies 3-12 -1
Connect with Kids: 2004–2005 Study Results for Kansas and Missouri. (2005)
Reviews of Individual Studies 4-8 -1
Performance of District 23 students participating in Scholastic READ 180. (2005)
Reviews of Individual Studies 4-8 -1
Balanced, strategic reading instruction for upper-elementary and middle school students with reading disabilities: A comparative study of two approaches. (2005)
This study compared the use of two supplemental balanced and strategic reading interventions that targeted the decoding, fluency, and reading comprehension of upper-elementary and middle school students with reading disabilities (RD). All students had significant delays in decoding, fluency, comprehension, and language processing. Two comparable, intensive tutorial treatments differed only in the degree of explicitness of the comprehension strategy instruction. Overall, there was meaningful progress in students' reading decoding, fluency, and comprehension. Gains in formal measures of word attack and reading fluency after five weeks of intervention translated into grade-equivalent gains of approximately half a school year. Analysis of the trends in the daily informal fluency probes translated into a weekly gain of 1.28 correct words per minute. The more explicit comprehension strategy instruction was more effective than the less explicit treatment. Findings are discussed in light of the question of how to maximize the effects of reading interventions for older children with RD.
Reviews of Individual Studies 4-8 -1
A study of the relationship between the National Board Certification status of teachers and students’ achievement: Technical report. (2005)
Reviews of Individual Studies 4-8 -1
Improved reading achievement by students in the school district of Philadelphia who used Fast ForWord® products. (2004b)
Reviews of Individual Studies 7-8 -1
The Talent Development Middle School model: Context, components, and initial impacts on students’ performance and attendance. (2004)
The Talent Development Middle School model was created to make a difference in struggling urban middle schools. The model is part of a trend in school improvement strategies whereby whole-school reform projects aim to improve performance and attendance outcomes for students through the use of major changes in both the organizational structure and the educational processes of middle schools. The models that function in this way--broadly referred to as "comprehensive school reform (CSR) models"--have been developed both nationally and locally, and they receive support from a combination of federal, state, and local funding as well as from private foundations. Talent Development has been a key target of federal resources earmarked for expanding the use of CSR initiatives in middle schools. The model reflects many of the core principles embedded in the CSR movement. School-level structural changes, for example, create more personalized learning environments for students and teachers; curricular changes improve the rigor of coursework and raise teachers' and students' expectations; and professional development for teachers fills gaps in both content knowledge and pedagogy. The findings in this report--which offers an initial assessment of the first and most intensive effort at scaling up the use of the Talent Development Middle School model--indicate that Talent Development had a positive impact on eighth-grade math achievement and exhibited modest impacts on attendance rates. At the same time, the model produced an inconsistent pattern of impacts on eighth-grade reading and had few significant impacts on outcomes for seventh-grade students. This assessment is based on an innovative analytic methodology that relies on a combination of before-and-after and comparison-schools methods. Although the findings offer hope that the Talent Development model can improve academic outcomes, at least in math, for middle school students, more data collection and analysis are needed before definite conclusions can be drawn. A subsequent report will track outcomes for two additional years of implementation and will provide a clearer picture of the potential for improvements in middle school achievement to lead to greater persistence in high school and, eventually, to graduation. Appended are: (1) Tables for Eighth-Grade Students in Early-Implementing Schools; and (2) Tables for Seventh-Grade Students in Early-Implementing Schools. (Contains 4 boxes, 11 figures, and 13 tables.) [Dissemination of MDRC publications is also supported by Starr Foundation.]
Reviews of Individual Studies 7 -1
Implementation study of The Real Reasons for Seasons (2003–2004): SCALE-uP Report No. 4. (2004)
Reviews of Individual Studies 6-8 -1
Evaluation of a two-year middle-school physical education intervention: M-SPAN. (2004)
Reviews of Individual Studies 6-8 -1
Evaluating the Lions-Quest Skills for Adolescence drug education program: Second-year behavior outcomes. (2003)
Reviews of Individual Studies 6-8 -1
Student team reading and writing: A cooperative learning approach to middle school literacy instruction. (2003)
Developed and evaluated a middle school literacy program designed to meet the needs of urban early adolescents. Findings from evaluation in two schools implementing the Student Team Reading and Writing program and three comparison schools indicated higher achievement for program participants. (SLD)
Reviews of Individual Studies 3-8 -1
Fast ForWord® evaluation, 2002–03 (Eye on Evaluation, E&R Report No. 03. 24). (2003)

Connect With the WWC

loading
back to top