Keyword

Filters
Publication Date
1
8
207
590
1237
1407
Topic
671
496
213
120
27
169
33
4
6
103
Populations
142
94
Product Type
24
204
1173
65
Grade Level
890
264
354
334
368
408
399
512
356
354
350
406
322
256
247
261
Evidence Tier
138
123
447
2
89
Locale
222
271
656
Standards Version
237
80
198
598
313
205
19

Search Results

1401 Results filtered by:
Product Type Grade Level Highest Evidence Tier Name (Release Date)
Practice Guide 4-9 1
Providing Reading Interventions for Students in Grades 4–9 (March 2022)
This practice guide provides four evidence-based recommendations that teachers can use to deliver reading interventions to meet the needs of their students.
Practice Guide K-6 1
Assisting Students Struggling with Mathematics: Intervention in the Elementary Grades (March 2021)
This practice guide provides evidence-based practices that can help teachers tailor their instructional approaches and/or their mathematics intervention programs to meet the needs of their students.
Practice Guide 6-12 1
Preventing Dropout in Secondary Schools (September 2017)
This practice guide provides school educators and administrators with four evidence-based recommendations for reducing dropout rates in middle and high schools and improving high school graduation rates. Each recommendation provides specific, actionable strategies; examples of how to implement the recommended practices in schools; advice on how to overcome potential obstacles; and a description of the supporting evidence.
Practice Guide 5-12 1
Teaching Secondary Students to Write Effectively (November 2016)
This practice guide presents three evidence-based recommendations for helping students in grades 6–12 develop effective writing skills. Each recommendation includes specific, actionable guidance for educators on implementing practices in their classrooms. The guide also summarizes and rates the evidence supporting each recommendation, describes examples to use in class, and offers the panel’s advice on how to overcome potential implementation obstacles. This guide is geared towards administrators and teachers in all disciplines who want to help improve their students’ writing.
Practice Guide K-3 1
Foundational Skills to Support Reading for Understanding in Kindergarten Through 3rd Grade (July 2016)
This practice guide provides four recommendations for teaching foundational reading skills to students in kindergarten through 3rd grade. Each recommendation includes implementation steps and solutions for common obstacles. The recommendations also summarize and rate supporting evidence. This guide is geared towards teachers, administrators, and other educators who want to improve their students’ foundational reading skills, and is a companion to the practice guide, Improving Reading Comprehension in Kindergarten Through 3rd Grade.
Practice Guide K-8 1
Teaching Academic Content and Literacy to English Learners in Elementary and Middle School (April 2014)
This practice guide provides four recommendations that address what works for English learners during reading and content area instruction. Each recommendation includes extensive examples of activities that can be used to support students as they build the language and literacy skills needed to be successful in school. The recommendations also summarize and rate supporting evidence. This guide is geared toward teachers, administrators, and other educators who want to improve instruction in academic content and literacy for English learners in elementary and middle school.
Practice Guide 1-6 1
Teaching Elementary School Students to Be Effective Writers (June 2012)
This practice guide provides four recommendations for improving elementary students’ writing. Each recommendation includes implementation steps and solutions for common roadblocks. The recommendations also summarize and rate supporting evidence. This guide is geared toward teachers, literacy coaches, and other educators who want to improve the writing of their elementary students.
Practice Guide 4-8 1
Improving Mathematical Problem Solving in Grades 4 Through 8 (May 2012)
This practice guide provides five recommendations for improving students’ mathematical problem solving in grades 4 through 8. This guide is geared toward teachers, math coaches, other educators, and curriculum developers who want to improve the mathematical problem solving of students.
Practice Guide 6-12 2
Teaching Strategies for Improving Algebra Knowledge in Middle and High School Students (April 2015)
This practice guide provides three recommendations for teaching algebra to students in middle school and high school. Each recommendation includes implementation steps and solutions for common roadblocks. The recommendations also summarize and rate supporting evidence. This guide is geared toward teachers, administrators, and other educators who want to improve their students’ algebra knowledge.
Practice Guide PK-K 2
Teaching Math to Young Children (November 2013)
This practice guide provides five recommendations for teaching math to children in preschool, prekindergarten, and kindergarten. Each recommendation includes implementation steps and solutions for common roadblocks. The recommendations also summarize and rate supporting evidence. This guide is geared toward teachers, administrators, and other educators who want to build a strong foundation for later math learning.
Practice Guide K-3 3
Improving Reading Comprehension in Kindergarten Through 3rd Grade (September 2010)
Students who read with understanding at an early age gain access to a broader range of texts, knowledge, and educational opportunities, making early reading comprehension instruction particularly critical. This guide recommends five specific steps that teachers, reading coaches, and principals can take to successfully improve reading comprehension for young readers.
Practice Guide K-8 3
Developing Effective Fractions Instruction for Kindergarten Through 8th Grade (September 2010)
This practice guide presents five recommendations intended to help educators improve students’ understanding of fractions. Recommendations include strategies to develop young children’s understanding of early fraction concepts and ideas for helping older children understand the meaning of fractions and the computations involved. The guide also highlights ways to build on students’ existing strategies to solve problems involving ratios, rates, and proportions.
Practice Guide 8-12 3
Helping Students Navigate the Path to College: What High Schools Can Do (September 2009)
Access to higher education remains a challenge for many students who face academic and informational barriers to college entry.
Practice Guide K-12 3
Structuring Out-of-School Time to Improve Academic Achievement (July 2009)
Out-of-school time programs can enhance academic achievement by helping students learn outside the classroom.
Practice Guide 1-8 3
Assisting Students Struggling with Mathematics: Response to Intervention (RtI) for Elementary and Middle Schools (April 2009)
Taking early action may be key to helping students struggling with mathematics.
Practice Guide K-3 3
Assisting Students Struggling with Reading: Response to Intervention (RtI) and Multi-Tier Intervention in the Primary Grades (February 2009)
This guide offers five specific recommendations to help educators identify struggling readers and implement evidence-based strategies to promote their reading achievement.
Practice Guide K-6 3
Reducing Behavior Problems in the Elementary School Classroom (September 2008)
Designed for elementary school educators and school- and district-level administrators, this guide offers prevention, implementation, and schoolwide strategies that can be used to reduce problematic behavior that interferes with the ability of students to attend to and engage fully in instructional activities.
Practice Guide 7-12 3
Dropout Prevention (August 2008)
Geared toward educators, administrators, and policymakers, this guide provides recommendations that focus on reducing high school dropout rates.
Practice Guide 5-12 3
Improving Adolescent Literacy: Effective Classroom and Intervention Practices (August 2008)
This guide presents strategies that classroom teachers and specialists can use to increase the reading ability of adolescent students.
Practice Guide K-5 3
Effective Literacy and English Language Instruction for English Learners in the Elementary Grades (December 2007)
The target audience for this guide is a broad spectrum of school practitioners such as administrators, curriculum specialists, coaches, staff development specialists and teachers who face the challenge of providing effective literacy instruction for English language learners in the elementary grades.
Practice Guide K-PS 3
Encouraging Girls in Math and Science (September 2007)
The objective of this guide is to provide teachers with specific recommendations that can be carried out in the classroom without requiring systemic change.
Practice Guide K-PS 3
Organizing Instruction and Study to Improve Student Learning (September 2007)
This guide includes a set of concrete actions relating to the use of instructional and study time that are applicable to subjects that demand a great deal of content learning, including social studies, science, and mathematics.
Practice Guide 2-12 4
Using Student Achievement Data to Support Instructional Decision Making (September 2009)
This guide offers five recommendations to help educators effectively use data to monitor students’ academic progress and evaluate instructional practices.
Practice Guide K-12 4
Turning Around Chronically Low-Performing Schools (May 2008)
This guide identifies practices that can improve the performance of chronically low-performing schools—a process commonly referred to as creating "turnaround schools."
Intervention Report PK-10 1
Class-Wide Function-Related Intervention Teams (CW-FIT) (Study Review Protocol) (May 2023)
Class-Wide Function-Related Intervention Teams (CW-FIT) is a classroom management strategy designed to help teachers create a positive learning environment by decreasing disruptive behavior and improving social skills and prosocial behaviors among students.
Intervention Report K-11 1
Good Behavior Game (Study Review Protocol) (May 2023)
Good Behavior Game is a classroom management strategy that aims to improve social skills, minimize disruptive behaviors, and create a positive learning environment. Teachers place students into teams and reward them for demonstrating appropriate behaviors and following classroom rules.
Intervention Report 4-7 1
Intelligent Tutoring for Structure Strategy (ITSS) (Adolescent Literacy) (April 2020)
Web-Based Intelligent Tutoring for the Structure Strategy (ITSS) is a supplemental web-based program for students in grades K-8. It is intended to develop literacy skills needed to understand factual texts encountered in classrooms and everyday life. The program teaches students how to follow the logical structure of factual text and to use text structure to improve understanding and recall. In particular, ITSS highlights five main text structures that are used to (1) make comparisons; (2) present problems and solutions; (3) link causes and effects; (4) present sequences; and (5) describe things, people, creatures, places, or events. The program helps students classify the structure of a passage by identifying certain key words, such as “solution” and “in contrast,” that clue readers in to the type of arguments the text is making.
Intervention Report 5-12 1
Knowledge is Power Program (KIPP) (Charter Schools) (January 2018)
The Knowledge is Power Program (KIPP) is a nationwide network of free open-enrollment college-preparatory schools in under-resourced communities throughout the United States. KIPP schools are usually established under state charter school laws and KIPP is America’s largest network of charter schools. KIPP Aims to prepare poor and minority students to succeed in a college preparatory curriculum. It provides training for principals and offers them greater autonomy over budget and hiring decisions. KIPP schools provide about 60% more instructional time than traditional public schools—through a longer school day and additional instructional days on Saturdays and in the summer.
Intervention Report K-2 1
Leveled Literacy (Beginning Reading) (September 2017)
Leveled Literacy Intervention (LLI) is a short-term, supplementary, small-group literacy intervention designed to help struggling readers achieve grade-level competency. The intervention provides explicit instruction in phonological awareness, phonics, fluency, vocabulary, reading comprehension, oral language skills, and writing. LLI helps teachers match students with texts of progressing difficulty and deliver systematic lessons targeted to a student’s reading ability.
Intervention Report PK-4 1
Success for All® (Beginning Reading) (March 2017)
Success for All (SFA®) is a whole-school reform model (that is, a model that integrates curriculum, school culture, family, and community supports) for students in prekindergarten through grade 8. SFA® includes a literacy program, quarterly assessments of student learning, a social-emotional development program, computer-assisted tutoring tools, family support teams for students’ parents, a facilitator who works with school personnel, and extensive training for all intervention teachers. The literacy program emphasizes phonics for beginning readers and comprehension for all students. Teachers provide reading instruction to students grouped by reading ability for 90 minutes a day, 5 days a week. In addition, certified teachers or paraprofessionals provide daily tutoring to students who have difficulty reading at the same level as their classmates.
Intervention Report 9-12 1
Dual Enrollment Programs (Transition to College) (February 2017)
Dual enrollment programs allow high school students to take college courses and earn college credits while still attending high school. Such programs, also referred to as dual credit or early college programs, are designed to boost college access and degree attainment, especially for students typically underrepresented in higher education. Dual enrollment programs support college credit accumulation and degree attainment via at least three mechanisms. First, allowing high school students to experience college-level courses helps them prepare for the social and academic requirements of college while having the additional supports available to high school students; this may reduce the need for developmental coursework. Second, students who accumulate college credits early and consistently are more likely to attain a college degree. Third, many dual enrollment programs offer discounted or free tuition, which reduces the overall cost of college and may increase the number of low socioeconomic status students who can attend and complete college.
Intervention Report 4-10 1
READ 180® (Adolescent Literacy) (November 2016)
READ 180® is a reading program designed for struggling readers who are reading 2 or more years below grade level. It combines online and direct instruction, student assessment, and teacher professional development. READ 180® is delivered in 90-minute sessions that include whole-group instruction, three small-group rotations, and whole-class wrap-up. Small-group rotations include individualized instruction using an adaptive computer application, small-group instruction, and independent reading. READ 180® is designed for students in elementary through high school.
Intervention Report 10-12 1
ACT/SAT Test Preparation and Coaching Programs (Transition to College) (October 2016)
Test preparation programs—sometimes referred to as test coaching programs—have been implemented with the goal of increasing student scores on college entrance tests. They generally (a) familiarize students with the format of the test; (b) introduce general test-taking strategies (e.g., get a good night’s sleep); (c) introduce specific testtaking strategies (e.g., whether the test penalizes incorrect answers, and what this means for whether or not one should guess an answer if it is not known); and (d) specific drills (e.g., practice factoring polynomial expressions). The programs can be delivered in person or online, and in whole class settings, in small groups, and individually.
Intervention Report K-12 1
Teach for America (Teacher Training, Evaluation, and Compensation) (August 2016)
Teach For America (TFA) is a highly selective route to teacher certification that aims to place non-traditionally trained teachers in high-need public schools. Many TFA teachers hold bachelors’ degrees from selective colleges and universities, in fields outside of education. TFA teachers commit to teach for at least 2 years. TFA teachers receive 5–7 weeks of in-person training over the summer before they begin teaching, then continue to receive professional development and one-on-one coaching from TFA while teaching, in addition to support provided by their schools and districts. As full-time employees of the public schools where they work, TFA teachers receive the same salary and benefits as other first- or second-year teachers in their school or district.
Intervention Report 8-PS 1
Cognitive Tutor® Algebra I (Secondary Mathematics) (June 2016)
Cognitive Tutor®, published by Carnegie Learning, is a math curricula that combines textbooks and interactive software.
Intervention Report K-1 2
Reading Recovery® (Study Review Protocol) (June 2023)
Reading Recovery® is an intervention that provides one-on-one tutoring to students in grade 1 with low literacy achievement. This supplemental program aims to improve student reading and writing skills by providing one-on-one tutoring, tailoring the content of each lesson to each student based on observations and analyses of the student strengths and weaknesses from prior lessons. Trained Reading Recovery® teachers deliver tutoring daily in 30-minute one-on-one sessions over the course of 12 to 20 weeks. Reading Recovery® teachers incorporate instruction in topics such as phonemic awareness, phonics, vocabulary, fluency, comprehension, writing, oral language, and motivation depending on student needs.
Intervention Report 7-12 2
Reading Apprenticeship® (Study Review Protocol) (January 2023)
Reading Apprenticeship® is a professional development program that aims to help teachers improve their students’ literacy skills. The program also aims to improve student social-emotional learning outcomes such as belonging, social awareness, growth mindset, and self-efficacy. Reading Apprenticeship® trains teachers to model reading comprehension strategies and help students practice these strategies in their classrooms.
Intervention Report K-8 2
Dual Language Programs (Systematic Review Protocol for English Language Arts Interventions) (December 2022)
Dual language programs are long-term instructional programs that provide content and literacy instruction to all students through two languages—English and a partner language—with the goals of promoting academic achievement, bilingualism and biliteracy, and sociocultural competence. Dual language programs can be implemented with students from one language group (in one-way programs) or with students from two language groups (in two-way programs).
Intervention Report 6-12 2
Pathway to Academic Success (Pathway Project) (English Language Learners) (November 2021)
The Pathway to Academic Success Project trains teachers to improve the reading and writing abilities of English learners who have an intermediate level of English proficiency by incorporating cognitive strategies into reading and writing instruction. The cognitive strategies include goal setting, tapping prior knowledge, asking questions, making predictions, articulating and revising understanding of text, and evaluating writing.
Intervention Report 12-PS 2
Success Boston (Supporting Postsecondary Success) (October 2020)
Success Boston Coaching is a coaching intervention for students who are traditionally underrepresented in college to help them transition from high school to college and progress in college. Students are paired with a dedicated coach starting as early as the spring of their senior year of high school and receive coaching through their first two years in college. As Boston’s citywide college completion initiative, Success Boston partners with existing nonprofit organizations focused on coaching and mentoring to deliver these one-on-one coaching services. Nonprofit coaching partners may also provide students with other direct services such as tutoring and career readiness support, and financial support that includes scholarships, transportation subsidies, and funding for school-related materials and supplies.
Intervention Report 4-8 2
eMINTS Comprehensive Program (Teacher Excellence Review Protocol ) (April 2020)
The eMINTS Comprehensive Program aims to help teachers improve their practice and the outcomes of their students by offering structured professional development, coaching, and support for integrating technology into the classroom. The program’s goals include supporting teachers in using classroom technology to implement high-quality, inquiry-based learning, in which students develop understanding and knowledge of content matter by engaging in meaningful investigations that require reasoning, judgement, and decision making. The intervention can provide support to teachers in any subject area, including math, literacy, and science.
Intervention Report 2-9 2
Achieve3000 (Adolescent Literacy) (February 2018)
Achieve3000® is a supplemental online literacy program that provides nonfiction reading content to students in grades preK–12 and focuses on building phonemic awareness, phonics, fluency, reading comprehension, vocabulary, and writing skills. Achieve3000® is designed to help students advance their nonfiction reading skills by providing differentiated online instruction. Teachers use the program with an entire class but the assignments are tailored to each student’s reading ability level. For example, teachers assign an article and related activities to an entire class; the program then tailors the version of the article to each student by automatically increasing the difficulty of text when a student is ready for more challenging text. Achieve3000® provides lessons that follow a five-step routine: (1) respond to a Before Reading Poll, (2) read an article, (3) answer activity questions, (4) respond to an After Reading Poll, and (5) answer a Thought Question. Progress reports and student usage data, provided by the online tool, enable teachers to track both whole-class and individual student progress. The program is designed for diverse student groups, including general education students, struggling readers in need of intensive tutoring, and English learners.
Intervention Report 4-8 2
Odyssey® Math (Primary Mathematics) (January 2017)
Odyssey® Math is a web-based program developed by Compass Learning® for mathematics instruction in grades K–8. The online program includes a mathematics curriculum and formative assessments designed to support differentiated and data-driven instruction. Based on assessment results, the program generates an individualized sequence of mathematics topics and skills—a “learning path.” Odyssey® Math is often used as a prescriptive tool, where students can start by taking a diagnostic assessment aligned with local or state standards. Teachers can modify learning paths to match their lesson plans or to align them with district scopes and sequences.
Intervention Report 2-6 2
Cooperative Integrated Reading and Composition® (CIRC®) (Beginning Reading) (June 2012)
Cooperative Integrated Reading and Composition® (CIRC®) is a comprehensive reading and writing program for students in grades 2–8. It includes story-related activities, direct instruction in reading comprehension, and integrated reading and language arts activities. Pairs of students (grouped either by or across ability levels) read to each other, predict how stories will end, summarize stories, write responses, and practice spelling, decoding, and vocabulary. Within cooperative teams of four, students work to understand the main idea of a story and work through the writing process. The CIRC® process includes teacher instruction, team practice, peer assessment, and team/partner recognition. A Spanish version of the program was also designed for grades 2–5.
Intervention Report K-2 2
Early Risers (Children Identified With or at Risk for an Emotional Disturbance) (June 2012)
Early Risers is a multi-year prevention program for elementary school children demonstrating early aggressive and disruptive behavior. The intervention model includes two child-focused components and two parent/family components. The Child Skills component is designed to teach skills that enhance children’s emotional and behavioral self-regulation, positive peer relationships, and academic success. The Child School Support component aims to identify areas of difficulty in the classroom and creates individualized plans to address those difficulties during the course of normal school activities. The Parent Skills component is delivered in “family night” group sessions and is intended to promote parents’ abilities to support their children’s healthy development by teaching skills that address positive parent–child relations, effective discipline practices, and parent involvement in school. The Family Support component is delivered via home visits to identify basic needs and health concerns and then implement plans designed to assist families in achieving and maintaining healthy lifestyles.
Intervention Report K-6 2
Peer-Assisted Learning Strategies (Beginning Reading) (May 2012)
Peer-Assisted Learning Strategies is a peer-tutoring program for grades K–6 that aims to improve student proficiency in several disciplines. During the 30-35 minute peer-tutoring sessions, students take turns acting at the tutor, coaching and correcting one another as they work through problems. The designation of tutoring pairs and skill assignment is based on teacher judgement of student needs and abilities, and teachers reassign tutoring pairs regularly.  
Intervention Report 4-5 3
Science Teachers Learning through Lesson Analysis (STeLLA) Professional Development (Science) (May 2021)
Science Teachers Learning through Lesson Analysis (STeLLA®) is a professional development program, developed by BSCS Science Learning, that aims to improve students’ science achievement by improving teachers’ science content knowledge and their abilities to (a) explain science concepts to students, (b) clearly identify to students the science concepts used in student learning activities, and (c) engage students in thinking about science.
Intervention Report 11-PS 3
Bottom Line (Transition to College) (April 2021)
Bottom Line provides intensive advising for high school students from low-income households, most of whom are the first in their family to go to college. The advising is designed to help students apply for college and financial aid and select a high-quality affordable institution. For students who attend one of their target colleges, Bottom Line continues to provide regular support to students on campus for up to six years.
Intervention Report 4 3
Fraction Face-Off! (Primary Mathematics) (March 2020)
Fraction Face-Off! is a supplemental math program developed to support fourth-grade students who need assistance solving fraction problems. Teachers use program materials with individual students or small groups to promote understanding of the magnitude of fractions, to compare two fractions, to put three fractions in order, and to place fractions on a number line.
Intervention Report K-12 3
McREL Balanced Leadership (School Leadership Review Protocol ) (March 2020)
Balanced Leadership® is a professional development program for school principals and other current and aspiring school leaders in schools serving kindergarten through grade 12. School leaders participate in professional development sessions with trained facilitators over one or two years, practice what they learn between sessions, and can receive additional coaching and online support. McREL International, the company that developed the Balanced Leadership® program, based the framework and content of the professional development on research identifying key actions and behaviors of school leaders that are associated with improved student outcomes.
Intervention Report 7-11 3
Facilitating Long-term Improvements in Graduation and Higher Education for Tomorrow (FLIGHT) (Transition to College) (April 2019)
FLIGHT is a program based on partnership of a private non-profit (Taking Stock in Children) and local educational agencies with the goal of increasing the extent to which low-income students with academic promise are prepared for, enrolled in, and successful in college. Specifically, FLIGHT provides school-based mentoring, college prep, and wrap-around services for at-risk students who show potential to be successful in postsecondary education endeavors.
Intervention Report 12-PS 3
Summer Counseling (Transition to College) (March 2018)
The summer counseling intervention was intended to reduce what study authors call the summer “melt,” a phenomenon in which students have been accepted to college but fail to matriculate. These summer counseling services, delivered during the months between high school graduation and college enrollment, involve outreach by college counselors or peer mentors via text messaging campaigns, e-mail, phone, in-person meetings, instant messaging, or social media. These intervention services provide college-intending individuals with information about tasks required for college enrollment, such as taking placement tests, arranging for housing, acquiring medical insurance, obtaining financial aid, and registering for courses. Summer counseling was also provided to help students overcome unanticipated financial, informational, and socio-emotional barriers that prevent college enrollment.
Intervention Report 9-12 3
Green Dot Public Schools (Charter Schools) (January 2018)
Green Dot Public Schools is a nonprofit organization that operates more than 20 public charter middle and high schools in California, Tennessee, and Washington. The Green Dot Public Schools are regulated and monitored by the local school district, but operate outside of the district’s direct control. The Green Dot Public Schools model emphasizes high quality teaching, strong school leadership, a curriculum that prepares students for college, and partnerships with the community. Any student may enroll in a Green Dot Public School if there is space available. Many Green Dot Public Schools operate with unionized teachers and staff. Several of the Green Dot Public Schools were chartered in existing public schools which were performing below district or community expectations. Funding for Green Dot Public Schools operations comes through public federal, state, and local finances, while some transformations of existing district-run schools into charter schools have been funded partly by private foundations.
Intervention Report 2-10 3
Self-Regulated Strategy Development (Students with a Specific Learning Disability) (November 2017)
Self-Regulated Strategy Development (SRSD) is an intervention designed to improve students’ academic skills through a six-step process that teaches students specific academic strategies and self-regulation skills. The practice is especially appropriate for students with learning disabilities. The intervention begins with teacher direction and ends with students independently applying the strategy, such as planning and organizing ideas before writing an essay. More specifically, the six steps involve the teacher providing background knowledge, discussing the strategy with the student, modeling the strategy, helping the student memorize the strategy, supporting the strategy, and then watching as the student independently performs the strategy. A key part of the process is teaching self-regulation skills, such as goal-setting and self-monitoring, which aim to help students apply the strategy without guidance. The steps can be combined, changed, reordered, or repeated, depending on the needs of the student. The SRSD model can be used with students in grades 2 through 12 in individual, small group, or whole classroom settings.
Intervention Report 8-10 3
I CAN Learn®(Primary Mathematics) (August 2017)
I CAN Learn® is a computer-based math curriculum for students in middle school, high school, and college. It provides math instruction through a series of interactive lessons that students work on individually at their own computers. Students move at their own pace and must demonstrate mastery of each concept before progressing to the next one. Classroom teachers may provide individual, small-group, or whole-class instruction based on students’ performance on the software program.
Intervention Report K-12 3
Functional Behavioral Assessment-based Interventions (December 2016)
Functional behavioral assessment (FBA) is an individualized problem-solving process for addressing student problem behavior. An assessment is conducted to identify the purpose or function of a student's problem behavior. This assessment process involves collecting information about the environmental conditions that precede the problem behavior and the subsequent rewards that reinforce the behavior. The information that is gathered is then used to identify and implement individualized interventions aimed at reducing problem behaviors and increasing positive behaviors. Accordingly, the studies evaluating FBA examine different FBA-based interventions identified for each student. FBA-based interventions can be used to address diverse problem behaviors, such as disruptive and off-task behaviors, noncompliance, and inappropriate social interactions.
Intervention Report 8 3
University of Chicago School Mathematics Project (UCSMP) Algebra (Secondary Mathematics) (May 2016)
University of Chicago School Mathematics Project (UCSMP) Algebra, designed to increase students’ skills in algebra, is appropriate for students in grades 7–10, depending on the students’ incoming knowledge. This 1-year course highlights applications, uses statistics and geometry to develop the algebra of linear equations and inequalities, and includes probability concepts in conjunction with algebraic fractions. The curriculum emphasizes graphing, delaying manipulation with rational algebraic expressions until later courses. This curriculum uses the UCSMP textbook.
Intervention Report 7-10 3
University of Chicago School Mathematics Project (UCSMP) Multiple Courses (Secondary Mathematics) (May 2016)
UCSMP is a core mathematics curriculum that emphasizes problem solving, real-world applications, and the use of technology. The curriculum is based on a student-centered approach with a focus on active learning that incorporates reading and uses a flexible lesson organization.
Intervention Report 1-4 3
Lindamood Phoneme Sequencing® (LiPS®) (Beginning Reading) (November 2015)
The Lindamood Phoneme Sequencing® (LiPS®) program (formerly called the Auditory Discrimination in Depth® [ADD] program) is designed to teach students the skills they need to decode words and to identify individual sounds and blends in words. LiPS® is designed for emergent readers in kindergarten through grade 3 or for struggling, dyslexic readers. The program is individualized to meet students’ needs and is often used with students who have learning disabilities or difficulties. Initial activities engage students in discovering the lip, tongue, and mouth actions needed to produce specific sounds. After students are able to produce, label, and organize the sounds with their mouths, subsequent activities in sequencing, reading, and spelling use the oral aspects of sounds to identify and order them within words. The program also offers direct instruction in letter patterns, sight words, and context clues in reading.
Intervention Report 3-5 3
Everyday Mathematics® (Primary Mathematics) (November 2015)
Everyday Mathematics® is a core curriculum for students in prekindergarten through grade 6. At each grade level, the Everyday Mathematics® curriculum provides students with multiple opportunities to learn concepts and practice skills. Across grade levels, concepts are reviewed and extended in varying instructional contexts. The distinguishing features of Everyday Mathematics® are its focus on real-life problem solving, student communication of mathematical thinking, and appropriate use of technology. This curriculum also emphasizes balancing different types of instruction (including collaborative learning), using various methods for skills practice, and fostering parent involvement in student learning.
Intervention Report 9-12 3
Career Academies (Dropout Prevention) (September 2015)
Career Academies are school-within-school programs operating in high schools. Students in Career Academies take both career-related and academic courses and acquire work experience through partnerships with local employers.
Intervention Report 6-12 3
MyTeachingPartner–Secondary (Teacher Training, Evaluation, and Compensation) (June 2015)
MyTeachingPartner–Secondary (MTP-S) is a professional development program that aims to increase student learning and development through improved teacher–student interactions. Through the program, middle and high school teachers access a video library featuring examples of high-quality interactions and receive individualized, web-based coaching approximately twice per month during the school year. MTP-S uses the secondary school version of the Classroom Assessment Scoring System®–Secondary (CLASS-S) to define and observe effective teaching practices.
Intervention Report 9-12 3
Check & Connect (Dropout Prevention) (May 2015)
Check & Connect is a dropout prevention strategy that relies on close monitoring of school performance, mentoring, case management, and other supports. The program has two main components: “Check” and “Connect.” The Check component is designed to continually assess student engagement through close monitoring of student performance and progress indicators. The Connect component involves program staff giving individualized attention to students, in partnership with school personnel, family members, and community service providers. Students enrolled in Check & Connect are assigned a “monitor” who regularly reviews their performance (in particular, whether students are having attendance, behavior, or academic problems) and intervenes when problems are identified. The monitor also advocates for students, coordinates services, provides ongoing feedback and encouragement, and emphasizes the importance of staying in school.
Intervention Report K 3
Fast Track: Elementary School (Children Identified With or at Risk for an Emotional Disturbance) (October 2014)
Fast Track is a comprehensive intervention program designed to reduce conduct problems and promote academic, behavioral, and social improvement. Prior to grade 1, students are identified as being at risk for long-term antisocial behavior through teacher and parent reports of conduct problems. Delivery of the program begins in grade 1 and continues through grade 10. After the first year, the frequency of the supports is reduced based on the assessed functioning of the students and their families. Fast Track consists of seven integrated intervention components: the Promoting Alternative Thinking Strategies (PATHS) curriculum, parent groups, parent–child sharing time, child social skills training groups, home visiting, child peer-pairing, and academic tutoring.
Intervention Report 1-5 3
Open Court Reading© (Beginning Reading) (October 2014)
Open Court Reading© is a reading program for grades K–6 that is designed to teach decoding, comprehension, inquiry, and writing in a three-part progression. Part One of each unit, Preparing to Read, focuses on phonemic awareness, sounds and letters, phonics, fluency, and word knowledge. Part Two, Reading and Responding, emphasizes reading literature for understanding, comprehension, inquiry, and practical reading applications. Part Three, Language Arts, focuses on writing, spelling, grammar, usage, mechanics, and basic computer skills.
Intervention Report 5-12 3
Repeated Reading (Students with Learning Disabilities) (May 2014)
Repeated reading is an academic practice that aims to increase oral reading fluency. Repeated reading can be used with students who have developed initial word reading skills but demonstrate inadequate reading fluency for their grade level. During repeated reading, a student sits in a quiet location with a teacher and reads a passage aloud at least three times. Typically, the teacher selects a passage of about 50 to 200 words in length. If the student misreads a word or hesitates for longer than 5 seconds, the teacher reads the word aloud, and the student repeats the word correctly. If the student requests help with a word, the teacher reads the word aloud or provides the definition. The student rereads the passage until he or she achieves a satisfactory fluency level.
Intervention Report 2-4 3
Spelling Mastery (Students with Learning Disabilities) (January 2014)
Spelling Mastery is designed to explicitly teach spelling skills to students in grades 1–6. One of several Direct Instruction curricula from McGraw-Hill that precisely specify how to teach incremental content, Spelling Mastery includes phonemic, morphemic, and whole-word strategies.
Intervention Report K-1 3
DreamBox Learning (Elementary School Mathematics) (December 2013)
DreamBox Learning is a supplemental online mathematics program that provides adaptive instruction for students in grades K–5 and focuses on number and operations, place value, and number sense. The program aims to individualize instruction for each student using unique paths through the curriculum ihat match each student’s level of comprehension and learning style.
Intervention Report K-1 3
Reading Recovery® (Beginning Reading) (July 2013)
Reading Recovery® is an intervention that provides one-on-one tutoring to students in grade 1 with low literacy achievement. This supplemental program aims to improve student reading and writing skills by providing one-on-one tutoring, tailoring the content of each lesson to each student based on observations and analyses of the student strengths and weaknesses from prior lessons. Trained Reading Recovery® teachers deliver tutoring daily in 30-minute one-on-one sessions over the course of 12 to 20 weeks. Reading Recovery® teachers incorporate instruction in topics such as phonemic awareness, phonics, vocabulary, fluency, comprehension, writing, oral language, and motivation depending on student needs.
Intervention Report 2-6 3
Read Naturally® (Beginning Reading) (July 2013)
Read Naturally is an elementary and middle school supplemental reading program designed to improve reading fluency using a combination of books, audiotapes, and computer software. The program has three main strategies: repeated reading of text for developing oral reading fluency, teacher modeling of story reading, and systematic monitoring of student progress by teachers and the students themselves. Students work at a reading level appropriate for their achievement level, progress through the program at their own rate, and, for the most part, work on an independent basis. Read Naturally® can be used in a variety of settings, including classrooms, resource rooms, or computer or reading labs. Although the program was not originally developed for English language learners, additional materials for these students are currently available.
Intervention Report 5-6 3
SpellRead (Adolescent Literacy) (January 2013)
SpellRead™ (formerly known as SpellRead Phonological Auditory Training®) is a literacy program for struggling readers in grade 2 or above, including special education students, English language learners, and students more than 2 years below grade level in reading. SpellRead integrates the auditory and visual aspects of the reading process and emphasizes specific skill mastery through systematic and explicit instruction. Students are taught to recognize and manipulate English sounds; to practice, apply, and transfer their skills using texts at their reading level; and to write about their reading.
Intervention Report 4-5 3
Great Explorations in Math and Science® (GEMS®) Space Science Sequence (Science) (June 2012)
Great Explorations in Math and Science® (GEMS®) Space Science Sequence is an instructional curriculum for grades 3–5 that covers fundamental concepts, including planetary sizes and distance, the earth’s shape and movement, gravity, and moon phases and eclipses. Part of the GEMS® core curriculum, GEMS® Space Science Sequence uses the solar system as the focal point for learning. The sequence uses models, hands-on investigations, peer-to-peer discussions, reflection, and informational student readings. Students complete four units, each lasting between four and nine sessions. Each unit builds upon knowledge from previous units and can be used independently or in conjunction with one another for an overall learning progression.
Intervention Report K-6 3
Peer-Assisted Learning Strategies (Students with Learning Disabilities) (June 2012)
Peer-Assisted Learning Strategies is a peer-tutoring program for grades K–6 that aims to improve student proficiency in several disciplines. During the 30-35 minute peer-tutoring sessions, students take turns acting at the tutor, coaching and correcting one another as they work through problems. The designation of tutoring pairs and skill assignment is based on teacher judgement of student needs and abilities, and teachers reassign tutoring pairs regularly.  
Intervention Report 3-4 3
Technology Enhanced Elementary and Middle School Science (TEEMSS) (Science) (May 2012)
Technology Enhanced Elementary and Middle School Science (TEEMSS) is a physical science curriculum for grades 3–8 that uses computers, sensors, and interactive models to support investigations of real-world phenomena. Through 15 inquiry-based instructional units, students interact with computers, gather and analyze data, and formulate ideas for further exploration. This information is managed by software in a handheld computer and transmitted to other students and to the teacher. The program includes a web-based teacher-reporting tool that allows teachers to review student portfolios and gather student responses for assessment and class discussion.
Intervention Report K-3 3
First Step to Success (Children Identified With or at Risk for an Emotional Disturbance) (March 2012)

First Step to Success is an early intervention program designed to help children who are at risk for developing aggressive or antisocial behavioral patterns. The program uses a trained behavior coach who works with each student and his or her class peers, teacher, and parents for approximately 50–60 hours over a 3-month period. First Step to Success includes three interconnected modules: screening, classroom intervention, and parent training.

Intervention Report K-6 3
Peer-Assisted Learning Strategies (Adolescent Literacy) (January 2012)
Peer-Assisted Learning Strategies is a peer-tutoring program for grades K–6 that aims to improve student proficiency in several disciplines. During the 30-35 minute peer-tutoring sessions, students take turns acting at the tutor, coaching and correcting one another as they work through problems. The designation of tutoring pairs and skill assignment is based on teacher judgement of student needs and abilities, and teachers reassign tutoring pairs regularly.  
Intervention Report K-6 3
Peer-Assisted Learning Strategies (English Language Learners) (September 2010)
Peer-Assisted Learning Strategies is a peer-tutoring program for grades K–6 that aims to improve student proficiency in several disciplines. During the 30-35 minute peer-tutoring sessions, students take turns acting at the tutor, coaching and correcting one another as they work through problems. The designation of tutoring pairs and skill assignment is based on teacher judgement of student needs and abilities, and teachers reassign tutoring pairs regularly.  
Intervention Report K-1 3
Sound Partners (Beginning Reading) (September 2010)
Sound Partners is a phonics-based tutoring program that provides supplemental reading instruction to elementary school students grades K–3 with below-average reading skills. The program is designed for use by tutors with minimal training and experience. Instruction emphasizes letter–sound correspondences, phoneme blending, decoding and encoding phonetically regular words, and reading irregular high-frequency words. It includes oral reading to practice applying phonics skills in text. The program consists of a set of scripted lessons in alphabetic and phonics skills and uses Bob Books beginning reading series as one of the primary texts for oral reading practice. The tutoring can be provided as a pull-out or after-school program or by parents who homeschool their children.
Intervention Report 11-12 3
National Guard Youth ChalleNGe Program (Dropout Prevention) (September 2010)
The National Guard Youth ChalleNGe Program is a residential education and training program designed for youth ages 16–18 who have dropped out of or been expelled from high school. During a 22-week residential period, participants are offered GED (General Educational Development) preparation classes and other program services intended to promote positive youth development, such as leadership, job skills, and service to the community. The residential period is quasi-military (youth live in barracks, wear uniforms, and experience military-style discipline), but there are no requirements for military service. After the residential period, trainees participate in a 1-year structured mentoring program. Trainees select their own mentors. After selection, mentors are screened and trained by the program.
Intervention Report 5-9 3
Reading Plus® (Adolescent Literacy) (September 2010)
Reading Plus® is a web-based reading intervention that uses technology to provide individualized scaffolded silent reading practice for students in grades 3 and higher. Reading Plus® aims to develop and improve students’ silent reading fluency, comprehension, and vocabulary. Reading Plus® is designed to adjust the difficulty of the content and duration of reading activities so that students proceed at a pace that corresponds to their reading skill level. The intervention includes differentiated reading activities, computer-based reading assessments, tools to monitor student progress, ongoing implementation support, and supplemental offline activities.
Intervention Report 9-10 3
Core-Plus Mathematics (High School Mathematics) (September 2010)
Core-Plus Mathematics is a 4-year curriculum that replaces the traditional sequence with courses that each feature interwoven strands of algebra and functions, statistics and probability, geometry and trigonometry, and discrete mathematics. The curriculum emphasizes mathematical modeling, using technology to emphasize reasoning with multiple representations (verbal, numerical, graphical, and symbolic) and to focus on goals in which mathematical thinking and problem solving are central. Instructional materials promote active learning and teaching centered around collaborative small-group investigations of problem situations, followed by teacher-led whole-class summarizing activities that lead to analysis, abstraction, and further application of underlying mathematical ideas.
Intervention Report 2-6 3
Cooperative Integrated Reading and Composition® (CIRC®) (Adolescent Literacy) (August 2010)
Cooperative Integrated Reading and Composition® (CIRC®) is a comprehensive reading and writing program for students in grades 2–8. It includes story-related activities, direct instruction in reading comprehension, and integrated reading and language arts activities. Pairs of students (grouped either by or across ability levels) read to each other, predict how stories will end, summarize stories, write responses, and practice spelling, decoding, and vocabulary. Within cooperative teams of four, students work to understand the main idea of a story and work through the writing process. The CIRC® process includes teacher instruction, team practice, peer assessment, and team/partner recognition. A Spanish version of the program was also designed for grades 2–5.
Intervention Report K-10 3
Fast ForWord® (Adolescent Literacy) (August 2010)
Fast ForWord® is a computer-based reading program intended to help students develop and strengthen the cognitive skills necessary for successful reading and learning. The program, which is designed to be used 30 to 100 minutes a day, five days a week, for 4 to 16 weeks, includes two components.
Intervention Report K-8 3
Accelerated Reader (Adolescent Literacy) (August 2010)
Accelerated Reader™ is a computerized supplementary reading program that provides guided reading instruction to students in grades K–12. It aims to improve students’ reading skills through reading practice and by providing frequent feedback on students’ progress to teachers. The Accelerated Reader™ program requires students to select and read a book based on their area of interest and reading level. Upon completion of a book, students take a computerized quiz based on the book’s content and vocabulary. Quiz performance allows teachers to monitor student progress and to identify students who may need additional reading assistance.
Intervention Report K-5 3
Reading Mastery (Adolescent Literacy) (August 2010)
Reading Mastery is designed to provide systematic reading instruction to students in grades K–6. Reading Mastery can be used as an intervention program for struggling readers, as a supplement to a school’s core reading program, or as a stand-alone reading program, and is available in three versions. During the implementation of Reading Mastery, students are grouped with other students at a similar reading level, based on program placement tests. The program includes a continuous monitoring component.
Intervention Report 2-6 3
Read Naturally® (Students with Learning Disabilities) (July 2010)
Read Naturally is an elementary and middle school supplemental reading program designed to improve reading fluency using a combination of books, audiotapes, and computer software. The program has three main strategies: repeated reading of text for developing oral reading fluency, teacher modeling of story reading, and systematic monitoring of student progress by teachers and the students themselves. Students work at a reading level appropriate for their achievement level, progress through the program at their own rate, and, for the most part, work on an independent basis. Read Naturally® can be used in a variety of settings, including classrooms, resource rooms, or computer or reading labs. Although the program was not originally developed for English language learners, additional materials for these students are currently available.
Intervention Report 7-12 3
Reading Apprenticeship® (Adolescent Literacy) (July 2010)
Reading Apprenticeship® is a professional development program that aims to help teachers improve their students’ literacy skills. The program also aims to improve student social-emotional learning outcomes such as belonging, social awareness, growth mindset, and self-efficacy. Reading Apprenticeship® trains teachers to model reading comprehension strategies and help students practice these strategies in their classrooms.
Intervention Report 4-6 3
Project CRISS® (Adolescent Literacy) (June 2010)
Project CRISS® (CReating Independence through Student-owned Strategies) is a professional development program for teachers that aims to improve reading, writing, and learning for students in grades 3–12. The implementation of Project CRISS® does not require a change in the curriculum or materials being used in the classroom, but instead calls for a change in teaching style to focus on three primary concepts derived from cognitive psychology and brain research. These three concepts include students (1) monitoring their learning to assess when they have understood content, (2) integrating new information with prior knowledge, and (3) being actively involved in the learning process through discussing, writing, organizing information, and analyzing the structure of text to help improve comprehension.
Intervention Report 1 3
Read Well® (English Language Learners) (June 2010)
Read Well® is a reading curriculum to increase the literacy abilities of students in kindergarten and grade 1. The program provides instruction in phonemic awareness, phonics, vocabulary, comprehension, and fluency. Students are given opportunities to discuss the vocabulary concepts that are presented in each story. The program is based on the tenets of scaffolded instruction, where teachers begin by presenting models, and gradually decrease their support by providing guided practice, before students are asked to complete the skill or strategy independently. For example, the student and teacher read new text aloud, with the teacher reading the difficult or irregular words. As student skills (and motivation) increase, the amount of teacher-read text decreases, and the student is given greater independence. The program combines daily whole class activities with small group lessons.
Intervention Report 1-4 3
Lindamood Phoneme Sequencing® (LiPS®) (Students with Learning Disabilities) (March 2010)
The Lindamood Phoneme Sequencing® (LiPS®) program (formerly called the Auditory Discrimination in Depth® [ADD] program) is designed to teach students the skills they need to decode words and to identify individual sounds and blends in words. LiPS® is designed for emergent readers in kindergarten through grade 3 or for struggling, dyslexic readers. The program is individualized to meet students’ needs and is often used with students who have learning disabilities or difficulties. Initial activities engage students in discovering the lip, tongue, and mouth actions needed to produce specific sounds. After students are able to produce, label, and organize the sounds with their mouths, subsequent activities in sequencing, reading, and spelling use the oral aspects of sounds to identify and order them within words. The program also offers direct instruction in letter patterns, sight words, and context clues in reading.
Intervention Report 4-10 3
Read 180® (Adolescent Literacy) (October 2009)
READ 180® is a reading program designed for struggling readers who are reading 2 or more years below grade level. It combines online and direct instruction, student assessment, and teacher professional development. READ 180® is delivered in 90-minute sessions that include whole-group instruction, three small-group rotations, and whole-class wrap-up. Small-group rotations include individualized instruction using an adaptive computer application, small-group instruction, and independent reading. READ 180® is designed for students in elementary through high school.
Intervention Report 4-8 3
Odyssey Math (Elementary School Mathematics) (August 2009)
Odyssey® Math is a web-based program developed by Compass Learning® for mathematics instruction in grades K–8. The online program includes a mathematics curriculum and formative assessments designed to support differentiated and data-driven instruction. Based on assessment results, the program generates an individualized sequence of mathematics topics and skills—a “learning path.” Odyssey® Math is often used as a prescriptive tool, where students can start by taking a diagnostic assessment aligned with local or state standards. Teachers can modify learning paths to match their lesson plans or to align them with district scopes and sequences.
Intervention Report PK-4 3
Success for All® (Beginning Reading) (August 2009)
Success for All (SFA®) is a whole-school reform model (that is, a model that integrates curriculum, school culture, family, and community supports) for students in prekindergarten through grade 8. SFA® includes a literacy program, quarterly assessments of student learning, a social-emotional development program, computer-assisted tutoring tools, family support teams for students’ parents, a facilitator who works with school personnel, and extensive training for all intervention teachers. The literacy program emphasizes phonics for beginning readers and comprehension for all students. Teachers provide reading instruction to students grouped by reading ability for 90 minutes a day, 5 days a week. In addition, certified teachers or paraprofessionals provide daily tutoring to students who have difficulty reading at the same level as their classmates.
Intervention Report K-1 3
Lexia Reading (Beginning Reading) (June 2009)
Lexia Reading is a computerized reading program that provides phonics instruction and gives students independent practice in basic reading skills. Lexia Reading is designed to supplement regular classroom instruction and to support skill development in the five areas of reading instruction identified by the National Reading Panel.
Intervention Report 8 3
I CAN Learn® Pre-Algebra and Algebra (Middle School Mathematics) (March 2009)
The I CAN Learn® Pre-Algebra and Algebra computerized curricula are designed to cover mathematics and problem-solving skills for ethnically diverse, inner-city students in grades 6–12. The curricula are designed to equip students with the skills they need to meet district, state, and national math objectives through an interactive software program that teaches pre‑algebra and algebra. The I CAN Learn® Pre-Algebra software program consists of 131 lessons, and the Algebra program consists of 181 lessons.
Intervention Report K-3 3
Earobics® (Beginning Reading) (January 2009)
Earobics® is an interactive software that provides students in prekindergarten through grade 3 with individual, systematic instruction in early literacy skills as students interact with animated characters. Earobics® Foundations is the version for prekindergaten, kindergarten, and grade 1. Earobics® Connections is for grades 2 and 3 and older struggling readers. The program builds students’ skills in phonemic awareness, auditory processing, and phonics, as well as the cognitive and language skills required for comprehension. Each level of instruction addresses recognizing and blending sounds, rhyming, and discriminating phonemes within words, adjusting to each student’s ability level. The software is supported by music, audiocassettes, and videotapes, and includes picture/word cards, letter–sound decks, big books, little books, and leveled readers for reading independently or in groups.
Intervention Report 1 3
Early Intervention in Reading (EIR)® (Beginning Reading) (November 2008)
Early Intervention in Reading (EIR)® is a program designed to provide extra instruction to groups of students at risk of failing to learn to read. The program uses picture books to stress instruction in phonemic awareness, phonics, and contextual analysis, along with repeated reading and writing. In grades K–2, the program includes whole-class instruction followed by small-group instruction for students who score low on oral reading and literacy skills. In grades 3 and 4, the program consists of small group instruction for 20 minutes, 4 days a week. Teachers are trained for 9 months using workshops and an Internet-based professional development program.
Intervention Report 6-8 3
Accelerated Middle Schools (Dropout Prevention) (July 2008)
Accelerated middle schools are self-contained academic programs designed to help middle school students who are behind grade level catch up with their peers. The program aims to ensure students stay in school and graduate by encouraging them to begin high school with other students their age. The programs serve students who are one to two years behind grade level, giving students the opportunity to cover an additional year of curriculum over 1–2 years in the program. Accelerated middle schools can be structured as separate schools or as schools within a traditional middle school.
Intervention Report 11-12 3
Job Corps (Dropout Prevention) (April 2008)
Job Corps, a federally funded education and job training program for economically disadvantaged youth, offers remedial education, GED (General Educational Development) preparation, vocational training, job placement assistance, and other supports. Job Corps participants typically reside in a Job Corps center while enrolled in the program and can remain in the program for up to 2 years.
Intervention Report 11-12 3
JOBSTART (Dropout Prevention) (March 2008)
JOBSTART is an alternative education and training program designed to improve the economic prospects of young, disadvantaged high school dropouts by increasing educational attainment and developing occupational skills. The program has four main components: (1) basic academic skills instruction with a focus on GED (General Educational Development) preparation, (2) occupational skills training, (3) training-related support services (such as transportation assistance and child care), and (4) job placement assistance. Participants receive at least 200 hours of basic education and 500 hours of occupational training.
Intervention Report 10-PS 3
New Chance (Dropout Prevention) (January 2008)
New Chance, a program for young welfare mothers who have dropped out of school, aims to improve both their employment potential and their parenting skills. Participants take GED (General Educational Development) preparation classes and complete a parenting and life skills curriculum. Once they complete this first phase of the program, they can receive occupational training and job placement assistance from New Chance, which also offers case management and child care.
Intervention Report PK-K 3
Ladders to Literacy (Beginning Reading) (August 2007)
Ladders to Literacy is a supplemental early literacy curriculum published in Ladders to Literacy: A Kindergarten Activity Book. The program targets children at different levels and from diverse cultural backgrounds. The activities are organized into three sections with about 20 activities each: print awareness, phonological awareness skills, and oral language skills.
Intervention Report K 3
Voyager Universal Literacy System® (Beginning Reading) (August 2007)
The Voyager Universal Literacy System® is a core reading program designed to help students learn to read at or above grade level by the end of grade 3. This program uses strategies such as individual reading instruction, higher-level comprehension activities, problem solving, and writing. Students are also exposed to computer-based practice and reinforcement in phonological skills, comprehension, fluency, language development, and writing. The program uses whole classroom, small group, and independent group settings. Voyager Universal Literacy System® emphasizes regular assessments, with biweekly reviews for struggling students and quarterly assessments for all students.
Intervention Report K 3
Waterford Early Reading Program (Beginning Reading) (July 2007)
Waterford Early Reading Program™ is a software-based curriculum for students in kindergarten through grade 2. The curriculum is designed to promote reading, writing, and typing, incorporating literacy skills such as letter mastery, language stories, spelling, basic writing skills, reading and listening development, and comprehension strategies. It can be used as a supplement to the regular reading curriculum. Program materials include classroom lessons and take-home materials in addition to the Waterford software. Waterford Early Reading Program™ offers pretest placement and posttest assessments, in addition to ongoing assessments throughout the program.
Intervention Report 1-4 3
ClassWide Peer Tutoring (Beginning Reading) (July 2007)
ClassWide Peer Tutoring (CWPT) is a peer-assisted instructional strategy designed to be integrated with most existing reading curricula. This approach provides students with increased opportunities to practice reading skills by asking questions and receiving immediate feedback from a peer tutor. Pairs of students take turns tutoring each other to reinforce concepts and skills initially taught by the teacher. The teacher creates age-appropriate peer teaching materials for the peer tutors; these materials take into account tutees’ language skills and disabilities.
Intervention Report 1-6 3
Peer Tutoring and Response Groups (English Language Learners) (July 2007)
Peer Tutoring and Response Groups aims to improve the language and achievement of English learners by pairing or grouping students to work on a task. The students may be grouped by age or ability, or the groups may be mixed. Peer tutoring typically consists of two students assuming the roles of tutor and tutee, or “coach and player” roles. Peer response groups give four or five students shared responsibility for a task, such as editing a passage or reading and answering comprehension questions. Both peer tutoring pairs and peer response groups emphasize peer interaction and discussion to complete a task.
Intervention Report 3 3
Failure Free Reading (Beginning Reading) (July 2007)
Failure Free Reading is a language development program designed to improve vocabulary, fluency, word recognition, and reading comprehension for students in kindergarten through grade 12 who score in the bottom 15% on standardized tests and who have not responded to conventional beginning reading instruction. The three key dimensions of the program are: 1) repeated exposure to text, 2) predictable sentence structures, and 3) story concepts that require minimal prior knowledge. The program combines systematic, scripted teacher instruction; talking software; workbook exercises; and independent reading activities.
Intervention Report 3 3
Wilson Reading System® (Beginning Reading) (July 2007)
The Wilson Reading System® is a reading and writing program. It provides a curriculum for teaching reading and spelling to individuals of any age who have difficulty with written language. The Wilson Reading System® directly teaches the structure of words in the English language, aiming to help students learn the coding system for reading and spelling. The program provides interactive lesson plans and uses a sequential system with extensive controlled text. The Wilson Reading System® is structured to progress from phoneme segmentation to more challenging tasks, and seeks to improve sight word knowledge, fluency, vocabulary, oral expressive language development, and reading comprehension.
Intervention Report 5-6 3
SpellRead (Beginning Reading) (July 2007)
SpellRead™ (formerly known as SpellRead Phonological Auditory Training®) is a literacy program for struggling readers in grade 2 or above, including special education students, English language learners, and students more than 2 years below grade level in reading. SpellRead integrates the auditory and visual aspects of the reading process and emphasizes specific skill mastery through systematic and explicit instruction. Students are taught to recognize and manipulate English sounds; to practice, apply, and transfer their skills using texts at their reading level; and to write about their reading.
Intervention Report 3-5 3
Corrective Reading (Beginning Reading) (July 2007)
Corrective Reading is designed to promote reading accuracy (decoding), fluency, and comprehension skills of students in grade 3 or higher who are reading below their grade level. The program has four levels that correspond to students’ decoding skills. All lessons in the program are sequenced and scripted. Corrective Reading can be implemented in small groups of 4–5 students or in a whole-class format. Corrective Reading is intended to be taught in 45-minute lessons 4–5 times a week.
Intervention Report 2 3
Fluency Formula (Beginning Reading) (June 2007)
Fluency Formula™ is a supplemental curriculum designed to promote reading fluency in grades 1–6. The program emphasizes automatic recognition of words, decoding accuracy, and oral expressiveness as the foundations for building reading fluency. A daily 10- to 15-minute lesson is delivered in the classroom. Students participate in whole-class, small-group, and individual practice activities using workbooks, read-aloud anthologies, library books, fluency activity cards, and audio CDs. The curriculum encourages at-home practice and includes a Fluency Formula™ Assessment System, which allows teachers to assess student fluency using 1-minute grade-level passages and a timer.
Intervention Report 1-2 3
Start Making a Reader Today® (SMART®) (Beginning Reading) (June 2007)
Start Making a Reader Today® (SMART®) is a volunteer tutoring program for students in grades K–2 who are at risk of reading failure. The program is designed to be a low-cost, easy-to-implement intervention. Volunteer tutors go into schools where at least 40% of students are eligible for free or reduced-price lunch and read one-on-one with students twice a week for 30 minutes. Typically, one volunteer works with two students on four types of activities: reading to the student, reading with the student, re-reading with the student, and asking the student questions about what has been read. The program also gives each student two new books a month to encourage families to read together.
Intervention Report K 3
Stepping Stones to Literacy (Beginning Reading) (June 2007)
Stepping Stones to Literacy (SSL) is a supplemental curriculum designed to promote listening, print conventions, phonological awareness, phonemic awareness, and serial processing/rapid naming (quickly naming familiar visual symbols and stimuli, such as letters or colors). The program targets older preschool and kindergarten students who are considered to be underachieving readers, based on teacher’s recommendations, assessments, and systematic screening. Students participate in 10- to 20-minute daily lessons in a small group or individually. The curriculum consists of 25 lessons, for a total of 9–15 hours of instructional time.
Intervention Report 1 3
Read, Write & Type! (Beginning Reading) (May 2007)
Read, Write & Type!™ Learning System is a software program with supporting materials designed to teach beginning reading skills by emphasizing writing as a way to learn to read. The program was developed for students ages 6–9 years who are just beginning to read, and for students who are struggling readers and writers. The main goal of Read, Write & Type!™ is to help students develop an awareness of the 40 English phonemes and the ability to associate each phoneme with a letter or a combination of letters and a finger stroke on the keyboard. Other goals of the program include identifying phonemes in words; and fluency in sounding out, typing, and reading regularly spelled words.
Intervention Report 12 3
Building Decision Skills (Character Education) (April 2007)
Building Decision Skills aims to raise middle and high school students’ awareness of ethics, help them gain experience developing core values, and give them strategies for dealing with ethical dilemmas. Building Decision Skills consists of 10 lessons that can fill 2 consecutive weeks of daily lessons or be drawn out over a longer period. Using readings, handouts, and overheads, the teacher covers key concepts. Students are encouraged to think about the key concepts through small-group activities, class discussions, and homework assignments. The program also includes schoolwide components such as group discussions, seminars, and assemblies, and can be combined with service learning.
Intervention Report K 3
Little Books (Beginning Reading) (April 2007)
The Little Books are a set of books designed for interactive book reading between parents and children or between teachers and students. The books use thematic topics familiar to children. They are written with high-frequency words and use simple phrases and sentences. The books also have strong links between illustrations and text.
Intervention Report 9-12 3
High School Redirection (Dropout Prevention) (April 2007)
High School Redirection is an alternative high school program for youth considered at risk of dropping out. The program emphasizes basic skills development (with a particular focus on reading skills) and offers limited extra-curricular activities. The schools operate in economically disadvantaged areas and serve students who have dropped out in the past, who are teen parents, who have poor test scores, or who are over-age for their grade. To foster a sense of community, the schools are small, and teachers are encouraged to act as mentors as well as instructors.
Intervention Report K-6 3
Caring School Community (CSC) (Character Education) (April 2007)
Caring School Community™ (CSC) is a modified version of a program formerly known as the Child Development Project. CSC is a multiyear school improvement program that involves all students in grades K–6. The program aims to promote core values, prosocial behavior, and a schoolwide feeling of community. The program consists of four elements originally developed for the Child Development Project: class meeting lessons, cross-age “buddies” programs, “homeside” activities, and schoolwide community. Class lessons provide teachers and students with a forum to get to know one another, discuss issues, identify and solve problems collaboratively, and make a range of decisions that affect classroom life. Cross-age buddies activities pair whole classes of older and younger students for academic and recreational activities that build caring cross-age relationships and create a schoolwide climate of trust. Homeside activities include short conversational activities that are sent home with students for them to do with parents or caregivers and then to discuss back in their classroom. The activities incorporate the families’ perspectives, cultures, and traditions, thereby promoting interpersonal understanding. Schoolwide community-building activities bring students, parents, and school staff together to create new school traditions.
Intervention Report K-6 3
Positive Action (Character Education) (April 2007)
Positive Action, at its core, teaches the philosophy that you feel good about yourself when you do positive actions and there is always a positive way to do everything. It is illustrated by the the Thoughts-Actions-Feelings about self Circle where positive thoughts lead to positive actions, which in turn lead to positive feelings about oneself. It also teaches the positive actions for physical, intellectual, social and emotional areas—the whole self. It is a Pre-K-12 school-based program that aims to promote good behavior while disrupting problem behaviors, improves academics, and develops social-emotional and character skills while improving mental and physical health and self-concept. Lessons are scripted and use a wide variety of strategies: classroom discussion, role-play, games, songs, journals, manipulatives and activity sheets and text booklets.
Intervention Report 8 3
Twelve Together (Dropout Prevention) (March 2007)
Twelve Together is a 1-year peer support and mentoring program for middle and early high school students that offers weekly after-school discussion groups led by trained volunteer adult facilitators. Each peer discussion group consists of about 12 participants who are a mix of students at high- and low-risk of academic failure. Group discussions are based on topics of student interest, usually focusing on personal, family, and social issues. The program also offers homework assistance, trips to college campuses, and an annual weekend retreat.
Intervention Report 2-3 3
Bilingual Cooperative Integrated Reading and Composition (BCIRC) (English Language Learners) (February 2007)
The Bilingual Cooperative Integrated Reading and Composition (BCIRC) program, an adaptation of the Cooperative Integrated Reading and Composition (CIRC) program, was designed to help Spanish-speaking students succeed in reading Spanish and then making a successful transition to English reading. In the adaptation, students complete tasks that focus on reading, writing, and language activities in Spanish and English, while working in small cooperative learning groups. The intervention focuses on students in grades 2–5.
Intervention Report 11-12 3
Financial Incentives for Teen Parents to Stay in School (Dropout Prevention) (December 2006)
Financial incentives for teen parents are components of state welfare programs intended to encourage enrollment, attendance, and completion of high school as a means of increasing employment and earnings and reducing welfare dependence. The incentives take the form of bonuses and sanctions to the welfare grant related to school enrollment, performance, and completion. The programs typically provide case management and social services to supplement financial incentives.
Intervention Report 11-12 3
Talent Search (Dropout Prevention) (December 2006)
Talent Search aims to help low-income and first-generation college students (those whose parents do not have 4-year college degrees) complete high school and gain access to college through a combination of services designed to improve academic achievement and increase access to financial aid. Services include test taking and study skills assistance, academic advising, tutoring, career development, college campus visits, and financial aid application assistance.
Intervention Report 2-5 3
Instructional Conversations and Literature Logs (English Language Learners) (October 2006)
The goal of Instructional Conversations is to help English learners develop reading comprehension ability along with English language proficiency. Acting as facilitators, teachers engage students in discussions about stories, key concepts, and related personal experiences, allowing students to appreciate and build on each others’ experiences, knowledge, and understanding. Literature Logs require students to respond in writing to prompts or questions related to sections of stories. These responses are then shared in small groups or with a partner.
Intervention Report 8 3
The Expert Mathematician (Middle School Mathematics) (October 2006)
The Expert Mathematician is designed to help middle school students develop the thinking processes for mathematical applications and communication. A 3-year program of instruction, The Expert Mathematician uses a software and print materials package with 196 lessons that teach the Logo programming language. Each lesson ranges from 40–120 minutes. A test of unit concepts is administered at the end of each instructional unit. The curriculum covers general mathematics, pre-algebra, and algebra I.
Intervention Report 7-9 3
ALAS (Dropout Prevention) (October 2006)
ALAS (Spanish for “wings”) is an intervention for middle and high school students that is designed to address student, school, family, and community factors that affect dropping out. Each student is assigned a counselor/mentor who monitors attendance, behavior, and academic achievement. The counselor/mentor provides feedback and coordinates interventions and resources to students, families, and teachers. Counselors/mentors also serve as advocates for students and intervene when problems are identified. Students are trained in problem-solving, self-control, and assertiveness skills. Parents are trained in parent-child problem solving, how to participate in school activities, and how to contact teachers and school administrators to address issues.
Intervention Report 5 3
Vocabulary Improvement Program for English Language Learners and Their Classmates (VIP) (English Language Learners) (October 2006)
The Vocabulary Improvement Program for English Language Learners and Their Classmates (VIP) is a vocabulary development curriculum for English language learners and native English speakers in grades 4–6. The 15-week program includes 30–45 minute whole class and small group activities that aim to increase students’ understanding of target vocabulary words included in a weekly reading assignment.
Intervention Report 4-5 3
Lessons in Character (Character Education) (September 2006)
Lessons in Character is designed to promote elementary and middle school students’ knowledge about core character education values and, through that knowledge, shape children’s positive behaviors and support academic success. It consists of 24 lessons organized around weekly themes, writing activities, and class projects. Teachers introduce the theme with a story that shows a value in action; students then engage that topic with a variety of activities. The program also includes daily oral language development and weekly writing assignments, optional parts of the program’s implementation.
Intervention Report 8 3
Facing History and Ourselves (Character Education) (September 2006)
Facing History and Ourselves aims to promote core character education values and to help middle and high school students develop moral reasoning skills. Students examine historical events; in particular, the events that led to World War II and the Holocaust. Teachers participate in professional development seminars and apply the content and approaches to their own teaching or school program. Facing History and Ourselves also includes optional schoolwide components (such as guest speakers and videos).
Intervention Report 3 3
Too Good For Violence (TGFV) (Character Education) (September 2006)
Too Good for Violence promotes character values, social-emotional skills, and healthy beliefs in elementary and middle school students. The program includes seven lessons per grade level for elementary school (K–5) and nine lessons per grade level for middle school (6–8). All lessons are scripted and engage students through role-playing and cooperative learning games, small group activities, and classroom discussions. Students are encouraged to apply these skills to different contexts. Too Good for Violence also includes optional parental and community involvement elements.
Intervention Report 3-12 3
Connect with Kids (Character Education) (September 2006)
Connect with Kids aims to promote prosocial attitudes and positive behavior of elementary (grades 3–5) and secondary (grades 6–12) school students by teaching core character values. Lesson plans include videos, story summaries, discussion questions, student games, and activities for both core and supplemental character traits. The classroom curriculum is reinforced by a website component and schoolwide and community outreach components. The program can be incorporated into an existing curriculum or used as a standalone program. The school or teacher decides on the number of character traits covered in each session, so the program duration may vary from one semester to an entire academic year.
Intervention Report 3-6 3
Too Good for Drugs (TGFD) (Character Education) (September 2006)
Too Good for Drugs™ is designed to promote elementary and middle school students’ life skills, character values, resistance skills to negative peer influence, and resistance to the use of illegal drugs, alcohol, and tobacco. The program is based on classroom discussions and structured activities that center on interactive learning and skill-building exercises. Students engage in role-play and cooperative learning games and are encouraged to apply the skills to different contexts. Too Good for Drugs™ also includes the optional elements of parental and community involvement.
Intervention Report 1 3
Enhanced Proactive Reading (English Language Learners) (September 2006)
Enhanced Proactive Reading, a comprehensive, integrated reading, language arts, and English language development curriculum, is targeted to first-grade English learners experiencing problems with learning to read through conventional instruction. The curriculum is implemented as small group daily reading instruction, during which instructors provide opportunities for participation from all students and give feedback on student responses.
Intervention Report K-5 3
Reading Mastery (English Language Learners) (September 2006)
Reading Mastery is designed to provide systematic reading instruction to students in grades K–6. Reading Mastery can be used as an intervention program for struggling readers, as a supplement to a school’s core reading program, or as a stand-alone reading program, and is available in three versions. During the implementation of Reading Mastery, students are grouped with other students at a similar reading level, based on program placement tests. The program includes a continuous monitoring component.
Intervention Report PK-1 3
DaisyQuest (Beginning Reading) (September 2006)
DaisyQuest is a software bundle that offers computer-assisted instruction in phonological awareness, targeting children 3–7 years old (or preschool to grade 2). The instructional activities, framed in a fairy tale involving a search for a friendly dragon named Daisy, teach children how to recognize words that rhyme; words that have the same beginning, middle, and ending sounds; and words that can be formed from a series of phonemes presented separately. Activities also teach children how to count the number of sounds in words.
Intervention Report PK-1 3
DaisyQuest (Early Childhood Education) (September 2006)
DaisyQuest is a software bundle that offers computer-assisted instruction in phonological awareness, targeting children 3–7 years old (or preschool to grade 2). The instructional activities, framed in a fairy tale involving a search for a friendly dragon named Daisy, teach children how to recognize words that rhyme; words that have the same beginning, middle, and ending sounds; and words that can be formed from a series of phonemes presented separately. Activities also teach children how to count the number of sounds in words.
Intervention Report 9-12 3
Too Good for Drugs and Violence (TGFD & V) (Character Education) (September 2006)
Too Good for Drugs and Violence is designed to promote high school students’ pro-social skills, positive character traits, and violence- and drug-free norms. The curriculum consists of 14 core lessons, as well as an additional 12 lessons that can be infused into other subject areas (such as English, science, and social studies). Teachers participate in 10 staff development lessons. The program includes optional elements of family and community involvement.
Intervention Report K 3
Arthur (English Language Learners) (September 2006)
Arthur, is a book-based educational television program designed for children ages 4–8. The program is based on the storybooks by Marc Brown about Arthur, an 8-year-old aardvark. Each show is 30 minutes in length and includes two stories involving characters dealing with moral issues. The show has been used as a listening comprehension and language development intervention for English language learning students.
Intervention Report K-10 3
Fast ForWord® (English Language Learners) (September 2006)
Fast ForWord® is a computer-based reading program intended to help students develop and strengthen the cognitive skills necessary for successful reading and learning. The program, which is designed to be used 30 to 100 minutes a day, five days a week, for 4 to 16 weeks, includes two components.
Intervention Report 3-8 -1
Leadership and Assistance for Science Education Reform (LASER) (Science) (September 2021)
The Leadership and Assistance for Science Education Reform (LASER) program is intended to build capacity for implementing inquiry-based science curricula in schools and districts. When participating in LASER, school or district teams attend leadership development institutes to plan the implementation of inquiry-based science curricula. These school or district teams receive support for key aspects of implementation such as professional development for teachers, access to instructional materials, and support for selecting appropriate assessments. LASER also helps schools and districts partner with scientists, science educators, and local business and community leaders who can promote and further support the implementation of inquiry-based science instruction.
Intervention Report 1-2 -1
Math Expressions (Primary Mathematics) (May 2021)
Math Expressions is a curriculum for students in prekindergarten through sixth grade that aims to build students’ conceptual understanding of mathematics and to develop fluency in mathematical problem solving and computation. The curriculum encourages student learning of mathematics through real-world situations, visual supports such as drawings and manipulatives, multiple approaches to solving problems, and opportunities for students to explain their mathematical thinking.
Intervention Report 6-9 -1
University of Chicago School Mathematics Project (UCSMP) Transitions/Pre-transitions Math (Primary Mathematics) (May 2021)
University of Chicago School Mathematics Project (UCSMP) is a core mathematics curriculum that includes materials and a routinized instructional approach with an option for teacher training. The curriculum uses an inquiry-based approach with a focus on active learning where students frequently engage in hands-on activities and small-group activities. Pre-Transition Mathematics teaches arithmetic, algebra, geometry, probability, and statistics. Transition Mathematics teaches more advanced arithmetic, algebra, and geometry, and connects these areas to measurement, probability, and statistics.
Intervention Report 9 -1
Xtreme Reading (Adolescent Literacy) (March 2021)
Xtreme Reading is a supplemental literacy curriculum designed to improve the literacy skills of struggling students in grades 6 to 12. The curriculum is primarily designed to help students improve their vocabulary, decoding, fluency, and reading comprehension skills. To ensure a productive learning environment, students initially learn social skills associated with creating a supportive learning community, including how to participate in certain class activities (for example, whole-group discussion, small-group work, partner work, transitions). They also participate in a motivational program whereby they discuss their hopes and dreams for the future and set personal goals related to reading and other life areas. The Xtreme Reading program includes teacher-led whole-group instruction, cooperative group work, paired practice, and independent practice.
Intervention Report 4-8 -1
Literacy Design Collaborative (Teacher Training, Evaluation, and Compensation) (March 2021)
Literacy Design Collaborative provides professional development, coaching, and resources to support teachers to work collaboratively in their schools to design and use high-quality, standards-aligned literacy instruction materials aimed at building students’ reading, research, and writing skills. Literacy Design Collaborative guides teachers to implement literacy modules they can use to teach students the content and literacy skills needed to complete a culminating writing task. Teachers implement existing modules and design new ones. Teachers across content areas—including English language arts, social studies, and science—can use the Literacy Design Collaborative program.
Intervention Report 1-5 -1
Promoting Alternative THinking Strategies (PATHS) (Supportive Learning Environment Interventions Review Protocol ) (March 2021)
The Promoting Alternative THinking Strategies (PATHS®) program is a curriculum that aims to promote emotional and social competencies and to reduce aggression and behavior problems in elementary school children. PATHS® is delivered through short lessons given two to three times a week over the school year. The program is based on the principle that understanding and regulating emotions are central to effective problem solving. The lessons focus on (1) self-control, (2) emotional literacy, (3) social competence, (4) positive peer relations, and (5) interpersonal problem-solving skills. There is a separate curriculum for each grade.
Intervention Report 4-7 -1
Word Generation (English Learner (EL)) (April 2020)
Word Generation is a supplemental program that aims to improve students’ reading comprehension by building students’ vocabulary, academic language, and perspective-taking skills through classroom discussion and debate. Word Generation was developed for all students; however, English learners in particular could benefit from its focus on academic language. Word Generation consists of a series of interdisciplinary units with daily lessons focused on a high-interest issue to increase student engagement. Each unit targets a small number of academic vocabulary words that are integrated into texts, activities, writing tasks, debates, and discussions across content areas. Several Word Generation programs exist. In the Word Generation Weekly (WordGen Weekly) and Word Generation Elementary (WordGen Elementary) programs, units are intended to be used across English language arts, math, science, and social studies in grades 6–8 and grades 4 and 5, respectively. In the Science Generation (SciGen) and Social Studies Generation (SoGen) programs, units can supplement or be used in place of regular science and social studies curriculum units in grades 6–8. The different Word Generation programs can be implemented separately or together.
Intervention Report 6-9 -1
Passport Reading Journeys (Adolescent Literacy) (November 2019)
Passport Reading Journeys is a supplemental literacy curriculum designed to help improve reading comprehension, vocabulary, word study, and writing skills of struggling readers in grades 6–12. Lessons incorporate both teacher-led instruction and technology, including whole-class and small-group instruction, independent reading, video segments, and independent computer-based practice. The curriculum includes a series of two-week, ten-lesson instructional sequences on topics in science, math, fine art, literature, and social studies. Each sequence is themed as an expedition or journey for students.
Intervention Report 3-8 -1
National Board for Professional Teaching Standards (NBPTS) Certification (Teacher Training, Evaluation, and Compensation) (February 2018)
The National Board for Professional Teaching Standards (NBPTS) establishes standards for accomplished teachers and awards professional certification to teachers who can demonstrate that their teaching practices meet those standards. Educators and experts in child development and related fields established the organization, and these experts work to develop and refine the standards for accomplished teaching based on the knowledge and skills that effective teachers demonstrate. The standards reflect five core propositions: (1) effective teachers are committed to students and their learning, (2) effective teachers know the subjects they teach and how to teach those subjects to students, (3) effective teachers manage and monitor student learning, (4) effective teachers think systematically about their practice and learn from experience, and (5) effective teachers are members of learning communities. Those seeking certification from the NBPTS must complete a computer-based assessment and three portfolio entries. The certification process can take 1 to 5 years.
Intervention Report 2-9 -1
Achieve3000 (Beginning Reading) (February 2018)
Achieve3000® is a supplemental online literacy program that provides nonfiction reading content to students in grades preK–12 and focuses on building phonemic awareness, phonics, fluency, reading comprehension, vocabulary, and writing skills. Achieve3000® is designed to help students advance their nonfiction reading skills by providing differentiated online instruction. Teachers use the program with an entire class but the assignments are tailored to each student’s reading ability level. For example, teachers assign an article and related activities to an entire class; the program then tailors the version of the article to each student by automatically increasing the difficulty of text when a student is ready for more challenging text. Achieve3000® provides lessons that follow a five-step routine: (1) respond to a Before Reading Poll, (2) read an article, (3) answer activity questions, (4) respond to an After Reading Poll, and (5) answer a Thought Question. Progress reports and student usage data, provided by the online tool, enable teachers to track both whole-class and individual student progress. The program is designed for diverse student groups, including general education students, struggling readers in need of intensive tutoring, and English learners.
Intervention Report 4 -1
System of Least Prompts (Children and Students with Intellectual Disability) (January 2018)
System of Least Prompts (SLP) is a practice that involves defining and implementing a hierarchy of prompts to assist students in learning a skill. A prompt is an action by the teacher or other practitioner—such as a verbal instruction to complete a task—that helps a student respond correctly during a learning activity. To use the procedure, the teacher or other practitioner systematically delivers the prompts to students in order, starting with the prompt that provides the least amount of assistance, and providing additional prompts with increasing levels of assistance until the student can correctly perform the task independently. For example, if a student does not independently complete a task following the initial instruction, a teacher may help the student by providing the least-intrusive prompt, such as restating the instruction. If the response still does not occur, the teacher may present the next most intrusive prompt, such as rephrasing the instruction. The teacher continues with more intrusive prompts, such as modeling how to do the task, until the desired response occurs reliably or all the prompts in the sequence have been used. The last prompt, often called the controlling prompt, should result in the student responding correctly. SLP is also known as “least-to-most prompting” or “least intrusive prompts.” SLP does not have a single developer that provides guidance or materials.
Intervention Report 2-9 -1
Accelerated Math® (Primary Mathematics) (December 2017)
Accelerated Math®, published by Renaissance Learning, is a software tool that provides practice problems for students in grades K–12 and provides teachers with reports to monitor student progress. Accelerated Math® creates individualized student assignments, scores the assignments, and generates reports on student progress. The software is typically used with the math curriculum being used in the classroom to add practice for students and help teachers differentiate instruction through the program’s progress-monitoring data.
Intervention Report 2-9 -1
Accelerated Math® (Secondary Mathematics) (December 2017)
Accelerated Math®, published by Renaissance Learning, is a software tool that provides practice problems for students in grades K–12 and provides teachers with reports to monitor student progress. Accelerated Math® creates individualized student assignments, scores the assignments, and generates reports on student progress. The software is typically used with the math curriculum being used in the classroom to add practice for students and help teachers differentiate instruction through the program’s progress-monitoring data.
Intervention Report 7-10 -1
Prentice Hall/Pearson Literature (c)2007, 2010, 2012, 2015 (Adolescent Literacy) (November 2017)
Prentice Hall/Pearson Literature© (2007–15) is an English language arts curriculum designed for students in grades 6–12 that focuses on building reading, vocabulary, literary analysis, and writing skills. It uses passages from fiction and nonfiction texts, poetry, and contemporary digital media. The curriculum is based on a textbook. The publisher also provides online components and other materials that enable teachers to provide personalized assignments, monitor students’ progress, and score writing assignments, enrich instruction, or provide additional practice to supplement the textbook.
Intervention Report 8 -1
I CAN Learn® Algebra (Secondary Mathematics) (August 2017)
I CAN Learn® is a computer-based math curriculum for students in middle school, high school, and college. It provides math instruction through a series of interactive lessons that students work on individually at their own computers. Students move at their own pace and must demonstrate mastery of each concept before progressing to the next one. Classroom teachers may provide individual, small-group, or whole-class instruction based on students’ performance on the software program.
Intervention Report 6-12 -1
TNTP Teaching Fellows (Teacher Training, Evaluation, and Compensation) (June 2017)
TNTP Teaching Fellows is a highly selective route to teacher certification that aims to prepare people to teach in high-need public schools. The program recruits professionals seeking to change careers and recent college graduates who are not certified teachers. TNTP Teaching Fellows expects its participants to teach for many years, but does not require them to make a minimum time commitment to teaching. Program participants complete online coursework and receive 5–7 weeks of in-person training focused on foundational teaching skills during the summer before they begin teaching. They must demonstrate mastery of these core skills to be eligible to teach. They receive continued professional development and coaching from TNTP Teaching Fellows during their first year of teaching, and additional support provided by their schools and districts. As full-time employees of the public schools in which they work, new TNTP Teaching Fellows teachers receive the same salary and benefits as other beginning teachers in their school district.
Intervention Report 1-8 -1
Saxon Math (Primary Mathematics) (May 2017)
Saxon Math is a curriculum for students in grades K–12. The amount of new math content students receive each day is limited and students practice concepts every day. New concepts are developed, reviewed, and practiced cumulatively rather than in discrete chapters or units.
Intervention Report 6-8 -1
Connected Mathematics Project (CMP) (Primary Mathematics) (February 2017)
Connected Mathematics Project (CMP) is a math curriculum for students in grades 6–8. It uses interactive problems and everyday situations to explore mathematical ideas, with a goal of fostering a problem-centered, inquiry-based learning environment. At each grade level, the curriculum covers numbers, algebra, geometry/measurement, probability, and statistics.
Intervention Report 9-12 -1
Cognitive Tutor® Geometry (Secondary Mathematics) (June 2016)
Cognitive Tutor®, published by Carnegie Learning, is a math curricula that combines textbooks and interactive software.
Intervention Report K-8 -1
Accelerated Reader (Beginning Reading) (June 2016)
Accelerated Reader™ is a computerized supplementary reading program that provides guided reading instruction to students in grades K–12. It aims to improve students’ reading skills through reading practice and by providing frequent feedback on students’ progress to teachers. The Accelerated Reader™ program requires students to select and read a book based on their area of interest and reading level. Upon completion of a book, students take a computerized quiz based on the book’s content and vocabulary. Quiz performance allows teachers to monitor student progress and to identify students who may need additional reading assistance.
Intervention Report 6-9 -1
Saxon Algebra I (Secondary Mathematics) (May 2016)
Saxon Math is a textbook series covering grades K–12 based on incremental development and continual review of mathematical concepts to give students time to learn and practice concepts throughout the year. The program is built on the premise that students learn best when instruction is incremental and explicit, previously learned concepts are continually reviewed, and assessment is frequent and cumulative. At each grade level, math concepts are introduced, reviewed, and practiced over time in order to move students from understanding to fluency.
Intervention Report 5-7 -1
SuccessMaker® (Adolescent Literacy) (November 2015)
The SuccessMaker program is a set of computer-based courses used to supplement regular classroom reading instruction in grades K–8. Using adaptive lessons tailored to a student’s reading level, SuccessMaker aims to improve understanding in areas such as phonological awareness, phonics, fluency, vocabulary, comprehension, and concepts of print.
Intervention Report PK-12 -1
TAP: The System for Teacher and Student Advancement (Teacher Training, Evaluation, and Compensation) (July 2015)
TAP™ (formerly known as the Teacher Advancement Program) is a comprehensive educator effectiveness program that aims to improve student achievement through supports and incentives that attract, retain, develop, and motivate effective teachers. The program provides teachers with leadership opportunities and associated salary increases; ongoing, school-based professional development; rigorous evaluations; and annual performance bonuses based on a combination of teacher value added to student achievement and observations of their classroom teaching.
Intervention Report K-6 -1
New Teacher Center Induction Model (Teacher Training, Evaluation, and Compensation) (July 2015)
The New Teacher Center (NTC) Induction Model is a comprehensive and systemic approach to support beginning teachers (i.e., teachers new to the profession). The induction model aims to accelerate the effectiveness of beginning teachers at increasing student learning by providing one-on-one mentoring and professional development in a supportive school environment. The NTC works with school districts and state departments of education to design, develop, and implement induction programs that are aligned with both district priorities and NTC standards.
Intervention Report K-5 -1
Reading Mastery (Beginning Reading) (November 2013)
Reading Mastery is designed to provide systematic reading instruction to students in grades K–6. Reading Mastery can be used as an intervention program for struggling readers, as a supplement to a school’s core reading program, or as a stand-alone reading program, and is available in three versions. During the implementation of Reading Mastery, students are grouped with other students at a similar reading level, based on program placement tests. The program includes a continuous monitoring component.
Intervention Report 4-12 -1
Reciprocal Teaching (Students with Learning Disabilities) (November 2013)
Reciprocal teaching is an interactive instructional practice that aims to improve students’ reading comprehension by teaching strategies to obtain meaning from a text. The teacher and students take turns leading a dialogue regarding segments of the text. Students discuss with their teacher how to apply four comprehension strategies—generating questions, summarizing, clarifying, and predicting—to passages of text. During the early stages of reciprocal teaching, the teacher assumes primary responsibility for modeling how to use these strategies. As students become more familiar with the strategies, there is a gradual shift toward student responsibility for talking through the application of the strategies to the text.
Intervention Report 1-5 -1
Scott Foresman-Addison Wesley Elementary Mathematics (Elementary School Mathematics) (May 2013)
Scott Foresman-Addison Wesley Elementary Mathematics is a core curriculum for students at all ability levels in kindergarten through grade 6. The program supports students’ understanding of key math concepts and skills, and it covers a range of mathematical content across grades. The curriculum focuses on questioning strategies, problem-solving skills, embedded assessment, and exercises tailored to students of different ability levels. The program provides explicit problem-solving instruction, hands-on activities, and opportunities to extend students’ mathematical understanding through reading and writing connections.
Intervention Report 1-8 -1
Saxon Math (Elementary School Mathematics) (May 2013)
Saxon Math is a curriculum for students in grades K–12. The amount of new math content students receive each day is limited and students practice concepts every day. New concepts are developed, reviewed, and practiced cumulatively rather than in discrete chapters or units.
Intervention Report 2-6 -1
Read Naturally® (Adolescent Literacy) (March 2013)
Read Naturally is an elementary and middle school supplemental reading program designed to improve reading fluency using a combination of books, audiotapes, and computer software. The program has three main strategies: repeated reading of text for developing oral reading fluency, teacher modeling of story reading, and systematic monitoring of student progress by teachers and the students themselves. Students work at a reading level appropriate for their achievement level, progress through the program at their own rate, and, for the most part, work on an independent basis. Read Naturally® can be used in a variety of settings, including classrooms, resource rooms, or computer or reading labs. Although the program was not originally developed for English language learners, additional materials for these students are currently available.
Intervention Report PK-K -1
Ladders to Literacy (Early Childhood Education) (March 2013)
Ladders to Literacy is a supplemental early literacy curriculum published in Ladders to Literacy: A Kindergarten Activity Book. The program targets children at different levels and from diverse cultural backgrounds. The activities are organized into three sections with about 20 activities each: print awareness, phonological awareness skills, and oral language skills.
Intervention Report K-10 -1
Fast ForWord® (Beginning Reading) (March 2013)
Fast ForWord® is a computer-based reading program intended to help students develop and strengthen the cognitive skills necessary for successful reading and learning. The program, which is designed to be used 30 to 100 minutes a day, five days a week, for 4 to 16 weeks, includes two components.
Intervention Report 1-5 -1
Investigations in Number, Data, and Space® (Elementary School Mathematics) (February 2013)
Investigations in Number, Data, and Space is an activity-based, K–5 mathematics curriculum designed to help students understand number and operations, geometry, data, measurement, and early algebra. Each instructional unit focuses on a particular content area and lasts for 2–5.5 weeks. The curriculum encourages students to develop their own strategies for solving problems and engage in discussion about their reasoning and ideas. The lessons are activity-based in order to facilitate increased comprehension of basic math fundamentals. The curriculum is presented through a series of resource books called ”curriculum units” that provide teachers with guidance on implementation. One or more of the units for each year has a software program associated with it. Other materials include manipulatives, flash cards, overheads, and textbooks.
Intervention Report 9-10 -1
LANGUAGE!® (Adolescent Literacy) (February 2013)
LANGUAGE!® is a language arts intervention designed for struggling learners in grades 3–12 who score below the 40th percentile on standardized literacy tests. The curriculum integrates English literacy acquisition skills into a six-step lesson format. During a daily lesson, students work on phonemic awareness and phonics (word decoding), word recognition and spelling (word encoding), vocabulary and morphology (word meaning), grammar and usage (understanding the form and function of words in context), listening and reading comprehension, and speaking and writing.
Intervention Report 7 -1
Great Explorations in Math and Science® (GEMS®) The Real Reasons for Seasons (Science) (January 2013)
Great Explorations in Math and Science® (GEMS®) The Real Reasons for Seasons is a curriculum unit for grades 6–8 that focuses on the connections between the Sun and the Earth to teach students the scientific concepts behind the seasons. The unit utilizes models, hands-on investigations, peer-to-peer discussions, reflection, and informational student readings to help students understand science content and develop scientific investigation skills.
Intervention Report 7-8 -1
Talent Development Middle Grades Program (Adolescent Literacy) (January 2013)
Talent Development Middle Grades Program (TDMG) is a whole school reform approach for large middle schools that face serious problems with student attendance, discipline, and academic achievement. The program includes both structural and curriculum reforms. It calls for schools to reorganize into small ”learning communities” of 200–300 students who attend classes in distinct areas of the school and stay together throughout their time in middle school. In addition to structural changes, schools adopting the program purchase one or more curricula that are intended to be developmentally appropriate and to engage students with culturally relevant content. For students who are behind in reading and math, the program provides additional periods devoted to these subjects that include group activities and computer-based lessons. To improve implementation, each school is assigned a team of “curriculum coaches” trained by the developer to work with school staff on a weekly basis to implement the program. In addition, teachers are offered professional development training, including monthly sessions designed to familiarize them with the program and demonstrate effective instructional approaches.
Intervention Report K-6 -1
Peer-Assisted Learning Strategies (Elementary School Mathematics) (January 2013)
Peer-Assisted Learning Strategies is a peer-tutoring program for grades K–6 that aims to improve student proficiency in several disciplines. During the 30-35 minute peer-tutoring sessions, students take turns acting at the tutor, coaching and correcting one another as they work through problems. The designation of tutoring pairs and skill assignment is based on teacher judgement of student needs and abilities, and teachers reassign tutoring pairs regularly.  
Intervention Report PK-4 -1
Success for All® (English Language Learners) (October 2012)
Success for All (SFA®) is a whole-school reform model (that is, a model that integrates curriculum, school culture, family, and community supports) for students in prekindergarten through grade 8. SFA® includes a literacy program, quarterly assessments of student learning, a social-emotional development program, computer-assisted tutoring tools, family support teams for students’ parents, a facilitator who works with school personnel, and extensive training for all intervention teachers. The literacy program emphasizes phonics for beginning readers and comprehension for all students. Teachers provide reading instruction to students grouped by reading ability for 90 minutes a day, 5 days a week. In addition, certified teachers or paraprofessionals provide daily tutoring to students who have difficulty reading at the same level as their classmates.
Intervention Report 1-5 -1
Open Court Reading© (Adolescent Literacy) (August 2012)
Open Court Reading© is a reading program for grades K–6 that is designed to teach decoding, comprehension, inquiry, and writing in a three-part progression. Part One of each unit, Preparing to Read, focuses on phonemic awareness, sounds and letters, phonics, fluency, and word knowledge. Part Two, Reading and Responding, emphasizes reading literature for understanding, comprehension, inquiry, and practical reading applications. Part Three, Language Arts, focuses on writing, spelling, grammar, usage, mechanics, and basic computer skills.
Intervention Report K-5 -1
Reading Mastery (Students with Learning Disabilities) (July 2012)
Reading Mastery is designed to provide systematic reading instruction to students in grades K–6. Reading Mastery can be used as an intervention program for struggling readers, as a supplement to a school’s core reading program, or as a stand-alone reading program, and is available in three versions. During the implementation of Reading Mastery, students are grouped with other students at a similar reading level, based on program placement tests. The program includes a continuous monitoring component.
Intervention Report 6 -1
Astronomy Resources for Intercurricular Elementary Science (ARIES): Exploring Motion and Forces (Science) (May 2012)
ARIES: Exploring Motion and Forces is a physical science curriculum for students in grades 5–8 that employs 18 inquiry-centered, hands-on lessons called “explorations.” The curriculum draws upon students’ curiosity to explore phenomena, allowing for a discovery-based learning process. Group-centered lab work is designed to help students build an understanding of inertia, friction, gravity, speed, and acceleration. Students examine their prior ideas about the phenomena, formulate questions, build and use an apparatus to observe natural phenomena, make predictions, and gather data through structured experiments. Exploring Motion and Forces is part of the ARIES sequence of eight physical science units. The ARIES sequences can be used together for an overall curriculum or independently.
Intervention Report 8 -1
Chemistry That Applies (Science) (February 2012)
Chemistry That Applies is an instructional unit designed to help students in grades 8–10 understand the law of conservation of matter. It consists of 24 lessons organized in four clusters. Working in groups, students explore four chemical reactions: burning, rusting, the decomposition of water, and the reaction of baking soda and vinegar. As part of the unit, students conduct experiments in which they cause these reactions to happen, obtain and record data in individual notebooks, analyze the data, and use evidence-based arguments to explain the data. The instructional unit engages the students in a structured sequence of hands-on laboratory investigations interwoven with other forms of instruction.
Intervention Report 8-10 -1
I CAN Learn® (High School Mathematics) (February 2012)
I CAN Learn® is a computer-based math curriculum for students in middle school, high school, and college. It provides math instruction through a series of interactive lessons that students work on individually at their own computers. Students move at their own pace and must demonstrate mastery of each concept before progressing to the next one. Classroom teachers may provide individual, small-group, or whole-class instruction based on students’ performance on the software program.
Intervention Report PK-2 -1
The Incredible Years (Early Childhood Education for Children with Disabilities) (February 2012)
The Incredible Years is composed of training programs for children, parents, and teachers. The child program is designed for children (ages 0–12) with challenging behaviors and focuses on building social and emotional skills. Lessons can be delivered to children referred for difficult behavior or to an entire classroom as a preventative measure. The program consists of 20- to 30-minute lessons 2–3 times a week; these lessons are reinforced by small-group activities, practicing skills throughout the day, and communicating with parents. Lessons cover recognizing and understanding feelings, getting along with friends, anger management, problem solving, and behavior at school. Parent training programs focus on positive discipline, promoting learning and development, and involvement in children’s life at school.
Intervention Report PK-2 -1
The Incredible Years (Children Identified With or at Risk for an Emotional Disturbance) (November 2011)
The Incredible Years is composed of training programs for children, parents, and teachers. The child program is designed for children (ages 0–12) with challenging behaviors and focuses on building social and emotional skills. Lessons can be delivered to children referred for difficult behavior or to an entire classroom as a preventative measure. The program consists of 20- to 30-minute lessons 2–3 times a week; these lessons are reinforced by small-group activities, practicing skills throughout the day, and communicating with parents. Lessons cover recognizing and understanding feelings, getting along with friends, anger management, problem solving, and behavior at school. Parent training programs focus on positive discipline, promoting learning and development, and involvement in children’s life at school.
Intervention Report 6-8 -1
Student team reading and writing (Adolescent Literacy) (November 2011)
Student team reading and writing refers to two cooperative learning programs for secondary students: (1) Student Team Reading and Writing and (2) Student Team Reading. The Student Team Reading and Writing program is an integrated approach to reading and language arts for early adolescents. Student Team Reading comprises the reading part of Student Team Reading and Writing and consists of two principal elements: (1) literature-related activities (including partner reading, treasure hunts, word mastery, story retelling, story-related writing, and quizzes) and (2) direct instruction in reading comprehension strategies (such as identifying main ideas and themes, drawing conclusions, making predictions, and understanding figurative language).
Intervention Report 9-12 -1
Check & Connect (Children Identified With or at Risk for an Emotional Disturbance) (October 2011)
Check & Connect is a dropout prevention strategy that relies on close monitoring of school performance, mentoring, case management, and other supports. The program has two main components: “Check” and “Connect.” The Check component is designed to continually assess student engagement through close monitoring of student performance and progress indicators. The Connect component involves program staff giving individualized attention to students, in partnership with school personnel, family members, and community service providers. Students enrolled in Check & Connect are assigned a “monitor” who regularly reviews their performance (in particular, whether students are having attendance, behavior, or academic problems) and intervenes when problems are identified. The monitor also advocates for students, coordinates services, provides ongoing feedback and encouragement, and emphasizes the importance of staying in school.
Intervention Report 4-5 -1
Coping Power (Children Identified With or at Risk for an Emotional Disturbance) (October 2011)
Coping Power is based on the earlier Anger Coping Power program. It emphasizes social and emotional skills that are needed during the transition to middle school. The program incorporates child and parent components. The child component consists of thirty-four 50-minute group sessions and periodic individual sessions over the course of 15–18 months, although the program can be shortened to fit into a single school year. Lessons focus on goal setting, problem solving, anger management, and peer relationships. The parent component is composed of 16 group sessions and periodic individual meetings. Lessons support the child component of the program and address setting expectations, praise, discipline, managing stress, communication, and child study skills.
Intervention Report 2-9 -1
Accelerated Math (High School Mathematics) (July 2011)
Accelerated Math®, published by Renaissance Learning, is a software tool that provides practice problems for students in grades K–12 and provides teachers with reports to monitor student progress. Accelerated Math® creates individualized student assignments, scores the assignments, and generates reports on student progress. The software is typically used with the math curriculum being used in the classroom to add practice for students and help teachers differentiate instruction through the program’s progress-monitoring data.
Intervention Report 5-12 -1
Repeated Reading (Middle School Mathematics) (April 2011)
Repeated reading is an academic practice that aims to increase oral reading fluency. Repeated reading can be used with students who have developed initial word reading skills but demonstrate inadequate reading fluency for their grade level. During repeated reading, a student sits in a quiet location with a teacher and reads a passage aloud at least three times. Typically, the teacher selects a passage of about 50 to 200 words in length. If the student misreads a word or hesitates for longer than 5 seconds, the teacher reads the word aloud, and the student repeats the word correctly. If the student requests help with a word, the teacher reads the word aloud or provides the definition. The student rereads the passage until he or she achieves a satisfactory fluency level.
Intervention Report 4-12 -1
Reciprocal Teaching (Adolescent Literacy) (September 2010)
Reciprocal teaching is an interactive instructional practice that aims to improve students’ reading comprehension by teaching strategies to obtain meaning from a text. The teacher and students take turns leading a dialogue regarding segments of the text. Students discuss with their teacher how to apply four comprehension strategies—generating questions, summarizing, clarifying, and predicting—to passages of text. During the early stages of reciprocal teaching, the teacher assumes primary responsibility for modeling how to use these strategies. As students become more familiar with the strategies, there is a gradual shift toward student responsibility for talking through the application of the strategies to the text.
Intervention Report 9-12 -1
Advancement Via Individual Determination (AVID) (Adolescent Literacy) (September 2010)
AVID is a college-readiness program whose primary goal is to prepare middle and high school students for enrollment in 4-year colleges through increased access to and support in advanced courses. The program, which focuses on underserved, middle-achieving students (defined as students earning B, C, and even D grades), places students in college preparatory classes (e.g., honors and Advancement Placement classes) while providing academic support through a daily elective period and ongoing tutorials.
Intervention Report 2-9 -1
Accelerated Math (Elementary School Mathematics) (September 2010)
Accelerated Math®, published by Renaissance Learning, is a software tool that provides practice problems for students in grades K–12 and provides teachers with reports to monitor student progress. Accelerated Math® creates individualized student assignments, scores the assignments, and generates reports on student progress. The software is typically used with the math curriculum being used in the classroom to add practice for students and help teachers differentiate instruction through the program’s progress-monitoring data.
Intervention Report 3-5 -1
Corrective Reading (Adolescent Literacy) (September 2010)
Corrective Reading is designed to promote reading accuracy (decoding), fluency, and comprehension skills of students in grade 3 or higher who are reading below their grade level. The program has four levels that correspond to students’ decoding skills. All lessons in the program are sequenced and scripted. Corrective Reading can be implemented in small groups of 4–5 students or in a whole-class format. Corrective Reading is intended to be taught in 45-minute lessons 4–5 times a week.
Intervention Report 11-12 -1
Service and Conservation Corps (Dropout Prevention) (September 2010)
Service and Conservation Corps engages young adults in full-time community service, job training, and educational activities. The program serves youth who are typically between the ages of 17 and 26 and who have dropped out of school, been involved with the criminal justice system, or face other barriers to success. Participants are organized into small crews that carry out environmental and energy conservation, urban infrastructure improvement, and other service projects intended to benefit local communities. These crews are guided by adult leaders who serve as mentors and role models. All participants receive educational training, in addition to a variety of job training and support services. Youth who have dropped out of school receive classroom training to secure a GED (General Educational Development) or high school diploma. Participants receive a living allowance while in the program. Those who complete the program are usually eligible for post-program educational stipends or small cash awards.
Intervention Report 1-4 -1
ClassWide Peer Tutoring (English Language Learners) (September 2010)
ClassWide Peer Tutoring (CWPT) is a peer-assisted instructional strategy designed to be integrated with most existing reading curricula. This approach provides students with increased opportunities to practice reading skills by asking questions and receiving immediate feedback from a peer tutor. Pairs of students take turns tutoring each other to reinforce concepts and skills initially taught by the teacher. The teacher creates age-appropriate peer teaching materials for the peer tutors; these materials take into account tutees’ language skills and disabilities.
Intervention Report 3 -1
Wilson Reading System® (Students with Learning Disabilities) (July 2010)
The Wilson Reading System® is a reading and writing program. It provides a curriculum for teaching reading and spelling to individuals of any age who have difficulty with written language. The Wilson Reading System® directly teaches the structure of words in the English language, aiming to help students learn the coding system for reading and spelling. The program provides interactive lesson plans and uses a sequential system with extensive controlled text. The Wilson Reading System® is structured to progress from phoneme segmentation to more challenging tasks, and seeks to improve sight word knowledge, fluency, vocabulary, oral expressive language development, and reading comprehension.
Intervention Report 4-10 -1
Read 180® (Students with Learning Disabilities) (July 2010)
READ 180® is a reading program designed for struggling readers who are reading 2 or more years below grade level. It combines online and direct instruction, student assessment, and teacher professional development. READ 180® is delivered in 90-minute sessions that include whole-group instruction, three small-group rotations, and whole-class wrap-up. Small-group rotations include individualized instruction using an adaptive computer application, small-group instruction, and independent reading. READ 180® is designed for students in elementary through high school.
Intervention Report 2-6 -1
Read Naturally® (English Language Learners) (July 2010)
Read Naturally is an elementary and middle school supplemental reading program designed to improve reading fluency using a combination of books, audiotapes, and computer software. The program has three main strategies: repeated reading of text for developing oral reading fluency, teacher modeling of story reading, and systematic monitoring of student progress by teachers and the students themselves. Students work at a reading level appropriate for their achievement level, progress through the program at their own rate, and, for the most part, work on an independent basis. Read Naturally® can be used in a variety of settings, including classrooms, resource rooms, or computer or reading labs. Although the program was not originally developed for English language learners, additional materials for these students are currently available.
Intervention Report K-5 -1
Project Read® Phonology (Students with Learning Disabilities) (July 2010)
Project Read® is a multisensory language arts curriculum designed for use in a classroom or group setting. Two main objectives of the program are to use language in all its forms, and to use responsive instruction rather than preplanned textbook lessons. The program emphasizes direct instruction, and lessons move from letter-sounds to words, sentences, and stories. Project Read® has three strands: Phonics/Linguistics, Reading Comprehension, and Written Expression, which are integrated at all grade levels, though the emphasis of the specific strands differs by grade.
Intervention Report 6 -1
PLATO (Middle School Mathematics) (March 2010)
PLATO® Achieve Now is a software-based curriculum for the elementary and middle school grades that focuses on pre-algebraic concepts and includes content pertaining to rational numbers in related organizational patterns, proportion and percent, integers, probability, statistics, problem solving, geometry, measurement, and the foundational concepts of algebra I. Instructional content is delivered via the PlayStation Portable (PSP®) system, allowing students to access learning materials in various settings. Software-based assessments are used to customize individual instruction, allowing students to learn at their own pace with content appropriate for their skill level.
Intervention Report 6-8 -1
Connected Mathematics Project (CMP) (Middle School Mathematics) (January 2010)
Connected Mathematics Project (CMP) is a math curriculum for students in grades 6–8. It uses interactive problems and everyday situations to explore mathematical ideas, with a goal of fostering a problem-centered, inquiry-based learning environment. At each grade level, the curriculum covers numbers, algebra, geometry/measurement, probability, and statistics.
Intervention Report K-8 -1
Accelerated Reader (English Language Learners) (December 2009)
Accelerated Reader™ is a computerized supplementary reading program that provides guided reading instruction to students in grades K–12. It aims to improve students’ reading skills through reading practice and by providing frequent feedback on students’ progress to teachers. The Accelerated Reader™ program requires students to select and read a book based on their area of interest and reading level. Upon completion of a book, students take a computerized quiz based on the book’s content and vocabulary. Quiz performance allows teachers to monitor student progress and to identify students who may need additional reading assistance.
Intervention Report K-1 -1
Reading Recovery® (English Language Learners) (December 2009)
Reading Recovery® is an intervention that provides one-on-one tutoring to students in grade 1 with low literacy achievement. This supplemental program aims to improve student reading and writing skills by providing one-on-one tutoring, tailoring the content of each lesson to each student based on observations and analyses of the student strengths and weaknesses from prior lessons. Trained Reading Recovery® teachers deliver tutoring daily in 30-minute one-on-one sessions over the course of 12 to 20 weeks. Reading Recovery® teachers incorporate instruction in topics such as phonemic awareness, phonics, vocabulary, fluency, comprehension, writing, oral language, and motivation depending on student needs.
Intervention Report 4-8 -1
Odyssey Math (Middle School Mathematics) (June 2009)
Odyssey® Math is a web-based program developed by Compass Learning® for mathematics instruction in grades K–8. The online program includes a mathematics curriculum and formative assessments designed to support differentiated and data-driven instruction. Based on assessment results, the program generates an individualized sequence of mathematics topics and skills—a “learning path.” Odyssey® Math is often used as a prescriptive tool, where students can start by taking a diagnostic assessment aligned with local or state standards. Teachers can modify learning paths to match their lesson plans or to align them with district scopes and sequences.
Intervention Report 8-9 -1
Summer Training and Education Program (STEP) (Dropout Prevention) (May 2009)
Summer Training and Education Program (STEP) is a summer employment, academic remediation, and life skills program intended to reduce school dropout rates by addressing summer learning loss and preventing teen parenthood. The program serves low-income 14- and 15-year-olds who have tested below grade level in either reading or math. The program is integrated into the federal summer jobs program and is offered as sessions of 6–8 weeks in two consecutive summers. It includes part-time summer work at minimum wage, a daily reading and math curriculum, and “life skills and opportunities” classes that focus on topics such as sexual behavior, drug use, careers, and community involvement.
Intervention Report 7-8 -1
Talent Development Middle Grades Program (Dropout Prevention) (March 2009)
Talent Development Middle Grades Program (TDMG) is a whole school reform approach for large middle schools that face serious problems with student attendance, discipline, and academic achievement. The program includes both structural and curriculum reforms. It calls for schools to reorganize into small ”learning communities” of 200–300 students who attend classes in distinct areas of the school and stay together throughout their time in middle school. In addition to structural changes, schools adopting the program purchase one or more curricula that are intended to be developmentally appropriate and to engage students with culturally relevant content. For students who are behind in reading and math, the program provides additional periods devoted to these subjects that include group activities and computer-based lessons. To improve implementation, each school is assigned a team of “curriculum coaches” trained by the developer to work with school staff on a weekly basis to implement the program. In addition, teachers are offered professional development training, including monthly sessions designed to familiarize them with the program and demonstrate effective instructional approaches.
Intervention Report 9-12 -1
Middle College High School (Dropout Prevention) (March 2009)
Middle College High Schools are alternative high schools located on college campuses that aim to help at-risk students complete high school and encourage them to attend college. The schools offer a project-centered, interdisciplinary curriculum with an emphasis on team teaching, individualized attention, and development of critical thinking skills. Students are also offered support services, including specialized counseling, peer support, and career experience opportunities.
Intervention Report 2-9 -1
Accelerated Math (Middle School Mathematics) (September 2008)
Accelerated Math®, published by Renaissance Learning, is a software tool that provides practice problems for students in grades K–12 and provides teachers with reports to monitor student progress. Accelerated Math® creates individualized student assignments, scores the assignments, and generates reports on student progress. The software is typically used with the math curriculum being used in the classroom to add practice for students and help teachers differentiate instruction through the program’s progress-monitoring data.
Intervention Report 9-12 -1
First Things First (Dropout Prevention) (January 2008)
First Things First is a reform model intended to transform elementary, middle, and high schools serving significant proportions of economically disadvantaged students. Its three main components are: (1) “small learning communities” of students and teachers; (2) a family and student advocate system that pairs staff members and students to monitor and support progress, and that serves as a bridge between the school and family; and (3) instructional improvements to make classroom teaching more rigorous and engaging and more closely aligned with state standards and assessments.
Intervention Report 9-12 -1
Project GRAD (Dropout Prevention) (July 2007)
Project “Graduation Really Achieves Dreams” (GRAD) is an initiative for students in economically disadvantaged communities that aims to reduce dropping out and increase rates of college enrollment and graduation by increasing reading and math skills, improving behavior in school, and providing a service safety net. At the high school level, Project GRAD provides 4-year college scholarships and summer institutes to promote attending and completing high school. Project GRAD also provides services in the elementary and middle schools that feed into the participating high schools.
Intervention Report 9-12 -1
Quantum Opportunity Program (Dropout Prevention) (July 2007)
The Quantum Opportunity Program (QOP) is an intensive and comprehensive program for high school-aged youth that offers case management, mentoring, tutoring, and other education and support services. The program also offers financial incentives for participation in program activities. Participants enter QOP in grade 9 and can receive services for 4–5 years, even if they drop out of school or move to another district.
Intervention Report 9-12 -1
Talent Development High Schools (Dropout Prevention) (July 2007)
Talent Development High Schools is a school reform model for restructuring large high schools with persistent attendance and discipline problems, poor student achievement, and high dropout rates. The model includes both structural and curriculum reforms. It calls for schools to reorganize into small “learning communities”—including ninth-grade academies for first-year students and career academies for students in upper grades—to reduce student isolation and anonymity. It also emphasizes high academic standards and provides all students with a college preparatory academic sequence.
Intervention Report K-5 -1
Project Read® Phonology (Beginning Reading) (July 2007)
Project Read® is a multisensory language arts curriculum designed for use in a classroom or group setting. Two main objectives of the program are to use language in all its forms, and to use responsive instruction rather than preplanned textbook lessons. The program emphasizes direct instruction, and lessons move from letter-sounds to words, sentences, and stories. Project Read® has three strands: Phonics/Linguistics, Reading Comprehension, and Written Expression, which are integrated at all grade levels, though the emphasis of the specific strands differs by grade.
Intervention Report 1 -1
Read Well® (Beginning Reading) (July 2007)
Read Well® is a reading curriculum to increase the literacy abilities of students in kindergarten and grade 1. The program provides instruction in phonemic awareness, phonics, vocabulary, comprehension, and fluency. Students are given opportunities to discuss the vocabulary concepts that are presented in each story. The program is based on the tenets of scaffolded instruction, where teachers begin by presenting models, and gradually decrease their support by providing guided practice, before students are asked to complete the skill or strategy independently. For example, the student and teacher read new text aloud, with the teacher reading the difficult or irregular words. As student skills (and motivation) increase, the amount of teacher-read text decreases, and the student is given greater independence. The program combines daily whole class activities with small group lessons.
Intervention Report 9-10 -1
Core-Plus Mathematics (Middle School Mathematics) (July 2007)
Core-Plus Mathematics is a 4-year curriculum that replaces the traditional sequence with courses that each feature interwoven strands of algebra and functions, statistics and probability, geometry and trigonometry, and discrete mathematics. The curriculum emphasizes mathematical modeling, using technology to emphasize reasoning with multiple representations (verbal, numerical, graphical, and symbolic) and to focus on goals in which mathematical thinking and problem solving are central. Instructional materials promote active learning and teaching centered around collaborative small-group investigations of problem situations, followed by teacher-led whole-class summarizing activities that lead to analysis, abstraction, and further application of underlying mathematical ideas.
Intervention Report 5-7 -1
SuccessMaker® (Beginning Reading) (July 2007)
The SuccessMaker program is a set of computer-based courses used to supplement regular classroom reading instruction in grades K–8. Using adaptive lessons tailored to a student’s reading level, SuccessMaker aims to improve understanding in areas such as phonological awareness, phonics, fluency, vocabulary, comprehension, and concepts of print.
Intervention Report 5-7 -1
SuccessMaker® (Elementary School Mathematics) (July 2007)
The SuccessMaker program is a set of computer-based courses used to supplement regular classroom reading instruction in grades K–8. Using adaptive lessons tailored to a student’s reading level, SuccessMaker aims to improve understanding in areas such as phonological awareness, phonics, fluency, vocabulary, comprehension, and concepts of print.
Intervention Report 5-7 -1
Successmaker (Elementary School Math) (July 2007)
The SuccessMaker program is a set of computer-based courses used to supplement regular classroom reading instruction in grades K–8. Using adaptive lessons tailored to a student’s reading level, SuccessMaker aims to improve understanding in areas such as phonological awareness, phonics, fluency, vocabulary, comprehension, and concepts of print.
Intervention Report PK-K -1
Direct Instruction (Early Childhood Education) (May 2007)
Direct Instruction refers to a family of interventions that includes all Direct Instruction products (DISTAR and Language for Learning), as well as to all versions past and present. Direct Instruction includes teaching techniques that are fast-paced, teacher-directed, and explicit with opportunities for student response and teacher reinforcement or correction.
Intervention Report 1 -1
Progress in Mathematics © 2006 (Elementary School Mathematics) (April 2007)
Progress in Mathematics © 2006 is a core curriculum for students in kindergarten through grade 6. Progress in Mathematics © 2006 uses a sequence of systematic lesson plans to teach mathematical concepts and skills. It incorporates the following features at each grade level: explicit instruction of mathematics content; development of conceptual understanding through a three-step process that begins with hands-on activities (concrete thinking to visual thinking to symbol use); fluency in numerical computation; problem solving; development of mathematical vocabulary; practice and review; and different types of assessment. Student textbooks, student workbooks, and teacher’s editions are available for each grade level, as well as manipulatives and online practice exercises.
Intervention Report 2-5 -1
Houghton Mifflin Mathematics (Elementary School Mathematics) (April 2007)
Houghton Mifflin Mathematics is a core mathematics curriculum for students at all ability levels in kindergarten through grade 6. At each grade level, the program focuses on basic skills development, problem solving, and vocabulary expansion to help students master key math concepts. Students practice daily math lessons through instructional software, enrichment worksheets, manipulatives, and workbooks, in addition to student textbooks. The program incorporates assessments—including lesson-level interventions to meet the needs of all learners—to monitor students’ progress.
Intervention Report 7-9 -1
Transition Mathematics (Middle School Mathematics) (March 2007)
Transition Mathematics aims to increase applied arithmetic, pre-algebra, and pre-geometry skills in students in grades 7–12 . This 1-year curriculum also addresses general application to different wordings of problems, types of numbers, and contexts for problems and aims to promote mathematical reading skills. The curriculum uses the University of Chicago School Mathematics Project (UCSMP) textbook. The sequence of the topics intends to assist the transition from arithmetic to algebra and geometry.
Intervention Report 6-8 -1
Lions Quest -- Skills for Adolescence (Character Education) (September 2006)
Lions Quest Skills for Adolescence is a schoolwide program for middle school students (grades 6–8). The program is designed to promote good citizenship skills, core character values, social-emotional skills, and discourage the use of drugs, alcohol, and violence. The program includes a classroom curriculum, schoolwide practices to create a positive school climate, parent and family involvement, and community involvement. The curriculum may vary in scope and intensity, lasting from 9 weeks to 3 years. The lessons use cooperative group learning exercises and classroom management techniques to improve classroom climate.
Intervention Report 6-7 -1
Voices Literature and Character Education (Voices LACE) (Character Education) (September 2006)
Voices Literature and Character Education Program (Voices LACE; formerly known as Voices of Love and Freedom and Literacy and Values) is a K–12 program that aims to promote positive character and citizenship values, literacy skills, and social skills. The program curriculum can be used over any length of time. During classroom lessons, students read books about issues such as ethnic discrimination, fighting, or bullying, and elaborate on central themes through role-playing and discussions practiced in school and at home. Emphasis is given to promoting caring relationships between teachers and students and among students, and to connecting the values taught to students’ personal stories. Voices LACE may also be implemented as a schoolwide improvement program. Optional components of the program include schoolwide events and restructuring of school organization and practices (establishing student assemblies and creating small learning communities), parental involvement (home visits and family nights), and community support (joint campaigns with supporting organizations and business).
Intervention Report 1-6 -1
Heartwood Ethics Curriculum/An Ethics Curriculum for Children (Character Education) (September 2006)
An Ethics Curriculum for Children, a read-aloud literature-based curriculum, aims to teach elementary school students seven universal attributes of good character. Lessons and home assignments are organized around multicultural stories. The program activities are designed to connect the experiences of characters in the stories to students’ own lives. Optional parts of the Heartwood Ethics Curriculum for Children also include integration of character education themes across curricular topics and parental notification and involvement.
Intervention Report 9-12 -1
Lions Quest -- Skills for Action (Character Education) (September 2006)
Lions Quest Skills for Action, a program to build positive character values and life and citizenship skills for students in grades 9–12, includes classroom lessons and service learning. The program includes more than 100 lessons focused around 26 personal, social, and thinking skills. Program length ranges from one semester to 4 years. Students explore personal stories highlighting values and behavior through teachers’ questions, group discussion, and resource pages in the curricular materials. For service learning, students perform school-based or community-based projects and reflect on their experiences. Optional components include a student magazine, an Advisory Team, and supplemental units on drug use prevention.
Intervention Report K -1
Stepping Stones to Literacy (Early Childhood Education) (December 2005)
Stepping Stones to Literacy (SSL) is a supplemental curriculum designed to promote listening, print conventions, phonological awareness, phonemic awareness, and serial processing/rapid naming (quickly naming familiar visual symbols and stimuli, such as letters or colors). The program targets older preschool and kindergarten students who are considered to be underachieving readers, based on teacher’s recommendations, assessments, and systematic screening. Students participate in 10- to 20-minute daily lessons in a small group or individually. The curriculum consists of 25 lessons, for a total of 9–15 hours of instructional time.
Intervention Report 1-5 -1
Open Court Reading© (Early Childhood Education) (December 2005)
Open Court Reading© is a reading program for grades K–6 that is designed to teach decoding, comprehension, inquiry, and writing in a three-part progression. Part One of each unit, Preparing to Read, focuses on phonemic awareness, sounds and letters, phonics, fluency, and word knowledge. Part Two, Reading and Responding, emphasizes reading literature for understanding, comprehension, inquiry, and practical reading applications. Part Three, Language Arts, focuses on writing, spelling, grammar, usage, mechanics, and basic computer skills.
Intervention Report 1-4 -1
Lindamood Phoneme Sequencing® (LiPS®) (Early Childhood Education) (December 2005)
The Lindamood Phoneme Sequencing® (LiPS®) program (formerly called the Auditory Discrimination in Depth® [ADD] program) is designed to teach students the skills they need to decode words and to identify individual sounds and blends in words. LiPS® is designed for emergent readers in kindergarten through grade 3 or for struggling, dyslexic readers. The program is individualized to meet students’ needs and is often used with students who have learning disabilities or difficulties. Initial activities engage students in discovering the lip, tongue, and mouth actions needed to produce specific sounds. After students are able to produce, label, and organize the sounds with their mouths, subsequent activities in sequencing, reading, and spelling use the oral aspects of sounds to identify and order them within words. The program also offers direct instruction in letter patterns, sight words, and context clues in reading.
Reviews of Individual Studies 7 1
The Impacts of Three Educational Technologies on Algebraic Understanding in the Context of COVID-19 (2023)
The current study investigated the effectiveness of three distinct educational technologies--two game-based applications (From Here to There and DragonBox 12+) and two modes of online problem sets in ASSISTments (an Immediate Feedback condition and an Active Control condition with no immediate feedback) on Grade 7 students' algebraic knowledge. More than 3,600 Grade 7 students across nine in-person and one virtual schools within the same district were randomly assigned to one of the four conditions. Students received nine 30-minute intervention sessions from September 2020 to March 2021. Hierarchical linear modeling analyses of the final analytic sample (N = 1,850) showed significantly higher posttest scores for students who used From Here to There and DragonBox 12+ compared to the Active Control condition. No significant difference was found for the Immediate Feedback condition. The findings have implications for understanding how game-based applications can affect algebraic understanding, even within pandemic pressures on learning.
Reviews of Individual Studies 7 1
The Impacts of Three Educational Technologies on Algebraic Understanding in the Context of COVID-19 (2023)
The current study investigated the effectiveness of three distinct educational technologies--two game-based applications (From Here to There and DragonBox 12+) and two modes of online problem sets in ASSISTments (an Immediate Feedback condition and an Active Control condition with no immediate feedback) on Grade 7 students' algebraic knowledge. More than 3,600 Grade 7 students across nine in-person and one virtual schools within the same district were randomly assigned to one of the four conditions. Students received nine 30-minute intervention sessions from September 2020 to March 2021. Hierarchical linear modeling analyses of the final analytic sample (N = 1,850) showed significantly higher posttest scores for students who used From Here to There and DragonBox 12+ compared to the Active Control condition. No significant difference was found for the Immediate Feedback condition. The findings have implications for understanding how game-based applications can affect algebraic understanding, even within pandemic pressures on learning.
Reviews of Individual Studies 1 1
Examining the Impact of a First Grade Whole Number Intervention by Group Size (2022)
This study utilized a partially nested randomized control design to investigate the impact of Fusion, a first grade math intervention. Blocking on classrooms, students were randomly assigned to one of three conditions: a Fusion two student group, a Fusion five student group, or a no treatment control group. Two primary research questions were examined: What was the overall impact of the Fusion intervention as compared to a business-as-usual comparison condition? and Was there a differential impact on student outcomes between the 2:1 Fusion and the 5:1 Fusion conditions? Analyses found a positive effects on four outcome measures favoring Fusion groups over control with two of the differences statistically significant. Results between Fusion groups found positive effects favoring the Fusion 2:1 group compared to the Fusion 5:1 group on all four outcome measures with two of the differences statistically significant. On a second grade follow up measure no difference was found between Fusion groups and control but a statistically significant difference was found between Fusion groups favoring the 2:1 Fusion group. Future research directions and implications for practice are discussed. [This paper will be published in the "Journal of Research on Educational Effectiveness."]
Reviews of Individual Studies 11-12 1
Does virtual advising increase college enrollment? Evidence from a random-assignment college access field experiment (2022)
Reviews of Individual Studies 11-12 1
Expanding the Expository Reading and Writing Curriculum: An Evaluation of an Investing in Innovation Validation Grant (2022)
This report presents the findings from an independent evaluation conducted by WestEd on the Expository Reading and Writing Curriculum (ERWC). Funded by an Investing in Innovation (i3) Validation grant, the ERWC is a grade 11 and grade 12 English language arts (ELA) curriculum developed by the California State University. The independent evaluation includes an evaluation of the fidelity of implementation of the curriculum and an impact evaluation that took place during the 2020/21 school year. The fidelity of implementation evaluation found that a high percentage of teachers participated in the professional learning with fidelity but that few teachers taught the full curriculum with fidelity, and these results were due to many factors, including time constraints and shifts in instruction due to the COVID-19 pandemic. The grade 11 impact evaluation found that assignment to the ERWC had a positive and statistically significant impact on student achievement as measured by the Non-Performance Task Interim Comprehensive Assessment; however, no statistically significant impact was detected among the students who took the Smarter Balanced Summative Assessment. In the grade 12 impact evaluation, there was no statistically significant difference in achievement between students who had enrolled in the ERWC and students who had enrolled in the comparison English course. Further evaluation of the ERWC in a non-pandemic year during which schooling takes place in person is recommended.
Reviews of Individual Studies K 1
Integrating Literacy and Science Instruction in Kindergarten: Results from the Efficacy "Study of Zoology One" (2022)
This study examines the efficacy, cost, and implementation of an integrated science and literacy curriculum for kindergarten. The study was conducted in a large urban district and included 1,589 students in 71 classrooms in 21 schools. The research includes a multi-site cluster-randomized controlled trial and mixed-methods cost and implementation studies. Analysis revealed significant impacts on comprehension, letter-naming fluency, and motivation to read. No main impacts were observed on decoding, word identification, or writing; however, exploratory analysis revealed that students whose teachers implemented the treatment with fidelity performed statistically significantly better in writing and decoding. The cost to produce the observed effects was estimated at $480 per student, two-thirds of which was borne by the school. Despite this cost, treatment classrooms achieved savings by using an average of three fewer instructional programs than control classrooms. Teachers reported positive effects from the integrated curriculum on student engagement, learning, and behavior.
Reviews of Individual Studies K-1 1
Efficacy of the Social-Emotional Learning Foundations Curriculum for Kindergarten and First Grade Students at Risk for Emotional and Behavioral Disorders (2021)
Researchers have shown that children's social-emotional growth is inextricably connected to academic learning. We developed the Social-Emotional Learning Foundations (SELF) intervention, a Grade K-1 curriculum merging social-emotional learning (SEL) and literacy instruction, to promote language supported self-regulation, specifically for primary grade children at early risk for emotional or behavioral difficulties. We report findings from a pretest-posttest cluster randomized efficacy trial with one fixed between-subjects factor to test the effects of teacher-delivered SEL instruction against those of business as usual (BAU). We recruited 163 kindergarten (K) and 141 first grade teachers from 52 schools across 11 school districts within one southeastern state. Our student sample (n=1154) consisted of 627 kindergarteners and 527 first graders identified by teachers as at risk for internalizing or externalizing emotional and behavioral problems using the "Systematic Screening for Behavioral Disorders"; 613 of these students participated in the SELF condition and 541 participated in the BAU condition. We randomly assigned schools to SELF or BAU and used a multilevel model with three levels (i.e., children, classrooms, schools) to analyze data on subscales of six (four teacher-report and two direct) assessments related to self-regulation, social-emotional learning, social-emotional vocabulary, and general behavioral functioning. We found positive main effects of SELF compared to BAU on all but one measure, with effect sizes (calculated using Hedges' "g") ranging from 0.20 to 0.65. Findings provide evidence for guiding future SEL intervention research and informing practice to improve student outcomes, particularly for children at risk for behavior problems. [This is the online first version of an article published in "Journal of School Psychology."]
Reviews of Individual Studies 9-12 1
Linking Learning to Careers Demonstration: Impacts 24 Months after Enrollment (2021)
The Linking Learning to Careers (LLC) program offered high school students with disabilities an individualized and targeted approach to strategically plan for their futures. The Vermont Division of Vocational Rehabilitation (DVR) designed LLC to build on its usual services for high school students to emphasize unpaid and paid work-based learning experiences (WBLEs) in integrated environments, college exploration and coursework opportunities at the Community College of Vermont, team-based guidance and support from DVR staff, dedicated support for assistive technology, and additional transportation funding. To support a rigorous evaluation, DVR relied on a randomized controlled trial design, recruiting 803 participants to participate. This report presents evidence on LLC's impacts up to two years after students enrolled in the program. The demonstration had impacts on services and education that were consistent with the LLC model and findings from the implementation evaluation. However, the program did not have consistent impacts on employment. [Mathematica prepared this report under contract to the Vermont Division of Vocational Rehabilitation under a grant from the U.S. Department of Education.]
Reviews of Individual Studies 9-PS 1
Early College, Continued Success: Longer-Term Impact of Early College High Schools (2021)
Following up on a previous impact study of Early Colleges (EC) based on retrospective admission lotteries, this study assessed longer-term impacts on students' postsecondary outcomes with 4 more years of data. The study found that students who won EC admission lotteries were significantly more likely to enroll in college, enroll in 2-year colleges, complete a college degree, complete associate's degrees or certificates, and complete bachelor's degrees within 6 years after expected high school graduation than control students. Moreover, it found that treatment students completed postsecondary degrees earlier and faster than control students. Consistent with EC's focus on college exposure during high school, the EC impacts on college enrollment and the completion of associate's degrees largely occurred within high school. The study also found that EC impacts did not vary significantly by students' demographic characteristics; however, some impacts were significantly stronger for students with higher levels of prior achievement.
Reviews of Individual Studies K-3 1
Evaluating the effectiveness of a volunteer one-on-one tutoring model for early elementary reading intervention: A randomized controlled trial replication study (2021)
Reviews of Individual Studies K-3 1
Literacy First: Evaluation summary report (2021)
Reviews of Individual Studies 12-PS 1
Nudging at scale: Experimental evidence from FAFSA completion campaigns. (2021)
Reviews of Individual Studies 6-8 1
Middle school classroom management: A randomized control trial of Class-Wide Function-Related Intervention Teams for Middle Schools (CW-FIT MS) (2021)
Reviews of Individual Studies 7-9 1
Evaluation of the College, Career, and Community Writers Program: Findings from the i3 Scale-up Grant. Technical Report. (2021)
Reviews of Individual Studies 9-11 1
Bridging the School-to-Work Divide: Interim Implementation and Impact Findings from New York City's P-TECH 9-14 Schools (2020)
The New York City P-TECH Grades 9-14 schools represent an education model that ties together the secondary, higher education, and workforce systems as a way to improve outcomes in both domains. The distinguishing feature of the P-TECH 9-14 model, as it is referred to in this report, is a partnership between a high school, a local community college, and one or more employer partners that focuses on preparing students for both college and careers -- not one or the other -- within a six-year timeframe. Education and workforce development are traditionally seen as separate spheres of influence with multiple transition points that students have been left to navigate largely on their own (for example, high school to postsecondary, and postsecondary to the workforce). P-TECH 9-14 is designed to seamlessly assist student navigation of those points -- supporting student success and mitigating the potential for students to fall through the cracks. P-TECH 9-14 schools collaborate with local colleges to provide students with an opportunity to earn a high school diploma (within four years) followed by a cost-free, industry-recognized associate's degree. During the six-year program, employer partners support P-TECH 9-14 schools by providing students with work-based learning experiences such as internships, mentoring, and job shadowing. By design, the P-TECH 9-14 model offers students the opportunity to participate in focused and accelerated high school pathways, early college, and career-focused activities. This study offers initial impact and implementation findings from the first rigorous evaluation of the model, evaluating the first seven P-TECH 9-14 schools that opened in New York City. The study leverages the random lottery process created by the New York City High School Admissions System to identify impacts. The majority of the students in the sample who participated in the admissions lotteries were academically below proficiency in both math and English language arts (ELA) prior to entering high school. [This report was written with Fernando Medina. For the executive summary, see ED605313.]
Reviews of Individual Studies 6-8 1
Distance Learning through Game-Based 3D Virtual Learning Environments: Mission Hydro Science. Evaluation Report for Mission HydroSci (2020)
Mission HydroSci (MHS) is a 3D game-based learning environment and curriculum that supports middle school student learning of water systems science and scientific argumentation. MHS is a rigorous, coherent and engaging 6 to 8-day curriculum with all learning activities and social interactions taking place in the virtual world and with teachers observing and supporting students through an online support system enhanced by analytics. MHS was evaluated in comparison to a high- quality alternative intervention developed by the Biological Sciences Curriculum Study (BSCS) using a stratified randomized block experimental design where 'classroom' was the unit of random assignment, stratified by teacher. The comparison curriculum is called Earth's Water Systems (EWS) and is provided online using the Canvas learning management platform. Three measurable outcomes: (1) content knowledge, (2) competency in scientific argumentation, and (3) affect for science and technology were used in the pre- post-comparison of MHS with EWS. The findings of this randomized experiment showed that MHS achieved roughly equivalent water systems learning outcomes and significantly higher development of argumentation competencies when compared to the EWS curriculum. The impacts of both MHS and the EWS curriculum on affect for science and technology were equivalent and slightly negative. A secondary exploratory quasi-experimental design (QED) analysis was conducted that found significant positive effects for MHS in comparison to EWS on water systems understandings and stronger detected effects for students' argumentation.
Reviews of Individual Studies 5-7 1
Aiming Higher: Assessing Higher Achievement's Out-of-School Expansion Efforts (2020)
Many talented students in under-resourced schools do not reach their full potential. Research shows that by sixth grade, children born into poverty have likely spent 6,000 fewer hours learning than their middle-class counterparts. Higher Achievement, an intensive summer and after-school program, aims to close that learning gap. It offers participants more than 500 hours of academic enrichment activities a year to help them meet the high academic standards expected of college-bound students. Known as "scholars"; Higher Achievement students enter the program during the summer before either fifth or sixth grade and commit to attending through eighth grade. The summer program consists of six weeks of morning classes in English Language Arts (ELA), math, science, and, in some centers, social studies, followed by enrichment activities in the afternoon, including chess, cooking, art, and soccer. During the school year, in addition to the program's regular study hall and enrichment activities, a cadre of mostly young professionals volunteer one day a week, delivering 75-minute ELA or math lessons to small groups of scholars. These volunteers receive detailed lesson plans and training so they can successfully execute the program's rigorous curricula. Part of what makes Higher Achievement affordable is its use of volunteers in this way. An earlier experimental evaluation of Metro DC, Higher Achievement's flagship affiliate in Washington, DC, and Alexandria, Virginia, found that the program was effective in improving academic performance two years after students applied. Since then, Higher Achievement has expanded to three new cities: Baltimore, Maryland; Richmond, Virginia; and Pittsburgh, Pennsylvania. Keenly aware that many effective flagship programs fail to be effective in new locations, the federal government funded an experimental validation study to examine the impacts at these expansion sites. Eligible students were randomly assigned either to a program group that could participate in Higher Achievement, or to a control group that could not enroll in the program. Comparing the two groups' outcomes provided an estimate of the program's impacts. The study found that the expansion sites experienced many of the implementation challenges common to school-based, out-of-school-time programs (for example, staff turnover, coordination with the host school, and lower-than-hoped-for attendance by middle school students), as well as those often seen in new programs (such as a lack of strong relationships with key partners and difficulty recruiting volunteers). Even so, Higher Achievement was found to be at least adequately implemented in all three cities. The study found that the program's detailed lesson plans, with scripted questions and student instructions, enabled the volunteers to deliver rigorous academic lessons. This report addresses the following questions: (1) How did the Higher Achievement centers operate during the study and what lessons are there for similar programs?; (2) Did scholars receive more academic enrichment over the two-year study period than they would have received without Higher Achievement?; and (3) How did Higher Achievement impact scholars' grades and test scores over the two years since they applied?
Reviews of Individual Studies 11-PS 1
Virtual advising for high-achieving high school students. (2020)
Reviews of Individual Studies K-3 1
Effects of a Universal Classroom Management Teacher Training Program on Elementary Children with Aggressive Behaviors (2020)
The purpose of this study was to examine the treatment effects of the Incredible Years Teacher Classroom Management (IY TCM), a universal classroom management intervention, on the outcomes of children with aggressive behavior in elementary school. Classroom management has been demonstrated as a factor in either escalating children's aggressive behavior or decreasing those problematic behaviors. Participants included 1,817 students (Grade K to 3) and 105 teachers from nine elementary schools in a large urban Midwestern school district. Teachers were randomly assigned to receive IY TCM or to a wait-list comparison group. The hypotheses were that baseline levels of aggression would moderate the relationship between intervention status and outcomes. Findings indicated the hypothesized moderation effect on several outcome variables; specifically, children with baseline aggression problems who were in IY TCM classrooms had significantly improved math achievement, emotional regulation, prosocial behaviors, and observed aggression in comparison to similar peers in the control classrooms. Implications for practice and future research based on the findings are discussed.
Reviews of Individual Studies K-5 1
Employing Evidence-Based Practices for Children with Autism in Elementary Schools (2020)
The purpose of this study was to test the efficacy of a comprehensive program model originally developed by the National Professional Development Center on Autism Spectrum Disorder (NPDC). Sixty elementary schools with 486 participants were randomly assigned to an NPDC and services as usual condition (SAU). Significantly greater changes in program quality occurred in the inclusive NPDC programs as compared with the SAU schools. Teachers in NPDC schools reported using more evidence-based practices (EBPs) and implemented EBPs with significantly greater fidelity than teachers in SAU schools. Autistic students in NPDC schools had significantly higher total attainment of educational goals than students in SAU schools, and the two groups made equivalent progress on standardized assessment outcomes across the school year. [This is the online first version of an article published in "Journal of Autism and Developmental Disorders."]
Reviews of Individual Studies 9-PS 1
Bridging the School-to-Work Divide: Interim Implementation and Impact Findings from New York City's P-TECH 9-14 Schools (2020)
The New York City P-TECH Grades 9-14 schools represent an education model that ties together the secondary, higher education, and workforce systems as a way to improve outcomes in both domains. The distinguishing feature of the P-TECH 9-14 model, as it is referred to in this report, is a partnership between a high school, a local community college, and one or more employer partners that focuses on preparing students for both college and careers -- not one or the other -- within a six-year timeframe. Education and workforce development are traditionally seen as separate spheres of influence with multiple transition points that students have been left to navigate largely on their own (for example, high school to postsecondary, and postsecondary to the workforce). P-TECH 9-14 is designed to seamlessly assist student navigation of those points -- supporting student success and mitigating the potential for students to fall through the cracks. P-TECH 9-14 schools collaborate with local colleges to provide students with an opportunity to earn a high school diploma (within four years) followed by a cost-free, industry-recognized associate's degree. During the six-year program, employer partners support P-TECH 9-14 schools by providing students with work-based learning experiences such as internships, mentoring, and job shadowing. By design, the P-TECH 9-14 model offers students the opportunity to participate in focused and accelerated high school pathways, early college, and career-focused activities. This study offers initial impact and implementation findings from the first rigorous evaluation of the model, evaluating the first seven P-TECH 9-14 schools that opened in New York City. The study leverages the random lottery process created by the New York City High School Admissions System to identify impacts. The majority of the students in the sample who participated in the admissions lotteries were academically below proficiency in both math and English language arts (ELA) prior to entering high school. [This report was written with Fernando Medina. For the executive summary, see ED605313.]
Reviews of Individual Studies 9-PS 1
What Happens When You Combine High School and College? The Impact of the Early College Model on Postsecondary Performance and Completion (2020)
Early colleges are a new model of schooling in which the high school and college experiences are merged, shortening the total amount of time a student spends in school. This study uses a lottery-based experimental design to examine the impact of the model on longer term outcomes, including attainment of a postsecondary credential and academic performance in 4-year institutions. Results show that a significantly higher proportion of early college students were attaining postsecondary credentials. The results also show that early college students were completing their degrees more rapidly but that their performance in 4-year institutions was still comparable with the control students. [For the corresponding grantee submission, see ED604350.]
Reviews of Individual Studies 9-PS 1
What Happens When You Combine High School and College? The Impact of the Early College Model on Postsecondary Performance and Completion (2020)
Early colleges are a new model of schooling in which the high school and college experiences are merged, shortening the total amount of time a student spends in school. This study uses a lottery-based experimental design to examine the impact of the model on longer term outcomes, including attainment of a postsecondary credential and academic performance in 4-year institutions. Results show that a significantly higher proportion of early college students were attaining postsecondary credentials. The results also show that early college students were completing their degrees more rapidly but that their performance in 4-year institutions was still comparable with the control students. [For the corresponding grantee submission, see ED604350.]
Reviews of Individual Studies K 1
Racing against the Vocabulary Gap: Matthew Effects in Early Vocabulary Instruction and Intervention (2019)
We investigated whether individual differences in overall receptive vocabulary knowledge measured at the beginning of the year moderated the effects of a kindergarten vocabulary intervention that supplemented classroom vocabulary instruction. We also examined whether moderation would offset the benefits of providing Tier-2 vocabulary intervention within a multitiered-system-of-support (MTSS) or response-to-intervention framework. Participants included students from two previous studies identified as at risk for language and learning difficulties who were randomly assigned in clusters to receive small-group vocabulary intervention in addition to classroom vocabulary instruction (n = 825) or to receive classroom vocabulary instruction only (n = 781). A group of not-at-risk students (n = 741) who received classroom vocabulary instruction served as a reference group. Initial vocabulary knowledge measured at pretest moderated the impact of intervention on experimenter-developed measures of expressive vocabulary learning and listening comprehension favoring students with higher initial vocabulary knowledge. Tier-2 intervention substantially counteracted the Matthew effect for target word learning. Intervention effects on listening comprehension depended on students' initial vocabulary knowledge. Implications present benefits and challenges of supporting vocabulary learning within an MTSS framework.
Reviews of Individual Studies 6 1
Reappraising Academic and Social Adversity Improves Middle-School Students' Academic Achievement, Behavior, and Well-Being (2019)
The period of early adolescence is characterized by dramatic changes, simultaneously affecting physiological, psychological, social, and cognitive development. The physical transition from elementary to middle school can exacerbate the stress and adversity experienced during this critical life stage. Middle school students often struggle to find social and emotional support, and many students experience a decreased sense of belonging in school, diverting students from promising academic and career trajectories. Drawing on psychological insights for promoting belonging, we fielded a brief intervention designed to help students reappraise concerns about fitting in at the start of middle school as both temporary and normal. We conducted the first district-wide double-blind experimental study of this approach with middle-school students (N=1,304). Compared to the control condition activities, the intervention reduced sixth-grade disciplinary incidents across the district by 34%, increased attendance by 12%, and reduced the number of failing grades by 18%. Differences in benefits across demographic groups were not statistically significant but some impacts were descriptively larger for historically underserved minority students and boys. A mediational analysis suggested 80% of long-term intervention effects on students' GPA were accounted for by changes in students' attitudes and behaviors. These results demonstrate the long-term benefits of psychologically reappraising stressful experiences during critical transitions and the psychological and behavioral mechanisms that support them. Furthermore, this brief intervention is a highly cost-effective and scalable approach that schools may use to help address the troubling decline in positive attitudes and academic outcomes typically accompanying adolescence and the middle school transition. [This paper was published in "Proceeedings of the National Academy of Sciences" v116 p16286-16291 2019.]
Reviews of Individual Studies 3-8 1
Investigating Causal Effects of Arts Education Experiences: Experimental Evidence from Houston's Arts Access Initiative. Research Report for the Houston Independent School District. Volume 7, Issue 4 (2019)
The recent wave of test-based accountability reforms has negatively impacted the provision of K-12 arts educational experiences. Advocates contend that, in addition to providing intrinsic benefits, the arts can positively influence academic and social development. However, the empirical evidence to support such claims is limited. We conducted a randomized controlled trial with 10,548 3rd-8th grade students who were enrolled in 42 schools that were assigned by lottery to receive substantial influxes of arts education experiences provided through school-community partnerships with local arts organizations, cultural institutions, and teaching-artists. We find that these increases in arts educational experiences significantly reduce the proportion of students receiving disciplinary infractions by 3.6 percentage points, improve STAAR writing achievement by 0.13 of a standard deviation, and increase students' compassion for others by 0.08 of a standard deviation. For students in elementary schools, which comprise 86 percent of the sample, we find that these arts educational experiences also significantly improve school engagement, college aspirations, and arts-facilitated empathy. These findings provide strong evidence that arts educational experiences can produce significant positive impacts on student academic and social development. Policymakers should consider these multifaceted educational benefits when assessing the role and value of the arts in K-12 schools.
Reviews of Individual Studies 7 1
A Randomized Controlled Trial of Interleaved Mathematics Practice (2019)
We report the results of a preregistered, cluster randomized controlled trial of a mathematics learning intervention known as interleaved practice. Whereas most mathematics assignments consist of a block of problems devoted to the same skill or concept, an interleaved assignment is arranged so that no 2 consecutive problems require the same strategy. Previous small-scale studies found that practice assignments with a greater proportion of interleaved practice produced higher test scores. In the present study, we assessed the efficacy and feasibility of interleaved practice in a naturalistic setting with a large, diverse sample. Each of 54 7th-grade mathematics classes periodically completed interleaved or blocked assignments over a period of 4 months, and then both groups completed an interleaved review assignment. One month later, students took an unannounced test, and the interleaved group outscored the blocked group, 61% versus 38%, d 0.83. Teachers were able to implement the intervention without training, and they later expressed support for interleaved practice in an anonymous survey they completed before they knew the results of the study. Although important caveats remain, the results suggest that interleaved mathematics practice is effective and feasible.
Reviews of Individual Studies 7 1
Improving Student Learning of Ratio, Proportion, and Percent: A Replication Study of Schema-Based Instruction (2019)
The purpose of this replication study was to provide replication evidence not currently available of the effects of a research-based mathematics program, schema-based instruction, on the mathematical problem-solving performance of 7th-grade students. The replication was implemented in 36 schools in 5 districts; 59 mathematics teachers and their students (N = 1,492) participated in the study. Multilevel hierarchical linear analyses revealed statistically significant differences between conditions on proximal and distal measures of mathematics problem solving, with effects sizes similar to those reported in Jitendra et al. (2015).
Reviews of Individual Studies 9 1
A national experiment reveals where a growth mindset improves achievement. (2019)
Reviews of Individual Studies 9 1
Building Assets and Reducing Risks (BARR) Validation Study. Final Report (2019)
This is the final report of a large-scale independent evaluation of the Building Assets and Reducing Risks (BARR) model in ninth grade in eleven high schools in Maine, California, Minnesota, Kentucky, and Texas. This sample of schools included large and small schools in urban, suburban, and rural areas, serving students from a wide range of demographic and socio-economic backgrounds. Funded with a validation grant from the U.S. Department of Education's Investing in Innovation (i3) program and carried out by researchers at the American Institutes for Research (AIR), this evaluation used random assignment of ninth-grade students to BARR and control conditions to estimate the impacts of the BARR model after one year. The evaluation also assessed the fidelity of implementation of BARR in the eleven study schools and identified barriers to and facilitators of successful implementation. The evaluation focused on several teacher- and student-level outcomes. The teacher outcomes included measures of teacher collaboration, and use of data, among others. The academic outcomes included course failure, students' grade point average (GPA), and performance on the Northwest Evaluation Association's (NWEA) Measures of Academic Progress (MAP) standardized reading and mathematics assessments. Student-reported experiences included measures of supportive relationships, perceptions of teachers' expectations of them, student engagement, and others. In addition to these outcomes, the report includes impact estimates for attendance, suspensions, and persistence into 10th grade. [This report was written with Brenna O'Brien, Cheryl Graczewski, So Jung Park, Feng Liu, Ethan Adelman-Sil, Lynn Hu.]
Reviews of Individual Studies 12 1
Study of Enhanced College Advising in Upward Bound: Impacts on Steps toward College. NCEE 2019-4002 (2018)
The U.S. Department of Education tested a set of promising, low-cost advising strategies, called "Find the Fit," designed to help low-income and "first generation" students enrolled in the Department's Upward Bound program choose more selective colleges and stay in until they complete a degree. About 200 Upward Bound projects with 4,500 seniors agreed to participate. The projects were randomly assigned to receive "Find the Fit" to supplement their regular college advising (treatment group) or to offer their regular advising (control group). This first of three reports looks at "Find the Fit's" effects on students' steps toward enrolling in a more selective college. The study found that the enhanced advising increased the number and selectivity of colleges to which students applied. [For the study snapshot, "Study of Enhanced College Advising in Upward Bound: Impacts on Steps toward College. Study Snapshot. NCEE 2019-4002," see ED588785. For the study highlights, "Study of Enhanced College Advising in Upward Bound: Impacts on Steps toward College. Study Highlights. NCEE 2019-4002," see ED588786.]
Reviews of Individual Studies 1 1
The Impacts of Reading Recovery at Scale: Results from the 4-Year i3 External Evaluation (2018)
Reading Recovery is an example of a widely used early literacy intervention for struggling first-grade readers, with a research base demonstrating evidence of impact. With funding from the U.S. Department of Education's i3 program, researchers conducted a 4-year evaluation of the national scale-up of Reading Recovery. The evaluation included an implementation study and a multisite randomized controlled trial with 6,888 participating students in 1,222 schools. The goal of this study was to understand whether the impacts identified in prior rigorous studies of Reading Recovery could be replicated in the context of a national scale-up. The findings of this study reaffirm prior evidence of Reading Recovery's immediate impacts on student literacy and support the feasibility of successfully scaling up an effective intervention.
Reviews of Individual Studies K-5 1
A Randomized Waitlist Controlled Analysis of Team-Initiated Problem Solving Professional Development and Use (2018)
Data-based problem solving is a hallmark of research-supported practices such as positive behavioral interventions and supports. In this study, we provided members of positive behavioral interventions and supports (PBIS) teams from 38 elementary schools with professional development focused on a research-supported problem-solving model (Team-Initiated Problem Solving). We used direct observations to document procedures, practices, and outcomes before and after participating in the professional development workshop. Within the context of a randomized waitlist controlled trial, team members in the Immediate Group demonstrated greater improvement in (a) problem-solving procedures, (b) decision-making practices, and (c) meeting outcomes than did members of PBIS teams in the Waitlist Group. Our findings extend what is known about team-based problem solving and provide a framework for future research and improved practice related to decision making by school teams.
Reviews of Individual Studies K-4 1
Acquiring Science and Social Studies Knowledge in Kindergarten through Fourth Grade: Conceptualization, Design, Implementation, and Efficacy Testing of Content-Area Literacy Instruction (CALI) (2017)
With national focus on reading and math achievement, science and social studies have received less instructional time. Yet, accumulating evidence suggests that content knowledge is an important predictor of proficient reading. Starting with a design study, we developed content-area literacy instruction (CALI) as an individualized (or personalized) instructional program for kindergarteners through 4th graders to build science and social studies knowledge. We developed CALI to be implemented in general education classrooms, over multiple iterations (n = 230 students), using principles of design-based implementation research. The aims were to develop CALI as a usable and feasible instructional program that would, potentially, improve science and social studies knowledge, and could be implemented during the literacy block without negatively affecting students' reading gains (i.e., no opportunity cost). We then evaluated the efficacy of CALI in a randomized controlled field trial with 418 students in kindergarten through 4th grade. Results reveal that CALI demonstrates promise as a usable and feasible instructional individualized general education program, and is efficacious in improving social studies (d = 2.2) and science (d = 2.1) knowledge, with some evidence of improving oral and reading comprehension skills (d = 0.125).
Reviews of Individual Studies K-8 1
Effects of Dual-Language Immersion Programs on Student Achievement: Evidence from Lottery Data (2017)
Using data from seven cohorts of language immersion lottery applicants in a large, urban school district, we estimate the causal effects of immersion programs on students' test scores in reading, mathematics, and science, and on English learners' (EL) reclassification. We estimate positive intent-to-treat (ITT) effects on reading performance in fifth and eighth grades, ranging from 13 to 22 percent of a standard deviation, reflecting 7 to 9 months of learning. We find little benefit in terms of mathematics and science performance, but also no detriment. By sixth and seventh grade, lottery winners' probabilities of remaining classified as EL are three to four percentage points lower than those of their counterparts. This effect is stronger for ELs whose native language matches the partner language. [This article was published in: "American Educational Research Journal" v54 n1 suppl p282S-306S Apr 2017 (EJ1155308).]
Reviews of Individual Studies K 1
Testing the Efficacy of a Kindergarten Mathematics Intervention by Small Group Size (2017)
This study used a randomized controlled trial design to investigate the ROOTS curriculum, a 50-lesson kindergarten mathematics intervention. Ten ROOTS-eligible students per classroom (n = 60) were randomly assigned to one of three conditions: a ROOTS five-student group, a ROOTS two-student group, and a no-treatment control group. Two primary research questions were investigated as part of this study: What was the overall impact of the treatment (the ROOTS intervention) as compared with the control (business as usual)? Was there a differential impact on student outcomes between the two treatment conditions (two- vs. five-student group)? Initial analyses for the first research question indicated a significant impact on three outcomes and positive but nonsignificant impacts on three additional measures. Results for the second research question, comparing the two- and five-student groups, indicated negligible and nonsignificant differences. Implications for practice are discussed. [For the corresponding grantee submission, see ED578431.]
Reviews of Individual Studies 9-PS 1
Smoothing the Transition to Postsecondary Education: The Impact of the Early College Model (2017)
Developed in response to concerns that too few students were enrolling and succeeding in postsecondary education, early college high schools are small schools that blur the line between high school and college. This article presents results from a longitudinal experimental study comparing outcomes for students accepted to an early college through a lottery process with outcomes for students who were not accepted through the lottery and enrolled in high school elsewhere. Results show that treatment students attained significantly more college credits while in high school, and graduated from high school, enrolled in postsecondary education, and received postsecondary credentials at higher rates. Results for subgroups are included.
Reviews of Individual Studies 9-PS 1
Smoothing the Transition to Postsecondary Education: The Impact of the Early College Model (2017)
Developed in response to concerns that too few students were enrolling and succeeding in postsecondary education, early college high schools are small schools that blur the line between high school and college. This article presents results from a longitudinal experimental study comparing outcomes for students accepted to an early college through a lottery process with outcomes for students who were not accepted through the lottery and enrolled in high school elsewhere. Results show that treatment students attained significantly more college credits while in high school, and graduated from high school, enrolled in postsecondary education, and received postsecondary credentials at higher rates. Results for subgroups are included. [This paper was published in the "Journal of Research on Educational Effectiveness" (EJ1135800)]
Reviews of Individual Studies 9-PS 1
Smoothing the Transition to Postsecondary Education: The Impact of the Early College Model (2017)
Developed in response to concerns that too few students were enrolling and succeeding in postsecondary education, early college high schools are small schools that blur the line between high school and college. This article presents results from a longitudinal experimental study comparing outcomes for students accepted to an early college through a lottery process with outcomes for students who were not accepted through the lottery and enrolled in high school elsewhere. Results show that treatment students attained significantly more college credits while in high school, and graduated from high school, enrolled in postsecondary education, and received postsecondary credentials at higher rates. Results for subgroups are included. [This paper was published in the "Journal of Research on Educational Effectiveness" (EJ1135800)]
Reviews of Individual Studies 12 1
Pathways after High School: Evaluation of the Urban Alliance High School Internship Program. Research Report (2017)
Senior year of high school can be a pivotal time in a young person's life. For some, it is the last step on the path to college and work. For others, finding stable employment or attending university after high school is far from guaranteed. Urban Alliance, headquartered in Washington, DC, helps students at risk of becoming disconnected from work or school transition to higher education or employment after high school. Through its High School Internship Program, it offers participating high school seniors training, an internship, and mentoring to help them succeed. The Urban Institute recently completed an evaluation of the program in Washington, DC, and Baltimore. Using an experimental design, the study revealed several key findings approximately two years after high school.
Reviews of Individual Studies 11-PS 1
The bottom line on college counseling (2017)
Reviews of Individual Studies 9 1
I3 BARR Validation Study (2017)
Reviews of Individual Studies 7-12 1
UC Irvine Writing Project’s Pathway to Academic Success program: An Investing in Innovation (i3) validation grant evaluation. Technical report. (2017)
Reviews of Individual Studies 6-8 1
Engaging Struggling Adolescent Readers to Improve Reading Skills (2017)
This study examined the efficacy of a supplemental, multicomponent adolescent reading intervention for middle school students who scored below proficient on a state literacy assessment. Using a within-school experimental design, the authors randomly assigned 483 students in grades 6-8 to a business-as-usual control condition or to the Strategic Adolescent Reading Intervention (STARI), a supplemental reading program involving instruction to support word-reading skills, fluency, vocabulary, and comprehension, and peer talk to promote reading engagement and comprehension. The authors assessed behavioral engagement by measuring how much of the STARI curricular activities students completed during an academic school year, and collected intervention teachers' ratings of their students' reading engagement. STARI students outperformed control students on measures of word recognition (Cohen's d = 0.20), efficiency of basic reading comprehension (Cohen's d = 0.21), and morphological awareness (Cohen's d = 0.18). Reading engagement in its behavioral form, as measured by students' participation and involvement in the STARI curriculum, mediated the treatment effects on each of these three posttest outcomes. Intervention teachers' ratings of their students' emotional and cognitive engagement explained unique variance on reading posttests. Findings from this study support the hypothesis that (a) behavioral engagement fosters struggling adolescents' reading growth, and (b) teachers' perceptions of their students' emotional and cognitive engagement further contribute to reading competence.
Reviews of Individual Studies 6-11 1
Texting Parents: Evaluation Report and Executive Summary (2017)
This report presents the findings from an efficacy trial and process evaluation of the Parent Engagement Programme (PEP). The PEP was a school-level intervention designed to improve pupil outcomes by engaging parents in their children's learning. The programme was developed collaboratively by research teams from the University of Bristol and Harvard University and was delivered between September 2014 and July 2015. The study was conducted by the Centre for Effective Education, Queen's University Belfast between February 2014 and February 2016. The trial involved 15,697 students in Years 7, 9, and 11 from 36 English secondary schools, with schools sending an average of 30 texts to each parent over the period of the trial. The developers of the intervention managed its delivery to ensure optimal implementation. It was a cluster randomised controlled trial with randomisation at the Key Stage level, designed to determine the impact of the intervention on the academic outcomes of students in English, maths, and science, and the impact on absenteeism. A process evaluation used focus groups, telephone surveys, interviews, and an online survey to provide data on implementation and to capture the perceptions and experiences of participating parents, pupils, and teachers. Key conclusions include: (1) Children who had the intervention experienced about one month of additional progress in maths compared to other children. This positive result is unlikely to have occurred by chance; (2) Children who had the intervention had reduced absenteeism compared to other children. This positive result is unlikely to have occurred by chance; (3) Children who had the intervention appeared to experience about one month of additional progress in English compared to other children. However, analysis suggests that this finding might have been affected by bias introduced by missing data, so evaluators cannot reliably draw this conclusion. There is no evidence to suggest that the intervention had an impact on science attainment; (4) Schools embraced the programme and liked its immediacy and low cost. Many respondents felt that the presence of a dedicated coordinator would be valuable to monitor the accuracy and frequency of texts. Schools should consider whether they would be able to provide this additional resource; and (5) The vast majority of parents were accepting of the programme, including the content, frequency, and timing of texts. [Note: The post-reporting appendix was added in June 2017.]
Reviews of Individual Studies 4-5 1
The Effect of an Analysis-of-Practice, Videocase-Based, Teacher Professional Development Program on Elementary Students' Science Achievement (2017)
This article describes the effects of an analysis-of-practice professional development (PD) program on elementary school students' (Grades 4-6) science outcomes. The study design was a cluster-randomized trial with an analysis sample of 77 schools, 144 teachers and 2,823 students. Forty-two schools were randomly assigned to treatment, (88.5 hours) of integrated analysis-of-practice and content deepening PD (over the course of one year) while 35 schools were randomly assigned to receive an equal number of PD hours in science content deepening alone. Students' content knowledge, as measured by a project-specific test, was compared across treatment groups. The effect size for this comparison was 0.52 standard deviations in favor of students whose teachers participated in the PD that included analysis-of-practice. This effect compares favorably to that of other elementary school interventions whose effectiveness was studied with a narrowly focused outcome measure. Analysis of the demographics of the study schools suggests that the treatment effect could be relevant outside the local study context. Implications for future research include tests of mediation for teacher-level outcomes and efficacy tests of specific teaching strategies (intervention subcomponents).
Reviews of Individual Studies 5-PS 1
Stand and deliver: Effects of Boston’s charter high schools on college preparation, entry, and choice. (2016)
Reviews of Individual Studies 7 1
Online Mathematics Homework Increases Student Achievement (2016)
In a randomized field trial with 2,850 seventh-grade mathematics students, we evaluated whether an educational technology intervention increased mathematics learning. Assigning homework is common yet sometimes controversial. Building on prior research on formative assessment and adaptive teaching, we predicted that combining an online homework tool with teacher training could increase learning. The online tool ASSISTments (a) provides timely feedback and hints to students as they do homework and (b) gives teachers timely, organized information about students' work. To test this prediction, we analyzed data from 43 schools that participated in a random assignment experiment in Maine, a state that provides every seventh-grade student with a laptop to take home. Results showed that the intervention significantly increased student scores on an end-of-the-year standardized mathematics assessment as compared with a control group that continued with existing homework practices. Students with low prior mathematics achievement benefited most. The intervention has potential for wider adoption. [For the corresponding grantee submission, see ED575159.]
Reviews of Individual Studies 9 1
i3 BARR validation study impact findings: Cohort 1. (2016)
Reviews of Individual Studies 1 1
Examining the Efficacy of a Multitiered Intervention for At-Risk Readers in Grade 1 (2016)
This study reports the results of a cluster RCT evaluating the impact of Enhanced Core Reading Instruction on reading achievement of grade 1 at-risk readers. Forty-four elementary schools, blocked by district, were randomly assigned to condition. In both conditions, at-risk readers received 90 minutes of whole-group instruction (Tier 1) plus an additional 30 minutes of daily, small-group intervention (Tier 2). In the treatment condition, Tier 1 instruction included enhancements to the core program and Tier 2 intervention was highly aligned with the core program. In the comparison condition, Tier 1 instruction used the same core program as treatment schools in the district and Tier 2 intervention followed standard district protocol. Significant treatment effects were found on measures of phonemic decoding and oral reading fluency from fall to winter and word reading from fall to spring. Student- and classroom-level variables predicted student response to instruction differentially by condition.
Reviews of Individual Studies K-2 1
The Results of a Randomized Control Trial Evaluation of the SPARK Literacy Program (2016)
The purpose of this report is to present the results of a two-year randomized control trial evaluation of the SPARK literacy program. SPARK is an early grade literacy program developed by Boys & Girls Clubs of Greater Milwaukee. In 2010, SPARK was awarded an Investing in Innovation (i3) Department of Education grant to further develop the program and test its impact in seven Milwaukee Public Schools (MPS). The evaluation used a randomized control trial selection to test the impact of SPARK across three domains: reading achievement, literacy, and school attendance. Informed consent was obtained from 576 parents for their students to participate in the study. A random sample of kindergarten, 1st, and 2nd grade students in seven MPS schools was selected in October and November of 2013 to participate. 286 students were randomly selected as SPARK participants and 290 students were randomly selected as control students. Stratification was done by school and grade level within school. The specific number of students selected to receive SPARK within each strata was determined both by the number of consented students and the capacity to serve students within each site. Students with a reading-related IEP or who were English Language Learners were not eligible to participate in the evaluation but were eligible to receive tutoring. All other students were eligible to participate. The results suggest that SPARK had statistically significant, positive impacts on reading achievement, literacy, and regular school day attendance. Tables are appended. [SREE documents are structured abstracts of SREE conference symposium, panel, and paper or poster submissions.]
Reviews of Individual Studies K-3 1
New Mexico StartSmart K-3 Plus validation study. Evaluator's report. (2015)
Reviews of Individual Studies K-4 1
Scaling up the Success for All: Model of School Reform. Final Report from the Investing in Innovation (i3) Evaluation (2015)
Success for All (SFA), one of the best-known school reform models, aims to improve the reading skills of all children but is especially directed at schools that serve large numbers of students from low-income families. First implemented in 1987, SFA combines a challenging reading program, whole-school reform elements, and an emphasis on continuous improvement, with the goal of ensuring that every child learns to read well in the elementary grades. This is the third and final report from an independent evaluation of the scale-up demonstration of the SFA elementary school reading program. Both the demonstration and the evaluation have been funded under the U.S. Department of Education's Investing in Innovation (i3) competition. Conducted by MDRC--a nonprofit, nonpartisan education and social policy research organization--the evaluation examines SFA's implementation and impacts in five school districts over a three-year period (the 2011-2012 school year through the 2013-2014 school year). It also includes an analysis of program costs. Finally, it considers the scale-up process itself--the methods employed and the extent to which the Success for All Foundation (SFAF), the organization that developed and provides technical assistance to schools operating the program, achieved its scale-up goals. [This report was written with Emma Alterman, Herbert Collado, and Emily Pramik. For the executive summary of this report, see ED579090. For the Early Findings report, see ED545452. For the Interim Report, see ED546642.]
Reviews of Individual Studies 1 1
Year One Results from the Multisite Randomized Evaluation of the i3 Scale-Up of Reading Recovery (2015)
Reading Recovery (RR) is a short-term, one-to-one intervention designed to help the lowest achieving readers in first grade. This article presents first-year results from the multisite randomized controlled trial (RCT) and implementation study under the $55 million Investing in Innovation (i3) Scale-Up Project. For the 2011-2012 school year, the estimated standardized effect of RR on students' Iowa Tests of Basic Skills (ITBS) Total Reading Scores was 0.69 standard deviations relative to the population of struggling readers eligible for RR under the i3 scale-up and 0.47 standard deviations relative to the nationwide population of all first graders. School-level implementation of RR was, in most respects, faithful to the RR "Standards and Guidelines," and the intensive training provided to new RR teachers was viewed as critical to successful implementation.
Reviews of Individual Studies 10 1
An Efficacy Trial of Research-Based Curriculum Materials with Curriculum-Based Professional Development (2015)
This study examined the efficacy of a curriculum-based intervention for high school science students. Specifically, the intervention was two years of research-based, multidisciplinary curriculum materials for science supported by comprehensive professional development for teachers that focused on those materials. A modest positive effect was detected when comparing outcomes from this intervention to those of business-as-usual materials and professional development. However, this effect was typical for interventions at this grade span that are tested using a state achievement test. Tests of mediation suggest a large treatment effect on teachers and in turn a strong effect of teacher practice on student achievement--reinforcing the hypothesized key role of teacher practice. Tests of moderation indicate no significant treatment by demographic interactions.
Reviews of Individual Studies 2 1
Efficacy of the Social Skills Improvement System Classwide Intervention Program (SSIS-CIP) Primary Version (2015)
A multisite cluster randomized trial was conducted to examine the effects of the Social Skills Improvement System Classwide Intervention Program (SSIS-CIP; Elliott & Gresham, 2007) on students' classroom social behavior. The final sample included 432 students across 38 second grade classrooms. Social skills and problem behaviors were measured via the SSIS rating scale for all participants, and direct observations were completed for a subsample of participants within each classroom. Results indicated that the SSIS-CIP demonstrated positive effects on teacher ratings of participants' social skills and internalizing behaviors, with the greatest changes occurring in classrooms with students who exhibited lower skill proficiency prior to implementation. Statistically significant differences were not observed between treatment and control participants on teacher ratings of externalizing problem behaviors or direct observation.
Reviews of Individual Studies 2-5 1
Mobilizing Volunteer Tutors to Improve Student Literacy: Implementation, Impacts, and Costs of the Reading Partners Program (2015)
This study reports on an evaluation of the "Reading Partners" program, which uses community volunteers to provide one-on-one tutoring to struggling readers in underresourced elementary schools. Established in 1999 in East Menlo Park, California, the mission of "Reading Partners" is to help children become lifelong readers by empowering communities to provide individualized instruction with measurable results. This report builds on those initial findings by describing the "Reading Partners" program and its implementation in greater detail, exploring whether the program is more or less effective for particular subgroups of students, and assessing some of the potential explanations for the program's success to date. In addition, this report includes an analysis of the cost of implementing the Reading Partners program in 6 of the 19 sites. The following are appended: (1) Implementation Study Methods; (2) Impact Study Methods and Teacher Survey; (3) Tutor Background Characteristics and Additional Impact Findings; (4) Cost Study Methods; and (5) Additional Cost Findings. [This report was written with A. Brooks Bowden and Yilin Pan.]
Reviews of Individual Studies 9-10 1
Not too late: Improving academic outcomes for disadvantaged youth (Working paper WP-15-01) (2015)
Reviews of Individual Studies 9-12 1
Academic Impacts of Career and Technical Schools (2015)
This study presents findings from three cohorts of students--the classes of 2003, 2004, and 2005, in the School District of Philadelphia--that were admitted to the district's career and technical education (CTE) schools through a randomized lottery process. This study takes advantage of this so-called "'natural experiment' to compare high school academic outcomes for" lottery applicants who were admitted with those for students who did not receive an acceptance. Results find that CTE students had significantly better outcomes in terms of graduation rates, credit accumulation, and the successful completion of the college preparatory mathematics sequence algebra 1, algebra 2, and geometry. Results for other outcomes such as the completion of science and foreign language course sequences, overall grade point average, and mathematics and reading comprehension achievement, were inconsistent across cohorts and statistical tests, neither favoring nor against students accepted to CTE schools.
Reviews of Individual Studies 8 1
Professional development in self-regulated strategy development: Effects on the writing performance of eighth grade Portuguese students. (2015)
Reviews of Individual Studies 7-8 1
The impact of eMINTS professional development on teacher instruction and student achievement. Year 3 report. (2015)
Reviews of Individual Studies 6-8 1
Understanding the Effect of KIPP as It Scales: Volume I, Impacts on Achievement and Other Outcomes. Final Report of KIPP's "Investing in Innovation Grant Evaluation" (2015)
KIPP (Knowledge is Power Program) is a national network of public charter schools whose stated mission is to help underserved students enroll in and graduate from college. Prior studies (see Tuttle et al. 2013) have consistently found that attending a KIPP middle school positively affects student achievement, but few have addressed longer-term outcomes and no rigorous research exists on impacts of KIPP schools at levels other than middle school. In this first high-quality study to rigorously examine the impacts of the network of KIPP public charter schools at all elementary and secondary grade levels, Mathematica found that KIPP schools have positive impacts on student achievement, particularly at the elementary and middle school levels. In addition, the study found positive impacts on student achievement for new entrants to the KIPP network in high school. For students continuing from a KIPP middle school, KIPP high schools' impacts on student achievement are not statistically significant, on average (in comparison to students who did not have the option to attend a KIPP high school and instead attended a mix of other non-KIPP charter, private, and traditional public high schools). Among these continuing students, KIPP high schools have positive impacts on several aspects of college preparation, including more discussions about college, increased likelihood of applying to college, and more advanced coursetaking. This report provides detailed findings and also includes the following appendices: (1) List of KIPP Schools In Network; (2) Detail on Survey Outcomes; (3) Cumulative Middle and High School Results; (4) Detailed Analytic Methods: Elementary School (Lottery-Based Analyses); (5) Detailed Analytic Methods: Middle School (Lottery-Based Analyses); (6) Understanding the Effects of KIPP As It Scales Mathematica Policy Research; (7) Detailed Analytic Methods: Middle School (Matched-Student Analyses); (8) Detailed Analytic Methods: High School (Matched-Student Analyses); (9) Detailed Analytic Methods: High School (Matched-School Analyses); and (10) Detailed Tables For What Works Clearinghouse Review. [For the executive summary, see ED560080; for the focus brief, see ED560043.]
Reviews of Individual Studies 7-12 1
School engagement mediates long-term prevention effects for Mexican American adolescents. (2014)
Reviews of Individual Studies 6 1
The Effects of Math Video Games on Learning: A Randomized Evaluation Study with Innovative Impact Estimation Techniques. CRESST Report 841 (2014)
A large-scale randomized controlled trial tested the effects of researcher-developed learning games on a transfer measure of fractions knowledge. The measure contained items similar to standardized assessments. Thirty treatment and 29 control classrooms (~1500 students, 9 districts, 26 schools) participated in the study. Students in treatment classrooms played fractions games and students in the control classrooms played solving equations games. Multilevel multidimensional item response theory modeling of the outcome measure produced scaled scores that were more sensitive to the instructional treatment than standard measurement approaches. Hierarchical linear modeling of the scaled scores showed that the treatment condition performed significantly higher on the outcome measure than the control condition. The effect (d = 0.58) was medium to large (Cohen, 1992). Two appendices are included: (1) Descriptive Statistics of Pretest and Posttest Scores by Schools and Conditions; and (2) Summary of Efficacy Trial Procedures.
Reviews of Individual Studies 5-12 1
Stand and Deliver: Effects of Boston's Charter High Schools on College Preparation, Entry, and Choice (2014)
One of the most important questions in education research is whether the gains from interventions for which perceived short-term success can be sustained. The possibility of short-lived impacts is especially relevant for research on charter schools, where charter operators who face high-stakes assessments have an incentive to "teach to the test." The fact that charters are subject to intense scrutiny and evaluation may even create incentives for cheating (Jacob and Levitt, 2003), strategic instruction (Jacob, 2007), and a focus on small groups of students that are pivotal for official accountability measures (Neal and Schanzenbach, 2010). The purpose of this paper is to assess the impact of attendance at Boston's charter high schools on outcomes where the link with human capital and future earnings seems likely to be sustained and strong. Specifically, the authors focus on outcomes that are either essential to or facilitate post-secondary schooling: high school graduation, the attainment of state competency thresholds, scholarship qualification, Advanced Placement (AP) and SAT scores, college enrollment, and college persistence. Importantly, most of these outcomes are less subject to strategic manipulation than are the state's test-based assessments. As in earlier work, the research design implemented here exploits randomized enrollment lotteries at oversubscribed charter schools. The resulting estimates are likely to provide reliable measures of average causal effects for charter applicants. Six tables are appended.
Reviews of Individual Studies 12-PS 1
The Forgotten Summer: Does the Offer of College Counseling after High School Mitigate Summer Melt among College-Intending, Low-Income High School Graduates? (2014)
Despite decades of policy intervention to increase college entry and success among low-income students, considerable gaps by socioeconomic status remain. To date, policymakers have overlooked the summer after high school as an important time period in students' transition to college, yet recent research documents high rates of summer attrition from the college pipeline among college-intending high school graduates, a phenomenon we refer to as "summer melt." We report on two randomized trials investigating efforts to mitigate summer melt. Offering college-intending graduates two to three hours of summer support increased enrollment by 3 percentage points overall, and by 8 to 12 percentage points among low-income students, at a cost of $100 to $200 per student. Further, summer support has lasting impacts on persistence several semesters into college.
Reviews of Individual Studies K-3 1
The Iterative Development and Initial Evaluation of "We Have Skills!", An Innovative Approach to Teaching Social Skills to Elementary Students (2014)
We describe the development and initial evaluation of the efficacy of "We Have Skills!" (WHS), a video-based social skills instructional program for early elementary school students. The components of WHS were designed to be scientifically sound, maximally useful to elementary school teachers, and effective in increasing students' social skills. Results from feasibility and social validity testing showed that teachers felt the program was easy to implement and highly recommended its use. The initial efficacy evaluation of WHS conducted with 70 classrooms randomly assigned to intervention and control conditions showed that teachers in the intervention group scored significantly higher on self-efficacy than teachers in the control group. Students in the intervention classrooms were rated significantly higher on key social skills by their teachers at posttest compared to students in the control group. Implications for further testing of WHS are discussed, along with study limitations and recommendations for future research and practice.
Reviews of Individual Studies PK-K 1
Cluster (School) RCT of ParentCorps: Impact on kindergarten academic achievement. (2013)
Reviews of Individual Studies 9-12 1
Sustained Progress: New Findings about the Effectiveness and Operation of Small Public High Schools of Choice in New York City (2013)
In 2002, New York City embarked on an ambitious and wide-ranging series of education reforms. At the heart of its high school reforms were three interrelated changes: the institution of a district wide high school choice process for all rising ninth-graders, the closure of 31 large, failing high schools with an average graduation rate of 40 percent, and the opening of more than 200 new small high schools. Over half of the new small schools created between the fall of 2002 and the fall of 2008 were intended to serve students in some of the district's most disadvantaged communities and are located mainly in neighborhoods where large, failing high schools had been closed. MDRC has previously released two reports on these "small schools of choice," or SSCs (so called because they are small, are academically nonselective, and were created to provide a realistic choice for students with widely varying academic backgrounds). Those reports found marked increases in progress toward graduation and in graduation rates for the cohorts of students who entered SSCs in the falls of 2005 and 2006. The second report also found that the increase in graduation rates applied to every student subgroup examined, and that SSC graduation effects were sustained even after five years from the time sample members entered high school. This report updates those previous findings with results from a third cohort of students, those who entered ninth grade in the fall of 2007. In addition, for the first time it includes a look inside these schools through the eyes of principals and teachers, as reported in interviews and focus groups held at the 25 SSCs with the strongest evidence of effectiveness. In brief, the report's findings are: (1) SSCs in New York City continue to markedly increase high school graduation rates for large numbers of disadvantaged students of color, even as graduation rates are rising at the schools with which SSCs are compared; (2) The best evidence that exists indicates that SSCs may increase graduation rates for two new subgroups for which findings were not previously available: special education students and English language learners. However, given the still-limited sample sizes for these subgroups, the evidence will not be definitive until more student cohorts can be added to the analysis; and (3) Principals and teachers at the 25 SSCs with the strongest evidence of effectiveness strongly believe that academic rigor and personal relationships with students contribute to the effectiveness of their schools. They also believe that these attributes derive from their schools' small organizational structures and from their committed, knowledgeable, hardworking, and adaptable teachers. Appended are: (1) Sample, Data, and Analysis; (2) Estimated Effects of Winning a Student's First SSC Lottery; (3) 2008 Requirements for Proposals to Create New SSCs Specified by the New York City Department of Education; and (4) Documentation for Interviews and Focus Groups.
Reviews of Individual Studies 1-3 1
A longitudinal cluster-randomized controlled study on the accumulating effects of individualized literacy instruction on students’ reading from first through third grade (2013)
Reviews of Individual Studies 1-12 1
Expanding College Opportunities (2013)
For this study, the authors designed an experiment to test whether some high-achieving, low-income students would change their behavior if they knew more about colleges and, more importantly, whether a cost-effective way to help such students realize their full array of college opportunities can be implemented. This was done by randomly assigning interventions that provide different types of information to roughly 18,000 students, including 3,000 students who serve as controls. The most comprehensive form of the intervention, which is called the Expanding College Opportunities-Comprehensive (ECO-C) Intervention, combined application guidance, semicustomized information about the net cost of attending different colleges, and no-paperwork application fee waivers. Expanding College Opportunities Project was designed to to test several hypotheses about why most high-achieving, low-income students do not apply to and attend selective colleges. The application guidance component of ECO-C provides the kind of advice that an expert college counselor would give a high-achieving student. An expert counselor would advise such a student to apply to eight or more colleges, including a combination of "safety," "match," and "reach" colleges. The authors call this group of colleges that are within an appropriate range for a given student's achievement "peer" colleges. Using random assignment of thousands of students, the authors successfully demonstrated that a low-cost, fully scalable intervention can help many high-achieving, low-income students recognize their full array of college opportunities.
Reviews of Individual Studies 1 1
Evaluation of the i3 scale-up of Reading Recovery year one report, 2011–12. (2013)
Reading Recovery (RR) is a short-term early intervention designed to help the lowest-achieving readers in first grade reach average levels of classroom performance in literacy. Students identified to receive Reading Recovery meet individually with a specially trained Reading Recovery (RR) teacher every school day for 30-minute lessons over a period of 12 to 20 weeks. The purpose of these lessons is to support rapid acceleration of each child's literacy learning. In 2010, The Ohio State University received a Scaling Up What Works grant from the U.S. Department of Education's Investing in Innovation (i3) Fund to expand the use of Reading Recovery across the country. The award was intended to fund the scale-up of Reading Recovery by training 3,675 new RR Teachers in U.S. schools, thereby expanding capacity to allow service to an additional 88,200 students. The Consortium for Policy Research in Education (CPRE) was contracted to conduct an independent evaluation of the i3 scale up of Reading Recovery over the course of five years. The evaluation includes parallel rigorous experimental and quasi-experimental designs for estimating program impacts, coupled with a large-scale mixed-methods study of program implementation under the i3 scale-up. This report presents findings through the second year of the evaluation. The primary goals of this evaluation were: (1) to assess the success of the scale-up in meeting the i3 grant's expansion goals; (2) to document the implementation of scale-up and fidelity to program standards; and (3) to provide experimental evidence of the impacts of Reading Recovery on student learning under this scale-up effort. This document is the first in a series of three annual reports produced based on our external evaluation of the Reading Recovery i3 Scale-Up. This report presents early results from the experimental impact and implementation studies conducted over the 2010-11 and 2011-12 school years. An appendix includes: Statistical Model for Impacts of Reading Scores. [For "WWC Review of the Report 'Evaluation of the i3 Scale-up of Reading Recovery Year One Report, 2011-12.' What Works Clearinghouse Single Study Review," see ED547670.]
Reviews of Individual Studies 1 1
Effects of First-Grade Number Knowledge Tutoring with Contrasting Forms of Practice (2013)
The purpose of this study was to investigate the effects of 1st-grade number knowledge tutoring with contrasting forms of practice. Tutoring occurred 3 times per week for 16 weeks. In each 30-min session, the major emphasis (25 min) was number knowledge; the other 5 min provided practice in 1 of 2 forms. Nonspeeded practice reinforced relations and principles addressed in number knowledge tutoring. Speeded practice promoted quick responding and use of efficient counting procedures to generate many correct responses. At-risk students were randomly assigned to number knowledge tutoring with speeded practice (n = 195), number knowledge tutoring with nonspeeded practice (n = 190), and control (no tutoring, n = 206). Each tutoring condition produced stronger learning than control on all 4 mathematics outcomes. Speeded practice produced stronger learning than nonspeeded practice on arithmetic and 2-digit calculations, but effects were comparable on number knowledge and word problems. Effects of both practice conditions on arithmetic were partially mediated by increased reliance on retrieval, but only speeded practice helped at-risk children compensate for weak reasoning ability. (Contains 7 tables, 2 figures and 6 footnotes.)
Reviews of Individual Studies 1 1
Effects of First-Grade Number Knowledge Tutoring with Contrasting Forms of Practice (2013)
The purpose of this study was to investigate the effects of 1st-grade number knowledge tutoring with contrasting forms of practice. Tutoring occurred 3 times per week for 16 weeks. In each 30-min session, the major emphasis (25 min) was number knowledge; the other 5 min provided practice in 1 of 2 forms. Nonspeeded practice reinforced relations and principles addressed in number knowledge tutoring. Speeded practice promoted quick responding and use of efficient counting procedures to generate many correct responses. At-risk students were randomly assigned to number knowledge tutoring with speeded practice (n = 195), number knowledge tutoring with nonspeeded practice (n = 190), and control (no tutoring, n = 206). Each tutoring condition produced stronger learning than control on all 4 mathematics outcomes. Speeded practice produced stronger learning than nonspeeded practice on arithmetic and 2-digit calculations, but effects were comparable on number knowledge and word problems. Effects of both practice conditions on arithmetic were partially mediated by increased reliance on retrieval, but only speeded practice helped at-risk children compensate for weak reasoning ability. (Contains 7 tables, 2 figures and 6 footnotes.)
Reviews of Individual Studies 1 1
Effects of First-Grade Number Knowledge Tutoring with Contrasting Forms of Practice (2013)
The purpose of this study was to investigate the effects of 1st-grade number knowledge tutoring with contrasting forms of practice. Tutoring occurred 3 times per week for 16 weeks. In each 30-min session, the major emphasis (25 min) was number knowledge; the other 5 min provided practice in 1 of 2 forms. Nonspeeded practice reinforced relations and principles addressed in number knowledge tutoring. Speeded practice promoted quick responding and use of efficient counting procedures to generate many correct responses. At-risk students were randomly assigned to number knowledge tutoring with speeded practice (n = 195), number knowledge tutoring with nonspeeded practice (n = 190), and control (no tutoring, n = 206). Each tutoring condition produced stronger learning than control on all 4 mathematics outcomes. Speeded practice produced stronger learning than nonspeeded practice on arithmetic and 2-digit calculations, but effects were comparable on number knowledge and word problems. Effects of both practice conditions on arithmetic were partially mediated by increased reliance on retrieval, but only speeded practice helped at-risk children compensate for weak reasoning ability. (Contains 7 tables, 2 figures and 6 footnotes.)
Reviews of Individual Studies 5-6 1
KIPP Middle Schools: Impacts on Achievement and Other Outcomes. Final Report (2013)
The Knowledge Is Power Program (KIPP) is a rapidly expanding network of public charter schools whose mission is to improve the education of low-income children. As of the 2012-2013 school year, 125 KIPP schools are in operation in 20 different states and the District of Columbia (DC). Ultimately, KIPP's goal is to prepare students to enroll and succeed in college. Prior research has suggested that KIPP schools have positive impacts on student achievement, but most of the studies have included only a few KIPP schools or have had methodological limitations. This is the second report of a national evaluation of KIPP middle schools being conducted by Mathematica Policy Research. The evaluation uses experimental and quasi-experimental methods to produce rigorous and comprehensive evidence on the effects of KIPP middle schools across the country. The study's first report, released in 2010, described strong positive achievement impacts in math and reading for the 22 KIPP middle schools for which data were available at the time. For this phase of the study, the authors nearly doubled the size of the sample, to 43 KIPP middle schools, including all KIPP middle schools that were open at the start of the study in 2010 for which they were able to acquire relevant data from local districts or states. The average impact of KIPP on student achievement is positive, statistically significant, and educationally substantial. KIPP impact estimates are consistently positive across the four academic subjects examined, in each of the first four years after enrollment in a KIPP school, and for all measurable student subgroups. A large majority of the individual KIPP schools in the study show positive impacts on student achievement as measured by scores on state-mandated assessments. KIPP produces similar positive impacts on the norm-referenced test, which includes items assessing higher-order thinking. Estimated impacts on measures of student attitudes and behavior are less frequently positive, but the authors found evidence that KIPP leads students to spend significantly more time on homework, and that KIPP increases levels of student and parent satisfaction with school. On the negative side, the findings suggest that enrollment in a KIPP school leads to an increase in the likelihood that students report engaging in undesirable behavior such as lying to or arguing with parents. These findings are described in this report. The following appendixes are included: (1) Sample selection and baseline characteristics; (2) Constructing survey outcomes; (3) Schools attended by lottery winners and lottery non-winners; (4) Analytic methods for the matched comparison group analysis; (5) Analytic methods for lottery-based analysis; and (6) Validation of matching methods using lottery-based impact estimates. (Contains 46 tables, 78 footnotes, and 16 figures.) [For "What Works Clearinghouse Quick Review: 'KIPP Middle Schools: Impacts on Achievement and Other Outcomes, Final Report,'" see ED540896.]
Reviews of Individual Studies 5-8 1
Staying on Track: Testing Higher Achievement's Long-Term Impact on Academic Outcomes and High School Choice (2013)
One crucial decision that middle schoolers (and their families) make is where they will attend high school. Many districts employ school choice systems designed to allow students to pick a high school that will meet their needs and interests. Yet most students prefer high schools that are close to home, and for youth in low-income neighborhoods, this often means attending a more disadvantaged, lower performing school (Nathanson et al. 2013). Youth who defy these odds and choose a competitive high school instead have much to gain. Cullen et al. (2005), for instance, found that Chicago public middle school students who chose to attend a higher-achieving high school were substantially more likely to graduate. However, even as eighth graders, these students already differed in many ways from their peers who chose a neighborhood school--they had better self-reported grades and higher expectations for the future, felt more prepared for high school, and were more likely to have spoken with their parents about what school to attend. These findings raise the question of how we can prepare more disadvantaged students to take the many steps necessary-throughout the middle school years-to successfully transition to a competitive, high-quality high school that can ultimately launch them toward college and careers. The Washington, DC-based Higher Achievement program is taking on this challenge. Higher Achievement targets rising fifth and sixth graders from "at-risk communities" and serves them throughout the middle school years. Its goal is to strengthen participants' academic skills, attitudes and behaviors, reinforce high aspirations and help students and their families navigate the process of applying to and selecting a high-quality high school. In 2006, the authors began a comprehensive multi-year evaluation of Higher Achievement to test its impact on participants' academic performance, attitudes and behaviors and on their high school enrollment. The evaluation used random assignment-the most rigorous design available to researchers-to assess program impacts. This brief summarizes the study's findings. Findings suggest that the program does appear to expand the options available to its students by making them more likely to apply to and attend private schools and less likely to apply to and attend weaker public magnet and charter schools. This, in turn, may position youth for better outcomes in high school and beyond. [This research was made possible by grants from The Atlantic Philanthropies, Bank of America, the Smith Richardson Foundation, the Spencer Foundation, The Wallace Foundation and the William T. Grant Foundation.]
Reviews of Individual Studies 3-8 1
Transfer Incentives for High-Performing Teachers: Final Results from a Multisite Randomized Experiment. NCEE 2014-4003 (2013)
One way to improve struggling schools' access to effective teachers is to use selective transfer incentives. Such incentives offer bonuses for the highest-performing teachers to move into schools serving the most disadvantaged students. In this report, we provide evidence from a randomized experiment that tested whether such a policy intervention can improve student test scores and other outcomes in low-achieving schools. The intervention, known to participants as the Talent Transfer Initiative (TTI), was implemented in 10 school districts in seven states. The highest-performing teachers in each district--those who ranked in roughly the top 20 percent within their subject and grade span in terms of raising student achievement year after year (an approach known as value added)--were identified. These teachers were offered $20,000, paid in installments over a two-year period, if they transferred into and remained in designated schools that had low average test scores. The main findings from the study include: (1) The transfer incentive successfully attracted high value-added teachers to fill targeted vacancies; (2) The transfer incentive had a positive impact on test scores (math and reading) in targeted elementary classrooms; and (3) The transfer incentive had a positive impact on teacher-retention rates during the payout period; retention of the high-performing teachers who transferred was similar to their counterparts in the fall immediately after the last payout. Seven appendixes are included: (1) Supplemental Materials for Chapters I and II; (2) Value-Added Analysis to Identify Highest-Performing Teachers; (3) Supplemental Materials for Chapter III; (4) Identification of Focal Teachers; (5) Supplemental Materials for Chapter IV; (6) Supplemental Materials for Chapter V; and (7) Supplemental Materials for Chapter VI. (Contains 114 footnotes, 61 figures, and 92 tables.) [For the executive summary, see ED544268.]
Reviews of Individual Studies 4 1
Improving At-Risk Learners' Understanding of Fractions (2013)
The purposes of this study were to investigate the effects of an intervention designed to improve at-risk 4th graders' understanding of fractions and to examine the processes by which effects occurred. The intervention focused more on the measurement interpretation of fractions; the control condition focused more on the part-whole interpretation of fractions and on procedures. Intervention was also designed to compensate for at-risk students' limitations in the domain-general abilities associated with fraction learning. At-risk students (n = 259) were randomly assigned to intervention and control. Whole-number calculation skill, domain-general abilities (working memory, attentive behavior, processing speed, listening comprehension), and fraction proficiency were pretested. Intervention occurred for 12 weeks, 3 times per week, 30 min per session, and then fraction performance was reassessed. On each conceptual and procedural fraction outcome, effects favored intervention over control (effect sizes = 0.29 to 2.50), and the gap between at-risk and low-risk students narrowed for the intervention group but not the control group. Improvement in the accuracy of children's measurement interpretation of fractions mediated intervention effects. Also, intervention effects were moderated by domain-general abilities, but not whole-number calculation skill.
Reviews of Individual Studies 6-12 1
The Effectiveness of Secondary Math Teachers from Teach For America and the Teaching Fellows Programs. NCEE 2013-4015 (2013)
Teach For America (TFA) and the Teaching Fellows programs are an important and growing source of teachers of hard-to-staff subjects in high-poverty schools, but comprehensive evidence of their effectiveness has been limited. This report presents findings from the first large-scale random assignment study of secondary math teachers from these programs. The study separately examined the effectiveness of TFA and Teaching Fellows teachers, comparing secondary math teachers from each program with other secondary math teachers teaching the same math courses in the same schools. The study focused on secondary math because this is a subject in which schools face particular staffing difficulties.The study had two main findings, one for each program studied: (1) TFA teachers were more effective than the teachers with whom they were compared. On average, students assigned to TFA teachers scored 0.07 standard deviations higher on end-of-year math assessments than students assigned to comparison teachers, a statistically significant difference. This impact is equivalent to an additional 2.6 months of school for the average student nationwide; and (2) Teaching Fellows were neither more nor less effective than the teachers with whom they were compared. On average, students of Teaching Fellows and students of comparison teachers had similar scores on end-of-year math assessments. By providing rigorous evidence on the effectiveness of secondary math teachers from TFA and the Teaching Fellows programs, the study can shed light on potential approaches for improving teacher effectiveness in hard-to-staff schools and subjects. The study findings can provide guidance to school principals faced with the choice of hiring teachers who have entered the profession via different routes to certification. The findings can also aid policymakers and funders of teacher preparation programs by providing information on the effectiveness of teachers from various routes to certification that use different methods to identify, attract, train, and support their teachers. Seven appendixes present: (1) Supplementary Technical Information on Study Design and Data Collection; (2) Supplementary Information on Analytic Methods; (3) Supplementary Information on Teach For America and Teaching Fellows Programs; (4) Teach For America and Teaching Fellows Teachers Compared with Comparison Teachers by Entry Route (Alternative or Traditional); (5) Supplementary Information on Teach For America and Teaching Fellows Teachers Compared with Comparison Teachers; (6) Supplementary Analyses of the Impacts of Teach For America and Teaching Fellows Teachers; and (7) Supplementary Findings on Factors Associated with Teacher Effectiveness. (Contains 96 tables, 21 figures, and 30 footnotes.)
Reviews of Individual Studies 9-12 1
Early College, Early Success: Early College High School Initiative Impact Study (2013)
In 2002, the Bill & Melinda Gates Foundation launched the Early College High School Initiative (ECHSI) with the primary goal of increasing the opportunity for underserved students to earn a postsecondary credential. To achieve this goal, Early Colleges provide underserved students with exposure to, and support in, college while they are in high school. Early Colleges partner with colleges and universities to offer all students an opportunity to earn an associate's degree or up to two years of college credits toward a bachelor's degree during high school at no or low cost to the students. The underlying assumption is that engaging underrepresented students in a rigorous high school curriculum tied to the incentive of earning college credit will motivate them and increase their access to additional postsecondary education and credentials after high school. Since 2002, more than 240 Early Colleges have opened nationwide. This study focused on the impact of Early Colleges. It addressed two questions: (1) Do Early College students have better outcomes than they would have had at other high schools?; and (2) Does the impact of Early Colleges vary by student background characteristics (e.g., gender and family income)? To answer these questions, the authors conducted a lottery-based randomized experiment, taking advantage of the fact that some Early Colleges used lotteries in their admissions processes. By comparing the outcomes for students who participated in admissions lotteries and were offered enrollment with the outcomes for students who participated in the lotteries but were not offered enrollment, they can draw causal conclusions about the impact of Early Colleges. The primary student outcomes for this study were high school graduation, college enrollment, and college degree attainment. The authors also examined students' high school and college experiences. Data on student background characteristics and high school outcomes came from administrative records from schools, districts, and states; data on college outcomes came from the National Student Clearinghouse (NSC); and data on high school and college experiences and intermediate outcomes such as college credit accrual came from a student survey. The authors assessed the impact of Early Colleges on these outcomes for a sample of 10 Early Colleges that did the following: (1) Enrolled students in grades 9-12 and had high school graduates in the study years (2005-2011); (2) Used lotteries as part of the admission processes in at least one of the study cohorts (students who entered ninth grade in 2005-06, 2006-07, or 2007-08); and (3) Retained the lottery records. Eight of the 10 Early Colleges in the study were included in the student survey. The overall study sample included 2,458 students and the survey sample included 1,294 students. The study extended through three years past high school.
Reviews of Individual Studies 9 1
Expanding the Start of the College Pipeline: Ninth-Grade Findings from an Experimental Study of the Impact of the Early College High School Model (2012)
Early college high schools are a new and rapidly spreading model that merges the high school and college experiences and that is designed to increase the number of students who graduate from high school and enroll and succeed in postsecondary education. This article presents results from a federally funded experimental study of the impact of the early college model on Grade 9 outcomes. Results show that, as compared to control group students, a statistically significant and substantively higher proportion of treatment group students are taking core college preparatory courses and succeeding in them. Students in the treatment group also have statistically significantly higher attendance and lower suspension rates than students in the control group. (Contains 10 footnotes, 5 tables and 1 figure.)
Reviews of Individual Studies 6-7 1
Louisiana Striving Readers: Final Evaluation Report (2012)
The Louisiana Striving Readers evaluation assessed the implementation and effectiveness of the Voyager "Passport Reading Journeys" (PRJ), a widely used supplemental literacy intervention for struggling adolescent readers that reflects the research-based practices recommended by the National Reading Panel (2000) and other more recent syntheses (Biancarosa & Snow, 2004; Edmonds, et al., 2009; Kamil, et al., 2008; Scammacca et al., 2007; Torgesen et al., 2007). To date, PRJ has been adopted in 45 states across the country in almost 470 districts and over 2,200 schools, and has served over 268,000 students. PRJ offers four levels of instruction appropriate for middle and high school students. The PRJ curriculum uses direct, explicit instruction in reading comprehension, vocabulary, and word study for adolescents who struggle with reading using age-appropriate fiction and non-fiction texts. The Louisiana Striving Readers Program, funded by the Louisiana Department of Education (LDOE) through a grant from the U.S. Department of Education, targeted over 1,200 struggling readers in grades 6-7 from ten middle schools across the state of Louisiana. The grant required a rigorous, independent experimental evaluation, conducted by SEDL, addressing fidelity of program implementation and program impacts on student motivation and reading achievement. The study reported here had two specific aims: (1) determine the fidelity of implementation, or the extent to which the program was delivered as the grant indicated it should be implemented; and (2) determine the impacts of PRJ on student reading and other related outcomes (i.e., student motivation and engagement in reading) and how the effects may have varied by student subgroups. This report details the intervention, the implementation study design and results, and the impact study design and results.
Reviews of Individual Studies 6-10 1
A randomized controlled trial of the impact of the Fusion Reading intervention on reading achievement and motivation for adolescent struggling readers. (2012)
This study estimates the effect of one year of Fusion Reading implementation, a multistrategy intervention, builds on the work of the Strategic Instruction Model's Learning Strategies Curriculum and Xtreme Reading by integrating some of the same strategies (e.g., paraphrasing, visual imagery, and self-questioning for information acquisition; mnemonics for information study; and writing and error monitoring for information expression), focusing on reading, and extending the time frame from 1 to 2 years in duration. Specifically, the study addressed the following: (1) What are the intent-to-treat impacts of the Fusion Reading intervention on the reading outcomes and motivation to read of struggling readers after receipt of 1 year of the intervention?; (2) For which students are the interventions most and least effective?; and (3) In what ways are implementation factors associated with impacts (or lack of impacts) on reading and motivation outcomes? The authors conducted a randomized controlled trial to estimate the effect of Fusion Reading on struggling readers in grades 6 through 10. Students in the intervention condition received the Fusion Reading intervention as a supplemental reading intervention in the 2010-11 school year, whereas students in the control condition engaged in nonliteracy, "business-as-usual" activities. After one year of implementation of a two year intervention, the authors learned that when vocabulary, paraphrasing and word study strategies are explicitly taught by following a specific instructional routine supported by motivation strategies (e.g., setting goals and reading text relevant for the age group), word reading outcomes will significantly improve compared to control middle and high school students. Future research is needed to fully understand whether the intended two year intervention will improve struggling adolescent's reading comprehension outcomes. Appended are: (1) References; and (2) Tables and Figures. (Contains 2 figures and 5 tables.)
Reviews of Individual Studies 6-10 1
Striving Readers: Impact study and project evaluation report—Wisconsin Department of Public Instruction (with Milwaukee Public Schools). (2012)
American Institutes for Research (AIR) conducted an evaluation of the effect on struggling readers of implementing the READ 180 reading intervention in five participating schools in Milwaukee Public Schools (MPS) under a Striving Readers grant from the U.S. Department of Education. The evaluation used an experimental design in order to produce a rigorous estimate of the impact of the READ 180 intervention on measures of reading achievement for struggling students. The evaluation also explored implementation fidelity and the contexts and conditions of implementation that may extend or limit the intervention's effects. To measure program impact on students' academic performance in reading, AIR analyzed student achievement data collected from the Northwest Evaluation Association (NWEA) Measures of Academic Progress (MAP) benchmark assessment. AIR also administered a student survey to assess the impact on student engagement and self-efficacy for reading. This report asked the following research questions: (1) Does the READ 180 reading intervention improve students' academic performance in reading?; (2) With what fidelity did the program implement the professional development model and what factors mediated the level of implementation?; and (3) With what fidelity did classroom intervention teachers implement READ 180 and what factors mediated the level of implementation?
Reviews of Individual Studies 4 1
Differential Effects of Three Professional Development Models on Teacher Knowledge and Student Achievement in Elementary Science (2012)
To identify links among professional development, teacher knowledge, practice, and student achievement, researchers have called for study designs that allow causal inferences and that examine relationships among features of interventions and multiple outcomes. In a randomized experiment implemented in six states with over 270 elementary teachers and 7,000 students, this project compared three related but systematically varied teacher interventions--"Teaching Cases, Looking at Student Work, and Metacognitive Analysis"--along with no-treatment controls. The three courses contained identical science content components, but differed in the ways they incorporated analysis of learner thinking and of teaching, making it possible to measure effects of these features on teacher and student outcomes. Interventions were delivered by staff developers trained to lead the teacher courses in their regions. Each course improved teachers' and students' scores on selected-response science tests well beyond those of controls, and effects were maintained a year later. Student achievement also improved significantly for English language learners in both the study year and follow-up, and treatment effects did not differ based on sex or race/ethnicity. However, only Teaching Cases and Looking at Student Work courses improved the accuracy and completeness of students' written justifications of test answers in the follow-up, and only Teaching Cases had sustained effects on teachers' written justifications. Thus, the content component in common across the three courses had powerful effects on teachers' and students' ability to choose correct test answers, but their ability to explain why answers were correct only improved when the professional development incorporated analysis of student conceptual understandings and implications for instruction; metacognitive analysis of teachers' own learning did not improve student justifications either year. Findings suggest investing in professional development that integrates content learning with analysis of student learning and teaching rather than advanced content or teacher metacognition alone. (Contains 1 figure and 4 tables.)
Reviews of Individual Studies 4-5 1
Large-Scale Randomized Controlled Trial with 4th Graders Using Intelligent Tutoring of the Structure Strategy to Improve Nonfiction Reading Comprehension (2012)
Reading comprehension is a challenge for K-12 learners and adults. Nonfiction texts, such as expository texts that inform and explain, are particularly challenging and vital for students' understanding because of their frequent use in formal schooling (e.g., textbooks) as well as everyday life (e.g., newspapers, magazines, and medical information). The structure strategy is explicit instruction about how to strategically use knowledge about text structures for encoding and retrieval of information from nonfiction and has consistently shown significant improvements in reading comprehension. We present the delivery of the structure strategy using a web-based intelligent tutoring system (ITSS) that has the potential to offer consistent modeling, practice tasks, assessment, and feedback to the learner. Finally, we report on statistically significant findings from a large scale randomized controlled efficacy trial with rural and suburban 4th-grade students using ITSS.
Reviews of Individual Studies 4-8 1
Evaluation of the Effectiveness of the Alabama Math, Science, and Technology Initiative (AMSTI). Final Report. NCEE 2012-4008 (2012)
This report presents the results of an experiment conducted in Alabama beginning in the 2006/07 school year, to determine the effectiveness of the Alabama Math, Science, and Technology Initiative (AMSTI), which aims to improve mathematics and science achievement in the state's K-12 schools. This study is the first randomized controlled trial testing the effectiveness of AMSTI in improving mathematics problem solving and science achievement in upper-elementary and middle schools. AMSTI is an initiative specific to Alabama and was developed and supported through state resources. An important finding is the positive and statistically significant effect of AMSTI on mathematics achievement as measured by the SAT 10 mathematics problem solving assessment administered by the state to students in grades 4-8. After one year in the program, student mathematics scores were higher than those of a control group that did not receive AMSTI by 0.05 standard deviation, equivalent to 2 percentile points. Nine of the 10 sensitivity analyses yielded effect estimates that were statistically significant at the 0.025 level, consistent with the main finding. The estimated effect of AMSTI on science achievement measured after one year was not statistically significant. Based on the SAT 10 science test administered by the state to students in grades 5 and 7, no difference between AMSTI and control schools could be discerned after one year. Changes in classroom instructional strategies, especially an emphasis on more active-learning strategies, are important to the AMSTI theory of action. Therefore, a secondary investigation of classroom practices was conducted, based on data from survey responses from teachers. For both mathematics and science, statistically significant differences were found between AMSTI and control teachers in the average reported time spent using the strategies. The effect of AMSTI on these instructional strategies was 0.47 standard deviation in mathematics and 0.32 standard deviation in science. Two years of AMSTI appeared to have a positive and statistically significant effect on achievement in mathematics problem solving, compared to no AMSTI. Two years of AMSTI appeared to have a positive and statistically significant effect on achievement in science. AMSTI appeared to have a positive and statistically significant effect on reading achievement as measured by the SAT 10 test of reading administered by the state to students in grades 4-8. AMSTI did not appear to have a statistically significant effect on teacher-reported content knowledge in mathematics or science after one year. AMSTI did not appear to have statistically significant differential effects on student achievement in mathematics problem solving or science based on racial/ethnic minority status, enrollment in the free or reduced-price lunch program, gender, or pretest level. Appended are: (1) Explanation of primary and secondary confirmatory outcome measures; (2) Explanation of exploratory research questions; (3) Selection and random assignment of schools; (4) Statistical power analysis; (5) Data collection procedures and timeline; (6) Description of program implementation data collected but not used in report; (7) Alabama Math, Science, and Technology Initiative (AMSTI) teacher survey #3; (8) Data cleaning and data file construction; (9) Attrition through study stages for samples used in the confirmatory analysis; (10) Description of degree rank; (11) Equivalence of Year 1 baseline and analyzed samples for confirmatory student-level and classroom practice outcomes; (12) Internal consistency and validity of active learning measures; (13) Number of students and teachers in schools in analytic samples used to analyze Year 1 confirmatory questions; (14) Attrition through study stages for samples used in Year 1 exploratory analysis; (15) Tests of equivalence for baseline and analytic samples for Year 1 exploratory outcomes; (16) Statistical power analyses for moderator analyses; (17) Derivation and motivation of the Bell-Bradley estimator when measuring estimated two-year effect of the Alabama Math, Science, and Technology Initiative (AMSTI); (18) Attrition through study stages for samples contributing to estimation of two-year effects; (19) Examination of equivalence in baseline and analytic samples used in the estimation of two-year effects; (20) Estimation model for two-year effects of the Alabama Math, Science, and Technology Initiative (AMSTI); (21) Topics and instructional methods used at the Alabama Math, Science, and Technology Initiative (AMSTI) summer institute; (22) Parameter estimates on probability scale for odds-ratio tests of differences between Alabama Math, Science, and Technology Initiative (AMSTI) and control conditions in Year 1 (associated with summer professional development and in-school support outcomes); (23) Descriptive statistics for variables that change to a binary scale used in the Alabama Math, Science, and Technology Initiative (AMSTI) and control conditions in Year 1; (24) Comparison of assumed parameter values and observed sample statistics for statistical power analysis after one year; (25) Parameter estimates for Stanford Achievement Test Tenth Edition (SAT 10) mathematics problem solving after one year; (26) Parameter estimates for Stanford Achievement Test Tenth Edition (SAT 10) science after one year; (27) Parameter estimates for active learning in mathematics after one year; (28) Parameter estimates for active learning in science after one year; (29) Sensitivity analyses of effect of the Alabama Math, Science, and Technology Initiative (AMSTI) on Stanford Achievement Test Tenth Edition (SAT 10) mathematics problem solving achievement after one year; (30) Sensitivity analyses of effect of the Alabama Math, Science, and Technology Initiative (AMSTI) on Stanford Achievement Test Tenth Edition (SAT 10) science achievement after one year; (31) Sensitivity analyses of effect of the Alabama Math, Science, and Technology Initiative (AMSTI) on active learning instructional strategies in mathematics classrooms after one year; (32) Sensitivity analyses of effect of the Alabama Math, Science, and Technology Initiative (AMSTI) on active learning instructional strategies in science classrooms after one year; (33) Tests for violations of factors associated with assumption of equal first year effects on students in Alabama Math, Science, and Technology Initiative (AMSTI) and control schools; (34) Post hoc adjustment to standard error for estimate of two-year effect of the Alabama Math, Science, and Technology Initiative (AMSTI) on mathematics achievement after two years; (35) Parameter estimates for effect of the Alabama Math, Science, and Technology Initiative (AMSTI) after two years; (36) Parameter estimates for effect of the Alabama Math, Science, and Technology Initiative (AMSTI) on student reading achievement after one year; (37) Parameter estimates for teacher content and student engagement after one year; (38) Estimates of effects for terms involving the indicator of treatment status in the analysis of the moderating effect of the three-level pretest variable; (39) Parameter estimates for the analysis of the moderating effect of racial/ethnic minority status on the impact of the Alabama Math, Science, and Technology Initiative (AMSTI) on reading after one year; (40) Parameter estimates for analysis of average effect of the Alabama Math, Science, and Technology Initiative (AMSTI) on reading by racial/ethnic minority students after one year; and (41) Parameter estimates for effect of the Alabama Math, Science, and Technology Initiative (AMSTI) on reading for White students after one year. (Contains 26 figures, 136 tables, 1 box and 130 footnotes.)
Reviews of Individual Studies 9-12 1
Information and College Access: Evidence from a Randomized Field Experiment. Working Paper 18551 (2012)
High school students from disadvantaged high schools in Toronto were invited to take two surveys, about three weeks apart. Half of the students taking the first survey were also shown a 3 minute video about the benefits of post secondary education (PSE) and invited to try out a financial-aid calculator. Most students' perceived returns to PSE were high, even among those not expecting to continue. Those exposed to the video, especially those initially unsure about their own educational attainment, reported significantly higher expected returns, lower concerns about costs, and expressed greater likelihood of PSE attainment. The two online surveys are appended.
Reviews of Individual Studies K-8 1
Enhancing the Efficacy of Teacher Incentives through Loss Aversion: A Field Experiment. NBER Working Paper No. 18237 (2012)
Domestic attempts to use financial incentives for teachers to increase student achievement have been ineffective. In this paper, we demonstrate that exploiting the power of loss aversion--teachers are paid in advance and asked to give back the money if their students do not improve sufficiently--increases math test scores between 0.201 (0.076) and 0.398 (0.129) standard deviations. This is equivalent to increasing teacher quality by more than one standard deviation. A second treatment arm, identical to the loss aversion treatment but implemented in the standard fashion, yields smaller and statistically insignificant results. This suggests it is loss aversion, rather than other features of the design or population sampled, that leads to the stark differences between our findings and past research.
Reviews of Individual Studies K-1 1
Evaluation of Rocketship Education’s use of DreamBox Learning’s online mathematics program. (2011)
Reviews of Individual Studies 6-12 1
A Randomized Experiment of a Cognitive Strategies Approach to Text-Based Analytical Writing for Mainstreamed Latino English Language Learners in Grades 6 to 12 (2011)
This study reports Year 1 findings from a multisite cluster randomized controlled trial of a cognitive strategies approach to teaching text-based analytical writing for mainstreamed Latino English language learners (ELLs) in 9 middle schools and 6 high schools. There were 103 English teachers stratified by school and grade and then randomly assigned to the Pathway Project professional development intervention or control group. The Pathway Project trains teachers to use a pretest on-demand writing assessment to improve text-based analytical writing instruction for mainstreamed Latino ELLs who are able to participate in regular English classes. The intervention draws on well-documented instructional frameworks for teaching mainstreamed ELLs. Such frameworks emphasize the merits of a cognitive strategies approach that supports these learners' English language development. Pathway teachers participated in 46 hrs of training and learned how to apply cognitive strategies by using an on-demand writing assessment to help students understand, interpret, and write analytical essays about literature. Multilevel models revealed significant effects on an on-demand writing assessment (d = 0.35) and the California Standards Test in English language arts (d = 0.07). (Contains 1 figure, 7 tables and 4 footnotes.)
Reviews of Individual Studies 7-12 1
Implementation and impact of the targeted and whole school interventions, summary of Year 4 (2009-2010): San Diego United School District, California. (2011)
Reviews of Individual Studies 8 1
Access to Algebra I: The Effects of Online Mathematics for Grade 8 Students. NCEE 2012-4021 (2011)
This report presents findings from a randomized control trial designed to inform the decisions of policymakers who are considering using online courses to provide access to Algebra I in grade 8. It focuses on students judged by their schools to be ready to take Algebra I in grade 8 but who attend schools that do not offer the course. The study tested the impact of offering an online Algebra I course on students' algebra achievement at the end of grade 8 and their subsequent likelihood of participating in an advanced mathematics course sequence in high school. The study was designed to respond to both broad public interest in the deployment of online courses for K-12 students and to calls from policymakers to provide students with adequate pathways to advanced coursetaking sequences in mathematics (National Mathematics Advisory Panel 2008). This study is the first of its kind to rigorously evaluate the impact of offering an online version of Algebra I in schools that otherwise do not typically offer the course, even though they have students who are ready to take it. For educators and students facing similar challenges, the results of this study may be particularly informative and promising. Results showed that offering an online course to AR students is an effective way to broaden access to Algebra I in grade 8 and later, to more challenging mathematics course opportunities. The study demonstrates that an online course as implemented is more effective in promoting students' success in mathematics than existing practices in these schools. Appended are: (1) Study Design, Study Samples, and Statistical Precision; (2) Measures; (3) Intervention Features; (4) Estimation Methods and Hypothesis Testing; (5) Sensitivity Analyses; and (6) Missing Data and Multiple Imputation. (Contains 77 tables, 12 figures and 61 footnotes.)
Reviews of Individual Studies 1 1
Effective Classroom Instruction: Implications of Child Characteristics by Reading Instruction Interactions on First Graders' Word Reading Achievement (2011)
Too many children fail to learn how to read proficiently with serious consequences for their overall well-being and long-term success in school. This may be because providing effective instruction is more complex than many of the current models of reading instruction portray; there are Child Characteristic x Instruction (CXI) interactions. Here we present efficacy results for a randomized control field trial of the Individualizing Student Instruction (ISI) intervention, which relies on dynamic system forecasting intervention models to recommend amounts of reading instruction for each student, taking into account CXI interactions that consider his or her vocabulary and reading skills. The study, conducted in seven schools with 25 teachers and 396 first graders, revealed that students in the ISI intervention classrooms demonstrated significantly greater reading skill gains by spring than did students in control classrooms. Plus, they were more likely to receive differentiated reading instruction based on CXI interaction guided recommended amounts than were students in control classrooms. The precision with which students received the recommended amounts of each type of literacy instruction, the distance from recommendation, also predicted reading outcomes. (Contains 7 figures and 6 tables.)
Reviews of Individual Studies 4-5 1
Large scale, randomized cluster design study of the relative effectiveness of reform-based and traditional/verification curricula in supporting student science learning. (2010, March)
Reviews of Individual Studies 4 1
Learning the Control of Variables Strategy in Higher and Lower Achieving Classrooms: Contributions of Explicit Instruction and Experimentation (2010)
Students (n = 797) from 36 4th-grade classrooms were taught the control of variables strategy for designing experiments. In the instruct condition, classes were taught in an interactive lecture format. In the manipulate condition, students worked in groups to design and run experiments to determine the effects of four variables. In the both condition, classes received the interactive lecture and also designed and ran experiments. We assessed students' understanding using a written test of their ability to distinguish valid from invalid experimental comparisons. Performance on this test improved from the pretest to the immediate posttest in all conditions, and gains were maintained at a 5-month delay. For students from both higher and lower achieving schools, gains ordered as follows: both greater than instruct greater than manipulate. However, students from higher achieving schools showed greater gains in all conditions. Item analyses showed that the interactive lecture improved students' understanding of the need to control irrelevant variables, and experimentation improved students' understanding of the need to vary the focal variable. (Contains 4 tables, 2 figures and 1 footnote.)
Reviews of Individual Studies 7-8 1
Integration of Technology, Curriculum, and Professional Development for Advancing Middle School Mathematics: Three Large-Scale Studies (2010)
The authors present three studies (two randomized controlled experiments and one embedded quasi-experiment) designed to evaluate the impact of replacement units targeting student learning of advanced middle school mathematics. The studies evaluated the SimCalc approach, which integrates an interactive representational technology, paper curriculum, and teacher professional development. Each study addressed both replicability of findings and robustness across Texas settings, with varied teacher characteristics (backgrounds, knowledge, attitudes) and student characteristics (demographics, levels of prior mathematics knowledge). Analyses revealed statistically significant main effects, with student-level effect sizes of 0.63, 0.50, and 0.56. These consistent gains support the conclusion that SimCalc is effective in enabling a wide variety of teachers in a diversity of settings to extend student learning to more advanced mathematics. (Contains 4 tables, 5 figures, and 1 note.)
Reviews of Individual Studies 9 1
The Enhanced Reading Opportunities Study Final Report: The Impact of Supplemental Literacy Courses for Struggling Ninth-Grade Readers. NCEE 2010-4021 (2010)
According to the National Assessment of Educational Progress (NAEP), just over 70 percent of students nationally arrive in high school with reading skills that are below "proficient"--defined as demonstrating competency over challenging subject matter. Of these students, nearly half do not exhibit even partial mastery of the knowledge and skills that are fundamental to proficient work at grade level. These limitations in literacy skills are a major source of course failure, high school dropout, and poor performance in postsecondary education. While research is beginning to emerge about the special needs of striving adolescent readers, very little is known about effective interventions aimed at addressing these needs. To help fill this gap and to provide evidence-based guidance to practitioners, the U.S. Department of Education initiated the Enhanced Reading Opportunities (ERO) study--a demonstration and rigorous evaluation of supplemental literacy programs targeted to ninth-grade students whose reading skills are at least two years below grade level. As part of this demonstration, 34 high schools from 10 school districts implemented one of two reading interventions: Reading Apprenticeship Academic Literacy (RAAL), designed by WestEd, and Xtreme Reading, designed by the University of Kansas Center for Research on Learning. These programs were implemented in the study schools for two school years. The U.S. Department of Education's (ED) Office of Elementary and Secondary Education (OESE) funded the implementation of these programs, and its Institute of Education Sciences (IES) was responsible for oversight of the evaluation. MDRC--a nonprofit, nonpartisan education and social policy research organization--conducted the evaluation in partnership with the American Institutes for Research (AIR) and Survey Research Management (SRM). The goal of the reading interventions--which consist of a year-long course that replaces a ninth-grade elective class--is to help striving adolescent readers develop the strategies and routines used by proficient readers, thereby improving their reading skills and ultimately, their academic performance in high school. The first two reports for the study evaluated the programs' impact on the two most proximal outcomes targeted by the interventions--students' reading skills and their reading behaviors at the end of ninth grade. This report--which is the final of three reports for this evaluation--examines the impact of the ERO programs on the more general outcomes that the programs hope to affect--students' academic performance in high school (grade point average [GPA], credit accumulation, and state test scores) as well as students' behavioral outcomes (attendance and disciplinary infractions). These academic and behavioral outcomes are examined during the year in which they were enrolled in the ERO programs (ninth grade), as well as the following school year (tenth grade for most students). Appendices include: (1) The ERO Programs and the ERO Teachers; (2) ERO Student Survey Measures; (3) ERO Implementation Fidelity; (4) State Tests Included in the ERO Study; (5) Response Analysis and Baseline Comparison Tables; (6) Technical Notes for Impact Findings; (7) Statistical Power and Minimum Detectable Effect Size; (8) Supplementary Impact Findings; (9) Baseline and Impact Findings, by Cohort; (10) The Association Between Reading Outcomes and Academic Performance in High School; (11) Variation in Impacts Across Sites and Cohorts; (12) Program Costs; and (13) Poststudy Adolescent Literacy Programming in the ERO Schools: Methodology and Additional Findings. (Contains 97 tables, 23 figures, 2 boxes, and 185 footnotes.) [This paper was written with Edmond Wong. For the first-year report, see ED499778. For the second report, see ED503380.]
Reviews of Individual Studies 9 1
The Enhanced Reading Opportunities Study Final Report: The Impact of Supplemental Literacy Courses for Struggling Ninth-Grade Readers. NCEE 2010-4021 (2010)
According to the National Assessment of Educational Progress (NAEP), just over 70 percent of students nationally arrive in high school with reading skills that are below "proficient"--defined as demonstrating competency over challenging subject matter. Of these students, nearly half do not exhibit even partial mastery of the knowledge and skills that are fundamental to proficient work at grade level. These limitations in literacy skills are a major source of course failure, high school dropout, and poor performance in postsecondary education. While research is beginning to emerge about the special needs of striving adolescent readers, very little is known about effective interventions aimed at addressing these needs. To help fill this gap and to provide evidence-based guidance to practitioners, the U.S. Department of Education initiated the Enhanced Reading Opportunities (ERO) study--a demonstration and rigorous evaluation of supplemental literacy programs targeted to ninth-grade students whose reading skills are at least two years below grade level. As part of this demonstration, 34 high schools from 10 school districts implemented one of two reading interventions: Reading Apprenticeship Academic Literacy (RAAL), designed by WestEd, and Xtreme Reading, designed by the University of Kansas Center for Research on Learning. These programs were implemented in the study schools for two school years. The U.S. Department of Education's (ED) Office of Elementary and Secondary Education (OESE) funded the implementation of these programs, and its Institute of Education Sciences (IES) was responsible for oversight of the evaluation. MDRC--a nonprofit, nonpartisan education and social policy research organization--conducted the evaluation in partnership with the American Institutes for Research (AIR) and Survey Research Management (SRM). The goal of the reading interventions--which consist of a year-long course that replaces a ninth-grade elective class--is to help striving adolescent readers develop the strategies and routines used by proficient readers, thereby improving their reading skills and ultimately, their academic performance in high school. The first two reports for the study evaluated the programs' impact on the two most proximal outcomes targeted by the interventions--students' reading skills and their reading behaviors at the end of ninth grade. This report--which is the final of three reports for this evaluation--examines the impact of the ERO programs on the more general outcomes that the programs hope to affect--students' academic performance in high school (grade point average [GPA], credit accumulation, and state test scores) as well as students' behavioral outcomes (attendance and disciplinary infractions). These academic and behavioral outcomes are examined during the year in which they were enrolled in the ERO programs (ninth grade), as well as the following school year (tenth grade for most students). Appendices include: (1) The ERO Programs and the ERO Teachers; (2) ERO Student Survey Measures; (3) ERO Implementation Fidelity; (4) State Tests Included in the ERO Study; (5) Response Analysis and Baseline Comparison Tables; (6) Technical Notes for Impact Findings; (7) Statistical Power and Minimum Detectable Effect Size; (8) Supplementary Impact Findings; (9) Baseline and Impact Findings, by Cohort; (10) The Association Between Reading Outcomes and Academic Performance in High School; (11) Variation in Impacts Across Sites and Cohorts; (12) Program Costs; and (13) Poststudy Adolescent Literacy Programming in the ERO Schools: Methodology and Additional Findings. (Contains 97 tables, 23 figures, 2 boxes, and 185 footnotes.) [This paper was written with Edmond Wong. For the first-year report, see ED499778. For the second report, see ED503380.]
Reviews of Individual Studies 9 1
The Enhanced Reading Opportunities Study Final Report: The Impact of Supplemental Literacy Courses for Struggling Ninth-Grade Readers. NCEE 2010-4021 (2010)
According to the National Assessment of Educational Progress (NAEP), just over 70 percent of students nationally arrive in high school with reading skills that are below "proficient"--defined as demonstrating competency over challenging subject matter. Of these students, nearly half do not exhibit even partial mastery of the knowledge and skills that are fundamental to proficient work at grade level. These limitations in literacy skills are a major source of course failure, high school dropout, and poor performance in postsecondary education. While research is beginning to emerge about the special needs of striving adolescent readers, very little is known about effective interventions aimed at addressing these needs. To help fill this gap and to provide evidence-based guidance to practitioners, the U.S. Department of Education initiated the Enhanced Reading Opportunities (ERO) study--a demonstration and rigorous evaluation of supplemental literacy programs targeted to ninth-grade students whose reading skills are at least two years below grade level. As part of this demonstration, 34 high schools from 10 school districts implemented one of two reading interventions: Reading Apprenticeship Academic Literacy (RAAL), designed by WestEd, and Xtreme Reading, designed by the University of Kansas Center for Research on Learning. These programs were implemented in the study schools for two school years. The U.S. Department of Education's (ED) Office of Elementary and Secondary Education (OESE) funded the implementation of these programs, and its Institute of Education Sciences (IES) was responsible for oversight of the evaluation. MDRC--a nonprofit, nonpartisan education and social policy research organization--conducted the evaluation in partnership with the American Institutes for Research (AIR) and Survey Research Management (SRM). The goal of the reading interventions--which consist of a year-long course that replaces a ninth-grade elective class--is to help striving adolescent readers develop the strategies and routines used by proficient readers, thereby improving their reading skills and ultimately, their academic performance in high school. The first two reports for the study evaluated the programs' impact on the two most proximal outcomes targeted by the interventions--students' reading skills and their reading behaviors at the end of ninth grade. This report--which is the final of three reports for this evaluation--examines the impact of the ERO programs on the more general outcomes that the programs hope to affect--students' academic performance in high school (grade point average [GPA], credit accumulation, and state test scores) as well as students' behavioral outcomes (attendance and disciplinary infractions). These academic and behavioral outcomes are examined during the year in which they were enrolled in the ERO programs (ninth grade), as well as the following school year (tenth grade for most students). Appendices include: (1) The ERO Programs and the ERO Teachers; (2) ERO Student Survey Measures; (3) ERO Implementation Fidelity; (4) State Tests Included in the ERO Study; (5) Response Analysis and Baseline Comparison Tables; (6) Technical Notes for Impact Findings; (7) Statistical Power and Minimum Detectable Effect Size; (8) Supplementary Impact Findings; (9) Baseline and Impact Findings, by Cohort; (10) The Association Between Reading Outcomes and Academic Performance in High School; (11) Variation in Impacts Across Sites and Cohorts; (12) Program Costs; and (13) Poststudy Adolescent Literacy Programming in the ERO Schools: Methodology and Additional Findings. (Contains 97 tables, 23 figures, 2 boxes, and 185 footnotes.) [This paper was written with Edmond Wong. For the first-year report, see ED499778. For the second report, see ED503380.]
Reviews of Individual Studies 7-8 1
Accommodations for English Language Learner Students: The Effect of Linguistic Modification of Math Test Item Sets. Final Report. NCEE 2009-4079 (2010)
This study examined the effect of linguistic modification on middle school students' ability to show what they know and can do on math assessments. REL West's study on middle school math assessment accommodations found that simplifying the language--or linguistic modification--on standardized math test items made it easier for English Language learners to focus on and grasp math concepts, and thus was a more accurate assessment of their math skills. The results contribute to the body of knowledge informing assessment practices and accommodations appropriate for English language learner students. The study examined students' performance on two sets of math items--both the originally worded items and those that had been modified. Researchers analyzed results from three subgroups of students--English learners (EL), non-English language arts proficient (NEP), and English language arts proficient (EP) students. Key results include: (1) Linguistically modifying the language of mathematics test items did not change the math knowledge being assessed; (2) The effect of linguistic modification on students' math performance varied between the three student subgroups. The results also varied depending on how scores were calculated for each student; and (3) For each of the four scoring approaches analyzed, the effect of linguistic modification was greatest for EL students, followed by NEP and EP students. The report is structured as follows. Following an Executive Summary and a Study Overview, Chapter 2 describes the study design, sample selection and recruitment, item set development processes, and standardized administration procedures. Chapter 3 describes the implementation of the accommodation (linguistic modification), including discussion of considerations and methods for data analysis. Chapter 4 presents findings from data analyses. Chapter 5 summarizes and interprets key findings, describes study challenges, comments on implications of the findings, and offers recommendations for future research. Appendices include: (1) Power analysis for primary research questions; (2) Operational test administration manual; (3) Student Language Background Survey; (4) Guide for developing a linguistically modified assessment; (5) Workgroup training materials; (6) Overview and protocol for cognitive interviews; (7) Item parameter estimates for IRT models; (8) Descriptive statistics from four scoring approaches; (9) ANOVA findings across four scoring approaches; (10) Cross-approach comparisons; (11) Results of the classical item-level analyses; (12) Summary of differential item functioning findings; (13) Exploratory factor analysis results; (14) Operational item set--original; and (15) Operational item set--linguistically modified. (Contains 31 tables, 10 figures, and 45 footnotes.)
Reviews of Individual Studies K 1
The Effectiveness of a Program to Accelerate Vocabulary Development in Kindergarten (VOCAB): Kindergarten Final Evaluation Report. NCEE 2010-4014 (2010)
State education departments, in discussions with Regional Educational Laboratory (REL) Southeast, identified low reading achievement as a critical issue for their students and expressed an interest in identifying effective strategies to promote the foundational skills in young students that might improve reading achievement. The Mississippi State Department of Education has focused specifically on interventions that might enhance students' vocabulary knowledge. Kindergarten PAVEd for Success (K-PAVE) was selected to be tested in Mississippi for three reasons. First, there were only a small number of vocabulary interventions appropriate for this age group to be considered. Second, among these, PAVE--the preschool version of the intervention--was the only one for which an impact study had been completed that provided some evidence of effects. Third, K-PAVE was the only curriculum that had developed teacher training materials and a training protocol, which meant that it could be implemented with sufficient fidelity across a variety of districts and school settings. The primary research question for the study addressed the impact of K-PAVE on kindergarten students' expressive vocabulary. Secondary research questions addressed the impacts on kindergarten students' academic knowledge and listening comprehension. Although the study was concerned primarily with the impacts of K-PAVE on students, impacts on intermediate classroom instruction outcomes were also assessed to provide context for understanding potential impacts on students. The study addressed research questions about impacts on classroom instruction in vocabulary and comprehension support, instructional support, and emotional support. Finally, the study examined whether the introduction of K-PAVE had the unintended consequence of reducing the time spent on areas of literacy instruction other than vocabulary and comprehension (such as phonological awareness, alphabet knowledge, print concepts, and decoding). The study found that kindergarten students in schools using K-PAVE as a supplement to the regular literacy instruction performed better than kindergarten students in control schools on the Expressive Vocabulary Test-2 administered at the end of the school year. The study also found that kindergarten students in K-PAVE schools performed better than students in control schools on the measure of academic knowledge administered at the end of the year. K-PAVE caused a positive and statistically significant impact on one of the three kindergarten classroom instructional practices examined: vocabulary and comprehension support, which includes introducing vocabulary words during read-alouds, introducing vocabulary words throughout the school day, asking higher order questions during read-alouds, and providing comprehension support during book read-alouds. Appendices include: (1) Mississippi Counties with Study Schools, by County; (2) Statistical Power Analysis; (3) Random Assignment; (4) Recruitment and Random Selection of the Student Sample; (5) Comparison of Students Missing and Not Missing Baseline Assessment; (6) Classroom Observation Measures for Impact Evaluation; (7) Teacher Survey; (8) K-PAVE Fidelity Observer Handbook and Training Fidelity Checklist; (9) Data Collection Procedures; (10) Data Quality Assurance Procedures; (11) Model Specifications; (12) Flowchart Illustrating Sample Attrition from Data Collection; (13) Missing Data Imputation; (14) Sensitivity Analyses; (15) School, Teacher, and Student Covariates; (16) List of K-PAVE Materials Provided to Teachers; (17) Sample Weekly Unit from K-PAVE Program; (18) List of the 240 K-PAVE Target Words; (19) K-PAVE Teacher Training Agenda; (20) K-PAVE Teacher Phone Follow-Up Agenda; (21) Sample Means and Standard Deviations for Student and Classroom Outcome Measures, by Intervention Status; (22) Checking Model Assumptions; and (23) Translating Impacts on Students into Age-Equivalent Differences in Posttest Outcomes. (Contains 53 tables, 16 figures, 1 map, 3 boxes, and 86 footnotes
Reviews of Individual Studies K-5 1
Examining the Effects of Schoolwide Positive Behavioral Interventions and Supports on Student Outcomes: Results from a Randomized Controlled Effectiveness Trial in Elementary Schools (2010)
Schoolwide Positive Behavioral Interventions and Supports (SWPBIS) is a universal, schoolwide prevention strategy that is currently implemented in over 9,000 schools across the nation to reduce disruptive behavior problems through the application of behavioral, social learning, and organizational behavioral principles. SWPBIS aims to alter school environments by creating improved systems and procedures that promote positive change in student behavior by targeting staff behaviors. This study uses data from a 5-year longitudinal randomized controlled effectiveness trial of SWPBIS conducted in 37 elementary schools to examine the impact of training in SWPBIS on implementation fidelity as well as student suspensions, office discipline referrals, and academic achievement. School-level longitudinal analyses indicated that the schools trained in SWPBIS implemented the model with high fidelity and experienced significant reductions in student suspensions and office discipline referrals. (Contains 1 table and 5 figures.)
Reviews of Individual Studies K-2 1
Implementation of Effective Intervention: An Empirical Study to Evaluate the Efficacy of Fountas & Pinnell's Leveled Literacy Intervention System (LLI). 2009-2010 (2010)
This report summarizes evaluation results for an efficacy study of the Leveled Literacy Intervention system (LLI) implemented in Tift County Schools (TCS) in Georgia and the Enlarged City School District of Middletown (ECSDM) in New York during the 2009-2010 school year. Developed by Fountas & Pinnell (2009) and published by Heinemann, LLI is a short-term, small-group, supplemental literacy intervention system designed for students in kindergarten through second grade (K-2) who struggle with literacy. The goal of LLI is to provide intensive support to help these early learners quickly achieve grade-level competency. Both school districts evaluated in this study adopted the targeted, small-group implementation model of LLI in their schools with support from Heinemann consultants providing LLI professional development. This report focuses on the implementation and impact of this model during the first full school year of the system in these schools. The purpose of this study was threefold: (1) to determine the efficacy of the Leveled Literacy Intervention system (LLI) in increasing reading achievement for K-2 students; (2) to examine the implementation fidelity of LLI; and (3) to determine perceptions of the LLI system according to relevant stakeholders. This study focused on two U.S. school districts and comprised 427 K-2 students who were matched demographically and randomly assigned to treatment and control groups. This evaluation used a mixed-methods design to address the following key research questions: (1) What progress in literacy do students who receive LLI make compared to students who receive only regular classroom literacy instruction? (2) Was LLI implemented with fidelity to the developers' model? and (3) What were LLI teachers' perceptions of LLI and its impact on their students' literacy? Altogether, the results from this evaluation allow us to conclude that the LLI system positively impacts students' literacy skills. These results also suggest that continued implementation of LLI would be beneficial in both Tift County Schools and the Enlarged City School District of Middletown. From this evaluation, CREP proposes several recommendations. (Contains 34 tables, 8 footnotes, and 1 figure.) [This study was supported by funding from Heinemann Publishing.]
Reviews of Individual Studies 8 1
Can Interdistrict Choice Boost Student Achievement? The Case of Connecticut's Interdistrict Magnet School Program (2009)
Connecticut's interdistrict magnet schools offer a model of choice-based desegregation that appears to satisfy current legal constraints. This study presents evidence that interdistrict magnet schools have provided students from Connecticut's central cities access to less racially and economically isolated educational environments and estimates the impact of attending a magnet school on student achievement. To address potential selection biases, the analyses exploit the random assignment that results from lottery-based admissions for a small set of schools, as well as value-added and fixed-effect estimators that rely on pre-magnet school measures of student achievement to obtain effect estimates for a broader set of interdistrict magnet schools. Results indicate that attendance at an interdistrict magnet high school has positive effects on the math and reading achievement of central city students and that interdistrict magnet middle schools have positive effects on reading achievement. (Contains 20 notes, 8 tables, and 1 figure.)
Reviews of Individual Studies 4-8 1
Impact Evaluation of the U.S. Department of Education's Student Mentoring Program. Final Report. NCEE 2009-4047 (2009)
This report summarizes the findings from a national evaluation of mentoring programs funded under the U.S. Department of Education's Student Mentoring Program. The impact evaluation used an experimental design in which students were randomly assigned to a treatment or control group. Thirty-two purposively selected School Mentoring Programs and 2,573 students took part in the evaluation, which estimated the impact of the programs over one school year on a range of student outcomes. The evaluation also describes the characteristics of the program and the mentors, and provides information about program delivery. The Student Mentoring Program is designed to fund grantees to enable them to provide mentoring to at-risk students in grades 4-8. The ultimate goal of the program is to improve student academic and behavioral outcomes through the guidance and encouragement of a volunteer mentor. Seventeen total impacts in the domains of academic achievement/engagement, interpersonal relationships/personal responsibility, and high-risk/delinquent behavior were measured. The main finding of the Impact Study was that there were no statistically significant impacts of the Student Mentoring Program for the sample as a whole on this array of student outcomes. However, there was some scattered evidence that impacts were heterogeneous across types of students. In particular, impacts on girls were statistically significantly different from impacts on boys for two self-reported scales: Scholastic Efficacy and School Bonding, and Pro-social Behaviors. For boys, the impact on Prosocial Behaviors was negative and statistically significant. For girls, the impact on Scholastic Efficacy and School Bonding was positive and statistically significant. The impact on truancy was negative and statistically significant for students below age 12. There were negative associations between program supervision of mentors and site-level impacts on three of the seventeen individual outcome measures: Pro-social Behaviors, grades in math and social studies, and a positive relationship with the outcome of school-reported delinquency. The report also presented results demonstrating that the Student Mentoring Program represented a fairly low level of intensity in terms of service: although grantees, on average, adhered to the general intents of the legislation and program guidance, they were simultaneously constrained by the limits of the school calendar and the population from which to draw mentors. Thirty-five percent of the control group students reported receiving mentoring either from the program or elsewhere in the community; this finding, coupled with the fact that not all treatment group students met with a mentor, reduced the treatment contrast and may have led to some dilution of the impacts on students compared to expectations. Seven appendices are included; (1) Sampling Design and Methodology; (2) Survey Instruments; (3) Construction of Student Outcome Measures; (4) Impact Analysis Results on Original Student Survey Scales and Measures; (5) Sensitivity Tests; (6) Standard Errors and Confidence Intervals of Main Effects; and (7) Site-Level Predictors and Impacts. (Contains 109 footnotes and 122 exhibits.) ["Impact Evaluation of the U.S. Department of Education's Student Mentoring Program. Final Report" was written with the assistance of Christine Dyous, Michelle Klausner, Nancy McGarry, Rachel Luck and William Rhodes.]
Reviews of Individual Studies 5-9 1
Evaluation of the Computer and Team Assisted Mathematical Acceleration (CATAMA) Lab for Urban, High-Poverty, High Minority Middle Grade Students. Final Report to the Institute of Education Sciences (2008)
This project entailed a three-year efficacy evaluation of the Computer and Team Assisted Mathematical Acceleration (CATAMA) Lab developed by the Center for Social Organization of Schools at Johns Hopkins University. The CATAMA Lab was proposed as an immediate and practical approach to addressing the different types of math deficits held by students at urban high-poverty schools. The Lab required only 1 teacher per school reducing staff and professional development requirements. It used multiple instructional techniques (including individualized computer instruction, direct instruction, pair and team learning, and individual instruction) to teach math concepts and skills. By taking the place of an elective it allowed students to continue with their on-grade math class. For a more detailed description of the Lab see Appendix 2. The original goal of the project was to establish the Lab at three urban schools serving high-poverty high-minority middle grade students (grades 5-8). Students underperforming in mathematics (as established by district standardized tests) were to take a trimester course of study in the Lab to increase their knowledge of math concepts and skills taught by a regular math teacher receiving extensive ongoing professional development. Students were to take the Lab as an elective course while continuing with their regular math class. From each school's pool of students eligible to participate, students were to be randomly assigned to take the Lab. An implementation analysis was to measure the teaching of the concepts and skills to be taught in the Lab. To evaluate the impact of the intervention, students' math achievement, as measured by standardized math tests, was to be compared to eligible students not assigned to the Lab. This report discusses the project in three sections: (1) A comparison of the actual project with the planned project; (2) The descriptive results from the project; (a) Description of the sample; (b) Description of implementation of the CATAMA Lab; and (3) The evaluative results from the project.
Reviews of Individual Studies 1-5 1
A multisite cluster randomized field trial of Open Court Reading. (2008)
In this article, the authors report achievement outcomes of a multisite cluster randomized field trial of Open Court Reading 2005 (OCR), a K-6 literacy curriculum published by SRA/McGraw-Hill. The participants are 49 first-grade through fifth-grade classrooms from predominantly minority and poor contexts across the nation. Blocking by grade level within schools, the trial includes 27 classrooms receiving the OCR curricular materials and professional development and 22 "business-as-usual" control classrooms. Multilevel analyses of classroom-level effects of assignment to OCR reveal statistically significant treatment effects on all three of the Comprehensive Test of Basic Skills, 5th edition, Terra Nova literacy posttests. The OCR effect sizes are d = 0.16 for the Reading Composite, d = 0.19 for Vocabulary, and d = 0.12 for Reading Comprehension. These effects achieved across 27 classrooms and 5 schools demonstrate the potential for replicating improved literacy outcomes through the scale-up of OCR. (Contains 4 tables and 1 note.)
Reviews of Individual Studies K 1
Scaling up an Early Reading Program: Relationships among Teacher Support, Fidelity of Implementation, and Student Performance across Different Sites and Years (2008)
Successful implementation of evidence-based educational practices at scale is of great importance but has presented significant challenges. In this article, the authors address the following questions: How does the level of on-site technical assistance affect student outcomes? Do teachers' fidelity of treatment implementation and their perceptions of school climate mediate effects on student performance? Using a randomized control trial at scale, the authors examine Kindergarten Peer Assisted Learning Strategies, which previously has been shown to be effective in increasing student reading achievement. Analyzing data from 2 years and three sites, the analyses show that the level of on-site technical support has significant effects on reading achievement gains, are robust across multiple sites, and are mediated by fidelity of implementation within teachers' classrooms. (Contains 2 figures and 4 tables.)
Reviews of Individual Studies 1-3 1
Final Reading Outcomes of the National Randomized Field Trial of Success for All (2007)
Using a cluster randomization design, schools were randomly assigned to implement Success for All, a comprehensive reading reform model, or control methods. This article reports final literacy outcomes for a 3-year longitudinal sample of children who participated in the treatment or control condition from kindergarten through second grade and a combined longitudinal and in-mover student sample, both of which were nested within 35 schools. Hierarchical linear model analyses of all three outcomes for both samples revealed statistically significant school-level effects of treatment assignment as large as one third of a standard deviation. The results correspond with the Success for All program theory, which emphasizes both comprehensive school-level reform and targeted student-level achievement effects through a multi-year sequencing of literacy instruction. (Contains 5 tables.)
Reviews of Individual Studies 1-5 1
Alternative Routes to Teaching: The Impacts of Teach for America on Student Achievement and Other Outcomes (2006)
This paper reports on a randomized experiment to study the impact of an alternative teacher preparation program, Teach for America (TFA), on student achievement and other outcomes. We found that TFA teachers had a positive impact on math achievement and no impact on reading achievement. The size of the impact on math scores was about 15 percent of a standard deviation, equivalent to about one month of instruction. The general conclusions did not differ substantially for subgroups of teachers, including novice teachers, or for subgroups of students. We found no impacts on other student outcomes such as attendance, promotion, or disciplinary incidents, but TFA teachers were more likely to report problems with student behavior than were their peers. The findings contradict claims that such programs allowing teachers to bypass the traditional route to the classroom harm students.
Reviews of Individual Studies 1-5 1
The Effects of Teach For America on Students: Findings from a National Evaluation. Discussion Paper no. 1285-04 (2004)
Teach For America (TFA) was founded in 1989 to address the educational inequities facing children in low-income communities across the United States by expanding the pool of teacher candidates available to the schools those children attend. TFA recruits seniors and recent graduates from colleges around the country, people who are willing to commit to teach for a minimum of two years in low-income schools. TFA focuses its recruitment on people with strong academic records and leadership capabilities, whether or not they have planned to teach or have taken education courses. TFA is particularly interested in candidates that have the potential to be effective in the classroom but in the absence of TFA would not consider a teaching career. Consequently, most TFA recruits do not have education-related majors in college and therefore have not received the same training that traditional teachers are expected to have. After an executive summary and introduction, this discussion paper addresses the following: (1) How TFA Works; (2) Study Design; (3) Who Teaches in the Schools Where TFA Places Teachers?; (4) What Does Our Sample of Students Look Like?; (5) Were TFA Teachers Effective in the Classroom?; and (6) Did TFA Have an Impact on Other Student Outcomes? Primary findings from the study include: from the perspective of a community or a school faced with the opportunity to hire TFA teachers, TFA offers an appealing pool of candidates; from the perspective of TFA and its funders, the organization is making progress toward its primary mission of reducing inequities in education--it supplies low-income schools with academically talented teachers who contribute positively to the academic achievement of their students; and from the perspective of policymakers who are trying to improve the educational opportunities of children in poor communities, many of the control teachers in the study were not certified or did not have formal pre-service training, highlighting the need for programs or policies that offer the potential of attracting good teachers to schools in the most disadvantaged communities--the findings show that TFA is one such program. Appended are: (1) Supplementary Tables; and (2) Estimation Approach. (Contains 17 tables and 6 figures.)
Reviews of Individual Studies 8 1
Implementation study of Chemistry That Applies (2002–2003): SCALE-uP Report No. 2. (2004)
Reviews of Individual Studies 9-12 1
Career Academies: Impacts on Labor Market Outcomes and Educational Attainment (2004)
Career Academies offer high schools--particularly those in urban communities that struggle to keep students in school and to prepare them for post-secondary education and employment opportunities--a systematic approach to addressing a range of challenges. Typically serving between 150 and 200 students from grades 9 or 10 through grade 12, Career Academies have three distinguishing features: (1) they are organized as small learning communities to create a more supportive, personalized learning environment; (2) they combine academic and career and technical curricula around a career theme to enrich teaching and learning; and (3) they establish partnerships with local employers to provide career awareness and work-based learning opportunities for students. There are estimated to be more than 2,500 Career Academies across the country, operating either as a single program or as multiple programs within a larger high school. This report examines the impact that Career Academies have had on the educational attainment and post-secondary labor market experiences of young people through the four years following their scheduled graduation from high school. It is based on survey data collected from 1,458 young people in the Career Academies Evaluation study sample (about 85 percent of whom are either Hispanic or African-American). Findings included: (1) the Career Academies substantially improved the labor market prospects of young men, a group that has experienced a severe decline in real earnings in recent years; (2) the Career Academies had no significant impacts (positive or negative) on the labor market outcomes for young women; (3) Overall, the Career Academies served as viable pathways to a range of post-secondary education opportunities, but they do not appear to have been more effective than options available to the non-Academy group; and (4) The positive labor market impacts were concentrated among Academy group members who were at high or medium risk of dropping out of high school when they entered the programs. The findings demonstrate the feasibility of improving labor market preparation and successful school-to-work transitions without compromising academic goals and preparation for college. (Contains 10 exhibits.) [Report written with Judith Scott-Clayton. Dissemination of MDRC publications is also supported by Starr Foundation.]
Reviews of Individual Studies 9-12 1
Career Academies: Impacts on Labor Market Outcomes and Educational Attainment (2004)
Career Academies offer high schools--particularly those in urban communities that struggle to keep students in school and to prepare them for post-secondary education and employment opportunities--a systematic approach to addressing a range of challenges. Typically serving between 150 and 200 students from grades 9 or 10 through grade 12, Career Academies have three distinguishing features: (1) they are organized as small learning communities to create a more supportive, personalized learning environment; (2) they combine academic and career and technical curricula around a career theme to enrich teaching and learning; and (3) they establish partnerships with local employers to provide career awareness and work-based learning opportunities for students. There are estimated to be more than 2,500 Career Academies across the country, operating either as a single program or as multiple programs within a larger high school. This report examines the impact that Career Academies have had on the educational attainment and post-secondary labor market experiences of young people through the four years following their scheduled graduation from high school. It is based on survey data collected from 1,458 young people in the Career Academies Evaluation study sample (about 85 percent of whom are either Hispanic or African-American). Findings included: (1) the Career Academies substantially improved the labor market prospects of young men, a group that has experienced a severe decline in real earnings in recent years; (2) the Career Academies had no significant impacts (positive or negative) on the labor market outcomes for young women; (3) Overall, the Career Academies served as viable pathways to a range of post-secondary education opportunities, but they do not appear to have been more effective than options available to the non-Academy group; and (4) The positive labor market impacts were concentrated among Academy group members who were at high or medium risk of dropping out of high school when they entered the programs. The findings demonstrate the feasibility of improving labor market preparation and successful school-to-work transitions without compromising academic goals and preparation for college. (Contains 10 exhibits.) [Report written with Judith Scott-Clayton. Dissemination of MDRC publications is also supported by Starr Foundation.]
Reviews of Individual Studies K-5 1
Improved language skills by children with low reading performance who used Fast ForWord Language. (2004)
Reviews of Individual Studies 9-Adult 1
Career Academies: Impacts on Students' Engagement and Performance in High School. (2000)
The career academy approach is one of the oldest and most widely established high school reforms in the U.S., stretching back for more than 30 years. A large-scale, multi-site, random assignment research design was conducted to determine the impact of career academies on student outcomes. Some of the findings of the study include the following: (1) the career academies in the study increased both the level of interpersonal support students experienced and their participation in career awareness and work-based learning activities; (2) the career academies substantially improved high school outcomes among students at high risk of dropping out; (3) among students least likely to drop out, the career academies increased the likelihood of graduating on time; (4) in academies that greatly enhanced interpersonal support from teachers and peers, the dropout rates dropped dramatically; (5) the academies did not improve standardized mathematics and reading test scores; and (6) the impact of the academies and the types of students who participated in them varied greatly from site to site. The study concluded that career academies can be an effective means of reducing the high school dropout rate and enhancing students' engagement with school, especially if they increase personal support of students through involvement with teachers and peers. (Contains 33 references and two appendixes that provide supplementary information about the career academies research study and strategies for creating subgroups of students defined by at-risk characteristics.) (KC)
Reviews of Individual Studies K 1
Initial impact of the Fast Track prevention trial for conduct problems: I. (1999a)
Reviews of Individual Studies K-5 2
NURTURES: Longitudinal Summary of Project Impact on Students' Mathematics, Reading, & Science Learning (2024)
Because standardized tests in science are not given to PreK-3 students in Ohio, this report examined the longitudinal effects of learning from a teacher who had participated in the NURTURES professional development program. Specifically, it looked at the effects on students' mathematics and reading learning in grades 2-5 and science learning in 5th grade in 2017. Students who were in 5th grade at that time could have had a NURTURES-trained teacher at any time between kindergarten and 3rd grade. Thus, the study followed students up to 5 years after having a NURTURES teacher. The sample included the population of students enrolled in the 41 elementary schools in the Toledo Public School District. Students who never learned from a teacher who participated in NURTURES served as the control group. The data came from the 2017 administration of the Ohio Measure of Academic Progress (MAP) (NWEA, 2019) for mathematics and reading and the Ohio Achievement Test in Science for science (Ohio Achievement Assessment, 2015). The total number of students from these schools who took the May 2017 reading MAP was 6759 and the total number who took mathematics was 6703. The number of those students who had at least one NURTURES teacher was 2801 (41.4%) for reading and 2707 (41.6%) for mathematics. Analysis of the reading scores showed 2.14 advantage points for NURTURES students as compared to the average non-intervention student to an annual growth rate of 7.02 units (p < .001). The treatment effect size (Hedges' g) was 0.12. For mathematics there were 1.55 advantage points to an annual growth rate estimated to be 8.17 units (p < .001) as compared to the average non-intervention student. The treatment effect size (Hedges' g) was 0.09. Analysis of the 5th grade Ohio Achievement Science Subtest showed that students associated with at least one NURTURES-trained teacher was modeled to have a 5.86 advantage points as compared to the average non-intervention student. The treatment effect size (Hedges' g) was 0.08, which is to be interpreted as a treatment group having, on average, 0.08 higher scores in standard deviation units as compared to the scores of the control cohort. When compared with our earlier evaluation report (2016; revised in 2018), we see that students who had a NURTURES-trained teacher, on average, continued to show greater gains compared to students who did not. In addition, the achievement gaps between non-minority and minority students in reading and mathematics were reduced when the minority students had a NURTURES-trained teacher and the non-minority students did not. In science, the impact of the intervention roughly compensated for the attainment gap between boys and girls and partially ameliorated the gap between minority and non-minority children's scores associated with these demographic factors. [Published May 6, 2020 with minor revisions based in WWC inquiries published January 5, 2024.]
Reviews of Individual Studies 9-12 2
Improving science achievement - Is it possible? evaluating the efficacy of a high school chemistry and physics project-based learning intervention (2022)
Reviews of Individual Studies 12-PS 2
Does Dual Enrollment Influence High School Graduation, College Enrollment, Choice, and Persistence? (2022)
This study examines relationships between dual enrollment and high school graduation, college enrollment, college choice (2-year or 4-year), and persistence in college among Nebraska's 2018 high school graduating class. Unlike previous studies that focus on states where dual enrollment is standardized and subsidized by state policy, the Nebraska context offers an opportunity to study potentially heterogeneous effects of dual enrollment where implementation is devolved to the local level. Using propensity score matching, we find that taking at least one dual enrollment course was positively associated with graduating from high school, going to college, choosing a 4-year college over a 2-year college, and re-enrolling in college in the second year. More importantly, the positive association was greater for racial minority students, first-generation students, and low-income students. Our findings suggest that dual enrollment may help close achievement gaps for historically underrepresented students. We provide policy implications on how states can use dual enrollment to improve higher education access and success.
Reviews of Individual Studies 12-PS 2
Biliteracy Seals in a Large Urban District in New Mexico: Who Earns Them and How Do They Impact College Outcomes? REL 2023-140 (2022)
New Mexico is one of 48 states that offer a biliteracy seal to high school graduates to recognize their proficiency in a non -English language. The Regional Educational Laboratory Southwest English Learners Research Partnership collaborated with a large urban district in New Mexico to study the characteristics and college readiness of students who earned different types of biliteracy seals (state, district, and global seals), the number of students who met some requirements for a seal but did not earn one, and the effect of earning a seal on college outcomes. The study used data from three cohorts of grade 12 students in the district from 2017/18 to 2019/20. Between 2017/18 and 2019/20, 7 percent of graduates earned at least one type of biliteracy seal, and these graduates were more likely than graduates who did not earn a seal to be Hispanic, to be eligible for the National School Lunch Program, to be a current English learner student, to have ever been an English learner student, and to speak Spanish at home. Graduates who earned a biliteracy seal were more likely than similar graduates who did not earn a seal to enroll in college within one year of high school graduation. Finally, among graduates who enrolled in college, graduates who earned a biliteracy seal were more likely than graduates who did not earn a seal to enroll in a four-year college and to enroll in college full time. The New Mexico Public Education Department and district leaders can use the findings to decide how to expand access to biliteracy seals. [For the Study Snapshot, see ED624244. For the appendixes, see ED624246.]
Reviews of Individual Studies 12-PS 2
What Were the Reach and Impact of the Oregon Promise Financial Aid Program in Its First Two Years? REL 2022-119 (2021)
In 2015 Oregon became the second state in the country to implement a statewide promise program. Its program, Oregon Promise, seeks to promote students' postsecondary attainment by covering nearly all community college tuition. This study used student data from K-12 public schools, Oregon Promise applications, and postsecondary records to examine which public high school seniors the program reached and served and to assess the program's impact on high school graduates' postsecondary outcomes in its first two years. The study found that Oregon Promise applicants generally reflected the demographic composition of all Oregon public high school seniors in 2015/16 and 2016/17, although applicants were more likely to be female and less likely to have received special education services. While applicant characteristics were similar in the first and second years, there were fewer eligible applicants and recipients in the second year, when an expected family contribution limit was added, than in the first year, and they were more likely to be from low-income households and to be students of color. Using grade point average (GPA) data from the Portland metropolitan area, the study also found that lowering the GPA requirement would have increased the overall applicant pool, as well as the number of applicants from low-income households and applicants of color. Just over half of recipients in the first year of the program renewed their award and received it in their second year at a community college. These recipients had better high school attendance and were more likely to have participated in college-level coursework during high school than recipients who received an award only in their first year. Finally, among high school graduates in the Portland metropolitan area with a GPA close to the eligibility cutoff (2.5), the offer of an award had a positive impact on first-year persistence and on persistence or college completion within four years of high school graduation. Findings from the statewide exploratory analysis also found positive program impacts on first-year persistence and persistence or college completion within three or four years of high school graduation for all 2015/16 and 2016/17 seniors in the state. Oregon stakeholders can use the findings to better understand the reach and impact of the Oregon Promise program, implications of program requirements on the number and composition of applicants and recipients, and the high school experiences of recipients who renewed their award. [For the Study Snapshot, see ED615646. For the appendixes, see ED615648.]
Reviews of Individual Studies 9-12 2
Creating a Future-Oriented Culture in High Schools: The Impact of the College and Career Readiness Expansion (CCRE) Project (2021)
The College and Career Readiness Expansion project was a five-year, federally funded effort to implement early college strategies in comprehensive high schools. This report presents the results from a quasi-experimental impact study of the project and a mixed methods examination of its implementation. Results showed that the program increased the percentage of students on-track for college in 9th and 10th grade and expanded the number of students taking dual enrollment courses, although there was no positive impact on college credits earned in high school. The implementation study found that schools were created a more future-oriented culture.
Reviews of Individual Studies 7 2
Effects of an Inquiry-Oriented Curriculum and Professional Development Program on Grade 7 Students&apos; Understanding of Statistics and on Statistics Instruction. REL 2021-055 (2021)
On average, Florida students earn only half of the points possible in the statistics content area of the state's annual mathematics assessment. Leaders in Broward County Public Schools, a large, diverse, urban school district, viewed changes to statistics curriculum and instruction as one way to address this issue. This study randomly assigned 40 middle schools in the district to either implement a replacement curriculum unit with four days of teacher professional development in probability and statistics or continue with their practice-as-usual instruction in probability and statistics. The replacement unit supported teaching and learning of all the probability and statistics standards in the grade 7 course description. The replacement unit with the associated professional development, called the Supporting Teacher Enactment of the Probability and Statistics Standards program, improved student understanding of statistics and statistics instruction. The magnitude of the effect on student understanding was 23 percent of 1 standard deviation, which is comparable to an increase of 9 percentile points for an average student. [For the appendixes, see ED610168. For the study snapshot, see ED610167.]
Reviews of Individual Studies 5-8 2
G[superscript 2]ROW STEM: Girls and Guys Realizing Opportunities with STEM (2021)
"G[superscript 2]ROW STEM" is an Investing in Innovation (i3) development grant funded by the Office of Innovation and Improvement, U.S. Department of Education. "G[superscript 2]ROW STEM" targets high-need middle school students, particularly females and minorities, that tend to be underrepresented in STEM careers. "G[superscript 2]ROW STEM" focuses on providing students with engaging, hands-on, project-based, extended-learning experiences to inspire interest in STEM and improve achievement. The impact evaluation used a quasi-experimental design (QED) to examine the effect of "G[superscript 2]ROW STEM" on academic achievement in science and math. "G[superscript 2]ROW STEM" student enrollment began during the 2016-17 school year and students were followed for three years, through the 2018-19 school year. Academic achievement outcomes for "G[superscript 2]ROW STEM" students were compared to a matched sample of students within the same grade in the same schools who participated in business-as-usual, traditional academic instruction with no extended learning experiences. Academic achievement for comparison students was also tracked over a three-year period. Results showed statistically significant differences between treatment and comparison groups in achievement test scores across both math and science. Overall, treatment students gained seven NCE score points more than the comparison group students did after up to three years in the "G[superscript 2]ROW STEM" program. This is roughly equivalent to one-third of a standard deviation. Significant differences were also noted for student subgroups with non-minority students realizing slightly higher gains in NCE scores than minority students by the end of the program (over all analyses a difference of 2.25 NCE points).
Reviews of Individual Studies 5 2
The Impact of Word Knowledge Instruction on Literacy Outcomes in Grade 5. REL 2021-083 (2021)
District leaders in a large urban school district in central Florida wanted to examine the efficacy of a new curriculum designed to enhance the word knowledge of grade 5 students so as to improve reading achievement. The new curriculum, called Word Knowledge Instruction (WKI), consists of 15-minute lessons 4 days a week for 20 weeks. The lessons address state standards and cover 20 prefixes and suffixes. Thirty-nine schools participated in the study, with 92 English language arts (ELA) teachers in high-poverty schools randomly assigned within schools either to use WKI or to continue to use their standard ELA curriculum. Classroom observations revealed that WKI was implemented as intended. WKI had a positive effect, equivalent to an increase of 9 percentile points, on students' ability to correctly extract and spell a base word from a derived word, one of the skills explicitly taught by WKI. WKI had no effect on two other related reading skills that were not directly taught by WKI (students' ability to select a nonword that best fits the grammatical context of a sentence or to use knowledge of word parts to infer meaning of new words) or on students' vocabulary or reading scores. These findings suggest that, although students learned what they were explicitly taught, the transferability to related but not directly taught skills might require more intense or longer duration instruction or additional professional development for teachers. [For the study snapshot, see ED611684. For the appendix, see ED611685.]
Reviews of Individual Studies 9-PS 2
The Effects of Accelerated College Credit Programs on Educational Attainment in Rhode Island. REL 2021-103 (2021)
This study examined participation in accelerated college credit programs dual enrollment, concurrent enrollment, and Advanced Placement courses in Rhode Island high schools to understand their effects on educational attainment in the 2013/14 grade 9 cohort. The state, which has funded and promoted these opportunities for students to earn college credit during high school over the past five years, sought evidence of the programs' effects on participants' high school graduation rates, postsecondary enrollment rates, and enrollment rates in developmental education courses in college. The study found that male, economically disadvantaged, and racial/ethnic minority students were underrepresented in accelerated college credit programs. Participation in these programs had positive effects on students' rates of high school graduation and postsecondary enrollment. Among students in the cohort who enrolled in Rhode Island public colleges, participation was associated with lower rates of developmental education course enrollment in the first year of college. The effects of participating in an accelerated college credit program were similar for economically disadvantaged students and for their peers. [For the Study Snapshot, see ED612888. For the appendices, see ED612890.]
Reviews of Individual Studies 9-PS 2
The Impact of Career and Technical Education on Postsecondary Outcomes in Nebraska and South Dakota. REL 2021-087 (2021)
Education leaders in Nebraska and South Dakota partnered with the Regional Educational Laboratory Central to examine how completing a sequence of career and technical education (CTE) courses in high school affects students' rates of on-time high school graduation and their rates of postsecondary education enrollment and completion within two and five years. The study found that CTE concentrators (students who complete a sequence of CTE courses aligned to a specific career field such as manufacturing or education and training) were 7 percentage points more likely than non-CTE concentrators to graduate from high school on time and 10 percentage points more likely to enroll in any type of postsecondary education within two years of their expected high school graduation year. The study also found that CTE concentrators were 3 percentage points more likely than non-CTE concentrators to earn a postsecondary award, such as a professional certificate, diploma, or associate's or bachelor's degree, within five years of their expected high school graduation year. CTE concentrators were 4 percentage points more likely than non-CTE concentrators to obtain up to an associate's degree as their highest postsecondary award within five years of their expected high school graduation year but 1 percentage point less likely to obtain a bachelor's degree or higher. [For the appendixes, see ED612631; for the study brief, see ED612632; for the study snapshot, see ED612633.]
Reviews of Individual Studies 9-PS 2
Indiana and Minnesota Students Who Focused on Career and Technical Education in High School: Who Are They, and What Are Their College and Employment Outcomes? REL 2021-090 (2021)
In Indiana and Minnesota the state education agency, state higher education agency, and the state workforce agency have collaborated to develop career and technical education courses intended to improve high school students' college and career readiness. These agencies partnered with the Regional Educational Laboratory Midwest to examine whether high school graduates in each state who completed a large number of career and technical education courses in a single career-oriented program of study (concentrators) had different college and workforce outcomes from graduates who completed fewer (samplers) or no career and technical education courses (nonparticipants). The study found that in the 2012/13-2017/18 graduation cohorts, male graduates were more likely to be concentrators than female graduates, and graduates who received special education services were more likely to be concentrators than those who did not receive services. Graduates who were not proficient in reading in grade 8 also were more likely to become concentrators than those who were proficient. Graduates who attended urban and suburban schools were more likely than students who attended town and rural schools to be nonparticipants. Concentrators were less likely than samplers and nonparticipants with similar characteristics to enroll in college, but the differences reflect mainly enrollment in four-year colleges. Concentrators were more likely to enroll in two-year colleges. Concentrators also were less likely than similar samplers and nonparticipants to complete a bachelor's degree within four to six years. Finally, compared with similar samplers and nonparticipants, concentrators were employed at higher rates in the first five years after high school and had higher earnings. [For the study brief, see ED613045; for the study snapshot, see ED613046; and for the appendixes, see ED613050.]
Reviews of Individual Studies 9-PS 2
Avid Participation in High School and Post-Secondary Success: An Evaluation and Cost Analysis (2020)
The purpose of this study is to evaluate the Advancement Via Individual Determination (AVID) program and to derive estimates of program costs. We used the Coarsened Exact Matching approach to match AVID students with non-AVID students on 40 baseline characteristics. After matching, we estimated group differences in high-school graduation and college enrollment. We used the ingredients method to estimate program costs and calculated cost-effectiveness ratios by the duration of participation. Findings indicate that students who complete at least one AVID elective have higher high school graduation and college enrollment rates than comparable non-AVID students. We discuss how AVID compares to other college outreach programs in terms of costs and effects.
Reviews of Individual Studies 9-12 2
Get the Picture?! Final Evaluation Report (2020)
The purpose of this study was to determine the effectiveness of Get the Picture?! in improving the overall college/career readiness of 900 students with disabilities in each of the nine participating treatment high schools in nine rural, high poverty Kentucky school districts after four years of implementation. This quasi-experimental study followed the 9th grade cohort of students with disabilities in the nine treatment and 18 matched control schools over four school years, 2015-16 through 2018-19. Through the development of self-determination skills, the goal of the intervention was to increase the number of students with disabilities who achieved the state standard for College and/or Career Readiness by meeting established benchmarks on State/National assessments and/or completion of a recognized industry certification in each of the nine participating schools. For the confirmatory analyses, there were two outcome variables in two different outcome domains: (a) Transition Ready, a binary "Yes"/"No" variable [Transition Readiness domain], and (b) the cumulative number of in-school suspensions (a continuous variable) [Self-management behaviors domain]. For the confirmatory analyses, outcome data were examined using two-level Hierarchical Linear Models (HLM) (for Cumulative In-School Suspensions) and Hierarchical Generalized Linear Models (HGLM) (for Transition Ready) to account for the nested structure of the data (i.e., students nested within schools). Overall, after four years of implementation, Get the Picture?! was able to demonstrate a statistically significant positive impact on the Transition Readiness of participating 9th grade cohort students compared to controls. Treatment students had statistically significantly higher odds of being Transition Ready, and were more than twice as likely to achieve Transition Readiness status compared to control students. However, while the confirmatory study showed the intervention was also able to reduce the total number of in-school suspensions for treatment students relative to controls, the outcome was indeterminate (i.e., not statistically significant). The following are appended: (a) Kentucky Department of Education Revised Transition Readiness Standards, and (b) Fidelity of Implementation Final Report.
Reviews of Individual Studies 3-12 2
A Team-Based Leadership Intervention in New York City Schools: An Evaluation of the Targeted Intensive School Support Program (2020)
In 2013, the NYC Leadership Academy (NYCLA) developed a leadership intervention--the Targeted Intensive School Support (TISS) program--in collaboration with the New York City Department of Education (NYC DOE) to support schools that were facing particular challenges. NYCLA asked the RAND Corporation to provide an independent evaluation of the program's implementation and effects, and those findings are detailed in this report. The TISS program consisted of five key components: (1) teaming and collaborative training in aligned preservice preparation programs for a principal and assistant principal (AP); (2) coplacement of a principal and AP into an NYC DOE school; (3) team-based coaching to support the principal and AP; (4) 328 hours of extended coaching over the first three years after placement; and (5) use of a diagnostic process to guide goal setting and coaching according to school needs. Implementation findings suggest that only two of the five key components were implemented with fidelity. A propensity weighting approach was used to compare schools with TISS principals to other schools with new principals trained through residency-based preservice programs who did not participate in TISS. Findings suggest no statistically significant differences between TISS schools and comparison schools on measures of student achievement, school culture, and principal retention. TISS schools underperformed relative to comparison schools on the measure of chronic student absenteeism. [Sponsored by NYC Leadership Academy through a subgrant from the U.S. Department of Education.]
Reviews of Individual Studies 3-12 2
Illustrating the Promise of Community Schools: An Assessment of the Impact of the New York City Community Schools Initiative. Research Report. RR-3245-NYCCEO (2020)
With the launch of the New York City Community Schools Initiative (NYC-CS) in 2014, the New York City Department of Education (NYCDOE) has increased its focus on the implementation of a holistic strategy of education reform to address the social consequences of poverty as a means to improving student outcomes. NYC-CS is a strategy to organize resources in schools and share leadership among stakeholders so that academics, health and wellness, youth development, and family engagement are integrated into the fabric of each school. New York City is implementing this strategy at a scale unmatched nationally. In this study, the authors assessed the impact of the NYC-CS through the 2017-2018 school year. The authors assessed the effects along seven outcome domains and explored the extent to which there is heterogeneity in programmatic impact based on student- and school-level characteristics. The authors leveraged innovative quasi-experimental methodology to determine whether students in the community schools are performing better than they would be had their schools not been designated as Community Schools. The findings of this report will contribute to the emerging evidence base on the efficacy of the community school strategy and will be useful for other school district- and state-level policymakers interested in developing or refining similar interventions that support students' and communities' academic, social, and emotional well-being. [The research described in this report was prepared for the New York City Mayor's Office for Economic Opportunity (NYC Opportunity).]
Reviews of Individual Studies 9-12 2
2015 Collaborative Regional Education (CORE) i3 Validation Study: Implementation and Impact Study Results. Final Report (2020)
Purpose: The purpose of this two-year study was to assess the impact of the CORE program, a model that integrates technology and active learning modules in high schools by providing multi-disciplinary teams of teachers and administrators with professional development and resources to support the development of students' non-cognitive skills and increase their college and career readiness. A fidelity of implementation study was also conducted to assess the seven key program components were being implemented as intended. Methods: This Randomized Control Trial (RCT) study followed a cohort of 9th and 10th grade high school students in 28 treatment and control schools; students completed the CWRA+ assessment and non-cognitive skills, engagement, and self-efficacy scales at three timepoints. Using the hierarchical linear model (HLM), the study assessed one-year program impact and two-year program impact. The two-year program impact model suffered a high attrition (due to COVID19) and the study became a quasi-experimental design (QED) study after propensity score matching analysis was applied. Results: Findings highlight how students at CORE schools showed increased scores across the two-year program intervention. Specifically, standardized effects on CWRA+ scores, the non-cognitive skills scale, engagement scale, and efficacy scale were respectively, 0.22, 0.22, 0.23, and 0.32. The effect size for the efficacy scale (0.32) was large enough to be considered important. To selectively mention exploratory findings, the level of program exposure both in terms of whether students were enrolled in the program-trained teachers' courses and whether teachers participated in PD activities seemed correlated with a higher growth in student's CWRA+ scores. Another set of exploratory findings implied that the program impact may interact with demographic characteristics of students. Findings demonstrate a need for further testing of differences between student subgroups based on demographics, as well as the importance of buy-in from program implementers to provide the customized PD support that educators and partners at rural schools need to more effectively serve their students. The exploratory findings suggested that the program exposure of teachers and students may be a key to enhance the CORE program impact. [This report was submitted by the ICF Evaluation Team.]
Reviews of Individual Studies 11-PS 2
Does Concurrent Enrollment Improve College Access, Success, Time-to-Degree and Earnings? A Quasi-Experimental Analysis of Colorado Students. Technical Report. Report No. 19-15B (2020)
The term dual, or concurrent, enrollment refers to the broad array of programs available to high school students that allow them to take college-level courses for credit. Dual enrollment creates multiple pathways to college by enabling high school students to take: (1) selected academic courses on college campuses; (2) college-led academic courses at their high school; or, (3) a hybrid of both. In addition, some dual enrollment programs permit students to take post-secondary level career and technical education courses. This study shows Concurrent Enrollment to be highly effective in increasing college graduation for high school students in Colorado. The sample included students across different demographics and academic abilities. Compared to students who did not take college courses while in high school, students who took Concurrent Enrollment courses were more likely to: (1) Attend college within one year following high school graduation, (2) Earn a college degree on time or early, and (3) Have higher workforce earnings after five years. [The Institute of Behavioral Science (IBS) at the University of Colorado Boulder also produced this report.]
Reviews of Individual Studies 12-PS 2
The Story of Scaling Up: Interim Report on the Impact of Success Boston&apos;s Coaching for Completion (2019)
Access to middle class jobs increasingly requires a college degree or credential. Individuals with postsecondary education have competitive advantage in the labor market: even when a job does not explicitly require a degree, a candidate with a degree will tend to be hired over an equally qualified candidate without one. Low-income students, in particular, along with first-generation students and racial/ethnic minorities, are underrepresented in postsecondary education Massachusetts is faced with an aging workforce where nearly half of the labor market is 45 or older. In Boston, the six-year college graduation rate for the city's 2011 public high school graduates who enrolled in college was 52 percent. This rate improves upon the 39 percent seven-year rate for 2000 graduates, yet likely is not sufficient to meet the predicted demand for a college-educated workforce. One-on-one coaching from experienced counselors when students are completing their senior year in high school and beginning college can help them succeed. A core strategy of the city-wide "Success Boston" initiative is one-on-one transition coaching. The coaching model is implemented across a network of nonprofit organizations (that provide coaching) in partnership with institutions of higher education. Transition coaching offers students sustained, proactive, and responsive support in their first two years after high school. This report refers to the transition coaching program as Success Boston Coaching (SBC). The report is designed to answer four main research questions about implementation and impact: (1) What is the effect of SBC on student success in college?; (2) How, if at all, do the impacts of SBC vary by student characteristics and features of the coaching?; (3) How is SBC implemented across partner organizations and partner colleges? and (4) What resources are necessary to implement SBC? This report focuses on the effectiveness of coaching on students' persistence and achievement early in college, answering the first and second research questions. [For the previous report, "Success Boston: Coaching for Completion. 2015-16 Implementation Report," see ED582088. For the companion report, "The Story of Scaling Up: Highlights from the Interim Report on the Impact of Success Boston's Coaching for Completion," see ED602749.]
Reviews of Individual Studies 9-12 2
Evaluating a Unit Aimed at Helping Students Understand Matter and Energy for Growth and Activity (2019)
To support implementation of the "Next Generation Science Standards," we designed a high school biology unit, "Matter and Energy for Growth and Activity" (MEGA), that engages students in explaining physical and life science phenomena using evidence, models, and science ideas about matter and energy changes within systems and transfers between systems. The unit's promise was evaluated using a randomized control trial (RCT) involving fifteen teachers from two schools. Teachers were randomly assigned to implement either the MEGA unit or district-developed activities that targeted the same learning goals. Pre- and post-tests were administered, and the data were analyzed using Rasch modeling and hierarchical linear modeling. Here we describe the unit and report on RCT results. Our data showed that, when controlling for pretest score, gender, language, and ethnicity, students in the treatment group performed better on the post-test than the students in the comparison group, indicating the MEGA unit has promise in improving students' understanding. We also discuss a number of challenges that arose when developing and evaluating the unit.
Reviews of Individual Studies 7-8 2
Visual-Syntactic Text Format: Improving Adolescent Literacy (2019)
Seventh- and 8th-grade students in a within-teacher randomized control study read from visual-syntactic formatted text for 44 min per week over the course of 1 year. On the annual state assessment, we found small statistically significant improvements on the overall English Language Arts scaled score (ES = 0.05, p < .05) and the writing assessment (ES = 0.07, p < .01) for the treatment group compared to the control group. We found no interactions between gifted, special education, or English learner classification and treatment status on the effect on overall English Language Arts score, but our categorical and subgroup analyses showed that the use of visual-syntactic text formatting provided a modest benefit to middle school students who were near or at grade level in the prior school year.
Reviews of Individual Studies 4 2
Improving Elementary School Students&apos; Vocabulary Skills and Reading Comprehension through a Word Learning Strategies Program (2019)
This study evaluated the efficacy of the Word Learning Strategies (WLS) supplementary program to improve elementary students' vocabulary skills and reading comprehension. The study used a multi-site cluster randomized, experimental design, which randomly assigned 92 4th grade classrooms (n=2558 students) from two cohorts to a treatment or control group. Results indicated that the program was positively associated with gains in students' vocabulary learning and knowledge as measured by the Word Learning Strategies Test and the VASE Assessment, and in students' reading comprehension as measured by the Gates-MacGrinitie Reading Test, after accounting for differences in baseline measures. The use of the WLS program also led to increases in teachers' awareness of strategies to support their students' vocabulary and reading comprehension. [This paper was published in the Proceedings of the 2019 Annual Meeting of the American Educational Research Association (AERA), Toronto, Canada.]
Reviews of Individual Studies K-8 2
Preparing School Leaders for Success: Evaluation of New Leaders&apos; Aspiring Principals Program, 2012-2017 (2019)
A growing body of research points to the ways in which principals influence teachers, classrooms, and, ultimately, student achievement. New Leaders aims to prepare transformational school leaders by partnering with districts and charter schools to offer rigorous, research-based training for aspiring principals. The Aspiring Principals program is New Leaders' signature program and has three core features: selective recruitment and admission, training and endorsement, and support for principals early in their tenure. This report is a follow-up to the 2014 evaluation of New Leaders' Aspiring Principals program. Focusing on the revised program, which was first implemented in 2012, the authors present evidence of the effectiveness of the revised Aspiring Principals program and share lessons that can inform principal-preparation policy and practice. To assess the effect of New Leaders' Aspiring Principals program, researchers analyzed whether schools and students led by graduates of the program outperformed comparison schools and students in the same district, focusing on student achievement and principal retention. They also examined program graduate placement and satisfaction with the Aspiring Principals program. [For the appendixes, see ED605724.]
Reviews of Individual Studies K-8 2
A State-Wide Quasi-Experimental Effectiveness Study of the Scale-up of School-Wide Positive Behavioral Interventions and Supports (2019)
The three-tiered Positive Behavioral Interventions and Supports (PBIS) framework promotes the development of systems and data analysis to guide the selection and implementation of evidence-based practices across multiple tiers. The current study examined the effects of universal (tier 1) or school-wide PBIS (SW-PBIS) in one state's scale-up of this tier of the framework. Annual propensity score weights were generated to examine the longitudinal effects of SW-PBIS from 2006-07 through 2011-12. School-level archival and administrative data outcomes were examined using panel models with an autoregressive structure. The sample included 1,316 elementary, middle, and high schools. Elementary schools trained in SW-PBIS demonstrated statistically significantly lower suspensions during the fourth and fifth study years (i.e., small effect size) and higher reading and math proficiency rates during the first two study years as well as in one and two later years (i.e., small to large effect sizes), respectively. Secondary schools implementing SW-PBIS had statistically significantly lower suspensions and truancy rates during the second study year and higher reading and math proficiency rates during the second and third study years. These findings demonstrate medium effect sizes for all outcomes except suspensions. Given the widespread use of SW-PBIS across nearly 26,000 schools in the U.S., this study has important implications for educational practices and policies. [This paper was published in the "Journal of School Psychology" v73 p41-55 Apr 2019 (ISSN 0022-4405).]
Reviews of Individual Studies K-Not reported 2
Impact of the UPSTART Program on Forestalling Summer Learning Loss (2019)
The UPSTART Summer program is a federally funded i3 validation project that uses a computer-based program to maintain and develop the literacy skills of elementary school students in rural Utah during the summer months when school is out of session. Researchers used a quasi-experimental design to evaluate the impact of the program in forestalling literacy learning loss during several summer periods. Students in the treatment group participated in the UPSTART Summer program, in the summer periods after kindergarten, first grade, and/or second grade. A second group of children, who were not enrolled in the program served as a comparison. Statistical matching procedures were used to create separate treatment and comparison analytic samples for each outcome measure that were equivalent on baseline scores and demographic variables (e.g., school, gender, race, language learner status, household income, Title 1 school enrollment, etc.). Standardized literacy assessments of letter knowledge, phonics, and reading fluency were administered prior to program commencement at the end of the academic school year and upon program completion at the beginning of the following school year. Results revealed that the UPSTART Summer program had a significant impact in reducing literacy learning loss in rising first graders on assessments of letter naming fluency, nonsense word fluency (correct letter sounds), and a reading composite score when compared to a matched comparison group. There were no differences in learning loss rates between rising first graders and comparison students on assessments measuring phoneme segmentation fluency or nonsense word reading (whole words read). Additionally, the UPSTART Summer program did not have an impact on literacy learning loss prevention in rising second or third grade students as measured by assessments of nonsense word reading, oral reading fluency, or overall reading composites. Taken together these results suggest that the UPSTART program helps to maintain early literacy skills in the summer months between Kindergarten and first grade.
Reviews of Individual Studies 8 2
Equipping and empowering 8th grade mathematics teachers to create dynamic learning activities promoting conceptual understanding (2018, April 14)
Reviews of Individual Studies 6-12 2
Evaluation of the James Madison Legacy Project: Cohort 2 Student Knowledge (2018)
Reviews of Individual Studies 3-5 2
Effects of the first year of a three-year CGI teacher professional development program on grades 3–5 student achievement: A multisite cluster-randomized trial. (Research Report No. 2018-25) (2018)
Reviews of Individual Studies 4-8 2
A year-long state-wide RCT of the Minnesota Math Corps: Final report to Laura and John Arnold Foundation (2018)
Reviews of Individual Studies 2-12 2
Can Restorative Practices Improve School Climate and Curb Suspensions? An Evaluation of the Impact of Restorative Practices in a Mid-Sized Urban School District. Research Report. RR-2840-DOJ (2018)
Across the country, school districts, their stakeholders, and policymakers have become increasingly concerned about suspensions, particularly about suspending students from elementary school and disproportionately suspending ethnic/racial minority students. Suspended students are less likely to graduate, possibly because they miss the instructional time they need to advance academically. Restorative practices have gained buy-in in the education community as a strategy to reduce suspension rates. Proactively improving relationships among students and staff and building a sense of community in classrooms and schools may make students less inclined to misbehave. And addressing severe misbehavior through a restorative approach may help students realize the impacts of their actions and make them less likely to offend again. This study of the implementation of restorative practices in the Pittsburgh Public Schools district (PPS) in school years 2015-16 and 2016-17 represents one of the first randomized controlled trials of the effects of restorative practices on classroom and school climates and suspension rates. The authors examined a specific restorative practices program -- the International Institute for Restorative Practices' SaferSanerSchools™ Whole-School Change program -- implemented in a selected group of PPS schools under a program called Pursuing Equitable and Restorative Communities, or PERC. The researchers found that PERC achieved several positive effects, including an improvement in overall school climates (as rated by teachers), a reduction in overall suspension rates, and a reduction in the disparities in suspension rates between African American and white students and between low- and higher-income students. Key Findings: Effects of the Pursuing Equitable and Restorative Communities (PERC) program in Pittsburgh Public Schools: (1) Implementation of restorative practices through PERC improved overall school climates, as rated by teachers; (2) Implementation of restorative practices reduced the average suspension rate: During the study period, average suspension rates decreased in both PERC and non-PERC schools, but rates decreased more in PERC schools; (3) Suspension rates of African American students and of those from low-income families also went down in PERC schools, shrinking the disparities in suspension rates between African American and white students and between low- and higher-income students; (4) Academic outcomes did not improve in PERC schools, and actually worsened for grades 6-8; and (5) Arrest rates among PERC schools did not decrease. Recommendations: (1) Given the constraints on teachers' time, emphasize restorative practices that can be woven into the school day; (2) Ensure that school leaders understand and can model restorative practices, including by providing mandatory professional development, books and other materials, and coaching on restorative practices; (3) Establish a mechanism for school staff to meet at least once per month as a professional learning community on restorative practices; (4) Ensure that leaders at the district level can coordinate this work; (5) Set, and update, clear expectations regarding the use of restorative practices; and (6) Implement data collection systems to collect accurate information on all types of behavioral incidents and remedies.
Reviews of Individual Studies K-3 2
English Language and Literacy Acquisition-Validation (ELLA-V) i3 Evaluation (Valid 22). Final Report (2018)
The English Language and Literacy Acquisition--Validation (ELLA-V) study was a five-year evaluation of a program that provided professional development, coaching, and curricula that targeted English-as-a-second-language (ESL) instruction for teachers of K-3 English learners (ELs). ELLA-V was implemented in 10 school districts in Texas in the 2013-14 through 2016-17 school years. The project was federally funded by a grant from the U.S. Department of Education's Investing in Innovation (i3) Fund (PR/Award Number U411B120047). Professors at Texas A&M University were the recipients of the grant and developed the professional development, the coaching program, and the curricula. Researchers at the Center for Research and Reform in Education (CRRE) at Johns Hopkins University were contracted to conduct the independent evaluation. The evaluation of ELLA-V was a multi-site cluster randomized trial designed to meet the What Works Clearinghouse (WWC) standards for rigorous education research (WWC, 2017). The study used a mixed method design to estimate program impacts on student and teacher outcomes and document the fidelity of implementation and perceived quality of the program. [This report was published at the Center for Research and Reform in Education (ED594703). Principal Investigators were Rafael Lara-Alecio, Beverly Irby, and Fuhui Tong. Cindy Guerrero and Laura Cajiao-Wingenbach were Lead Coordinators.]
Reviews of Individual Studies K-4 2
HEROES i3 Development Grant: External Evaluation Report. (2018)
Reviews of Individual Studies 9-12 2
Evaluation of the We the People Program: Student Knowledge (2018)
Reviews of Individual Studies 9-12 2
Linked Learning San Bernardino (LLSB): Accelerating College and Career Readiness in Low-Performing Schools: An Investing in Innovation (i3) Development Grant Evaluation. Technical Report. (2018)
Reviews of Individual Studies K-1 2
Annual Evaluation Report for the Pennsylvania Dyslexia Screening and Early Literacy Intervention Pilot Program Pilot Year 2, 2016-17 School Year (2018)
The 3-year Pennsylvania Dyslexia Screening and Early Literacy Intervention Pilot Program (Pilot) began in 2015-16 (Year 1) with the kindergarten class of 2015-16 (Cohort 1). In 2016-17 (Year 2), the Pilot was implemented with Cohort 1 students, now in first grade, and a second cohort of kindergarteners (Cohort 2). A third cohort will be added in 2017-18. The Pilot provides two levels of support: (1) a classroom program, which supplements core instruction for all students, with an increased focus on phonemic awareness and multisensory structured language (MSL), and (2) an MSL intervention to provide extra instruction for students identified as needing more support based on early literacy screening in the winter of kindergarten. Both levels of support are meant to affect special education referrals and students' literacy skills, measured by the Dynamic Indicators of Basic Early Literacy Skills (DIBELS) Next benchmark assessments (only DIBELS data are available at this time). This report presents key findings from Year 2. The effectiveness of the classroom program was evaluated using a school-level matched design, in which the performance of students in the 21 Pilot schools was compared with the performance of students in 21 matched comparison (Comparison) schools identified through Mahalanobis distance matching. These analyses suggest that both Pilot cohorts (21 schools) outperformed the Comparison sample on some spring 2017 (Year 2) measures (nonsense word fluency for both cohorts and letter naming fluency for Cohort 2). This may be because of improved implementation in Year 2, and is particularly encouraging given the Comparison sample's participation in another literacy initiative, which may result in an underestimation of Pilot program effects compared with typical schools (which may not use universal screening to inform core instruction and identify students to receive supplemental intervention). The effectiveness of the MSL intervention was assessed using a regression discontinuity (RD) design, in which Pilot students eligible for the intervention were compared with similarly performing students in the same schools who were not eligible for the intervention. Although these analyses yielded no positive effects, exploratory analyses suggest that the intervention may have contributed to improved performance for Cohort 1 Pilot intervention students compared to similar Comparison students. Exploratory analyses also found an association between intervention hours and outcomes, suggesting increased dosage might yield stronger intervention effects (most schools did not meet target hours). These findings suggest that the combination of enhanced core instruction and supplemental MSL intervention improve some student outcomes in school settings, warranting further study. The Pilot's final evaluation report will cover the third year of Pilot implementation, allowing comparisons across three cohorts and expanding the Pilot to second grade (Cohort 1), and consider other variables such as special education status. This report includes numerous exhibits to explain implementation, samples, and findings, and includes the following appendices: (1) Study Design; (2) Matching to Establish Comparison Sample; (3) Supplementary Implementation Information; (4) Comparisons of Analysis Samples; (5) Sample Parent Notification and Opt-Out Template Provided by PDE to Pilot Districts; (6) Technical Information.
Reviews of Individual Studies K-8 2
A comprehensive model of teacher induction: Implementation and impact on teachers and students. Evaluation of the New Teacher Center’s i3 Validation Grant, Final Report (2017)
Reviews of Individual Studies 12-PS 2
The power of coaching: Interim report on the impact of Success Boston’s transition coaching on college success (2017)
Reviews of Individual Studies 5-8 2
Enhancing Middle School Science Lessons with Playground Activities: A Study of the Impact of Playground Physics (2017)
Playground Physics is a technology-based application and accompanying curriculum designed by New York Hall of Science (NYSCI) to support middle school students' science engagement and learning of force, energy, and motion. The program includes professional development, the Playground Physics app, and a curriculum aligned with New York State Learning Standards, Common Core State Standards, and Next Generation Science Standards. The iOS app allows students to record and review videos through three "lenses": (1) motion; (2) force (Newton's third law); and (3) energy, and the curriculum integrates informal and formal, inquiry-based learning strategies to promote greater student knowledge and understanding of physics. The program was designed to be implemented in a formal school setting during the regular school day. This report describes the results of an experimental study of the Playground Physics program's impact on learning of physics concepts, student engagement, and science-related attitudes. Sixty New York City middle grade teachers were randomly assigned to treatment or control conditions. Treatment teachers were asked to participate in Playground Physics professional development and use Playground Physics as part of their physics instruction during the 2015-16 academic year; control teachers were asked to use their regular instruction. In total, 15 teachers left the study. The final sample included student data from 24 treatment teachers and 21 control teachers. The following are appended: (1) Playground Physics Curriculum Activities; (2) Student Outcome Measures; (3) Teacher Survey; (4) Impact Analysis Technical Approach; (5) Output from Statistical Models; (6) Knowledge Assessment Responses and Standards Alignment; (7) 2014-15 Fidelity of Implementation Analysis; and (8) Supplemental Analysis.
Reviews of Individual Studies 4-11 2
The Effects of Statewide Private School Choice on College Enrollment and Graduation: Evidence from the Florida Tax Credit Scholarship Program. Education Policy Program. Research Report (2017)
Although several studies have documented the effects of statewide private school choice programs on student test scores, this report is the first to examine the effects of one of these programs on college enrollment and graduation. Using data from the Florida Tax Credit (FTC) Scholarship program, we find that low-income Florida students who attended private schools using an FTC scholarship enrolled in and graduated from Florida colleges at a higher rate than their public school counterparts. [Additional support for this study was provided by the Bill and Susan Oberndorf Foundation and Kate and Bill Duhamel.]
Reviews of Individual Studies 6-8 2
The Urban Advantage: The impact of informal science collaborations on student achievement (2017)
Reviews of Individual Studies 6-12 2
Leveraging technology to engage parents at scale: Evidence from a randomized controlled trial. (2017)
Reviews of Individual Studies 7 2
Web-Based Text Structure Strategy Instruction Improves Seventh Graders&apos; Content Area Reading Comprehension (2017)
Reading comprehension in the content areas is a challenge for many middle grade students. Text structure-based instruction has yielded positive outcomes in reading comprehension at all grade levels in small and large studies. The text structure strategy delivered via the web, called Intelligent Tutoring System for the Text Structure Strategy (ITSS), has proven successful in large-scale studies at 4th and 5th grades and a smaller study at 7th grade. Text structure-based instruction focuses on selection and encoding of strategic memory. This strategic memory proves to be an effective springboard for many comprehension-based activities such as summarizing, inferring, elaborating, and applying. This was the first large-scale randomized controlled efficacy study on the web-based delivery of the text structure strategy to 7th-grade students. 108 classrooms from rural and suburban schools were randomly assigned to ITSS or control and pretests and posttests were administered at the beginning and end of the school year. Multilevel data analyses were conducted on standardized and researcher designed measures of reading comprehension. Results showed that ITSS classrooms outperformed the control classrooms on all measures with the highest effects reported for number of ideas included in the main idea. Results have practical implications for classroom practices.
Reviews of Individual Studies 8 2
Improving Content Knowledge and Comprehension for English Language Learners: Findings from a Randomized Control Trial (2017)
Supporting the reading comprehension and content knowledge acquisition of English language learners (ELs) requires instructional practices that continue beyond developing the foundational skills of reading. In particular, the challenges ELs face highlight the importance of teaching reading comprehension practices in the middle grades through content acquisition. We conducted a randomized control trial to examine the efficacy of a content acquisition and reading comprehension intervention implemented in eighth-grade social studies classrooms with English language learners. Using a within-teacher design, in which 18 eighth-grade teachers' social studies classes were randomly assigned to treatment or comparison conditions. Teachers taught the same instructional content to treatment and comparison classes, but the treatment classes used instructional practices that included comprehension canopy, essential words, knowledge acquisition, and team-based learning. Students in the treatment group (n = 845) outperformed students in the comparison group (n = 784) on measures of content knowledge acquisition and content reading comprehension but not general reading comprehension. Both ELs and non-ELs who received the treatment outperformed those assigned to the BAU comparison condition on measures of content knowledge acquisition (ES = 0.40) and content-related reading comprehension (ES = 0.20). In addition, the proportion of English language learners in classes moderated outcomes for content knowledge acquisition.
Reviews of Individual Studies 9 2
The Causal Effects of Cultural Relevance: Evidence from an Ethnic Studies Curriculum. CEPA Working Paper No. 16-01 (2016)
An extensive theoretical and qualitative literature stresses the promise of instructional practices and content aligned with the cultural experiences of minority students. Ethnic studies courses provide a growing but controversial example of such "culturally relevant pedagogy." However, the empirical evidence on the effectiveness of these courses is limited. In this study, we estimate the causal effects of an ethnic studies curriculum piloted in several San Francisco high schools. We rely on a "fuzzy" regression discontinuity design based on the fact that several schools assigned students with eighth-grade GPAs below a threshold to take the course in ninth grade. Our results indicate that assignment to this course increased ninth-grade student attendance by 21 percentage points, GPA by 1.4 grade points, and credits earned by 23. These surprisingly large effects are consistent with the hypothesis that the course reduced dropout rates and suggest that culturally relevant teaching, when implemented in a supportive, high-fidelity context, can provide effective support to at-risk students.
Reviews of Individual Studies 7-8 2
Impact Results of the eMINTS Professional Development Validation Study: Professional Development Validation Study (2016)
This article presents the findings of an evaluation of the eMINTS (enhancing Missouri's Instructional Networked Teaching Strategies) professional development program. eMINTS is an intensive teacher professional development program designed to promote inquiry-based learning, support high-quality lesson design, build community among students and teachers, and create technology-rich learning environments. This evaluation included 60 high-poverty rural schools across Missouri that were randomly assigned to two treatment conditions and a control condition, with approximately 200 teachers and 3,000 students in the 2011-2012 baseline academic year. The researchers conclude that after 3 years, the eMINTS treatment group and an eMINTS treatment group with an additional year of Intel support resulted in changed teacher instructional behaviors and increased student achievement in mathematics.
Reviews of Individual Studies 3-8 2
National Board Certification and Teacher Effectiveness: Evidence from Washington State (2016)
We study the effectiveness of teachers certified by the National Board for Professional Teaching Standards (NBPTS) in Washington State, which has one of the largest populations of National Board-Certified Teachers (NBCTs) in the nation. Based on value-added models in math and reading, we find that NBPTS-certified teachers are about 0.01-0.05 student standard deviations more effective than non-NBCTS with similar levels of experience. Certification effects vary by subject, grade level, and certification type, with greater effects for middle school math certificates. We find mixed evidence that teachers who pass the assessment are more effective than those who fail, but that the underlying NBPTS assessment score predicts student achievement.
Reviews of Individual Studies 3-8 2
Can Universal SEL Programs Benefit Universally? Effects of the Positive Action Program on Multiple Trajectories of Social-Emotional and Misconduct Behaviors (2016)
Behavioral trajectories during middle childhood are predictive of consequential outcomes later in life (e.g., substance abuse, violence). Social and emotional learning (SEL) programs are designed to promote trajectories that reflect both growth in positive behaviors and inhibited development of negative behaviors. The current study used growth mixture models to examine effects of the "Positive Action" program (PA) on behavioral trajectories of social-emotional and character development (SECD) and misconduct using data from a cluster-randomized trial that involved 14 schools and a sample of predominately low-income, urban youth followed from 3rd through 8th grade. For SECD, findings indicated that PA was similarly effective at improving trajectories within latent classes characterized as "High/declining" and "Low/stable". Favorable program effects were likewise evident to a comparable degree for misconduct across observed latent classes that reflected "Low/rising" and "High/rising" trajectories. These findings suggest that PA and perhaps other school-based universal SEL programs have the potential to yield comparable benefits across subgroups of youth with differing trajectories of positive and negative behaviors, making them promising strategies for achieving the intended goal of school-wide improvements in student outcomes. [This paper was published in "Prevention Science" v18 p214-224 2017.]
Reviews of Individual Studies 1 2
Reading Recovery: Exploring the Effects on First-Graders' Reading Motivation and Achievement (2016)
This study examined the effects of Reading Recovery on children's motivational levels, and how motivation may contribute to the effect of the intervention on literacy achievement. Prior studies concluded that Reading Recovery was positively associated with increased student motivation levels, but most of those studies were limited methodologically. The achievement and motivation levels before and after the intervention of Reading Recovery students and similarly low-performing first-grade students were compared using structural equation modeling. It was found that Reading Recovery had a 0.31 treatment effect on achievement after controlling for baseline achievement and motivational differences among the treatment and comparison students. Reading Recovery also was associated with greater average levels of posttest motivation, and motivation was found to mediate the treatment-achievement relationship. This study highlights how important it is for early reading interventions to consider the role motivation plays in literacy acquisition.
Reviews of Individual Studies 2-5 2
The Impact of Achieve3000 on Elementary Literacy Outcomes: Randomized Control Trial Evidence, 2013-14 to 2014-15. Eye on Evaluation. DRA Report No. 16.02 (2016)
In 2013-14, the Wake County Public School System (WCPSS) launched Achieve3000 as a randomized controlled trial in 16 elementary schools. Achieve3000 is an early literacy program that differentiates non-fiction reading passages based on individual students' Lexile scores. Twoyear results show that Achieve3000 did not have a significant impact on student outcomes. However, both intent-to-treat and treatment-on-treated estimates show that in 2015, the second year of implementation, students in the treatment group outperformed their control-group counterparts by 0.13 standard deviation units (SD) on the year-end Achieve3000 LevelSet Lexile test. This effect size is consistent with mean empirical effect sizes reported by Lipsey et al. (2012). Yet in neither the pooled nor annual results did Achieve3000 significantly impact student performance on additional Lexile outcomes (EOG or DIBELS ORF). Both implementation and impact results for Achieve3000 suggest that the ability of this particular technology-based literacy solution to improve student performance beyond that of a control group fell short of vendor-defined and empirical expectations.
Reviews of Individual Studies K-4 2
NURTURES evaluation report: 5 year summary, 2011-2016 (2016)
Reviews of Individual Studies 9-PS 2
Charter High Schools&apos; Effects on Long-Term Attainment and Earnings (2016)
Since their inception in 1992, the number of charter schools has grown to more than 6,800 nationally, serving nearly three million students. Various studies have examined charter schools' impacts on test scores, and a few have begun to examine longer-term outcomes including graduation and college attendance. This paper is the first to estimate charter schools' effects on earnings in adulthood, alongside effects on educational attainment. Using data from Florida, we first confirm previous research (Booker et al., 2011) that students attending charter high schools are more likely to graduate from high school and enroll in college. We then examine two longer-term outcomes not previously studied in research on charter schools--college persistence and earnings. We find that students attending charter high schools are more likely to persist in college, and that in their mid-20s they experience higher earnings.
Reviews of Individual Studies 9-12 2
Understanding the Effect of KIPP as It Scales: Volume I, Impacts on Achievement and Other Outcomes. Final Report of KIPP&apos;s &quot;Investing in Innovation Grant Evaluation&quot; (2015)
KIPP (Knowledge is Power Program) is a national network of public charter schools whose stated mission is to help underserved students enroll in and graduate from college. Prior studies (see Tuttle et al. 2013) have consistently found that attending a KIPP middle school positively affects student achievement, but few have addressed longer-term outcomes and no rigorous research exists on impacts of KIPP schools at levels other than middle school. In this first high-quality study to rigorously examine the impacts of the network of KIPP public charter schools at all elementary and secondary grade levels, Mathematica found that KIPP schools have positive impacts on student achievement, particularly at the elementary and middle school levels. In addition, the study found positive impacts on student achievement for new entrants to the KIPP network in high school. For students continuing from a KIPP middle school, KIPP high schools' impacts on student achievement are not statistically significant, on average (in comparison to students who did not have the option to attend a KIPP high school and instead attended a mix of other non-KIPP charter, private, and traditional public high schools). Among these continuing students, KIPP high schools have positive impacts on several aspects of college preparation, including more discussions about college, increased likelihood of applying to college, and more advanced coursetaking. This report provides detailed findings and also includes the following appendices: (1) List of KIPP Schools In Network; (2) Detail on Survey Outcomes; (3) Cumulative Middle and High School Results; (4) Detailed Analytic Methods: Elementary School (Lottery-Based Analyses); (5) Detailed Analytic Methods: Middle School (Lottery-Based Analyses); (6) Understanding the Effects of KIPP As It Scales Mathematica Policy Research; (7) Detailed Analytic Methods: Middle School (Matched-Student Analyses); (8) Detailed Analytic Methods: High School (Matched-Student Analyses); (9) Detailed Analytic Methods: High School (Matched-School Analyses); and (10) Detailed Tables For What Works Clearinghouse Review. [For the executive summary, see ED560080; for the focus brief, see ED560043.]
Reviews of Individual Studies 9-12 2
Measuring the causal effect of National Math + Science Initiative’s College Readiness Program (CRESST Report No. 847). (2015)
Reviews of Individual Studies 1 2
Intervention for First Graders with Limited Number Knowledge: Large-Scale Replication of a Randomized Controlled Trial (2015)
Replication studies are extremely rare in education. This randomized controlled trial (RCT) is a scale-up replication of Fuchs et al., which in a sample of 139 found a statistically significant positive impact for Number Rockets, a small-group intervention for at-risk first graders that focused on building understanding of number operations. The study was relatively small scale (one site) and highly controlled. This replication was implemented at a much larger scale--in 76 schools in four urban districts; 994 at-risk students participated. Intervention students participated in approximately 30 hours of small-group work in addition to classroom instruction; control students received typical instruction and whatever assistance the teacher would normally provide. Intervention students showed significantly superior performance on a broad measure of mathematics proficiency.
Reviews of Individual Studies 4-8 2
The District-Wide Effectiveness of the Achieve3000 Program: A Quasi-Experimental Study (2015)
The purpose of this study was to evaluate the impact of Achieve3000, a differentiated online literacy curriculum, on students' scores on the California State Test (CST). In the 2011-12 school year, 1,957 students in Chula Vista began using Achieve3000's solutions in 3rd through 8th grade. Using a form of propensity score matching called Inverse Probability-of-Treatment Weighting (IPTW), the researchers assigned weights for the likelihood that students in the non-user comparison group (N = 7,598) could have been in the Achieve3000 treatment group. A Weighted Least Squares (WLS) regression model with IPTW weights estimated the average treatment effect. The researchers found that, overall, the students assigned to Achieve3000 performed statistically significantly higher on the CST, by 2.4 points, than students who were not using these solutions. This suggests the program is effective in improving student learning over conventional classroom activities in the first year of use, however more data is needed to determine the long term impact of usage. Five appendices contain supplemental tables and figures.
Reviews of Individual Studies 7-10 2
Impact of the National Writing Project’s College-Ready Writers Program on teachers and students. (2015)
Reviews of Individual Studies 7 2
Effects of a Research-Based Intervention to Improve Seventh-Grade Students&apos; Proportional Problem Solving: A Cluster Randomized Trial (2015)
This experimental study evaluated the effectiveness of a research-based intervention, schema-based instruction (SBI), on students' proportional problem solving. SBI emphasizes the underlying mathematical structure of problems, uses schematic diagrams to represent information in the problem text, provides explicit problem solving and metacognitive strategy instruction, and focuses on the flexible use of multiple solution strategies. Eighty-two teachers/classrooms with a total of 1,999 seventh-grade students across 50 school districts were randomly assigned to a treatment (SBI) or control (business-as-usual) condition. An observational measure provided evidence that the SBI intervention was implemented with fidelity. Results of multilevel modeling indicated that the SBI group scored on average significantly higher than the control group on the posttest and retention test (9 weeks later) and also showed significantly more growth in proportional problem solving. There were no treatment effects on the Process and Applications subtest of the Group Mathematics Assessment and Diagnostic Evaluation. These results demonstrate that SBI can be more effective than the control approach in improving students' proportional problem solving. [This paper was published in the "Journal of Educational Psychology," (EJ1082754).]
Reviews of Individual Studies 6-8 2
Understanding the Effect of KIPP as It Scales: Volume I, Impacts on Achievement and Other Outcomes. Final Report of KIPP&apos;s &quot;Investing in Innovation Grant Evaluation&quot; (2015)
KIPP (Knowledge is Power Program) is a national network of public charter schools whose stated mission is to help underserved students enroll in and graduate from college. Prior studies (see Tuttle et al. 2013) have consistently found that attending a KIPP middle school positively affects student achievement, but few have addressed longer-term outcomes and no rigorous research exists on impacts of KIPP schools at levels other than middle school. In this first high-quality study to rigorously examine the impacts of the network of KIPP public charter schools at all elementary and secondary grade levels, Mathematica found that KIPP schools have positive impacts on student achievement, particularly at the elementary and middle school levels. In addition, the study found positive impacts on student achievement for new entrants to the KIPP network in high school. For students continuing from a KIPP middle school, KIPP high schools' impacts on student achievement are not statistically significant, on average (in comparison to students who did not have the option to attend a KIPP high school and instead attended a mix of other non-KIPP charter, private, and traditional public high schools). Among these continuing students, KIPP high schools have positive impacts on several aspects of college preparation, including more discussions about college, increased likelihood of applying to college, and more advanced coursetaking. This report provides detailed findings and also includes the following appendices: (1) List of KIPP Schools In Network; (2) Detail on Survey Outcomes; (3) Cumulative Middle and High School Results; (4) Detailed Analytic Methods: Elementary School (Lottery-Based Analyses); (5) Detailed Analytic Methods: Middle School (Lottery-Based Analyses); (6) Understanding the Effects of KIPP As It Scales Mathematica Policy Research; (7) Detailed Analytic Methods: Middle School (Matched-Student Analyses); (8) Detailed Analytic Methods: High School (Matched-Student Analyses); (9) Detailed Analytic Methods: High School (Matched-School Analyses); and (10) Detailed Tables For What Works Clearinghouse Review. [For the executive summary, see ED560080; for the focus brief, see ED560043.]
Reviews of Individual Studies 6-12 2
Enhancing Secondary School Instruction and Student Achievement: Replication and Extension of the My Teaching Partner-Secondary Intervention (2015)
My Teaching Partner-Secondary (MTP-S) is a web-mediated coaching intervention, which an initial randomized trial, primarily in middle schools, found to improve teacher-student interactions and student achievement. Given the dearth of validated teacher development interventions showing consistent effects, we sought to both replicate and extend these findings with a modified version of the program in a predominantly high school population, and in a more urban, sociodemographically diverse school district. MTP-S produced substantial gains in student achievement across 86 secondary school classrooms involving 1,194 students. Gains were robust across subject areas and equivalent to moving the average student from the 50th to the 59th percentile in achievement scores. Results suggest that MTP-S can enhance student outcomes across diverse settings and implementation modalities.
Reviews of Individual Studies 9-10 2
Taking stock of the California Linked Learning District Initiative. Sixth-year evaluation report. (2015)
Reviews of Individual Studies 8 2
The implementation and effects of the Literacy Design Collaborative (LDC): Early findings in eighth-grade history/social studies and science courses (CRESST Report 848) (2015)
Reviews of Individual Studies 8 2
The Implementation and Effects of the Literacy Design Collaborative (LDC): Early Findings in Sixth-Grade Advanced Reading Courses. CRESST Report 846 (2015)
The Bill and Melinda Gates Foundation invested in the Literacy Design Collaborative (LDC) as one strategy to support teachers' and students' transition to the Common Core State Standards (CCSS) in English language arts. This report provides an early look at the implementation of LDC in sixth-grade Advanced Reading classes in a large Florida district, and the effectiveness of the intervention in this setting. The study found that teachers understood LDC and implemented it with fidelity and that curriculum modules were well crafted. Teachers also generally reported positive attitudes about the effectiveness of LDC and its usefulness as a tool for teaching CCSS skills. Although implementation results were highly positive, quasi-experimental analyses employing matched control group and regression discontinuity designs found no evidence of an impact of LDC on student performance on state reading or district writing assessments. Furthermore, students generally performed at basic levels on assessments designed to align with the intervention, suggesting the challenge of meeting CCSS expectations. Exploratory analyses suggest that LDC may have been most effective for higher achieving students. However understandable, the findings thus suggest that, in the absence of additional scaffolding and supports for low-achieving students, LDC may be gap enhancing. Two appendices are included: (1) LDC Instruments and Rubrics; and (2) Summary Report: Developing an Assignment Measure to Assess Quality of LDC Modules (Abby Reisman, Joan Herman, Rebecca Luskin, and Scott Epstein).
Reviews of Individual Studies 8 2
Supporting middle school content teachers transition to the Common Core: The implementation and effects of LDC. (2014)
Reviews of Individual Studies 3-12 2
The Effects of Teacher Entry Portals on Student Achievement (2014)
The current teacher workforce is younger, less experienced, more likely to turnover, and more diverse in preparation experiences than the workforce of two decades ago. Research shows that inexperienced teachers are less effective, but we know little about the effectiveness of teachers with different types of preparation. In this study, we classify North Carolina public school teachers into "portals"--fixed and mutually exclusive categories that capture teachers' formal preparation and qualifications upon first entering the profession--and estimate the adjusted average test score gains of students taught by teachers from each portal. Compared with undergraduate-prepared teachers from in-state public universities, (a) out-of-state undergraduate-prepared teachers are less effective in elementary grades and high school, (b) alternative entry teachers are less effective in high school, and (c) Teach For America corps members are more effective in STEM subjects and secondary grades.
Reviews of Individual Studies 2-5 2
Alignment of game design features and state mathematics standards: Do results reflect intentions? (2014)
Reviews of Individual Studies 1 2
Success for All in England: Results from the third year of a national evaluation. (2014)
Reviews of Individual Studies 11 2
The Effects of Team-Based Learning on Social Studies Knowledge Acquisition in High School (2014)
This randomized control trial examined the efficacy of team-based learning implemented within 11th-grade social studies classes. A randomized blocked design was implemented with 26 classes randomly assigned to treatment or comparison. In the treatment classes teachers implemented team-based learning practices to support students in engaging in dialogue about course content, application of content to solve problems, and use of evidence to support responses. Significant differences in favor of the treatment group on content acquisition were noted (Hedges's g = 0.19). Examination of differences in response to the treatment indicated groups of students classified with high or moderate pretest scores benefitted from the treatment, whereas a group of students classified with low pretest scores did not benefit from the treatment.
Reviews of Individual Studies 9-12 2
Exploring Variation in the Impact of Dual-Credit Coursework on Postsecondary Outcomes: A Quasi-Experimental Analysis of Texas Students (2014)
Despite the growing popularity of dual-credit courses as a college readiness strategy, numerous reviews of the literature have noted a number of important limitations of the research on the effects of dual-credit on student postsecondary outcomes. This study addressed these gaps in the literature by estimating the impact of dual-credit courses on postsecondary access, first-to-second year persistence, and eventual college attainment, and overcame many of the methodological limitations of previous studies. The study utilized a statewide longitudinal data system (SLDS), allowing us to track an entire cohort of students through their transition into postsecondary statewide. Propensity score matching was used in order to reduce the self-selection bias associated with high achieving students being more likely to take dual-credit courses. We explored how the number of dual-credit courses students complete and the subject of the courses influences their impact. We also compared the effects of dual-credit to alternative advanced courses. Our results suggest that dual-credit is a promising strategy for increasing the likelihood of students accessing, persisting through, and completing a degree in postsecondary, and is possibly even more impactful than advanced coursework. However, significant variation in the benefit of dual-credit exists.
Reviews of Individual Studies K-12 2
Early progress: Interim research on personalized learning. (2014)
Reviews of Individual Studies K-12 2
Preparing Principals to Raise Student Achievement: Implementation and Effects of the New Leaders Program in Ten Districts. Research Report (2014)
New Leaders is a nonprofit organization with a mission to ensure high academic achievement for all students by developing outstanding school leaders to serve in urban schools. Its premise is that a combination of preparation and improved working conditions for principals, especially greater autonomy, would lead to improved student outcomes. Its approach involves both preparing principals and partnering with school districts and charter management organizations (CMOs) to improve the conditions in which its highly trained principals work. As part of the partnerships, New Leaders agrees to provide carefully selected and trained principals who can be placed in schools that need principals and to provide coaching and other support after those principals are placed. The districts and CMOs agree to establish working conditions that support, rather than hinder, the principals' efforts to improve student outcomes. This report describes how the New Leaders program was implemented in partner districts, and it provides evidence of the effect that New Leaders has on student achievement. [The research in this report was produced within RAND Education. For the appendices that accompany this report, see ED561154. For the research brief, "Principal Preparation Matters: How Leadership Development Affects Student Achievement. Research Brief," see ED561155.]
Reviews of Individual Studies 1 2
National charter school study 2013. (2013)
Reviews of Individual Studies 1-2 2
After Two Years, Three Elementary Math Curricula Outperform a Fourth. NCEE Evaluation Brief. NCEE 2013-4019 (2013)
This brief aims to help educators understand the implications of math curriculum choice in the early elementary grades by presenting new findings from a study that examined how four math curricula affect students' achievement across two years--from 1st through 2nd grades. The four curricula were (1) Investigations in Number, Data, and Space (Investigations); (2) Math Expressions; (3) Saxon Math (Saxon); and (4) Scott Foresman-Addison Wesley Mathematics (SFAW), which the developer revised and renamed enVision Math (enVision) during the study. These curricula are widely used and differ in their approaches to teaching and learning. Within districts, we randomly assigned one of the four curricula to each school that participated in the study. After one year (by the end of 1st grade), students taught with Math Expressions and Saxon made greater gains in achievement than students taught with Investigations and SFAW. After two years (by the end of 2nd grade), Investigations students continued to lag behind Math Expressions and Saxon students, while SFAW/enVision students caught up to Math Expressions and Saxon students. Therefore, Math Expressions, Saxon, and SFAW/enVision improved 1st-through-2nd-grade math achievement by similar amounts, and all three outperformed Investigations. Our findings also suggest that switching between some of the study's curricula does not harm student achievement and can even be beneficial. (Contains 24 endnotes, 3 figures, and 2 tables.) [For "After Two Years, Three Elementary Math Curricula Outperform a Fourth. NCEE Technical Appendix. NCEE 2013-4019", see ED544187.]
Reviews of Individual Studies 1 2
Evaluating Math Recovery: Assessing the Causal Impact of a Diagnostic Tutoring Program on Student Achievement (2013)
Mathematics Recovery (MR) is designed to identify first graders who are struggling in mathematics and provide them with intensive one-to-one tutoring. We report findings from a 2-year evaluation of MR conducted in 20 elementary schools across five districts in two states. The design allowed for the estimation of the counterfactual growth trajectory based on those students randomly assigned either to a tutoring cohort with a delayed start or to a wait list. Results demonstrate strong end of first grade effects on a diagnostic measure developed by MR and weak to moderate effects (effect size, 0.15-0.30) on measures administered by external evaluators. By the end of second grade, no significant effects were found on any measures. Practical and research implications are discussed. (Contains 7 tables, 3 figures, and 5 notes.)
Reviews of Individual Studies 5 2
Evaluation of the 2010-2011 Reasoning Mind program in Beaumont ISD. (2013)
Reviews of Individual Studies 6-8 2
Impacts of Five Expeditionary Learning Middle Schools on Academic Achievement (2013)
Expeditionary Learning (EL) is a growing provider of curriculum and professional development services to teachers and school leaders. The EL model combines an interdisciplinary instructional approach with ongoing training and coaching for teachers and school leaders. The EL curriculum uses an experiential approach in which students conduct research projects to share with outside audiences. Learning expeditions--case-studies of academic topics--often bring together teachers from different subjects to coordinate shared projects; this curriculum includes several elements that are closely aligned with the Common Core standards for English-language arts and literacy. As of the 2010-2011 school year, EL's network included a total of 161 schools in 30 states. This report presents findings from the first rigorous study of the impacts of EL schools. This research aims to use the best available quasi-experimental methods to estimate the impacts of five urban EL middle schools on students' reading and math test scores. Using the study's data on student characteristics, the report also provides additional descriptive information on the types of students who enroll in EL schools. [The report was submitted to Expeditionary Learning.]
Reviews of Individual Studies 9-12 2
Evaluation of Green Dot&apos;s Locke Transformation Project: Findings for Cohort 1 and 2 Students. CRESST Report 815 (2012)
With funding from the Bill and Melinda Gates Foundation, CRESST conducted a multi-year evaluation of a major school reform project at Alain Leroy Locke High School, historically one of California's lowest performing secondary schools. Beginning in 2007, Locke High School transitioned into a set of smaller, Green Dot Charter High Schools, subsequently referred to as Green Dot Locke (GDL) in this report. Based on 9th grade students who entered GDL in 2007 and 2008 respectively, CRESST used a range of student outcomes to monitor progress of the GDL transformation. The CRESST evaluation, employing a strong quasi-experimental design with propensity score matching, found statistically significant, positive effects for the GDL transformation including improved achievement, school persistence, and completion of college preparatory courses. Appended are: (1) Demographic Characteristics and Achievement of the Freshmen at GDL and LAUSD; (2) Cohort Specific Descriptives; and (3) General Descriptives. (Contains 17 figures, 43 tables and 6 footnotes.)
Reviews of Individual Studies 9 2
Springfield-Chicopee School Districts Striving Readers (SR) Program. Final Report Years 1-5: Evaluation of Implementation and Impact (2012)
This evaluation report presents implementation and impact findings to date regarding the Striving Readers grant as implemented by the Springfield and Chicopee Public School Districts. Any questions regarding this final report should be directed to the Office of Elementary and Secondary Education (OESE) at the U.S. Department of Education. There were 25,213 students enrolled in Springfield and 7,845 in Chicopee in the 2010-11 school year. The districts differed in terms of student demographics as well as in size. In Springfield, 88% to 92% of the students were designated as minority in the participating schools as compared to 25% to 35% in Chicopee. Over three-quarters of the students in Springfield were also eligible for free or reduced lunch (80% to 84%) as compared to approximately one half in Chicopee (44% to 51%). [This report was prepared by the Research & Evaluation Division at the Education Alliance at Brown University.]
Reviews of Individual Studies 9 2
Springfield-Chicopee School Districts Striving Readers (SR) Program. Final Report Years 1-5: Evaluation of Implementation and Impact (2012)
This evaluation report presents implementation and impact findings to date regarding the Striving Readers grant as implemented by the Springfield and Chicopee Public School Districts. Any questions regarding this final report should be directed to the Office of Elementary and Secondary Education (OESE) at the U.S. Department of Education. There were 25,213 students enrolled in Springfield and 7,845 in Chicopee in the 2010-11 school year. The districts differed in terms of student demographics as well as in size. In Springfield, 88% to 92% of the students were designated as minority in the participating schools as compared to 25% to 35% in Chicopee. Over three-quarters of the students in Springfield were also eligible for free or reduced lunch (80% to 84%) as compared to approximately one half in Chicopee (44% to 51%). [This report was prepared by the Research & Evaluation Division at the Education Alliance at Brown University.]
Reviews of Individual Studies 4-8 2
Evaluation of Teach For America in Texas schools. (2012)
Reviews of Individual Studies 4-8 2
An Evaluation of the Chicago Teacher Advancement Program (Chicago TAP) after Four Years. Final Report (2012)
In 2007, using funds from the federal Teacher Incentive Fund (TIF) and private foundations, the Chicago Public Schools (CPS) began piloting its version of a schoolwide reform model called the Teacher Advancement Program (TAP). Under the TAP model, teachers can earn extra pay and take on increased responsibilities through promotion (to mentor teacher or master teacher), and they become eligible for annual performance bonuses based on a combination of their contribution to student achievement (known as "value added") and observed performance in the classroom. The model calls for weekly meetings of teachers and mentors ("cluster groups"), and regular classroom observations by a school leadership team to help teachers meet their performance goals. The idea behind TAP is that giving teachers performance incentives, along with tools to track their performance and improve instruction, will help schools attract and retain talented teachers and help all teachers raise student achievement. This report is the last in a series of reports providing evidence on the impacts of CPS' version of TAP, called "Chicago TAP." It presents findings from the four-year implementation period, with special emphasis on the 2009-2010 and 2010-2011 school years, the third and fourth years of the program's rollout in Chicago. Earlier reports (Glazerman et al. 2009; Glazerman and Seifullah 2010) provide detailed data on each of the first two years of the program, respectively. CPS implemented Chicago TAP as a pilot program intended for 40 high-need schools. The program began in 10 schools in the first year (cohort 1) with a rollout plan to add 10 more Chicago TAP schools (cohorts 2, 3, and 4) in each year of the TIF grant's four-year implementation period. The authors address three research questions regarding Chicago TAP: (1) How was the program implemented?; (2) What impact did the program have on student achievement?; and (3) What impact did the program have on teacher retention within schools? To assess the first year under Chicago TAP for schools that began the program in fall 2009 (cohort 3), the authors looked at how teacher development and compensation practices in Chicago TAP schools differ from practices normally implemented in CPS schools. The authors found that teachers in Chicago TAP schools reported receiving significantly more mentoring support than teachers in similar non-TAP (control) schools. This finding reflects the fact that under the Chicago TAP model, teachers are guided by mentor teachers, and cluster groups meet weekly. They also found that veteran teachers in Chicago TAP schools were more likely than their control group counterparts to provide mentoring support to their colleagues; this finding is consistent with the fact that under Chicago TAP, teachers have the opportunity to assume leadership roles and responsibilities as Chicago TAP mentor or lead teachers. Teachers in Chicago TAP schools (veteran and novice) were aware of their eligibility for performance-based compensation. The authors found that the amount of compensation they expected approached the amount that was eventually paid out; that is, the average expectation was about $900, and the actual amount paid out in bonuses to this group was an average of about $1,100 per teacher. They generally did not find evidence of an impact of Chicago TAP on teacher attitudes or school climate. While the introduction of Chicago TAP led to real changes inside the schools, the program did not consistently raise student achievement as measured by growth in Illinois Standards Achievement Test (ISAT) scores. The authors found evidence of both positive and negative test score impacts in selected subjects, years, and cohorts of schools, but overall there was no detectable impact on math, reading, or science achievement that was robust to different methods of estimation. For example, impacts on science scores overall (across years and cohorts) were positive, but not statistically significant unless they used one particular matching method that excluded some Chicago TAP schools from the analysis. The authors did find evidence suggesting that Chicago TAP increased schools' retention of teachers, although the impacts were not uniform or universal across years, cohorts, and subgroups of teachers. They found that teachers who were working in Chicago TAP schools in 2007 returned in each of the following three years at higher rates than teachers in comparable non-TAP schools. For example, the authors found that 67 percent of classroom teachers in cohort 1 schools in fall 2007 returned to their same school in fall 2010 compared to about 56 percent of teachers in non-TAP schools, an impact of nearly 12 percentage points. In other words, teachers in Chicago TAP schools in fall 2007 were about 20% more likely than teachers in comparison schools to be in those same schools three years later. When the authors looked at teachers who were working in schools that started Chicago TAP in later years, some of the impact estimates were not statistically significant. The authors also found some evidence of impacts on retention for subgroups of teachers, such as those with less experience, but the pattern of findings was not consistent. When they considered retention of teachers in the district, the authors did not find consistent evidence of a measurable impact. Given that Chicago TAP is a school-specific program, their main focus was on school-level retention, as opposed to retention in the district. Appended are: (1) Propensity Score Matching; and (2) Supplemental Tables. (Contains 32 tables, 6 figures and 27 footnotes.) [For related reports, see "An Evaluation of the Teacher Advancement Program (TAP) in Chicago: Year One Impact Report. Final Report" (ED507502) and "An Evaluation of the Teacher Advancement Program (TAP) in Chicago: Year Two Impact Report" (ED510712).]
Reviews of Individual Studies 3-10 2
MPCP Longitudinal Educational Growth Study: Fifth Year Report. SCDP Milwaukee Evaluation Report #29 (2012)
This is the final report in a five-year evaluation of the Milwaukee Parental Choice Program (MPCP). This report features analyses of student achievement growth four years after the authors carefully assembled longitudinal study panels of MPCP and Milwaukee Public Schools (MPS) students in 2006-07. The MPCP, which began in 1990, provides government-funded vouchers for low-income children to attend private schools in the City of Milwaukee. The maximum voucher amount in 2010-11 was $6,442, and 20,996 children used a voucher to attend either secular or religious private schools. The MPCP is the oldest and largest urban school voucher program in the United States. This evaluation was authorized by 2005 Wisconsin Act 125, which was enacted in 2006. The primary purpose of the evaluation is twofold: 1) to analyze the effectiveness of the MPCP in promoting growth in student achievement as compared to MPS; and 2) to examine the educational attainment--measured by high school graduation and college enrollment rates--of MPCP and MPS students. The first purpose is accomplished by gauging growth in student achievement--as measured by the Wisconsin Knowledge and Concepts Examinations (WKCE) in math and reading in grades 3 through 8 and grade 10--over a five-year period for a sample of MPCP students and a carefully matched group of MPS students. The second purpose is accomplished by following the 2006-07 8th and 9th grade MPCP and matched MPS cohorts over a five-year period during which they would have had the opportunity to graduate from high school and enroll in college. Appended are: (1) Descriptive Statistics; (2) Attrition Study; and (3) Stability of the Sample. (Contains 4 figures, 12 tables and 14 footnotes.) [For the "MPCP Longitudinal Educational Growth Study: Fourth Year Report. SCDP Milwaukee Evaluation. Report # 23", see ED518597. Additional support for this report was provided by the Robertson Foundation.]
Reviews of Individual Studies 3-8 2
Charter school performance in New Jersey. (2012)
Reviews of Individual Studies 12-PS 2
The role of application assistance and information in college decisions: Results from the H&R Block FAFSA experiment. (2012)
Reviews of Individual Studies 11-12 2
Taking College Courses in High School: A Strategy Guide for College Readiness--The College Outcomes of Dual Enrollment in Texas (2012)
States and school districts are searching for strategies to raise the college and career readiness of high school graduates--imperative in an era when postsecondary credentials are the key to good jobs, better pay, and stronger economies. The creation and implementation of higher graduation standards aligned to college and career expectations is the most visible and emblematic effort by states to ensure students are prepared to succeed after high school, but it is far from the only one. A policy strategy of increasing interest is the practice of providing students with the opportunity to take college courses while in high school, known as dual enrollment. The premise of dual enrollment is that high school students can enhance their chances for college success if they better understand what it takes to succeed in college: they do this by actually experiencing real college coursework, often earning "dual credit" for both high school and college. New research, conducted in Texas by Jobs for the Future (JFF), points to the effectiveness of dual enrollment as a strategy for improving postsecondary success. This study focused on the academic outcomes of 32,908 Texas students from the high school graduating class of 2004. Like some of these studies, the authors' research used rigorous quasi-experimental methods to control for factors other than dual enrollment that could explain student success by comparing dual enrollees to non-dual enrollees who are otherwise closely matched academically and socially. JFF's methodological approach, known as a propensity score matching model, enabled the authors to account for student background characteristics to the highest degree possible short of a randomized study. This greatly increases the certainty that the better college outcomes found for dual enrollment participants are due t o the effects of the dual enrollment courses they completed. Appended are: (1) Propensity Score Model; (2) Cohort, Treatment, and Control Group, by Region; (3) Educational Attainment of Treatment and Control Groups; (4) Test Scores by Treatment and Control Groups; (5) Odds Ratios for College Access Model; (6) Odds Ratios for College Completion Model; and (7) Dual-credit Study Methodology. (Contains 2 figures, 7 tables, and 15 endnotes.)
Reviews of Individual Studies PK-K 2
Longitudinal evaluation of a scale-up model for teaching mathematics with trajectories and technologies. (2012)
We used a cluster randomized trial to evaluate the effectiveness of a research-based model for scaling up educational interventions, focusing on the persistence of effects with and without a follow-through intervention. The instantiation of the Technology-enhanced, Research-based, Instruction, Assessment, and professional Development (TRIAD) model emphasized teaching early mathematics for understanding via learning trajectories and technology. The TRIAD implementation began in 42 schools in two city districts serving low-resource communities, randomly assigned to three conditions. In pre-kindergarten, the 2 experimental interventions were identical, but 1 included follow-through in the kindergarten year, including knowledge of the pre-K intervention and ways to build upon that knowledge using learning trajectories. Intent-to-treat analyses showed that students in both the follow-through condition (g = 0.33) and non-follow-through condition (g = 0.22) scored statistically significantly higher than children in the control condition. Both groups outperformed the control condition in treatment-on-the-treated analyses (g = 0.38, follow-through; g = 0.30 non-follow-through). Moderators and mediators were also analyzed. We conclude that the instantiation of the TRIAD model was successful and that follow through may contribute to the persistence of the effects of preschool interventions. (Contains 5 tables and 3 figures.)
Reviews of Individual Studies 9-12 2
Making a Difference? The Effects of Teach For America in High School (2011)
Teach For America (TFA) selects and places graduates from the most competitive colleges as teachers in the lowest-performing schools in the country. This paper is the first study that examines TFA effects in high school. We use rich longitudinal data from North Carolina and estimate TFA effects through cross-subject student and school fixed effects models. We find that TFA teachers tend to have a positive effect on high school student test scores relative to non-TFA teachers, including those who are certified in field. Such effects offset or exceed the impact of additional years of experience and are particularly strong in science. (Contains 1 figure, 14 tables and 14 footnotes.)
Reviews of Individual Studies 9-12 2
Transforming the High School Experience: How New York City's New Small Schools Are Boosting Student Achievement and Graduation Rates (2011)
Over the last decade, New York City has been the site of a systemwide high school reform effort that is unprecedented in its scope and pace. Since 2002, the school district has closed more than 20 failing high schools, opened more than 200 new secondary schools, and implemented a centralized high school admission process in which approximately 80,000 students a year indicate their school preferences from a wide-ranging choice of programs. At the heart of these reforms lie the new schools that in this report are called "small schools of choice" (SSCs)--small, academically nonselective, public high schools that were opened between 2002 and 2008. Serving approximately 100 students per grade in grades 9 through 12 and open to students at all levels of academic achievement, the SSCs in this study were created to serve the district's most disadvantaged and historically underserved students. Prior to the 2002-2003 school year, these students would have had little option but to enroll in one of the city's large, zoned high schools when they made the transition from eighth to ninth grade. Many of the large schools were low-performing, with graduation rates below 50 percent. This report presents encouraging findings from an unusually large and rigorous study, supported by the Bill & Melinda Gates Foundation, of the effects of SSCs on students' academic achievement in high school. SSCs have a substantial positive impact on the transition into high school during ninth grade, according to data using all four cohorts: (1) SSC enrollees were 10.8 percentage points more likely than the students who enrolled in other schools to earn 10 or more credits during their first year--73.1 percent compared with 62.3 percent; (2) SSC enrollees were 7.8 percentage points less likely to fail more than one core subject (39 percent compared with 46.8 percent); (3) Combining these two indicators, 58.5 percent of SSC enrollees were on track to graduate in four years compared with 48.5 percent of their counterparts who attended a different type of school--a 10 percentage point difference; and (4) During the first year of high school, SSC enrollees earn almost one full credit more (0.9 credit) toward graduation than do their control group counterparts. These positive effects on the transition into high school during ninth grade were seen among nearly all subgroups as defined by students' academic proficiency, socioeconomic status, race/ethnicity, and gender. For all students, second- and third-year follow-up data indicate that these effects are sustained and/or increased as they continue through high school. For the "first" cohort of students (the only cohort for whom there are four years of follow-up data), the evidence indicates that SSC improvements in students' academic progress and school engagement during the early years of high school translate into higher rates of on-time graduation after four years: (1) SSCs increase overall graduation rates by 6.8 percentage points, from 61.9 percent for students who attend schools other than SSCs to 68.7 percent for SSC enrollees; (2) A majority of the SSC effect on graduation rates reflects an increase in receipt of New York State Regents diplomas. For this type of diploma, students must pass a series of Regents examinations with a score of 65 points or above and pass all of their required courses; and (3) SSCs increase the proportion of students (by 5.3 percentage points) who passed the English Regents with a score of 75 points or higher, the threshold for exempting incoming students at the City University of New York from remedial courses. They did not have an effect on math Regents exams. (Contains 2 tables and 4 footnotes.) [For the full report, "Transforming the High School Experience: How New York City's New Small Schools Are Boosting Student Achievement and Graduation Rates," see ED511106.]
Reviews of Individual Studies K 2
Evaluating the effectiveness of Read Well Kindergarten. (2011)
This article reports the outcomes of an experimental evaluation of "Read Well Kindergarten" (RWK), a program that focuses on the development of vocabulary, phonological awareness, alphabetic understanding, and decoding. Kindergarten teachers in 24 elementary schools in New Mexico and Oregon were randomly assigned, by school, to teach RWK or their own program. Treatment teachers received 2 days of training and taught daily lessons. Project staff assessed 1,520 students at pretest and 1,428 at posttest with measures of vocabulary, phonological awareness, alphabetic understanding, and decoding. Follow-up testing was conducted in fall and spring of first grade. Analyses of final outcomes revealed a statistically significant difference favoring intervention students on curriculum-based measures of sight words and decodable words. Although these results did not generalize to standardized measures, follow-up analyses indicated that the impact of RWK rested on the rate of opportunities for independent student practice for letter names, letter sounds, sight words, and oral reading fluency, collected at the end of kindergarten. The findings suggest the potential efficacy of RWK in conjunction with frequent opportunities for independent practice for developing beginning reading skills. (Contains 2 figures and 5 tables.)
Reviews of Individual Studies 3 2
Classroom instruction, child X instruction interactions and the impact of differentiating student instruction on third graders’ reading comprehension. (2011)
Reviews of Individual Studies 3-8 2
The Impact of the NISL Executive Development Program on School Performance in Massachusetts: Cohort 2 Results (2011)
School leaders are increasingly being asked, whether by rhetoric or policy, to measurably improve student achievement. The resultant need to assist school leaders in their ability to improve teaching and learning for all students in their schools led to the establishment of the National Institute of School Leadership's (NISL's) Executive Development Program. The NISL program emphasizes the role of principals as strategic thinkers, instructional leaders, and creators of a just, fair, and caring culture in which all students meet high standards. The current national focus on the importance of effective, instructional leadership has, in turn, led to calls for principal evaluation to be tied directly to student achievement (Davis, Kearney, Sanders, Thomas, and Leon, 2011). Within this milieu, effective and proven principal leadership development programs are crucial. (Contains 3 tables and 2 figures.) [This report was produced by the Center for Educational Partnerships, Old Dominion University.]
Reviews of Individual Studies 6-12 2
An Interaction-Based Approach to Enhancing Secondary School Instruction and Student Achievement (2011)
Improving teaching quality is widely recognized as critical to addressing deficiencies in secondary school education, yet the field has struggled to identify rigorously evaluated teacher-development approaches that can produce reliable gains in student achievement. A randomized controlled trial of My Teaching Partner-Secondary--a Web-mediated approach focused on improving teacher-student interactions in the classroom--examined the efficacy of the approach in improving teacher quality and student achievement with 78 secondary school teachers and 2237 students. The intervention produced substantial gains in measured student achievement in the year following its completion, equivalent to moving the average student from the 50th to the 59th percentile in achievement test scores. Gains appeared to be mediated by changes in teacher-student interaction qualities targeted by the intervention. [For a related What Works Clearinghouse Intervention Report, see ED557783.]
Reviews of Individual Studies 1-2 2
Achievement Effects of Four Early Elementary School Math Curricula: Findings for First and Second Graders. NCEE 2011-4001 (2010)
National achievement data show that elementary school students in the United States, particularly those from low socioeconomic backgrounds, have weak math skills (National Center for Education Statistics 2009). In fact, data show that, even before they enter elementary school, children from disadvantaged backgrounds are behind their more advantaged peers in basic competencies such as number-line ordering and magnitude comparison (Rathburn and West 2004). Furthermore, after a year of kindergarten, disadvantaged students still have less extensive knowledge of mathematics than their more affluent peers (Denton and West 2002). This study examines whether some early elementary school math curricula are more effective than others at improving student math achievement in disadvantaged schools. A small number of curricula, which are based on different approaches for developing student math skills, dominate elementary math instruction--7 curricula make up 91 percent of those used by K-2 educators, according to a 2008 survey (Resnick et al. 2010). Little rigorous evidence exists to support one approach over another, however, which means that research does not provide educators with much useful information when choosing a math curriculum to use. The key findings in this report include the following: (1) Teachers used their assigned curriculum, and the instructional approaches of the four curriculum groups differed as expected; (2) Math instruction varied in other notable ways across the curriculum groups; (3) In terms of student math achievement, the curriculum used by the study schools mattered; and (4) The curriculum used in different contexts also mattered, and some of these findings are consistent with findings based on all students whereas others are not. Appendices include: (1) Data Collection and Response Rates; (2) Teacher-Reported Frequency of Implementing Other Curriculum-Specific Activities; (3) Glossary of Curriculum-Specific Terms; and (4) Constructing the Analyses Samples and Estimating Curriculum Effects. (Contains 82 tables, 7 figures and 97 footnotes.) [For the executive summary, see ED512553.]
Reviews of Individual Studies 1 2
Effectiveness of a Supplemental Early Reading Intervention Scaled Up in Multiple Schools (2010)
The effectiveness study examined a supplemental reading intervention that may be appropriate as one component of a response-to-intervention (RTI) system. First-grade students in 31 schools who were at risk for reading difficulties were randomly assigned to receive Responsive Reading Instruction (RRI; Denton, 2001; Denton & Hocker, 2006; n = 182) or typical school practice (TSP; n = 240). About 43% of the TSP students received an alternate school-provided supplemental reading intervention. Results indicated that the RRI group had significantly higher outcomes than the TSP group on multiple measures of reading. About 91% of RRI students and 79% of TSP students met word reading criteria for adequate intervention response, but considerably fewer met a fluency benchmark. (Contains 8 tables.)
Reviews of Individual Studies 5-8 2
San Francisco Bay Area KIPP schools: A study of early implementation and achievement. Final report. (2008)
Reviews of Individual Studies 3-8 2
Use of a Progress Monitoring System to Enable Teachers to Differentiate Mathematics Instruction (2007)
We explored how a progress monitoring and instructional management system can be used to help educators differentiate instruction and meet the wide-ranging learning needs of their increasingly diverse classrooms. We compared classrooms in 24 states that used a curriculum-based progress monitoring and instructional management system, Accelerated Math, to same school control classrooms that did not use it. Among the major findings were the following: (1) At every grade level there were large differences in grade equivalent score and percentile gains for students in the experimental and control classrooms; (2) Gains were experienced across the achievement spectrum. An analysis of low-, middle-, and high-achieving students showed consistent rates of gain for each math objective mastered; (3) Intervention integrity had a significant effect on student achievement; (4) Teachers using the progress monitoring and instructional management system spent more time providing individual versus group instruction and felt better able to meet the individual needs of their students; and (5) Significantly more students who were in classrooms where teachers used the progress monitoring and instructional management system reported that they like math, help each other with math, and like math better this year than last year. Addition of a progress monitoring and instructional management system to ongoing mathematics instruction improves mathematics outcomes for students. The effects of the program clearly are a function of intervention integrity; when progress monitoring and instructional management practices are implemented with high fidelity or integrity, the mathematics performance of all students is significantly enhanced. Implications for practice are discussed.
Reviews of Individual Studies 6-12 2
A Cognitive Strategies Approach to Reading and Writing Instruction for English Language Learners in Secondary School (2007)
This study was conducted by members of a site of the California Writing Project in partnership with a large, urban, low-SES school district where 93% of the students speak English as a second language and 69% are designated Limited English Proficient. Over an eight-year period, a relatively stable group of 55 secondary teachers engaged in ongoing professional development implemented a cognitive strategies approach to reading and writing instruction, making visible for approximately 2000 students per year the thinking tools experienced readers and writers access in the process of meaning construction. The purpose of the study was to assess the impact of this approach on the reading and writing abilities of English language learners (ELLs) in all 13 secondary schools in the district. Students receiving cognitive strategies instruction significantly out-gained peers on holistically scored assessments of academic writing for seven consecutive years. Treatment-group students also performed significantly better than control-group students on GPA, standardized tests, and high-stakes writing assessments. Findings reinforce the importance of having high expectations for ELLs; exposing them to a rigorous language arts curriculum;explicitly teaching, modeling and providing guided practice in a variety of strategies to help students read and write about challenging texts; and involving students as partners in a community of learners. What distinguishes the project is its integrity with respect to its fidelity to three core dimensions: Teachers and students were exposed to an extensive set of cognitive strategies and a wide array of curricular approaches to strategy use (comprehensiveness) in a manner designed to cultivate deep knowledge and application of those strategies in reading and writing (density) over an extended period of time (duration). The consistency of positive outcomes on multiple measures strongly points to the efficacy of using this approach with ELLs. Appended are: (1) Great Expectations Writing Prompt; and (2) Student Models. (Contains 1 note, 5 tables, and 6 figures.)
Reviews of Individual Studies 9 2
Improving student literacy in the Phoenix Union High School District 2003–04 and 2004–05: Final report. (2006)
Reviews of Individual Studies 9-10 2
Improving student literacy in the Phoenix Union High School District 2003–04 and 2004–05: Final report. (2006)
Reviews of Individual Studies 6-8 2
An efficacy study of READ 180: A print and electronic adaptive intervention program, grades 4 and above. (2002)
Reviews of Individual Studies 3-8 2
Evaluation of a Tiered Model for Staff Development in Writing. (1994)
Investigates the value of a tiered model of staff development for five districts using "teacher consultants" drawn from a parent district with a long writing project history. Evaluates preconditions, processes and outcomes. Discusses results in terms of student achievement and classroom practices. (SR)
Reviews of Individual Studies PK-4 2
Success for All: Longitudinal Effects of a Restructuring Program for Inner-City Elementary Schools. (1993)
Effects of variations in a schoolwide restructuring program, Success for All, in Baltimore (Maryland) on student reading achievement and other outcomes in elementary schools with large numbers of disadvantaged children are presented. Strong positive effects of the intervention are recognized, and program replication is discussed. (SLD)
Reviews of Individual Studies 6-8 2
Using Student Team Reading and Student Team Writing in Middle Schools: Two Evaluations. (1992)
Two studies evaluated the use of the Student Team Reading (STR) and Student Team Writing (STW) program in urban middle schools. The first study investigated the use of STR in 20 experimental sixth-grade classes in three schools matched with 39 classes in three control schools. The second study investigated the use of STR and STW in sixth, seventh, and eighth grades in two urban middle schools in Maryland matched with three control schools. In the first study, experimental students achieved significantly higher on a standardized measure of reading comprehension. The reading comprehension achievement of academically handicapped students, analyzed separately, was highly significant in favor of the experimental group. In the second study, the STR and STW students had significantly higher achievement on measures of reading vocabulary, reading comprehension, and language expression. (Two tables of data are included in the first study, and one table of data is included in the second study; 25 references are attached to the first study, and 22 references are attached to the second study.) (Author/RS)
Reviews of Individual Studies 9 2
Mastery learning and student teams: A factorial experiment in urban general mathematics classes. (1984)
Reviews of Individual Studies 5 3
Reasoning Mind students outperform comparison on Singapore Math Test. (in press)
Reviews of Individual Studies 9 3
Effects of a behavior management strategy, CW-FIT, on high school student and teacher behavior. (2022)
Reviews of Individual Studies 1 3
Examining the Impact of a First Grade Whole Number Intervention by Group Size (2022)
This study utilized a partially nested randomized control design to investigate the impact of Fusion, a first grade math intervention. Blocking on classrooms, students were randomly assigned to one of three conditions: a Fusion two student group, a Fusion five student group, or a no treatment control group. Two primary research questions were examined: What was the overall impact of the Fusion intervention as compared to a business-as-usual comparison condition? and Was there a differential impact on student outcomes between the 2:1 Fusion and the 5:1 Fusion conditions? Analyses found a positive effects on four outcome measures favoring Fusion groups over control with two of the differences statistically significant. Results between Fusion groups found positive effects favoring the Fusion 2:1 group compared to the Fusion 5:1 group on all four outcome measures with two of the differences statistically significant. On a second grade follow up measure no difference was found between Fusion groups and control but a statistically significant difference was found between Fusion groups favoring the 2:1 Fusion group. Future research directions and implications for practice are discussed. [This paper will be published in the "Journal of Research on Educational Effectiveness."]
Reviews of Individual Studies 2-6 3
Positive Behavior Change: Effects of an Intervention Package for Disruptive Behavior in a Specialized School Setting (2022)
An ABAB design was used to analyze the effects of positive peer reporting plus a randomized dependent group contingency (PPR + DGC). This intervention package was implemented across three classrooms in an alternative school setting for students diagnosed with emotional and behavioral disorders. The DGC consisted of the teacher randomly choosing a student to watch throughout the 45-min class period to determine if that student was following classroom rules. If so, the entire class earned a randomly selected reward at the end of class period. The intervention package also included two opportunities, one at the start and one at the end of class, for students to engage in positive reporting sessions. Results indicated an increase in engagement and a decrease in off-task and disruptive behavior while the intervention was implemented. The effects on positive and negative peer statements were ultimately minimal throughout all classrooms and phases. Social validity data indicated that teachers found the intervention package to be easy to include in their daily routine and stated that they would continue using this intervention package in the future. Discussion focuses on implications for practice and the need for additional research examining the effects of positive peer reports on student behavior.
Reviews of Individual Studies K-5 3
Educational technology in support of elementary students with reading or language-based disabilities: A cluster randomized controlled trial. (2022)
Reviews of Individual Studies K-3 3
First Step Next and homeBase: A Comparative Efficacy Study of Children with Disruptive Behavior (2022)
Disruptive behavior disorders in childhood are increasingly pervasive and associated with numerous, negative long-term outcomes. The current study examined whether adding a brief, home-visitation intervention to an existing, multi-component (child and teacher) intervention, would improve social-emotional and behavioral outcomes for young children with challenging behavior in home and school settings who required intensive support. A total of 379 teacher-parent-student triads were screened for elevated levels of behavioral risk in school and home settings and then randomly assigned to school only intervention (i.e., teacher and student components), home only intervention (i.e., parent), both combined, or business-as-usual control conditions. We examined baseline and posttest outcomes across prosocial behavior, problem behavior, and academic domains. The results demonstrated substantial support for the teacher and child-focused condition and combined conditions, and modest support for the parent-focused condition. The study advances the literature by increasing the knowledge base related to these interventions implemented alone and in combination.
Reviews of Individual Studies K-3 3
First Step Next and homeBase: A Comparative Efficacy Study of Children with Disruptive Behavior (2022)
Disruptive behavior disorders in childhood are increasingly pervasive and associated with numerous, negative long-term outcomes. The current study examined whether adding a brief, home-visitation intervention to an existing, multi-component (child and teacher) intervention, would improve social-emotional and behavioral outcomes for young children with challenging behavior in home and school settings who required intensive support. A total of 379 teacher-parent-student triads were screened for elevated levels of behavioral risk in school and home settings and then randomly assigned to school only intervention (i.e., teacher and student components), home only intervention (i.e., parent), both combined, or business-as-usual control conditions. We examined baseline and posttest outcomes across prosocial behavior, problem behavior, and academic domains. The results demonstrated substantial support for the teacher and child-focused condition and combined conditions, and modest support for the parent-focused condition. The study advances the literature by increasing the knowledge base related to these interventions implemented alone and in combination.
Reviews of Individual Studies K-3 3
First Step Next and homeBase: A Comparative Efficacy Study of Children with Disruptive Behavior (2022)
Disruptive behavior disorders in childhood are increasingly pervasive and associated with numerous, negative long-term outcomes. The current study examined whether adding a brief, home-visitation intervention to an existing, multi-component (child and teacher) intervention, would improve social-emotional and behavioral outcomes for young children with challenging behavior in home and school settings who required intensive support. A total of 379 teacher-parent-student triads were screened for elevated levels of behavioral risk in school and home settings and then randomly assigned to school only intervention (i.e., teacher and student components), home only intervention (i.e., parent), both combined, or business-as-usual control conditions. We examined baseline and posttest outcomes across prosocial behavior, problem behavior, and academic domains. The results demonstrated substantial support for the teacher and child-focused condition and combined conditions, and modest support for the parent-focused condition. The study advances the literature by increasing the knowledge base related to these interventions implemented alone and in combination.
Reviews of Individual Studies 9-12 3
Efficacy of a School-Based Comprehensive Intervention Program for Adolescents with Autism (2022)
We tested the efficacy of a comprehensive intervention program designed for high school students across the autism spectrum, the Center on Secondary Education for Students with Autism (CSESA) model, in a cluster randomized control trial involving 60 high schools in three states (California, North Carolina, Wisconsin), with implementation occurring over a 2-year period. We examined outcomes for the schools, students (N = 547), and families. At the conclusion of the study, CSESA schools had significantly higher program quality than the services-as-usual (SAU) schools. In addition, students in the CSESA schools had significantly higher total attainment of educational goals than students in SAU schools. There were not significant differences between the two groups on standardized assessment outcomes. We discuss implications for intervention implementation and future research with this population in the public school context.
Reviews of Individual Studies K-5 3
Equity-Focused PBIS Approach Reduces Racial Inequities in School Discipline: A Randomized Controlled Trial (2021)
We assessed the effects of a whole-school equity intervention implemented within a school-wide positive behavioral interventions and supports (PBIS) framework on racial inequities in school discipline in eight elementary schools with inequitable referrals for Black students. The intervention involved assessing patterns of racial disparities in school discipline decisions and providing professional development on adapting school-wide behavior systems to improve cultural responsiveness through concrete strategies targeting the patterns. After consent and matching on existing levels of racial inequities, half of the schools were randomly assigned to receive the intervention. Analyses showed that schools receiving the intervention had significant decreases in racial disparities in school discipline and rates of office discipline referrals (ODRs) for Black students, while control schools had minimal change. Results are discussed in terms of improving equity in school discipline within multitiered systems of support.
Reviews of Individual Studies 3 3
Alternative Paths to Improved Word-Problem Performance: An Advantage for Embedding Prealgebraic Reasoning Instruction within Word-Problem Intervention (2021)
The purpose of this study was to explore the paths by which word-problem intervention, with versus without embedded prealgebraic reasoning instruction, improved word-problem performance. Students with mathematics difficulty (MD; n = 304) were randomly assigned to a business-as-usual condition or 1 of 2 variants of word-problem intervention. The prealgebraic reasoning component targeted relational understanding of the equal sign as well as standard and nonstandard equation solving. Intervention occurred for 16 weeks, 3 times per week, 30 min per session. Sequential mediation models revealed main effects, in which each intervention condition significantly and substantially outperformed the business-as-usual condition, corroborating prior research on the efficacy of schema word-problem intervention. Yet despite comparable effects on word-problem outcomes between the two word-problem conditions, the process by which effects accrued differed: An indirect path via equal-sign understanding and then equation solving was significant only for the word-problem intervention condition with embedded prealgebraic reasoning instruction. Additionally, the effect of this condition on equal-sign reasoning was strong. Given the link between equal-sign reasoning for success with algebra and the importance of algebra for success with advanced mathematics, results suggest an advantage for embedding prealgebraic reasoning instruction within word-problem intervention.
Reviews of Individual Studies 2-3 3
Empowering Teachers with Low-Intensity Strategies: Supporting Students At-Risk for EBD with Instructional Choice during Reading (2021)
Teachers may benefit from using classroom-delivered, low-intensity strategies to increase engagement of students at-risk for emotional and behavioral disorders and academic failure in the general education classroom. This project focused on empowering teachers to be involved in every step of the research process: screening, planning, data collection, and intervention implementation. Six teachers utilized instructional choice to improve engagement during reading for one targeted student in their second- or third-grade class. Teachers implemented practices with high levels of treatment integrity and collected momentary time sampling data with high levels of reliability. Using a withdrawal design, we observed a clear functional relation between instructional choice and increases in student's academic engagement for three students with improved outcomes for five. Both teachers and students rated intervention goals, procedures, and outcomes as acceptable. Limitations and directions for future research are discussed.
Reviews of Individual Studies 1-2 3
Can feedback, correct, and incorrect worked examples improve numerical magnitude estimation precision? (2021)
Reviews of Individual Studies 5-6 3
Putting Fractions Together (2021)
Learning fractions is a critical step in children's mathematical development. However, many children struggle with learning fractions, especially fraction arithmetic. In this article, we propose a general framework for integrating understanding of individual fractions and fraction arithmetic, and we use the framework to generate interventions intended to improve understanding of both individual fractions and fraction addition. The framework, Putting Fractions Together (PFT), emphasizes that both individual fractions and sums of fractions are composed of unit fractions and can be represented by concatenating them (putting them together). To illustrate, both "3/9" and "2/9 + 1/9" can be represented by concatenating three 1/9s; similarly, 2/9 + 1/8 can be represented by concatenating two 1/9s and one 1/8. Interventions based on the PFT framework were tested in 2 experiments with fourth, fifth, and sixth grade children. The interventions led to improved performance on number line estimation and magnitude comparison tasks involving individual fractions and sums of fractions with equal and unequal denominators. Especially large improvements were observed on relatively difficult unequal-denominator fraction sum problems. The findings suggest that viewing individual nonunit fractions and sums of fractions as concatenations of unit fractions provides a sound conceptual foundation for improving children's knowledge of both. We discuss implications of the research for teaching and learning fractions, children's numerical development, and mathematics education in general.
Reviews of Individual Studies 4-5 3
Putting Fractions Together (2021)
Learning fractions is a critical step in children's mathematical development. However, many children struggle with learning fractions, especially fraction arithmetic. In this article, we propose a general framework for integrating understanding of individual fractions and fraction arithmetic, and we use the framework to generate interventions intended to improve understanding of both individual fractions and fraction addition. The framework, Putting Fractions Together (PFT), emphasizes that both individual fractions and sums of fractions are composed of unit fractions and can be represented by concatenating them (putting them together). To illustrate, both "3/9" and "2/9 + 1/9" can be represented by concatenating three 1/9s; similarly, 2/9 + 1/8 can be represented by concatenating two 1/9s and one 1/8. Interventions based on the PFT framework were tested in 2 experiments with fourth, fifth, and sixth grade children. The interventions led to improved performance on number line estimation and magnitude comparison tasks involving individual fractions and sums of fractions with equal and unequal denominators. Especially large improvements were observed on relatively difficult unequal-denominator fraction sum problems. The findings suggest that viewing individual nonunit fractions and sums of fractions as concatenations of unit fractions provides a sound conceptual foundation for improving children's knowledge of both. We discuss implications of the research for teaching and learning fractions, children's numerical development, and mathematics education in general. [The article was published in "Journal of Educational Psychology" (EJ1291033).]
Reviews of Individual Studies 5 3
An Evaluation of the Literacy-Infused Science Using Technology Innovation Opportunity (LISTO) i3 Evaluation (Valid 45) Final Report (2021)
The purpose of this study was to evaluate the Literacy-Infused Science Using Technology Innovation Opportunity (LISTO) validation project (Valid 45). LISTO was funded by the Investing in Innovation (i3) Fund and involved a multi-year intervention that provided virtual professional development and coaching, and literacy-infused science curricula to fifth-grade science teachers who taught predominantly low-income students and in predominantly rural public schools in Texas. The overarching goal of LISTO is to validate, via a 5-year longitudinal randomized controlled trial (RCT) study, literacy-infused science (LIS) instructional and curricular innovations to increase instructional capacity of teachers and to improve students' science and reading/writing literacy achievement in rural/non-rural schools for economically challenged (EC), inclusive of English language learners (ELL) students. Outcomes collected in the 2017-18 school year were considered to be exploratory, given the timing of Hurricane Harvey, which impacted Texas in August of 2017. Outcomes in the 2018-19 school year served as the confirmatory contrasts. LISTO resulted in increased teacher capacity to implement research-based strategies while teaching science content, yet this improvement did not necessarily translate into improved student achievement in science or reading. The LISTO professional development and coaching covered pedagogical strategies for teaching science, including those that have been shown to improve literacy and be particularly effective for ELs. There was a negative impact on students' science achievement in both 2017-18 (ES = -0.10) and in 2018--19 (ES = -0.13). There was a negative program impact on students' science interest (ES = -0.14), as measured by a survey, in 2017-18, and no impact in 2018-19. These quantitative findings were in conflict with qualitative data collected from LISTO teachers, who indicated that the program led to improvements in both science vocabulary and engagement and self-efficacy in science for students. LISTO had positive effects on teacher practices for a subsample of teachers, specifically on increased delivery of research-based instruction to teach science content as rated on a rubric by external reviewers (ES = +1.12). LISTO appeared to improve instructional practices for a sample of teachers who implemented the program for two years with complete data but did not positively impact student or teacher outcomes more broadly. However, results should be cautiously interpreted due to limitations of delayed and incomplete implementation in the first year of the project due to Hurricane Harvey. Encouragingly, teachers' overall positive reactions to the program suggest its potential to improve student affect and learning, but more extensive implementation experience by teachers and multi-year exposure by students starting from early grades may be needed to yield measurable benefits. Clearly, such focuses emerge as a highly recommended topic for future research.
Reviews of Individual Studies 4-5 3
The Effects of a Paraphrasing and Text Structure Intervention on the Main Idea Generation and Reading Comprehension of Students with Reading Disabilities in Grades 4 and 5 (2020)
This study examined the effects of a small group intervention targeting paraphrasing and text structure instruction on the main idea generation and reading comprehension of students with reading disabilities in Grades 4 and 5. Students (N = 62) were randomly assigned to receive the Tier 2-type intervention or business-as-usual instruction. Students in the intervention received 25, 40-minute lessons focused on paraphrasing sections of text by identifying the main topic and the most important idea about that topic. Students utilized the text structure organization to inform their main idea generation. Results yielded statistically significant, positive effects in favor of the intervention group on near-transfer and mid-transfer measures of text structure identification (g = 0.75) and main idea generation (g = 0.70), but no statistically significant effect on a far-transfer measure of reading comprehension. These findings provide initial support for utilizing this instruction to improve students' main idea generation on taught and untaught structures.
Reviews of Individual Studies 9-11 3
Efficacy of a no-team version of the Good Behavior Game in high school classrooms. (2020)
Reviews of Individual Studies 6-7 3
The Effects of Inference Instruction on the Reading Comprehension of English Learners with Reading Comprehension Difficulties (2020)
Inference skill is one of the most important predictors of reading comprehension. Still, there is little rigorous research investigating the effects of inference instruction on reading comprehension. There is no research investigating the effects of inference instruction on reading comprehension for English learners with reading comprehension difficulties. The current study investigated the effects of small-group inference instruction on the inference generation and reading comprehension of sixth- and seventh-grade students who were below-average readers (M = 86.7, SD = 8.1). Seventy-seven percent of student participants were designated limited English proficient. Participants were randomly assigned to 24, 40-min sessions of the inference instruction intervention (n = 39) or to business-as-usual English language arts instruction (n = 39). Membership in the treatment condition statistically significantly predicted higher outcome score on the "Gates-MacGinitie Reading Test" Reading Comprehension subtest (d = 0.60, 95% confidence interval [CI] [0.16, 1.03]), but not on the other measures of inference skill.
Reviews of Individual Studies 6-7 3
Impact of CW-FIT on Student and Teacher Behavior in a Middle School (2020)
Positive behavior interventions and supports (PBIS) improve student behavior. Yet, teachers may not receive adequate training to implement PBIS at the classroom level. This study evaluated class-wide function-related intervention teams (CW-FIT) as a classroom-level behavior management system to determine whether the behavior of middle school students would improve with teacher implementation of CW-FIT. A multiple-baseline across conditions design was used to evaluate changes in on-task behavior of adolescent students in sixth and seventh grade from a socioeconomically and ethnically diverse middle school. In addition, the effects on teacher behavior-specific praise statements and teacher reprimands were assessed. Consistent with previous evaluations of CW-FIT, findings indicated a functional relation between the intervention and increases in on-task student behavior. In addition, the findings also showed improvements to teacher behavior with increases in behavior-specific praise statements; however, no effect was observed with teacher reprimands. Social validity measures indicated students and teachers found the intervention favorable. Implications, limitations, and areas for future inquiry are discussed.
Reviews of Individual Studies 1-2 3
Measuring Academic Output during the Good Behavior Game: A Single Case Design Study (2020)
The impact of the Good Behavior Game (GBG) on students' classroom behavior has been studied for 50 years. What is less established is the impact of the GBG on students' academic progress. With emerging research in curriculum-based measurement for written expression (WE-CBM), it may be possible to observe changes in students' writing output while playing the GBG versus when the game is not played. The purpose of the current study was to systematically introduce the GBG during writing practice time in a Grade 1 and Grade 2 classroom, and observe any changes to all students' academic engagement, disruptive behavior, as well as target students' writing output using WE-CBM. Results indicated large increases in all students' academic engagement and decreases in disruptive behavior when the GBG was played. For writing output, target students demonstrated modest improvement in the amount of words written and accuracy of writing when the game was played, especially students identified as having emerging writing skills. Future studies might continue to empirically explore the connection between behavioral intervention and academic output by replicating study procedures in different contexts and/or with alternative WE-CBM indices.
Reviews of Individual Studies 3 3
Addressing Challenging Mathematics Standards with At-Risk Learners: A Randomized Controlled Trial on the Effects of Fractions Intervention at Third Grade (2020)
The purposes of this study were to assess the effects of fractions intervention for students who are at-risk for poor outcomes and to examine whether a component that combines self-regulated learning with growth mindset instruction (SR-GM) provides added value for improving outcomes. At-risk students (N = 84) were randomly assigned to 3 conditions: fractions intervention, fractions intervention with embedded SR-GM, and a control group. Intervention was conducted 3 times per week for 35 min per session for 13 weeks. Multilevel models indicated both fractions intervention conditions produced strong effects, with no added value for SR-GM. Posttest fractions achievement gaps for both intervention conditions held steady, narrowed, or closed, while the control group's gaps remained sizeable or grew. Results suggest that intervention can address challenging mathematics standards for at-risk learners and that SR-GM instruction may not be necessary in the context of strong intervention. [This is the in press version of an article published in "Exceptional Children."]
Reviews of Individual Studies 3 3
Empowering Teachers with Low-Intensity Strategies to Support Instruction: Implementing Across-Activity Choices during Third-Grade Reading Instruction (2020)
Students with and at-risk for academic and behavioral challenges often have low levels of academic engagement. Providing instructional choice is one way to increase engagement in the classroom. In this study, we replicated and extended previous inquiry by investigating the effects of across-activity choices offered by third-grade teachers during reading instruction to participating students with behavioral (one with internalizing and two with internalizing and externalizing patterns) and academic needs. Using a standardized professional development module, teachers learned to implement instructional choice during reading instruction while collecting direct observation data on a student's academic engagement. Teachers implemented practices with integrity and collected momentary time sampling data for one student in their classroom with high levels of reliability. Results of a withdrawal design indicated a functional relation between the introduction of instructional choice and increases in the academic engagement for the three students. Teachers and students rated the intervention goals, procedures, and outcomes as acceptable. Limitations and future directions are presented.
Reviews of Individual Studies 1 3
A Multisite Randomized Controlled Trial of the Effectiveness of "Descubriendo la Lectura" (2020)
We present findings from a randomized controlled trial of "Descubriendo la Lectura" (DLL), an intervention designed to improve the literacy skills of Spanish-speaking first graders, who are struggling with reading. DLL offers one-on-one native language literacy instruction for 12 to 20 weeks to each school's lowest performing first-graders. Examining literacy outcomes for 187 students, hierarchical linear model analyses revealed statistically significant effects of student-level assignment to DLL on all 9 outcomes evaluated. Impacts were as large as 1.24 standard deviations, or a learning advantage relative to controls exceeding a full school year of achievement growth. The mean effect size of d = 0.66 across the nine literacy measures is equal to approximately two thirds of the overall literacy growth that occurs across the first-grade year.
Reviews of Individual Studies K-6 3
Combining Social Skills Instruction and the Good Behavior Game to Support Students with Emotional and Behavioral Disorders (2020)
Research indicates that students with emotional and behavioral disorders (EBD) may engage in severe disruptions and off-task behaviors in the classroom setting that adversely impact the learning environment. This leads to many students identified as having EBD being placed in alternative education settings, such as restrictive schools or residential facilities. Due to placement in more restrictive environments and high rates of disciplinary actions, it is especially critical to decrease disruptive behaviors for students diagnosed with EBD. In addition, classroom teachers report disruptive behaviors and conduct problems as a major barrier to teaching their students. An ABC multiple baseline across classes design was used in an alternative school setting to evaluate the effects of explicit social skills training combined with a group contingency on class-wide levels of engagement and disruptive behavior. Participants were students in the first through sixth grade diagnosed with EBD. Through the class-wide intervention, social skills acquisition deficits were targeted through social skills instruction and social skills performance deficits were targeted through reinforcement programs. Results showed an increase in engagement and a decrease in disruptive behavior across all classrooms as a result of the intervention package.
Reviews of Individual Studies K-3 3
The effects, generalization, and incidental benefits of class-wide function-related intervention [Doctoral Dissertation, University of Kansas]. (2020)
Reviews of Individual Studies K-4 3
Implementing Comprehensive Literacy Instruction for Students with Severe Disabilities in General Education Classrooms (2020)
The purpose of this conceptual replication study was to investigate the efficacy of an early literacy intervention when it was implemented by special educators in general education classrooms with students in the class participating in the lessons. The study was conducted in 16 schools in three states. Eighty students with severe disabilities participated in the study. Students in the intervention group received Early Literacy Skills Builder (ELSB) instruction, and students in the "business-as-usual" control group received literacy instruction planned by special education teachers to address the students' individualized education program literacy goals. Literacy assessments were conducted in five waves scheduled across the school year. Results showed that students receiving ELSB instruction made greater gains in assessed literacy skills than students in the control group. These findings provide evidence that students with severe disabilities can benefit from comprehensive emergent literacy instruction when it is implemented in general education settings. [For the corresponding grantee submission, see ED601011.]
Reviews of Individual Studies 9-12 3
Massachusetts Innovation Pathway & Early College Pathway Program Evaluation (2020)
Reviews of Individual Studies 9-12 3
Improving High Schools through STEM Early College Strategies: The Impact of the STEM Early College Expansion Partnership (SECEP) (2019)
The STEM Early College Expansion Project is an effort to integrate STEM strategies with the early college model and implement this in comprehensive high schools. This report summarizes findings from two separate quasi-experimental impact studies of the model in Michigan and Connecticut. Results from Michigan showed statistically significant impacts on enrollment in college-level courses and on attainment of college credits. Treatment schools in Michigan also had descriptively lower dropout rates. The Connecticut impact study had challenges with the study design that resulted in an inability to make clear causal claims about the impact.
Reviews of Individual Studies K 3
Building number sense among English learners: A multisite randomized controlled trial of a Tier 2 kindergarten mathematics intervention (2019)
Reviews of Individual Studies K 3
Effects of daily and reduced frequency implementation of the Good Behavior Game in kindergarten classrooms (2019)
Reviews of Individual Studies K-2 3
Cluster randomized trial of the classroom SCERTS intervention for elementary students with Autism Spectrum Disorder (2019)
Reviews of Individual Studies PK-K 3
The Effects of Full-Day Prekindergarten: Experimental Evidence of Impacts on Children&apos;s School Readiness (2019)
This study is a randomized control trial of full- versus half-day prekindergarten (pre-K) in a school district near Denver, Colorado. Four-year-old children were randomly assigned an offer of half-day (4 days/week) or full-day (5 days/week) pre-K that increased class time by 600 hours. The full-day pre-K offer produced substantial, positive effects on children's receptive vocabulary skills (0.275 standard deviations) by the end of pre-K. Among children enrolled in district schools, full-day participants also outperformed their peers on teacher-reported measures of cognition, literacy, math, physical, and socioemotional development. At kindergarten entry, children offered full day still outperformed peers on a widely used measure of basic literacy. The study provides the first rigorous evidence on the impact of full-day preschool on children's school readiness skills.
Reviews of Individual Studies 1 3
Addressing Literacy Needs of Struggling Spanish-Speaking First Graders: First-Year Results from a National Randomized Controlled Trial of Descubriendo La Lectura (2019)
Given the growing number of Latino English learners and the lack of evidence-based educational opportunities they are provided, we investigated the impact of one potentially effective literacy intervention that targets struggling first-grade Spanish-speaking students: Descubriendo La Lectura (DLL). DLL provides first-grade Spanish-speaking students one-on-one literacy instruction in their native language and is implemented at an individualized pace for approximately 12 to 20 weeks by trained bilingual teachers. Using a multisite, multicohort, student-level randomized controlled trial, we examined the impact of DLL on both Spanish and English literacy skills. In this article, we report findings from the first of three cohorts of students to participate in the study. Analyses of outcomes indicate that treated students outperformed control students on all 11 Spanish literacy assessments with statistically significant effect sizes ranging from 0.34 to 1.06. Analyses of outcomes on four English literacy assessments yielded positive effect sizes, though none were statistically significant. [This article was published in "AERA Open" (EJ1229779).]
Reviews of Individual Studies 3 3
Effects of Super Solvers fractions intervention for at-risk third graders: A research report (2019)
Reviews of Individual Studies 3 3
Embedding Self-Regulation Instruction within Fractions Intervention for Third Graders with Mathematics Difficulties (2019)
The purpose of this study was to explore the efficacy of fractions intervention with and without an embedded self-regulation (SR) component for third-grade students at risk for mathematics disabilities. Fractions intervention focused on magnitude understanding and word problems. Embedded SR was designed to support a growth mindset (fostering belief that intellectual and academic abilities can be developed) along with SR processes in which students set goals, self-monitor, and use strategies to engage motivationally, metacognitively, and behaviorally through challenging tasks. Students (n = 69) were randomly assigned to business-as-usual control and the two versions of fractions intervention. Multilevel models, accounting for the nested structure of the data, identified a moderation effect on fraction word problems: For students receiving fractions intervention with embedded SR, response to intervention was robust across the continuum of students' pretest word problem skill; by contrast, without SR, response to fractions intervention depended on students' pretest word problem skill. On the remaining outcomes, results reflected stronger outcomes when fractions intervention embedded SR instruction without moderation. [This paper will be published in the "Journal of Learning Disabilities."]
Reviews of Individual Studies 2-4 3
Effects of Tactile Prompting and Self-Monitoring on Teachers&apos; Use of Behavior-Specific Praise (2019)
Effectively managing a classroom is crucial in promoting positive student outcomes. Behavior-specific praise is an empirically supported strategy to reinforce desirable student behaviors. Following a review of the literature, we identified tactile prompting and self-monitoring as effective methods to increase teachers' use of behavior-specific praise while sustaining intervention long enough until teachers contacted natural maintaining contingencies. We created electronic tactile awareness prompting with self-monitoring (eTAPS) by combining two applications on an Apple Watch. Using a multiple-baseline-across-participants design, this study primarily investigated the effects of eTAPS on special education teachers' use of behavior-specific praise. Secondarily, this study investigated the impact that behavior-specific praise would have on the on-task behaviors of targeted students with disabilities demonstrating frequent off-task behaviors. Results indicated that eTAPS was effective in increasing and maintaining behavior-specific praise rates. Furthermore, significant increases in student on-task behavior occurred. Implications of results and future research are discussed.
Reviews of Individual Studies 1-5 3
Cluster Randomized Trial of a School Intervention for Children with Autism Spectrum Disorder (2019)
Objective: There are currently no empirically-supported, comprehensive school-based interventions (CSBIs) for children with autism spectrum disorder (ASD) without concomitant intellectual and language disability. This study compared outcomes for a CSBI (schoolMAX) to typical educational programming (services-as-usual [SAU]) for these children. Method: A total of 103 children (ages 6-12 years) with ASD (without intellectual and language disability) were randomly assigned by school buildings (clusters) to receive the CSBI (n=52 completed) or SAU (n=50 completed). The CSBI was implemented by trained school personnel and targeted social competence and ASD symptoms using social skills groups, emotion recognition instruction, therapeutic activities, behavioral reinforcement, and parent training. Outcome measures tested the effects of the CSBI on social competence and ASD symptoms, as well as potential collateral effects on academic achievement. Outcomes (baseline-to-follow-up) were assessed using tests of social-cognition and academic skills and behavioral observations (by masked evaluators) and parent-teacher ratings of ASD symptoms and social/social-communication skills (non-masked) [ClinicalTrials.gov, NCT03338530, https://www.clinicaltrials.gov/]. Results: The CSBI group improved significantly more than the SAU group on the test of emotion recognition skills and parent-teacher ratings of ASD symptoms (primary outcomes) and social/social-communication skills (secondary outcome). No differences between groups were detected for recess social interactions or academic skills. Conclusions: The CSBI improved several core areas of functioning for children with ASD compared to usual educational programming. Additional intervention elements may be needed to expand the efficacy of the CSBI so that the observed skills/symptom improvements generalize to recess social interactions and/or academic skills are enhanced. [This paper was published in the "Journal of Clinical Child and Adolescent Psychology" v48 n6 p922-933 Dec 2019.]
Reviews of Individual Studies 1 3
Schema-based word-problem intervention with and without embedded language comprehension instruction (2019)
Reviews of Individual Studies 1 3
Schema-based word-problem intervention with and without embedded language comprehension instruction (2019)
Reviews of Individual Studies 6-8 3
Managing Student Behavior in the Middle Grades Using Class-Wide Function-Related Intervention Teams (2019)
During the transition from the elementary to middle grades, young adolescents may become increasingly vulnerable for emotional and behavioral problems. Class-Wide Function-Related Intervention Teams for middle level school (CW-FIT MS), the independent variable examined in this study, was developed to improve teaching and learning by fostering student engagement. The study's purpose was to examine the feasibility and effects of CW-FIT MS Tier 1 implementation in nine middle level school classes using a single-subject ABAB withdrawal design. Participants were 234 students in grades 6-8, including 23 identified as at risk for emotional behavioral disorders. Results of CW-FIT MS Tier 1 implementation showed significant improvement in on-task behavior for groups as well as individual target students, increased teacher praise-to-reprimand ratios, and decreased target student disruptions. Outcomes of social validity surveys were consistent with earlier studies. Study findings extend previous results by demonstrating positive intervention effects in novel settings with a greater number of participants. Study limitations and areas for future research are discussed.
Reviews of Individual Studies 9-12 3
Building bridges to life after high school: Contemporary career academies and student outcomes. (2019)
Reviews of Individual Studies 9-12 3
Effectiveness of &quot;Enhanced Units&quot;: A Report of a Randomized Experiment in California and Virginia. Research Report (2019)
Empirical Education Inc. is the independent evaluator of SRI International's 2014 Investing in Innovation (i3) Development grant called Redesigning Secondary Courses to Improve Academic Outcomes for Adolescents with Disabilities and Other Underperforming Adolescents. The goal of the grant is to develop "Enhanced Units" that combine research-based content enhancement routines, collaboration strategy, and technology components for secondary U.S. History and biology classes. This report presents findings of a randomized control trial (RCT) during the 2017-18 school year. The RCT measured the impact of "Enhanced Units" on higher order content skills (as measured through unit tests) in high school biology and U.S. History classes in three districts in Virginia and California. SRI, the Center for Applied Special Education Technology (CAST), and their research and practitioner partners developed "Enhanced Units" (EU) with the goal of integrating research-based content enhancement routines with technological enhancements to improve student content learning and higher order reasoning, especially for students with disabilities or other learning challenges. This study also documents the extent to which the core components of EU were implemented with fidelity. The authors provide descriptive results on classroom practices (as measured by teacher surveys) and contextual factors that support or hinder implementation (as described during teacher interviews). Future improvements to EU should focus on answering the question: "What is/are the best way(s) for teachers to present SIM routines to their students, particularly for students with learning challenges through SIM intervention?"
Reviews of Individual Studies 9-12 3
Early College, Continued Success: Longer-Term Impact of Early College High Schools (2019)
Building on a previous randomized experiment of the impact of Early Colleges (ECs) (Berger et al., 2013), this follow-up study assessed longer-term impacts of ECs on students' postsecondary outcomes 6 years after expected high school graduation. It also explored the extent to which students' high school experiences mediate EC impacts. Specifically, this study addressed three research questions: (1) Did EC students have better postsecondary outcomes (i.e., college enrollment and degree attainment) than control students? (2) Did the impacts of ECs vary by student background characteristics (i.e., gender, race/ethnicity, low-income status, and prior mathematics and English language arts [ELA] achievement)? and (3) Were the impacts of ECs mediated by students' high school experiences (i.e., college credit accrual during high school, instructional rigor, college-going culture, and student supports)? To answer these questions for the follow-up study, the authors analyzed 4 more years of postsecondary outcome data from the StudentTracker Service at the National Student Clearinghouse for students participating in the EC admission lotteries that were the basis of the previous impact study. They also analyzed data on student background characteristics from administrative records and data on high school experiences from a student survey administered in the previous impact study 5 or 6 years after students entered the ninth grade. [To view the earlier report, "Early College, Early Success: Early College High School Initiative Impact Study," see ED577243.]
Reviews of Individual Studies 9-10 3
Brief Prompting to Improve Classroom Behavior: A First-Pass Intervention Option (2019)
Two studies were conducted to examine the effects of a brief prompting intervention (verbal and visual reminder of classroom rules) to improve classroom behavior for an elementary student during small-group reading instruction in a special education classroom (Study 1) and for three high school students with mild disabilities in an inclusive general education classroom (Study 2). Using within-participant reversal designs, the teachers provided brief reminders of behavioral expectations just before class. Teachers were instructed to respond to the students' appropriate and inappropriate behaviors in a typical manner to ensure no programmed changes in the contingencies for student behavior. Results indicated improvements in classroom behavior for all four students, and teachers and students indicated positive perceptions about the intervention and its effects. Implications for future research and practice are discussed.
Reviews of Individual Studies 4-5 3
Replication of an Experimental Study Investigating the Efficacy of a Multisyllabic Word Reading Intervention with and without Motivational Beliefs Training for Struggling Readers (2019)
This randomized control trial examined the efficacy of an intervention aimed at improving multisyllabic word reading (MWR) skills among fourth- and fifth-grade struggling readers (n = 109, 48.6% male), as well as the relative effects of an embedded motivational beliefs training component. This study was a closely aligned replication of our earlier work. The intervention was replicated with a three-condition design: MWR only, MWR with a motivational beliefs component, and business-as-usual control. Students were tutored in small groups for 40 lessons (four 40-min lessons each week). When we combined performance of students in both MWR conditions, intervention students significantly outperformed controls on proximal measures of affix reading and MWR, as well as standardized measures of decoding, spelling, and text comprehension. Furthermore, there was a noted interaction between English learner status and treatment on spelling performance. There were no statistically significant main effects between the MWR groups on proximal or standardized measures of interest. Findings are discussed in terms of their relevance to MWR instruction for students with persistent reading difficulties and considerations for future research related to the malleability of motivation.
Reviews of Individual Studies 5 3
The Effects of Tootling via ClassDojo on Student Behavior in Elementary Classrooms (2019)
The current study was designed to evaluate the effects of a tootling intervention, in which students report on peers' appropriate behavior, modified to incorporate ClassDojo technology, on class-wide disruptive behavior and academically engaged behavior. An A-B-A-B withdrawal design was used to evaluate the effects of the intervention in 3 fifth-grade classrooms. Student-produced tootles were recorded using the ClassDojo website and displayed to students via projector. Reinforcement for tootling was provided through an interdependent group contingency based on the number of tootles produced. Results indicated substantial and meaningful decreases in class-wide disruptive behaviors and increases in academically engaged behaviors during intervention phases compared to baseline and withdrawal phases across all three classrooms. Limitations, implications for practice, and directions for future research are discussed.
Reviews of Individual Studies 6 3
Improving Fraction Understanding in Sixth Graders with Mathematics Difficulties: Effects of a Number Line Approach Combined with Cognitive Learning Strategies (2019)
The effectiveness of an experimental middle school fraction intervention was evaluated. The intervention was centered on the number line and incorporated key principles from the science of learning. Sixth graders (N = 51) who struggled with fraction concepts were randomly assigned at the student level to the experimental intervention (n = 28) or to a business-as-usual control who received their school's intervention (n = 23). The experimental intervention occurred over 6 weeks (27 lessons). Fraction number line estimation, magnitude comparisons, concepts, and arithmetic were assessed at pretest, posttest, and delayed posttest. The experimental group demonstrated significantly more learning than the control group from pretest to posttest, with meaningful effect sizes on measures of fraction concepts (g = 1.09), number line estimation as measured by percent absolute error (g = -0.85), and magnitude comparisons (g = 0.82). These improvements held at delayed posttest 7 weeks later. Exploratory analyses showed a significant interaction between classroom attentive behavior and intervention group on fraction concepts at posttest, suggesting a buffering effect of the experimental intervention on the normally negative impact of low attentive behavior on learning. A number line-centered approach to teaching fractions that also incorporates research-based learning strategies helps struggling learners to make durable gains in their conceptual understanding of fractions. [This paper will be published in the "Journal of Educational Psychology."]
Reviews of Individual Studies 3 3
The Role of Pre-Algebraic Reasoning within a Word-Problem Intervention for Third-Grade Students with Mathematics Difficulty (2019)
Students in the elementary grades often experience difficulty setting up and solving word problems. Using an equation to represent the structure of the problem serves as an effective tool for solving word problems, but students may require specific pre-algebraic reasoning instruction about the equal sign as a relational symbol to set up and solve such equations successfully. We identified students with mathematics difficulty (n = 138) from a sample of 916 third-grade students. We randomly assigned students to a word-problem intervention with a pre-algebraic reasoning component, a word-problem intervention without pre-algebraic reasoning, or the business-as-usual. Students in the 2 active intervention conditions participated in 45 individual sessions and learned about 3 additive word-problem schemas. Students who received word-problem intervention with a pre-algebraic reasoning component demonstrated improved nonstandard equation solving, equal sign understanding, and word-problem solving compared to students in the other two conditions. [The paper will be published in "ZDM Mathematics Education."]
Reviews of Individual Studies 3 3
Relational Scaffolding Enhances Children&apos;s Understanding of Scientific Models (2019)
Models are central to the practice and teaching of science. Yet people often fail to grasp how scientific models explain their observations of the world. Realizing the explanatory power of a model may require aligning its relational structure to that of the observable phenomena. The present research tested whether "relational scaffolding"--guided comparisons between observable and modeled events--enhances children's understanding of scientific models. We tested relational scaffolding during instruction about the day-night cycle, a topic that involves relating "Earth-based" observations to a "space-based" model of Earth rotation. Experiment 1 found that 3rd graders (N = 108) learned more from instruction that incorporated relational scaffolding. Experiment 2 (N = 99) found that guided comparison--not merely viewing observable and modeled events--is a critical component of relational scaffolding, especially for children with low initial knowledge. Relational scaffolding could be applied broadly to assist the many students who struggle with science. [This is the in press version of an article to be published in "Psychological Science."]
Reviews of Individual Studies 4-5 3
Effects of Fourth- and Fifth-Grade Super Solvers Intervention on Fraction Magnitude Understanding and Calculation Skill (2019)
Reviews of Individual Studies 4-5 3
Effects of Fourth- and Fifth-Grade Super Solvers Intervention on Fraction Magnitude Understanding and Calculation Skill (2019)
Reviews of Individual Studies 4-5 3
Efficacy of a Word- and Text-Based Intervention for Students with Significant Reading Difficulties (2019)
We examine the efficacy of an intervention to improve word reading and reading comprehension in fourth- and fifth-grade students with significant reading problems. Using a randomized control trial design, we compare the fourth- and fifth-grade reading outcomes of students with severe reading difficulties who were provided a researcher-developed treatment with reading outcomes of students in a business-as-usual (BAU) comparison condition. A total of 280 fourth- and fifth-grade students were randomly assigned within school in a 1:1 ratio to either the BAU comparison condition (n = 139) or the treatment condition (n = 141). Treatment students were provided small-group tutoring for 30 to 45 minutes for an average of 68 lessons (mean hours of instruction = 44.4, SD = 11.2). Treatment students performed statistically significantly higher than BAU students on a word reading measure (effect size [ES] = 0.58) and a measure of reading fluency (ES = 0.46). Though not statistically significant, effect sizes for students in the treatment condition were consistently higher than BAU students for decoding measures (ES = 0.06, 0.08), and mixed for comprehension (ES = -0.02, 0.14).
Reviews of Individual Studies 4 3
Does an integrated focus on fractions and decimals improve at-risk students’ rational number magnitude performance? (2019)
Reviews of Individual Studies 4 3
Does an integrated focus on fractions and decimals improve at-risk students’ rational number magnitude performance? (2019)
Reviews of Individual Studies 6 3
A Fraction Sense Intervention for Sixth Graders with or at Risk for Mathematics Difficulties (2018)
The efficacy of a research-based fraction sense intervention for sixth graders with or at risk for mathematics difficulties (N = 52) was examined. The intervention aimed to build understanding of fraction magnitudes on the number line. Key concepts were taught with a narrow range of denominators to develop deep understanding. The intervention was centered on a visual number line in the meaningful context of a color run race. Students were randomly assigned to the fraction sense intervention (n = 25) or a business-as-usual control group (n = 27). Students in the intervention condition received 21 lessons in small groups (45 min each) during their regular mathematics intervention period. Students in the intervention group performed significantly better than those in the control group on a measure of fraction number line estimation and a more general measure of fraction concepts, both at immediate posttest and delayed posttest, with large effect sizes; lesser effects were shown for fraction arithmetic. [This paper will be published in "Remedial and Special Education."]
Reviews of Individual Studies 5 3
Impact of a Tier 2 Fractions Intervention on Fifth-Grade Students&apos; Fractions Achievement: A Technical Report (2018)
The goal of this randomized controlled trial (RCT) was to evaluate the effectiveness of a small-group intervention in fractions for fifth-graders who are performing below grade level in mathematics. The impact of the fractions intervention was assessed on fifth-grade at-risk students' understanding of foundational fractions concepts and procedural competence with fractions. For the fractions intervention, lessons from the "TransMath"® curriculum (Level 2; Woodward & Stroh, 2015) were modified to create 52 thirty-five-minute lessons focused only on fourth- and fifth-grade level fractions content that could be used in a small-group setting. In this rigorous large-scale RCT, a sample of 1,123 students from three school districts across two U.S. states were screened at the beginning of the school year using a fractions measure developed by the research team. Two hundred and five students who scored between the 15th and the 37th percentile on the screening measure and received parental consent to participate were randomly assigned to the intervention (n = 102) and comparison (n = 103) conditions. Students in the fractions intervention condition received 35-minute tutoring sessions 3-4 times a week. Fraction instruction using the 52 "TransMath" lessons was provided by trained tutors. The comparison condition (n = 103) was business as usual instruction (i.e., core classroom fractions instruction, including intervention or support traditionally provided by the school). Results from the final analytic sample of 186 students (87 in intervention, 99 in comparison) showed that the intervention group significantly outperformed the comparison group on all outcome measures, which included an array of assessments used to measure both student understanding of foundational fractions concepts as well as procedural competence with grade-level fraction material (Hedges' g = 0.66 to 1.08; p < 0.0001).
Reviews of Individual Studies 9-12 3
Evaluation of Learning by Making i3 Project: STEM Success for Rural Schools (2018)
The Learning by Making (LbyM) project is funded by the U.S. Department of Education's Investing in Innovation Fund (i3). As a five-year development project (2014-2018), Sonoma State University (SSU), in partnership with high-need schools and districts, has been developing an innovative, integrated high school Science, Technology, Engineering, and Mathematics (STEM) curriculum. The curriculum consists of Disciplinary Core Ideas (DCIs) in earth science and biology as described in the Next Generation Science Standards (NGSS, 2013) and utilizes an easy-to-use Logo programming language that conducts data transfer and network communications in support of student-designed investigations. The purpose of this study is to understand how LbyM is implemented in high school classrooms in rural environments, to observe the influences of this curriculum on student learning and engagement, and to explore how teachers' instructional practices and technological capacities evolve while using the curriculum. The study used a quasi-experimental design. One hundred thirty-seven students were recruited to enroll in eight LbyM STEM classes in six participating high schools. Three of the participating high schools are small schools, and it is not possible to find comparison students from these small schools. Therefore, all comparison students were recruited from the larger schools, with a total of 141 comparison students from six classrooms in three out of six participating high schools. The results from the study indicated that the LbyM curriculum that was developed by SSU helped teachers integrate NGSS and project-based learning into classroom instruction. Teachers reported spending more instructional time supporting students to collect, organize, display, and present data. Students were highly engaged with the LbyM curriculum and demonstrated increased confidence and problem solving stamina. Teachers reported that some students who typically struggle to participate in class exhibited higher levels of participation in LbyM and even demonstrated leadership. They also reported that some students with special needs, while still requiring extra attention, remained engaged with the curriculum and were even quicker to complete certain activities than the other students. The LbyM curriculum was positively associated with significant gains in students' science content knowledge. It helped low-achieving students improve math understanding.
Reviews of Individual Studies 6-7 3
Word Knowledge and Comprehension Effects of an Academic Vocabulary Intervention for Middle School Students (2018)
This article presents findings from an intervention across sixth and seventh grades to teach academic words to middle school students. The goals included investigating a progression of outcomes from word knowledge to comprehension and investigating the processes students use in establishing word meaning. Participants in Year 1 were two sixth-grade reading teachers and 105 students (treatment n = 62; control n = 43) and in Year 2, one seventh-grade reading teacher and 87 students (treatment n = 44; control n = 43) from the same public school. In both years, results favored instructed students in word knowledge, lexical access, and morphological awareness on researcher-designed measures. In Year 2, small advances were also found for comprehension. Transcripts of lessons shed light on processes of developing representations of unfamiliar words.
Reviews of Individual Studies 1 3
Summary of Outcomes from First Grade Study with &quot;Read, Write, and Type&quot; and &quot;Auditory Discrimination in Depth&quot; Instruction and Software with At-Risk Children. FCRR Technical Report #2 (2018)
The purpose of this study was to examine the relative effectiveness of two computer supported approaches to teaching beginning reading skills that differed in important aspects of their instructional approach and emphasis. One of the programs was "Auditory Discrimination in Depth," which provides very explicit instruction and practice in acquiring phonological awareness and phonemic decoding skills. In this program, children spend a lot of time practicing word reading skills out of context, but they also read phonetically controlled text in order to learn how to apply their word reading skills to passages that convey meaning. The other program was "Read, Write, and Type," which provides explicit instruction and practice in phonological awareness, letter sound correspondences, and phonemic decoding, but does so primarily in the context of encouraging children to express themselves in written language. In this program, children spend a greater proportion of their time processing meaningful written material, and they are encouraged to acquire "phonics" knowledge to enable written communication. All the first grade children in five elementary schools were initially screened using a test of letter-sound knowledge. Selection procedures identified 18% of children as the most at risk in these schools to develop problems in learning to read. These 104 children were randomly assigned to the ADD group, and the RWT group. Children were seen from October through May in groups of three children. The children received four, 50 minute sessions per week during this time. Approximately half the time in each instructional session was devoted to direct instruction by a trained teacher in skills and concepts that would be practiced on the computer. The big surprise here was how well everyone did. Particularly in phonemic reading skills, the children in both groups showed very large gains (two full standard deviations) in this area, and their gains in fluency were almost as strong as those for accuracy. The results are encouraging for both intervention programs. It is also important to note that the reading comprehension scores were higher than expected based on the children's estimated general verbal ability.
Reviews of Individual Studies 11 3
The Effectiveness of a Teacher Delivered Mindfulness-Based Curriculum on Adolescent Social-Emotional and Executive Functioning (2018)
Reviews of Individual Studies 1-5 3
Tactile Prompting and Weekly Performance Feedback for Increasing Teachers&apos; Behavior-Specific Praise (2018)
The school-based consultation literature includes a variety of empirically supported procedures for increasing teachers' implementation of classroom management strategies. However, teachers may respond differently to empirically supported consultation procedures. This study used a multiple baseline design across three elementary teachers to test the effects of a tactile prompting and weekly performance feedback consultation procedure for increasing teachers' behavior-specific praise. Additionally, this study included data for teachers' rate of reprimands and their classrooms' appropriately engaged behavior and disruptive behavior. Results indicated that tactile prompting and weekly performance feedback increased behavior-specific praise for all three teachers. However, a functional relation between tactile prompting and weekly performance feedback and changes in teachers' reprimands and their classrooms' appropriately engaged and disruptive behavior was not established. Implications for applied practice, and limitations and directions for future research are discussed.
Reviews of Individual Studies 3 3
Empowering Teachers with Low-Intensity Strategies to Support Instruction: Within-Activity Choices in Third-Grade Math with Null Effects (2018)
Instructional choice is a low-intensity strategy that can improve academic engagement. In this study, we investigated the effects of within-activity choices offered during math by third-grade teachers to participating students with behavioral and academic needs. We utilized a professional development model to train teachers to implement instructional choice in the classroom while collecting direct observation data on student's academic engagement. Teachers were able to implement practices with high levels of integrity and collect momentary time sampling data on one student with high levels of reliability. Using a withdrawal design, we found no clear functional relation between instructional choice and increases in student's academic engagement. However, some students demonstrated an increase in level upon the introduction of the intervention. Both teachers and students rated the intervention goals, procedures, and outcomes as acceptable. Possible reasons for a lack of treatment effect on student academic engagement are discussed.
Reviews of Individual Studies K-6 3
Class-Wide Function-Related Intervention Teams (CW-FIT): Student and Teacher Outcomes from a Multisite Randomized Replication Trial (2018)
The purpose of the study was to conduct a randomized controlled trial (RCT) to demonstrate efficacy of the Class-wide Function-Related Intervention Teams (CW-FIT) program. The study was designed to replicate an initial RCT conducted by the CW-FIT developers in 1 site, with 2 additional research groups not involved in its development. The study was conducted across 3 states, in 21 culturally diverse schools, and with 83 teachers (classrooms) assigned to CW-FIT and 74 teachers (classrooms) assigned to the comparison group. The CW-FIT intervention included teaching prosocial skills and use of differential attention (teacher praise and points) for appropriate behaviors using a group contingency, class teams, goal setting, points, and rewards. Class-wide student on-task behavior improved, teacher praise and attention to appropriate behaviors increased, and reprimands decreased in the CW-FIT classes with significantly fewer changes over time for the comparison group.
Reviews of Individual Studies K-8 3
Promoting Cultural Responsivity and Student Engagement through Double Check Coaching of Classroom Teachers: An Efficacy Study (2018)
This article presents findings from a randomized controlled trial (RCT) testing the impact of a novel coaching approach utilized as one element of the Double Check cultural responsivity and student engagement model. The RCT included 158 elementary and middle school teachers randomized to receive coaching or serve as comparisons; all participating teachers were exposed to school-wide professional development activities. Pre-post nonexperimental comparisons indicated improvements in self-reported culturally responsive behavior management and self-efficacy for teachers in both conditions following professional development exposure. With regard to the experimental findings, trained observers recorded significantly more proactive behavior management and anticipation of student problems by teachers, higher student cooperation, less student noncooperation, and fewer disruptive behaviors in classrooms led by coached teachers relative to comparison teachers. Taken together, the findings suggest the potential promise of coaching combined with school-wide professional development for improving classroom management practices and possibly reducing office discipline referrals among Black students.
Reviews of Individual Studies K-2 3
SPARK Early Literacy: Testing the Impact of a Family-School-Community Partnership Literacy Intervention (2018)
This report presents the SPARK literacy model, an innovative approach developed by Boys & Girls Clubs of Greater Milwaukee, for addressing the literacy needs of low-income and minority schools in Milwaukee. It also presents the results of a two-year randomized control trial evaluation of the SPARK literacy program's impact on reading achievement. Through a family-school-community partnership model, SPARK attempts to both build student literacy skills and develop natural supports in the student's family and community that promote a sustained programmatic impact. SPARK was awarded an Investing in Innovation (i3) Department of Education grant to develop the program and test its impact in six Milwaukee Public Schools (MPS). While SPARK was still being developed, 251 students were randomly assigned to receive SPARK for two years and 245 were assigned to the "business as usual" control condition. The study found that SPARK had a small but statistically significant positive impact on student reading achievement, but no impact was found on regular school day attendance. Although the results of the study were somewhat mixed, the family-school-community partnership approach employed by SPARK holds great promise for having a sustained impact on student literacy.
Reviews of Individual Studies K-1 3
Feasibility of and Teacher Preference for Student-Led Implementation of the Good Behavior Game in Early Elementary Classrooms (2018)
The Good Behavior Game (GBG) is a classwide group contingency shown to reduce disruptive student behavior. We examined the feasibility of training young students to lead the GBG in one first-grade and three kindergarten classes. We also examined teacher preference for teacher-led GBG, student-led GBG, or no GBG using a concurrent chains procedure. We successfully trained students in all classes to lead the GBG, and the GBG reduced disruptive behavior regardless of who implemented it. Preference for who implemented the game varied across teachers. Results of this study suggest that students as young as kindergarten age can be trained to implement the GBG and that teacher preference should be taken into account when determining how classwide interventions are to be implemented.
Reviews of Individual Studies K-1 3
The Effect of e-Book Vocabulary Instruction on Spanish-English Speaking Children (2018)
Purpose: This study aimed to examine the effect of an intensive vocabulary intervention embedded in e-books on the vocabulary skills of young Spanish-English speaking English learners (ELs) from low-socioeconomic status backgrounds. Method: Children (N = 288) in kindergarten and 1st grade were randomly assigned to treatment and read-only conditions. All children received e-book readings approximately 3 times a week for 10-20 weeks using the same books. Children in the treatment condition received e-books supplemented with vocabulary instruction that included scaffolding through explanations in Spanish, repetition in English, checks for understanding, and highlighted morphology. Results: There was a main effect of the intervention on expressive labeling (g = 0.38) and vocabulary on the Peabody Picture Vocabulary Test--Fourth Edition (g = 0.14; Dunn & Dunn, 2007), with no significant moderation effect of initial Peabody Picture Vocabulary Test score. There was no significant difference between conditions on children's expressive definitions. Conclusion: Findings substantiate the effectiveness of computer-implemented embedded vocabulary intervention for increasing ELs' vocabulary knowledge.
Reviews of Individual Studies K-1 3
Effects of the Good Behavior Game on individual student behavior (2017)
Reviews of Individual Studies K-3 3
The Efficacy of Conjoint Behavioral Consultation in the Home Setting: Outcomes and Mechanisms in Rural Communities (2017)
This study reports the results of a randomized controlled trial examining the effect of Conjoint Behavioral Consultation (CBC), a family-school partnership intervention, on children's behaviors, parents' skills, and parent-teacher relationships in rural community and town settings. Participants were 267 children, 267 parents, and 152 teachers in 45 Midwestern schools. Using an Intent to Treat approach and data analyzed within a multilevel modeling framework, CBC yielded promising results for some but not all outcomes. Specifically, children participating in CBC experienced decreases in daily reports of aggressiveness, noncompliance, and temper tantrums; and increases in parent-reported adaptive skills and social skills at a significantly greater pace than those in a control group. Other outcomes (e.g., parent reports of internalizing and externalizing behaviors) suggested a nonsignificant effect at post-test. CBC parents reported using more effective parenting strategies, gaining more competence in their problem-solving practices, and feeling more efficacious for helping their child succeed in school than parents in the control group. Parents participating in CBC also reported significant improvements in the parent-teacher relationship, and the parent-teacher relationship mediated the effect of CBC on children's adaptive skills. Implications for practice in rural communities, study limitations, and directions for future research are discussed. [This article was published in "Journal of School Psychology" v62 p81-101 2017.]
Reviews of Individual Studies 2-4 3
The Effects of Dialect Awareness Instruction on Nonmainstream American English Speakers (2017)
The achievement gaps between poor and more affluent students are persistent and chronic, as many students living in poverty are also members of more isolated communities where dialects such as African American English and Southern Vernacular English are often spoken. Non-mainstream dialect use is associated with weaker literacy achievement. The principal aims of the two experiments described in this paper were to examine whether second through fourth graders, who use home English in contexts where more formal school English is expected, can be taught to dialect shift between home and school English depending on context; and whether this leads to stronger writing and literacy outcomes. The results of two randomized controlled trials with students within classrooms randomly assigned to DAWS (Dialect Awareness, a program to explicitly teach dialect shifting), editing instruction, or a business as usual group revealed (1) that DAWS was more effective in promoting dialect shifting than instruction that did not explicitly contrast home and school English; and (2) that students in both studies who participated in DAWS were significantly more likely to use school English in contexts where it was expected on proximal and distal outcomes including narrative writing, morphosyntactic awareness, and reading comprehension. Implications for theory and practice are discussed.
Reviews of Individual Studies 2-4 3
The Effects of Dialect Awareness Instruction on Non-Mainstream American English Speakers (2017)
Reviews of Individual Studies 2-3 3
Efficacy of Peer-Mediated Incremental Rehearsal for English Language Learners (2017)
School psychologists will likely become more involved in supporting the reading achievement of English language learners (ELLs). This requires evidence-based interventions that are validated for ELL students. Incremental rehearsal (IR) is an evidence-based intervention for teaching words, but the resource intensity often precludes its use. Using peers as interventionists may increase the contextual validity of IR while maintaining the benefits when compared with other drill techniques. This efficacy study examined if (a) peer-mediated IR (PMIR) was effective for teaching ELL students high-frequency words and (b) improvements in word reading generalized to changes in students' oral reading fluency. Five ELL students participated in a randomized multiple-baseline design across participants. Results indicated that PMIR was functionally related to an increase in word reading for all 5 participants. Effect sizes estimated using TauU and multilevel modeling indicated that PMIR had a large effect on sight-word reading. No functional relationship between PMIR and oral reading fluency was observed. PMIR was generally acceptable to target students and peer tutors. Limitations and potential implications of the results are discussed.
Reviews of Individual Studies 10-12 3
Final Report of the Impacts of the National Math + Science Initiative&apos;s (NMSI&apos;s) College Readiness Program on High School Students&apos; Outcomes (2017)
The National Math + Science Initiative's (NMSI's) College Readiness Program (CRP) is an established program whose goal is to promote science, technology, engineering, and mathematics education in high schools to improve students' readiness for college. It provides teacher, student, and school supports to promote high school students' success in mathematics, science, and English Advanced Placement (AP) courses, with a focus on students who are traditionally underrepresented in the targeted AP courses. Through a federal Investing in Innovation Fund (i3) validation grant awarded to NMSI in 2011, CRP was implemented in a total of 58 high schools in two states--Colorado and Indiana--beginning in the 2012-13 school year. American Institutes for Research (AIR) conducted an independent evaluation of the impacts of CRP on students' AP outcomes in these schools for the three cohorts of schools that adopted the program in sequential years, using a comparative interrupted time series (CITS) design that matched comparison schools to program schools in the two states. Overall, schools implementing CRP demonstrated significantly larger increases in the share of students taking and passing AP tests in targeted areas relative to comparison schools in each of the three cohorts of schools, and the gains in CRP schools were sustained over time. Fidelity of program implementation was evaluated using a fidelity matrix approach required as part of the National Evaluation of the i3 program, which showed that not all elements of the program were implemented with high fidelity. Teachers and students were not always able to attend all meetings, and schools did not always meet negotiated enrollment targets. Teacher survey data indicated that teachers found the professional development activities provided by CRP to be the most helpful support they received under CRP, and students reported that the tutoring and special study sessions were the most helpful. Although the program provided financial incentives to both teachers and students that were tied to student performance on AP tests, these incentives were considered the least important element of the program by both teachers and students
Reviews of Individual Studies 1-4 3
Use of a Technology-Enhanced Version of the Good Behavior Game in an Elementary School Setting (2017)
The purpose of this study was to investigate the effectiveness of a variation of the Good Behavior Game (GBG) in which teachers used ClassDojo to manage each team's progress. ClassDojo is a computer-based program that enables teachers to award students with points for demonstrating target behaviors. Dependent variables included class-wide disruptive and academically engaged behavior, teachers' ratings on the Behavior Intervention Rating Scale (BIRS), and the rate of teacher praise statements delivered in each phase. Overall, results indicated that the GBG with ClassDojo was effective at reducing disruptive behavior, increasing academically engaged behavior, and was rated as socially valid. Additionally, when the intervention was in place, increases in the amount of behavior-specific praise statements delivered were observed across all three classrooms.
Reviews of Individual Studies 1-4 3
Impact of Intensive Summer Reading Intervention for Children with Reading Disabilities and Difficulties in Early Elementary School (2017)
Efficacy of an intensive reading intervention implemented during the nonacademic summer was evaluated in children with reading disabilities or difficulties (RD). Students (ages 6-9) were randomly assigned to receive Lindamood-Bell's "Seeing Stars" program (n = 23) as an intervention or to a waiting-list control group (n = 24). Analysis of pre- and posttesting revealed significant interactions in favor of the intervention group for untimed word and pseudoword reading, timed pseudoword reading, oral reading fluency, and symbol imagery. The interactions mostly reflected (a) significant declines in the nonintervention group from pre- to posttesting, and (2) no decline in the intervention group. The current study offers direct evidence for widening differences in reading abilities between students with RD who do and do not receive intensive summer reading instruction. Intervention implications for RD children are discussed, especially in relation to the relevance of summer intervention to prevent further decline in struggling early readers.
Reviews of Individual Studies 1 3
A Randomized Control Trial of Working Memory Training with and without Strategy Instruction: Effects on Young Children's Working Memory and Comprehension (2017)
Researchers are increasingly interested in working memory (WM) training. However, it is unclear whether it strengthens comprehension in young children who are at risk for learning difficulties. We conducted a modest study of whether the training of verbal WM would improve verbal WM and passage listening comprehension and whether training effects differed between two approaches: training with and without strategy instruction. A total of 58 first-grade children were randomly assigned to three groups: WM training with a rehearsal strategy, WM training without strategy instruction, and controls. Each member of the two training groups received a one-to-one, 35-min session of verbal WM training on each of 10 consecutive school days, totaling 5.8 hr. Both training groups improved on trained verbal WM tasks, with the rehearsal group making greater gains. Without correction for multiple group comparisons, the rehearsal group made reliable improvements over controls on an untrained verbal WM task and on passage listening comprehension and listening retell measures. The no-strategy-instruction group outperformed controls on passage listening comprehension. When corrected for multiple contrasts, these group differences disappeared but were associated with moderate to large effect sizes. Findings suggest--however tentatively--that brief but intensive verbal WM training may strengthen the verbal WM and comprehension performance of young children at risk. Necessary caveats and possible implications for theory and future research are discussed.
Reviews of Individual Studies 6-8 3
Overcoming the Research-to-Practice Gap: A Randomized Trial With Two Brief Homework and Organization Interventions for Students With ADHD as Implemented by School Mental Health Providers (2017)
Reviews of Individual Studies 6-8 3
Overcoming the Research-to-Practice Gap: A Randomized Trial with Two Brief Homework and Organization Interventions for Students with ADHD as Implemented by School Mental Health Providers (2017)
Objective: To evaluate the effectiveness of 2 brief school-based interventions targeting the homework problems of adolescents with attention-deficit/hyperactivity disorder (ADHD)--the Homework, Organization, and Planning Skills (HOPS) intervention and the Completing Homework by Improving Efficiency and Focus (CHIEF) intervention, as implemented by school mental health providers during the school day. A secondary goal was to use moderator analyses to identify student characteristics that may differentially predict intervention response. Method: Two-hundred and eighty middle school students with ADHD were randomized to the HOPS or CHIEF interventions or to waitlist, and parent and teacher ratings were collected pre, post, and at a 6-month follow-up. Results: Both interventions were implemented with fidelity by school mental health providers. Participants were pulled from elective periods and sessions averaged less than 20 min. Participants in HOPS and CHIEF demonstrated significantly greater improvements in comparison with waitlist on parent ratings of homework problems and organizational skills and effect sizes were large. HOPS participants also demonstrated moderate effect size improvements on materials management and organized action behaviors according to teachers. HOPS participants made significantly greater improvements in parent- and teacher-rated use of organized actions in comparison with CHIEF, but not on measures of homework problems. Moderation analyses revealed that participants with more severe psychopathology and behavioral dysregulation did significantly better with the HOPS intervention as compared to the CHIEF intervention. Conclusions: Brief school-based interventions implemented by school providers can be effective. This type of service delivery model may facilitate overcoming the oft cited research-to-practice gap. [At the time of submission to ERIC, this article was in press with "Journal of Consulting and Clinical Psychology."]
Reviews of Individual Studies 7-12 3
Reducing Achievement Gaps in Academic Writing for Latinos and English Learners in Grades 7-12 (2017)
This study reports 2 years of findings from a randomized controlled trial designed to replicate and demonstrate the efficacy of an existing, successful professional development program, the Pathway Project, that uses a cognitive strategies approach to text-based analytical writing. Building on an earlier randomized field trial in a large, urban, low socioeconomic status (SES) district in which 98% of the students were Latino and 88% were mainstreamed English learners (ELs) at the intermediate level of fluency, the project aimed to help secondary school students, specifically Latinos and mainstreamed ELs, in another large, urban, low-SES district to develop the academic writing skills called for in the rigorous Common Core State Standards for English Language Arts. The Pathway Project draws on well-documented instructional frameworks that support approaches that incorporate strategy instruction to enhance students' academic literacy. Ninety-five teachers in 16 secondary schools were stratified by school and grade and then randomly assigned to the Pathway or control group. Pathway teachers participated in 46 hr of training to help students write analytical essays. Difference-in-differences and regression analyses revealed significant effects on student writing outcomes in both years of the intervention (Year 1, d = 0.48; Year 2, d = 0.60). Additionally, Pathway students had higher odds than control students of passing the California High School Exit Exam in both years.
Reviews of Individual Studies 7-8 3
Evaluation of a positive version of the Good Behavior Game utilizing ClassDojo technology in secondary classrooms (2017)
Reviews of Individual Studies 6 3
The Effects of a Comprehensive Reading Program on Reading Outcomes for Middle School Students with Disabilities (2017)
Reading achievement scores for adolescents with disabilities are markedly lower than the scores of adolescents without disabilities. For example, 62% of students with disabilities read "below" the basic level on the NAEP Reading assessment, compared to 19% of their nondisabled peers. This achievement gap has been a continuing challenge for more than 35 years. In this article, we report on the promise of a comprehensive 2-year reading program called Fusion Reading. Fusion Reading is designed to significantly narrow the reading achievement gap of middle school students with reading disabilities. Using a quasi-experimental design with matched groups of middle school students with reading disabilities, statistically significant differences were found between the experimental and comparison conditions on multiple measures of reading achievement with scores favoring the experimental condition. The effect size of the differences were Hedges's g = 1.66 to g = 1.04 on standardized measures of reading achievement.
Reviews of Individual Studies 4-5 3
Progress Monitoring Using Direct Behavior Rating Single Item Scales in a Multiple-Baseline Design Study of the Daily Report Card Intervention (2017)
Direct behavior rating (DBR) may be a viable assessment for documenting current areas of impaired functioning and progress monitoring students' response to a behavioral intervention. Challenging behaviors are often addressed in general education settings using interventions such as the daily report card (DRC). To best implement and monitor such interventions, effective progress monitoring tools are needed. The present study reports on the results of a multiple-baseline design across three elementary school children who had a DRC implemented to address academic engagement and social behaviors. The DRC and systematic direct observation (SDO) were compared with teacher-completed DBR to investigate the correspondence between these two measures of progress monitoring. Relative to SDO, results indicated that DBR was generally an effective means of monitoring progress for most cases and most target behaviors. The results of the present study support using DBR to monitor progress following the use of a behavioral intervention such as the DRC.
Reviews of Individual Studies 5 3
A Single-Subject Study of a Technology-Based Self-Monitoring Intervention (2016)
Students with ADHD often struggle with self-regulation skills. One strategy demonstrating considerable success in helping these students regulate their behavior is self-monitoring. Although there is an abundance of research on self-monitoring, research on the use of technology for self-monitoring is only beginning to emerge. The primary goal of this single-subject study was to examine the effects of an iPad application ("SCORE IT") for self-monitoring on the behavior of three fifth-grade students with or at risk for ADHD who were exhibiting low rates of academic engagement in a general education environment. A secondary goal was to gain an in-depth understanding of the teacher's perceptions of the feasibility and value of the intervention. Overall, the "SCORE IT" intervention resulted in substantial improvements in academic engagement, and teacher perceptions of the feasibility and worth of the intervention were reported as highly favorable. Limitations and future directions for research are discussed.
Reviews of Individual Studies 4 3
Effects of Intervention to Improve At-Risk Fourth Graders&apos; Understanding, Calculations, and Word Problems with Fractions (2016)
The purposes of this study were to (a) investigate the efficacy of a core fraction intervention program on understanding and calculation skill and (b) isolate the effects of different forms of fraction word-problem (WP) intervention delivered as part of the larger program. At-risk 4th graders (n = 213) were randomly assigned at the individual level to receive the school's business-as-usual program or 1 of 2 variants of the core fraction intervention (each 12 weeks, 3 sessions/week). In each session of the 2 variants, 28 min were identical, focused mainly on the measurement interpretation of fractions. The other 7 min addressed fraction WPs: multiplicative WPs versus additive WPs. Children were pre- and posttested on fraction understanding, calculations, and WPs. On understanding and calculations, both intervention conditions outperformed the control group, and the effect of intervention versus control on released fraction items from the National Assessment of Education Progress were mediated by children's improvement in the measurement interpretation of fractions. On multiplicative WPs, multiplicative WP intervention was superior to the other 2 conditions, but additive WP intervention and the control group performed comparably. By contrast, on additive WPs, there was a step-down effect in which additive WP intervention was superior to multiplicative WP intervention, which was superior to control. [This paper was published in "Elementary School Journal," v116 n4 p625-661 Jun 2016 (EJ1103953).]
Reviews of Individual Studies 4 3
Effects of Intervention to Improve At-Risk Fourth Graders&apos; Understanding, Calculations, and Word Problems with Fractions (2016)
The purposes of this study were to (a) investigate the efficacy of a core fraction intervention program on understanding and calculation skill and (b) isolate the effects of different forms of fraction word-problem (WP) intervention. At-risk fourth graders (n = 213) were randomly assigned to the school's business-as-usual program, or one of two variants of the core fraction intervention (each 12 weeks, 36 sessions). In each session of the two variants, 28 minutes were identical, focused mainly on the measurement interpretation of fractions. The other 7 minutes addressed multiplicative WPs versus additive WPs. Children were pre-/posttested on fraction understanding, calculations, and WPs. On understanding and calculations, both intervention conditions outperformed the control group. The effect of intervention versus control on released fraction items from the National Assessment of Education Progress was mediated by children's improvement in the measurement interpretation of fractions. On multiplicative WPs, multiplicative WP intervention was superior to the other conditions, but additive WP intervention and the control group performed comparably. On additive WPs, additive WP intervention was superior to multiplicative WP intervention, which was superior to control.
Reviews of Individual Studies 4 3
Supported Self-Explaining during Fraction Intervention (2016)
The main purposes of this study were to test the effects of teaching at-risk 4th graders to provide explanations for their mathematics work and examine whether those effects occur by compensating for limitations in cognitive processes. We randomly assigned 212 children to 3 conditions: a control group and 2 variants of a multicomponent fraction intervention. Both intervention conditions included 36 sessions, each lasting 35 min. All but 7 min of each session were identical. In the 7-min component, students were taught to provide high quality explanations when comparing fraction magnitudes or to solve fraction word problems. Children were pretested on cognitive variables and pre/posttested on fraction knowledge. On accuracy of magnitude comparisons and quality of explanations, children who received the explaining intervention outperformed those in the word-problem condition. On word problems, children who received the word-problem intervention outperformed those in the explaining condition. Moderator analyses indicated that the explaining intervention was more effective for students with weaker working memory, while the word-problem intervention was more effective for students with stronger reasoning ability.
Reviews of Individual Studies 4 3
Supported Self-Explaining during Fraction Intervention (2016)
The main purposes of this study were to test the effects of teaching at-risk 4th graders to provide explanations for their mathematics work and examine whether those effects occur by compensating for limitations in cognitive processes. We randomly assigned 212 children to 3 conditions: a control group and 2 variants of a multicomponent fraction intervention. Both intervention conditions included 36 sessions, each lasting 35 min. All but 7 min of each session were identical. In the 7-min component, students were taught to provide high quality explanations when comparing fraction magnitudes or to solve fraction word problems. Children were pretested on cognitive variables and pre/posttested on fraction knowledge. On accuracy of magnitude comparisons and quality of explanations, children who received the explaining intervention outperformed those in the word-problem condition. On word problems, children who received the word-problem intervention outperformed those in the explaining condition. Moderator analyses indicated that the explaining intervention was more effective for students with weaker working memory, while the word-problem intervention was more effective for students with stronger reasoning ability.
Reviews of Individual Studies 4 3
Supported Self-Explaining during Fraction Intervention (2016)
The main purposes of this study were to test the effects of teaching at-risk 4th graders to provide explanations for their mathematics work and examine whether those effects occur by compensating for limitations in cognitive processes. We randomly assigned 212 children to 3 conditions: a control group and 2 variants of a multicomponent fraction intervention. Both intervention conditions included 36 sessions, each lasting 35 min. All but 7 min of each session were identical. In the 7-min component, students were taught to provide high quality explanations when comparing fraction magnitudes or to solve fraction word problems. Children were pretested on cognitive variables and pre/posttested on fraction knowledge. On accuracy of magnitude comparisons and quality of explanations, children who received the explaining intervention outperformed those in the word-problem condition. On word problems, children who received the word-problem intervention outperformed those in the explaining condition. Moderator analyses indicated that the explaining intervention was more effective for students with weaker working memory, while the word-problem intervention was more effective for students with stronger reasoning ability.
Reviews of Individual Studies 6-8 3
Effects of a Text-Processing Comprehension Intervention on Struggling Middle School Readers (2016)
Purpose: We examined the effects of a text-processing reading comprehension intervention emphasizing listening comprehension and expressive language practices with middle school students with reading difficulties. Method: A total of 134 struggling readers in grades 6-8 were randomly assigned to treatment (n = 83) and control conditions (n = 51) using a 2:1 ratio (two students randomized to treatment for every one student randomized to control). Students in the treatment condition received 40 min of daily instruction in small groups of four to six students for approximately 17 hr. Results: One-way analysis of covariance models on outcome measures with the respective pretest scores as a covariate revealed significant gains on proximal measures of vocabulary and key word and main idea formulation. No significant differences were found on standardized measures of listening and reading comprehension. Discussion: Results provide preliminary support for integrating listening comprehension and expressive language practices within a text-processing reading comprehension intervention framework for middle-grade struggling readers.
Reviews of Individual Studies 1 3
An Examination of the Promise of the NumberShire Level 1 Gaming Intervention for Improving Student Mathematics Outcomes (2016)
The purpose of this study was to test the promise of the NumberShire Level 1 Gaming Intervention (NS1) to accelerate math learning for first-grade students with or at risk for math difficulties. The NS1 intervention was developed through the Institute of Education Sciences, Small Business Innovation Research Program (Gause, Fien, Baker, & Clarke, 2011 Gause, M., Fien, H., Baker, S. K., & Clarke, B. (2011). Project NumberShire I: A game-based integrated learning and assessment system to target whole number concepts. This study used a randomized controlled trial design to test the promise of the NS1 intervention. In total, 250 first-grade students were randomly assigned within classrooms to the treatment condition or a control condition. Results indicate significant effects favoring the treatment group on proximal measures of whole-number concepts and skills. Intervention effects were not statistically significant for distal outcome measures. Treatment effects were not moderated by special education or English learner status; however, the condition by initial skill level interaction approached significance. Additionally, there was no relationship between dosage variables and students' response to the intervention. Limitations and future directions for research are discussed. [This paper was published in "Journal of Research on Educational Effectiveness" (EJ1115268).]
Reviews of Individual Studies 1 3
Introducing an iPad App into Literacy Instruction for Struggling Readers: Teacher Perceptions and Student Outcomes (2016)
There is a critical need, according to national policy statements in the United States, to integrate information and communication technologies into instruction, and yet research about the effect of such integration on the literacy learning of at-risk populations is scant. In addition, barriers exist that prevent teachers from realizing the goal of information and communication technology integration. To address this issue, we conducted a mixed-methods study to investigate the effects of LetterWorks, an iPad app, on the letter learning of 6- to 7-year-old children in an early literacy intervention, Reading Recovery. We present empirical evidence about the effects of the integration of this iPad app into literacy instruction for struggling learners and we describe teachers' perceptions about the affordances and challenges of integrating this app into their instruction. Despite the positive effects of the iPad app on the letter learning of the children in the treatment group, teachers identified a misfit between their beliefs about literacy teaching and learning and the app as a barrier to their continued use. We suggest that the successful uptake of information and communication technologies into literacy instruction may depend, at least in part, on whether and how well training addresses the coherence between the information and communication technology itself and teachers' theories about teaching and learning.
Reviews of Individual Studies 12 3
Customized Nudging to Improve FAFSA Completion and Income Verification (2016)
For most students from low- or moderate-income families, successfully completing the Free Application for Federal Student Aid (FAFSA) is a crucial gateway on the path to college access. However, FAFSA filing and income verification tasks pose substantial barriers to college access for low-income students. In this paper, the authors report on a pair of interventions that utilize automated, text-based outreach to: (1) provide students and families with customized information about the importance of and their status on completing the FAFSA; (2) simplify information for students and families about how to complete the FAFSA; and (3) connect students and families to personalized counseling assistance to complete the FAFSA as well as the subsequent verification process, if selected. Data from the study points to the benefit of text-based outreach as a low-cost and readily scalable strategy for improving student completion of important college-going milestones, such as timely FAFSA filing. Tables and figures are appended.
Reviews of Individual Studies 1 3
The Quiet Classroom Game: A Class-Wide Intervention to Increase Academic Engagement and Reduce Disruptive Behavior (2016)
The current study investigated the effectiveness of the Quiet Classroom Game, an interdependent group contingency using an iPad loaded with a decibel meter app, for increasing academically engaged behavior. Three first-grade classrooms in the southeastern United States, identified as displaying high levels of noise and disruptive behavior, were included in the study. A multiple-baseline design with an embedded ABAB condition sequence was used to evaluate the effect of implementation of the Quiet Classroom Game on academically engaged behavior, disruptive behavior, and classroom decibel level. Implementation of the intervention resulted in large increases in academically engaged behavior, moderate to large reductions in disruptive behavior, and large decreases in classroom noise. Results of social validity checklists administered to teachers and students indicated acceptability and utility of the intervention. Findings of the study suggest that the Quiet Classroom Game may be an effective method for increasing the academically engaged behavior and decreasing the noise and disruptive behavior of first-grade students in a general-education setting.
Reviews of Individual Studies 1 3
Reading Recovery: An evaluation of the four-year i3 scale-up (2016)
This report presents the final results of a four-year independent external evaluation of the impacts and implementation of the scale-up of Reading Recovery, a literacy intervention targeting struggling 1st-grade students. The evaluation of Reading Recovery includes parallel rigorous experimental and quasi-experimental designs for estimating program impacts, coupled with a large-scale, mixed-methods study of program implementation under the Investing in Innovation (i3) scale-up. The primary goals of the evaluation are to: (1) Provide experimental evidence of the short- and long-term impacts of Reading Recovery on student learning in schools that are part of the i3 scale-up; and (2) Assess the implementation of Reading Recovery under the i3 grant, including fidelity to the program model and progress toward the scale-up goals. The impact evaluation includes a multi-site randomized controlled trial (RCT) for estimating immediate impacts, a regression discontinuity study (RD) for estimating longterm impacts, and an implementation study for assessing fidelity of implementation and exploring program implementation in depth. The RCT includes nearly 7,000 randomized students in more than 1,200 schools over four years. The RD study measures Reading Recovery's impacts at the end of first grade and in third grade, and replicates the RCT's immediate post-treatment findings in a separate sample of students. The implementation study involves a combination of qualitative and quantitative research executed on a large scale over the same four-year timeframe. The evaluation's key findings pertain to the following topics: (1) Scale-Up Processes, Challenges, and Outcomes; (2) Immediate Impacts of Reading Recovery; (3) Sustained Impacts of Reading Recovery; and (4) Implementation Fidelity. The authors' analysis revealed strong fidelity to the program model in all of these areas and all years of the scale-up. This suggests that the intervention was delivered as designed to the students in the scale-up, and that teachers delivering Reading Recovery lessons were properly trained. In total, the results of the fidelity analysis support the validity of their impact findings. Three appendices are included. [To view the brief for this report, "Evidence for Early Literacy Intervention: The Impacts of Reading Recovery," see ED586802.]
Reviews of Individual Studies 2-3 3
Effects of Tootling on Classwide and Individual Disruptive and Academically Engaged Behavior of Lower-Elementary Students (2016)
Reviews of Individual Studies 2 3
The Benefits of Computer-Generated Feedback for Mathematics Problem Solving (2016)
The goal of the current research was to better understand when and why feedback has positive effects on learning and to identify features of feedback that may improve its efficacy. In a randomized experiment, second-grade children (N = 75) received instruction on a correct problem-solving strategy and then solved a set of relevant problems. Children were assigned to receive no feedback, immediate feedback, or summative feedback from the computer. On a posttest the following day, feedback resulted in higher scores relative to no feedback for children who started with low prior knowledge. Immediate feedback was particularly effective, facilitating mastery of the material for children with both low and high prior knowledge. Results suggest that minimal computer-generated feedback can be a powerful form of guidance during problem solving.
Reviews of Individual Studies 2 3
The Benefits of Computer-Generated Feedback for Mathematics Problem Solving (2016)
The goal of the current research was to better understand when and why feedback has positive effects on learning and to identify features of feedback that may improve its efficacy. In a randomized experiment, second-grade children (N = 75) received instruction on a correct problem-solving strategy and then solved a set of relevant problems. Children were assigned to receive no feedback, immediate feedback, or summative feedback from the computer. On a posttest the following day, feedback resulted in higher scores relative to no feedback for children who started with low prior knowledge. Immediate feedback was particularly effective, facilitating mastery of the material for children with both low and high prior knowledge. Results suggest that minimal computer-generated feedback can be a powerful form of guidance during problem solving.
Reviews of Individual Studies 2-5 3
A Randomized Controlled Trial of a School-Implemented School-Home Intervention for ADHD Symptoms and Impairment (2016)
Objectives: This study evaluated the efficacy of a novel psychosocial intervention (Collaborative Life Skills, CLS) for primary-school students with ADHD symptoms. CLS is a 12-week program consisting of integrated school, parent, and student treatments delivered by school-based mental health providers. Using a cluster randomized design, CLS was compared to usual school/community services on psychopathology and functional outcomes. Methods: Schools within a large urban public school district were randomly assigned to CLS (12 schools) or usual services (11 schools). Approximately six students participated at each school (N = 135, mean age = 8.4 years, grade range = 2nd-5th, 71% boys). Using PROC GENMOD (SAS 9.4) the difference between the means of CLS and usual services for each outcome at post-treatment was tested. To account for clustering effects by school, the Generalized Estimating Equation method was used. Results: Students from schools assigned to CLS, relative to those assigned to usual services, had significantly greater improvement on parent and teacher ratings of ADHD symptom severity and organizational functioning, teacher-rated academic performance and parent ratings of ODD symptoms and social/interpersonal skills. Conclusions: These results support the efficacy of CLS relative to typical school and community practices for reducing ADHD and ODD symptoms and improving key areas of functional impairment. They further suggest that existing school-based mental health resources can be re-deployed from non-empirically supported practices to those with documented efficacy. This model holds promise for improving access to efficient, evidence-based treatment for inattentive and disruptive behavior beyond the clinic setting. [This article was published in the "Journal of the American Academy of Child and Adolescent Psychiatry," v55 p762-770 2016.]
Reviews of Individual Studies 3 3
Inclusion of Students with an Intellectual Disability in the General Education Classroom with the Use of Response Cards (2016)
The passage of the Individuals With Disabilities Education Improvement Act and the No Child Left Behind Act has highlighted the importance of all students having access to the general education curriculum. Because students with disabilities are being included in the general education classroom in greater numbers, teachers need to implement research-based instructional strategies. To extend research on one effective strategy, the authors used a single case ABAB reversal design to investigate the effects of using response cards on active student responding and on-task behavior for five students with intellectual disabilities during science and social studies lessons in the general education classroom. Results suggest increased active student responding and on-task behavior for all five participants. A discussion of study limitations, implications, and future research directions is included.
Reviews of Individual Studies K-6 3
Student and Teacher Outcomes of the Class-Wide Function-Related Intervention Team Efficacy Trial (2016)
Schools continue to strive for the use of evidenced-based interventions and policies to foster well-managed classrooms that promote improved student outcomes. The present study examined the effects of the Class-Wide Function-related Intervention Teams (CW-FIT), a group contingency intervention, on the on-task and disruptive behavior of elementary school students with or at risk for emotional behavior disorders (EBD). Seventeen elementary schools, 159 general education teachers, and 313 students participated in the randomized-control group design study. Fidelity of implementation was strong for intervention group teachers and was measured across groups and throughout baseline conditions. Results suggest that CW-FIT can be used to increase on-task behavior and reduce the disruptive behavior of students with or at risk for EBD. In addition, teachers in intervention classes increased praise and reduced reprimands to individual students and along with their students, reported high levels of consumer satisfaction.
Reviews of Individual Studies K 3
Testing the Efficacy of a Tier 2 Mathematics Intervention: A Conceptual Replication Study (2016)
The purpose of this closely aligned conceptual replication study was to investigate the efficacy of a Tier 2 kindergarten mathematics intervention. The replication study differed from the initial randomized controlled trial on three important elements: geographical region, timing of the intervention, and instructional context of the counterfactual. Similar to the original investigation, however, the current study tested the same intervention, used the same outcome measures and statistical analyses, and involved the same population of learners. A total of 319 kindergarten students with mathematics difficulties from 36 kindergarten classrooms participated in the study. Students who were randomly assigned to the treatment condition received the intervention in small-group formats, with 2 or 5 students per group. Control students participated in a no-treatment control condition. Significant effects on proximal and distal measures of mathematics achievement were found. Effect sizes obtained for all measures fell within or exceeded the upper bound of the effects reported in the initial study. Implications for systematically situating replication studies in larger frameworks of intervention research and reporting rates of treatment response across replication studies are discussed.
Reviews of Individual Studies K 3
Testing the Efficacy of a Tier 2 Mathematics Intervention: A Conceptual Replication Study (2016)
The purpose of this closely aligned conceptual replication study was to investigate the efficacy of a Tier 2 kindergarten mathematics intervention. The replication study differed from the initial randomized controlled trial on three important elements: geographical region, timing of the intervention, and instructional context of the counterfactual. Similar to the original investigation, however, the current study tested the same intervention, used the same outcome measures and statistical analyses, and involved the same population of learners. A total of 319 kindergarten students with mathematics difficulties from 36 kindergarten classrooms participated in the study. Students who were randomly assigned to the treatment condition received the intervention in small-group formats, with 2 or 5 students per group. Control students participated in a no-treatment control condition. Significant effects on proximal and distal measures of mathematics achievement were found. Effect sizes obtained for all measures fell within or exceeded the upper bound of the effects reported in the initial study. Implications for systematically situating replication studies in larger frameworks of intervention research and reporting rates of treatment response across replication studies are discussed. [This paper was published in "Exceptional Children" (EJ1116305).]
Reviews of Individual Studies K 3
Effects of an Early Numeracy Intervention on Struggling Kindergarteners&apos; Mathematics Performance (2016)
The purpose of this study was to investigate the effects of an early numeracy intervention delivered by kindergarten teachers to students identified as having mathematics difficulties. A multigroup growth-modeling-with-random-assignment-to-intervention-condition design was employed. Thirty-two teachers were randomly assigned to the treatment or comparison condition. A total of 71 students participated in the study, 47 in the treatment group and 24 in the comparison group. Results indicated that the treatment condition students outperformed comparison students (g* = 0.99) and demonstrated statistically significantly higher scores on all proximal measures of early numeracy. Also, about 80% to 100% of the variance was accounted for at the student level. Performance on distal measures was less impressive, with no significant differences between groups; the effect size was 0.44. Teachers rated components of the intervention highly, reflecting strong teacher satisfaction.
Reviews of Individual Studies K 3
Improving Mathematics Learning of Kindergarten Students through Computer-Assisted Instruction (2016)
This study evaluated the effects of a mathematics software program, the Building Blocks software suite, on young children's mathematics performance. Participants included 247 Kindergartners from 37 classrooms in 9 schools located in low-income communities. Children within classrooms were randomly assigned to receive 21 weeks of computer-assisted instruction (CAI) in mathematics with Building Blocks or in literacy with Earobics Step 1. Children in the Building Blocks condition evidenced higher posttest scores on tests of numeracy and Applied Problems after controlling for beginning-of-year numeracy scores and classroom nesting. These findings, together with a review of earlier CAI, provide guidance for future work on CAI aiming to improve mathematics performance of children from low-income backgrounds. [This paper was published in "Journal for Research in Mathematics Education" (EJ1100307).]
Reviews of Individual Studies 9-12 3
Randomized evaluation of peer support arrangements to support the inclusion of high school students with severe disabilities (2016)
Enhancing the social and learning experiences of students with severe disabilities in inclusive classrooms has been a long-standing focus of research, legislative, and advocacy efforts. The authors used a randomized controlled experimental design to examine the efficacy of peer support arrangements to improve academic and social outcomes for 51 students with severe disabilities in high school general education classrooms. Paraprofessionals or special educators recruited, trained, and supported 106 peers to provide individualized academic and social assistance to students with severe disabilities throughout one semester. Compared to students exclusively receiving adult-delivered support (n = 48), students participating in peer support arrangements experienced increased interactions with peers, increased academic engagement, more progress on individualized social goals, increased social participation, and a greater number of new friendships. Moreover, an appreciable proportion of relationships lasted one and two semesters later after the intervention had concluded. These findings challenge prevailing practices for supporting inclusive education and establish the efficacy and social validity of peer support arrangements as a promising alternative to individually assigned paraprofessional support.
Reviews of Individual Studies 9-12 3
Effects of Multimedia Vocabulary Instruction on Adolescents with Learning Disabilities (2015)
The purpose of this experimental study is to investigate the effects of using content acquisition podcasts (CAPs), an example of instructional technology, to provide vocabulary instruction to adolescents with and without learning disabilities (LD). A total of 279 urban high school students, including 30 with LD in an area related to reading, were randomly assigned to one of four experimental conditions with instruction occurring at individual computer terminals over a 3-week period. Each of the four conditions contained different configurations of multimedia-based instruction and evidence-based vocabulary instruction. Dependent measures of vocabulary knowledge indicated that students with LD who received vocabulary instruction using CAPs through an explicit instructional methodology and the keyword mnemonic strategy significantly outperformed other students with LD who were taught using the same content, but with multimedia instruction that did not adhere to a specific theoretical design framework. Results for general education students mirrored those for students with LD. Students also completed a satisfaction measure following instruction with multimedia and expressed overall agreement that CAPs are useful for learning vocabulary terms.
Reviews of Individual Studies K 3
A Kindergarten Number-Sense Intervention with Contrasting Practice Conditions for Low-Achieving Children (2015)
The efficacy of a research-based number-sense intervention for low-achieving kindergartners was examined. Children (N = 126) were randomly assigned to 1 of 3 conditions: a number-sense intervention followed by a number-fact practice session, an identical number-sense intervention followed by a number-list practice session, or a business-as-usual control group. The number-fact practice condition not only gave children an additional advantage over the number-list practice condition on the outcomes at delayed posttest 8 weeks later but also was especially effective for producing gains in English learners.
Reviews of Individual Studies K 3
A Kindergarten Number-Sense Intervention with Contrasting Practice Conditions for Low-Achieving Children (2015)
The efficacy of a research-based number-sense intervention for low-achieving kindergartners was examined. Children (N = 126) were randomly assigned to 1 of 3 conditions: a number-sense intervention followed by a number-fact practice session, an identical number-sense intervention followed by a number-list practice session, or a business-as-usual control group. The number-fact practice condition not only gave children an additional advantage over the number-list practice condition on the outcomes at delayed posttest 8 weeks later but also was especially effective for producing gains in English learners.
Reviews of Individual Studies K 3
A Kindergarten Number-Sense Intervention with Contrasting Practice Conditions for Low-Achieving Children (2015)
The efficacy of a research-based number-sense intervention for low-achieving kindergartners was examined. Children (N = 126) were randomly assigned to 1 of 3 conditions: a number-sense intervention followed by a number-fact practice session, an identical number-sense intervention followed by a number-list practice session, or a business-as-usual control group. The number-fact practice condition not only gave children an additional advantage over the number-list practice condition on the outcomes at delayed posttest 8 weeks later but also was especially effective for producing gains in English learners.
Reviews of Individual Studies 9-12 3
The Quantum Opportunities Program: A randomized control evaluation (2015)
Reviews of Individual Studies K 3
Effectiveness of Supplemental Kindergarten Vocabulary Instruction for English Learners: A Randomized Study of Immediate and Longer-Term Effects of Two Approaches (2015)
A two-cohort cluster randomized trial was conducted to estimate effects of small-group supplemental vocabulary instruction for at-risk kindergarten English learners (ELs). "Connections" students received explicit instruction in high-frequency decodable root words, and interactive book reading (IBR) students were taught the same words in a storybook reading context. A total of 324 EL students representing 24 home languages and averaging in the 10th percentile in receptive vocabulary completed the study ("Connections" n = 163 in 75 small groups; IBR n = 161 in 72 IBR small groups). Although small groups in both conditions made significant immediate gains across all measures, "Connections" students made significantly greater gains in reading vocabulary and decoding (d = 0.64 and 0.45, respectively). At first-grade follow-up, longer-term gains were again greater for Connections students, but with smaller effect sizes (d = 0.29 and 0.27, respectively). Results indicate that explicit "Connections" instruction features designed to build semantic, orthographic and phonological connections for word learning were effective for improving proximal reading vocabulary and general decoding; however, increases in root word reading vocabulary did not transfer to general vocabulary knowledge. Additional tables are presented in two appendices. [At time of submission to ERIC this article was in press with the "Journal of Research on Educational Effectiveness."]
Reviews of Individual Studies K-5 3
Increasing Teacher Praise and on Task Behavior for Students With Autism Using Mobile Technology. (2015)
Reviews of Individual Studies K-2 3
Results from a three-year i3 impact evaluation of the Children’s Literacy Initiative (CLI): Implementation and impact findings of an intensive professional development and coaching program. (2015)
Reviews of Individual Studies K-5 3
Class-Wide Function-Related Intervention Teams "CW-FIT" Efficacy Trial Outcomes. (2015)
The purpose of the study was to determine the efficacy of the Class-Wide Function-Related Intervention Teams (CW-FIT) program for improving students' on-task behavior, and increasing teacher recognition of appropriate behavior. The intervention is a group contingency classroom management program consisting of teaching and reinforcing appropriate behaviors (i.e., getting the teacher's attention, following directions, and ignoring inappropriate behaviors of peers). Seventeen elementary schools, the majority in urban and culturally diverse communities, participated in a randomized trial with 86 teachers (classrooms) assigned to CW-FIT, and 73 teachers (classrooms) assigned to the comparison group. Class-wide student on-task behavior improved over baseline levels in the intervention classes. Teachers were able to implement the intervention with high fidelity overall, as observed in adherence to 96% of the fidelity criteria on average. Teacher praise and attention to appropriate behaviors increased, and reprimands decreased. These effects were replicated in new classrooms each of the 4 years of the study, and for all years combined.
Reviews of Individual Studies 2 3
The Effect of Tutoring with Nonstandard Equations for Students with Mathematics Difficulty (2015)
Students often misinterpret the equal sign (=) as operational instead of relational. Research indicates misinterpretation of the equal sign occurs because students receive relatively little exposure to equations that promote relational understanding of the equal sign. No study, however, has examined effects of nonstandard equations on the equation solving and equal-sign understanding of students with mathematics difficulty (MD). In the present study, second-grade students with MD (n = 51) were randomly assigned to standard equations tutoring, combined tutoring (standard and nonstandard equations), and no-tutoring control. Combined tutoring students demonstrated greater gains on equation-solving assessments and equal-sign tasks compared to the other two conditions. Standard tutoring students demonstrated improved skill on equation solving over control students, but combined tutoring students' performance gains were significantly larger. Results indicate that exposure to and practice with nonstandard equations positively influence student understanding of the equal sign.
Reviews of Individual Studies 2 3
The Effect of Tutoring with Nonstandard Equations for Students with Mathematics Difficulty (2015)
Students often misinterpret the equal sign (=) as operational instead of relational. Research indicates misinterpretation of the equal sign occurs because students receive relatively little exposure to equations that promote relational understanding of the equal sign. No study, however, has examined effects of nonstandard equations on the equation solving and equal-sign understanding of students with mathematics difficulty (MD). In the present study, second-grade students with MD (n = 51) were randomly assigned to standard equations tutoring, combined tutoring (standard and nonstandard equations), and no-tutoring control. Combined tutoring students demonstrated greater gains on equation-solving assessments and equal-sign tasks compared to the other two conditions. Standard tutoring students demonstrated improved skill on equation solving over control students, but combined tutoring students' performance gains were significantly larger. Results indicate that exposure to and practice with nonstandard equations positively influence student understanding of the equal sign.
Reviews of Individual Studies 2 3
Effects of a Multitier Support System on Calculation, Word Problem, and Prealgebraic Performance among At-Risk Learners (2015)
The focus of the present study was enhancing word problem and calculation achievement in ways that support prealgebraic thinking among second-grade students at risk for mathematics difficulty. Intervention relied on a multitier support system (i.e., responsiveness to intervention, or RTI) in which at-risk students participate in general classroom instruction and receive supplementary small-group tutoring. Participants were 265 students in 110 classrooms in 25 schools. Teachers were randomly assigned to one of three conditions: calculation RTI, word problem RTI, or business-as-usual control. Intervention lasted 17 weeks. Multilevel modeling indicated that calculation RTI improved calculation but not word problem outcomes, word problem RTI enhanced proximal word problem outcomes as well as performance on some calculation outcomes, and word problem RTI provided a stronger route than calculation RTI to prealgebraic knowledge.
Reviews of Individual Studies 2 3
Effects of a Multitier Support System on Calculation, Word Problem, and Prealgebraic Performance among At-Risk Learners (2015)
The focus of the present study was enhancing word problem and calculation achievement in ways that support prealgebraic thinking among second-grade students at risk for mathematics difficulty. Intervention relied on a multitier support system (i.e., responsiveness to intervention, or RTI) in which at-risk students participate in general classroom instruction and receive supplementary small-group tutoring. Participants were 265 students in 110 classrooms in 25 schools. Teachers were randomly assigned to one of three conditions: calculation RTI, word problem RTI, or business-as-usual control. Intervention lasted 17 weeks. Multilevel modeling indicated that calculation RTI improved calculation but not word problem outcomes, word problem RTI enhanced proximal word problem outcomes as well as performance on some calculation outcomes, and word problem RTI provided a stronger route than calculation RTI to prealgebraic knowledge.
Reviews of Individual Studies 12 3
Evaluation of the Expository Reading and Writing Course: Findings from the Investing in Innovation Development Grant (2015)
The Expository Reading and Writing Course (ERWC) was developed by California State University (CSU) faculty and high school educators to improve the academic literacy of high school seniors, thereby reducing the need for students to enroll in remedial English courses upon entering college. This report, produced by Innovation Studies at WestEd, presents the findings of an independent evaluation of the ERWC funded by an Investing in Innovation (i3) development grant from the U.S. Department of Education. The study sample for the evaluation included more than 5,000 12th grade students in 24 high schools across nine California school districts in the 2013/14 school year. The authors of the report found that the ERWC has a statistically significant positive impact on student achievement. Results from an analysis of implementation fidelity are also presented, along with qualitative findings based on survey data from study participants. Appendixes include: (1) Statistical Power for Impact Estimates; (2) Data Collection Instruments to Measure Fidelity of Implementation; and (3) Rubric for Calculating Fidelity of Implementation for Each Component of the Expository Reading and Writing Course.
Reviews of Individual Studies 6-8 3
Impact of Enhanced Anchored Instruction in Inclusive Math Classrooms (2015)
The Common Core State Standards for Mathematics will place more pressure on special education and math teachers to raise the skill levels of all students, especially those with disabilities in math (MD). The purpose of this study was to assess the effects of enhanced anchored instruction (EAI) on students with and without MD in co-taught general education classrooms. Results showed that students in the EAI condition improved their performance on math skills contained in several of the standards. Effect sizes were especially large for students with MD when the special education teacher more actively participated in the instructional activities with the math teacher. Classroom observations provided examples of how teachers can work together to benefit students in inclusive math settings.
Reviews of Individual Studies 7-12 3
FLIGHT Final Evaluation Report: Facilitating Long-term Improvements in Graduation and Higher Education for Tomorrow (2015)
Reviews of Individual Studies 7 3
The effects of the Elevate Math summer program on math achievement and algebra readiness (REL 2015-096) (2015)
Reviews of Individual Studies 7 3
Interleaved Practice Improves Mathematics Learning (2015)
A typical mathematics assignment consists primarily of practice problems requiring the strategy introduced in the immediately preceding lesson (e.g., a dozen problems that are solved by using the Pythagorean Theorem). This means that students know which strategy is needed to solve each problem before they read the problem. In an alternative approach known as "interleaved practice," problems from the course are rearranged so that a portion of each assignment includes different kinds of problems in an interleaved order. Interleaved practice requires students to choose a strategy on the basis of the problem itself, as they must do when they encounter a problem during a comprehensive examination or subsequent course. In the experiment reported here, 126 seventh-grade students received the same practice problems over a three-month period, but the problems were arranged so that skills were learned by interleaved practice or by the usual blocked approach. The practice phase concluded with a review session, followed 1 or 30 days later by an unannounced test. Compared to blocked practice, interleaved practice produced higher scores on both the immediate and delayed tests (Cohen's d = 0.42 and 0.79, respectively). Two appendices include: (1) Serial Position of Each Graph and Slope Problem in the Assignments (table); and (2) Frequency of Responses of Three Teachers to Statements About Interleaved Practice (table). [Note: This article was "in press" at the time of submission. No citation information is available at this time.]
Reviews of Individual Studies 9 3
The Building Assets-Reducing Risks Program: Replication and Expansion of an Effective Strategy to Turn Around Low-Achieving Schools. i3 Development Grant. Final Report (2015)
The Building Assets Reducing Risks (BARR) Model BARR is a comprehensive model that addresses the challenges that are part of the 9th grade transition year. BARR employs eight different school-wide and individual strategies that are built on positive relationships and ongoing monitoring of student data. In 2010, BARR received an Investing in Innovation (i3) Development grant from the US Department of Education to replicate BARR and conduct a randomized controlled trial to test its effectiveness. This report details the final results of the i3 Development grant. A large suburban high school in southern California participated in a within-school Randomized Controlled Trial (RCT) of the BARR Model. A total of 555 9th grade students were randomly assigned to BARR and non-BARR conditions. At the end of the RCT year, BARR students had earned significantly more core course credits, higher grade point averages, and had a lower course failure rate than non-BARR students. BARR students also earned significantly higher standardized test scores on the Northwest Education Association's (NWEA) Measures of Academic Progress (MAP) scores in mathematics and reading than did non-BARR students after one year of implementation; specifically an average of two years of growth in mathematics, compared to one year of decline in the non-BARR condition. In the second and third years of the grant, BARR was implemented in the entire 9th grade, and the core course failure rate continued to decline. In addition, the achievement gap between Hispanic and non-Hispanic students closed by year two of implementation and remained closed in year three. Implementation fidelity of the BARR model was achieved in year one, and continued to improve over the second and third years of the study. BARR was also implemented in two smaller rural high schools in Maine. Decreases in core course failure rate, increases in grade point averages, and increases in standardized test scores in reading, language, and mathematics were achieved if the BARR model was implemented with fidelity. BARR teachers reported improved relationships with students, increased ability to perceive student strengths, use of data to improve student performance, better communication with administration, less isolation, and better problem solving of problematic student issues. Results were seen for both new and veteran teachers. The following are appended: (1) Attrition for credits earned, NWEA Reading, NWEA Mathematics; (2) Baseline Measurement--Group Data; (3) Mean number of core credits and NWEA scores by study group, gender and Hispanic origin; (4) Regression models predicting core credits earned, spring NWEA Mathematics scores, and spring NWEA Reading scores; (5) Reported findings--group data and estimates; (6) OLS Regressions for proficiency groups; (7) Core credits by gender and Hispanic origin over 3 years; (8) Fidelity ratings for key components of the BARR program; and (9) Teacher survey results.
Reviews of Individual Studies 3-8 3
Does Teacher Evaluation Improve School Performance? Experimental Evidence from Chicago&apos;s Excellence in Teaching Project (2015)
Chicago Public Schools initiated the Excellence in Teaching Project, a teacher evaluation program designed to increase student learning by improving classroom instruction through structured principal-teacher dialogue. The pilot began in forty-four elementary schools in 2008-09 (cohort 1) and scaled up to include an additional forty-eight elementary schools in 2009-10 (cohort 2). Leveraging the experimental design of the roll-out, cohort 1 schools performed better in reading and math than cohort 2 schools at the end of the first year, though the math effects are not statistically significant. We find the initial improvement for cohort 1 schools remains even after cohort 2 schools adopted the program. Moreover, the pilot differentially impacted schools with different characteristics. Higher-achieving and lower-poverty schools were the primary beneficiaries, suggesting the intervention was most successful in more advantaged schools. These findings are relevant for policy makers and school leaders who are implementing evaluation systems that incorporate classroom observations.
Reviews of Individual Studies 4 3
Does Working Memory Moderate the Effects of Fraction Intervention? An Aptitude-Treatment Interaction (2014)
This study investigated whether individual differences in working memory (WM) moderate effects of 2 variations of intervention designed to improve at-risk 4th graders' fraction knowledge. We also examined the effects of each intervention condition against a business-as-usual control group and assessed whether children's measurement interpretation of fractions mediated those effects. At-risk students (n = 243) were randomly assigned to control and 2 intervention conditions. The interventions each lasted 12 weeks, with three 30-min sessions per week. The major focus of both intervention conditions was the measurement interpretation of fractions. Across the 2 conditions, only 5 min of each 30-min session differed. One condition completed activities to build fluency with 4 measurement interpretation topics; in the other, activities were completed to consolidate understanding on the same 4 topics. Results revealed a significant aptitude-treatment interaction, in which students with very weak WM learned better with conceptual activities but children with more adequate (but still low) WM learned better with fluency activities. Both intervention conditions outperformed the control group on all outcomes, and improvement in the measurement interpretation of fractions mediated those effects.
Reviews of Individual Studies 4 3
Does Working Memory Moderate the Effects of Fraction Intervention? An Aptitude-Treatment Interaction (2014)
This study investigated whether individual differences in working memory (WM) moderate effects of 2 variations of intervention designed to improve at-risk 4th graders' fraction knowledge. We also examined the effects of each intervention condition against a business-as-usual control group and assessed whether children's measurement interpretation of fractions mediated those effects. At-risk students (n = 243) were randomly assigned to control and 2 intervention conditions. The interventions each lasted 12 weeks, with three 30-min sessions per week. The major focus of both intervention conditions was the measurement interpretation of fractions. Across the 2 conditions, only 5 min of each 30-min session differed. One condition completed activities to build fluency with 4 measurement interpretation topics; in the other, activities were completed to consolidate understanding on the same 4 topics. Results revealed a significant aptitude-treatment interaction, in which students with very weak WM learned better with conceptual activities but children with more adequate (but still low) WM learned better with fluency activities. Both intervention conditions outperformed the control group on all outcomes, and improvement in the measurement interpretation of fractions mediated those effects.
Reviews of Individual Studies 4 3
Does Working Memory Moderate the Effects of Fraction Intervention? An Aptitude-Treatment Interaction (2014)
This study investigated whether individual differences in working memory (WM) moderate effects of 2 variations of intervention designed to improve at-risk 4th graders' fraction knowledge. We also examined the effects of each intervention condition against a business-as-usual control group and assessed whether children's measurement interpretation of fractions mediated those effects. At-risk students (n = 243) were randomly assigned to control and 2 intervention conditions. The interventions each lasted 12 weeks, with three 30-min sessions per week. The major focus of both intervention conditions was the measurement interpretation of fractions. Across the 2 conditions, only 5 min of each 30-min session differed. One condition completed activities to build fluency with 4 measurement interpretation topics; in the other, activities were completed to consolidate understanding on the same 4 topics. Results revealed a significant aptitude-treatment interaction, in which students with very weak WM learned better with conceptual activities but children with more adequate (but still low) WM learned better with fluency activities. Both intervention conditions outperformed the control group on all outcomes, and improvement in the measurement interpretation of fractions mediated those effects.
Reviews of Individual Studies 9-12 3
Early college, continued success: Early college high school initiative impact study. (2014)
Reviews of Individual Studies 7 3
The Benefit of Interleaved Mathematics Practice Is Not Limited to Superficially Similar Kinds of Problems (2014)
Most mathematics assignments consist of a group of problems requiring the same strategy. For example, a lesson on the quadratic formula is typically followed by a block of problems requiring students to use the quadratic formula, which means that students know the appropriate strategy before they read each problem. In an alternative approach, different kinds of problems appear in an interleaved order, which requires students to choose the strategy on the basis of the problem itself. In the classroom-based experiment reported here, grade seven students (n = 140) received blocked or interleaved practice over a nine-week period, followed two weeks later by an unannounced test. Mean test scores were greater for material learned by interleaved practice rather than by blocked practice (72% vs. 38%, d = 1.05). This interleaving effect was observed even though the different kinds of problems were superficially dissimilar from each other, whereas previous interleaved mathematics studies required students to learn nearly identical kinds of problems. We conclude that interleaving improves mathematics learning not only by improving discrimination between different kinds of problems but also by strengthening the association between each kind of problem and its corresponding strategy. [This article was published in: "Psychonomic Bulletin & Review" v21 n5 p1323-1330 Oct 2014; http://dx.doi.org/ 10.3758/s13423-014-0588-3.]
Reviews of Individual Studies 7-8 3
A Randomized Study of a Literacy-Integrated Science Intervention for Low-Socio-Economic Status Middle School Students: Findings from First-Year Implementation (2014)
This paper presents the findings from a randomized control trial study of reading/literacy-integrated science inquiry intervention after 1 year of implementation and the treatment effect on 5th-grade low-socio-economic African-American and Hispanic students' achievement in science and English reading. A total of 94 treatment students and 194 comparison students from four randomized intermediate schools participated in the current project. The intervention consisted of ongoing professional development and specific instructional science lessons with inquiry-based learning, direct and explicit vocabulary instruction, and integration of reading and writing. Results suggested that (a) there was a significantly positive treatment effect as reflected in students' higher performance in district-wide curriculum-based tests of science and reading and standardized tests of science, reading, and English reading fluency; (b) males and females did not differ significantly from participating in science inquiry instruction; (c) African-American students had lower chance of sufficiently mastering the science concepts and achieving above the state standards when compared with Hispanic students across gender and condition, and (d) below-poverty African-American females are the most vulnerable group in science learning. Our study confirmed that even a modest amount of literacy integration in inquiry-based science instruction can promote students' science and reading achievement. Therefore, we call for more experimental research that focus on the quality of literacy-integrated science instruction from which middle grade students, particularly low-socio-economic status students, can benefit.
Reviews of Individual Studies 6-8 3
Effects of blended instructional models on math performance (2014)
Reviews of Individual Studies 6-8 3
A Delayed Treatment Control Group Design Study of an After-School Online Tutoring Program in Reading (2014)
This chapter concerns a year-long, United States federally-funded evaluation of Educate Online, an online, at home, 1:1 tutoring program aimed at improving reading performance for middle school students who are below grade level. Participating students receive after-school instruction from teachers in real-time over Voice over Internet Protocol (VoIP) connections. The researcher discusses study findings, the methodological challenges of conducting research on online tutoring, the multiple perspectives for understanding the effectiveness of a tutoring program, and areas for additional research. The chapter examines a key aspect of the evaluation, a delayed treatment control group design study to determine the effect that involvement in the tutoring program has upon student academic achievement in reading. [This chapter was published in: F. J. García-Peñalvo, A. M. Seoane Pardo (Eds.), "Online Tutor 2.0: Methodologies and Case Studies for Successful Learning," (pp. 264-279). Hershey, PA: IGI Global, 2014. (978-1-4666-5832-5 / 2326-8905).]
Reviews of Individual Studies 1 3
Preliminary Evaluation of a Tier 2 Mathematics Intervention for First-Grade Students: Using a Theory of Change to Guide Formative Evaluation Activities (2014)
This pilot study examined the efficacy of a Tier 2 first-grade mathematics intervention program targeting whole-number understanding for students at risk in mathematics. The study used a randomized block design. Students (N = 89) were randomly assigned to treatment (Fusion) or control (standard district practice) conditions. Measures of mathematics achievement were collected at pretest and posttest. Treatment and control students did not differ on mathematics assessments at pretest. A series of random-effects models were estimated to compare gains between treatment and control conditions. Gain scores of intervention students were significantly greater than those of control peers on a proximal measure of mathematics achievement. The role of a strong theory-of-change model in the development and evaluation of mathematics interventions is articulated. Implications for researchers and educators designing and delivering instruction for at-risk students in a response-to-intervention model are discussed.
Reviews of Individual Studies 2 3
The effect of phonics-enhanced Big Book reading on the language and literacy skills of six-year-old pupils of different reading ability attending lower SES schools. (2014)
Reviews of Individual Studies K-2 3
Evaluation of the Milwaukee Community Literacy Project/SPARK Program: Findings from the first cohort. (2014)
Reviews of Individual Studies K-1 3
The Success for All Model of School Reform: Interim Findings from the Investing in Innovation (i3) Scale-Up (2014)
This is the second of three reports from MDRC's evaluation of the Success for All (SFA) scale-up demonstration, funded under the U.S. Department of Education's Investing in Innovation (i3) competition. The report presents updated findings on SFA's implementation and impacts in the scale-up sites participating in the evaluation. The i3 evaluation of SFA employs an experimental design, in which 37 schools in five school districts that are participating in the scale-up effort were assigned at random to a program group or to a control group. The two groups of schools were similar on all school-level characteristics at baseline, although they were not fully representative of all schools participating in SFA's i3 scale-up. The 19 program group schools received SFA. The 18 control group schools did not get the intervention and, instead, either continued with the same reading program that they had used previously or, in the case of some schools, adopted a new one. The study compares the experiences of adults and the performance of students in the two groups of schools. This second report tracks the literacy growth of the initial group of kindergartners as they advanced through first grade, and it also measures the reading skills of students in grades 3 through 5. Like the first report, this report uses quantitative and qualitative data from a variety of sources. Through teacher and principal surveys, implementation summaries completed by SFA staff, logs completed by teachers to describe the instruction that they provided to individual students, interviews and focus groups with school personnel conducted in the course of site visits, school district databases, and individual and group assessments of students' reading skills, it addresses three main questions: (1) To what extent were SFA's features implemented during the program's second year? (2) How distinct were the program group schools and the control group schools in various aspects of school functioning? (3) Did SFA continue to produce impacts on students' reading skills as the students progressed through first grade? In brief, the report finds that, during the second year, schools strengthened their implementation of SFA, and teachers were more at ease with it. Reading instruction in SFA schools continued to differ from instruction in control group schools in a number of respects, although in other ways the two groups of schools were similar. Finally, first-graders who had been enrolled in SFA schools since kindergarten significantly outperformed their counterparts who had been continuously enrolled in control group schools on two measures of phonetic and decoding skills, although not on measures of higher-order reading skills. At this point, the impact findings about the students' academic trajectories are consistent with those reported in the major previous experimental study of SFA. Four appendices include: (1) Data Sources and Response Rates; (2) Subgroup Impacts; (3) Full-Sample Impacts; and (4) Auxiliary-Sample Impacts. [This report was written with Emma Alterman and Emily Pramik.]
Reviews of Individual Studies 9 3
Building assets and reducing risks whole ninth-grade strategy reduces coursework failure for students of color. (2013, April/May)
Reviews of Individual Studies 9 3
Early College, Early Success: Early College High School Initiative Impact Study (2013)
In 2002, the Bill & Melinda Gates Foundation launched the Early College High School Initiative (ECHSI) with the primary goal of increasing the opportunity for underserved students to earn a postsecondary credential. To achieve this goal, Early Colleges provide underserved students with exposure to, and support in, college while they are in high school. Early Colleges partner with colleges and universities to offer all students an opportunity to earn an associate's degree or up to two years of college credits toward a bachelor's degree during high school at no or low cost to the students. The underlying assumption is that engaging underrepresented students in a rigorous high school curriculum tied to the incentive of earning college credit will motivate them and increase their access to additional postsecondary education and credentials after high school. Since 2002, more than 240 Early Colleges have opened nationwide. This study focused on the impact of Early Colleges. It addressed two questions: (1) Do Early College students have better outcomes than they would have had at other high schools?; and (2) Does the impact of Early Colleges vary by student background characteristics (e.g., gender and family income)? To answer these questions, the authors conducted a lottery-based randomized experiment, taking advantage of the fact that some Early Colleges used lotteries in their admissions processes. By comparing the outcomes for students who participated in admissions lotteries and were offered enrollment with the outcomes for students who participated in the lotteries but were not offered enrollment, they can draw causal conclusions about the impact of Early Colleges. The primary student outcomes for this study were high school graduation, college enrollment, and college degree attainment. The authors also examined students' high school and college experiences. Data on student background characteristics and high school outcomes came from administrative records from schools, districts, and states; data on college outcomes came from the National Student Clearinghouse (NSC); and data on high school and college experiences and intermediate outcomes such as college credit accrual came from a student survey. The authors assessed the impact of Early Colleges on these outcomes for a sample of 10 Early Colleges that did the following: (1) Enrolled students in grades 9-12 and had high school graduates in the study years (2005-2011); (2) Used lotteries as part of the admission processes in at least one of the study cohorts (students who entered ninth grade in 2005-06, 2006-07, or 2007-08); and (3) Retained the lottery records. Eight of the 10 Early Colleges in the study were included in the student survey. The overall study sample included 2,458 students and the survey sample included 1,294 students. The study extended through three years past high school.
Reviews of Individual Studies 8 3
Improving Reading Comprehension and Social Studies Knowledge in Middle School (2013)
This study aimed to determine the efficacy of a content acquisition and reading comprehension treatment implemented by eighth-grade social studies teachers. Using a within-teacher design, the eighth-grade teachers' social studies classes were randomly assigned to treatment or comparison conditions. Teachers (n = 5) taught the same instructional content to both treatment and comparison classes, but the treatment classes used instructional practices focused on teaching essential words, text as a source for reading and discussion, and team-based learning approaches. Students in the treatment conditions (n = 261) scored statistically higher than students in the comparison conditions (n = 158) on all three outcomes: content acquisition (ES = 0.17), content reading comprehension (ES = 0.29), and standardized reading comprehension (ES = 0.20). Findings are interpreted as demonstrating support for the treatment in improving both knowledge acquisition and reading comprehension within content area instruction. (Contains 8 tables, 1 figure, and 1 note.)
Reviews of Individual Studies 7-8 3
The Effects of Response to Intervention on the Mathematics Achievement of Seventh and Eighth Grade Students (2013)
The purpose of this quantitative study was to investigate the effectiveness of a system-wide Response to Intervention (RTI) program on the mathematical achievement of seventh and eighth grade students. The study consisted of five district schools with a total of 502 participants. The students were identified as belonging to one of two tiers, which differed in regard to amount of intervention. The first tier (Tier 1) of students only received the regular classroom instruction while the second tier (Tier 2/3) received an additional thirty minutes of intervention strategies. The students receiving interventions, the Tier 2/3 students, were divided into two groups. One group received primarily teacher-directed instruction (TDI) as an intervention while the other group received computer-assisted instruction (CAI) as an intervention. For the purpose of this study, the CAI intervention involved the use of the commercial program, Odyssey Math. The students were benchmark tested at the beginning and end of the 2010-2011 school year using the STAR Math assessment program and also progress monitored on a regular basis. In an attempt to determine the effectiveness of the RTI program, a gain score ANOVA was conducted using the scaled scores of the two tiers from the beginning and the end of the school year. The analysis indicated that Tier 2/3 students did demonstrate greater growth than the students in Tier 1. The gain scores of the two groups of Tier 2/3 students were also used in a gain score ANOVA to measure differences in growth. An additional analysis of their mean scores was also conducted using ANCOVA. Both analyses indicated that the CAI group demonstrated greater gains. A third analysis was conducted in order to determine how accurately the STAR Math assessment program could predict student success (reaching either a Proficient or Advanced level) on the state assessment. While the STAR Math program did not accurately predict the students' level in every case, the logistic regression analysis did indicate that the program was successful in identifying struggling students. [The dissertation citations contained here are published with the permission of ProQuest LLC. Further reproduction is prohibited without permission. Copies of dissertations may be obtained by Telephone (800) 1-800-521-0600. Web page: http://www.proquest.com/en-US/products/dissertations/individuals.shtml.]
Reviews of Individual Studies 9-11 3
Experimental study of a self-determination intervention for youth in foster care (2013)
Reviews of Individual Studies 6-8 3
Four methods of identifying change in the context of a multiple component reading intervention for struggling middle school readers (2013)
Reviews of Individual Studies 4 3
Improving At-Risk Learners' Understanding of Fractions (2013)
The purposes of this study were to investigate the effects of an intervention designed to improve at-risk 4th graders' understanding of fractions and to examine the processes by which effects occurred. The intervention focused more on the measurement interpretation of fractions; the control condition focused more on the part-whole interpretation of fractions and on procedures. Intervention was also designed to compensate for at-risk students' limitations in the domain-general abilities associated with fraction learning. At-risk students (n = 259) were randomly assigned to intervention and control. Whole-number calculation skill, domain-general abilities (working memory, attentive behavior, processing speed, listening comprehension), and fraction proficiency were pretested. Intervention occurred for 12 weeks, 3 times per week, 30 min per session, and then fraction performance was reassessed. On each conceptual and procedural fraction outcome, effects favored intervention over control (effect sizes = 0.29 to 2.50), and the gap between at-risk and low-risk students narrowed for the intervention group but not the control group. Improvement in the accuracy of children's measurement interpretation of fractions mediated intervention effects. Also, intervention effects were moderated by domain-general abilities, but not whole-number calculation skill.
Reviews of Individual Studies 4 3
Improving At-Risk Learners' Understanding of Fractions (2013)
The purposes of this study were to investigate the effects of an intervention designed to improve at-risk 4th graders' understanding of fractions and to examine the processes by which effects occurred. The intervention focused more on the measurement interpretation of fractions; the control condition focused more on the part-whole interpretation of fractions and on procedures. Intervention was also designed to compensate for at-risk students' limitations in the domain-general abilities associated with fraction learning. At-risk students (n = 259) were randomly assigned to intervention and control. Whole-number calculation skill, domain-general abilities (working memory, attentive behavior, processing speed, listening comprehension), and fraction proficiency were pretested. Intervention occurred for 12 weeks, 3 times per week, 30 min per session, and then fraction performance was reassessed. On each conceptual and procedural fraction outcome, effects favored intervention over control (effect sizes = 0.29 to 2.50), and the gap between at-risk and low-risk students narrowed for the intervention group but not the control group. Improvement in the accuracy of children's measurement interpretation of fractions mediated intervention effects. Also, intervention effects were moderated by domain-general abilities, but not whole-number calculation skill.
Reviews of Individual Studies 2 3
Effects of tier 3 intervention for students with persistent reading difficulties and characteristics of inadequate responders. (2013)
This article describes a randomized controlled trial conducted to evaluate the effects of an intensive, individualized, Tier 3 reading intervention for second grade students who had previously experienced inadequate response to quality first grade classroom reading instruction (Tier 1) and supplemental small-group intervention (Tier 2). Also evaluated were cognitive characteristics of students with inadequate response to intensive Tier 3 intervention. Students were randomized to receive the research intervention (N = 47) or the instruction and intervention typically provided in their schools (N = 25). Results indicated that students who received the research intervention made significantly better growth than those who received typical school instruction on measures of word identification, phonemic decoding, and word reading fluency and on a measure of sentence- and paragraph-level reading comprehension. Treatment effects were smaller and not statistically significant on phonemic decoding efficiency, text reading fluency, and reading comprehension in extended text. Effect sizes for all outcomes except oral reading fluency met criteria for substantive importance; however, many of the students in the intervention continued to struggle. An evaluation of cognitive profiles of adequate and inadequate responders was consistent with a continuum of severity (as opposed to qualitative differences), showing greater language and reading impairment prior to the intervention in students who were inadequate responders.
Reviews of Individual Studies 2 3
Extending Self-Management Strategies: the use of a Classwide Approach (2013)
Reviews of Individual Studies 3 3
Impact of Small-Group Tutoring Interventions on the Mathematical Problem Solving and Achievement of Third-Grade Students with Mathematics Difficulties (2013)
This intervention study compared the efficacy of small-group tutoring on the mathematics learning of third-grade students at risk for mathematics difficulty using either a school-provided standards-based curriculum (SBC) or a schema-based instruction (SBI) curriculum. The SBI curriculum placed particular emphasis on the underlying mathematical structure of additive problems to represent and solve word problems. At-risk students (N = 136) from 35 classrooms scoring below a proficiency level on their district accountability assessment were assigned randomly to treatment groups. Results indicated interaction effects on the word problem-solving (WPS) posttest and retention tests such that SBI students with higher incoming (pretest) WPS scores outperformed SBC students with higher pretest scores, whereas SBC students with lower pretest scores outperformed SBI students with lower pretest scores. No effects were found on number combinations automaticity, and mathematics and reading achievement. Implications to improve the problem-solving performance of at-risk students are discussed. (Contains 4 tables and 2 figures.)
Reviews of Individual Studies 3 3
A Randomized Controlled Trial of the Impact of Schema-Based Instruction on Mathematical Outcomes for Third-Grade Students with Mathematics Difficulties (2013)
This study compared the effects of delivering a supplemental, small-group tutoring intervention on the mathematics outcomes of third-grade students at risk for mathematics difficulties (MD) who were randomly assigned to either a schema-based instruction (SBI) or control group. SBI emphasized the underlying mathematical structure of additive problems. All students at risk for MD identified through screening received a mathematics intervention in groups of 2-4 for 12 weeks across the school year. Results revealed that students in the SBI group outperformed students in the control group on a word problem solving (WPS) posttest ("g" = 0.46). The effect of SBI proved to be equivalent for students in both high and low at-risk subgroups. On a district-administered mathematics achievement test, SBI students scored significantly higher than control students (g = 0.34); however, there were no significant effects on the WPS retention test (8 weeks later). (Contains 3 tables and 1 figure.)
Reviews of Individual Studies 3 3
Effects of Cognitive Strategy Interventions and Cognitive Moderators on Word Problem Solving in Children at Risk for Problem Solving Difficulties (2013)
This study investigated the role of strategy instruction and cognitive abilities on word problem solving accuracy in children with math difficulties (MD). Elementary school children (N = 120) with and without MD were randomly assigned to 1 of 4 conditions: general-heuristic (e.g., underline question sentence), visual-schematic presentation (diagrams), general-heuristic + visual-schematic, and an untreated control. When compared to the control condition that included children with MD, an advantage at posttest was found for children with MD for the visual-schematic-alone condition on measures of problem solving and calculation accuracy, whereas all strategy conditions facilitated posttest performance in correctly identifying problem solving components. The results also suggested that strategy conditions drew upon different cognitive resources. The General-heuristic condition drew primarily upon the executive component of working memory (WM), Visual-schematic condition drew upon the visual component of WM and the combined strategies condition drew upon number processing skills.
Reviews of Individual Studies 1 3
Decreasing reading differences in children from disadvantaged backgrounds: The effects of an early literacy intervention. (2013)
Children from low socioeconomic backgrounds (SES) are at increased risk of reading problems. Although phonological awareness consistently emerges as a critical literacy skill for children, little research exists regarding the effects of the acquisition of phonological awareness skills on decreasing the reading achievement gap between children of different SES levels. In this study, 50 first graders from low SES backgrounds were randomly assigned to receive 10 weeks of phonological awareness intervention or a control condition. In addition, 25 first graders from middle-high SES backgrounds served as a comparison group. A significant difference in phonological awareness skills was found between children in the low SES intervention group who received the phonological awareness intervention and similar children in the control group who did not receive the intervention. Reading skill differences between the low SES intervention and control groups were found at follow-up 24 weeks later but not immediately following intervention. Although the gap in reading skills of children from the low SES intervention group and the middle-high SES comparison group decreased, reading differences remained. Implications of findings with regard to prevention and identification of children at-risk for reading difficulties, as well as planning and implementing early literacy intervention for children from disadvantaged backgrounds are provided.
Reviews of Individual Studies 1 3
An Evaluation of an Explicit Read Aloud Intervention Taught in Whole-Classroom Formats In First Grade (2013)
This study describes an evaluation of a read aloud intervention to improve comprehension and vocabulary of first-grade students. Twelve teachers were randomly assigned to an intervention or comparison condition. The study lasted 19 weeks, and the intervention focused on the systematic use of narrative and expository texts and dialogic interactions between teachers and students delivered in whole-classroom formats. Read aloud intervention lessons included before-, during-, and after-reading components and explicit instruction targeted comprehension and vocabulary knowledge. Teachers in the comparison condition implemented the same amount of read aloud instruction, focusing on strategies they believed would help their students with comprehension and vocabulary. On some, but not all, outcome measures, intervention students at low risk and high risk for language difficulties outperformed comparable students in the comparison group. Implications are discussed. (Contains 1 note and 7 tables.)
Reviews of Individual Studies K-12 3
The system for teacher and student advancement: An evaluation of achievement and engagement in Louisiana. (2013)
Reviews of Individual Studies K-2 3
Efficacy of the Leveled Literacy Intervention System for K–2 urban students: An empirical evaluation of LLI in Denver Public Schools. (2013)
Reviews of Individual Studies K-1 3
Summer School Effects in a Randomized Field Trial (2013)
This field-based randomized trial examined the effect of assignment to and participation in summer school for two moderately at-risk samples of struggling readers. Application of multiple regression models to difference scores capturing the change in summer reading fluency revealed that kindergarten students randomly assigned to summer school outperformed their control group peers by 0.60 of a standard deviation in an intent-to-treat analysis. For the first grade sample, the intent-to-treat estimate was over three quarters of a standard deviation. The contrast in performance was greater when the comparison was focused more specifically on the change in literacy between treatment participants (i.e., randomly assigned students who actually attended summer school) and students randomly assigned to the control group and in analyses that explicitly adjusted for non-compliance with treatment assignment. These results support the experiential intuition of school district personnel regarding the benefits of summer school and suggest that targeted summer instruction can be a useful strategy to support student learning over the summer months. (Contains 2 figures and 3 tables.)
Reviews of Individual Studies K-1 3
Live Webcam Coaching to Help Early Elementary Classroom Teachers Provide Effective Literacy Instruction for Struggling Readers: The Targeted Reading Intervention (2013)
This study evaluated whether the Targeted Reading Intervention (TRI), a classroom teacher professional development program delivered through webcam technology literacy coaching, could provide rural classroom teachers with the instructional skills to help struggling readers progress rapidly in early reading. Fifteen rural schools were randomly assigned to the experimental or control condition. Five struggling readers and 5 non-struggling readers were randomly selected from eligible children in each classroom. There were 75 classrooms and 631 children in the study. Teachers in experimental schools used the TRI in one-on-one sessions with 1 struggling reader in the regular classroom for 15 min a day until that struggler made rapid reading progress. Teachers then moved on to another struggling reader until all 5 struggling readers in the class received the TRI during the year. Biweekly webcam coaching sessions between the coach and teacher allowed the coach to see and hear the teacher as she instructed a struggling reader in a TRI session, and the teacher and child could see and hear the coach. In this way the classroom teacher was able to receive real-time feedback from the coach. Three-level hierarchical linear models suggested that struggling readers in the intervention schools significantly outperformed the struggling readers in the control schools, with effect sizes from 0.36 to 0.63 on 4 individualized achievement tests. Results suggested that struggling readers were gaining at the same rate as the non-struggling readers, but they were not catching up with their non-struggling peers.
Reviews of Individual Studies 9-12 3
The Impact of Dual Enrollment on College Degree Attainment: Do Low-SES Students Benefit? (2013)
Dual enrollment in high school is viewed by many as one mechanism for widening college admission and completion of low-income students. However, little evidence demonstrates that these students discretely benefit from dual enrollment and whether these programs narrow attainment gaps vis-a-vis students from middle-class or affluent family backgrounds. Using the National Longitudinal Study of 1988 ("N"= 8,800), I find significant benefits in boosting rates of college degree attainment for low-income students while holding weaker effects for peers from more affluent backgrounds. These results remain even with analyses from newer data of college freshman of 2004. I conduct sensitivity analyses and find that these results are robust to relatively large unobserved confounders. However, expanding dual enrollment programs would modestly reduce gaps in degree attainment. (Contains 1 note and 4 tables.)
Reviews of Individual Studies K-2 3
A Randomised Control Trial of a Tier-2 Small-Group Intervention ("MiniLit") for Young Struggling Readers (2012)
The response-to-intervention model is predicated upon increasingly intensive tiers of instruction. The aim of the present study was to examine the efficacy of a Tier-2 small-group literacy intervention ("MiniLit") designed for young readers who are still struggling after experiencing whole-class initial instruction. A total of 22 students in Kindergarten and Year 2 at a New South Wales public school were randomly allocated to form two comparable groups. The experimental group received the Tier-2 small-group literacy intervention for one hour per day for four days per week for three school terms (27 weeks of instruction) while the control group continued to receive regular whole-class literacy instruction during this time. All students were assessed on four measures of reading and related skills before the intervention commenced, again after two terms of instruction and once more after three terms of instruction. Large and statistically significant mean differences between the two groups were evident at post-test on two of the four tests employed measuring phonological recoding and single word reading. Large effect sizes provided evidence for the efficacy of the small-group intervention for young struggling readers. (Contains 5 figures, 1 table and 1 note.)
Reviews of Individual Studies 1-5 3
Modifying Students' Classroom Behaviors Using an Electronic Daily Behavior Report Card (2012)
This study examined the effects of e-mailed daily behavior report cards (DBRC) on students' disruptive classroom behaviors. Additionally, teacher acceptability of e-mailed DBRC as an intervention was assessed. Participants included 46 elementary students (37 males and 9 females), that were assigned to one of three conditions; delayed treatment control, e-mailed DBRC, and e-mailed DBRC with performance feedback. Student behaviors were measured by direct observations and teacher ratings. Results suggest that e-mailed DBRC can decrease students' disruptive behaviors, that e-mailed DBRC with performance feedback did not produce superior outcomes, and that e-mailed DBRC was perceived as acceptable. (Contains 1 table.)
Reviews of Individual Studies 10-12 3
My life: Effects of a longitudinal, randomized study of self-determination enhancement on the transition outcomes of youth in foster care and special education. (2012)
Reviews of Individual Studies 4-8 3
Evaluation of "System 44." Final Report [2012] (2012)
The purpose of this evaluation of Scholastic's "System 44" conducted by RMC Research was to expand the existing research on students with learning disabilities by conducting a randomized study of struggling readers with approximately half of the sample comprised of students with learning disabilities. Specifically, this evaluation examined the impact of "System 44" on the reading outcomes of struggling readers and on a subsample of students with learning disabilities in Grades 4-8. The evaluation of the implementation and impact of "System 44" involved 12 elementary schools and 4 middle and K-8 schools in a district in Michigan. Scholastic's "System 44" is a foundational reading program intended for older struggling readers who have not mastered basic phonics and decoding skills. Combining researched-based phonics instruction with adaptive technology, "System 44" is designed to improve students' word reading accuracy, fluency, and comprehension. The "System 44" program delivers research-based instruction through an adaptive computer component; teacher-led small-group instruction; and individual student practice involving high-interest, leveled materials. Thus students who have not responded to classroom reading instruction may benefit from the more intensive and specific decoding instruction provided through "System 44." The evaluators selected the target sample based on student performance on the fall 2011 Michigan Educational Assessment Program (MEAP) and spring 2011 AIMSweb assessment. The Scholastic Reading Inventory (SRI) was used to screen students for "System 44" eligibility. The district administered the SRI to all students in the target sample. Those students who scored below 600 Lexiles on the SRI were administered the Scholastic Phonics Inventory (SPI). All students who scored in the Beginning or Developing reader categories on the SPI were randomly assigned (stratified by school and grade level) to either the "System 44" treatment group or the control group. RMC Research hired and trained 4 local testers to individually administer a battery of standardized reading tests to all treatment and control group students. The testers administered the tests in October 2011 to establish baseline scores and again in May 2012 to attain follow-up scores. The tests included the following: (1) Test of Silent Reading Efficiency and Comprehension (TOSREC); (2) Comprehensive Test of Phonological Processing (CTOPP) Elision subtest; (3) Test of Word Reading Efficiency (TOWRE) Sight Word Efficiency subtest; and (4) Test of Word Reading Efficiency (TOWRE) Phonetic Decoding Efficiency subtest. The evaluation of "System 44" revealed significant impacts on several tests for both the overall sample and the learning disabled sample. Additional findings revealed that impacts were stronger on several tests for middle school students than for elementary school students, particularly on SPI Nonsense Word Accuracy, TOSREC, and SRI. Although significant impacts were attained by the end of Year 1, the majority of students in the study did not complete the "System 44" program. Data collected through teacher surveys, classroom visits, and interviews provided information on teachers' implementation of "System 44" in the classroom, and software usage data were used to examine differences in students with varying program exit and topic completion patterns. [For the November 2011 report, see ED613693.]
Reviews of Individual Studies 8 3
Developing Procedural Flexibility: Are Novices Prepared to Learn from Comparing Procedures? (2012)
Background: A key learning outcome in problem-solving domains is the development of procedural flexibility, where learners know multiple procedures and use them appropriately to solve a range of problems (e.g., Verschaffel, Luwel, Torbeyns, & Van Dooren, 2009). However, students often fail to become flexible problem solvers in mathematics. To support flexibility, teaching standards in many countries recommend that students be exposed to multiple procedures early in instruction and be encouraged to compare them. Aims: We experimentally evaluated this recommended instructional practice for supporting procedural flexibility during a classroom lesson, relative to two alternative conditions. The alternatives reflected the common instructional practice of delayed exposure to multiple procedures, either with or without comparison of procedures. Sample: Grade 8 students from two public schools (N= 198) were randomly assigned to condition. Students had not received prior instruction on multi-step equation solving, which was the topic of our lessons. Method: Students learned about multi-step equation solving under one of three conditions in math class for about 3 hr. They also completed a pre-test, post-test, and 1-month-retention test on their procedural knowledge, procedural flexibility, and conceptual knowledge of equation solving. Results: Novices who compared procedures immediately were more flexible problem solvers than those who did not, even on a 1-month retention test. Although condition had limited direct impact on conceptual and procedural knowledge, greater flexibility was associated with greater knowledge of both types. Conclusions: Comparing procedures can support flexibility in novices and early introduction to multiple procedures may be one important reason. (Contains 5 tables and 2 figures.)
Reviews of Individual Studies 9 3
The impact of curriculum-based professional development on science instruction: Results from a cluster-randomized trial. (2011, March)
This research is part of a larger, IES-funded study titled: "Measuring the Efficacy and Student Achievement of Research-based Instructional Materials in High School Multidisciplinary Science" (Award # R305K060142). The larger study seeks to use a cluster-randomized trial design, with schools as the unit of assignment, to make causal inferences about the effect of treatment on both students and teachers. The research described in this report addresses the following research question associated with path "a" in Figure 1: (1) What is the mean difference in teacher outcome (i.e., instruction) across the treatment groups? (a) What is the effect size (practical significance)? (b) Is the difference statistically significant at the alpha = 0.05 level?; and (2) If practically or statistically significant differences in instruction exist across treatment groups, to what extent can the differences be attributed to the treatment (instructional materials and PD)? The research takes place in both suburban and rural high schools in the state of Washington. In particular, the suburban schools are clustered near Seattle/Tacoma and the rural schools are clustered near Yakima. The data from this analysis suggest that the PD treatment was more effective in fostering reform-oriented science instruction, on average, than was the extant PD experienced by the business-as-usual comparison group. This difference was both statistically and practically significant. Applying this result to the authors' hypothesis of mediation, they now have confidence that one of the causal paths (path a) that are necessary to argue mediation is trustworthy. Further study of path b is necessary to understand whether instruction is serving as a mediator of the treatment effect. That said, there is evidence in the literature suggesting that the possibility of a significant b path is quite real. For example, Hedges and Hedberg (2007) found that in school-level interventions, a considerable amount of the variance in outcomes was attributable to teacher and /or classroom effects. Threats to internal validity that are noteworthy include limitations in the authors' confidence that the post-intervention differences in RTOP scores were not pre-existing (i.e., not attributable to the treatment). Unfortunately, they did not have a baseline RTOP measure that could have served as a covariate in the main effect analysis of treatment. Use of such a covariate would have likely provided a more precise estimate of the treatment effect. Further, because the comparison group received business-as-usual PD, this experience was highly variable across teachers. The research team has only cursory knowledge of the nature and duration of extant PD experienced by the comparison group. As such, there is limited clarity in the PD experiences to which the treatment is being compared. In the context of an efficacy trial, external validity (i.e., generalizability) of findings is not paramount. However, it should be noted again that the authors' sampling approach was not random. Therefore, they are cautious not to suggest that their treatment effect estimates would generalize far beyond their sample of rural and suburban schools in Washington state. (Contains 1 figure and 6 tables.)
Reviews of Individual Studies 9 3
The Impact of Curriculum-Based Professional Development on Science Instruction: Results from a Cluster-Randomized Trial (2011)
This research is part of a larger, IES-funded study titled: "Measuring the Efficacy and Student Achievement of Research-based Instructional Materials in High School Multidisciplinary Science" (Award # R305K060142). The larger study seeks to use a cluster-randomized trial design, with schools as the unit of assignment, to make causal inferences about the effect of treatment on both students and teachers. The research described in this report addresses the following research question associated with path "a" in Figure 1: (1) What is the mean difference in teacher outcome (i.e., instruction) across the treatment groups? (a) What is the effect size (practical significance)? (b) Is the difference statistically significant at the alpha = 0.05 level?; and (2) If practically or statistically significant differences in instruction exist across treatment groups, to what extent can the differences be attributed to the treatment (instructional materials and PD)? The research takes place in both suburban and rural high schools in the state of Washington. In particular, the suburban schools are clustered near Seattle/Tacoma and the rural schools are clustered near Yakima. The data from this analysis suggest that the PD treatment was more effective in fostering reform-oriented science instruction, on average, than was the extant PD experienced by the business-as-usual comparison group. This difference was both statistically and practically significant. Applying this result to the authors' hypothesis of mediation, they now have confidence that one of the causal paths (path a) that are necessary to argue mediation is trustworthy. Further study of path b is necessary to understand whether instruction is serving as a mediator of the treatment effect. That said, there is evidence in the literature suggesting that the possibility of a significant b path is quite real. For example, Hedges and Hedberg (2007) found that in school-level interventions, a considerable amount of the variance in outcomes was attributable to teacher and /or classroom effects. Threats to internal validity that are noteworthy include limitations in the authors' confidence that the post-intervention differences in RTOP scores were not pre-existing (i.e., not attributable to the treatment). Unfortunately, they did not have a baseline RTOP measure that could have served as a covariate in the main effect analysis of treatment. Use of such a covariate would have likely provided a more precise estimate of the treatment effect. Further, because the comparison group received business-as-usual PD, this experience was highly variable across teachers. The research team has only cursory knowledge of the nature and duration of extant PD experienced by the comparison group. As such, there is limited clarity in the PD experiences to which the treatment is being compared. In the context of an efficacy trial, external validity (i.e., generalizability) of findings is not paramount. However, it should be noted again that the authors' sampling approach was not random. Therefore, they are cautious not to suggest that their treatment effect estimates would generalize far beyond their sample of rural and suburban schools in Washington state. (Contains 1 figure and 6 tables.)
Reviews of Individual Studies 8-12 3
Striving Readers Year 5 project evaluation report: Ohio—An addendum to the Year 4 report. (2011)
Reviews of Individual Studies 6-8 3
Efficacy of a Reading Intervention for Middle School Students with Learning Disabilities (2011)
This experimental study reports findings on the effects from a year-long reading intervention providing daily 50-min sessions to middle school students with identified learning disabilities (n = 65) compared with similar students who did not receive the reading intervention (n = 55). All students continued to receive their special education services as provided by the school. Statistically significant results favored the treatment group for sight word reading fluency following intervention. Small effects were found for phonemic decoding fluency and passage comprehension. No other statistically significant differences were noted between groups. The findings suggest that although gains on word reading fluency resulted from the additional reading treatment, accelerating the reading performance of students identified with learning disabilities may be unlikely to result from a 1-year daily intervention provided in groups of 10 to 15 students. (Contains 2 tables.)
Reviews of Individual Studies 7-10 3
Portland Public Schools' Striving Readers Program: Year 5 Evaluation Report (2011)
Portland Public Schools (PPS), the largest school district in Oregon, serves more than 46,000 students in regular and special programs. More than 2,900 classroom teachers address the needs of a diverse student population (44% minority, 46% low income, 14% special education, 9% English language learners). A district needs assessment in fall 2005 revealed that 13 of Portland's 85 regular schools were eligible to participate in the Striving Readers program. Four of the high schools and 5 of the middle schools determined that they could meet the program's research requirements. All 9 schools had at each grade level a significant number of students who were at least 2 years behind in reading achievement; all received Title I funding; and none had achieved Adequate Yearly Progress under No Child Left Behind at the time of the Striving Readers application. School leaders expected the Striving Readers program to impact more than 6,400 students and 450 teachers in the 9 participating schools. After examining adolescent reading programs and studying the research on adolescent literacy, Portland Public Schools selected the Strategic Instruction Model Content Literacy Continuum developed by the University of Kansas' Center for Research on Learning to improve teacher instruction and student reading achievement in the participating middle and high schools. This report summarizes Year 1 (2006-2007), Year 2 (2007-2008), Year 3 (2008-2009), Year 4 (2009-2010), and Year 5 (2010-2011) of implementation of the targeted intervention for students reading at least 2 years below grade level in Grades 7-10 and the whole school intervention designed to help all students in Grades 6-12 learn the critical content in all curricular areas.
Reviews of Individual Studies 4-8 3
Evaluation of "System 44." Final Report [2011] (2011)
Scholastic's "System 44" is a foundational reading program intended for older struggling readers who have not mastered basic phonics and decoding skills. Combining researched-based phonics instruction with adaptive technology, "System 44" is designed to improve students' word reading accuracy, fluency, and comprehension. The "System 44" program delivers research-based instruction through an adaptive computer component; teacher-led small group instruction; and individual student practice involving high-interest, leveled materials. Thus students who have not responded to classroom reading instruction may benefit from the more intensive and specific decoding instruction provided through "System 44." Using a randomized design, this evaluation assessed the effectiveness of "System 44" in terms of improving the foundational reading skills of struggling readers in Grades 4-8 in a large suburban school district in southern California during the 2010-2011 school year. The evaluation of the implementation and impact of "System 44" involved 7 of the 11 elementary schools and all 4 middle schools in the district. A 2-step process was used to establish student eligibility for "System 44." The Scholastic Reading Inventory (SRI) was used to screen students in Grades 4-8 who performed below the 50th percentile on the spring 2010 California Standards Test (CST) for "System 44" eligibility. Those students who scored below 600 Lexiles on the SRI were administered the Scholastic Phonics Inventory (SPI), a computer-based test used to identify students in need of additional phonics instruction. Students who scored in the Beginning or Developing reader categories on the SPI were randomly assigned (stratified by school and grade level) to either the "System 44" treatment group or the control group. Data collection activities for the "System 44" evaluation included student reading tests, teacher surveys, "System 44" classroom observations, a professional development observation, and staff interviews. RMC Research hired and trained 4 local testers to administer a battery of standardized reading tests to all treatment and control students. The testers administered the tests to each student separately over a 3-week period in September and October 2010 to establish baseline scores and again in May 2011 to attain follow-up scores. Listed in order of administration, the tests included the following: (1) Test of Silent Reading Efficiency and Comprehension (TOSREC); (2) Comprehensive Test of Phonological Processing (CTOPP) Elision subtest; (3) Woodcock-Johnson III Word Identification subtest; (4) Woodcock-Johnson III Word Attack subtest; (5) Test of Word Reading Efficiency (TOWRE) Sight Word Efficiency subtest; and (6) Test of Word Reading Efficiency (TOWRE) Phonetic Decoding Efficiency subtest. This report details the program impact findings and concludes with recommendations from the evaluation team.
Reviews of Individual Studies 4-6 3
Can a Mixed-Method Literacy Intervention Improve the Reading Achievement of Low-Performing Elementary School Students in an After-School Program? Results from a Randomized Controlled Trial of READ 180 Enterprise (2011)
The authors describe an independent evaluation of the READ 180 Enterprise intervention designed by Scholastic, Inc. Despite widespread use of the program with upper elementary through high school students, there is limited empirical evidence to support its effectiveness. In this randomized controlled trial involving 312 students enrolled in an after-school program, the authors generated intention-to-treat and treatment-on-the-treated estimates of the program's impact on several literacy outcomes of fourth, fifth, and sixth graders reading below proficiency on a state assessment at baseline. READ 180 Enterprise students outperformed control group students on vocabulary (d = 0.23) and reading comprehension (d = 0.32) but not on spelling and oral reading fluency. The authors interpret the findings in light of the theory of instruction underpinning the READ 180 Enterprise intervention. (Contains 2 figures, 7 tables, and 4 notes.)
Reviews of Individual Studies 5 3
Self-Monitoring During Spelling Practice: Effects on Spelling Accuracy and On-Task Behavior of Three Students Diagnosed With Attention Deficit Hyperactivity Disorder. (2011)
Reviews of Individual Studies 10-12 3
Evaluation of Achieving a College Education Plus: A Credit-Based Transition Program (2011)
This ex post facto study evaluated Achieving a College Education (ACE) Plus program, a credit-based transition program between a high school district and a community college. Achieving a College Education Plus is an early outreach program. It is designed to aid at-risk students in graduating from high school and making a smooth transition to higher education, while taking college courses and earning college credit. The authors examined the efficacy of Achieving a College Education Plus with respect to retention rates, graduation rates, and rate of transfer to colleges. Sixty high school students who had participated in Achieving a College Education Plus were matched to a sample of 60 non-Achieving a College Education Plus students. Archival records, postgraduate survey, and school district transcript information comprised three sources of data for this study. Using a series of logistic regression analyses to assess data and provide adequate controls for prior academic achievement, the authors determined that there were no differences in the findings with respect to gender, ethnicity, and language spoken in the home. However, statistically significant differences were found in favor of the Achieving a College Education Plus program with regard to student retention, graduation, and college enrollment. With an increasing emphasis on college readiness and student retention, this study is timely and contributes empirical data and findings to the community college literature. (Contains 4 tables.)
Reviews of Individual Studies 1-3 3
Benefits of Practicing 4 = 2 + 2: Nontraditional Problem Formats Facilitate Children's Understanding of Mathematical Equivalence (2011)
This study examined whether practice with arithmetic problems presented in a nontraditional problem format improves understanding of mathematical equivalence. Children (M age = 8;0; N = 90) were randomly assigned to practice addition in one of three conditions: (a) traditional, in which problems were presented in the traditional "operations on left side" format (e.g., 9 + 8 = 17); (b) nontraditional, in which problems were presented in a nontraditional format (e.g., 17 = 9 + 8); or (c) no extra practice. Children developed a better understanding of mathematical equivalence after receiving nontraditional practice than after receiving traditional practice or no extra practice. Results suggest that minor differences in early input can yield substantial differences in children's understanding of fundamental concepts.
Reviews of Individual Studies 1 3
Early Numeracy Intervention Program for First-Grade Students with Mathematics Difficulties (2011)
The purpose of this study was to determine the effects of an early numeracy preventative Tier 2 intervention on the mathematics performance of first-grade students with mathematics difficulties. Researchers used a pretest-posttest control group design with randomized assignment of 139 students to the Tier 2 treatment condition and 65 students to the comparison condition. Systematic instruction, visual representations of mathematical concepts, purposeful and meaningful practice opportunities, and frequent progress monitoring were used to develop understanding in early numeracy skills and concepts. Researchers used progress-monitoring measures and a standardized assessment measure to test the effects of the intervention. Findings showed that students in the treatment group outperformed students in the comparison group on the progress-monitoring measures of mathematics performance and the measures that focused on whole-number computation. There were no differences between groups on the problem-solving measures. (Contains 5 tables.)
Reviews of Individual Studies 1 3
Efficacy of Supplemental Phonics-Based Instruction for Low-Skilled First Graders: How Language Minority Status and Pretest Characteristics Moderate Treatment Response (2011)
We examined the efficacy of 20 weeks of individual supplemental phonics-based instruction for language minority (LM) and non-LM first graders. Students were designated LM if the primary home language was not English (otherwise non-LM). Those performing in the bottom half of their classroom LM/non-LM group in letter knowledge and phonological awareness were randomly assigned to treatment and control conditions. Treatment included alphabetics, decoding, and oral reading practice. Results showed that treatment students (n = 93) outperformed controls (n = 94) on 5 of the 6 posttests; however, LM students exhibited lower treatment response on passage reading fluency. Pretest word reading did not moderate treatment response, and LM students with greater baseline vocabulary showed greater treatment response on posttest word reading and spelling. (Contains 4 tables and 3 figures.)
Reviews of Individual Studies PK-12 3
Toward Reducing Poverty across Generations: Early Findings from New York City's Conditional Cash Transfer Program (2011)
Aimed at low-income families in six of New York City's highest-poverty communities, Family Rewards ties cash rewards to a pre-specified set of activities and outcomes thought to be critical to families' short- and long-term success in the areas of children's education, family preventive health care, and parents' employment. The purpose of this project is to experimentally evaluate the effects of this three-year innovative holistic conditional cash transfer (CCT) initiative. This paper presents initial findings from an ongoing and comprehensive evaluation of Family Rewards. It examines the program's implementation in the field and families' responses to it during the first two of its three years of operations, and early findings on the program's impacts on children's educational processes and outcomes. More specifically, this paper addresses the following questions: (1) What are the effects of ONYC-Family Rewards on family income, poverty, and financial hardship?; (2) What are the effects of ONYC-Family Rewards on use of health care and health insurance?; (3) What are the effects of ONYC-Family Rewards on parents' employment and educational attainment?; and (4) What are the effects of ONYC-Family Rewards on children's educational outcomes? Overall, this study shows that, despite an extraordinarily rapid start-up, the program was operating largely as intended by its second year. Although many families struggled with the complexity of the program, most were substantially engaged with it and received a large amount of money for meeting the conditions it established. Specifically, nearly all families (98 percent) earned at least some rewards in both program years, with payments averaging more than $6,000 during the first two program years combined. The program reduced current poverty and hardship; increased savings; increased families' continuous use of health insurance coverage and increased their receipt of medical care; and increased employment in jobs that are not covered by the unemployment insurance (UI) system but reduced employment in UI-covered jobs. The program has had mixed success in improving children's academic performance specifically. Contrary to expectations, Family Rewards did not affect school attendance or annual standardized test scores in Math and English Language Arts (ELA) for either group of youngest children, but did lead to notable gains for a group of more academically prepared high school students. The program also had important effects on several key proposed mediators of the intervention. However, these effects vary by parents with different age groups of children. Appended are: (1) References; and (2) Tables and Figures. (Contains 2 tables.)
Reviews of Individual Studies PK-K 3
School-based early childhood education and age-28 well-being: Effects by timing, dosage, and subgroups. (2011)
Reviews of Individual Studies K 3
Efficacy of a Tier 2 Supplemental Root Word Vocabulary and Decoding Intervention with Kindergarten Spanish-Speaking English Learners (2011)
The purpose of this study was to test the efficacy of a Tier 2 standard protocol supplemental intervention designed simultaneously to develop root word vocabulary and reinforce decoding skills being taught to all students in the core beginning reading program with kindergarten Spanish-speaking English learners (ELs). Participating students were drawn from six public elementary schools in the Midwest. Within classrooms, students were randomly assigned to either the supplemental intervention (treatment) or the specified control condition (i.e., used to control for instructional time and consistency). All instruction in both conditions was delivered by paraeducator tutors and occurred in small groups for approximately 20 min a day, 5 days a week, for 20 weeks (October to April). At posttest, treatment students (n = 93) in the experimental condition significantly outperformed controls (n = 92) on a proximal (i.e., linked directly with the instructional focus of the intervention) measure of root word vocabulary (d = 1.04) and word reading (d = 0.69). Treatment students did not significantly outperform controls on a distal (i.e., not linked directly to the instructional focus of the intervention) measure of reading vocabulary (d = 0.38). The results, practical importance, and limitations are discussed. (Contains 3 tables.)
Reviews of Individual Studies 9 3
The acquisition of problem- solving skills in mathematics: How animations can aid understanding of structural problem features and solution procedures. (2010, September)
In this paper the augmentation of worked examples with animations for teaching problem-solving skills in mathematics is advocated as an effective instructional method. First, in a cognitive task analysis different knowledge prerequisites are identified for solving mathematical word problems. Second, it is argued that so called hybrid animations would be most effective for acquiring these prerequisites, because they show the continuous transition from a concrete, but superficial problem representation to a more abstract, mathematical problem model that forms a basis for solving a problem. An experiment was conducted, where N = 32 pupils from a German high school studied either only text-based worked examples explaining different problem categories from the domain of algebra or worked examples augmented with hybrid animations. Learners with hybrid animations showed superior problem-solving performance for problems of different transfer distance relative to those in the text-only condition.
Reviews of Individual Studies 7 3
Middle School Mathematics Professional Development Impact Study: Findings After the First Year of Implementation. NCEE 2010-4009 (2010)
Student achievement in mathematics has been a focal concern in the United States for many years. The National Research Council's 2001 report and the recent report of the National Mathematics Advisory Panel (2008) both called attention to student achievement in mathematics, and both called for all students to learn algebra by the end of eighth grade. Reports have argued, further, that achieving this goal requires that students first successfully learn several topics in rational numbers--fractions, decimals, ratio, rate, proportion, and percent. These topics are typically covered in grades 4 through 7, yet many students continue to struggle with them beyond the seventh grade. The National Mathematics Advisory Panel wrote that--difficulty with fractions (including decimals and percent) is pervasive and is a major obstacle to further progress in mathematics, including algebra. The panel also specified that by the end of seventh grade, students should be able to solve problems involving percent, ratio, and rate, and extend this work to proportionality. The U.S. Department of Education's National Center for Educational Evaluation and Regional Assistance (NCEE)--within the Institute of Education Sciences--initiated the Middle School Mathematics Professional Development Impact Study to test the impact of a professional development (PD) program for teachers that was designed to address the problem of low student achievement in topics in rational numbers. The study focuses on seventh grade, the culminating year for teaching those topics and has three central research questions: (1) What impact did the PD program provided in this study have on teacher knowledge of rational number topics? (2) What impact did the PD program provided in this study have on teacher instructional practices? and (3) What impact did the PD program provided in this study have on student achievement in rational number topics? The study produced the following results: (1) The study's PD program was implemented as intended; (2) The PD program did not produce a statistically significant impact on teacher knowledge of rational numbers (effect size = 0.19, p-value = 0.15); (3) The PD program had a statistically significant impact on the frequency with which teachers engaged in activities that elicited student thinking, one of the three measures of instructional practice used in the study (effect size = 0.48); and (4) The PD program did not produce a statistically significant impact on student achievement (effect size = 0.04, p-value = 0.37). This report presents the study's findings after 1 year of implementing the PD in the treatment schools. A subsequent report will present findings after 2 years of implementing the PD. Chapter 1 presents an overview of the study. Chapter 2 describes the study design and its realization, including a description of the sample and tests of baseline equivalence of the treatment and control groups on observed characteristics. Chapter 3 describes the design and implementation of the PD program and the extent of service contrast between the treatment and control groups. Chapter 4 addresses the impact of the PD program on teacher knowledge, instructional practice, and student mathematics achievement. Chapter 5 provides several nonexperimental analyses that explore additional questions related to the impact findings. Appended are: (1) Data Collection; (2) Details of the Study Samples and Analytic Approaches; (3) Supplemental Information on the Design and Implementation of the PD Program; (4) Supporting Tables and Figures for Impact Analyses; and (5) Exploratory Analyses: Approaches and Additional Results. (Contains 9 exhibits, 9 figures, and 90 tables.)
Reviews of Individual Studies 6-8 3
Reorganizing the Instructional Reading Components: Could There Be a Better Way to Design Remedial Reading Programs to Maximize Middle School Students with Reading Disabilities&apos; Response to Treatment? (2010)
The primary purpose of this study was to explore if there could be a more beneficial method in organizing the individual instructional reading components (phonological decoding, spelling, fluency, and reading comprehension) within a remedial reading program to increase sensitivity to instruction for middle school students with reading disabilities (RD). Three different modules (Alternating, Integrated, and Additive) of the Reading Achievement Multi-Modular Program were implemented with 90 middle school (sixth to eighth grades) students with reading disabilities. Instruction occurred 45 min a day, 5 days a week, for 26 weeks, for approximately 97 h of remedial reading instruction. To assess gains, reading subtests of the Woodcock Johnson-III, the Gray Silent Reading Test, and Oral Reading Fluency passages were administered. Results showed that students in the Additive module outperformed students in the Alternating and Integrated modules on phonological decoding and spelling and students in the Integrated module on comprehension skills. Findings for the two oral reading fluency measures demonstrated a differential pattern of results across modules. Results are discussed in regards to the effect of the organization of each module on the responsiveness of middle school students with RD to instruction.
Reviews of Individual Studies 6 3
Response to Intervention for Middle School Students with Reading Difficulties: Effects of a Primary and Secondary Intervention (2010)
This study examined the effectiveness of a yearlong, researcher-provided, Tier 2 (secondary) intervention with a group of sixth-graders. The intervention emphasized word recognition, vocabulary, fluency, and comprehension. Participants scored below a proficiency level on their state accountability test and were compared to a similar group of struggling readers receiving school-provided instruction. All students received the benefits of content area teachers who participated in researcher-provided professional development designed to integrate vocabulary and comprehension practices throughout the school day (Tier 1). Students who participated in the Tier 2 intervention showed gains on measures of decoding, fluency, and comprehension, but differences relative to students in the comparison group were small (median d = +0.16). Students who received the researcher-provided intervention scored significantly higher than students who received comparison intervention on measures of word attack, spelling, the state accountability measure, passage comprehension, and phonemic decoding efficiency, although most often in particular subgroups. (Contains 2 tables.)
Reviews of Individual Studies 5-8 3
Student Characteristics and Achievement in 22 KIPP Middle Schools: Final Report (2010)
The Knowledge Is Power Program (KIPP) is a bold effort to create a network of charter schools designed to transform and improve the educational opportunities available to low/income families. KIPP schools seek to actively engage students and parents in the educational process, expand the time and effort students devote to their studies, reinforce students' social competencies and positive behaviors, and dramatically improve their academic achievement. Ultimately, the goal of KIPP is to prepare students to enroll and succeed in college. The KIPP Foundation is guiding this effort by selecting and training school leaders, promoting the program model, and supporting the KIPP network schools. This report presents preliminary findings from a matched, longitudinal analysis designed to estimate KIPP's effect on student achievement. The author's preliminary work estimates effects in 22 KIPP middle schools--making this the first report that applies a rigorous (nonexperimental) methodological approach across a nationwide sample of KIPP schools. They selected schools for which they were able to collect longitudinal, student/level data, and that were established by the 2005/06 school year or earlier to ensure that a minimum of two entering cohorts of students per school would be observed for multiple years. They find that students entering these 22 KIPP schools typically had prior achievement levels that were lower than average achievement in their local school districts. For the vast majority of KIPP schools studied, impacts on students' state assessment scores in mathematics and reading are positive, statistically significant, and educationally substantial. Estimated impacts are frequently large enough to substantially reduce race/ and income/based achievement gaps within three years of entering KIPP. They describe these findings in more detail in this report. Appendices include: (1) Administrative Data; (2) Supplemental Tables for Chapter II; (3) Analytic Methods; (4) Alternative Specifications; and (5) Subgroup Analyses. (Contains 34 tables, 21 figures and 28 footnotes.) [This paper was submitted to KIPP Foundation. For the accompanying report, see ED511108.]
Reviews of Individual Studies 4-7 3
The Evaluation of Charter School Impacts: Final Report. NCEE 2010-4029 (2010)
Adding to the growing debate and evidence base on the effects of charter schools, this evaluation was conducted in 36 charter middle schools in 15 states. It compares the outcomes of 2,330 students who applied to these schools and were randomly assigned by lotteries to be admitted (lottery winners) or not admitted (lottery losers) to the schools. Both sets of students were tracked over two years and data on student achievement, academic progress, behavior, and attitudes were collected. The study is the first large-scale randomized trial of the effectiveness of charter schools in varied types of communities and states. Among the key findings were that, on average, charter middle schools that held lotteries were neither more nor less successful than traditional public schools in improving math or reading test scores, attendance, grade promotion, or student conduct within or outside of school. Being admitted to a study charter school did significantly improve both students' and parents' satisfaction with school. Charter middle schools' impact on student achievement varied significantly across schools. Charter middle schools in urban areas--as well as those serving higher proportions of low-income and low achieving students--were more effective (relative to their nearby traditional public schools) than were other charter schools in improving math test scores. Some operational features of charter middle schools were associated with less negative impacts on achievement. These features include smaller enrollments and the use of ability grouping in math or English classes. There was no significant relationship between achievement impacts and the charter schools' policy environment. Because the study could only include charter middle schools that held lotteries, the results do not necessarily apply to the full set of charter middle schools in the U.S. Appended are: (1) Selecting the Charter School and Student Samples; (2) Calculation of Sample Weights; (3) Outcome Measures for the Impact Analysis; (4) Analytic Methods; (5) Supplemental Materials for Chapter III; (6) Supplemental Tables for Chapter IV; and (7) Supplemental Tables for Chapter V. (Contains 78 tables, 29 figures, and 164 footnotes.) [For the study snapshot of this full report, see ED510574.]
Reviews of Individual Studies 4-8 3
An Evaluation of the Teacher Advancement Program (TAP) in Chicago: Year Two Impact Report (2010)
In 2007, the Chicago Public Schools (CPS) began implementing a schoolwide reform called the Teacher Advancement Program (TAP) using funds from the federal Teacher Incentive Fund (TIF) and private foundations. Under the TAP model, teachers can earn extra pay and responsibilities through promotion to mentor or master teacher as well as annual performance bonuses based on a combination of their value added to student achievement and observed performance in the classroom. The idea behind the program is that performance incentives, combined with tools for teachers to track performance and improve instruction, should help schools attract and retain talented teachers and help all teachers produce greater student achievement. This report provides evidence on the impacts of TAP during the 2008-2009 school year, the second year of the program's rollout in CPS. Appended are: (1) Propensity Score Matching; and (2) Longitudinal Analysis of Test Score Data. (Contains 18 tables, 7 figures and 14 footnotes.) [For the Year One Impact Report, see ED507502.]
Reviews of Individual Studies 4-6 3
A Randomized Experiment of a Mixed-Methods Literacy Intervention for Struggling Readers in Grades 4-6: Effects on Word Reading Efficiency, Reading Comprehension and Vocabulary, and Oral Reading Fluency (2010)
The purpose of this study was (1) to examine the causal effects of READ 180, a mixed-methods literacy intervention, on measures of word reading efficiency, reading comprehension and vocabulary, and oral reading fluency and (2) to examine whether print exposure among children in the experimental condition explained variance in posttest reading scores. A total of 294 children in Grades 4-6 were randomly assigned to READ 180 or a district after-school program. Both programs were implemented 4 days per week over 23 weeks. Children in the READ 180 intervention participated in three 20-min literacy activities, including (1) individualized computer-assisted reading instruction with videos, leveled text, and word study activities, (2) independent and modeled reading practice with leveled books, and (3) teacher-directed reading lessons tailored to the reading level of children in small groups. Children in the district after-school program participated in a 60-min program in which teachers were able to select from 16 different enrichment activities that were designed to improve student attendance. There was no significant difference between children in READ 180 and the district after-school program on norm-referenced measures of word reading efficiency, reading comprehension, and vocabulary. Although READ 180 had a positive impact on oral reading fluency and attendance, these effects were restricted to children in Grade 4. Print exposure, as measured by the number of words children read on the READ 180 computer lessons, explained 4% of the variance in vocabulary and 2% of the variance in word reading efficiency after all pretest reading scores were partialed out.
Reviews of Individual Studies 3 3
The Effects of Strategic Counting Instruction, with and without Deliberate Practice, on Number Combination Skill among Students with Mathematics Difficulties (2010)
The primary purpose of this study was to assess the effects of strategic counting instruction, with and without deliberate practice with those counting strategies, on number combination (NC) skill among students with mathematics difficulties (MD). Students (n = 150) were stratified on MD status (i.e., MD alone versus MD with reading difficulty) and site (proximal versus distal to the intervention developer) and then randomly assigned to control (no tutoring) or 1 of 2 variants of NC remediation. Both remediations were embedded in the same validated word-problem tutoring protocol (i.e., Pirate Math). In 1 variant, the focus on NCs was limited to a single lesson that taught strategic counting. In the other variant, 4-6 min of practice per session was added to the other variant. Tutoring occurred for 16 weeks, 3 sessions per week for 20-30 min per session. Strategic counting without deliberate practice produced superior NC fluency compared to control; however, strategic counting with deliberate practice effected superior NC fluency and transfer to procedural calculations compared with both competing conditions. Also, the efficacy of Pirate Math word-problem tutoring was replicated. (Contains 6 tables.)
Reviews of Individual Studies 3 3
The Effects of Strategic Counting Instruction, with and without Deliberate Practice, on Number Combination Skill among Students with Mathematics Difficulties (2010)
The primary purpose of this study was to assess the effects of strategic counting instruction, with and without deliberate practice with those counting strategies, on number combination (NC) skill among students with mathematics difficulties (MD). Students (n = 150) were stratified on MD status (i.e., MD alone versus MD with reading difficulty) and site (proximal versus distal to the intervention developer) and then randomly assigned to control (no tutoring) or 1 of 2 variants of NC remediation. Both remediations were embedded in the same validated word-problem tutoring protocol (i.e., Pirate Math). In 1 variant, the focus on NCs was limited to a single lesson that taught strategic counting. In the other variant, 4-6 min of practice per session was added to the other variant. Tutoring occurred for 16 weeks, 3 sessions per week for 20-30 min per session. Strategic counting without deliberate practice produced superior NC fluency compared to control; however, strategic counting with deliberate practice effected superior NC fluency and transfer to procedural calculations compared with both competing conditions. Also, the efficacy of Pirate Math word-problem tutoring was replicated. (Contains 6 tables.)
Reviews of Individual Studies 1 3
Computer-Assisted Instruction to Prevent Early Reading Difficulties in Students at Risk for Dyslexia: Outcomes from Two Instructional Approaches (2010)
The relative effectiveness of two computer-assisted instructional programs designed to provide instruction and practice in foundational reading skills was examined. First-grade students at risk for reading disabilities received approximately 80 h of small-group instruction in four 50-min sessions per week from October through May. Approximately half of the instruction was delivered by specially trained teachers to prepare students for their work on the computer, and half was delivered by the computer programs. At the end of first grade, there were no differences in student reading performance between students assigned to the different intervention conditions, but the combined-intervention students performed significantly better than control students who had been exposed to their school's normal reading program. Significant differences were obtained for phonemic awareness, phonemic decoding, reading accuracy, rapid automatic naming, and reading comprehension. A follow-up test at the end of second grade showed a similar pattern of differences, although only differences in phonemic awareness, phonemic decoding, and rapid naming remained statistically reliable.
Reviews of Individual Studies 1 3
A Tiered Intervention Model for Early Vocabulary Instruction: The Effects of Tiered Instruction for Young Students at Risk for Reading Disability (2010)
Vocabulary knowledge at school entry is a robust predictor of later reading achievement. Many children begin formal reading instruction at a significant disadvantage due to low levels of vocabulary. Until recently, relatively few research studies examined the efficacy of vocabulary interventions for children in the early primary grades (e.g., before fourth grade), and even fewer addressed vocabulary intervention for students at increased risk for reading failure. In more recent work, researchers have begun to explore ways in which to diminish the "meaningful differences" in language achievement noted among children as they enter formal schooling. This article provides a review of a particularly effective model of vocabulary intervention based on shared storybook reading and situates this model in a context of tiered intervention, an emerging model of instructional design in the field of special education. In addition, we describe a quasi-experimental posttest-only study that examines the feasibility and effectiveness of the model for first-grade students. Participants were 224 first-grade students of whom 98 were identified as at risk for reading disability based on low levels of vocabulary. Results of a multivariate analysis of variance revealed significant differences on measures of target vocabulary knowledge at the receptive and context level, suggesting that students at risk for reading failure benefit significantly from a second tier of vocabulary instruction. Implications for classroom practice as well as future research are provided.
Reviews of Individual Studies 1-4 3
A final report for the evaluation of Renaissance Learning’s Accelerated Reader Program. (2010)
Reviews of Individual Studies 1-5 3
Addressing Summer Reading Setback among Economically Disadvantaged Elementary Students (2010)
Much research has established the contribution of summer reading setback to the reading achievement gap that is present between children from more and less economically advantaged families. Likewise, summer reading activity, or the lack of it, has been linked to summer setback. Finally, family socioeconomic status has been linked to the access children have to books in their homes and neighborhoods. Thus, in this longitudinal experimental study we tested the hypothesis that providing elementary school students from low-income families with a supply of self-selected trade books would ameliorate summer reading setback. Thus, 852 students from 17 high-poverty schools were randomly selected to receive a supply of self-selected trade books on the final day of school over a 3-year period, and 478 randomly selected students from these same schools received no books and served as the control group. No further effort was provided in this intervention study. Outcomes on the state reading assessment indicated a statistically significant effect (p = 0.015) for providing access to books for summer reading along with a significant (d = 0.14) effect size. Slightly larger effects (d = 0.21) were found when comparing the achievement of the most economically disadvantaged students in the treatment and control groups. (Contains 3 tables and 2 notes.)
Reviews of Individual Studies 1 3
Validation of a supplemental reading intervention for first-grade children. (2010)
This experimental study was designed to validate a short-term supplemental reading intervention for at-risk first-grade children. Although substantial research on long-term supplemental reading interventions exists, less is known about short-term interventions. Thirty first-grade children were randomly assigned to intervention or control conditions. Students in the intervention received 16 hours of instruction. Analyses of pre- and posttest data and growth measures suggest that short-term supplemental reading intervention had a significant effect on children's reading skills; however, effects were not consistent across measures. Parent and teacher ratings moderated significant effects. Findings support the validity of a brief intervention for students at risk for reading failure that may inform Tier 2 interventions within a Response to Intervention framework. (Contains 9 tables and 2 figures.)
Reviews of Individual Studies 10-12 3
The Advanced Placement Teacher Training Incentive Program (APTIP): Estimating the impact of an incentive and training program on students. (2010)
Reviews of Individual Studies 11-12 3
Making the Transition: Interim Results of the National Guard Youth ChalleNGe Evaluation (2010)
Young people who drop out of high school face long odds of success in a labor market that increasingly values education and skills. This report presents interim results from a rigorous, ongoing evaluation of the National Guard Youth ChalleNGe Program, which aims to "reclaim the lives of at-risk youth" who have dropped out of high school. ChalleNGe is an intensive residential program that currently operates in more than half the states. More than 90,000 young people have completed the program since it was launched in the early 1990s. MDRC, a nonprofit, nonpartisan research organization, is conducting the evaluation in collaboration with the MacArthur Foundation Research Network on Transitions to Adulthood. Several private foundations and the U.S. Department of Defense are funding the evaluation. The 17-month ChalleNGe program is divided into three phases: Pre-ChalleNGe, a demanding two- week orientation and assessment period; a 20-week Residential Phase built around eight core components designed to promote positive youth development; and a one-year Postresidential Phase featuring a structured mentoring program. During the first two phases, participants live at the program site, often on a military base. The environment is "quasi-military," though there are no requirements for military service. The evaluation uses a random assignment design. Because there were more qualified applicants than slots, a lottery-like process was used to decide which applicants were admitted to the program. The young people who were admitted (the program group) are being compared over time with those who were not admitted (the control group); any significant differences that emerge between the groups can be attributed to ChalleNGe. About 3,000 young people entered the study in 10 ChalleNGe programs in 2005-2006. Key findings from the survey include: (1) The program group was much more likely than the control group to have obtained a high school diploma or a General Educational Development certificate (GED) and to have earned college credits; (2) At the time of the survey, program group members were somewhat more likely to be engaged in productive activities; (3) Young people in the two groups were equally likely to have been arrested in the year prior to the survey, but the program group was less likely to have been convicted of a crime or to have engaged in certain delinquent acts; and (4) There were few differences between groups in measures of physical or mental health. These interim results are impressive, but longer-term follow-up will be critical to understanding the full story of the program's effects. Results from a 36-month survey should be available by late 2010. Appendices include: (1) Analysis of Survey Response Bias; (2) Supplementary Tables on Delinquency and Criminal Activity; (3) Supplementary Tables Analyses on Life-Coping, Leadership, and Group Skills; (4) Items and Factor Loadings for Civic Engagement Scales; and (5) Supplementary Subgroup Tables. Individual chapters contain footnotes. (Contains 40 tables, 1 figure, and 3 boxes.) [For the executive summary, see ED514661.]
Reviews of Individual Studies 2 3
Improvement in Reading Rate under Independent and Difficult Text Levels: Influences on Word and Comprehension Skills (2010)
Improving reading rate can be difficult for poor readers. In this experiment, we investigated the impact of improvement in reading rate on other aspects of reading, including word recognition, decoding, vocabulary, and comprehension. Poor readers in Grades 2 or 4 (N = 123) were randomly assigned to 1 of 3 conditions: practice reading text at their independent reading level (92%-100% word reading accuracy), practice reading text at a difficult reading level (80%-90% accuracy), or an untreated control. Students in practice conditions read aloud to an adult listener who assisted with difficult words. Before, midway, and following 20 weeks of treatment, we assessed improvement in reading rate, word recognition, decoding, vocabulary, and comprehension across conditions and determined the impact of improved rate on comprehension. We found significant differences favoring the treatment groups in rate, word recognition, and comprehension, but not in decoding or vocabulary. We found no significant differences in growth between levels of text difficulty. (Contains 8 tables and 1 figure.)
Reviews of Individual Studies 2-9 3
Financial Incentives and Student Achievement: Evidence from Randomized Trials. NBER Working Paper No. 15898 (2010)
This paper describes a series of school-based randomized trials in over 250 urban schools designed to test the impact of financial incentives on student achievement. In stark contrast to simple economic models, our results suggest that student incentives increase achievement when the rewards are given for inputs to the educational production function, but incentives tied to output are not effective. Relative to popular education reforms of the past few decades, student incentives based on inputs produce similar gains in achievement at lower costs. Qualitative data suggest that incentives for inputs may be more effective because students do not know the educational production function, and thus have little clue how to turn their excitement about rewards into achievement. Several other models, including lack of self-control, complementary inputs in production, or the unpredictability of outputs, are also consistent with the experimental data.
Reviews of Individual Studies K 3
Efficacy of Supplemental Phonics-Based Instruction for Low-Skilled Kindergarteners in the Context of Language Minority Status and Classroom Phonics Instruction (2010)
This study tested the efficacy of supplemental phonics instruction for 84 low-skilled language minority (LM) kindergarteners and 64 non-LM kindergarteners at 10 urban public schools. Paraeducators were trained to provide the 18-week (January-May) intervention. Students performing in the bottom half of their classroom language group (LM and non-LM) were randomly assigned either to individual supplemental instruction (treatment) or to classroom instruction only (control). Irrespective of their language status, treatment students (n = 67) significantly outperformed controls (n = 81) at posttest in alphabetics, word reading, spelling, passage reading fluency, and comprehension (average treatment d = 0.83); nevertheless, LM students tended to have lower posttest performance than non-LM students (average LM d = -0.30) and were significantly less responsive to treatment on word reading. When we examined the contribution of classroom phonics time to student outcomes, we found that the treatment effect on spelling was greater for students in lower phonics classrooms, whereas the treatment effect on comprehension was greater for those in higher phonics classrooms. Finally, when we examined LM students alone, we found that pretest English receptive vocabulary positively predicted most posttests and interacted with treatment only on phonological awareness. In general, pretest vocabulary did not moderate kindergarten LM treatment response. (Contains 6 tables and 2 figures.)
Reviews of Individual Studies K 3
An Evaluation of the Good Behavior Game in Early Reading Intervention Groups. (2010)
As an increasing number of studies document the link between the development of student academic and social behavior, there is a growing need to create and evaluate interventions that address both types of skill development in school contexts. It is of particular importance to focus on interventions that improve the learning environment to maximize student success. The Good Behavior Game (TGBG) is an example of a research-based intervention that can be easily modified and implemented in conjunction with academic interventions to maximize effectiveness of student supports. The present study focused on the development and implementation of a modified version of TGBG implemented during the delivery of a secondary level early literacy intervention for students at-risk for reading difficulties. Specifically, this study examined whether instructional assistants' implementation of TGBG was functionally related to changes in student and instructor outcomes. The student outcomes assessed were (1) problem behavior, (2) academic engagement, and (3) pre-literacy skill development. The instructor outcomes assessed were provision of opportunities to respond to instruction, specific praise, and corrective statements for student social behavior. Data were also collected on fidelity of implementation, contextual fit, and social validity of TGBG. A concurrent multiple baseline design across five instructional reading groups was used to evaluate effects of TGBG. Results indicated that TGBG was functionally related to reductions in student problem behavior. In addition, a functional relation was established between implementation of TGBG and increases in instructor provision of specific praise statements and decreases in provision of corrective statements. Academic engagement and provision of opportunities to respond remained high and stable throughout the study. Pre-literacy trajectories did not appear to be functionally related to TGBG implementation; however, this may have been due to the short timeframe of the study. Instructional assistants implementing TGBG as well as students participating in TGBG rated it positively. Conceptual, practical, and future research implications are discussed. [The dissertation citations contained here are published with the permission of ProQuest LLC. Further reproduction is prohibited without permission. Copies of dissertations may be obtained by Telephone (800) 1-800-521-0600. Web page: http://www.proquest.com/en-US/products/dissertations/individuals.shtml.]
Reviews of Individual Studies K 3
Responding to Rule Violations or Rule Following: A Comparison of Two Versions of the Good Behavior Game with Kindergarten Students (2010)
The purpose of this study was to examine the differential effects of 2 versions of the Good Behavior Game (Barrish, Saunders, & Wolf, 1969), allocating teacher attention to rule violations (GBG-response cost) and to rule following (GBG-reinforcement), on student and teacher behavior. The participants were 6 kindergarten students who were nominated as the 3 most disruptive students in each classroom. The study was conducted using single-case A/B/A/C/B/C reversal design with each teacher randomly assigned to either GBG-response cost or GBG-reinforcement condition for implementation in the first B phase. Results indicated that both versions were effective at reducing rule violations and that GBG-reinforcement consistently resulted in either comparable or lower levels of rule violations across classrooms and students. In addition, GBG-reinforcement was preferred by the teachers as a better fit to their classrooms. The implications of the findings to teachers and school psychologists in classroom settings are discussed. (Contains 3 figures and 1 table.)
Reviews of Individual Studies K-12 3
Evaluation of the DC Opportunity Scholarship Program: Final Report. NCEE 2010-4018 (2010)
The District of Columbia School Choice Incentive Act of 2003, passed by Congress in January 2004, established the first federally funded, private school voucher program in the United States. Since that time, more than 8,400 students have applied for what is now called the DC Opportunity Scholarship Program (OSP), and a rigorous evaluation of the Program, mandated by Congress, has been underway. This last formal report from the ongoing evaluation describes the impacts of the Program at least four years after families who applied and were given the option to move from a public school to a participating private school of their choice. The research priorities for the evaluation were shaped largely by the primary topics of interest specified in the statute. This legislative mandate led the evaluators to focus on the following research questions: (1) What is the impact of the Program on student academic achievement? (2) What is the impact of the Program on other student measures? (3) What effect does the Program have on school safety and satisfaction? (4) What is the effect of attending private versus public schools? (5) To what extent is the Program influencing public schools and expanding choice options for parents in Washington, DC? These research questions are consistent with the topics that scholars and policymakers have identified as important questions of interest surrounding private school scholarship programs. The report found that that the Program had mixed longer-term effects on participating students and their parents, including: (1) No conclusive evidence that the OSP affected student achievement overall, or for the high-priority group of students who applied from "schools in need of improvement"; (2) The Program significantly improved students' chances of graduating from high school, according to parent reports. Overall, 82 percent of students offered scholarships received a high school diploma, compared to 70 percent of those who applied but were not offered scholarships. This graduation rate improvement also held for the subgroup of OSP students who came from "schools in need of improvement."; and (3) Although parents had higher satisfaction and rated schools as safer if their child was offered or used an OSP scholarship, students reported similar ratings for satisfaction and safety regardless of whether they were offered or used a scholarship. Appendices include: (1) Research Methodology; (2) Benjamini-Hochberg Adjustments for Multiple Comparisons; (3) Sensitivity Testing; (4) Relationship Between Attending a Private School and Key Outcomes; (5) Detailed ITT Tables; (6) Exploration of Whether Parents Get What They Seek From School Choice; (7) To What Extent Are Treatment Effects of the OSP Observed Across the Outcome Test-Score Distribution? Quantile Regression Analysis of the OSP; and (8) Intermediate Outcome Measures. (Contains 99 tables, 31 figures, and 61 footnotes.)
Reviews of Individual Studies K-12 3
Evaluation of the DC Opportunity Scholarship Program: Impacts after Three Years. NCEE 2009-4050 (2009)
The "District of Columbia School Choice Incentive Act of 2003," passed by the Congress in January 2004, established the first federally funded, private school voucher program in the United States. The purpose of the new scholarship program was to provide low-income residents, particularly those whose children attend schools in need of improvement or corrective action under the "Elementary and Secondary Education Act," with "expanded opportunities to attend higher performing schools in the District of Columbia" (Sec. 303). As part of this legislation, the Congress mandated a rigorous evaluation of the impacts of the Program, now called the "DC Opportunity Scholarship Program" (OSP). This report presents findings from the evaluation on the impacts three years after families who applied were given the option to move from a public school to a participating private school of their choice. The evaluation is based on a randomized controlled trial design that compares the outcomes of eligible applicants randomly assigned to receive (treatment group) or not receive (control group) a scholarship through a series of lotteries. The main findings of the evaluation so far include: (1) After 3 years, there was a statistically significant positive impact on reading test scores, but not math test scores; (2) The OSP had a positive impact overall on parents' reports of school satisfaction and safety, but not on students' reports; (3) This same pattern of findings holds when the analysis is conducted to determine the impact of using a scholarship rather than being offered a scholarship; (4) The OSP improved reading achievement for 5 of the 10 subgroups examined; and (5) No achievement impacts were observed for five other subgroups of students, including those who entered the Program with relative academic disadvantage. Six appendices are included: (1) Research Methodology; (2) Benjamini-Hochberg Adjustments for Multiple Comparisons; (3) Sensitivity Testing; (4) Detailed ITT Tables; (5) Relationship Between Attending a Private School and Key Outcomes; and (6) Intermediate Outcome Measures.. (Contains 115 footnotes, 15 figures and 129 tables.) [For Executive Summary, see ED504784. For "Evaluation of the DC Opportunity Scholarship Program: Impacts after Two Years", see ED501696. For "Evaluation of the DC Opportunity Scholarship Program: Impacts after One Year", see ED497154.]
Reviews of Individual Studies K 3
Student and Teacher Outcomes of The Superkids Quasi-Experimental Study (2009)
In this article, we report kindergarten student and teacher outcomes from a quasi-experimental evaluation of The Superkids, a systematic, phonics-based, comprehensive K-2 reading program. We recruited 23 kindergarten teachers to implement The Superkids program from a diverse, yet predominantly ethnic minority, group of classrooms from across the United States. We then employed a precise computerized matching methodology to derive a statistically equivalent comparison group of 20 control teachers who implemented their standard "business as usual" core literacy program. Multilevel analyses of classroom-level effects of The Superkids revealed achievement advantages of more than 1/10 of a standard deviation, d = 0.11, to 1/4 of a standard deviation, d = 0.25, for the treatment group on the 5 subtests from the Stanford Achievement Test, 10th edition (SAT-10). Four measures of teachers' self-reported satisfaction with the core reading program used in their classrooms also revealed statistically significant advantages for Superkids of nearly three-quarters of a standard deviation, d = 0.72, to nearly 1 1/2 standard deviation units, d = 1.49. (Contains 3 tables and 1 footnote.)
Reviews of Individual Studies 9-12 3
Same-Language-Subtitling (SLS): Using subtitled music video for reading growth. (2009)
Reviews of Individual Studies 3 3
Effects of Fact Retrieval Tutoring on Third-Grade Students with Math Difficulties with and without Reading Difficulties (2009)
The purpose of this study was to assess the efficacy of fact retrieval tutoring as a function of math difficulty (MD) subtype, that is, whether students have MD alone (MD-only) or have concurrent difficulty with math and reading (MDRD). Third graders (n = 139) at two sites were randomly assigned, blocking by site and MD subtype, to four tutoring conditions: fact retrieval practice, conceptual fact retrieval instruction with practice, procedural computation/estimation instruction, and control (no tutoring). Tutoring occurred for 45 sessions over 15 weeks for 15-25 minutes per session. Results provided evidence of an interaction between tutoring condition and MD subtype status for assessment of fact retrieval. For MD-only students, students in both fact retrieval conditions achieved comparably and outperformed MD-only students in the control group as well as those in the procedural computation/estimation instruction group. By contrast, for MDRD students, there were no significant differences among intervention conditions.
Reviews of Individual Studies 3 3
Effects of Fact Retrieval Tutoring on Third-Grade Students with Math Difficulties with and without Reading Difficulties (2009)
The purpose of this study was to assess the efficacy of fact retrieval tutoring as a function of math difficulty (MD) subtype, that is, whether students have MD alone (MD-only) or have concurrent difficulty with math and reading (MDRD). Third graders (n = 139) at two sites were randomly assigned, blocking by site and MD subtype, to four tutoring conditions: fact retrieval practice, conceptual fact retrieval instruction with practice, procedural computation/estimation instruction, and control (no tutoring). Tutoring occurred for 45 sessions over 15 weeks for 15-25 minutes per session. Results provided evidence of an interaction between tutoring condition and MD subtype status for assessment of fact retrieval. For MD-only students, students in both fact retrieval conditions achieved comparably and outperformed MD-only students in the control group as well as those in the procedural computation/estimation instruction group. By contrast, for MDRD students, there were no significant differences among intervention conditions.
Reviews of Individual Studies 3 3
Empirical evaluation of Read Naturally effects: A randomized control trial (RCT) (Unpublished journal article). (2009)
Reviews of Individual Studies 3 3
Remediating Number Combination and Word Problem Deficits among Students with Mathematics Difficulties: A Randomized Control Trial (2009)
The purposes of this study were to assess the efficacy of remedial tutoring for 3rd graders with mathematics difficulty, to investigate whether tutoring is differentially efficacious depending on students' math difficulty status (mathematics difficulty alone vs. mathematics plus reading difficulty), to explore transfer from number combination (NC) remediation, and to examine the transportability of the tutoring protocols. At 2 sites, 133 students were stratified on mathematics difficulty status and site and then randomly assigned to 3 conditions: control (no tutoring), tutoring on automatic retrieval of NCs (i.e., Math Flash), or tutoring on word problems with attention to the foundational skills of NCs, procedural calculations, and algebra (i.e., Pirate Math). Tutoring occurred for 16 weeks, 3 sessions per week and 20-30 min per session. Math Flash enhanced fluency with NCs with transfer to procedural computation but without transfer to algebra or word problems. Pirate Math enhanced word problem skill as well as fluency with NCs, procedural computation, and algebra. Tutoring was not differentially efficacious as a function of students' mathematics difficulty status. The tutoring protocols proved transportable across sites. (Contains 5 tables and 8 footnotes.)
Reviews of Individual Studies 3 3
Remediating Number Combination and Word Problem Deficits among Students with Mathematics Difficulties: A Randomized Control Trial (2009)
The purposes of this study were to assess the efficacy of remedial tutoring for 3rd graders with mathematics difficulty, to investigate whether tutoring is differentially efficacious depending on students' math difficulty status (mathematics difficulty alone vs. mathematics plus reading difficulty), to explore transfer from number combination (NC) remediation, and to examine the transportability of the tutoring protocols. At 2 sites, 133 students were stratified on mathematics difficulty status and site and then randomly assigned to 3 conditions: control (no tutoring), tutoring on automatic retrieval of NCs (i.e., Math Flash), or tutoring on word problems with attention to the foundational skills of NCs, procedural calculations, and algebra (i.e., Pirate Math). Tutoring occurred for 16 weeks, 3 sessions per week and 20-30 min per session. Math Flash enhanced fluency with NCs with transfer to procedural computation but without transfer to algebra or word problems. Pirate Math enhanced word problem skill as well as fluency with NCs, procedural computation, and algebra. Tutoring was not differentially efficacious as a function of students' mathematics difficulty status. The tutoring protocols proved transportable across sites. (Contains 5 tables and 8 footnotes.)
Reviews of Individual Studies 2-8 3
Impact of For-Profit and Nonprofit Management on Student Achievement: The Philadelphia Intervention, 2002-2008.Working Paper Series PEPG 09-02 (2009)
At the request of the State of Pennsylvania, the School District of Philadelphia, in the summer of 2002, asked three for-profit firms to assume responsibility for 30 of its lowest-performing schools and it asked four nonprofit managers to assume the management of 16 other low-performing schools. A difference-in-differences analysis is used to estimate the impact of nonprofit and for-profit management on individual student achievement. Gains in test scores at the treated schools are estimated by comparing them with gains in other low-performing schools in the district. Students at schools under for-profit management outperformed those at schools under nonprofit management in all six years in both reading and math. Most estimations are statistically significant. Impacts of for-profit management relative to district management were positive in math, but no reading impacts could be detected. At nonprofits, students appear to have learned substantially less, especially in math, at nonprofit schools, than had their school remained under regular district management. However, impacts fell short of statistical significance. (Propensity Score Analysis is appended. Contains 21 endnotes and 9 tables.)
Reviews of Individual Studies 2-3 3
Supplemental Fluency Intervention and Determinants of Reading Outcomes (2009)
This study replicates research on the efficacy of a repeated reading intervention with word-level instruction for students in Grades 2 and 3 with low to moderate fluency skills, examines differences between treatment implementers, and tests unique contributions of treatment-related variables on outcomes. Students from 13 schools were randomly assigned to dyads; dyads were randomly assigned to treatment or control conditions. Schools were matched into treatment implementer groups (teachers or paraeducators) at study onset. Tutoring occurred during school hours for 15 weeks (M = 25.5 hr). Multilevel model results showed treatment students (n = 98) gained more than controls (n = 104) on measures of letter-sound knowledge (d = 0.41), fluency (d = 0.37-0.38), and comprehension (d = 0.30-0.31); students tutored by teachers gained more than their paraeducator-tutored peers on word reading and fluency. Finally, dyads tutored with greater fidelity gained more in word reading and fluency; dyads that read more complex words in their texts gained less on letter-sounds, fluency, and comprehension. (Contains 9 tables.)
Reviews of Individual Studies 1-3 3
A Randomized Controlled Trial of the First Step to Success Early Intervention: Demonstration of Program Efficacy Outcomes in a Diverse, Urban School District (2009)
This article reports on a randomized controlled trial of the First Step to Success early intervention that was conducted over a 4-year period in Albuquerque Public Schools. First Step is a selected intervention for students in Grades 1 through 3 with externalizing behavior problems, and it addresses secondary prevention goals and objectives. It consists of three modular components (screening, school intervention, parent training); lasts approximately 3 months; and is initially set up, delivered, and coordinated by a behavioral coach (e.g., school counselor, behavior specialist, social worker). Project Year 1 of this efficacy trial was devoted to gearing-up activities (e.g., hiring, training, planning, logistical arrangements); Years 2 and 3 each involved implementing First Step with approximately 100 behaviorally at-risk students. Students, teachers, and classrooms were randomly assigned to either intervention or usual care comparison conditions. Year 4 activities focused on conducting long-term, follow-up assessments and implementing sustainability procedures to preserve achieved gains. Pre-post teacher and parent ratings of student behavior and social skills showed moderately robust effect sizes, ranging from 0.54 to 0.87, that favored the intervention group. Direct measures of academic performance (oral reading fluency, letter-word identification) were not sensitive to the intervention. The implications and limitations of the study are discussed. (Contains 3 tables and 1 figure.)
Reviews of Individual Studies 1-12 3
Effectiveness of Reading and Mathematics Software Products: Findings From Two Student Cohorts. NCEE 2009-4041 (2009)
In the No Child Left Behind Act (NCLB), Congress called for the U.S. Department of Education (ED) to conduct a rigorous study of the conditions and practices under which educational technology is effective in increasing student academic achievement. A 2007 report presenting study findings for the 2004-2005 school year, indicated that, after one school year, differences in student test scores were not statistically significant between classrooms that were randomly assigned to use software products and those that were randomly assigned not to use products. School and teacher characteristics generally were not related to whether products were effective. The second year of the study examined whether an additional year of teaching experience using the software products increased the estimated effects of software products on student test scores. The evidence for this hypothesis is mixed. For reading, there were no statistically significant differences between the effects that products had on standardized student test scores in the first year and the second year. For sixth grade math, product effects on student test scores were statistically significantly lower (more negative) in the second year than in the first year, and for algebra I, effects on student test scores were statistically significantly higher in the second year than in the first year. The study also tested whether using any of the 10 software products increased student test scores. One product had a positive and statistically significant effect. Nine did not have statistically significant effects on test scores. Five of the insignificant effects were negative and four were positive. Study findings should be interpreted in the context of design and objectives. The study examined a range of reading and math software products in a range of diverse school districts and schools. But it did not study many forms of educational technology and it did not include many types of software products. How much information the findings provide about the effectiveness of products that are not in the study is an open question. Products in the study also were implemented in a specific set of districts and schools, and other districts and schools may have different experiences with the products. The findings should be viewed as one element within a larger set of research studies that have explored the effectiveness of software products. Three appendixes are included: (1) Second-Year Data Collection and Response Rates; (2) Description of Sample for the 10 Products; and (3) Details of Estimation Methods. (Contains 29 footnotes, 4 figures and 24 tables.
Reviews of Individual Studies 1 3
A Randomized Controlled Trial Study of the ABRACADABRA Reading Intervention Program in Grade 1 (2009)
This study reports a randomized controlled trial evaluation of a computer-based balanced literacy intervention, ABRACADABRA (http://grover.concordia.ca/abra/version1/abracadabra.html). Children (N = 144) in Grade 1 were exposed either to computer activities for word analysis, text comprehension, and fluency, alongside shared stories (experimental groups), or to balanced literacy approaches delivered by their classroom teachers (control group). Two computer-based interventions--a phoneme-based synthetic phonics method and a rime-based analytic phonics method--were contrasted. Children were taught 4 times per week for 12 weeks in small groups. There were significant improvements in letter knowledge in the analytic phonics program and significant improvements in phonological awareness, listening comprehension, and reading comprehension at immediate posttest and in phonological awareness and reading fluency at a delayed posttest in the synthetic phonics program. Effect size analyses confirmed that both interventions had a significant impact on literacy at both posttests. (Contains 2 tables.)
Reviews of Individual Studies 4-5 3
Culture and the Interaction of Student Ethnicity with Reward Structure in Group Learning (2009)
This study tests the hypothesis that cultural differences in group orientation predict an interaction between the student variable--ethnicity--and a learning context variable--reward structure--on math performance after group learning. One hundred and thirty-two African-American and European-American female and male fourth and fifth grade students studied math estimation in one of three group learning contexts. The learning contexts operationalized were: intergroup competitive, interpersonally competitive, and communal-no reward. ANCOVA confirmed a predicted interaction of ethnicity with learning context on post study session performance. Although there was no difference overall, African-American and European-American students performed best in the aggregate in different contexts. Independent ratings of students' group-positive behaviors mirrored the two-way interaction between learning context and ethnicity. The findings suggest that important student variables interact with the variable elements of group learning and should be studied in greater detail. They also support Boykin's (1994) contention that the cultural context of learning is a critical mediator of children's achievement. (Contains 4 tables, 3 figures and 7 footnotes.)
Reviews of Individual Studies 6-8 3
Are High Quality Schools Enough to Close the Achievement Gap? Evidence from a Social Experiment in Harlem. NBER Working Paper No. 15473 (2009)
Harlem Children's Zone (HCZ), which combines community investments with reform minded charter schools, is one of the most ambitious social experiments to alleviate poverty of our time. We provide the first empirical test of the causal impact of HCZ on educational outcomes, with an eye toward informing the long-standing debate whether schools alone can eliminate the achievement gap or whether the issues that poor children bring to school are too much for educators alone to overcome. Both lottery and instrumental variable identification strategies lead us to the same story: Harlem Children's Zone is effective at increasing the achievement of the poorest minority children. Taken at face value, the effects in middle school are enough to close the black-white achievement gap in mathematics and reduce it by nearly half in English Language Arts. The effects in elementary school close the racial achievement gap in both subjects. We conclude by presenting four pieces of evidence that high-quality schools or high-quality schools coupled with community investments generate the achievement gains. Community investments alone cannot explain the results.
Reviews of Individual Studies 6-8 3
Effects of Teaching Syllable Skills Instruction on Reading Achievement in Struggling Middle School Readers (2009)
Direct, explicit, and systematic instruction of critical skills has been a hallmark of effective teaching for many years. In this study, we implemented a quasi-experimental pre-/post-test design with nonequivalent groups to determine the effectiveness of syllable skills instruction on reading achievement. Classes were randomly assigned to control or treatment groups. Participants included middle-school students with high incidence disabilities, including attention deficit hyperactivity disorder (ADHD) and their peers at risk for reading failure. The syllable skills intervention included instruction in syllable patterns, syllabication steps and rules, and accenting patterns. Students practiced skills by decoding and encoding nonsense and low-frequency mono- and multisyllabic words. Statistically significant differences were evident between pre-test and post-test scores for three dependent measures: (a) word identification, (b) word attack, and (c) reading comprehension. The treatment group demonstrated greater increase from pre-test to post-test on word identification, word attack, and reading comprehension; and the gap in fluency performance between the groups decreased. We discuss these outcomes with regard to their implications for practice and future research. (Contains 4 tables and 1 figure.)
Reviews of Individual Studies 7-8 3
Compared with What? The Effects of Different Comparisons on Conceptual Knowledge and Procedural Flexibility for Equation Solving (2009)
Researchers in both cognitive science and mathematics education emphasize the importance of comparison for learning and transfer. However, surprisingly little is known about the advantages and disadvantages of what types of things are being compared. In this experimental study, 162 seventh- and eighth-grade students learned to solve equations (a) by comparing equivalent problems solved with the same solution method, (b) by comparing different problem types solved with the same solution method, or (c) by comparing different solution methods to the same problem. Students' conceptual knowledge and procedural flexibility were best supported by comparing solution methods and to a lesser extent by comparing problem types. The benefits of comparison are augmented when examples differ on relevant features, and contrasting methods may be particularly useful in mathematics learning. (Contains 3 figures, 8 tables, and 1 footnote.)
Reviews of Individual Studies 9 3
Exploring the Relative Effectiveness of Reading Interventions for High School Students (2009)
The purpose of this research was to explore the relative effectiveness of intensive reading interventions for struggling high school readers. A yearlong randomized control study was conducted to estimate causal effects, as measured by the criterion-referenced state assessment test, for 1,265 ninth-grade students in 89 classes across 7 high schools in a large school district. Students in the high risk group and the moderate risk group were randomly assigned to one of four intensive reading interventions (three new interventions and a "business as usual" control condition.) Results indicated that for all four interventions, gains made by students in the high risk group exceeded the benchmark for expected annual growth. For the moderate risk group, random effects mixed modeling showed that reliable differences were observed in the state outcome gain scores between two of the intensive interventions and the "business as usual" control condition (Glass's adjusted [delta] = 0.27, 0.30). (Contains 3 tables.)
Reviews of Individual Studies 9-12 3
Cognitive Tutor Algebra I: Evaluation of results (1993–1994). (2008)
Reviews of Individual Studies 8 3
The Effects of Content and Audience Awareness Goals for Revision on the Persuasive Essays of Fifth- and Eighth-Grade Students (2008)
The purpose of the study was to investigate the effects of revising goals focused on content and audience awareness on the persuasive writing of fifth- and eighth-grade students. Students were randomly assigned to three different goal conditions: a general goal; a goal to improve content; and a goal to improve content and communication with an audience. Final drafts of essays were scored for elements of persuasive discourse relevant to content and audience and for overall persuasiveness. Students in the audience goal group were more likely than both other groups to consider opposing positions and rebut them. Students in both the content and audience goal groups wrote essays that were more persuasive than essays by students in the general goal group. The results also indicate that eighth-grade students wrote more persuasively than fifth-grade students and that girls wrote more persuasively than boys.
Reviews of Individual Studies 6-9 3
Desert Sands Unified School District, CA. (2008)
Reviews of Individual Studies 4-5 3
Benefits of Repeated Reading Intervention for Low-Achieving Fourth- and Fifth-Grade Students (2008)
Many students have difficulty achieving reading fluency, and nearly half of fourth graders are not fluent readers in grade-level texts. Intensive and focused reading practice is recommended to help close the gap between students with poor fluency and their average reading peers. In this study, the "Quick Reads" fluency program was used as a supplemental fluency intervention for fourth and fifth graders with below-grade-level reading skills. "Quick Reads" prescribes a repeated reading procedure with short nonfiction texts written on grade-appropriate science and social science topics. Text characteristics are designed to promote word recognition skills. Students were randomly assigned to "Quick Reads" instruction that was implemented by trained paraeducator tutors with pairs of students for 30 minutes per day, 4 days per week, for 18 weeks. At posttest, "Quick Reads" students significantly outperformed classroom controls in vocabulary, word comprehension, and passage comprehension. Fluency rates for both treatment and control groups remained below grade level at posttest. (Contains 5 tables.)
Reviews of Individual Studies 3 3
Remediating Computational Deficits at Third Grade: A Randomized Field Trial (2008)
The major purposes of this study were to assess the efficacy of tutoring to remediate 3rd-grade computational deficits and to explore whether remediation is differentially efficacious depending on whether students experience mathematics difficulty alone or concomitantly with reading difficulty. At 2 sites, 127 students were stratified on mathematics difficulty status and randomly assigned to 4 conditions: word recognition (control) tutoring or 1 of 3 computation tutoring conditions: fact retrieval, procedural computation and computational estimation, and combined (fact retrieval + procedural computation and computational estimation). Results revealed that fact retrieval tutoring enhanced fact retrieval skill, and procedural computation and computational estimation tutoring (whether in isolation or combined with fact retrieval tutoring) enhanced computational estimation skill. Remediation was not differentially efficacious as a function of students' mathematics difficulty status. (Contains 4 tables and 1 footnote.)
Reviews of Individual Studies 3 3
The effects of Read Naturally on grade 3 reading. (2008)
Reviews of Individual Studies 3-4 3
Learning Science in Grades 3-8 Using Probeware and Computers: Findings from the TEEMSS II Project (2008)
The Technology Enhanced Elementary and Middle School Science II project (TEEMSS), funded by the National Science Foundation, produced 15 inquiry-based instructional science units for teaching in grades 3-8. Each unit uses computers and probeware to support students' investigations of real-world phenomena using probes (e.g., for temperature or pressure) or, in one case, virtual environments based on mathematical models. TEEMSS units were used in more than 100 classrooms by over 60 teachers and thousands of students. This paper reports on cases in which groups of teachers taught science topics without TEEMSS materials in school year 2004-2005 and then the same teachers taught those topics using TEEMSS materials in 2005-2006. There are eight TEEMSS units for which such comparison data are available. Students showed significant learning gains for all eight. In four cases (sound and electricity, both for grades 3-4; temperature, grades 5-6; and motion, grades 7-8) there were significant differences in science learning favoring the students who used the TEEMSS materials. The effect sizes are 0.58, 0.94, 1.54, and 0.49, respectively. For the other four units there were no significant differences in science learning between TEEMSS and non-TEEMSS students. We discuss the implications of these results for science education.
Reviews of Individual Studies 4-6 3
What works in afterschool programs: The impact of a reading intervention on student achievement in the Brockton Public Schools (phase II). (2008)
Reviews of Individual Studies 4-8 3
Reading Comprehension: Effects of Individualized, Integrated Language Arts as a Reading Approach with Struggling Readers (2008)
This study examined the effects of individualized, integrated language arts as a reading approach on struggling readers' comprehension scores obtained from oral narrative, silent narrative, and silent expository passages at three levels: below-grade, on-grade, and above-grade levels. Students (N = 93) in grades four through eight, who were reading below grade level, participated in the study. Treatment group students (n = 51) received individualized, integrated language arts as a reading approach once a week in place of basal reading instruction. Comparison group students (n = 42) received basal reading instruction for the duration of the study. Multivariate analysis of covariance was used to analyze posttest Analytical Reading Inventory (ARI) comprehension scores. Several statistically significant (p less than 0.001) differences in comprehension performance were found for on-grade-level scores and for above-grade-level scores, but few differences were found between treatment and comparison groups on below-grade-level scores. All statistically significant differences favored students in the treatment group. The findings of the study strongly suggest that the use of individualized, integrated language arts as a method for teaching reading is an effective approach for improving the reading comprehension performance of struggling readers. (Contains 5 tables.)
Reviews of Individual Studies 5-9 3
Reading improvement report: Miami-Dade regions II and III. (2008)
Reviews of Individual Studies 6 3
Flexibility in Problem Solving: The Case of Equation Solving (2008)
A key learning outcome in problem-solving domains is the development of flexible knowledge, where learners know multiple strategies and adaptively choose efficient strategies. Two interventions hypothesized to improve flexibility in problem solving were experimentally evaluated: prompts to discover multiple strategies and direct instruction on multiple strategies. Participants were 132 sixth-grade students who solved linear equations for three hours. Both interventions improved students' flexibility in problem solving and did not replace, nor interfere with, one another. Overall, the study provides causal evidence that exposure to multiple strategies leads to improved flexibility in problem solving and that discovery learning and direct instruction are compatible instructional approaches. (Contains 6 tables.)
Reviews of Individual Studies 5 3
Teaching Science as a Language: A &quot;Content-First&quot; Approach to Science Teaching (2008)
Our research project was guided by the assumption that students who learn to understand phenomena in everyday terms prior to being taught scientific language will develop improved understanding of new concepts. We used web-based software to teach students using a "content-first" approach that allowed students to transition from everyday understanding of phenomena to the use of scientific language. This study involved 49 minority students who were randomly assigned into two groups for analysis: a treatment group (taught with everyday language prior to using scientific language) and a control group (taught with scientific language). Using a pre-post-test control group design, we assessed students' conceptual and linguistic understanding of photosynthesis. The results of this study indicated that students taught with the "content-first" approach developed significantly improved understanding when compared to students taught in traditional ways. (Contains 8 tables and 2 figures.)
Reviews of Individual Studies 10-11 3
The effect of a test preparation course on the SAT scores of students at Saint Joseph Academy (Doctoral dissertation). (2008)
Reviews of Individual Studies 2-5 3
National Board Certification and Teacher Effectiveness: Evidence from a Random Assignment Experiment. NBER Working Paper No. 14608 (2008)
The National Board for Professional Teaching Standards (NBPTS) assesses teaching practice based on videos and essays submitted by teachers. We compared the performance of classrooms of elementary students in Los Angeles randomly assigned to NBPTS applicants and to comparison teachers. We used information on whether each applicant achieved certification, along with information on each applicant's NBPTS scaled score and subscores, to test whether the NBPTS score was related to teacher impacts on student achievement. We found that students randomly assigned to highly-rated applicants performed better than students assigned to comparison teachers, while students assigned to poorly-rated applicants performed worse. Estimates were similar using data on pairs of teachers that were not randomly assigned. Our results suggest a number of changes that would improve the predictive power of the NBPTS process.
Reviews of Individual Studies 3 3
Effects of Preventative Tutoring on the Mathematical Problem Solving of Third-Grade Students with Math and Reading Difficulties (2008)
This study assessed the effects of preventative tutoring on the math problem solving of third-grade students with math and reading difficulties. Students (n = 35) were assigned randomly to continue in their general education math program or to receive secondary preventative tutoring 3 times per week, 30 min per session, for 12 weeks. Schema-broadening tutoring taught students to (a) focus on the mathematical structure of 3 problem types; (b) recognize problems as belonging to those 3 problem-type schemas; (c) solve the 3 word-problem types; and (d) transfer solution methods to problems that include irrelevant information, 2-digit operands, missing information in the first or second positions in the algebraic equation, or relevant information in charts, graphs, and pictures. Also, students were taught to perform the calculation and algebraic skills foundational for problem solving. Analyses of variance revealed statistically significant effects on a wide range of word problems, with large effect sizes. Findings support the efficacy of the tutoring protocol for preventing word-problem deficits among third-grade students with math and reading deficits. (Contains 3 tables and 1 figure.)
Reviews of Individual Studies 3 3
Effects of Small-Group Tutoring with and without Validated Classroom Instruction on At-Risk Students' Math Problem Solving: Are Two Tiers of Prevention Better than One? (2008)
This study assessed the effects of small-group tutoring with and without validated classroom instruction on at-risk students' math problem solving. Stratifying within schools, 119 3rd-grade classes were randomly assigned to conventional or validated problem-solving instruction (Hot Math, schema-broadening instruction). Students identified as at risk (n = 243) were randomly assigned, within classroom conditions, to receive or not receive Hot Math tutoring. Students were tested on problem-solving and math applications measures before and after 16 weeks of intervention. Analyses of variance, which accounted for the nested structure of the data, revealed that the tutored students who received validated classroom instruction achieved better than the tutored students who received conventional classroom instruction (effect size = 1.34). However, the advantage for tutoring over no tutoring was similar whether students received validated or conventional classroom instruction (effect sizes = 1.18 and 1.13). Tutoring, not validated classroom instruction, reduced the prevalence of math difficulty. Implications for responsiveness-to-intervention prevention models and for enhancing math problem-solving instruction are discussed. (Contains 5 tables, 1 figure and 1 footnote.)
Reviews of Individual Studies 3 3
Effects of Small-Group Tutoring with and without Validated Classroom Instruction on At-Risk Students' Math Problem Solving: Are Two Tiers of Prevention Better than One? (2008)
This study assessed the effects of small-group tutoring with and without validated classroom instruction on at-risk students' math problem solving. Stratifying within schools, 119 3rd-grade classes were randomly assigned to conventional or validated problem-solving instruction (Hot Math, schema-broadening instruction). Students identified as at risk (n = 243) were randomly assigned, within classroom conditions, to receive or not receive Hot Math tutoring. Students were tested on problem-solving and math applications measures before and after 16 weeks of intervention. Analyses of variance, which accounted for the nested structure of the data, revealed that the tutored students who received validated classroom instruction achieved better than the tutored students who received conventional classroom instruction (effect size = 1.34). However, the advantage for tutoring over no tutoring was similar whether students received validated or conventional classroom instruction (effect sizes = 1.18 and 1.13). Tutoring, not validated classroom instruction, reduced the prevalence of math difficulty. Implications for responsiveness-to-intervention prevention models and for enhancing math problem-solving instruction are discussed. (Contains 5 tables, 1 figure and 1 footnote.)
Reviews of Individual Studies K 3
Code-Oriented Instruction for Kindergarten Students at Risk for Reading Difficulties: A Replication and Comparison of Instructional Groupings (2008)
The purposes of this study were to replicate previous research on phonics-based tutoring in kindergarten and to compare treatment effects for students who received individual instruction compared to instruction in dyads. Thirty classroom teachers from 13 urban elementary schools referred at-risk students for participation. Students who met screening criteria were quasi-randomly assigned, within classroom, to one of three conditions: individual tutoring (n = 22), tutoring in dyads (n = 32), or no tutoring (n = 22, classroom instruction only). Twenty-one paraeducators provided 18 weeks of explicit instruction in phonemic skills and the alphabetic code to students during the latter half of kindergarten. Multilevel model results showed that tutored students outperformed non-tutored controls on posttest measures of phonological awareness, word reading accuracy, oral reading fluency, spelling, and comprehension. However, no significant differences were found between the two tutored groups on any measure, suggesting that code-oriented tutoring for pairs of students is a viable alternative to the gold standard of individual instruction.
Reviews of Individual Studies K 3
Pathways to literacy: A study of invented spelling and its role in learning to read. (2008)
This intervention study tested whether invented spelling plays a causal role in learning to read. Three groups of kindergarten children (mean age = 5 years 7 months) participated in a 4-week intervention. Children in the invented-spelling group spelled words as best they could and received developmentally appropriate feedback. Children in the 2 comparison groups were trained in phonological awareness or drew pictures. Invented-spelling training benefited phonological and orthographic awareness and reading of words used in the intervention. Importantly, the invented-spelling group learned to read more words in a learn-to-read task than the other groups. The findings are in accord with the view that invented spelling coupled with feedback encourages an analytical approach and facilitates the integration of phonological and orthographic knowledge, hence facilitating the acquisition of reading.
Reviews of Individual Studies 9-12 3
Making a difference? The effects of Teach for America in high school (CALDER Working Paper 17). (2007)
This research investigates the relative effectiveness (in terms of student tested achievement) of Teach for America (TFA) teachers, and examines the validity of the criticisms of TFA. Specifically, the authors look at TFA teachers in secondary schools, and especially in math and science, where considerable program growth is planned over the next few years. Using individual level student data linked to teacher data in North Carolina, the authors estimate the effects of having a TFA teacher compared to a traditional teacher on student performance. The North Carolina data they employ are uniquely suited for this type of analysis because it includes end of course (EOC) testing for students across multiple subjects. This allows them to employ statistical methods that attempt to account for the nonrandom nature of student assignments to classes/teachers, which have been shown to lead to biased estimates of the impact of teacher credentials (Clotfelter, Ladd, and Vigdor, 2007a; Goldhaber, 2007). The findings show that TFA teachers are more effective, as measured by student exam performance, than traditional teachers. Moreover, the authors suggest that the TFA effect, at least in the grades and subjects investigated, exceeds the impact of additional years of experience, implying that TFA teachers are more effective than experienced secondary school teachers. The positive TFA results are robust across subject areas, but are particularly strong for math and science classes. An appendix is included. (Contains 1 figure, 12 tables, 1 exhibit and 14 footnotes.) [This report was supported by the Steven L. Merrill Family Foundation.]
Reviews of Individual Studies K-1 3
Literacy Progress of Young Children from Poor Urban Settings: A Reading Recovery Comparison Study (2007)
This naturalistic inquiry evaluated the impact of early literacy intervention on children in London schools. The progress, in the 2005-06 school year, was compared for 234 of the lowest-achieving children in 42 schools serving disadvantaged urban areas. The children, aged around 6 years who received Reading Recovery in their schools, were compared with those in schools which provided them with a range of other interventions. Both groups started the year with literacy levels below that of a 5-year-old. Comparison between the groups was made for reading and writing and phonic knowledge as well as oracy, work habits, social skills, and attitudes to learning. Those children who received Reading Recovery achieved significant gains in all assessments compared with those who did not. At the end of the year the children who had received Reading Recovery had an average reading age of 6 years 7 months, in line with their chronological age. The comparison group was 14 months behind, with an average reading age of 5 years 5 months. The study also evaluated classroom literacy. A word recognition and phonic skills measure was used with all children in the sample Year 1 (age 5-6) classroom in schools with Reading Recovery (605 children) and without Reading Recovery (566 children). Children in sample classrooms, with Reading Recovery available to the lowest group, ended the year with an average reading age 4 months above that of children in comparison classrooms. (Contains 9 figures, 9 tables, and 2 footnotes.)
Reviews of Individual Studies K-2 3
Final Reading Outcomes of the National Randomized Field Trial of Success for All (2007)
Using a cluster randomization design, schools were randomly assigned to implement Success for All, a comprehensive reading reform model, or control methods. This article reports final literacy outcomes for a 3-year longitudinal sample of children who participated in the treatment or control condition from kindergarten through second grade and a combined longitudinal and in-mover student sample, both of which were nested within 35 schools. Hierarchical linear model analyses of all three outcomes for both samples revealed statistically significant school-level effects of treatment assignment as large as one third of a standard deviation. The results correspond with the Success for All program theory, which emphasizes both comprehensive school-level reform and targeted student-level achievement effects through a multi-year sequencing of literacy instruction. (Contains 5 tables.)
Reviews of Individual Studies 2-8 3
Effect of Technology-Enhanced Continuous Progress Monitoring on Math Achievement (2007)
We examined the extent to which use of a technology-enhanced continuous progress monitoring system would enhance the results of math instruction, examined variability in teacher implementation of the program, and compared math results in classrooms in which teachers did and did not use the system. Classrooms were randomly assigned to within-school experimental and control groups. Participating students were pre- and post-tested using two standardized, nationally normed tests of math achievement. When teachers implemented the continuous progress monitoring system as intended, and when they used the data from the system to manage and differentiate instruction, students gained significantly more than those for whom implementation was limited or nil. Failure to take into account intervention integrity would have made it look like continuous progress monitoring did not enhance math results. (Contains 5 tables.)
Reviews of Individual Studies 1 3
Reading rescue: An effective tutoring intervention model for language-minority students who are struggling readers in first grade. (2007)
This report describes the effects of Project Graduation Really Achieves Dreams (GRAD) on student progress at three high schools in Houston (the initiative's original site) and at high schools in two other school districts (Columbus, Ohio, and Atlanta, Georgia). MDRC--a nonprofit, nonpartisan research organization--conducted a third-party evaluation to determine the effects of Project GRAD by comparing the changes in student outcomes at Project GRAD schools with changes at similar, non-Project GRAD schools in the same districts. (A companion report discusses findings for Project GRAD elementary schools.) In general, Project GRAD student outcomes are tracked from the implementation of the first components of the model at each site until the 2002-2003 school year. The key findings of this report are: At Jefferson Davis High School in Houston, the initiative's flagship school, Project GRAD had a statistically significant positive impact on the proportion of students who completed a core academic curriculum on time--that is, received an average grade of 75 out of 100 in their core courses; earned four credits in English, three in math, two in science, and two in social students; and graduated from high school within four years. As Project GRAD expanded into two other Houston high schools, these positive effects on students' academic preparation were not evident. Student outcomes at the newer Project GRAD high schools improved, but generally this progress was matched by progress at the comparison high schools. Improvements in graduation rates at the three Project GRAD Houston high schools were generally matched by improvements in graduation rates at the comparison schools. Looking at early indicators of student success, the initial Project GRAD high schools in Columbus and Atlanta showed improvements in attendance and promotion to tenth grade that appear to have outpaced improvements at the comparison schools, although the differences are only sometimes statistically significant. The following are appended: (1) The Impacts on High School Graduation among All Ninth-Grade Students in Houston; (2) High School Achievement in Houston: Was There Shifting of the Pool of Test-Takers?; and (3) Selecting Comparison Schools. (Contains 3 boxes, 6 tables, and 20 figures.) [Additional supplemental funding for this document was provided by the Lucent Technologies Foundation; and Project GRAD USA.]
Reviews of Individual Studies 7 3
Scaling up SimCalc project: Can a technology enhanced curriculum improve student learning of important mathematics? (Technical Report 01). (2007)
Reviews of Individual Studies 7 3
Does Comparing Solution Methods Facilitate Conceptual and Procedural Knowledge? An Experimental Study on Learning to Solve Equations (2007)
Encouraging students to share and compare solution methods is a key component of reform efforts in mathematics, and comparison is emerging as a fundamental learning mechanism. To experimentally evaluate the effects of comparison for mathematics learning, the authors randomly assigned 70 seventh-grade students to learn about algebra equation solving by either (a) comparing and contrasting alternative solution methods or (b) reflecting on the same solution methods one at a time. At posttest, students in the compare group had made greater gains in procedural knowledge and flexibility and comparable gains in conceptual knowledge. These findings suggest potential mechanisms behind the benefits of comparing contrasting solutions and ways to support effective comparison in the classroom.
Reviews of Individual Studies 7 3
Implicit Theories of Intelligence Predict Achievement across an Adolescent Transition: A Longitudinal Study and an Intervention (2007)
Two studies explored the role of implicit theories of intelligence in adolescents' mathematics achievement. In Study 1 with 373 7th graders, the belief that intelligence is malleable (incremental theory) predicted an upward trajectory in grades over the two years of junior high school, while a belief that intelligence is fixed (entity theory) predicted a flat trajectory. A mediational model including learning goals, positive beliefs about effort, and causal attributions and strategies was tested. In Study 2, an intervention teaching an incremental theory to 7th graders (N=48) promoted positive change in classroom motivation, compared with a control group (N=43). Simultaneously, students in the control group displayed a continuing downward trajectory in grades, while this decline was reversed for students in the experimental group.
Reviews of Individual Studies 6-7 3
A Pilot Evaluation of Small Group Challenging Horizons Program (CHP): A Randomized Trial (2007)
This study examined the efficacy of an after-school program, the Challenging Horizons Program (CHP), that met four days a week and focused on improving organization, academic skills, and classroom behavior. The CHP was compared with a community control that included involvement in a district-run after-school program that met one to three days a week and focused on preparation for standardized testing. Participants were 48 middle-school youth, referred as experiencing a combination of learning and behavior problems, randomly assigned to either the CHP or the control. Parent and teacher ratings of behavioral and academic functioning were collected at the beginning of the academic year and again after one semester of intervention. Relative to the control, participants in the CHP made significant improvements in parent rated academic progress, self-esteem, and overall severity of problem. While teacher ratings did not reach significance, CHP participants made medium effect size improvements in academic progress and small improvements in overall severity. Core class grades and discipline records were also examined to provide a broad picture of functioning beyond rating scale data.
Reviews of Individual Studies 9 3
Instructional Sensitivity of a Complex Language Arts Performance Assessment (2007)
Validation of assessments intended to improve instruction and learning should include evidence of instructional sensitivity. This study investigated the instructional sensitivity of a standards-based ninth-grade performance assessment that required students to write an essay about conflict in a literary work. Before administering the assessment, teachers of 886 ninth-grade students were randomly assigned to one of three instructional groups: literary analysis, organization of writing, and teacher-selected instruction. Despite the short duration of instruction (8 class periods), results support the instructional sensitivity of the assessment in two ways: Instruction on literary analysis significantly improved students' ability to analyze and describe conflicts in literature, and instruction on the organization of writing led to significantly higher scores on measures of coherence and organization. (Contains 9 tables. Appended are: (1) Example of Writing Group Lesson; (2) Example of Literary Analysis Group Lesson; (3) The English-Language Arts Grade 9 Performance Assessment Rubric; and (4) CRESST/LAUSD Instructional Sensitivity Study Score Sheet.)
Reviews of Individual Studies 4-8 3
Effect of a Combined Repeated Reading and Question Generation Intervention on Reading Achievement (2006)
Research was conducted to ascertain if a combined repeated reading and question generation intervention was effective at improving the reading achievement of fourth through eighth grade students with learning disabilities or who were at risk for reading failure. Students were assigned to a treatment or control group via a stratified random sampling. Instructional components and training were based on best practices reported in the literature. Students receiving intervention significantly improved their reading speed and ability to answer inferential comprehension questions on passages that were reread. Compared to the control group, students in the intervention group also made significant gains in oral reading fluency on independent passages.
Reviews of Individual Studies 1 3
The Effects of Computer-Assisted Instruction on Number Combination Skill in At-Risk First Graders (2006)
The purpose of this pilot study was to assess the potential for computer-assisted instruction (CAI) to enhance number combination skill among children with concurrent risk for math disability and reading disability. A secondary purpose was to examine the effects of CAI on spelling. At-risk students were assigned randomly to math or spelling CAI, which they received in 50 sessions over 18 weeks. Acquisition and transfer effects were assessed. The results indicated that math CAI was effective in promoting addition but not subtraction number combination skill and that transfer to arithmetic story problems did not occur. Spelling CAI effects were reliable on acquisition and transfer spelling measures, with small to moderate effect sizes on transfer to reading measures. These results provide the basis for additional work with larger samples.
Reviews of Individual Studies 11-12 3
Study of the Effect of the Talent Search Program on Secondary and Postsecondary Outcomes in Florida, Indiana and Texas. Final Report from Phase II of the National Evaluation (2006)
Low-income students and students whose parents have not attended college typically are less likely than middle- and upper-income students to complete high school and attend college, and are thus less likely to reap the benefits of attending college. Lack of information, resources, and exposure to others who have navigated the college process may be substantial hurdles for these students. Federal financial aid is available through Pell Grants, college tuition tax credits, and student loan programs, but low-income students may not be taking full advantage of these sources. Even low-income students with high educational aspirations may find the financial aid and college application processes overwhelming and discouraging. The Talent Search program primarily provides information on the types of high school courses students should take to prepare for college and on the financial aid available to pay for college. The program also helps students access financial aid through applications for grants, loans, and scholarships, and orients students to different types of colleges and the college application process. After a two-year implementation study, the U.S. Department of Education's Policy and Program Studies Service selected Mathematica Policy Research Inc. (MPR) in 2000 to assess the effect of Talent Search in selected states. The study team opted to compile data from administrative records from many sources, including program, state, and federal records, to evaluate the effectiveness of federal education programs, partly as a test of whether such an evaluation was feasible. The study also yielded useful information about the effectiveness of the Talent Search program. It included an analysis of the effectiveness of the Talent Search program in Florida, Indiana, and Texas. The study team's analysis was based on administrative data compiled in these three states and a quasi-experimental design to create matched comparison groups. The findings presented in this report suggest that assisting low-income students who have college aspirations to overcome information barriers--an important objective of the Talent Search program--may be effective in helping these students achieve their aspirations. Practical information--direct guidance on how to complete applications for financial aid and admission to college and what a college campus looks and feels like--may have been one of the key services that Talent Search projects delivered. Appended are: (1) Chapter Tables; and (2) Compilation of Data Sources and Feasibility of Evaluations Based on Administrative Records. (Contains 38 tables and 15 figures.)
Reviews of Individual Studies 11-12 3
Study of the Effect of the Talent Search Program on Secondary and Postsecondary Outcomes in Florida, Indiana and Texas. Final Report from Phase II of the National Evaluation (2006)
Low-income students and students whose parents have not attended college typically are less likely than middle- and upper-income students to complete high school and attend college, and are thus less likely to reap the benefits of attending college. Lack of information, resources, and exposure to others who have navigated the college process may be substantial hurdles for these students. Federal financial aid is available through Pell Grants, college tuition tax credits, and student loan programs, but low-income students may not be taking full advantage of these sources. Even low-income students with high educational aspirations may find the financial aid and college application processes overwhelming and discouraging. The Talent Search program primarily provides information on the types of high school courses students should take to prepare for college and on the financial aid available to pay for college. The program also helps students access financial aid through applications for grants, loans, and scholarships, and orients students to different types of colleges and the college application process. After a two-year implementation study, the U.S. Department of Education's Policy and Program Studies Service selected Mathematica Policy Research Inc. (MPR) in 2000 to assess the effect of Talent Search in selected states. The study team opted to compile data from administrative records from many sources, including program, state, and federal records, to evaluate the effectiveness of federal education programs, partly as a test of whether such an evaluation was feasible. The study also yielded useful information about the effectiveness of the Talent Search program. It included an analysis of the effectiveness of the Talent Search program in Florida, Indiana, and Texas. The study team's analysis was based on administrative data compiled in these three states and a quasi-experimental design to create matched comparison groups. The findings presented in this report suggest that assisting low-income students who have college aspirations to overcome information barriers--an important objective of the Talent Search program--may be effective in helping these students achieve their aspirations. Practical information--direct guidance on how to complete applications for financial aid and admission to college and what a college campus looks and feels like--may have been one of the key services that Talent Search projects delivered. Appended are: (1) Chapter Tables; and (2) Compilation of Data Sources and Feasibility of Evaluations Based on Administrative Records. (Contains 38 tables and 15 figures.)
Reviews of Individual Studies 2 3
Paraeducator-Supplemented Instruction in Structural Analysis with Text Reading Practice for Second and Third Graders at Risk for Reading Problems (2006)
Reviews of Individual Studies K-4 3
Progress report of the randomized trial of Positive Action in Hawaii: End of third year of intervention. (2006)
Reviews of Individual Studies K 3
Code-Oriented Instruction for Kindergarten Students at Risk for Reading Difficulties: A Randomized Field Trial with Paraeducator Implementers (2006)
The purpose of this study was to evaluate the effectiveness of code-oriented supplemental instruction for kindergarten students at risk for reading difficulties. Paraeducators were trained to provide 18 weeks of explicit instruction in phonemic skills and the alphabetic code. Students identified by their teachers meeting study eligibility criteria were randomly assigned to 2 groups: individual supplemental instruction and control. Students were pretested in December, midtested, and posttested in May-June of kindergarten. At posttest, treatment students significantly outperformed controls on measures of reading accuracy, reading efficiency, oral reading fluency, and developmental spelling. Treatment students had significantly higher linear growth rates in phonemic awareness and alphabetic knowledge during the kindergarten treatment. At a 1-year follow-up, significant group differences remained in reading accuracy and efficiency. Ethical challenges of longitudinal intervention research are discussed. Findings have policy implications for making supplemental instruction in critical early reading skills available.
Reviews of Individual Studies K 3
Code-oriented instruction for kindergarten students at risk for reading difficulties: A randomized field trial with paraeducator implementers. (2006)
According to the National Assessment of Educational Progress, nearly 4 in 10 fourth graders read below the basic level. These literacy problems get worse as students advance through school and are exposed to progressively more complex concepts and courses. The purpose of this study was to assess the effectiveness of four remedial reading programs in improving the reading skills of 3rd and 5th graders, whether the impacts of the programs vary across students with difference baseline characteristics, and to what extent can this instruction close the reading gap and bring struggling readers within the normal range--relative to the instruction normally provided by their schools. The study took place in elementary schools in 27 districts of the Allegheny Intermediate Unit outside Pittsburgh, PA during the 2003-04 school year. Within each of 50 schools, 3rd and 5th grade students were identified as struggling readers by their teachers. These students were tested and were eligible for the study if they scored at or below the 30th percentile on a word-level reading test and at or above the 5th percentile on a vocabulary test. The final sample contains a total of 742 students. There are 335 3rd graders ? 208 treatment and 127 control students. There are 407 5th graders ? 228 treatment and 179 control students. Four existing programs were used: Spell Read P.A.T., Corrective Reading, Wilson Reading, and Failure Free Reading. Corrective Reading and Wilson Reading were modified to focus only on word-level skills. Spell Read P.A.T. and Failure Free Reading were intended to focus equally on word-level skills and reading comprehension/vocabulary. Teachers received 70 hours of professional development and support during the year. Instruction was delivered in small groups of 3 students, 5 days a week, for a total of 90 hours. Seven measures of reading skill were administered at the beginning and end of the school year to assess student progress: Word Attack, Word Identification Comprehension (Woodcock Reading Mastery Test); Phonemic Decoding Efficiency and Sight Word Efficiency (Test of Word Reading Efficiency); Oral Reading Fluency (Edformation); and Passage Comprehension (Group Reading Assessment and Diagnostic Evaluation). After one year of instruction, there were significant impacts on phonemic decoding, word reading accuracy and fluency, and comprehension for 3rd graders, but not for 5th graders. For third graders in the reading programs, the gap in word attach skills between struggling readers and average readers was reduced by about two-thirds. It was found that reading skills of 3rd graders can be significantly improved through instruction in word-level skills, but not the reading skills of 5th graders. The following are appended: (1) Details of Study Design and Implementation; (2) Data Collection; (3) Weighting Adjustment and Missing Data; (4) Details of Statistical Methods; (5) Intervention Impacts on Spelling and Calculation; (6) Instructional Group Clustering; (7) Parent Survey; (8) Teacher Survey and Behavioral Rating Forms; (9) Instructional Group Clustering; (10) Videotape Coding Guidelines for Each Reading Program; (11) Supporting Tables; (12) Sample Test Items; (13) Impact Estimate Standard Errors and P-Values; (14) Association between Instructional Group Heterogeneity and The Outcome; (15) Teacher Rating Form; (16) School Survey; and (17) Scientific Advisory Board. [This report was produced by the Corporation for the Advancement of Policy Evaluation. Additional support provided by the Barksdale Reading Institute, and the Haan Foundation for Children.]
Reviews of Individual Studies K-1 3
The effect of computer-delivered phonological awareness training on the early literacy skills of students identified as at-risk for reading failure. (2006)
Reviews of Individual Studies K-1 3
Severe Reading Difficulties--Can They Be Prevented? A Comparison of Prevention and Intervention Approaches (2005)
This study evaluated the efficacy of a preventative program delivered in kindergarten to children who were identified as being at risk for experiencing reading difficulties. It also examined the effects of two 1st-grade intervention programs delivered to children who demonstrated substantial difficulty with reading development at the beginning of 1st grade. The 1st-grade programs differed in the amount of emphasis placed on helping the children to develop phonological skills versus providing the children with the opportunity to read connected text with guidance. These kindergarten and 1st-grade intervention approaches were instituted in an effort to identify instructional approaches that would reduce the incidence of reading difficulties among at-risk children. Of particular interest was reduction in the incidence of treatment resisters--children who continue to experience serious reading difficulties despite being provided with early and intensive intervention services to alleviate their early difficulties. The results indicated that the kindergarten intervention program was effective in reducing the number of children who qualified as poor readers in 1st grade and in reducing the incidence of treatment resistance at the end of 1st grade regardless of the type of intervention provided in 1st grade. The data further suggested that the 1st-grade intervention approach that emphasized the development of phonological skills was more effective in reducing the incidence of treatment resistance than the program that emphasized engaging the children in reading connected text.
Reviews of Individual Studies K 3
An investigation of the effects of a prereading intervention on the early literacy skills of children at risk of emotional disturbance and reading problems. (2005)
The purpose of this study was to investigate the effects of a cohesive and intensive preventive prereading intervention on the phonological awareness, word reading, and rapid naming skills of children at risk of emotional disturbance and reading problems. Thirty-six children were assigned randomly to an experimental or comparison condition. Children in the experimental condition received "Stepping Stones to Literacy". "Stepping Stones" includes 25 lessons designed to teach children pivotal prereading skills (e. g., phonological awareness, letter identification). Children in the experimental condition showed statistically significant improvements in their phonological awareness, word reading, and rapid naming skills relative to children in the comparison condition. Effect size estimates indicate that the improvements were moderate to large across all of the phonological awareness, word reading, and rapid naming measures. Treatment nonresponder analyses indicated that a relatively small number of children in the experimental group failed to show satisfactory gains in their phonological awareness (n = 3), word reading (n = 1), and rapid naming (n = 3) skills.
Reviews of Individual Studies K 3
Effects of a prereading intervention on the literacy and social skills of children. (2005)
This study investigated the effects of an intensive prereading intervention on the beginning reading skills and social behavior of kindergarten children at risk for behavioral disorders and reading difficulties. Children identified through a systematic screening process were assigned randomly to experimental or nonspecific treatment conditions. Children who received the intensive prereading intervention showed statistically and educationally significant gains in their beginning reading skills relative to their counterparts in the nonspecific treatment condition. In contrast, improvements in teacher ratings of the classroom competence, emotional and behavioral self-control, and self-confidence of children in the experimental and nonspecific treatment conditions were not statistically significant from one another. (Contains 3 tables.)
Reviews of Individual Studies 9-12 3
Promoting School Completion of Urban Secondary Youth with Emotional or Behavioral Disabilities (2005)
An experimental research design was used to examine the effectiveness of a targeted, long-term intervention to promote school completion and reduce dropout among urban high school students with emotional or behavioral disabilities. African American (67%) males (82%) composed a large portion of the sample. This intervention study was a replication of an empirically supported model referred to as check & connect. Study participants included 144 ninth graders, randomly assigned to the treatment or control group. The majority of youth were followed for 4 years, with a subsample followed for 5 years. Program outcomes included lower rates of dropout and mobility, higher rates of persistent attendance and enrollment status in school, and more comprehensive transition plans.
Reviews of Individual Studies 3 3
Building a Foundation against Violence: Impact of a School-Based Prevention Program on Elementary Students (2005)
This study examined the effectiveness of the Too Good for Violence Prevention Program (TGFV), a multifaceted interactive intervention. Grounded in Bandura's Social Learning Theory, the TGFV curricula focus on developing personal and interpersonal skills to solve conflict non-violently and resist social influences that lead to violence. Participants were 999 third grade students and 46 teachers in ten elementary schools. The schools were matched on student characteristics and academic performance and assigned to treatment or control conditions. Teachers and students completed checklists assessing students' behaviors prior to, following, and 20 weeks after program delivery. Results show that treatment students, as compared to control students, were perceived by teachers as evidencing more frequent use of personal and social skills and of prosocial behaviors after program delivery. Student survey data show that treatment students, as compared to control students, evidenced more positive scores in the areas of emotional competency skills, social and resistance skills, and communication skills after program delivery. The benefits of the TGFV program continued to be observed at the 20-week follow-up. (Contains 6 tables.)
Reviews of Individual Studies 1 3
The Prevention, Identification, and Cognitive Determinants of Math Difficulty (2005)
This study examined the efficacy of preventive 1st-grade tutoring in mathematics, estimated the prevalence and severity of mathematics disability, and explored pretreatment cognitive characteristics associated with mathematics development. Participants were 564 first graders, 127 of whom were designated at risk (AR) for mathematics difficulty and randomly assigned to tutoring or control conditions. Before treatment, all participants were assessed on cognitive and academic measures. Tutoring occurred 3 times weekly for 16 weeks; treatment fidelity was documented; and math outcomes were assessed. Tutoring efficacy was supported on computation and concepts/applications, but not on fact fluency. Tutoring decreased the prevalence of math disability, with prevalence and severity varying as a function of identification method and math domain. Attention accounted for unique variance in predicting each aspect of end-of-year math performance. Other predictors, depending on the aspect of math performance, were nonverbal problem solving, working memory, and phonological processing.
Reviews of Individual Studies 1 3
Relative Effectiveness of Reading Practice or Word-Level Instruction in Supplemental Tutoring: How Text Matters (2005)
In this quasi-experimental study, which is part of a series of investigations on supplemental reading tutoring variations, the relative effectiveness of more intense decoding instruction or text reading practice was examined. Fifty-seven first-grade students scoring in the lowest quartile for reading skills received either classroom reading instruction or one of two treatments: tutoring in word study with text reading practice, or word study tutoring alone. Individual instruction was provided by trained paraprofessional tutors. At the end of first grade, treatment students significantly out performed their nontutored peers on measures of reading accuracy, reading comprehension, reading efficiency, passage reading fluency, and spelling. Differential treatment effects on passage reading fluency are examined, taking into consideration pretest skill levels and text reading practice characteristics.
Reviews of Individual Studies 1 3
Severe Reading Difficulties--Can They Be Prevented? A Comparison of Prevention and Intervention Approaches (2005)
Reviews of Individual Studies 1-2 3
Improved early reading skills by students in three districts who used Fast ForWord® to Reading 1. (2005)
Reviews of Individual Studies 1 3
Literacy learning of at-risk first-grade students in the Reading Recovery early intervention. (2005)
This study investigated the effectiveness and efficiency of the Reading Recovery early intervention. At-risk 1st-grade students were randomly assigned to receive the intervention during the 1st or 2nd half of the school year. High-average and low-average students from the same classrooms provided additional comparisons. Thirty-seven teachers from across the United States used a Web-based system to register participants (n = 148), received random assignment of the at-risk students from this system, and submitted complete data sets. Performance levels were measured at 3 points across the year on M. M. Clay's (1993a) observation survey tasks, 2 standardized reading measures, and 2 phonemic awareness measures. The intervention group showed significantly higher performance compared with the random control group and no differences compared with average groups. Further analyses explored the efficiency of Reading Recovery to identify children for early intervention service and subsequent long-term literacy support.
Reviews of Individual Studies 3-6 3
Peer-Assisted Learning Strategies for English Language Learners with Learning Disabilities (2005)
This study assessed the effects of Peer-Assisted Learning Strategies (PALS), a reciprocal classwide peer-tutoring strategy, on the reading performance of native Spanish-speaking students with learning disabilities (LD) and their low-, average-, and high-achieving classroom peers. Participants were 132 native Spanish-speaking English language learners (ELL) in Grades 3 through 6, along with their 12 reading teachers. Teachers were assigned randomly to PALS and contrast groups. PALS sessions were conducted 3 times a week for 15 weeks. Students were tested before and after treatment. PALS students outgrew contrast students on reading comprehension, and those effects were not mediated by student type.
Reviews of Individual Studies 6-10 3
Help with English Language Proficiency &ldquo;HELP&rdquo; program evaluation of sheltered instruction multimedia lessons. (2005)
Reviews of Individual Studies 6-8 3
Effects of Mathematical Word Problem-Solving Instruction on Middle School Students with Learning Problems (2005)
This study investigated the differential effects of two problem-solving instructional approaches--schema-based instruction (SBI) and general strategy instruction (GSI)--on the mathematical word problem-solving performance of 22 middle school students who had learning disabilities or were at risk for mathematics failure. Results indicated that the SBI group significantly outperformed the GSI group on immediate and delayed posttests as well as the transfer test. Implications of the study are discussed within the context of the new IDEA amendment and access to the general education curriculum.
Reviews of Individual Studies 4-8 3
Improved reading achievement by students in the school district of Philadelphia who used Fast ForWord® products. (2004b)
Reviews of Individual Studies 1 3
Effects of reading decodable texts in supplemental first-grade tutoring. (2004)
At-risk 1st graders were randomly assigned to tutoring in more or less decodable texts, and instruction in the same phonics program. The more decodable group (n = 39) read storybooks that were consistent with the phonics program. The less decodable group (n = 40) read storybooks written without phonetic control. During the first 30 lessons, storybook decodability was 85% versus 11% for the 2 groups. Tutoring occurred 4 days per week for 25 weeks. A control group did not receive tutoring in phonics or story reading. Both tutored groups significantly surpassed the control on an array of decoding, word reading, passage reading, and comprehension measures. However, the more and less decodable text groups did not differ on any posttest.
Reviews of Individual Studies 1 3
Accelerating the Development of Reading, Spelling and Phonemic Awareness Skills in Initial Readers (2004)
In Experiment 1, it was found that 5-year-old new school entrants taught by a synthetic phonics method had better reading, spelling and phonemic awareness than two groups taught analytic phonics. The synthetic phonics children were the only ones that could read by analogy, and they also showed better reading of irregular words and nonwords. For one analytic phonics group the programme was supplemented by phonological awareness training; this led to gains in phonemic awareness but not reading or spelling compared with the other analytic phonics group. The synthetic phonics programme was taught to the analytic phonics groups after their initial programmes had been completed and post-tested. The group that had had phonological awareness training did not perform better than the other two groups when tested 15 months later; this was also the case when the same comparison was made for the subset of children that had started school with weak phonological awareness skill. Speed of letter learning was controlled for in Experiment 2; it was found that the synthetic phonics group still read and spelt better than the analytic phonics group. It was concluded that synthetic phonics was more effective than analytic phonics, and that with the former approach it was not necessary to carry out supplementary training in phonological awareness.
Reviews of Individual Studies 2-3 3
Effects of intensive reading remediation for second and third graders and a 1-year follow-up. (2004)
Second- and 3rd-grade children with poor word-level skills were randomly assigned to 8 months of explicit instruction emphasizing the phonologic and orthographic connections in words and text-based reading or to remedial reading programs provided by the schools. At posttest, treatment children showed significantly greater gains than control children in real word and nonword reading, reading rate, passage reading, and spelling, and largely maintained gains at a 1-year follow-up. Growth curve analyses indicated significant differences in growth rate during the treatment year, but not during the follow-up year. Results indicate that research-based practices can significantly improve reading and spelling outcomes for children in remedial programs.
Reviews of Individual Studies K-8 3
The Teacher Advancement Program report two: Year three results from Arizona and year one results from South Carolina TAP schools. (2004)
Reviews of Individual Studies K-4 3
The effects of a group-oriented contingency—the Good Behavior Game—on the disruptive behavior of children with developmental disabilities (2003)
Reviews of Individual Studies 2 3
The Differential Effects of Teaching Addition through Strategy Instruction versus Drill and Practice to Students with and without Learning Disabilities. (2003)
This study compared instruction in addition using either a minimum addend strategy or drill and practice with 84 students either with or without learning disabilities (LD). Students with LD improved significantly only in the strategy condition, whereas general education students improved in both the strategy and the drill-and-practice conditions. In a transfer task, students from both groups improved only in the strategy conditions. (Contains references.) (Author/DB)
Reviews of Individual Studies 2 3
The Differential Effects of Teaching Addition through Strategy Instruction versus Drill and Practice to Students with and without Learning Disabilities. (2003)
This study compared instruction in addition using either a minimum addend strategy or drill and practice with 84 students either with or without learning disabilities (LD). Students with LD improved significantly only in the strategy condition, whereas general education students improved in both the strategy and the drill-and-practice conditions. In a transfer task, students from both groups improved only in the strategy conditions. (Contains references.) (Author/DB)
Reviews of Individual Studies 1-6 3
Long-Term Effects of the Positive Action Program. (2003)
Used a matched-schools design, school-level achievement, and disciplinary data to evaluate the effectiveness of the elementary-level Positive Action program on students' performance and behavior over time. Results indicated that program participation improved student behavior, school involvement, and academic achievement into high school. The program had equally strong behavioral effects in higher risk schools. There was a clear dose-response relationship for most outcomes. (SM)
Reviews of Individual Studies 3-5 3
The impact of a computer-based training system on strengthening phonemic awareness and increasing reading ability level (Doctoral dissertation). (2003)
Reviews of Individual Studies 6 3
The effects of rime- and phoneme-based teaching delivered by learning support assistants. (2003)
Reviews of Individual Studies 7 3
Description and evaluation of Reasoning Mind’s 2003 pilot project. (2003)
Reviews of Individual Studies 9-10 3
The Core-Plus Mathematics project: Perspectives and student achievement. (2002)
Reviews of Individual Studies 2 3
Contribution of spelling instruction to the spelling, writing, and reading of poor spellers. (2002)
Reviews of Individual Studies K 3
Beginning Reading by Teaching in Rime Analogy: Effects on Phonological Skills, Letter-Sound Knowledge, Working Memory, and Word-Reading Strategies. (2002)
Finds teaching prereading kindergartners in the rime analogy strategy and prereading skills resulted in more reading than teaching either alone. Notes many children developed the untaught abilities of medial and final phoneme identity and the letter recoding reading strategy; and children were able to generalize the rime analogy strategy to read words with unfamiliar rime spellings. (RS)
Reviews of Individual Studies K 3
Emergent Literacy Skills and Training Time Uniquely Predict Variability in Responses to Phonemic Awareness Training in Disadvantaged Kindergartners. (2002)
Investigated factors that predicted variability in responses to analytic and synthetic phonemic awareness training with kindergartners living in poverty. Found that spelling skills were the most consistent predictor of variability in phonemic awareness in response to instruction. Amount of exposure children had to the intervention contributed to individual differences in phonemic awareness and spelling. (JPB)
Reviews of Individual Studies 9-12 3
Impact on high school students’ behaviors and protective factors: A pilot study of the Too Good for Drugs and Violence prevention program. (2001)
Reviews of Individual Studies K-1 3
The Effects of Computer Software for Developing Phonological Awareness in Low-Progress Readers. (2001)
Examines the effectiveness of two computer programs designed to increase phonological awareness in young children. Finds that children who received computer-administered phonological awareness instruction and children who received teacher-delivered phonological awareness instruction showed a significant increase in phonological processing over that of the instructional technology control group. (SG)
Reviews of Individual Studies 1-6 3
The effectiveness of a group reading instruction program with poor readers in multiple grades. (2001)
This study evaluated the effectiveness of a phonologically based reading program delivered to first- through sixth-grade impaired readers (N=115) in small groups. Post-tests after program completion found the program resulted in significantly better phonological awareness, decoding, reading accuracy, comprehension, and spelling. Improved skills were evident regardless of original level of deficiency and were not limited to specific grades. (Contains references.) (Author/DB)
Reviews of Individual Studies 12 3
Integrating a Structured Ethical Reflection Curriculum into High School Community Service Experiences: Impact on Students' Sociomoral Development. (2001)
Within the field of community services it is widely accepted that reflection is an important factor in personal and sociomoral development. The purpose of this research was to determine if a particular form of reflection-decision making with an emphasis on the ethical nature of community-has special value in achieving service-learning goals. (BF)
Reviews of Individual Studies 1 3
Teaching Rime Analogy or Letter Recoding Reading Strategies to Prereaders: Effects on Prereading Skills and Word Reading. (2001)
Examines teaching rime analogy or letter recoding reading strategies to prereaders. Results reveal that experience with rime analogy increased letter recoding ability, but teaching in letter recoding did not enhance rime analogy. Children learned to read with a rime analogy or letter recoding reading strategy, and many developed new reading strategies independently. (Contains 46 references and 11 tables.) (GCP)
Reviews of Individual Studies 11-12 3
National Job Corps Study: The Impacts of Job Corps on Participants' Employment and Related Outcomes [and] Methodological Appendixes on the Impact Analysis. (2001)
A study involving random assignment of all youth eligible for Job Corps to either a Job Corps program or to a control group was conducted to assess the impact of Job Corps on key participant outcomes. Participants in the study were nationwide youth eligible for Job Corps who applied for enrollment for the first time between November 16, 1994, and December 17, 1995. The study sought to determine the following:(1) how effectively Job Corps improves the employability of disadvantaged participants, (2) whether Job Corps impacts differ for youths with different baseline characteristics, and (3) how effective the residential and nonresidential components of Job Corp are. Findings over the first 4 years after random assignment include the following: (1) Job Corps provided extensive education, training, and other services to the program group and improved their educational attainment; (2) Job Corps generated positive employment and earnings impacts by the beginning of the third year after random assignment and the impacts persisted through the fourth year; (3) employment and earnings gains were found broadly across most subgroups of students; (4) the resident and nonresidential programs were each effective for the youths they served; (5) Job Corps significantly reduced youths' involvement with the criminal justice system; (6) Job Corps had small beneficial impacts on the receipt of public assistance and self-assessed health status, but no impacts on illegal drug use; and (7) Job Corps had no impacts on fertility or custodial responsibility, but it slightly promoted independent living and mobility. (The report include numerous tables and charts, 31 references, and five appendixes concerning the study methodology.) (KC)
Reviews of Individual Studies 9-12 3
Evaluation of the Too Good for Drugs and Violence--High school prevention program. (2001)
Reviews of Individual Studies 8 3
The Value of a Developmental Approach to Evaluating Character Development Programmes: An Outcome Study of &quot;Facing History and Ourselves.&quot; (2001)
Finds that eighth grade students in Facing History and Ourselves classrooms show increases in relationship maturity and decreases in racist attitudes and self-reported fighting behavior relative to comparison students. Reports that the gains made by Facing History students in moral reasoning and in civic attitudes and participation were not significantly greater than the comparison students. (DAJ)
Reviews of Individual Studies 4 3
Intensive Remedial Instruction for Children with Severe Reading Disabilities: Immediate and Long-Term Outcomes from Two Instructional Approaches. (2001)
Sixty children (ages 8-10) with severe reading disabilities received daily intensive one-to-one instruction that differed in depth and extent of instruction in phonemic awareness and phonemic decoding. Both approaches were highly effective in improving reading accuracy and comprehension although measures of reading rate showed continued severe impairment. Twenty-four children were judged to no longer need special education. (Contains references.) (Author/DB)
Reviews of Individual Studies 12 3
Impact of California's Cal-Learn Demonstration Project: Final Report. (2000)
Reviews of Individual Studies 1-6 3
Tell Me A Story: An Evaluation of a Literature-based Character Education Programme. (2000)
Reports the results of an evaluation of a popular literature-based character education program using a sample of first to sixth grade students (n=965). Finds that the curriculum had a positive effect on cognitive outcomes and that an emphasis of character throughout the curriculum contributed to achieving character outcomes. Includes references. (CMK)
Reviews of Individual Studies 2-5 3
Individual Differences in Gains from Computer-Assisted Remedial Reading. (2000)
Compared effects of a computer-assisted remedial reading program providing speech-supported reading in context with or without explicit phonological training. Found that phonologically trained second to fifth graders gained more in phonological skills and untimed word reading than untrained children. Children with more contextual reading gained more in time-limited word reading. Lower level readers benefited more than higher level readers. (Author/KB)
Reviews of Individual Studies 1 3
Effects of Tutoring in Phonological and Early Reading Skills on Students at Risk for Reading Disabilities. (2000)
Twenty-three first-graders at risk for learning disabilities received one-to-one tutoring from noncertified tutors for 30 minutes, 4 days a week, for one school year. Tutoring included instruction in phonological skills, explicit decoding, writing, spelling, and reading phonically controlled text. Participants significantly outperformed controls on measures of reading, spelling, and decoding. (Contains references.) (Author/CR)
Reviews of Individual Studies 9-12 3
The Use and Effectiveness of Analogical Instruction in Diverse Secondary Content Classrooms. (2000)
Explores the use of analogies while teaching important concepts in secondary content classrooms containing students of diverse abilities. Measures included students' knowledge of concepts, the numbers and types of analogies teachers used, and teacher and student satisfaction. Results reveal that teacher use of the routine led to increased student retention and expression of information. (Contains 49 references and 2 tables.) (Author/GCP)
Reviews of Individual Studies K 3
Teachers learning Ladders to Literacy. (1999)
Reviews of Individual Studies K 3
Teachers Learning Ladders to Literacy. (1999)
A study involving 10 kindergarten teachers found that kindergarten children whose teachers learned to implement phonological and print awareness activities performed better than children in control classes on phonological and literacy measures, with those in classes of teachers with more intensive professional development achieving the highest literacy outcomes. (Author/CR)
Reviews of Individual Studies 2-5 3
Improving Literacy Achievement for English Learners in Transitional Bilingual Programs. (1999)
Reports on the development and evaluation of a transitional bilingual program for grades 2 through 5. Evaluation results based on achievement of 42 students and 42 comparisons show that the program is more effective than the transition program students typically receive. Discusses implications for education of English learners. (SLD)
Reviews of Individual Studies 4-5 3
Effects of Instructional Conversations and Literature Logs on Limited- and Fluent-English-Proficient Students' Story Comprehension and Thematic Understanding. (1999)
Examined effects of instructional components for studying literature on limited-English-proficient and English-proficient students, part of an ongoing program to estimate effects of several individual components of a Spanish-to-English language-arts transition program. Found that combined effects of literature logs and instructional conversations on students' essays about a story's theme varied by language proficiency. (Author/SD)
Reviews of Individual Studies 8-12 3
Impacts of dropout prevention programs: Final report. (1998)
Reviews of Individual Studies 9 3
Dropout Prevention for Youth with Disabilities: Efficacy of a Sustained School Engagement Procedure. (1998)
Ninety-four 7th- and 8th-grade students with learning and emotional/behavioral disabilities received intervention services that incorporated monitoring and school engagement strategies. Half continued to receive services through grade 9. On two of three measures, students receiving continued intervention services were significantly more likely to be engaged in school than those receiving the shorter intervention. (Author/DB)
Reviews of Individual Studies 2-5 3
Effects of Mathematical Word Problem Solving by Students At Risk or With Mild Disabilities. (1998)
Examined the differential effects of two instructional strategies (explicit schema-based and traditional-based) on the acquisition, maintenance, and generalization of mathematical word problem solving among elementary students at risk or with mild disabilities. Pretesting and posttesting indicated that both groups' performance increased from pretest to posttest, though students in the schema-based increased more significantly. (Author/SM)
Reviews of Individual Studies 2-3 3
Effects of Bilingual Cooperative Integrated Reading and Composition on Students Transitioning from Spanish to English Reading. Report No. 10. (1997)
The effects of a cooperative learning program, Bilingual Cooperative Integrated Reading and Composition (BCIRC), on the Spanish and English reading, writing, and language achievement of second and third graders of limited English proficiency in Spanish bilingual programs in El Paso (Texas) were studied. BCIRC was expected to improve student achievement during the transition from Spanish to English by giving students daily opportunities to use language to find meanings and solve problems, and by applying well- established principles of cooperative learning to increase student motivation and achievement. A comparison of standardized test scores in three BCIRC and four comparison schools generally supported these expectations. On the Spanish Texas Assessment of Academic Skills, second graders scored significantly better than comparison students in writing and marginally better in reading. On the English Norm-referenced Assessment Program for Texas third graders scored better than comparison students in reading, but not language. Third graders in BCIRC for 2 years scored better than control students on both scales, and BCIRC third graders met criteria for exit from bilingual education at a significantly higher rate than did comparison students. Qualitative evidence shows that students in cooperative groups are making meaning for themselves, enjoying the program and having success in writing contests. (Contains 6 tables and 43 references.) (Author/SLD)
Reviews of Individual Studies 10-PS 3
New Chance. Final Report on a Comprehensive Program for Young Mothers in Poverty and Their Children. (1997)
This report focuses on young mothers who had children as teenagers, who had dropped out of high school, and who were receiving Aid to Families with Dependent Children. It was a voluntary demonstration project that provided comprehensive education, training, and other services intended to increase the long-term self-sufficiency and well-being of these mothers and their children. The evaluation of New Chance is one of the few large-scale, rigorous evaluations of programs designed to change the outcomes for this population. This is the last in a series of reports from the study. A variety of community-based organizations implemented the program well in 16 diverse sites, although participation by the enrollees was uneven. At the 18-month follow-up point, the program had created a substantial increase in educational attainment, with acquisition of a General Educational Development certificate by many participants, greater use of good quality child care, and improvement in parenting skills, balanced against high rates of repeat pregnancy, inconsistent program attendance, and the fact that more than 80% of the participants were still on welfare. A monograph based on 50 interviews with participants explored some of the circumstances behind these findings. This report extends the study to 42 months of follow-up. The 2,079 young mothers who were studied in the follow-up are now 22.4 years of age on average. For many measures, outcomes have improved for these young women since they enrolled in New Chance, but the sobering news is that the absolute levels of progress leave these families far from self-sufficiency. For most outcomes, New Chance did not improve progress over and above that shown by an equivalent group of young women who did not attend New Chance. Although the New Chance experience provides few definitive answers about what should be done, it does raise critical questions about the direction and consequences of public policy, and it does indicate the need for public policies that move beyond the scope of the welfare system to enhance young mothers' efforts to become self-sufficient. (Contains eight tables.) (SLD)
Reviews of Individual Studies 2-6 3
Peer-Assisted Learning Strategies: Making Classrooms More Responsive to Diversity. (1996)
A classwide peer tutoring program in reading, implemented at 12 elementary and middle schools in three contiguous districts in the middle of a southern state, was evaluated for its effectiveness with three learner types: low achievers with disabilities, low achievers without disabilities, and learners of average achievement. Twenty teachers implemented the Peer Assisted Learning Strategies (PALS) program for 15 weeks, and 20 teachers who did not implement it served as controls. The PALS program involves having pairs of students engage in three strategic reading activities: partner reading with retell, paragraph summary, and prediction relay. In each of the 40 classrooms, data were collected systematically on three students representing the three learner types. Pre- and post-treatment reading achievement data were collected on three measures of the Comprehensive Reading Assessment Battery. Findings indicated that, irrespective of type of measure and type of learner, students in peer tutoring classrooms demonstrated greater reading progress than control students. (Contains approximately 120 references.) (DB)
Reviews of Individual Studies K 3
The Effect of Kindergarten Phonological Intervention on the First Grade Reading and Writing of Children with Mild Disabilities. (1996)
A study tested the long-term (end of Grade 1) effects of phonological skills treatment in kindergarten for children across a range of abilities. In Grade 1, 80 children from treatment and control classes participated in the study, along with 16 children in self-contained special education classes. In an earlier study with these same children, 6 kindergarten teachers in regular and special education classes were taught to conduct activities designed to stimulate their students' phonological manipulation skills such as blending and segmenting. Compared to controls, children with and without disabilities ended the year with significant treatment effects that transferred to measures of reading and writing. In the present study, for children without disabilities the early effects were no longer evident. Children from treated and control kindergartens gained in phonological, reading, and writing skills during Grade 1. For children with disabilities, the treatment continued to show significant effects on standardized measures of reading and writing, and on oral reading fluency and spelling. These long-term effects were found regardless of the setting (general or special education) in which children received kindergarten instruction. (Contains 3 tables of data and 38 references.) (Author/NKA)
Reviews of Individual Studies K 3
Report on Workstation Uses: Effects of Success for All on the Reading Achievement of First Graders in California Bilingual Programs. (1995)
A study assessed the effectiveness of the Success for All Program for grade-one English-as-a-Second-Language (ESL) learners in bilingual or ESL programs in three California elementary schools. The reading instruction program provides both native (in this case, Spanish) language support as well as English language instruction and materials. The three schools in question were matched with comparison schools in their districts, that were similar in level of student disadvantage and other factors. The 2-year evaluation measured student (n=313) progress from kindergarten entry (receptive vocabulary) to the end of first grade (phonetic synthesis skills, recognition of common sight words, and text comprehension). Analysis of the results indicates that the 2 years of instruction in the Success for All program were effective for both students taught in Spanish-English bilingual programs and in ESL programs. While the instruction raised the average student performance, it also raised the performance of the lowest-performing students, with some of the largest treatment effects occurring in this group. A suggested area for further research is the monitoring of achievement over time. (MSE)
Reviews of Individual Studies 2-6 3
The Cooperative Elementary School: Effects on Students' Achievement, Attitudes, and Social Relations. (1995)
The cooperative elementary school model uses cooperation, particularly cooperative learning, as a philosophy for educational change. A 2-year study of the cooperative elementary school model in 2 treatment and 3 comparison schools involving 1,012 students demonstrates positive effects on academic achievement and social relations. (SLD)
Reviews of Individual Studies 10-12 3
A Computerized Method to Teach Latin and Greek Root Words: Effect on Verbal SAT Scores. (1995)
This study investigated the effectiveness of using a computer program over six weeks to teach high school students to use Latin and Greek root words for deciphering English terms in order to increase their scores on the verbal portion of the Scholastic Aptitude Test. Results indicated that knowledge of Latin and Greek root words improved students' English skills. (SM)
Reviews of Individual Studies 1 3
An evaluation of computer-assisted instruction in phonological awareness with below average readers. (1995)
Reviews of Individual Studies 7-9 3
ALAS: Achievement for Latinos through Academic Success. (1995)
Reviews of Individual Studies 4-6 3
Project CRISS: Validation report for the Program Effectiveness Panel. (1994)
Reviews of Individual Studies 1 3
Comparing Instructional Models for the Literacy Education of High-Risk First Graders. (1994)
Examines the effectiveness of Reading Recovery as compared to a one-on-one skills practice model, group treatment taught by trained Reading Recovery teachers, and a treatment modeled on Reading Recovery provided by teachers trained in a shortened program. Finds that Reading Recovery children performed significantly better than any other treatments and the comparison group. (RS)
Reviews of Individual Studies 10-11 3
The effects of teaching practice review items and test-taking strategies on the ACT mathematics scores of second-year algebra students (Doctoral dissertation). (1994)
Reviews of Individual Studies K 3
Computer administered instruction in phonological awareness: Evaluation of the DaisyQuest program. (1994)
Reviews of Individual Studies K-1 3
1991–1992 Ft. Wayne, Indiana Success for All results. (1993)
Reviews of Individual Studies 11-12 3
JOBSTART. Final Report on a Program for School Dropouts. (1993)
The JOBSTART demonstration program provided education and vocational training, support services, and job placement assistance to educationally disadvantaged dropouts aged 17-21 at 13 sites. An evaluation assessed whether helping disadvantaged dropouts increase their educational attainment led to increased earnings. A total of 2,312 people were randomly assigned to an experimental group that received JOBSTART services and a control group that did not. Data from 1,941 youth for whom 48 months of follow-up data were available were analyzed. Findings indicated that JOBSTART led to a significant increase in the rate at which the youths passed the General Educational Development examination or completed high school. Youths in the experimental group earned less on average than those in the control group during the first year of follow-up. In the final 2 years, experimentals' earnings appeared to overtake those of controls for the full sample. Encouraging earnings impacts included those for young men who had been arrested between age 16 and program entry and for young men and women who had dropped out of school because they had educational difficulties. Earnings impacts were very large for one site: Center for Employment Training, San Jose, California. Overall, JOBSTART led to little change in youths' receipt of public assistance. From the perspectives of taxpayers and society as a whole, the investment in JOBSTART services was not repaid through increases in earnings or other quantified benefits by the end of the follow-up period. (Appendixes include descriptions of data sources, methodological issues of the JOBSTART impact analysis, description of the cost estimation, data tables, and 84 references.) (YLB)
Reviews of Individual Studies 1-4 3
Achievement, Placement, and Services: Middle School Benefits of Classwide Peer Tutoring Used at the Elementary School. (1993)
Trial spanning grades 1-4 reported changes in classroom processes produced by ClassWide Peer Tutoring (CWPT) Program covaried with statistically and educationally significant levels of growth in at-risk students' academic achievement. Investigated follow-up outcomes at end of sixth grade. Found continued improved academic outcomes in students at risk for academic delay resulting from sustained use of CWPT in early grades. (Author/NB)
Reviews of Individual Studies 7-10 3
A Longitudinal Study of Students Completing Four Years of UCSMP Mathematics. (1993)
Compared students who had four years of the University of Chicago School Mathematics Project (UCSMP) secondary curriculum to two distinct groups of comparable students at three different sites (one urban and two suburban). UCSMP students at all three sites achieved higher but registered little difference in attitude. (Contains 48 references.) (MDH)
Reviews of Individual Studies 3-4 3
The Effects of Cooperative Learning and Direct Instruction in Reading Comprehension Strategies on Main Idea Identification. (1991)
The impact of direct instruction on reading comprehension strategies and the degree to which cooperative learning processes enhanced students' learning of strategies were studied using 486 third and fourth graders in Pennsylvania. Subjects identified main ideas of passages. Pretest-posttest data highlight the significant impact of direct instruction and cooperative learning. (SLD)
Reviews of Individual Studies 1 3
Early Intervention in Reading: Preventing reading failure among low-achieving first grade students. (1991)
Reviews of Individual Studies 4 3
Effectiveness of Visual Imagery versus Rule-Based Strategies in Teaching Spelling to Learning Disabled Students. (1990)
Among 28 upper elementary learning-disabled students in a summer remedial program, those that were taught spelling with explicit rule-based strategies out-performed students presented with a visual imagery mnemonic on unit tests, a posttest, and a standardized spelling test. Contains 20 references. (SV)
Reviews of Individual Studies 1 3
Reading Recovery: Early Intervention for At-Risk First Graders. ERS Monograph. (1988)
This monograph presents information about Reading Recovery, describes the latest research concerning the program, and summarizes practical experience concerning the implementation of this innovation in reading instruction. Chapter 1 presents a general description of Reading Recovery instructional procedures. Chapter 2 contains three case studies that provide a more concrete look at how the program works with individual children and teachers. Chapter 3 discusses a longitudinal study conducted in the Columbus Public Schools to determine both the short-range and the long-range effects of Reading Recovery on a group of at-risk students. Chapter 4 describes the studies of Reading Recovery at sites throughout the state of Ohio during the years of 1985-86, 1986-87, and 198-88. Chapter 5 describes the Reading Recovery staff development component, along with studies of teacher training and development in program techniques. Chapter 6 presents suggestions for school districts or state agencies that wish to implement Reading Recovery. Thirty-three references and three appendixes containing a list of books used in Reading Recovery, a description of the alternative intervention program employed during the first year of the longitudinal study, and measures used to assess children in the Reading Recovery Program are attached. (MS)
Reviews of Individual Studies 5-6 3
Using Computer-Assisted Instruction to Personalize Arithmetic Materials for Elementary School Children. (1987)
The purpose of this research was to design and evaluate a computer based adaptive strategy for teaching mathematics. Results indicated preference for materials with personalized examples for motivation and meaningful learning of problem solving procedures. Practical advantages of the computer-based model for adapting instruction are also considered. (Author/JAZ)
Reviews of Individual Studies 1-6 3
Individual Differences in Second Language Learning of Korean Immigrant Students. (1985)
A study of the effects of peer-pairing and integrative motivation on both formal language performance and actual language behavior with Korean immigrant children is presented. The formal language learning was measured by tests of oral production and listening comprehension, and actual language behavior was measured by observations in a natural school environment. Both oral production and listening comprehension posttests were administered four-and-a-half months after pretest administration. Thirty elementary school children (11 boys and 19 girls) were randomly assigned to two groups, resulting in 14 children (8 girls and 6 boys) in the peer-paired group and 16 (11 girls and 5 boys) in the no-paired group. Stepwise multiple regression analyses indicated that (1) peer-pairing was a significant predictor for listening comprehension and the actual language behavior, and (2) prior language knowledge was the best predictor of formal language learning. The theoretical implications are that peer-pairing not only facilitates formal listening comprehension and actual language behavior, but also enhances social relationships between second-language learners and the target-language speakers. (MSE)
Reviews of Individual Studies 4 3
Explicit Instruction in Mathematics Problem Solving. (1984)
An explicit strategy method developed from a composite of basal arithmetic texts was used for mathematics problem-solving instruction for a group of fourth graders. Posttest results were positive. Implications for teaching mathematics problem solving to low performing students are discussed. (Author/DF)
Reviews of Individual Studies 1-2 9
Early Literacy Intervention for Culturally and Linguistically Diverse Students with Varying English Language Proficiency Levels (2022)
Objectives: This study examined the effectiveness of Sound Partners, an evidence-based early literacy intervention program, with culturally and linguistically diverse elementary students within an applied Response to Intervention (RTI) system. Method: Participants (n = 11) with a range of English language proficiency (ELP) who spoke English, Hmong, Khmer, or Nepali as a first language were recruited based on indicators of high academic risk displayed during the participating school's universal literacy screening process. Three replications of a randomized multiple baseline single case research study were conducted to assess the effectiveness of Sound Partners in three groups: those with lower ELP, middle ELP, and native English speakers. Progress monitoring of early literacy skills occurred weekly across baseline and intervention phases. Results: Visual analysis results supported two intervention effects: PSF effects in the low ELP replication and LSF effects in the native English speaker replication. Supplemental statistical analyses were conducted to describe the magnitudes and variations of effect sizes. Conclusion: Results suggest that key factors related to heterogeneity within the diverse population of ELL students, such as ELP levels, must be carefully considered when implementing RTI.
Reviews of Individual Studies K 9
Supporting Vocabulary Development within a Multitiered System of Support: Evaluating the Efficacy of Supplementary Kindergarten Vocabulary Intervention (2022)
We evaluated the impact of a supplemental, small-group kindergarten vocabulary intervention designed to reinforce content taught in core classroom instruction implemented within a multitiered system of support (MTSS) framework. Kindergarten teachers implemented a published vocabulary program with all their students during whole-class instruction for 15 min to 20 min per day over the course of the year. We identified students at risk for language and learning difficulties who scored below the 30th percentile on the Peabody Picture Vocabulary Test-4 (PPVT-4; Dunn & Dunn, 2007) and randomly assigned them in clusters to either the control group (n = 453) that received only the classroom vocabulary instruction, or to the treatment group (n = 468) that received the classroom instruction plus small-group supplemental intervention for 30 min, four times per week between November and May. Analyses using multilevel modeling indicated that students who received supplemental vocabulary intervention outperformed control group students on measures of target vocabulary taught during whole-class and small-group instruction and listening comprehension of passages that included taught vocabulary. There were no effects on standardized measures of vocabulary. At-risk students who received the supplemental intervention also eliminated vocabulary learning differences with typically achieving students (n = 430) who received only classroom vocabulary instruction on words targeted for instruction. Findings suggest that supplemental vocabulary intervention that reinforces content taught during classroom instruction implemented within an MTSS framework can accelerate the learning of at-risk students on proximal and near transfer outcomes that are aligned with the content and focus of the instruction and that MTSS offer a feasible framework for schools to provide effective and efficient vocabulary supports to students in the primary grades.
Reviews of Individual Studies K-2 9
Literacy Now Reading Intervention Program: A Cohort Analysis of Reading Achievement at Selected HISD Campuses, 2020-2021. Research Educational Program Report (2021)
Since 2007, nineteen Houston Independent School District (HISD) campuses have partnered with Literacy Now to offer the Reading Intervention program. The Reading Intervention program provides individualized, small group reading tutorials for at-risk students in kindergarten to second grade to create proficient readers by the end of third grade. Literacy Now also supports literacy development at home (Parent Engagement Workshops, Book Distribution, Family Literacy Night, and monthly newsletters). Between 2015 and 2019, 996 students in kindergarten to second grade from 11 HISD campuses participated in the Reading Intervention program. During this period, results from a post-program survey, on a 3.0 scale, found that teachers observed that the program was beneficial to students (M = 2.62), grades improved (M = 2.51), and students displayed greater confidence in reading (M = 2.48). The evaluation employed a two-group quasi-experimental design with an intervention group and a control group to examine the effectiveness of the program on two cohorts of students from 2015-2016 and 2016-2017. The evaluation found that kindergarten and first-grade students in both cohorts who participated in the reading intervention program showed significant differences between the pre-and post-test scores on Istation for the average proficiency rate in reading immediately after completing the program. Compared to their grade-level peers, first graders, English language learners, Black, or economically disadvantaged students who participated in the Reading Intervention program showed higher percentage points increase in their reading performance on STAAR grade 3 reading assessment. The three-year mean percentage of the students who met the Approaches grade-level benchmark score fell within 15 percentage points of their campus-level peers on STAAR grade 3 reading at Piney Point (6%), Walnut Bend (10%), Ross (11%), Bruce (15%), and McGowen (15%).
Reviews of Individual Studies 1 9
A Quasiexperimental Evaluation of Two Versions of First-Grade PALS: One with and One without Repeated Reading (2021)
We attempted to strengthen an evidence-based, peer-mediated, first-grade reading program (First Grade Peer-Assisted Learning Strategies [PALS]) by modestly revising its content and adding a repeated-reading (RR) component. In a cluster-randomized trial, we conducted a component analysis of the revised program by creating two versions of it. "PALS+Fluency" represented the modified program with an RR component, whereas "PALS-Only" represented the same program without RR. We tested the efficacy of the two PALS versions together against controls and against each other to determine if peer-mediated RR had "value added." With moderator analyses, we further explored whether the PALS programs benefited weaker and stronger readers alike. Thirty-three first-grade classroom teachers (and 491 students) from eight urban schools were randomly assigned to the three study groups within their schools. The PALS-Only and PALS+Fluency programs ran for 22 weeks. Multilevel modeling showed that the combined effects of the two PALS programs on phonological awareness (PA), word reading, and reading fluency were superior to those of controls. Students' pretreatment PA moderated combined program effects on PA and word reading, indicating stronger effects for students with weaker PA. PALS-Only students improved PA skills (over PALS+Fluency students) with stronger effects for those with weaker pretreatment PA.
Reviews of Individual Studies K-3 9
Evaluation Study of the Istation Early Reading Program in Idaho (2020)
Istation is a digital-based instructional intervention tool for various content areas aimed at pre-K through 8th grade learners. The Istation Reading program consists of formative assessments, named Istation Indicators of Progress (ISIP™), which are computer-adaptive and diagnostic literacy assessments designed to track student growth over time. Istation Reading also includes an adaptive, online curriculum, which generates personalized learner data profiles that teachers can use to make data-driven instructional decisions and assign custom learning interventions. Istation's Early Reading (ER) program was designed specifically for students in grades K-3, focusing on the critical areas of early reading, including phonemic awareness, phonics, vocabulary, reading comprehension, and fluency. The ISIP became the state of Idaho's early literacy assessment in the 2018-19 school year. The state-mandated early literacy assessment for students in grades K-3 is referred to as the Idaho Reading Indicator (IRI). The state of Idaho used a different assessment in previous years and switched to using the ISIP for the IRI in the 2018-19 school year. The IRI is administered to all K-3 public school students in the state, and is intended to serve as an early reading diagnostic and screener. A sample of public elementary schools in Idaho piloted the ISIP and the Istation curriculum during the 2017-18 school year. In the 2018-19 school year, all public elementary schools in Idaho administered the ISIP. Schools were required to administer the ISIP in both the fall and spring, and had the option to administer it more frequently for yearly progress monitoring. Schools also had the option of purchasing Istation's related curricular resources. This study examines effects of the Istation ER program on student reading achievement in the state of Idaho and the validity of the ISIP for predicting student performance on the Idaho Standards Achievement Test (ISAT). It also highlights implementation successes and challenges experienced by educators who piloted Istation's ER program during the 2017-18 school year. [Istation contracted with the Center for Research and Reform in Education (CRRE) at Johns Hopkins University (JHU) to conduct a study of the predictive validity of Istation's Early Reading (ER) program in the state of Idaho.]
Reviews of Individual Studies K-5 9
Evaluating Paraeducator-Led Reading Interventions in Elementary School: A Multi-Cutoff Regression-Discontinuity Analysis (2018)
A two-cutoff regression discontinuity design (RDD) was used to assign 321 students in grades 1 through 6 at a Title I elementary school to two types of Tier 2 reading interventions administered by paraeducators: (a) direct instruction (DI) and (b) computer-assisted instruction (CAI). Students scoring at or below a lower cutoff pretest score were assigned to the DI reading intervention. Students scoring between the lower cutoff score and an upper cutoff score on the pretest were assigned to a CAI reading intervention. Student reading ability was reassessed in January and May. Results indicated that the DI intervention was significantly more effective than the CAI interventions at the lower cutoff (p < 0.01). No significant treatment effect was detected at the upper cutoff, but the estimation power of the design at this cutoff was limited to medium-to-large effect size. Findings suggest that the DI intervention was superior to the CAI interventions for at-risk readers. Implications for practice, including fidelity of paraeducator implementation, are discussed.
Reviews of Individual Studies K-3 9
The Effects of Combining Peer-Assisted Learning Strategies and Incremental Rehearsal on Non-Spanish-Speaking English Language Learners&apos; Reading Achievement (2017)
This study examined the effects of a phonics-based intervention on the reading outcomes of non-Spanish-speaking English Learners (ELs). Thirty-six K-3, primarily Karen- and Hmong-speaking ELs were randomly assigned to receive a modified version of Kindergarten Peer-Assisted Learning Strategies (K-PALS; Fuchs et al., 2001b) combined with Incremental Rehearsal (IR; Tucker, 1989; treatment), 30 min per day for 27-36 sessions in small groups or to continue with business as usual (control). A between-subjects pre-/post-test design using five Formative Assessment System for Teachers™ (FAST; Christ et al., 2014) earlyReading and CBMReading subtests was implemented. Multivariate and univariate analyses of variances (MANOVAs and ANOVAs) on the fluency and error rate of participants indicated treatment students outperformed control students at post-test in letter-sound identification (p = 0.006) with a large effect size (g = 0.88) and had significantly fewer errors (p = 0.002) with a moderately-strong effect size (g = 0.69). There were no significant differences between the treatment and control group in consonant-vowel-constant, nonsense and sight words or passage reading fluency or error rate. Effect sizes were small to moderate (g = -0.28-0.45). Results suggest that modified K-PALS with IR may be an effective intervention to improve the letter-sound identification skills of non-Spanish-speaking ELs, but further research is needed to verify this claim. [The dissertation citations contained here are published with the permission of ProQuest LLC. Further reproduction is prohibited without permission. Copies of dissertations may be obtained by Telephone (800) 1-800-521-0600. Web page: http://www.proquest.com/en-US/products/dissertations/individuals.shtml.]
Reviews of Individual Studies 2-3 9
Examining the Impact of Quickreads' Technology and Print Formats on Fluency, Comprehension, and Vocabulary Development for Elementary Students (2016)
National reports reveal one third of American fourth graders read below basic level on measures of comprehension. One critical component of comprehension is fluency: rapid, accurate, expressive reading with automaticity and prosody. Many fluency studies and classroom interventions focus only on reading rate, but this alone is not sufficient. This experimental study focused on QuickReads, which uses science and social studies texts to build reading fluency, vocabulary, and comprehension. We explored the impact of QuickReads in print-only and print + technology formats for 1,484 students in second through fifth grades. Using hierarchical linear modeling with pre-post design, we found significant gains in fluency, comprehension, and vocabulary for students in all grades using either QuickReads format over control. Results generalized across achievement groups, ethnicities, and ELL levels. Implementation measures indicated high teacher fidelity to intervention techniques, lending robustness to student results. This study provides an example of scaling up validated instructional practices and lends support for important elements of fluency instruction: emphasizing prosody as well as rate, including content area topics, supported and independent practice, vocabulary and comprehension development, and motivational aspects such as ease of use.
Reviews of Individual Studies 1-2 9
Immediate and Long-Term Effects of Tier 2 Reading Instruction for First-Grade Students with a High Probability of Reading Failure (2014)
This research investigated the immediate and long-term effects of a Tier 2 intervention for beginning readers identified as having a high probability of reading failure using a randomized control trial. First-grade participants (n = 123) were randomly assigned either to a 25-session intervention targeting key reading components, including decoding, spelling, word recognition, fluency, and comprehension, or to a no-treatment control condition. Analyses of immediate posttests (end of first grade) indicated significant differences in measures of Decodable Word Fluency (effect size = 0.40) favoring the intervention group. Within the intervention group, tutor ratings of attention were significantly related to growth in Passage Reading Fluency and Spelling Fluency. Longitudinal assessments (end of second grade) indicated no significant differences by group. Analysis of responder status indicated that students defined as responders maintained gains to the end of second grade.
Reviews of Individual Studies 1-2 9
An Experimental Evaluation of Guided Reading and Explicit Interventions for Primary-Grade Students At-Risk for Reading Difficulties (2014)
Considerable research evidence supports the provision of explicit instruction for students at risk for reading difficulties; however, one of the most widely implemented approaches to early reading instruction is Guided Reading (GR; Fountas & Pinnel, 1996), which deemphasizes explicit instruction and practice of reading skills in favor of extended time reading text. This study evaluated the two approaches in the context of supplemental intervention for at-risk readers at the end of Grade 1. Students (n = 218) were randomly assigned to receive GR intervention, explicit intervention (EX), or typical school instruction (TSI). Both intervention groups performed significantly better than TSI on untimed word identification. Significant effects favored EX over TSI on phonemic decoding and one measure of comprehension. Outcomes for the intervention groups did not differ significantly from each other; however, an analysis of the added value of providing each intervention relative to expected growth with typical instruction indicated that EX is more likely to substantially accelerate student progress in phonemic decoding, text reading fluency, and reading comprehension than GR. Implications for selection of Tier 2 interventions within a response-to-intervention format are discussed.
Reviews of Individual Studies K 9
Replicating the Impact of a Supplemental Beginning Reading Intervention: The Role of Instructional Context (2013)
The purpose of this varied replication study was to evaluate the effects of a supplemental reading intervention on the beginning reading performance of kindergarten students in a different geographical location and in a different instructional context from the initial randomized trial. A second purpose was to investigate whether students who received the intervention across both the initial and replication studies demonstrated similar learning outcomes. Kindergarten students (n = 162) identified as at risk of reading difficulty from 48 classrooms were assigned randomly at the classroom level either to a commercial program (i.e., Early Reading Intervention; Pearson/Scott Foresman, 2004) that included explicit/systematic instruction (experimental group) or school-designed typical practice intervention (comparison group). Both interventions were taught by classroom teachers for 30 min per day in small groups for approximately 100 sessions. Multilevel hierarchical linear analyses revealed no statistically significant differences between conditions on any measure. Combined analyses that included students from both the initial and replication studies suggested that differences in the impact of the intervention across studies were largely explained by mean differences in the comparison group students' response to school-designed intervention. (Contains 10 tables, 1 figure, and 1 footnote.)
Reviews of Individual Studies 9-12 -1
Report to NETWORK Steering Committee and the USDOE Office of Innovation and Improvement as part of the Investing in Innovation (i3) Grant Program Evaluation: Analysis and Summary (Five Year) (N.D.)
Reviews of Individual Studies 4-11 -1
Unconditional Education Year 1 Evaluation Report. (n.d.)
Reviews of Individual Studies 1-12 -1
Multiple choice: Charter school performance in 16 states. (June 2009)
Reviews of Individual Studies 1 -1
Charter school performance in New York City. (January 2010)
Reviews of Individual Studies 6 -1
Blended learning as a tool for international transfer of instructional practices. (in press)
Reviews of Individual Studies 1 -1
Efficacy of a theory-based abstinence-only intervention over 24 Months: A randomized controlled trial with young adolescents. (February 2010)
Reviews of Individual Studies 3-8 -1
The New York City Aspiring Principals Program: A school-level evaluation. (August 2009)
Reviews of Individual Studies 7 -1
The Impacts of Three Educational Technologies on Algebraic Understanding in the Context of COVID-19 (2023)
The current study investigated the effectiveness of three distinct educational technologies--two game-based applications (From Here to There and DragonBox 12+) and two modes of online problem sets in ASSISTments (an Immediate Feedback condition and an Active Control condition with no immediate feedback) on Grade 7 students' algebraic knowledge. More than 3,600 Grade 7 students across nine in-person and one virtual schools within the same district were randomly assigned to one of the four conditions. Students received nine 30-minute intervention sessions from September 2020 to March 2021. Hierarchical linear modeling analyses of the final analytic sample (N = 1,850) showed significantly higher posttest scores for students who used From Here to There and DragonBox 12+ compared to the Active Control condition. No significant difference was found for the Immediate Feedback condition. The findings have implications for understanding how game-based applications can affect algebraic understanding, even within pandemic pressures on learning.
Reviews of Individual Studies 9-12 -1
CompuPower Investing in Innovation Evaluation: Final Report (2022)
This is the final report of an independent evaluation of the CompuPower program that was developed by Arizona State University's Center for Gender Equity in Science and Technology (ASU CGEST). CompuPower is a multifaceted program for high school students that is centered on a culturally responsive computing course that includes four key components: the CompuPower course curriculum, mentor teacher professional development, a multi-day CompuPower Residency Experience, and a series of parent workshops. The evaluation of the CompuPower program was funded with a development grant from the U.S. Department of Education's Investing in Innovation (i3) program and carried out by the American Institutes for Research (AIR) over the 2019-20 and 2020-21 school years in nine mostly rural high schools. The evaluation employed a quasi-experimental matched comparison design to estimate the impact of CompuPower on one confirmatory student social emotional outcome--self-regulation--and two exploratory outcomes--critical thinking skills in everyday life and grade point average. The evaluation also assessed the implementation fidelity of the four key CompuPower program components. Across the four program components, only the mentor teacher professional development was implemented with fidelity. Most implementation challenges for the other three program components resulted from the COVID-19 pandemic, but there were other challenges as well. CompuPower students showed slightly higher scores on self-regulation, critical thinking skills in everyday life, and GPA measures than comparison group students, but the differences were not statistically significant.
Reviews of Individual Studies 11-12 -1
Does virtual advising increase college enrollment? Evidence from a random-assignment college access field experiment. (2022)
Reviews of Individual Studies 1-2 -1
A longitudinal randomized trial of a sustained content literacy intervention from first to second grade: Transfer effects on students’ reading comprehension outcomes (2022)
Reviews of Individual Studies 11-PS -1
Digital Messaging to Improve College Enrollment and Success. (2021)
Reviews of Individual Studies 1-4 -1
Comparing Technology-Based Reading Intervention Programs in Rural Settings (2021)
Reviews of Individual Studies 12-PS -1
Digital messaging to improve college enrollment and success. (2021)
Reviews of Individual Studies 1-12 -1
The Effects of the Louisiana Scholarship Program on Student Achievement and College Entrance (2021)
The Louisiana Scholarship Program (LSP) offers publicly funded vouchers to moderate- and low-income students in low-performing public schools to enroll in participating private schools. Established in 2008 as a pilot program in New Orleans, the LSP expanded statewide in 2012. Drawing upon the random lotteries that placed students in LSP schools, we estimate the causal impact of using an LSP voucher to enroll in a private school on student achievement on the state accountability assessments in math, English Language Arts, and science over a four-year period, as well as on the likelihood of enrolling in college. The results from our primary analytic sample indicate substantial negative achievement impacts, especially in math, that diminish after the first year but persist after four years. In contrast, when considering the likelihood of students entering college, we observe no statistically significant difference between scholarship users and their control counterparts.
Reviews of Individual Studies 1 -1
Improving Reading Comprehension, Science Domain Knowledge, and Reading Engagement through a First-Grade Content Literacy Intervention (2021)
This study investigated the effectiveness of the Model of Reading Engagement (MORE), a content literacy intervention, on first graders' science domain knowledge, reading engagement, and reading comprehension. The MORE intervention emphasizes the role of domain knowledge and reading engagement in supporting reading comprehension. MORE lessons included a 10-day thematic unit that provided a framework for students to connect new learning to a meaningful schema (i.e., Arctic animal survival) and to pursue mastery goals for acquiring domain knowledge. A total of 38 first-grade classrooms (N = 674 students) within 10 elementary schools were randomly assigned to (a) MORE at school (MS), (b) MORE at home, (MS-H), in which the MS condition included at-home reading, or (c) typical instruction. Since there were minimal differences in procedures between the MS and MS-H conditions, the main analyses combined the two treatment groups. Findings from hierarchical linear models revealed that the MORE intervention had a positive and significant effect on science domain knowledge, as measured by vocabulary knowledge depth (effect size [ES] = 0.30), listening comprehension (ES = 0.40), and argumentative writing (ES = 0.24). The MORE intervention effects on reading engagement as measured by situational interest, reading motivation, and task orientations were not statistically significant. However, the intervention had a significant, positive effect on a distal measure of reading comprehension (ES = 0.11), and there was no evidence of Treatment × Aptitude interaction effects. Content literacy can facilitate first graders' acquisition of science domain knowledge and reading comprehension without contributing to Matthew effects.
Reviews of Individual Studies 3 -1
Alternative Paths to Improved Word-Problem Performance: An Advantage for Embedding Prealgebraic Reasoning Instruction within Word-Problem Intervention (2021)
The purpose of this study was to explore the paths by which word-problem intervention, with versus without embedded prealgebraic reasoning instruction, improved word-problem performance. Students with mathematics difficulty (MD; n = 304) were randomly assigned to a business-as-usual condition or 1 of 2 variants of word-problem intervention. The prealgebraic reasoning component targeted relational understanding of the equal sign as well as standard and nonstandard equation solving. Intervention occurred for 16 weeks, 3 times per week, 30 min per session. Sequential mediation models revealed main effects, in which each intervention condition significantly and substantially outperformed the business-as-usual condition, corroborating prior research on the efficacy of schema word-problem intervention. Yet despite comparable effects on word-problem outcomes between the two word-problem conditions, the process by which effects accrued differed: An indirect path via equal-sign understanding and then equation solving was significant only for the word-problem intervention condition with embedded prealgebraic reasoning instruction. Additionally, the effect of this condition on equal-sign reasoning was strong. Given the link between equal-sign reasoning for success with algebra and the importance of algebra for success with advanced mathematics, results suggest an advantage for embedding prealgebraic reasoning instruction within word-problem intervention.
Reviews of Individual Studies 9 -1
Effects of cross-age peer mentoring program within a randomized controlled trial (2021)
Reviews of Individual Studies 7-12 -1
Evaluation Report: Investing in Innovation Pathways to Success (2021)
In 2016, McREL and the University of Southern California (USC) were awarded a grant from the U.S. Department of Education's Investing in Innovation (i3) Fund (Award Number U411C150011) to develop a translation of the identity-based motivation (IBM) in vivo program "Pathways to Success" to a digital platform to deliver IBM to middle and high school students. The resulting digital "Pathways to Success" program consisted of 12 15-minute digital platform activities, planned to take place over the first six to eight weeks in the Fall semester of 2017 in 10 schools from five districts in Colorado. While the former McREL research director and the original external evaluator led the field operation and the randomization process, in 2018, there was a change in the Principal Investigator at McREL, and an evaluator from USC was contacted to conduct the independent evaluation. Project data, including student and teacher responses and administrative data from schools in years 2016-2017, 2017-2018, and 2018-2019 were provided by McREL to the USC evaluator. The report documented the implementation fidelity and examined the impact of digital "Pathways to Success" on students' overall, English language, and Math achievement, and "non-cognitive" variables in the IBM theory.
Reviews of Individual Studies 4-8 -1
Final Report of the i3 Evaluation of the Collaboration and Reflection to Enhance Atlanta Teacher Effectiveness (CREATE) Teacher Residency Program: A Quasi-Experiment in Georgia (2021)
Teacher residencies are surfacing as a promising model for teacher preparation. One such residency program--Collaboration and Reflection to Enhance Atlanta Teacher Effectiveness (CREATE)--seeks to raise student achievement in local high-needs schools by increasing the effectiveness and retention of both new and veteran educators. CREATE aims to achieve this by developing critically-conscious, compassionate, and skilled educators who are committed to teaching practices that prioritize racial justice and interrupt inequities. This quasi-experiment, funded by an Investing in Innovations (i3) grant, follows two staggered cohorts of study participants (CREATE and comparison teachers) for three years per cohort, starting with the first cohort in 2015-16. Confirmatory analyses found no statistically significant effects of CREATE on two Teacher Assessment on Performance Standards (TAPS) ratings for Instructional Strategies (p = 0.221) and Positive Learning Environment (p = 0.192), or on student achievement on ELA (p = 0.454), math (p = 0.569), and general achievement (p = 0.234). However, exploratory analyses (pre-registered) found very promising results showing undisrupted retention over a three-year time period (spanning graduation from Georgia State University's College of Education and Human Development, entering teaching, and retention into the second year of teaching) for the CREATE group, relative to the comparison group (p = 0.038). We also observed that the favorable impact is driven largely by higher continuous retention among Black educators in CREATE relative to those in the comparison group (p = 0.021). The percentages of teachers in CREATE, as averaged across the two study cohorts, who maintain an uninterrupted trajectory of graduating from GSU-CEHD, and taught in their first and second year are 94.8%, 87.4% and 84.6%, respectively. In the matched comparison group the corresponding values are 87.9%, 72.9%, and 68.0%. Among Black teachers in CREATE, the values are 98.6%, 96.3% and 95.5%, respectively. In the matched comparison group of Black teachers, the corresponding values are 85.7%, 68.5%, and 62.8%. These results are further corroborated by statistically significant or marginally statistically significant differential impacts favoring Black teachers on several potential mediators of impact: resilience, self-efficacy, and stress management and empathy related to teaching. The positive findings on retention, particularly for Black educators, are important given that 44% of teachers in Georgia leave the profession within the first five years, with evidence in the literature indicating that in the South, Black teachers experience higher turnover rates than non-Black teachers (Carver-Thomas & Darling-Hammond, 2017). The authors discuss a number of factors that could have led to null impacts on confirmatory outcomes. The lack of variation in teacher performance ratings, which is a known issue in Georgia and in the literature at large (Weisberg et al, 2009; Kraft & Gilmour, 2017) could have contributed to the results for the TAPS ratings. Studies of teacher residency programs also suggest that impact on student achievement might not be present or detected in earlier years of teaching. Additionally, analyses of student achievement in this study were limited by small sample sizes of teachers in tested grades and subjects. The authors hope to address these limitations and to investigate the promising outcomes on retention, especially for Black educators, in current and future studies of CREATE, for which we have secured funding for programming and research through the eighth cohort. [For the appendices, see ED611803.]
Reviews of Individual Studies 9-12 -1
First-Year Effects of Early Indicator and Intervention Systems in Oregon. REL 2021-097 (2021)
Although Oregon has made recent gains in its overall high school graduation rate, 21?percent of public school students entering grade?9 in 2014 did not graduate within four years, by 2018. To improve graduation rates, Oregon voters approved Ballot Measure 98 in 2016 to fund dropout prevention and college and career readiness initiatives in high schools. Many districts used the funding to adopt an early indicator and intervention system (EIIS) to identify students who are not on track to graduate on time by monitoring related indicators, such as chronic absenteeism, disciplinary infractions, course progression, and academic performance, through a frequently updated data system. Districts can tailor the system by setting their own on-track thresholds for each indicator to identify students at risk of not graduating on time, assigning those students to interventions, and monitoring student response to the interventions. This study took advantage of the additional funding being offered to districts across the state to look at first-year effects on chronic absenteeism, disciplinary infractions, course progression, and academic performance by comparing the outcomes in 65 districts that adopted an EIIS to the outcomes in a set of similar districts that used the additional funding for other dropout prevention or college and career readiness initiatives. The study offers insight into the effectiveness of early efforts to scale up EIISs, a popular school-level intervention. EIIS adoption appears to have reduced the percentage of students who were chronically absent by 3.9?percentage points but does not appear to have had positive effects on the three other student outcomes during the first year: the percentage of students with disciplinary infractions, the percentage of grade?10 students who had acquired enough credits by the end of grade?9 to be considered on track for on-time graduation, or the percentage of grade?11 students meeting or exceeding proficiency standards on state math and English language arts tests. The findings offer the Oregon Department of Education information on the early effects of its efforts to promote EIIS across Oregon. The findings can also be used by other state and district education leaders to inform their considerations to scale up EIIS or other similar programs. [For the Study Snapshot, see ED614631. For the appendixes, see ED614632.]
Reviews of Individual Studies 9-PS -1
Optimal College Financial Aid: Theory and Evidence on Free College, Early Commitment, and Merit Aid from an Eight-Year Randomized Trial. EdWorkingPaper No. 21-393 (2021)
We provide theory and evidence about how the design of college financial aid programs affects a variety of high school, college, and life outcomes. The evidence comes from an eight-year randomized trial where 2,587 high school ninth graders received a $12,000 merit-based grant offer. During high school, the program increased their college expectations and non-merit effort but had no effect on merit-related effort (e.g., GPA). After high school, the program increased graduation from two-year colleges only, apparently because of the free college design/framing in only that sector. But we see no effects on incarceration or teen pregnancy. Overall, the results suggest that free college affects student outcomes in ways similar to what advocates of free college suggest and making aid commitments early, well before college starts, increases some forms of high school effort. But we see no evidence that merit requirements are effective. Both the standard human capital model and behavioral economics are required to explain these results.
Reviews of Individual Studies 9-12 -1
What Happens When You Combine High School and College? The Impact of the Early College Model on Postsecondary Performance and Completion (2020)
Early colleges are a new model of schooling in which the high school and college experiences are merged, shortening the total amount of time a student spends in school. This study uses a lottery-based experimental design to examine the impact of the model on longer term outcomes, including attainment of a postsecondary credential and academic performance in 4-year institutions. Results show that a significantly higher proportion of early college students were attaining postsecondary credentials. The results also show that early college students were completing their degrees more rapidly but that their performance in 4-year institutions was still comparable with the control students. [For the corresponding grantee submission, see ED604350.]
Reviews of Individual Studies K-3 -1
Children&apos;s Literacy Initiative: Final Report of the i3 Scale-Up Study (2020)
This i3 scale-up study examined the implementation and effectiveness of a 3-year literacy intervention developed by the Children's Literacy Initiative (CLI). The study was a school-level cluster randomized controlled trial conducted in 55 elementary schools from four states. Implementation results showed a high level of fidelity of intervention implementation across the treatment schools in the four urban school districts that had not previously worked with CLI. Intent-to-treat analyses of observation data showed that the intervention's effects on classroom literacy environment and teacher practices were not statistically significant in Year 1. By Year 3, however, treatment teachers who had taught in intervention schools for all 3 years were rated significantly higher in both the quality of classroom environment and the quality of literacy instructional practices than their peers in control schools. Analyses of student achievement data indicated that the CLI intervention had no statistically significant impact on students' reading achievement in any of the 3 intervention years. This held true for the overall student sample and for grade-specific subsamples, based on the overall literacy test score and for literacy subtest scores. In addition, differential impact analyses revealed that the impact of the CLI intervention on students' literacy achievement did not differ significantly by the level of students' baseline achievement. Further evidence from exploratory analyses showed that the intervention had no statistically significant impact on the English proficiency of English learner students or on teachers' knowledge of beginning reading practices. Because of the high amount of teacher attrition, an additional exploratory analysis that restricted the sample to only students of teachers who were stable across all 3 years in both conditions. There were positive and statistically significant effects for students in the CLI intervention condition who had stable teachers (teachers who had greater opportunity for intervention exposure) and who entered in Grade 1 and progressed to Grade 3 during the course of the study.
Reviews of Individual Studies K-12 -1
NW BOCES&apos;s System for Educator Effectiveness Development (SEED) Project: Final Evaluation Report (2020)
Purpose: In January 2015, the Northwest Board of Cooperative Educational Services (NW BOCES) received a five-year Investing in Innovation (i3) grant to develop and implement the System for Educator Effectiveness Development (SEED) program--an innovative professional development (PD) system designed to provide geographically isolated educators an impactful tool to improve teacher effectiveness. The purpose of this report is to document the implementation and impact evaluation of the grant on educator and student outcomes. Methods: Twenty-one schools in rural areas, where obtaining PD can be a challenge, participated in SEED between 2015 and 2020. One school closed during the study period but the majority of its students transferred to other participating schools. Because SEED was a school-level intervention, the target population consisted of all principals, assistant principals, teachers, and students in the participating sites. Correlational designs were implemented to examine the relationships between teacher-level and school-level SEED participation and the outcomes of interest, such as (1) principal engagement in teacher professional growth, (2) teacher access to and use of evidence-based and up-to-date practices, (3) teacher implementation of practice learned from PD in the classroom. A quasi-experimental design (QED) using propensity score matching (PSM) method was employed to examine difference in student achievement outcomes between the SEED schools and the matched non-SEED schools. Results: Correlational findings suggest that teachers who participated in SEED reported better outcomes compared to teachers who did not participate in SEED. Schools with high level of SEED participation had better outcomes compared to schools with low level of SEED participation. Findings of QED PSM design revealed that SEED had a statistically significant positive effect on one outcome measure (minority students' English language acquisition, or ELA) and marginally significant positive effects on four outcome measures (all related to English language acquisition and math outcomes among racial/ethnic minority and free and reduced-lunch, or FRL, students). Implications: Evaluation findings provided some positive and promising pieces of evidence to support SEED efficacy. Implementation findings suggest that the program was largely implemented with fidelity; yet, there are opportunities for improvement. Future research may consider replicating the program design and identify strategies to increase teacher participation at school level. Additional Materials: The following are appended: (1) SEED Evaluation: Technical Report; (2) Assessment of Fidelity of Implementation; and (3) Baseline Equivalence and Impact Analysis Outputs and Results.
Reviews of Individual Studies 4-8 -1
Literacy Design Collaborative 2018-2019 Evaluation Report. CRESST Report 867 (2020)
Engaged in the evaluation of LDC tools since June 2011, UCLA's National Center for Research on Evaluation, Standards, and Student Testing (CRESST) is using multiple data sources and a quasi-experimental design to examine LDC implementation and impact in two cohorts of schools in two large, urban school districts. This report presents the results on implementation of LDC in the large urban school district on the West Coast during the third year of the intervention, and the impact of the program across multiple years. Findings from both participant surveys and analyses of student outcomes reveal positive results for the LDC intervention. Analysis of student outcomes provided evidence of the program's effectiveness and confirmation for participants' positive views. Quasi-experimental analyses demonstrated a statistically significant positive impact of LDC as practiced by middle school teachers with 2 years of program experience across two cohorts of schools and teachers. A statistically significant positive impact was also found for Cohort 2 middle schools after just one year of implementation. [For the 2017-2018 report, see ED600053.]
Reviews of Individual Studies 4-5 -1
The Evaluation of the Enhanced Positive School Climate Model (2020)
Purpose: The Santa Ana Unified School District received an i3 grant (Investing in Innovation; funded by the U.S. Department of Education Grant number U411C160074) to build on their existing school climate practices. Called the Enhanced Positive School Climate Model, the aim is to improve school climate, student-adult relationships, create social emotional learning programs, and provide students the needed structure to access challenging curriculum and expectations. As part of this enhanced model, School Climate Liaisons (SCLs) were hired to support and provide coaching to schools in the intervention group on PBIS [Positive Behavioral Intervention and Supports], RP [Restorative Practice] implementation, and behavioral interventions. As part of the i3 grant requirements, the district employed a rigorous cluster-randomized trial whereby half of the district's elementary schools were assigned to receive the Enhanced Positive School Climate Model and half were assigned to a waitlist control. The confirmatory research question is: Do students in grades 4 and 5 at follow-up, in schools assigned to receive support from PBIS and Restorative Practice school climate specialists and community liaisons, who receive services for two years, exhibit higher levels of self-management at the end of the second year, as compared to students in grades 4 and 5 in schools assigned to not receive such support? Additionally, there were exploratory research questions examining changes in other SEL [social-emotional learning] measures including growth mindset, self-efficacy, and social awareness. Methods: This study employed a cluster-randomized controlled design whereby half of the study schools were assigned to the treatment condition and the other half of schools were assigned to the "business as usual" control condition. In total, 35 schools (30 K-5 schools; 5 K-8 schools) were randomly assigned to either the treatment or control condition. All students within these schools were included in the evaluation. Students in the treatment schools (n = 17) were eligible to receive services through the grant. Randomization occurred in May 2017. The 2016-17 school year served as a baseline school year (i.e., no services were provided). The Enhanced Positive School Climate Model began in the 2017-18 school year and continued into the 2018-19 school year for treatment schools only. Control schools were waitlisted and began receiving services in the 2019-20 school year. Students enrolled in district schools in May 2017 were tracked using student roster information through the end of the 2018-19 school year. Only students who were in study schools continuously from the 2016-2017 to 2018-2019 school years were included in the impact analysis. The confirmatory and exploratory outcomes referenced below were conducted using extant data from the district. Data were used from routine data collection processes within the district from the annual CORE climate student survey. The primary outcome measure was the five-item self-management scale on the CORE District's student survey (Taylor, Oberle, Durlak, & Weissberg, 2017; Transforming Education, 2014; https://www.rand.org/education-and-labor/projects/assessments/tool/2014/panorama-social-emotional-learning-questionnaire-measures.html) asked of all students in grades 4-12 each year. For the confirmatory research question (and all exploratory questions), adjusted post-intervention outcomes for students in treatment schools were compared to the outcomes for their counterparts in the control schools. This involved fitting conditional multilevel regression models (i.e., hierarchical linear modeling [HLM]), with additional terms to account for the nesting of individuals within schools (see Goldstein 1987; Raudenbush & Bryk, 2002; Murray 1998). Results: Eight two-level models were estimated per grade level to address the confirmatory and exploratory research questions. Although the students in treatment schools had slightly higher self-management, growth mindset and self-efficacy scores at follow-up, only the difference in fourth grade self-efficacy scores was statistically significant. In contrast, students in control schools had very slightly higher social awareness scores; this finding was not statistically significant. Implications: Meaningful and statistically significant differences were not found between students who attended schools that received the Enhanced Positive School Climate Model compared to their peers in schools that did not receive the Enhanced Positive School Climate Model. The lack of findings may be due to the other changes in school climate practices throughout the district during the study period. Additionally, variations in the implementation of the Enhanced Positive School Climate Model may have contributed to the lack of findings. Although the findings are not significant, the direction of results is mostly consistent, indicating increases in SEL competencies for students receiving additional school climate supports. Future studies should continue to investigate the relationship between whole-school approaches to school climate and changes in SEL competencies for students.
Reviews of Individual Studies 5-8 -1
The Impact of an Intensive Year-Round Middle School Program on College Attendance (2020)
Too many talented students who go to under-resourced schools do not achieve their full potential. Though they may perform very well relative to their classmates, these students do not receive the same kinds of academically challenging opportunities throughout their educational journey as do their counterparts in better-resourced public and private schools. Rather than matriculating to competitive high schools and from there to selective colleges they are qualified to attend, these students often go to less academically competitive high schools and on to colleges where graduation rates are low. Some even forgo college altogether. To address this problem, Higher Achievement offers an intensive, academically oriented program for middle school students in under-resourced schools. Starting in the summer before fifth or sixth grade, Higher Achievement offers its participants, called "scholars," 650 extra hours of academic enrichment and instruction after school and during the summers through the eighth grade. The program includes English and math instruction as well as field trips to competitive high schools and colleges, achievement test preparation, and assistance in applying for financial aid. This short report presents the results of a randomized controlled trial of Higher Achievement that started in 2005, comparing the outcomes of students who were offered the opportunity to participate in Higher Achievement (the program group) and students who were not (the control group). It presents the impacts of the program one, two, and four years after enrollment, as well as its long-term impacts on college attendance. The study found that Higher Achievement was successful at changing the educational trajectory of students through middle school and improved the academic quality of many students' high school experiences, but did not affect the colleges to which they matriculated. By Year 2, there were positive impacts on students' math and reading test scores. In Year 4, the impacts on math test scores remained statistically significant. Higher Achievement had a small impact on the types of high schools its scholars ultimately attended. Program group students were more likely than control group students to matriculate to private or parochial schools and less likely to go to nonacademically competitive charter or magnet schools. By 2019, there was no difference in college going. More than 70 percent of both program and control group students had ever attended college. There were no differences in the academic quality of the colleges Higher Achievement's scholars ultimately attended, as measured by being a two- or four-year college; a college having a lower acceptance rate; or a college whose freshmen on average had higher SAT math or reading scores. Higher Achievement's college impacts did not differ by whether a student's parent had attended college or by student characteristics. The study shows that Higher Achievement is a very effective middle school program, improving students' middle school trajectories. However, the impacts did not persist after the program through high school and college.
Reviews of Individual Studies 4 -1
An Adaption of the Good Behaviour Game to Promote Social Skill Development at the Whole-Class Level (2020)
Social skill interventions are utilised by educational psychologists (EPs) to promote positive social behaviour amongst pupils. These have predominantly occurred for target populations, rather than at the whole-class level. Research into evidence-based, whole-class interventions for social skill development is warranted. The Good Behaviour Game (GBG) is a contingency management intervention for promoting positive behaviour at the whole-class level. The current study evaluates an adaptation of the GBG to target engagement in social skills in a mainstream primary school classroom setting. An ABAB reversal design was used to evaluate teacher implementation of the GBG. The GBG was shown to be effective in promoting engagement in targeted social behaviour of "positive social interactions" and "working as team". No change in behaviour was observed for the targeted social behaviour of "supporting peers". The paper discusses the implications of the findings, limitations, relevancy to EP practice and impetus for further research.
Reviews of Individual Studies 4-5 -1
Final Report of the i3 Impact Study of Making Sense of SCIENCE, 2016-17 through 2017-18 (2020)
Science education has experienced a significant transition over the last decade, catalyzed by a re-envisioning of what students should know and be able to do in science. That re-envisioning culminated in the release of the Next Generation Science Standards (NGSS) in 2013. The new standards set off a chain reaction of standards adoption and implementation across states, districts, and schools, including steps taken toward transforming science professional learning, instruction, curriculum, and assessment. It was in this dynamic context that Empirical Education conducted an impact evaluation, as part of an Investing in Innovation (i3) grant, of WestEd's Making Sense of SCIENCE project, a teacher professional learning model aimed at raising students' science achievement through improving science instruction. Under this grant, WestEd and Empirical Education also partnered with Heller Research Associates (HRA) to conduct an implementation study and a scale-up study of Making Sense of SCIENCE. The impact evaluation, which is the focus of this report, was a two-year cluster-randomized control trial (RCT) that took place in California and Wisconsin across seven school districts and 66 elementary schools in the 2016-17 and 2017-18 school years. The study randomized schools to either receive the Making Sense of SCIENCE professional learning or to the business-as-usual ("control") group, which received the professional learning (delayed-treatment) after the study ended. The study found that Making Sense of SCIENCE had a positive impact on teacher content knowledge (effect size = 0.56, p = 0.006) and a positive impact on a holistic scale of teacher pedagogical content knowledge (effect size = 0.41, p = 0.026). The study also yielded positive and significant impacts on the amount of time teachers spent on science instruction (effect size = 0.40, p = 0.015) and on the emphasis that teachers placed on NGSS-aligned instructional practices, with statistically significant effect sizes ranging from 0.40 to 0.49. This suggestive evidence that Making Sense of SCIENCE changes classroom science learning experiences in ways that align with expectations in NGSS, which is a hypothesized precursor to measuring impacts on student achievement, deserves notice. In regard to student science achievement, the study did not find statistically significant results for the full sample of students (effect size = 0.06, p = 0.494), or for the sample of students in the bottom third of incoming math and English Language Arts achievement, with effect sizes of 0.22 (p = 0.099) and 0.073 (p = 0.567), respectively. Notably, with the exception of one negative effect size, additional analyses on student achievement using different measures and samples yielded positive, but not statistically significant, effect sizes ranging from 0.02 to 0.12. Evaluators offer three potential contributors to the findings of limited impact on student science achievement. First, given the timing of the study in relation to the release of the NGSS in 2013, finding a suitable NGSS-aligned student science assessment was a challenge. Second, most study schools and districts had not yet adopted NGSS-aligned curricula and did not have access to NGSS-aligned curriculum resources. Third, the sample of teachers was unstable across the two years, with the percentage of teachers leaving the school congruous to the percentage observed at the national level. [For the appendices, see ED609254; for the research summary, see ED609256.]
Reviews of Individual Studies 7-12 -1
The Pathway to Academic Success: Scaling Up a Text-Based Analytical Writing Intervention for Latinos and English Learners in Secondary School (2020)
This study reports findings from a multisite cluster randomized controlled trial designed to validate and scale up an existing successful professional development program that uses a cognitive strategies approach to text-based analytical writing. The Pathway to Academic Success Project worked with partner districts affiliated with 4 National Writing Project (NWP) sites in southern California. Informed by a wide body of research on the efficacy of strategy instruction to enhance students' academic literacy, the intervention aimed to help secondary school students, particularly Latinos and mainstreamed English learners, to develop the academic writing skills called for in the rigorous Common Core State Standards for English Language Arts. Two hundred thirty teachers from partner districts affiliated with the NWP sites were stratified by school and grade and then randomly assigned to the treatment or control group. Treatment teachers participated in 46 hrs of training and learned how to apply cognitive strategies by using an on-demand writing assessment to help students understand, interpret, and write analytical essays about nonfiction texts. Multilevel models revealed significant effects on a holistic measure of an on-demand writing assessment (d = 0.32) as well as on 4 analytic attributes: content (d = 0.31), structure (d = 0.29), fluency (d = 0.27), and conventions (d = 0.32). Four dimensions of scaling up--spread, reform ownership, depth, and sustainability--are also discussed.
Reviews of Individual Studies 7 -1
Improving Student Behavior in Middle School Art Classrooms: Initial Investigation of CW-FIT Tier 1 (2020)
Classroom management is commonly challenging in middle schools. Class-wide function-related intervention teams (CW-FIT) is a multitiered intervention designed to decrease problem behaviors at the classroom level. It is comprises evidence-based practices such as teaching classroom expectations, increasing teacher praise, and using positive reinforcement in an interdependent group contingency. CW-FIT has shown promise in a variety of school settings, but it has not been tested in middle school art classrooms. This initial investigation examined the effects of CW-FIT using a single-subject ABAB design in two middle school art classrooms. Results indicated that class on-task behavior increased by more than 25% and teacher praise-to-reprimand ratios more than doubled during CW-FIT implementation compared with baseline levels. Results also indicated that on-task behavior for students identified as at risk for behavioral disorders improved by more than 18% during the intervention. Teachers and students found the intervention to be socially valid. Resulting implications were promising for using CW-FIT in other middle school art classrooms.
Reviews of Individual Studies 6-8 -1
Effects of the Executive Development Program and Aligned Coaching for School Principals in Three U.S. States. Investing in Innovation Study Final Report. Research Report. RR-A259-1 (2020)
The purpose of this study was to evaluate the National Institute for School Leadership's (NISL's) Executive Development Program (EDP) and paired leadership coaching as implemented in three states, with funding from the U.S. Department of Education's Investing in Innovation (i3) grant program. NISL's Executive Development Program (EDP) is a year-long professional development program that has served thousands of principals in 23 states since 2014. The study was a randomized control trial study spanning 332 schools and 118 school districts. It evaluated the effects of the offer of and of participation in the EDP and coaching. Take up rates of the program were relatively low, and the study found no significant effects of the EDP and coaching on student achievement in English language arts or mathematics, on student attendance rates, or on student grade progression rates within three years of the start of the program. There were, however, effects of participation in the EDP and coaching in two areas of leadership practice as reported by principals on surveys conducted more than two years after the start of the intervention. We hypothesize that local buy-in and capacity to fully participate in the intensive professional development program most likely influenced the degree to which the intervention was successful. [Criterion Education sponsored this report, with funding from NISL through the i3 grant from the U.S. Department of Education. For the first report of this series, "Putting Professional Learning to Work: What Principals Do with Their Executive Development Program Learning," see ED606171.]
Reviews of Individual Studies 8-9 -1
Impact Study Evaluation of the Rural Math Innovation Network (RMIN) i3 Development Project (2020)
The Rural Math Innovation Network (RMIN) is a 4-year project that launched in January 2017 after receiving a $2.9 million Investing in Innovation (i3) development grant from the U.S. Department of Education (ED) and matching funds from the private sector. Virginia Ed Strategies and rural local education agencies (LEAs) in Virginia are implementing a project using a networked improvement community (NIC) of Pre-Algebra and Algebra 1 teachers to incorporate social-emotional learning (SEL) factors of academic self-efficacy and growth mindset into lesson plans for teaching career readiness math competencies. During Year 1, the project established Memos of Understanding with 18 school divisions in southwest and southside Virginia, which enabled math teachers within these divisions to submit applications to participate in the project. At the end of Year 1, December 2017, the project had a 38-member teacher cohort across 25 schools. By the end of Year 2 (January 1 - December 31, 2018), the cohort included 30 teachers (19 middle school teachers and 11 high school teachers) across 20 schools (12 middle schools and 8 high schools) within 16 participating divisions (several teachers dropped out of the project in Year 2 and a few teachers were added). During Year 3 (January 1 - December 31, 2019), several more teachers dropped out of the project, resulting in 26 teachers (17 middle school and 9 high school) across 18 schools within 15 participating divisions. Sixteen of the 26 teachers are located in the southside region, with the remaining 10 teachers located in the southwest region of Virginia One of the i3 requirements is to have an external evaluation conducted of the project; development grants must include both an implementation study and an impact study. To fulfill this requirement, Virginia Ed Strategies hired ICF to conduct an independent evaluation of the RMIN project throughout the 4-year period. The evaluation includes three components: a formative study to provide ongoing feedback about participants' reactions, learning, behaviors, and results; an implementation study focusing on how well the structural and programmatic aspects of the RMIN project are implemented, as well as facilitating or impeding factors; and an impact study to determine the extent to which the project impacts high-need students' math achievement. Previously in Year 2, the evaluation team recruited 10 comparison teachers across rural Virginia school divisions who were also teaching either Pre-Algebra or Algebra 1 (no school has both a participating and comparison teacher). The purpose of this report is to summarize key findings from the impact study. The primary audience is the RMIN project staff at Virginia Ed Strategies; secondary audiences include ED and other interested stakeholders. Although the impact study was designed originally to include students from the 2018-19 and 2019-20 school years, the COVID-19 pandemic in spring 2020 led to school closings and no administration of the statewide Standards of Learning (SOL) math assessment. Therefore, the impact study is based solely on the one year of SOL data. Findings are presented for the impact data and framed by the evaluation questions. Conclusions are presented below. Impact on student achievement. The one-year program impact on students' SOL scores was estimated and the results did not find evidence that the RMIN program significantly improved students' SOL performance. The program impact from the Pre-Algebra sample was negative, but it was not statistically significant, and the effect size was small. The program impact from the Algebra I analysis was positive but not statistically significant, and the effect size was small.
Reviews of Individual Studies 7-9 -1
Managing Student Behavior in a Middle School Special Education Classroom Using CW-FIT Tier 1 (2020)
Middle school special education teachers often express concern about challenging student behavior. Class-Wide Function-Related Intervention Teams (CW-FIT), a behavior management program based on school-wide positive behavior support, have been effective in elementary general education classrooms. The present study, the first to apply it in a middle school special education setting, used an ABAC design to examine effects on student on-task behavior and teacher praise rates in a self-contained special education classroom for students with severe disabilities and their typically developing peer tutors. Results suggested that CW-FIT Tier 1 is associated with improvements in student on-task behavior and teacher praise rates, especially when peer tutors are included in the intervention and when the timer is silent. Both teachers and students reported the intervention to be socially valid. Study limitations and areas for future research are addressed.
Reviews of Individual Studies 1-8 -1
Literacy Design Collaborative 2018-2019 Evaluation Report for New York City Department of Education (2020)
The Literacy Design Collaborative (LDC) was created to support teachers in implementing college and career readiness standards in order to teach literacy skills throughout the content areas. Teachers work collaboratively with coaches to further develop their expertise and design standards-driven, literacy-rich writing assignments within their existing curriculum across all content areas. This report presents the results on implementation of LDC in the New York City Department of Education during the third year of the intervention, and the impact of the program across multiple years. As of 2018-2019, participating schools included 13 from Cohort 1, which began implementation during the 2016-2017 school year, and 23 from Cohort 2, which commenced at the beginning of the 2017-2018 school year. Our primary impact analyses, presented in this report for the first time, pool teachers from both cohorts to measure their impact after participating in LDC for 2 consecutive years (2017-2018 student outcomes for Cohort 1 and 2018-2019 student outcomes for Cohort 2). Teachers and administrators appreciated LDC and perceived positive impact on their practice and their students' learning. Quasi-experimental analyses tended to produce positive estimates for the impact of LDC on student English language arts (ELA) assessment scores, but the differences did not reach the level of statistical significance. [For the 2017-2018 evaluation report, see ED606884.]
Reviews of Individual Studies 11-PS -1
Can Light-Touch College-Going Interventions Make a Difference? Evidence from a Statewide Experiment in Michigan (2020)
I conduct a statewide experiment in Michigan with nearly 50,000 high-achieving high school seniors. Treated students are mailed a letter encouraging them to consider college and providing them with the web address of a college information website. I find that very high-achieving, low-income students, and very high-achieving, minority students are the most likely to navigate to the website. Small changes to letter content affect take-up. For example, highlighting college affordability induces 18 percent more students to the website than highlighting college choice, and 37 percent more than highlighting how to apply to college. I find a statistically precise zero impact on college enrollment among all students who were mailed the letter. However, low-income students experience a small increase in the probability that they enroll in college, driven by increases at four-year institutions. An examination of persistence through college, while imprecise, suggests that the students induced into college by the intervention persist at a lower rate than the inframarginal student.
Reviews of Individual Studies 11-12 -1
Dual-Credit Courses and the Road to College: Experimental Evidence from Tennessee (2020)
Dual-credit courses expose high school students to college-level content and provide the opportunity to earn college credits, in part to smooth the transition to college. With the Tennessee Department of Education, we conduct the first randomized controlled trial of the effects of dual-credit math coursework on a range of high school and college outcomes. We find that the dual-credit advanced algebra course alters students' subsequent high school math course-taking, reducing enrollment in remedial math and boosting enrollment in precalculus and Advanced Placement math courses. We fail to detect an effect of the dual-credit math course on overall rates of college enrollment. However, the course induces some students to choose four-year universities instead of two-year colleges, particularly for those in the middle of the math achievement distribution and those first exposed to the opportunity to take the course in eleventh rather than twelfth grade. We see limited evidence of improvements in early math performance during college.
Reviews of Individual Studies 12-PS -1
Experimental Evidence on the Effects (or Lack Thereof) of Informational Framing during the College Transition (2020)
Technology-facilitated interventions following high school graduation have shown promise for increasing the likelihood of college matriculation, but we know little about how to fine-tune these tools. I conducted an experiment in which college-intending Tennessee high school graduates received informational messages in distinct behavioral frames: business-as-usual, in which they received the same messages as the prior cohort; loss aversion, which emphasized what students would lose if they did not act; reduction of ambiguity, which provided details on necessary actions and anticipated completion times; and peer support, which encouraged students to work with friends on enrollment tasks. There was no main effect of the treatment frames. Heterogeneity analyses suggest that, at certain eligibility checkpoints, a loss aversion frame may negatively affect men and the peer support frame may negatively affect first-generation and Black participants. I situate the findings in the literature and recommend future directions for research on informational intervention delivery.
Reviews of Individual Studies 11-PS -1
Dual-Credit Courses and the Road to College: Experimental Evidence from Tennessee (2020)
Dual-credit courses expose high school students to college-level content and provide the opportunity to earn college credits, in part to smooth the transition to college. With the Tennessee Department of Education, we conduct the first randomized controlled trial of the effects of dual-credit math coursework on a range of high school and college outcomes. We find that the dual-credit advanced algebra course alters students' subsequent high school math course-taking, reducing enrollment in remedial math and boosting enrollment in precalculus and Advanced Placement math courses. We fail to detect an effect of the dual-credit math course on overall rates of college enrollment. However, the course induces some students to choose four-year universities instead of two-year colleges, particularly for those in the middle of the math achievement distribution and those first exposed to the opportunity to take the course in eleventh rather than twelfth grade. We see limited evidence of improvements in early math performance during college.
Reviews of Individual Studies 12 -1
Customized Nudging to Improve FAFSA Completion and Income Verification (2020)
Informational and behavioral barriers hinder social benefit take-up. We investigate the impact of mitigating these barriers through providing personalized information on benefits application status and application assistance on filing the Free Application for Federal Student Aid (FAFSA), the gateway to college financial aid. Through a multidistrict experiment, we assess the impact of this outreach, delivered via text message. This data-driven strategy improves FAFSA completion and college matriculation and potentially reduces the negative consequences of additional procedural hurdles such as FAFSA income verification, required of approximately one third of filers nationally.
Reviews of Individual Studies 1-2 -1
Using Intensive Intervention to Improve Mathematics Skills of Students with Disabilities: Project Evaluation Report (2020)
The purpose of this project evaluation was to assess the impact of data-based individualization (DBI) on the mathematics achievement of students with intensive mathematics learning needs, including students with disabilities. The evaluation study used a cluster randomized trial in which elementary schools were randomly assigned to treatment using a delayed-intervention design. Since this was a development project, the evaluation delineated between the primary, confirmatory impact question and exploratory research questions. The confirmatory question included students in Grades 1-2 and was concerned with the relationship of one year of DBI implementation support in comparison with a business-as-usual, delayed intervention group. Because of the developmental, iterative nature of the project, exploratory questions were concerned with cumulative longitudinal relations between years of DBI implementation support between two cohorts of elementary schools. In addition, project staff supported DBI implementation pilot in two middle schools and tracked student progress in those sites. Analytic results provided preliminary evidence to suggest that there may be contextual factors that govern the likelihood a student will profit from DBI. In addition, schools may require significant ongoing support to sustain implementation.
Reviews of Individual Studies 1-2 -1
Efficacy Study of a Social Communication and Self-Regulation Intervention for School-Age Children with Autism Spectrum Disorder: A Randomized Controlled Trial (2019)
Purpose: This study aimed to examine the initial efficacy of a parent-assisted blended intervention combining components of Structured TEACCHing and Social Thinking, designed to increase social communication and self-regulation concept knowledge in 1st and 2nd graders (n = 17) diagnosed with autism spectrum disorder (ASD) and their parents. Method: A randomized delayed treatment control group design with pre- and postintervention assessments of both parents and children was implemented within a community practice setting. Two follow-up assessments at 3 and 6 months post intervention were also completed. Results: Overall, results indicate that the intervention is efficacious in teaching social communication and self regulation concept knowledge to children with ASD and their parents. Both parents and children demonstrated an increase in social communication and self-regulation knowledge after participating in the Growing, Learning, and Living With Autism Group as compared to a delayed treatment control group. The effects of the intervention did not extend to parent-child interactions coded from video recordings. Child treatment effects were maintained at the 3- and 6-month follow-up assessments. Conclusions: Preliminary efficacy of the Growing, Learning, and Living With Autism Group was established. Based on parent report at the conclusion of the intervention, this is a socially valid intervention for teaching social communication and self-regulation skills to school-age children with ASD. [This is the online version of an article published in "Language, Speech, and Hearing Services in Schools." For the final published version of this article, see EJ1222622.]
Reviews of Individual Studies 12 -1
Preparing New York City High School Students for the Workforce: Evaluation of the Scholars at Work Program. Research Report. RR-2488-NYCCEO (2019)
As the New York City economy becomes increasingly reliant on workers who have some postsecondary education or training in a specialized field, there is a growing need for local policymakers and educators to identify the most efficient ways to prepare high school students to take on these "middle-skill jobs." These needs are particularly acute in the transportation and manufacturing industries. To address these needs, the New York City Department of Small Business Services (SBS) and Department of Education (DOE) created Scholars at Work (SAW), a program available to an eligible subset of New York City high school students enrolled in Career and Technical Education (CTE) programs. The goal of the SAW program is to expose students to career opportunities, to provide them with real-life work experience alongside adults, and to develop their workplace skills. This report presents findings from the RAND Corporation's evaluation of the SAW program. The evaluation has two components: an implementation study that examines and describes SAW's activities and processes, to understand the extent to which those are functioning as the designers and implementers of the program expect, and an outcomes study, which analyzes how SAW participants are faring in the labor market compared to comparable NYC public school graduates. [This report was supported by the New York City's Mayor's Office for Economic Opportunity.]
Reviews of Individual Studies 12 -1
Preparing New York City High School Students for the Workforce: Evaluation of the Scholars at Work Program. Research Report. RR-2488-NYCCEO (2019)
As the New York City economy becomes increasingly reliant on workers who have some postsecondary education or training in a specialized field, there is a growing need for local policymakers and educators to identify the most efficient ways to prepare high school students to take on these "middle-skill jobs." These needs are particularly acute in the transportation and manufacturing industries. To address these needs, the New York City Department of Small Business Services (SBS) and Department of Education (DOE) created Scholars at Work (SAW), a program available to an eligible subset of New York City high school students enrolled in Career and Technical Education (CTE) programs. The goal of the SAW program is to expose students to career opportunities, to provide them with real-life work experience alongside adults, and to develop their workplace skills. This report presents findings from the RAND Corporation's evaluation of the SAW program. The evaluation has two components: an implementation study that examines and describes SAW's activities and processes, to understand the extent to which those are functioning as the designers and implementers of the program expect, and an outcomes study, which analyzes how SAW participants are faring in the labor market compared to comparable NYC public school graduates. [This report was supported by the New York City's Mayor's Office for Economic Opportunity.]
Reviews of Individual Studies 10-12 -1
College Guidance for All: A Randomized Experiment in Pre-College Advising (2019)
Pre-college advising programs exist in most disadvantaged high schools throughout the United States. These programs supplement traditional advising by high school guidance counselors and attempt to help underrepresented and disadvantaged students overcome the complexities of the postsecondary admission and financial aid processes. Existing evidence on these programs often uses within-school randomization where spillovers and alternative supports may confound estimates. We provide the first evidence on a whole school intervention resulting from a school-level randomized controlled trial in the United States. The college access program we study uses a near-peer model where a recent college graduate works at the school assisting students in the application and enrollment process. Pooled results across the first three years of program implementation find no significant impacts on overall college enrollment. However, subgroup analyses reveal positive, significant effects among the groups most targeted by the intervention: Hispanic and low-income students. Most of the impact comes through increasing two-year college enrollment, but this appears to be new entrants rather than inducing students to move from four-year to two-year colleges. The observed positive effects for these subgroups attenuate over time. We attribute this drop in the estimated impact to departures in fidelity of the experiment. Even among the cohorts for which we find positive enrollment impacts, we find no significant impacts on college persistence. [For the grantee submission, see ED594418.]
Reviews of Individual Studies 11-12 -1
Realizing Your College Potential? Impacts of College Board&apos;s RYCP Campaign on Postsecondary Enrollment. EdWorkingPaper No. 19-40 (2019)
The College Board sought to reduce barriers in the college application process by minimizing information aggregation costs, encouraging a broad application portfolio, and providing an impetus to start the search process. Some students were offered additional encouragements, such as text message reminders or college application fee waivers. In a randomized control trial with 785,000 low- and middle-income students in the top 50% of the PSAT and SAT distributions, we find no changes in college enrollment patterns, with the exception of a 0.02[sigma] increase in college quality measures for African-American and Hispanic students
Reviews of Individual Studies 1 -1
Schema-based word-problem intervention with and without embedded language comprehension instruction (2019)
Reviews of Individual Studies 2-3 -1
Exploring Solutions to Address Students&apos; Social Competencies to Facilitate School Success: A Usability and Feasibility Study (2019)
In this methodological illustration, we examined Tier 2 social skills interventions to support school success for students with or at risk for emotional or behavior disorders. We presented findings examining the usability and feasibility of the "Social Skills Improvement System-Intervention Guide" and "Positive Action Counselor's Kit," which emphasize teaching and reinforcing social skills associated with success within and beyond school settings. We described how data-informed decision-making processes were conducted to design, implement, and evaluate social skills interventions, including monitoring student outcomes across the two programs. We end with a discussion of barriers and enablers toward conducting data-informed social skills interventions in authentic educational settings.
Reviews of Individual Studies 3 -1
Effects of Super Solvers fractions intervention for at-risk third graders: A research report (2019)
Reviews of Individual Studies 2-4 -1
MindPlay Virtual Reading Coach: Does It Affect Reading Fluency in Elementary School? (2019)
Important strides have been made in the science of learning to read. Yet, many students still struggle to attain reading proficiency. This calls for sustained efforts to bridge theoretical insights with applied considerations about ideal pedagogy. The current study was designed to contribute to this conversation, namely by looking at the efficacy of an online reading program. The chosen reading program, referred to as MindPlay Virtual Reading Coach (MVRC), emphasizes the mastery of basic reading skills to support the development of reading fluency. Its focus on basic skills diverges from the goal of increasing reading motivation. And its focus on reading fluency, vs. broad literacy achievement, offers an alternative to already existing reading enrichment. In order to test the efficacy of MVRC, we recruited three school districts. One district provided data from elementary schools that used the MVRC program in Grades 2 to 6 (N = 2,531 total). The other two districts participated in a quasi-experimental design: Six 2nd-grade classrooms and nine 4th-grade classrooms were randomly assigned to one of three conditions: (1) instruction as usual, (2) instruction with an alternative online reading program, and (3) instruction with MVRC. Complete data sets were available from 142 2nd-graders and 172 4th-graders. Three assessments from the MVRC screener were used: They assessed reading fluency, phonic skills, and listening vocabulary at two time points: before and after the intervention. Results show a clear advantage of MVRC on reading fluency, more so than on phonics or listening vocabulary. At the same time, teachers reported concerns with MVRC, highlighting the challenge with reading programs that emphasize basic-skills mastery over programs that seek to encourage reading.
Reviews of Individual Studies 1 -1
A feasibility study and a pilot cluster randomised controlled trial of the PAX 'Good Behaviour Game' in disadvantaged schools [Doctoral dissertation, Queen's University Belfast]. (2019)
Reviews of Individual Studies 7-8 -1
Study of Physical Science and Engineering Invention Kit Curriculum for Middle School: External Evaluation of the Investing in Innovation Central Virginia Advanced Manufacturing Development Grant 78. Making Research Relevant (2019)
Three central Virginia school districts and engineering education researchers at the University of Virginia were awarded an Investing in Innovation development grant to design, implement, test, and nationally disseminate a project-based engineering curriculum for middle school students. Referred to as invention kits, the curriculum is developed to teach key science and engineering principles and related skills to Grades 7 or 8 students by constructing modern interpretations of 19th-century inventions that sparked industrial activity within society: the solenoid, the linear motor, and the linear generator. As part of the external evaluation, American Institutes for Research (AIR) conducted an impact study to assess the invention kits' effect on students' engineering and physical science knowledge, as well as students' interest and confidence in STEM learning. The study used a quasi-experimental comparison group design investigating differences in student pre- and-posttests during the 2017-18 school year. Students in four schools across the three districts used a set of three invention kits in their engineering electives, as compared with students taking engineering electives in three schools within one district that had business-as-usual engineering curriculum. AIR studied implementation of the kits by collecting data reported by teachers on student use of kit components, interviews with teachers on how kits were incorporated into their engineering elective curriculum and adapted for use with their students, and observations of kits in use during site visits. The research team did not find a statistically significant difference between the physical science and engineering assessment scores of students who used the kits and comparison students. The research team did not find a statistically significant difference between the measures of STEM interest and confidence of students who used the kits and comparison students. Teachers and students in two of the four schools in the treatment group implemented the three invention kits with fidelity (defined as with at least 75% of their students, using at least 60% of kit components). One of the three kits (Solenoid) was implemented with fidelity by all four participating schools.
Reviews of Individual Studies 9 -1
An Efficacy Study of a Ninth-Grade Early Warning Indicator Intervention (2019)
Building on previous research showing how well ninth-grade student behaviors predict on-time high school graduation, this experimental study investigates the impact of a ninth-grade intervention on student attendance and course passing. The study, conducted in 41 geographically and demographically diverse high schools within a single state, evaluates the effects of placing a half-time staff member in high schools to implement the Early Warning Intervention (EWI) Team model designed to monitor ninth-grade early warning indicators and provide timely interventions. Analyses based on the prespecified student outcomes of attendance rate and percentage of ninth-grade course credits earned indicated no statistically significant impact of the intervention. On secondary outcome variables, results indicated that students in treatment schools were significantly less likely than control school students to be chronically absent. The difference between treatment and control school students on dichotomous measures of course failure were not statistically significant. The widespread dissemination of research and best practices related to early warning systems and ninth-grade interventions likely accounted for low levels of contrast between treatment and control school practices and outcomes.
Reviews of Individual Studies 9-12 -1
Effectiveness of &quot;Enhanced Units&quot;: A Report of a Randomized Experiment in California and Virginia. Research Report (2019)
Empirical Education Inc. is the independent evaluator of SRI International's 2014 Investing in Innovation (i3) Development grant called Redesigning Secondary Courses to Improve Academic Outcomes for Adolescents with Disabilities and Other Underperforming Adolescents. The goal of the grant is to develop "Enhanced Units" that combine research-based content enhancement routines, collaboration strategy, and technology components for secondary U.S. History and biology classes. This report presents findings of a randomized control trial (RCT) during the 2017-18 school year. The RCT measured the impact of "Enhanced Units" on higher order content skills (as measured through unit tests) in high school biology and U.S. History classes in three districts in Virginia and California. SRI, the Center for Applied Special Education Technology (CAST), and their research and practitioner partners developed "Enhanced Units" (EU) with the goal of integrating research-based content enhancement routines with technological enhancements to improve student content learning and higher order reasoning, especially for students with disabilities or other learning challenges. This study also documents the extent to which the core components of EU were implemented with fidelity. The authors provide descriptive results on classroom practices (as measured by teacher surveys) and contextual factors that support or hinder implementation (as described during teacher interviews). Future improvements to EU should focus on answering the question: "What is/are the best way(s) for teachers to present SIM routines to their students, particularly for students with learning challenges through SIM intervention?"
Reviews of Individual Studies 9-12 -1
Building college and career pathways for high school students: Youth CareerConnect [RCT]. (2019)
Reviews of Individual Studies 9 -1
Writing Instruction and Technology in the Classroom: Supporting Teachers with the Drive to Write Program (2019)
Around the country, high school teachers are being called upon to improve student writing, but they often lack the tools and requisite know-how to make a difference. An ambitious new program called Drive to Write is attempting to change that. This report describes an evaluation of the program's implementation in 11 public high schools in New York City during the 2017-2018 school year. Key findings include: (1) The program rolled out as intended throughout the 2017-2018 school year. Coaches tailored their feedback for teachers and helped them focus on writing instruction by using technology to support workflow and data to guide their approach to individual students. Overall, teachers expressed a high rate of satisfaction with, and adoption of, the tools and support provided by Drive to Write; (2) Teachers customized their use of technology tools and writing instruction to suit the needs of their students and the constraints of their classroom. Nevertheless, practices related to writing and technology use among the 15 program teachers in the 11 Drive to Write schools were similar to those of the 17 teachers in 12 comparison schools. Teachers in program schools, however, exhibited greater understanding of, and proficiency with, higher-level writing instruction; and (3) It is unclear whether the program had a positive effect on student writing after one academic year of implementation. The analytic sample included 1,008 program students and 936 comparison students. Several factors could have dampened early effects, such as comparable writing improvement among all students during ninth-grade, similar technology practices between program and comparison students, or a sample of schools too small to detect modest effects. It could also be that the assessment score outcome may reflect student skill at timed test taking (which all schools address), rather than the intervention's core focus on intensive writing composition (on which program schools spent dedicated time). This evaluation contributes to the growing literature that highlights the support teachers require to integrate new technology and data tools into their instructional routines, the role of individualized coaching for teachers, and the sustainability of data-driven teacher feedback to students. An understanding of these elements can lead to better implementation of writing programs in high schools across the country and, potentially, improved student writing.
Reviews of Individual Studies 6-8 -1
Final impact results from the i3 implementation of Teach to One: Math (2019)
Reviews of Individual Studies 7-8 -1
Evaluation of Reading Apprenticeship across the Disciplines (RAAD): Effective Secondary Teaching and Learning through Literacy Leadership (2019)
Reading Apprenticeship is a model of academic literacy instruction designed by the Strategic Literacy Initiative (SLI) at WestEd to improve student literacy skills and academic achievement. Based on understandings of the close relationship between curricular reform and professional development, Reading Apprenticeship includes an instructional framework and associated professional development model for secondary and post-secondary teachers across the academic subject areas. Teachers across the subject areas learn how to build student capacities to carry out intellectually engaged reading, make meaning, acquire academic and disciplinary language, read independently, and set personal goals for literacy development. In 2015, the U.S. Department of Education awarded SLI a three-year Supporting Effective Educator Development (SEED) grant to disseminate Reading Apprenticeship professional learning through the Reading Apprenticeship Across the Disciplines (RAAD) project, a cross-disciplinary blended model of Reading Apprenticeship. Through RAAD, WestEd served 2,240 teachers from 570 schools in 6 states (California, Illinois, Michigan, New York, Texas, and Wisconsin). As part of the grant, IMPAQ International conducted an independent evaluation of RAAD effectiveness. This report presents findings from the randomized controlled trial conducted in California, New York, Texas, and Wisconsin. The impact evaluation employed a group-randomized controlled trial (RCT) in which 40 middle schools from 6 blocks, labeled A through F, were randomly assigned to a treatment group (19 schools), which received the RAAD intervention; or a control group (21 schools), which was set to receive delayed professional development. Grade 7 or 8 English Language Arts (ELA), science, and social studies teachers recruited from treatment schools received the RAAD professional development and ongoing support during the 2016-18 study period, while control schools conducted business as usual. Two years of data were collected from the study schools. Findings from this study demonstrate the success of the RAAD project in offering teachers professional learning and support to scale to help them change their instructional practices to foster metacognitive inquiry, increase class time spent reading, and encourage use of collaboration and reading strategies by students. These findings were accompanied by significant reduction in traditional teacher practices and are consistent with positive findings from other studies of Reading Apprenticeship. However, this study also shows that this iteration of the Reading Apprenticeship fell short of improving student literacy and achievement as measured by standardized assessments.
Reviews of Individual Studies 4-5 -1
Effects of Fourth- and Fifth-Grade Super Solvers Intervention on Fraction Magnitude Understanding and Calculation Skill (2019)
Reviews of Individual Studies 4-11 -1
The Next Generation of State Reforms to Improve their Lowest Performing Schools: An Evaluation of North Carolina's School Transformation Initiative (2019)
In contrast to prior federally mandated school reforms, the Every Student Succeeds Act (ESSA) allows states more discretion in reforming their lowest performing schools, removes requirements to disrupt the status quo, and does not allocate substantial additional funds. Using a regression discontinuity design, we evaluate a state turnaround initiative aligned with ESSA requirements. We find the effect on student test score growth was not significant in year one and -0.13 in year two. Also in year two, we find that teachers in turnaround schools were 22.5 percentage points more likely to turn over. Teacher turnover appears to have been voluntary rather than the result of strategic staffing decisions.
Reviews of Individual Studies 4 -1
Does an Integrated Focus on Fractions and Decimals Improve At-Risk Students&apos; Rational Number Magnitude Performance? (2019)
The purpose of this study was to assess whether intervention with an integrated focus on fraction and decimal magnitude provides added value in improving rational number performance over intervention focused exclusively on fractions. We randomly assigned 4th graders with poor whole-number performance to 3 conditions: a business-as-usual control group and 2 variants of a validated fraction magnitude (FM) intervention. One variant of FM intervention included an integrated component on fraction-decimal magnitude (FM+DM); the other included a fraction applications component (FM+FAPP) to more closely mirror the validated FM intervention and to control for intervention time. Cross-classified partially-nested analyses (N=225) provided the basis for 3 conclusions. First, FM intervention improves 4th-graders' fraction understanding and applications. Second, effects of FM intervention, even without a focus on decimals, transfer to decimal number line performance. Third, an intervention component integrating fraction-decimal magnitude does not provide added value over FM intervention on fraction or decimal performance, except on decimal tasks paralleling intervention tasks. [This is the in press version of an article published in "Contemporary Educational Psychology."]
Reviews of Individual Studies 4 -1
Efficacy Study of the Science Notebook in a Universal Design for Learning Environment: Preliminary Findings (2019)
The Science Notebook in a Universal Design for Learning Environment (SNUDLE) is a digital notebook that uses the Universal Design for Learning framework to support active science learning among elementary school students, particularly those who struggle with reading and writing or are unmotivated to learn science. Preliminary findings from the first of a two-year randomized control trial suggest no significant impact on motivation or academic achievement in science among the full sample of fourth graders receiving the SNUDLE intervention. Moderator analysis indicates significant positive interaction effects of the intervention on motivation in science and science content assessments among students with learning disabilities.
Reviews of Individual Studies 5-8 -1
Is the pen mightier than the keyboard? The effect of online testing on measured student achievement (2019)
Nearly two dozen states now administer online exams to deliver testing to K-12 students. These tests have real consequences: their results feed into accountability systems, which have been used for more than a decade to hold schools and districts accountable for their students’ learning. We examine the rollout of computerbased testing in Massachusetts over 2 years to investigate test mode effects. Crucial to the study design is the state administering the same exam (PARCC) in online and offline formats each year during the transitional period. We find an online test penalty of about 0.10 standard deviations in math and 0.25 standard deviations in English language arts (ELA), which partially but not fully fades out in the second year of online testing.
Reviews of Individual Studies 6 -1
Improving Student Learning and Engagement through Gamified Instruction: Evaluation of iPersonalize (2019)
The purpose of this research study was to evaluate iPersonalize, a gamified instructional approach developed by Fullerton School District (FSD) in California to encourage student engagement and promote achievement. An instructional approach is considered gamified when it incorporates computer game elements to augment existing classroom, instructional, and assessment processes (Bedwell, Pavlas, Heyne, Lazzara, & Salas, 2012; Landers, 2015). The study employed a randomized controlled trial designed to support causal inferences about the effectiveness of iPersonalize for impacting sixth-grade student engagement and achievement in English language arts (ELA). The study included 1,295 students from 42 classrooms in 15 schools. All students were enrolled in sixth grade in FSD during the 2017/18 school year. Students in 24 of these classrooms were assigned to ELA instruction using iPersonalize. Students in the remaining 18 classrooms were assigned to business-as-usual instruction. Teachers in both groups were expected to teach the same ELA unit. Teachers in the iPersonalize group were expected to incorporate elements of gamification, while the teachers in the control group were expected to not incorporate elements of gamification. Key findings from the study were as follows: (1) On both reading and writing assessments, the difference between the treatment group and the control group was small and not statistically significant, indicating that the two groups performed similarly; (2) Students in both groups reported similar levels of engagement in school; (3) Gender did not significantly moderate the impact of iPersonalize on student achievement or student engagement; (4) The impact of the program on reading and writing assessments was close to zero, regardless of the extent to which students interacted with the online learning management system; and (5) There was some evidence to suggest that the program had a stronger impact on engagement for students who were already the most engaged in school.
Reviews of Individual Studies 4-5 -1
The Impact of Adaptive, Web-Based, Scaffolded Silent Reading Instruction on the Reading Achievement of Students in Grades 4 and 5 (2019)
This randomized controlled trial examined the impact of adaptive, web-based, scaffolded silent reading instruction on 426 fourth- and fifth-grade students in an urban US school district. Reading proficiency was evaluated in the fall and spring using the Group Reading Assessment Diagnostic Evaluation (GRADE) and an eye movement recording system (Visagraph). Fall GRADE scores and demographic factors were used to pair students. One member of each pair was then randomly assigned to the treatment or control condition and their pair to the alternate condition. During scheduled 25-minute supplemental literacy blocks, students in the control group received "business-as-usual" reading instruction, whereas the treatment group engaged in scaffolded silent reading instruction. Structural equation modeling indicated that scaffolded silent reading instruction produced significantly larger gains on measures of reading efficiency in grade 4 and significantly larger gains on the GRADE reading achievement measures in grade 5. Implications for practice and future research are discussed.
Reviews of Individual Studies 4-7 -1
Evaluation of the Teacher Potential Project (2019)
This study assesses the implementation and impacts of the Teacher Potential Project (TPP), a program designed by EL Education and which includes an English language arts (ELA) standards-aligned curriculum and embedded professional development for teachers. The study uses a randomized controlled trial (RCT) design to assess the impacts of TPP on the instructional practice outcomes of ELA teachers in grades 3 through 8 and the ELA achievement outcomes of their students. The RCT includes 70 elementary and middle schools (35 treatment and 35 control) in 18 relatively high-need districts that were randomly assigned to treatment and control conditions within matched pairs of schools in three cohorts that began participating in the 2014-2015, 2015-2016, and 2016-2017 school years. Treatment schools engaged in TPP for one year while control schools continued with business as usual. The study also uses a two-year quasi-experimental design (QED) study to assess the impact of extending implementation of TPP to a second year on teacher instructional practice and student ELA achievement outcomes. EL Education recruited 22 of the study schools (10 treatment and 12 control) in five districts in one cohort to participate in a second year of the study. The study team collected a variety of data for the evaluation of TPP, including teacher surveys and classroom observations administered in fall and spring each year and student administrative records. Impacts of TPP on ELA teacher instructional practices and student ELA achievement were estimated using multivariate regression methods. The implementation evaluation found that the TPP ELA curriculum was implemented in all schools, and that there was generally high school-level implementation fidelity of the TPP professional development components in the first and second years of TPP among the novice ELA teachers. The impact evaluation found positive impacts of TPP on ELA teachers' overall instructional practices after one year compared to teachers who used their district-provided curriculum and participated in their district's professional development supports. After two years of teacher participation, impacts on their students' ELA achievement were roughly equivalent to 1.4 months of typical student improvement, or moving an average student scoring at the 50th percentile to the 54th percentile. The findings be useful to districts and policymakers aiming to support teachers and students in the context of rigorous state standards such as the Common Core State Standards (CCSS). The study of TPP makes several important contributions to the literature evaluating paired curriculum and PD programs: it uses rigorous group designs, evaluates the impact of one and two years of program implementation, and examines broad outcomes on both teacher instructional practice and student ELA achievement. [This report was submitted by Mathematica to EL Education.]
Reviews of Individual Studies 4-8 -1
Literacy Design Collaborative 2017–2018 evaluation report for New York City Department of Education (2019)
Reviews of Individual Studies K-12 -1
A state-wide quasi-experimental effectiveness study of the scale-up of school-wide Positive Behavioral Interventions and Supports (2019)
The three-tiered Positive Behavioral Interventions and Supports (PBIS) framework promotes the development of systems and data analysis to guide the selection and implementation of evidence based practices across multiple tiers. The current study examined the effects of universal (tier 1) or school-wide PBIS (SW-PBIS) in one state's scale-up of this tier of the framework. Annual propensity score weights were generated to examine the longitudinal effects of SW-PBIS from 2006–07 through 2011–12. School-level archival and administrative data outcomes were examined using panel models with an autoregressive structure. The sample included 1316 elementary, middle, and high schools. Elementary schools trained in SW-PBIS demonstrated statistically significantly lower suspensions during the fourth and fifth study years (i.e., small effect size) and higher reading and math proficiency rates during the first two study years as well as in one and two later years (i.e., small to large effect sizes), respectively. Secondary schools implementing SW-PBIS had statistically significantly lower suspensions and truancy rates during the second study year and higher reading and math proficiency rates during the second and third study years. These findings demonstrate medium effect sizes for all outcomes except suspensions. Given the widespread use of SW-PBIS across nearly 26,000 schools in the U.S., this study has important implications for educational practices and policies.
Reviews of Individual Studies K-12 -1
Effects of National Board Certified Instructional Leaders on Classroom Practice and Student Achievement of Novice Teachers. A Study Report Developed for the National Board for Professional Teaching Standards (2019)
The study examined the effect of National Board Certified Teachers (NBCTs) in instructional leadership roles, operationalized as mentors to novice teachers, on (a) classroom practices of mentored novice teachers in Grades K-12 and (b) student achievement of mentored teachers' students in Grades 4-8. The study compared outcomes between NBCT mentors and non-NBCT mentors. The study examined the effect of NBCT mentors after one academic year and was conducted in San Francisco Unified School District. Using the Classroom Assessment Scoring System, we examined novice teachers' classroom practices on the domains of Emotional Support, Classroom Organization, Instructional Support, and across all three domains. The results did not reach statistical significance, but the effect sizes for Emotional Support, Classroom Organization, and a global measure across all domains suggest meaningful differences between classroom practices of novice teachers mentored by NBCTs and non-NBCTs. These effect sizes were 0.28, 0.28, and 0.21 standard deviations, respectively. The effect size for the domain of Instructional Support was near zero at -0.06 standard deviations. Our sample size for the analysis of classroom practices did not have sufficient power to estimate differences at a statistically significant level. We examined student achievement using the state's standardized test scores in mathematics and English language arts. Our achievement measure includes either subject: That is, we did not estimate effects separately for mathematics and English language arts. The results suggest that students taught by teachers mentored by NBCTs had a higher level of achievement than students mentored by non-NBCTs. The difference was statistically significant at a p value of 0.05, and the effect size was meaningful at 0.18 standard deviations. Small sample sizes and low statistical power prevent us from making confident conclusions about the effect of NBCTs in instructional leadership roles on classroom practices of supported teachers and student achievement. However, the evidence is encouraging and warrants additional rigorous research on the impact of NBCTs as instructional leaders.
Reviews of Individual Studies K-5 -1
A Randomized Controlled Trial of the Combination of Two School-Based Universal Preventive Interventions (2019)
The Good Behavior Game (GBG, Barrish, Saunders, & Wolf, 1969) and the PATHS Curriculum (Promoting Alternative Thinking Strategies; Greenberg, Kusche, Cook, & Quamma, 1995) represent 2 universal, elementary school, preventive interventions which have been shown in large-scale, randomized controlled trials to have an immediate and beneficial impact (GBG, Dolan et al., 1993; PATHS, Conduct Problems Prevention Research Group [CPPRG], 1999) on aggressive/disruptive and off-task behavior. Importantly, both risk behaviors are strong predictors of antisocial behavior, drug abuse, and low educational and occupational attainment in adolescence and young adulthood (Kellam et al., 2008). What has yet to be explored within a randomized controlled trial is whether the combination of these interventions would yield significantly greater impact on aggressive/disruptive and off-task behavior than the GBG alone. One reason for expecting additive if not synergistic effects as a result of combining the two interventions is that the GBG, by increasing attention to task and reducing disruptive behavior in the classroom, may facilitate the acquisition of the emotion regulation, social problem-solving, and conflict resolution skills taught in PATHS. To that end, a group randomized, effectiveness trial was carried out, wherein 27 schools were randomly assigned to one of 3 conditions, (a) the PAX GBG Alone (Embry, Staatemeier, Richardson, Lauger, & Mitich, 2003), (b) PATHS to PAX (that is, the PAX GBG + PATHS), or (c) a standard setting (control) condition. Classroom observations and teacher ratings of student behavior were carried out at pretest and 6 months later at posttest. Limited evidence of the superiority of the combined approach was found and potential reasons why and future directions are discussed.
Reviews of Individual Studies K-5 -1
A Randomized Controlled Trial of the Combination of Two School-Based Universal Preventive Interventions (2019)
The Good Behavior Game (GBG, Barrish, Saunders, & Wolf, 1969) and the PATHS Curriculum (Promoting Alternative Thinking Strategies; Greenberg, Kusche, Cook, & Quamma, 1995) represent 2 universal, elementary school, preventive interventions which have been shown in large-scale, randomized controlled trials to have an immediate and beneficial impact (GBG, Dolan et al., 1993; PATHS, Conduct Problems Prevention Research Group [CPPRG], 1999) on aggressive/disruptive and off-task behavior. Importantly, both risk behaviors are strong predictors of antisocial behavior, drug abuse, and low educational and occupational attainment in adolescence and young adulthood (Kellam et al., 2008). What has yet to be explored within a randomized controlled trial is whether the combination of these interventions would yield significantly greater impact on aggressive/disruptive and off-task behavior than the GBG alone. One reason for expecting additive if not synergistic effects as a result of combining the two interventions is that the GBG, by increasing attention to task and reducing disruptive behavior in the classroom, may facilitate the acquisition of the emotion regulation, social problem-solving, and conflict resolution skills taught in PATHS. To that end, a group randomized, effectiveness trial was carried out, wherein 27 schools were randomly assigned to one of 3 conditions, (a) the PAX GBG Alone (Embry, Staatemeier, Richardson, Lauger, & Mitich, 2003), (b) PATHS to PAX (that is, the PAX GBG + PATHS), or (c) a standard setting (control) condition. Classroom observations and teacher ratings of student behavior were carried out at pretest and 6 months later at posttest. Limited evidence of the superiority of the combined approach was found and potential reasons why and future directions are discussed.
Reviews of Individual Studies PK-1 -1
Literacy and Academic Success for English Learners Through Science LASErS Evaluation Report (2019)
Reviews of Individual Studies PK-12 -1
Parents at the Center: Final Parent Leadership Institute Evaluation Report (2019)
The Parent Leadership Institute (PLI) of Children's Aid (CA), funded via a 2013 Investing in Innovation (i3) development grant operated between the 2014-15 through 2018-19 school years. Key goals of the PLI included: (1) improving the capacity of parents to effectively engage in the school community in support of their child; and (2) increasing the capacity of school staff to create and support environments which are welcoming to and supportive of the active engagement of parents as key members of the school community. Through implementation of the PLI, CA expanded its partnership with six schools located in the South Bronx community of Morrisania, an area characterized by high levels of poverty, health disparities, and crime, and low levels of academic achievement and attainment among both children and adults. This report serves as the final report on this phase of the PLI and includes an exploration of implementation during year 4 (2016-17 school year) and analyses of quantitative data on student academic performance. [This report was prepared for Children's Aid New York.]
Reviews of Individual Studies PK-3 -1
The Effects of Enrolling in Oversubscribed Prekindergarten Programs through Third Grade (2019)
This study leverages naturally occurring lotteries for oversubscribed Boston Public Schools prekindergarten program sites between 2007 and 2011, for 3,182 children (M = 4.5 years old) to estimate the impacts of winning a first choice lottery and enrolling in Boston prekindergarten versus losing a first choice lottery and not enrolling on children's enrollment and persistence in district schools, grade retention, special education placement, and third-grade test scores. There are large effects on enrollment and persistence, but no effects on other examined outcomes for this subsample. Importantly, children who competed for oversubscribed seats were not representative of all appliers and almost all control-group children attended center-based preschool. Findings contribute to the larger evidence base and raise important considerations for future prekindergarten lottery-based studies. [This is the online version of an article published in "Child Development" (ISSN 0009-3920).]
Reviews of Individual Studies 9-12 -1
Interdependent Group Contingencies Reduce Disruption in Alternative High School Classrooms (2019)
Group contingencies have been indicated to be effective in reducing disruptive behavior and increasing academic engagement in school settings. Previous research has demonstrated their efficacy with a wide range of student ages, but there have been few studies with older students who engage in severe disruptive behavior. In the current study, we implemented an interdependent group contingency in three high school classrooms of students aged 14-19 years with histories of delinquency, emotional and behavioral disorder diagnoses, or both. Results indicated that interdependent group contingencies can be effective in reducing the disruptive classroom behavior of these students. Implications for future research and special considerations for this population are discussed.
Reviews of Individual Studies 9-12 -1
Project RISE final report (2018)
Reviews of Individual Studies 9-12 -1
Transforming Comprehensive High Schools into Early Colleges: The Impacts of the Early College Expansion Partnership (2018)
As originally conceptualized, Early Colleges were small schools focused purposefully on college readiness for all students. Frequently located on college campuses, Early Colleges targeted students who might face challenges in postsecondary education, including students who were the first in their family to go to college, economically disadvantaged students, English Language Learners (ELL), or students who are members of racial or ethnic groups underrepresented in college. The Early College Expansion Partnership (ECEP) is among the first large-scale effort to apply Early College strategies into comprehensive high schools. Supported by a $15 million grant from U.S. Department of Education's Investing in Innovation (i3) program, the ECEP was designed to increase the number of students graduating from high school prepared for enrollment and success in postsecondary education. The project sought to blend high school and college by applying strategies from the successful Early College high school model to 14 middle schools, 12 high schools, and two 6th-12th-grade schools in three districts in two states: Colorado and Texas. ECEP implemented an adapted version of the Early College High School Model. The program provided a set of services that supported implementation of a whole-school reform model emphasizing the creation of a college-preparatory school environment. A primary emphasis of the program was increasing the number of students who participated in college-credit-bearing courses while in high school. This report describes the approach used to assess student impacts and to track changes over time; uses survey and site visit data to describe key changes that have been made at the district and school levels; presents the impact estimates for the core student-level outcomes; places the findings in context and discusses the broader implications of this work; and summarizes the overall findings. [For the companion report, "Implementation Supports of the Early College Expansion Partnership," see ED618696.]
Reviews of Individual Studies K-8 -1
Can We Increase Attendance and Decrease Chronic Absenteeism with a Universal Prevention Program? A Randomized Control Study of Attendance and Truancy Universal Procedures and Interventions (2018)
The purpose of this study was to examine the effects of a school-wide attendance and truancy intervention and universal procedures (ATI-UP) on student attendance. Student attendance was measured through average daily attendance and the percentage of students who would be considered chronically absent, i.e., missing 10% or more of school. The sample included 27 elementary schools in Oregon implementing school-wide positive behavior intervention and supports (SWPBIS) with varying levels of fidelity. Results indicate that schools can have a moderate effect on increasing average daily attendance (ADA) and a small effect on decreasing chronic absenteeism, although these results were not statistically significant. SWPBIS implementation did not act as a statistically significant moderator on the ATI-UP effects, although the treatment effect on ADA decreased with higher SWPBIS implementation. [The dissertation citations contained here are published with the permission of ProQuest LLC. Further reproduction is prohibited without permission. Copies of dissertations may be obtained by Telephone (800) 1-800-521-0600. Web page: http://www.proquest.com/en-US/products/dissertations/individuals.shtml.]
Reviews of Individual Studies K-5 -1
Teacher Coaching Supported by Formative Assessment for Improving Classroom Practices (2018)
The present study is a wait-list controlled, randomized study investigating a teacher coaching approach that emphasizes formative assessment and visual performance feedback to enhance elementary school teachers' classroom practices. The coaching model targeted instructional and behavioral management practices as measured by the Classroom Strategies Assessment System (CSAS) Observer and Teacher Forms. The sample included 89 general education teachers, stratified by grade level, and randomly assigned to 1 of 2 conditions: (a) immediate coaching, or (b) waitlist control. Results indicated that, relative to the waitlist control, teachers in immediate coaching demonstrated significantly greater improvements in observations of behavior management strategy use but not for observations of instructional strategy use. Observer- and teacher-completed ratings of behavioral management strategy use at postassessment were significantly improved by both raters; ratings of instructional strategy use were significantly improved for teacher but not observer ratings. A brief coaching intervention improved teachers' use of observed behavior management strategies and self-reported use of behavior management and instructional strategies.
Reviews of Individual Studies K-2 -1
Investing in Innovation (i3) validation study of Families and Schools Together (FAST) final report (2018)
Reviews of Individual Studies 4-8 -1
Literacy Design Collaborative 2016-2017 Evaluation Report for the New York City Department of Education. CRESST Report 856 (2018)
The Literacy Design Collaborative (LDC) was created to support teachers in implementing college and career readiness standards in order to teach literacy skills throughout the content areas. Teachers work collaboratively with coaches to further develop their expertise and design standards-driven, literacy-rich writing assignments within their existing curriculum across all content areas. The 2016-2017 school year was the first year of implementation, following a pilot year during which the implementation plan, instruments, data collection processes, and analytical methodologies were refined. Participants across all groups reported positive attitudes toward LDC and perceive a positive impact on student outcomes. Analysis of module artifacts suggest that teachers at the elementary school level were moderately successful in the backwards design process, particularly in developing high-quality writing tasks for students. As an ongoing multiyear intervention, the LDC implementation will continue to evolve year to year as participants provide feedback and LDC program managers make refinements. Thus, we anticipate that further significant changes to the course material and the delivery system that are already in progress for Year 2 will likely result in continued and possibly increased positive feedback. [Funding for this work was provided by the Literacy Design Collaborative.]
Reviews of Individual Studies 5 -1
Classroom Management in an Urban, Alternative School: A Comparison of Mindfulness and Behavioral Approaches (2018)
Managing classroom behavior is an important prerequisite to effective teaching and a salient need in alternative schools. Unfortunately, students from these schools are often underrepresented in the intervention literature. The primary aim of this study was to compare the effectiveness of two different theoretical approaches to classroom management, one behavioral (i.e., the good behavior game) and the other mindfulness-based (i.e., mindfulness skills training), with a sample of fifth-grade, predominantly African American students from an urban, high-poverty alternative school. The study examined the effectiveness of the two interventions in comparison to each other and a treatment-as-usual control using a quasi-experimental group design with blocked random assignment. Results revealed that neither intervention led to significant improvements in student internalizing behavior, externalizing behavior, or wellbeing. Though, some practically meaningful treatment effects were found through examination of effect sizes. Mindfulness skills training was the only condition to yield meaningful pre-post change in student outcomes, including a moderate therapeutic effect for externalizing behavior and an iatrogenic effect with respect to student wellbeing. These findings provide preliminary evidence that mindfulness skills training might have differential effects on student mental health outcomes, compared with education as usual and a traditional classwide behavioral intervention. Additionally, study findings make clear the importance of careful deliberation when transporting evidence-based interventions to unique student populations and intervention contexts.
Reviews of Individual Studies 5 -1
Classroom Management in an Urban, Alternative School: A Comparison of Mindfulness and Behavioral Approaches. (2018)
Managing classroom behavior is an important prerequisite to effective teaching and a salient need in alternative schools. Unfortunately, students from these schools are often underrepresented in the intervention literature. The primary aim of this study was to compare the effectiveness of two different theoretical approaches to classroom management, one behavioral (i.e., the good behavior game) and the other mindfulness-based (i.e., mindfulness skills training), with a sample of fifth-grade, predominantly African American students from an urban, high-poverty alternative school. The study examined the effectiveness of the two interventions in comparison to each other and a treatment-as-usual control using a quasi-experimental group design with blocked random assignment. Results revealed that neither intervention led to significant improvements in student internalizing behavior, externalizing behavior, or wellbeing. Though, some practically meaningful treatment effects were found through examination of effect sizes. Mindfulness skills training was the only condition to yield meaningful pre-post change in student outcomes, including a moderate therapeutic effect for externalizing behavior and an iatrogenic effect with respect to student wellbeing. These findings provide preliminary evidence that mindfulness skills training might have differential effects on student mental health outcomes, compared with education as usual and a traditional classwide behavioral intervention. Additionally, study findings make clear the importance of careful deliberation when transporting evidence-based interventions to unique student populations and intervention contexts.
Reviews of Individual Studies 4-6 -1
Evaluation of Leading with Learning i3 development initiative: Final report. (2018)
Reviews of Individual Studies 4-7 -1
Reducing academic inequalities for English language learners: variation in experimental effects of word generation in high-poverty schools (2018)
Reviews of Individual Studies 5-6 -1
Study of ATLAS Use by Preservice and Early Career Teachers (2018)
In 2013, the National Board for Professional Teaching Standards received a 5-year Investing in Innovation Fund Development grant from the U.S. Department of Education to develop, implement, and study Accomplished Teaching, Learning, and Schools (ATLAS). ATLAS is an online case library that contains examples of "accomplished teaching" practice delivered by National Board Certified Teachers. A purpose of the grant activities was to expose preservice and early career teachers to ATLAS content, which was hypothesized to affect their teaching practice and the achievements of their students. This final report summarizes research on the first 2 years of the program's implementation at scale (during the grant's fourth and fifth years), and the effects of ATLAS use on the outcomes of preservice and early career teachers and on the mathematics and science achievements of students in Grades 3-6. The study team determined that ATLAS was implemented with fidelity at the institution of higher education and local education agency levels during the second study year but not the first study year. Regarding the effects of ATLAS use on the outcomes of preservice teachers, early career teachers, and students, the study did not identify any observable differences between ATLAS users and non-ATLAS users or their students. [This report was funded by the National Board for Professional Teaching Standards (NBPTS) through a U.S. Department of Education Investing in Innovation Fund grant to NBPTS.]
Reviews of Individual Studies 4 -1
Examining the Efficacy of Targeted Component Interventions on Language and Literacy for Third and Fourth Graders Who Are at Risk of Comprehension Difficulties (2018)
Testing a component model of reading comprehension in a randomized controlled trial, we evaluated the efficacy of 4 interventions that were designed to target components of language and metacognition that predict children's reading comprehension: vocabulary, listening comprehension, comprehension of literate language, academic knowledge, and comprehension monitoring. Third- and 4th-graders with language skills falling below age expectations participated (N = 645). Overall, the component interventions were only somewhat effective in improving the targeted skills, compared to a business-as-usual control (g ranged from -0.14 to 0.33), and no main effects were significant after correcting for multiple comparisons. Effects did not generalize to other language skills or to students' reading comprehension. Moreover, there were Child Characteristic × Treatment interaction effects. For example, the intervention designed to build sensorimotor mental representations was more effective for children with weaker vocabulary skills. Implications for component models of reading and interventions for children at risk of reading comprehension difficulties are discussed.
Reviews of Individual Studies 4 -1
Examining the Efficacy of Targeted Component Interventions on Language and Literacy for Third and Fourth Graders Who Are at Risk of Comprehension Difficulties (2018)
Testing a component model of reading comprehension in a randomized controlled trial, we evaluated the efficacy of 4 interventions that were designed to target components of language and metacognition that predict children's reading comprehension: vocabulary, listening comprehension, comprehension of literate language, academic knowledge, and comprehension monitoring. Third- and 4th-graders with language skills falling below age expectations participated (N = 645). Overall, the component interventions were only somewhat effective in improving the targeted skills, compared to a business-as-usual control (g ranged from -0.14 to 0.33), and no main effects were significant after correcting for multiple comparisons. Effects did not generalize to other language skills or to students' reading comprehension. Moreover, there were Child Characteristic × Treatment interaction effects. For example, the intervention designed to build sensorimotor mental representations was more effective for children with weaker vocabulary skills. Implications for component models of reading and interventions for children at risk of reading comprehension difficulties are discussed.
Reviews of Individual Studies 4-5 -1
Assessing the impact of the Math for All professional development program on elementary school teachers and their students (2018)
Reviews of Individual Studies 4 -1
Academic Achievement of Students in Dual Language Immersion (2018)
This article reports on a study that investigated achievement in math of third and fourth grade dual language immersion (DLI) students, building on research that has demonstrated the academic achievement of students who receive content instruction predominantly in the target language. Our study expands the scope and methodology of prior research by including one-way programs in three languages (Chinese, French and Spanish) and two-way Spanish-English programs; and by relying on propensity matching to mitigate possible effects of school and student differences. In our third grade study, we compared students' math scores in relation to their English Language Arts (ELA) achievement to control for pre-existing differences between DLI and non-DLI students. DLI students who attained the same levels in ELA, and who received math instruction in a target language, performed at the same level as their non-DLI peers in third grade math tests given in English. For the fourth grade study, we compared DLI students to a propensity-matched non-DLI group. DLI students grew more in math than their counterparts not in DLI. The results from this natural experiment indicate that students in a DLI program that has been implemented state-wide were able to succeed academically in math.
Reviews of Individual Studies 3-5 -1
Early Evaluation Findings from the Instructional Conversation Study: Culturally Responsive Teaching Outcomes for Diverse Learners in Elementary School (2018)
This study explores preliminary results from a pedagogical intervention designed to improve instruction for all students, particularly emergent bilinguals in the United States (or English language learners). The study is part of a larger efficacy randomized controlled trial (RCT) of the Instructional Conversation (IC) pedagogy for improving the school achievement of upper elementary grade students. Standardized achievement student data were gathered from (N = 74) randomized teachers' classrooms. Preliminary ordinary least squares analyses of the intervention appear promising for English language arts in general. Limitations in baseline equivalency for students after teacher randomization are discussed along with strategies to overcome them and implications concerned with the education of all students, notably those whose parents speak languages other than English at home.
Reviews of Individual Studies 3-5 -1
Examining the Effects of Afterschool Reading Interventions for Upper Elementary Struggling Readers (2018)
We examined the efficacy of an afterschool multicomponent reading intervention for third- through fifth-grade students with reading difficulties. A total of 419 students were identified for participation based on a 90 standard score or below on a screening measure of the Test of Silent Reading Efficiency and Comprehension. Participating students were randomly assigned to a business as usual comparison condition or one of two reading treatments. All treatment students received 30 min of computer-based instruction plus 30 min of small-group tutoring for four to five times per week. No statistically significant reading comprehension posttest group differences were identified (p > 0.05). The limitations of this study included high attrition and absenteeism. These findings extend those from a small sample of experimental studies examining afterschool reading interventions and provide initial evidence that more instruction, after school, may not yield the desired outcome of improved comprehension.
Reviews of Individual Studies 3-5 -1
Improving Student Behavior in Art Classrooms: An Exploratory Study of CW-FIT Tier 1 (2018)
Disruptive student behavior, a common concern for teachers, presents particular challenges for those who teach art. Class-Wide Function-Related Intervention Teams (CW-FIT) is a multitiered intervention for implementing effective classroom management strategies aligned with schoolwide positive behavior interventions and supports. CW-FIT has proven effective in general education classrooms, with its emphasis on social skills instruction, teacher praise, group contingency, and positive reinforcement. This first study of CW-FIT implementation in elementary art classrooms examined its effects on student on-task behavior. The researchers used a single-subject (AB) design in one classroom and reversal designs (ABAB) in two classrooms. Results indicated student on-task behavior significantly improved, and the teacher was able to implement CW-FIT with fidelity as well as increase her praise-to-reprimand ratios. Both teacher and students found the intervention to be socially valid. Study implications and limitations are discussed.
Reviews of Individual Studies 3-10 -1
Impact Evaluation of &quot;INSPIRE: Infusing Innovative STEM Practices into Rigorous Education&quot; (2018)
"INSPIRE" is an Investing in Innovation (i3) development grant funded by the Office of Innovation and Improvement, U.S. Department of Education. "INSPIRE" provides an innovative integrated K-12 STEM pipeline approach focused on STEM course content and instructional redesign. The INSPIRE model was implemented in Cabarrus County Schools (CCS), which is among the largest school systems in North Carolina, serving nearly 30,000 students in 39 schools. The impact evaluation included two studies that examined the effect of INSPIRE on mathematics and science achievement as measured by North Carolina standardized End-of-Grades assessments. The elementary study (Study 1) used a three-year, longitudinal, single-cohort quasi-experimental design (QED) to assess the impact of INSPIRE on math achievement at the end of 5th grade after two years of program exposure. The secondary study (Study 2) used an individual-level, longitudinal, randomized controlled trial (RCT) with blocking by school level and cohort to assess the effects of INSPIRE on math and science achievement at the end of 7th and 10th grades after two years of program exposure. For both studies, we compared the outcomes of INSPIRE students with similar students from schools that did not offer a STEM program. For the elementary study, propensity score matching (PSM) was used to match INSPIRE elementary students and comparison student samples at baseline (on pre-test math achievement scores, gender, minority status, and economically disadvantaged status) and baseline equivalence was established all pre-test assessment measures; this study met What Works Clearinghouse (WWC) Group Design Standards with Reservations. For the secondary study, the overall and differential attrition rates were low based on the WWC attrition standards (WWC, 2017); this study met WWC Group Design Standards without Reservations. The results of the elementary study indicated a statistically significant difference between the "INSPIRE" treatment group and the business-as-usual comparison group on the math achievement outcome. Comparison students reported a statistically significant higher increase in math achievement than "INSPIRE" students. Results of the secondary study indicated no statistically significant difference between the "INSPIRE" treatment group and the business-as-usual comparison group on the math and science achievement outcome. The duration of students' exposure to INSPIRE, fidelity of implementation, alignment between PBL instruction and NC standardized assessments, and contextual factors that might have weakened the intervention strength relative to business-as-usual conditions are discussed as possible factors that account for these findings. The report concludes with suggestions for future research and implications for education policy.
Reviews of Individual Studies 6-8 -1
The i3 validation of SunBay Digital Mathematics (2018)
Reviews of Individual Studies 6-8 -1
Middle-Grades Leadership Development (MLD) Project: A U.S. Department of Education Investing in Innovation (i3) Development Grant Final Evaluation Report (2018)
The Middle-Grades Leadership Development (MLD) Project was designed to develop principal leaders and leadership teams who create high-performing middle-grades schools. Designed by the National Forum to Accelerate Middle-Grades Reform, the four-year project was funded from 2013 to 2017 by a U.S. Department of Education Investing in Innovation (i3) development grant. The project was implemented in 12 middle-grades schools in rural and small town areas of Kentucky and Michigan. Schools received an extensive set of school improvement supports, including: creating a vision using the Forum's Schools to Watch (STW) criteria; engaging in an assessment and planning process for improvement; STW leadership coach; principal mentor; STW mentor schools; leadership team; networking opportunities; and focused professional development. The evaluation of the MLD Project used a quasi-experimental design (QED) with matched comparison schools (12 treatment schools and 38 comparison schools) to examine the impact of the project on intermediate outcomes such as culture, collaboration, work climate, and teaching efficacy, as well as the long term outcomes of principal effectiveness and student achievement. Results showed that MLD treatment schools significantly improved their collaboration practices, teaching efficacy, middle-grades instructional practices, and their implementation of the STW criteria for high performance. There was significant improvement in the long-term outcome of principal effectiveness among treatment principals, with nine of the twelve principals improving their leadership skills and behaviors to the proficient or distinguished levels by the end of the grant. Although there was no overall intervention effect on ELA/reading or math student achievement, seven treatment schools displayed larger growth than the state average for some groups of students. The results provide unique insight into a middle-grades program focused on principal leaders and collaborative leadership. A roadmap that depicts the key supports, activities, and practices implemented at MLD schools that were the most impactful on building middle-grades leadership effectiveness were articulated. These include school-level practices (i.e., guiding vision, continuous improvement practices, reflective practices), principal-level practices (i.e., knowledge of young adolescents, commitment to developmentally appropriate practices, instructional leadership), collaborative leadership practices (i.e., developing teacher leaders, shared capacity), and teaching practices (i.e., student centered, high expectations, rigorous instruction) that combined, result in middle-grades leadership that is more effective. [The report was prepared by the Center for Prevention Research and Development.]
Reviews of Individual Studies 6-8 -1
Closing inspiration and achievement gaps in STEM with volunteer-led apprenticeships (2018)
Reviews of Individual Studies 6-12 -1
Evaluation of Education Connections: Supporting teachers with standards-based instruction for English learners in mainstream classrooms. Final report. (2018)
Reviews of Individual Studies 9-10 -1
Efficacy of a High School Extensive Reading Intervention for English Learners with Reading Difficulties (2018)
This study examined the effects of Reading Intervention for Adolescents, a 2-year extensive reading intervention targeting current and former English learners identified as struggling readers based on their performance on the state accountability assessment. Students who enrolled at three participating urban high schools were randomly assigned to the Reading Intervention for Adolescents treatment condition (n = 175) or a business-as-usual comparison condition. Students assigned to the treatment condition participated in the intervention for approximately 50 minutes daily for 2 school years in lieu of a school-provided elective course, which business-as-usual students took consistent with typical scheduling. Findings revealed significant effects for the treatment condition on sentence-level fluency and comprehension (g = 0.18) and on a proximal measure of vocabulary learning (g = 0.41), but not on standardized measures of word reading, vocabulary, or reading comprehension (g range: -0.09 to 0.06). Posthoc moderation analyses investigated whether initial proficiency levels interacted with treatment effects. On sentence-level fluency and comprehension and on vocabulary learning, initial scores were significantly associated with treatment effects--however, in opposite directions. Students who scored low at baseline on sentence reading and comprehension scored relatively higher at posttest on that measure, whereas students who scored high at baseline on the proximal vocabulary measure scored relatively higher at posttest on that measure. The discussion focuses on the difficulty of remediating persistent reading difficulties in high school, particularly among English learners, who are often still in the process of acquiring academic proficiency in English. [This paper was published in the "Journal of Educational Psychology," 2018.]
Reviews of Individual Studies 8-Not reported -1
2013 Collaborative Regional Education (CORE) i3 Study: Implementation and Impact Study Results. Final Report (2018)
The purpose of this report is to provide an overview of evaluation findings at the culmination of the Collaborative Regional Education (CORE) i3 2013 grant, including implementation and impact results from the local and national study phases. The goal of CORE is to have a positive impact on students' college and work readiness outcomes by improving teachers' use of classroom technology and project-based learning (PBL). This report provides details on data collection procedures and results obtained during school year (SY) 2017-18, which represents the second year of the national-phase study and final year of the evaluation. Impact and implementation study findings from all grant years are presented separately in the report.
Reviews of Individual Studies 8-10 -1
An evaluation of the Positive Action program for youth violence prevention: From schools to summer camps. (2018)
Reviews of Individual Studies 1 -1
A Cluster Randomized Trial of the Social Skills Improvement System-Classwide Intervention Program (SSIS-CIP) in First Grade (2018)
The purpose of this study was to evaluate the efficacy of a universal social skills program, the Social Skills Improvement System Classwide Intervention Program (SSIS-CIP; Elliott & Gresham, 2007), for students in first grade. Classrooms from 6 elementary schools were randomly assigned to treatment or business-as-usual control conditions. Teachers assigned to the treatment condition implemented the SSIS-CIP over a 12-week period. Students' social skills, problem behaviors, and approaches to learning were assessed via teacher ratings and direct observations of classroom behavior. In addition, their early literacy and numeracy skills were measured via computer-adaptive standardized tests. SSIS-CIP participation yielded small positive effects in students' social skills (particularly empathy and social engagement) and approaches to learning (academic motivation and engagement). Students' problem behaviors and academic skills, however, were unaffected by SSIS-CIP exposure.
Reviews of Individual Studies 2-5 -1
Promoting afterschool quality and positive youth development: Cluster randomized trial of the PAX Good Behavior Game. (2018)
Reviews of Individual Studies 2-3 -1
Good Behaviour Game: Evaluation Report and Executive Summary (2018)
The Good Behaviour Game (GBG) is a universal behaviour management intervention that aims to to improve pupil behaviour with the following core elements: classroom rules, team membership, monitoring of behaviour, and positive reinforcement (rewards). While it is primarily used with children in primary schools, it can also be implemented in early years and secondary education settings. Over the course of implementation, it is intended that there is a natural progression in terms of the types of rewards given (from tangible rewards such as stickers to more abstract rewards such as free time), how long the game is played for (from 10 minutes to a whole lesson), at what frequency (from three times a week to every day), and when rewards are given (at the end of the game, the end of the day, and the end of the week). A randomised controlled trial design was used in which 77 schools were randomly allocated to implement the GBG for two years (38 schools) or continue their normal practices (39 schools). The target cohort was pupils in Year 3 (aged 7-8) in the first year of implementation (N=3084). The project was designed as an efficacy trial. Alongside the assessment of outcomes, the evaluators undertook a comprehensive mixed-methods implementation and process evaluation involving observations, interviews and focus groups. Findings showed: (1) no evidence that the GBG improves pupils' reading; (2) no evidence that the GBG improves pupils' behaviour (specifically, concentration problems, disruptive behaviour, and pro-social behaviour); (3) implementation was variable and in particular, the frequency and duration with which the GBG was played did not reach the levels expected by the developer; (4) higher levels of pupil engagement with the game were associated with improved reading, concentration, and disruptive behaviour scores at follow-up; and (5) tentative evidence that boys identified as at-risk of developing conduct problems at the beginning of the project benefitted from the GBG.
Reviews of Individual Studies 11-12 -1
2016-2017 Implementation Evaluation of the National Math and Science Initiative&apos;s College Readiness Program (2018)
The National Math + Science Initiative's (NMSI's) College Readiness Program (CRP) is an established program whose goal is to promote science, technology, engineering, and mathematics education in high schools to improve students' readiness for college. The program provides teacher, student, and school supports to promote high school students' success in mathematics, science, and English Advanced Placement (AP) courses, with a focus on students who are traditionally underrepresented in the targeted AP courses. Through a scale-up grant awarded to NMSI by the Investing in Innovation (i3) program, the CRP was implemented in 28 schools in the 2016-2017 school year. CRESST conducted an independent evaluation of the impact of the CRP on students' AP outcomes using a randomized cluster trial with 28 CRP schools and 24 control schools in 10 states. The evaluation of the CRP consisted of two parts: (1) assessment of the program's impact on selected student AP exam outcomes and (2) assessment of the fidelity of implementation of the CRP. Program impact was evaluated using a 2-level hierarchical generalized linear model (HGLM) with students nested within schools The descriptive statistics showed that a higher percetange of students in the treatment schools took at least one AP course (30.7%) compared to those in the control schools (26.4%) by approximately 4.3%, however the difference was not statistically significant. In addition, students in the treatment schools were not more likely to achieve a score of 3 or higher, when compared to the delayed treatment schools. We further examined the effectiveness of the CRP using the prior year's school-level performance on the AP exam as a covariate. As with the above findings, the results indicated the probability of a student taking at least one AP course or scoring 3 or higher on at least one AP exam is not statistically different between students in the treatment schools and those in the control treatment schools. Fidelity of implementation was evaluated using a fidelity matrix approach (required as part of the evaluation of the i3 program), which showed that not all elements of the program were implemented with high fidelity. Overall results, however, indicated that 23 schools out of 28 treatment schools (82.1%) achieved 80% or better implementation fidelity, for an average fidelity score of 89.5%. Seven schools achieved a perfect 100% fidelity score. Looking at the different indicator groups (school, teacher and student), we found that all school support measures across all schools were implemented with fidelity. In over 80% of schools, not all teachers fulfilled their requirements for attending all training sessions, and so this component was not implemented with fidelity. Stipends and teacher awards were paid as expected as were student award payments. Teacher survey data indicated that teachers found the training and professional development activities provided by the CRP to be the most beneficial program supports relating to helping increase student achievement in AP courses. Teacher incentives were chosen as the least important program component relating to increasing student performance by 16% of teachers and student incentives by 12% of teachers. Teachers did, however, view the student incentives as an important program component to encourage enrollment in AP courses. Likewise, students rated the financial incentives on average as somewhat important in encouraging them to participate in AP courses.
Reviews of Individual Studies 10-12 -1
Impact Evaluation of &quot;12 for Life&quot;: Better Lives through Education and Employment (2018)
"12 for Life" is an Investing in Innovation (i3) development grant funded by the Office of Innovation and Improvement, U.S. Department of Education. "12 for Life" provides a rigorous STEM curriculum, combined with on-the-job-training, work/life skills development, mentoring, and employment opportunities to high school students who are at high risk of dropping out of school. The impact evaluation used a quasi-experimental design (QED) to examine the effect of "12 for Life" on grade point average (GPA), number of suspensions, and incidence of dropping out of school. "12 for Life" students who enrolled in the program during the 2014-15 school year were followed for three years. Outcomes for "12 for Life" students were compared to a matched sample of students with similar risk factors for dropping out of school who started 10th grade in fall 2014 and who participate in business-as-usual, traditional academic instruction in the high school environment. Comparison students were followed for three years. Results showed no statistically significant impact on grade point average (GPA) at the end of 12th grade, number of suspensions, or incidence of dropping out of school.
Reviews of Individual Studies 11-PS -1
When "low touch" is not enough: Evidence from a random assignment college access field experiment. (2018)
Reviews of Individual Studies 12-PS -1
Closing the Gap: The Effect of a Targeted, Tuition-Free Promise on College Choices of High-Achieving, Low-Income Students. NBER Working Paper No. 25349 (2018)
Low-income students, even those with strong academic credentials, are unlikely to attend a highly selective college. With a field experiment, we test an intervention to increase enrollment of low-income students at the highly selective University of Michigan. We contact students (as well as their parents and principals) with an encouragement to apply and a promise of four years of free tuition and fees upon admission. Materials emphasize that this offer is not contingent on completing aid applications (e.g., the FAFSA or PROFILE). Treated students were more than twice as likely to apply to (67 percent vs. 26 percent) and enroll at (27 percent vs. 12 percent) the University of Michigan. There was no diversion from schools as (or more) selective as UM. The enrollment effect of 15 percentage points (pp) comprises students who would otherwise attend a less selective, four-year college (7 pp), a community college (4 pp), or no college (4 pp). Effects persist through two years of follow-up. The intervention closed by half the income gaps in college choice among Michigan's high-achieving students. We conclude that an encouragement to apply, paired with a promise of aid, when communicated to students and influential adults, can substantially close income gaps in college choices.
Reviews of Individual Studies 12-PS -1
Think College Transition: Developing an Evidenced-Based Model of Inclusive Dual Enrollment Transition Services for Students with Intellectual Disabilities and Autism. Evaluation Final Report (2018)
This report is an evaluation of the i3 development grant Think College Transition (TCT), an inclusive dual enrollment transition model to improve achievement and post-school outcomes for students with intellectual disabilities or autism (ID/A). The model offers an innovative approach to transition services for students with intellectual disabilities and autism by providing participation in inclusive academic and social environments of a college campus with same-aged peers rather than continuing to receive transition services in typical high school environments. This evaluation examined the impact of TCT services on the job-seeking skills, career readiness, self-determination, college self-efficacy, and employment of ID/A youth. A quasi-experimental design was used to compare baseline and end-of-the year data on outcome variables from students with ID/A participating in the TCT model at three institutes of higher education in Massachusetts with students with ID/A participating in business-as-usual transition services through their school districts. The fidelity with which the TCT model was implemented at the intervention sites was also evaluated. Results from the evaluation found that, after controlling for student baseline scores, the TCT model had a significant effect on students' scores of self-determination after one year of participation. This is one of the first quantitative studies to examine college-based transition programs using a rigorous research design. Future research will need to be conducted to learn what TCT model components specifically affect self-determination and what other long-term effects participation in the TCT model might have. [Additional financial support for this research was provided by the Peter and Elizabeth C. Tower Foundation.]
Reviews of Individual Studies 1-3 -1
An Evaluation of the Lightning Squad Computer-Assisted Small Group Tutoring Program on the Reading Achievement of Disadvantaged Students in Grades 1-3. Technical Report (2017)
During the fall of the 2016-17 school year, first, second, and third grade students in six elementary schools -- two in St. Paul and Eagan, Minnesota, and four in Bedford County in the Piedmont region of Virginia -- were assigned to take part in randomized efficacy trials carried out for the purpose of rigorously evaluating the impact of "Tutoring with the Lightning Squad" on reading outcomes. The study was designed to follow procedures that could qualify for "meets standards without reservation" in the What Works Clearinghouse (Standards 3.0). "Tutoring with the Lightning Squad" showed a significant and substantial impact on Woodcock measures of Passage Comprehension and Word Attack for students who received at least 25 sessions of tutoring. No significant differences were seen for Letter-Word Identification -- a result which can be attributed, at least in part, to the fact that this skill is specifically addressed only in the earliest levels of the program. Results did not vary for students by grade, gender, or ethnicity. In summary, this efficacy study suggests that "Tutoring with the Lightning Squad" has the potential to provide schools with a cost-effective tool for increasing reading levels, as the impacts of our program among students in small groups supervised by a paraprofessional tutor compare favorably with the much more expensive one-to-one tutoring models considered the most effective intervention for struggling readers.
Reviews of Individual Studies 1-3 -1
Evaluations of Technology-Assisted Small-Group Tutoring for Struggling Readers (2017)
This article reports on 2 experiments in inner-city Baltimore evaluating a computer-assisted tutoring approach, Tutoring With Alphie (TWA), in which 1 paraprofessional can work with up to 6 children at a time. In Study 1, we randomly assigned 14 schools to receive TWA or to continue with whatever approaches they were currently using. Each experimental school (n = 8) received a half-time paraprofessional tutor. Struggling readers in the lowest 30% of Grades 1-3 received tutoring using TWA. In comparison to control schools (n = 6), reading outcomes strongly favored TWA (effect size = +0.46, p < 0.01). In Study 2, new students in 7 of the 8 TWA schools received tutoring, and 6 schools continued as controls. Results again favored the TWA group (effect size = +0.40, p < 0.001). The findings support the effectiveness and cost-effectiveness of using technology to offer tutoring to many more students than could have received it individually.
Reviews of Individual Studies 1-3 -1
Evaluations of Technology-Assisted Small-Group Tutoring for Struggling Readers (2017)
This article reports on 2 experiments in inner-city Baltimore evaluating a computer-assisted tutoring approach, Tutoring With Alphie (TWA), in which 1 paraprofessional can work with up to 6 children at a time. In Study 1, we randomly assigned 14 schools to receive TWA or to continue with whatever approaches they were currently using. Each experimental school (n = 8) received a half-time paraprofessional tutor. Struggling readers in the lowest 30% of Grades 1-3 received tutoring using TWA. In comparison to control schools (n = 6), reading outcomes strongly favored TWA (effect size = +0.46, p < 0.01). In Study 2, new students in 7 of the 8 TWA schools received tutoring, and 6 schools continued as controls. Results again favored the TWA group (effect size = +0.40, p < 0.001). The findings support the effectiveness and cost-effectiveness of using technology to offer tutoring to many more students than could have received it individually.
Reviews of Individual Studies 1-7 -1
The effect of mentoring on school attendance and academic outcomes: A randomized evaluation of the Check & Connect program (Working Paper WP-16-18) (2017)
Reviews of Individual Studies 1-5 -1
Impacts of the Retired Mentors for New Teachers program (REL 2017-225) (2017)
Reviews of Individual Studies 2-4 -1
Managing student behavior in dual immersion classrooms: A study of Class-Wide Function-Related Intervention Teams. (2017)
Reviews of Individual Studies 2-4 -1
The Effects of Dialect Awareness Instruction on Non-Mainstream American English Speakers (2017)
Reviews of Individual Studies 1 -1
Exploring the Cross-­Linguistic Transfer of Reading Skills in Spanish to English in the Context of a Computer Adaptive Reading Intervention (2017)
We explore the potential of a computer-adaptive decoding game in Spanish to increase the decoding skills and oral reading fluency in Spanish and English of bilingual students. Participants were 78 first-grade Spanish-speaking students attending bilingual programs in five classrooms in Texas. Classrooms were randomly assigned to the treatment (i.e., where students played Graphogame Spanish) for 16 weeks for ten minutes per day (n = 3) versus business as usual instruction (n = 2). Results indicate that students at some risk on Spanish pseudoword reading appeared to benefit the most from playing the game. Analysis of gains suggests a potentially small, but meaningful educational effect of the game on Spanish oral reading fluency and English pseudoword reading when taking Spanish decoding skills at pretest into account. Students indicated that they enjoyed playing the game, and that the game helped them improve their reading skills. Teachers perceived the game as an engaging tool for students to use during small-group instruction or during independent time in a Response-to-Intervention approach. We discuss our mixed results in the context of using computer-adaptive games to improve the academic outcomes of bilingual students. [This is the online version of an article published in "Bilingual Research Journal." For the final version of this article, see EJ1143411.]
Reviews of Individual Studies 9-10 -1
Getting Students on Track for Graduation: Impacts of the Early Warning Intervention and Monitoring System after One Year. REL 2017-272 (2017)
Although high school graduation rates are rising--the national rate was 82 percent during the 2013/14 school year (U.S. Department of Education, 2015)--dropping out remains a persistent problem in the Midwest and nationally. Many schools now use early warning systems to identify students who are at risk of not graduating, with the goal of intervening early to help students get back on track for on-time graduation. Although research has guided decisions about the types of data and indicators used to flag students as being at risk, little is known about the impact of early warning systems on students and schools--and in particular, whether these systems do help get students back on track. This study, designed in collaboration with the REL Midwest Dropout Prevention Research Alliance, examined the impact and implementation of one early warning system--the Early Warning Intervention and Monitoring System (EWIMS)--on student and school outcomes. To assess the impact of EWIMS on student and school outcomes, 73 high schools in three Midwest Region states were randomly assigned to implement EWIMS during the 2014/15 school year (37 EWIMS schools) or to continue their usual practices for identifying and supporting students at risk of not graduating on time and to delay implementation of EWIMS until the following school year (36 control schools). The study included 37,671 students in their first or second year of high school, with 18,634 students in EWIMS schools and 19,037 students in control schools. EWIMS and control schools and students were similar on all background characteristics prior to random assignment. The study examined the impacts of EWIMS on indicators of student risk and on student progress in school after the first year of EWIMS adoption. The study found that EWIMS reduced the percentage of students with risk indicators related to chronic absence and course failure but not related to low GPAs or suspension: (1) The percentage of students who were chronically absent (missed 10 percent or more of instructional time) was lower in EWIMS schools (10 percent) than in control schools (14 percent); this 4 percentage point difference was statistically significant; and (2) The percentage of students who failed one or more courses was lower in EWIMS schools (21 percent) than in control schools (26 percent); this 5 percentage point difference was statistically significant; (3) The percentage of students who had a low GPA (2.0 or lower) was 17 percent in EWIMS schools and 19 percent in control schools; this difference was not statistically significant. However, sensitivity analyses that used continuous GPA data instead of the binary risk indicator showed that, on average, GPAs were higher in EWIMS schools (2.98) than in control schools (2.87); this difference was statistically significant; and (4) The percentage of students who were suspended once or more was 9 percent in both EWIMS and control schools; there was no statistically significant difference. EWIMS did not have an impact on student progress in school. That is, there was not a statistically significant difference between EWIMS and control schools in the percentage of students who earned insufficient credits to be on track to graduate within four years (14 percent in both). At the school level, EWIMS did not have a detectable impact on school data culture, that is, the ways in which schools use data to make decisions and identify students in need of additional support. In nearly all participating schools, overall implementation of the EWIMS seven-step process was low, and implementation was challenging. Nevertheless, EWIMS schools were more likely than control schools to report using an early warning system and having a dedicated team to identify and support at-risk students, but EWIMS schools did not differ from control schools in the frequency of data review or the number and type of interventions offered. This report provides rigorous initial evidence that even with limited implementation during the first year of adoption, using a comprehensive early warning system can reduce the percentage of students who are chronically absent or who fail one or more courses. These short-term results are promising because chronic absence and course failure in grades 9 and 10 are two key indicators that students are off track for on-time graduation. However, because the past research linking indicators to on-time graduation is correlational, it is not yet known if improving these indicators leads to improving on-time graduation rates. Also, EWIMS did not have a detectable impact on other measured indicators that are related to students' likelihood of on-time graduation, including low GPAs, suspensions, and earning insufficient credits. Future research is needed to better understand the mechanisms through which EWIMS had an impact on chronic absence and course failure and why EWIMS did not affect other outcomes. In particular, studies could focus on identifying which staff actions and student experiences lead to improved student outcomes. Studies should also examine whether schools achieve improved overall implementation in subsequent years and whether (and how) the observed impacts fade, grow larger, or extend to other risk indicators (low GPAs and suspensions); to intermediate outcomes (including student persistence and progress in school); and to long-term outcomes (including dropout and on-time graduation rates). The following are appended: (1) Planned implementation of the Early Warning Intervention and Monitoring System; (2) Recruitment, random assignment, and study sample; (3) Data collection and analytic methods; (4) Detailed findings and supplementary analyses; and (5) Disclosure of potential conflicts of interest.
Reviews of Individual Studies 9-11 -1
Variables and constants: a2i accessing algebra through inquiry (Final report) (2017)
Reviews of Individual Studies 9-10 -1
The Struggle to Pass Algebra: Online vs. Face-to-Face Credit Recovery for At-Risk Urban Students (2017)
Students who fail algebra are significantly less likely to graduate on time, and algebra failure rates are consistently high in urban districts. Identifying effective credit recovery strategies is critical for getting students back on track. Online courses are now widely used for credit recovery, yet there is no rigorous evidence about the relative efficacy of online versus face-to-face credit recovery courses. To address this gap, this study randomly assigned 1,224 ninth graders who failed algebra in 17 Chicago public high schools to take an online or face-to-face algebra credit recovery course. Compared to students in face-to-face credit recovery, students in online credit recovery reported that the course was more difficult, were less likely to recover credit, and scored lower on an algebra posttest. There were no statistically significant differences by condition on any outcomes measured during the second year of high school (standardized mathematics test and algebra subtest scores, likelihood of passing subsequent math classes, cumulative math credits, or on-track rates). The benefits and challenges of online learning for credit recovery are discussed in light of the findings to date.
Reviews of Individual Studies 6-8 -1
Evaluating the Impact of a Multistrategy Inference Intervention for Middle-Grade Struggling Readers (2017)
Purpose: We examined the effectiveness of a multistrategy inference intervention designed to increase inference making and reading comprehension for middle-grade struggling readers. Method: A total of 66 middle-grade struggling readers were randomized to treatment (n = 33) and comparison (n = 33) conditions. Students in the treatment group received explicit instruction in 4 inference strategies (i.e., clarification using text clues; activating and using prior knowledge; understanding character perspectives and author's purpose; answering inferential questions). In addition, narrative and informational texts were carefully chosen and sequenced to build requisite background knowledge to form inferences. Intervention was delivered in small groups of 3 students for 10 days of instruction. Results: One-way analysis of covariance models on outcome measures with the respective pretest scores as a covariate revealed significant gains on a proximal measure of Egyptian-content knowledge (g = 1.37) and on a standardized measure of reading comprehension--i.e., Wechsler Individual Achievement Test--Third Edition Reading Comprehension (g = 0.46). Conclusion: The moderate effect on a standardized measure of reading comprehension provides preliminary evidence for the effectiveness of this multistrategy inference intervention in improving reading comprehension of middle-grade struggling readers.
Reviews of Individual Studies 6-8 -1
Group Work is Not Cooperative Learning: An Evaluation of PowerTeaching in Middle Schools. A Report from the Investing in Innovation (i3) Evaluation (2017)
To succeed in today's economy, students need both proficiency in the "three Rs" (reading, writing and arithmetic) and strong applied skills. Communication skills, team work, and critical thinking have long been at the top of employers' lists of applied skills they seek in employees. States are responding to employers' needs by putting in place new educational standards. These standards include not only higher levels of basic academic knowledge that students are expected to master but also applied skills pertaining to presenting information, explaining one's reasoning, and effectively collaborating in groups. As a result, teachers nationwide are having students work in groups more frequently. This report examines a recent large-scale effort to expand a cooperative learning program in middle schools. The change in standard instructional practices gives schools a chance to not only teach students applied skills, but improve students' academic learning, if they can help teachers turn "group work" into "cooperative learning teams." PowerTeaching, a structured cooperative learning program, was designed to do just that. Thus, the expansion of PowerTeaching through a federal Investing in Innovation grant offers the education field a unique opportunity to learn what it takes to help teachers create cooperative learning environments in their classrooms. This report presents the lessons learned from this scale-up effort and findings from a multiyear evaluation of it. It describes how PowerTeaching was implemented over the first few years, how classrooms with the program differed from those without it, and whether students in the program performed better in math. The evaluation found that while teachers who taught with PowerTeaching learned to place their students into longstanding mixed-ability groups, which are thought to be conducive to cooperative learning, teachers did not consistently use the program's instructional techniques that transform group work into cooperative learning. In turn, students' math performance did not differ significantly between schools using the program and schools not using it. A likely cause for the weak implementation was that the ongoing professional development, which is an integral part of the PowerTeaching program, mostly did not occur or focused more on teaching the new material required by recently adopted education standards rather than on cooperative learning techniques. The evaluation thus points to the importance of focused, ongoing training and support when trying to modify teachers' instructional practices. This report was written with Deni Chen, Ashley Kennedy, and Joseph Quinn.
Reviews of Individual Studies 6-8 -1
Impact of a Technology-Mediated Reading Intervention on Adolescents&apos; Reading Comprehension (2017)
In this experimental study we examined the effects of a technology-mediated, multicomponent reading comprehension intervention, Comprehension Circuit Training (CCT), for middle school students, the majority of whom were struggling readers. The study was conducted in three schools, involving three teachers and 228 students. Using a within-teacher design, middle school teachers' reading classes were randomly assigned to treatment (n = 9) or business as usual (n = 7) conditions. In the CCT condition, students received, on average, 39 lessons of video-modeled instruction in word reading, vocabulary, and comprehension instruction during reading intervention classes. Results of multilevel structural equation models indicated statistically significant effects favoring the CCT condition on three measures: reading comprehension latent variable (ES = 0.14), proximal vocabulary (ES = 0.43), and silent reading efficiency (ES = 0.28). Subgroup analyses indicated that students with lower entry-level reading comprehension tended to benefit more from the CCT intervention in reading comprehension, silent reading efficiency, and state test scores.
Reviews of Individual Studies 6-8 -1
Targeting the Three Stages of Retrieval from Secondary Memory in a Double-Blinded, Placebo-Controlled, Randomized Working Memory Training Study (2017)
Working memory (WM) is the ability to temporarily store and retrieve a limited amount of information during complex cognitive activities, especially in the face of distraction. The dual-component model describes WM as including active maintenance in primary memory (PM) and cue-dependent search and retrieval from secondary memory (SM). Previously, researchers have found that WM training (WMT) fails to enhance SM capacity, a component that mediates the relationship between WM and fluid reasoning (gF). Thus, a double-blinded, placebo-controlled, randomized trial was conducted to elucidate whether retrieval from SM could be targeted using a two-component WMT regimen versus two control conditions: adaptive one-component WMT targeting solely PM capacity and non-adaptive one-component WMT. Participants were 174 adolescents, aged 10 to 13 years, who were assessed before, after, and six-moths following training. Retrieval from SM was measured using delayed free recall tasks, far transfer to gF was assessed with matrix reasoning and verbal inference tests, and far transfer to academic performance was assessed with reading and math tests. It was predicted that solely two-component WMT would enhance retrieval from SM and result in far transfer. ANCOVAs with pre-test scores as the covariate indicated that two-component participants increased total errors over controls. There were no significant differences between the groups on recall latency, total correct, or gF measures. The non-adaptive one-component group significantly improved on reading, although a drop in the other two groups drove the effect. Additional research is needed to elucidate whether theoretically-motivated WMT can positively impact higher-level cognition through SM retrieval mechanisms. [This paper was published in "Journal of Cognitive Enhancement" v1 p455-477 2017.]
Reviews of Individual Studies 3-5 -1
Evaluating the Efficacy of a Multidimensional Reading Comprehension Program for At-Risk Students and Reconsidering the Lowly Reputation of Tests of Near Transfer (2017)
Reviews of Individual Studies 3-5 -1
Evaluating the Efficacy of a Multidimensional Reading Comprehension Program for At-Risk Students and Reconsidering the Lowly Reputation of Tests of Near Transfer (2017)
Reviews of Individual Studies 4-5 -1
Exploring the Influence of Homogeneous versus Heterogeneous Grouping on Students&apos; Text-Based Discussions and Comprehension (2017)
Small-group, text-based discussions are a prominent and effective instructional practice, but the literature on the effects of different group composition methods (i.e., homogeneous vs. heterogeneous ability grouping) has been inconclusive with few direct comparisons of the two grouping methods. A yearlong classroom-based intervention was conducted to examine the ways in which group composition influenced students' discourse and comprehension. Fourth- and fifth-grade students (N = 62) were randomly assigned to either a homogeneous or heterogeneous ability small-group discussion. All students engaged in Quality Talk, a theoretically- and empirically-supported intervention using small-group discussion to promote high-level comprehension. Multilevel modeling revealed that, on average, students displayed positive, statistically and practically significant gains in both basic and high-level comprehension performance over the course of Quality Talk. Further, our findings indicated heterogeneous ability grouping was more beneficial than homogeneous ability grouping for high-level comprehension, on average, with low-ability students struggling more in homogeneous grouping. With respect to student discourse, additional quantitative and qualitative analyses revealed group composition differences in terms of the frequency, duration, and quality of student questions and responses, as well as the types of discourse low-ability students enacted in homogeneous groups. This study expands upon the extant literature and informs future research and practice on group composition methods. [This paper was published in "Contemporary Educational Psychology" v51 p336-355 2017.]
Reviews of Individual Studies 4-12 -1
Impact of TNTP’s Teaching Fellows in urban school districts (2017)
Reviews of Individual Studies 4 -1
Effects of a Year Long Supplemental Reading Intervention for Students with Reading Difficulties in Fourth Grade (2017)
Research examining effective reading interventions for students with reading difficulties in the upper elementary grades is limited relative to the information available for the early elementary grades. In the current study, we examined the effects of a multicomponent reading intervention for students with reading comprehension difficulties. We employed a partially nested analysis with latent variables to adequately match the design of the study and provide the necessary precision of intervention effects. We examined the effects of the intervention on students' latent word reading, latent vocabulary, and latent reading comprehension. In addition, we examined whether these effects differed for students of varying levels of reading or English language proficiency. Findings indicated the treatment significantly outperformed the comparison on reading comprehension (ES = 0.38), but no overall group differences were noted on word reading or vocabulary. Students' initial word reading scores moderated this effect. Reading comprehension effects were similar for English learner and non-English learner students. [This article was published in "Journal of Educational Psychology" (EJ1160638).]
Reviews of Individual Studies 4 -1
Effects of a Year Long Supplemental Reading Intervention for Students with Reading Difficulties in Fourth Grade (2017)
Research examining effective reading interventions for students with reading difficulties in the upper elementary grades is limited relative to the information available for the early elementary grades. In the current study, we examined the effects of a multicomponent reading intervention for students with reading comprehension difficulties. We used a partially nested analysis with latent variables to adequately match the design of the study and provide the necessary precision of intervention effects. We examined the effects of the intervention on students' latent word reading, latent vocabulary, and latent reading comprehension. In addition, we examined whether these effects differed for students of varying levels of reading or English language proficiency. Findings indicated the treatment significantly outperformed the comparison on reading comprehension (Effect Size = 0.38), but no overall group differences were noted on word reading or vocabulary. Students' initial word reading scores moderated this effect. Reading comprehension effects were similar for English learner and non-English learner students.
Reviews of Individual Studies 5 -1
The Effects of Arts-Integrated Instruction on Students&apos; Memory for Science Content: Results from a Randomized Control Trial Study (2017)
Strong correlational evidence suggests that involvement in the arts improves students' academic outcomes and memory of learning events (e.g., Peppler et al., 2014; Robinson, 2013; Scripps & Paradis, 2014). It is unclear, however, whether the improved outcomes are the result of general exposure to the arts, arts integrated into content instruction, the use of effective instructional practices, or a combination of these factors. Moreover, as a growing number of studies suggest that arts-integrated pedagogy enhances learning, few empirical studies have explicitly examined the direct effect of an arts-integrated curriculum on learning and specifically on students' memory for non-arts academic content. Thus, this study sought to determine the effects of arts-integrated lessons on long-term memory for science content. We hypothesized that embedding arts-based activities into conventionally taught lessons would produce learning outcomes as good as or better than traditional instruction. This paper describes the results of a randomized control trial that measured retention of science content using arts-integrated science units and matched units employing convention science instruction. The study was conducted in 16 fifth-grade classrooms in an urban mid-Atlantic school district.
Reviews of Individual Studies 5 -1
Effects of an Informational Text Reading Comprehension Intervention for Fifth-Grade Students (2017)
Upper elementary school students who have reading problems may have difficulty in one or more areas of reading, each requiring specific types of interventions. This study evaluated a short-term reading intervention for 46 fifth-grade students with poor reading comprehension. Students were randomly assigned to an intervention or no treatment control condition. The 40 session (20 hr) intervention targeted reading comprehension strategy instruction in the context of informational science texts. Analyses showed statistically significant effects favoring the intervention on two proximal measures (i.e., measures closely related to the intervention content). The effects for the outcomes were moderate (gs = 0.61 and 0.72). There were no statistically significant differences on distal measures (i.e., measures less closely aligned with the intervention). The findings provide support for the efficacy of a reading comprehension intervention that may inform short-term interventions within a Response to Intervention framework.
Reviews of Individual Studies 6 -1
Managing Student Behavior in an Elementary School Music Classroom: A Study of Class-Wide Function-Related Intervention Teams (2017)
Classroom management is a common concern for teachers. Music teachers in particular experience unique behavior challenges because of large class sizes, uncommon pacing requirements, and performance-based outcomes. Positive behavior support is an evidence-based framework for preventing or eliminating challenging behaviors by teaching and reinforcing appropriate social skills. Class-Wide Function-Related Intervention Teams (CW-FIT), a specific positive behavior support intervention involving social skills instruction, positive reinforcement, and group contingencies, has proven effective in elementary schools but has not been evaluated specifically in music classrooms. The present study sought to investigate the effectiveness of CW-FIT in increasing on-task behavior and teacher praise-to-reprimand ratios in a sixth-grade music classroom. A single-subject reversal (ABAB) design was used. Results indicated that student on-task behavior increased when CW-FIT was implemented. Teacher praise-to-reprimand ratios also improved. Results suggest the teacher and the students found CW-FIT valuable and enjoyable. Study limitations and implications are addressed.
Reviews of Individual Studies 4-Not reported -1
Mentoring Early Career Teachers in Urban Alaska: Impact Findings from the Investing in Innovation (i3) Evaluation of the Alaska Statewide Mentor Project Urban Growth Opportunity (2017)
In 2011, the University of Alaska Fairbanks (UAF) received an Investing in Innovation (i3) Grant through the U.S. Department of Education. UAF applied for the grant to expand the predominantly rural-serving Alaska Statewide Mentor Project (ASMP) to urban settings. ASMP is a professional development initiative that supplies fully released, highly trained mentors to early career teachers (ECTs). UAF's i3 grant, The Urban Growth Opportunity (UGO), included five districts: Anchorage, Fairbanks North Star Borough, Kenai Peninsula Borough, Matanuska-Susitna Borough, and Sitka. This is the final report for the grant conducted over four years (2011 2012 to 2014 2015). The research team randomly assigned 556 ECTs to treatment (UGO) and business as usual (BAU) groups. UGO ECTs received an ASMP mentor for two years; BAU ECTs received their districts' business as usual support that varied by district and included content coaches without mentoring support and non-ASMP instructional mentoring support. Researchers conducted impact, implementation, and intervention studies. The impact study included seven outcomes: teacher retention; teacher instructional practice as measured by the three Classroom Assessment Scoring System (CLASS®) domains (Emotional Support, Classroom Organization, and Instructional Support); and student achievement in reading, writing, and mathematics as measured by the state assessment. While UGO ECTs were retained as teachers in Alaska public schools at higher rates than BAU ECTs, the difference was not statistically significant. There were no statistically significant differences between UGO and BAU ECTs on instructional practices as measured by CLASS®. Finally, student achievement was generally higher for students of UGO ECTs, but differences in achievement were statistically significant only for some student groups: primary reading students and secondary math students who were White, Hispanic, Alaskan Native, or two or more races. Results from the implementation study, conducted over three of the four years of implementation, found ASMP implemented UGO with fidelity across all components: mentor recruitment and assignment, mentor participation in professional development, mentor interaction with their ECTs, and mentors' use of formative assessment tools. Results from the intervention study identified two types of mentor-mentee dyads: Gliders and Sliders, with gliders engaging in longer conversations, focused more explicitly on instruction and students, responding to each other more often, and engaging as peers more frequently than the slider dyads.
Reviews of Individual Studies K-5 -1
Using Multi-Component Consultation to Increase the Integrity with Which Teachers Implement Behavioral Classroom Interventions: A Pilot Study (2017)
The goal of this pilot study was to evaluate the effectiveness of a multi-component consultation package in improving teachers' classroom management skills, particularly among teachers with lower baseline levels of knowledge, skills, and intervention-supportive beliefs. Participants were 58 elementary school teachers (93% female; 50% Non-Hispanic White) who received up to eight biweekly consultation sessions focused on general classroom management strategies and implementation of a daily report card (DRC) intervention with one target student with or at-risk for ADHD. Teachers were randomly assigned to either a comparison consultation condition designed to mirror current best practices (Frank & Kratochwill, 2014; Noell & Gansle, 2014) or a multi-component condition designed to simultaneously address teacher knowledge, skills, and beliefs as possible barriers to implementation of classroom interventions. Teachers in both conditions showed significant improvements in labeled praise, appropriate response to student rule violations, and general competence in classroom management. In support of the hypotheses, teachers with lower baseline levels of knowledge, skills, and intervention-supportive beliefs demonstrated more improvement in key outcomes in response to multi-component consultation, as compared to the comparison consultation (Cohen's "d" ranged from 0.33 to 1.12). Implications for research and practice in school consultation are discussed. [This paper was published in "School Mental Health" v9 p218-234 2017.]
Reviews of Individual Studies K-5 -1
Impacts of the CARE for Teachers Program on Teachers&apos; Social and Emotional Competence and Classroom Interactions (2017)
Understanding teachers' stress is of critical importance to address the challenges in today's educational climate. Growing numbers of teachers are reporting high levels of occupational stress, and high levels of teacher turnover are having a negative impact on education quality. Cultivating Awareness and Resilience in Education (CARE for Teachers) is a mindfulness-based professional development program designed to promote teachers' social and emotional competence and improve the quality of classroom interactions. The efficacy of the program was assessed using a cluster randomized trial design involving 36 urban elementary schools and 224 teachers. The CARE for Teachers program involved 30 hr of in-person training in addition to intersession phone coaching. At both pre- and postintervention, teachers completed self-report measures and assessments of their participating students. Teachers' classrooms were observed and coded using the Classroom Assessment Scoring System (CLASS). Analyses showed that CARE for Teachers had statistically significant direct positive effects on adaptive emotion regulation, mindfulness, psychological distress, and time urgency. CARE for Teachers also had a statistically significant positive effect on the emotional support domain of the CLASS. The present findings indicate that CARE for Teachers is an effective professional development both for promoting teachers' social and emotional competence and increasing the quality of their classroom interactions.
Reviews of Individual Studies PK-6 -1
Effects of CW-FIT on Teachers' Ratings of Elementary School Students at Risk for Emotional and Behavioral Disorders (2017)
Students with deficits in social skills have been found to experience both short- and long-term problems, including interpersonal conflicts and academic difficulties. These problems are compounded for students with emotional and behavioral disorders (EBD). Class-wide function-related intervention teams (CW-FIT), a multi-tiered classroom management program, has been shown to be effective in increasing on-task behavior and decreasing disruptive behavior of students at risk for EBD. The present study examined the effects of CW-FIT on teachers' ratings of students' social skills, problem behaviors, and academic competence. A randomized control trial was completed with 160 elementary school teachers located in 19 schools across three states. Teachers completed rating scales on 350 students identified as at risk for EBD, for whom consent had been obtained. After being randomly assigned to treatment or control conditions, CW-FIT was implemented for approximately four months in treatment classrooms, after which teachers completed post-test ratings on all students. CW-FIT implementation was associated with significantly improved teacher ratings of social skills and academic competence for students at risk for EBD, but no significant changes in teacher ratings of student problem behaviors were found. Higher fidelity of CW-FIT implementation was associated with improved outcomes. Implications, limitations, and areas for future research are addressed. [This paper was published in "Journal of Positive Behavior Interventions."]
Reviews of Individual Studies K-Not reported -1
Effects of a Cross-Age Peer Learning Program on the Vocabulary and Comprehension of English Learners and Non-English Learners in Elementary School (2017)
This study evaluated the effects of a cross-age peer learning program targeting vocabulary and comprehension in kindergarten and fourth-grade classrooms with substantial proportions of English Learners (ELs). The study followed a quasi-experimental design with 12 classrooms (6 kindergarten and 6 fourth grade) in the intervention group and 12 classrooms (6 kindergarten and 6 fourth grade) in the comparison group. Students were assessed before and after the 14-week intervention via curriculum-aligned and norm-referenced vocabulary and comprehension assessments. Findings of analyses of researcher-developed measures showed positive and significant intervention effects on receptive and expressive vocabulary in kindergarten and fourth grade and comprehension (i.e., understanding of text and strategy use) in fourth grade. Findings of analyses of norm-referenced measures showed positive and significant intervention effects on receptive vocabulary in kindergarten. In general, the intervention had similar effects for ELs and non-ELs.
Reviews of Individual Studies PK-K -1
Evaluation of Around the Corner (2016)
(Purpose) The purpose of this study was to understand if inclusion of computer activities and videos for pre-K and kinder students, with opportunities to view these videos again at home, providing a repeated learning experience with language concepts and vocabulary, improved young students' early reading skill. (Methods) The study followed one cohort of students over two years. Students who were in preschool in the 2014-15 school year and who progressed into kindergarten in the 2015-16 school year were included. The outcome measures for the impact study were tests that gauge students' language development and early reading skills. These included the Woodcock-Johnson III Tests of Achievement subtests: Letter-Word ID and Word Attack, the Peabody Picture Vocabulary Test, and the Test of Language Development-4, Sentence Imitation subtest. (Results) There were no statistically significant differences between ATC and control students in early reading skills, as measured by the confirmatory outcome measure. We also found no statistically significant differences between ATC and control students on additional post-tests analyzed for exploratory purposes. (Implications) The findings of the impact study suggest that the evaluation study may have been underpowered and that the effect of ATC on some measures of early reading skills compared with the business-as-usual condition may be directionally positive on average but less than 0.20 standard deviations. More research is needed with larger sample sizes and lower minimally detectable effect sizes. Another limitation of this study is that the business-as-usual condition consisted of programs that are, at least in some ways, similar to the ATC intervention. Thus, the effect size of ATC may be much greater in a context where ATC participation is compared with a lower quality preschool or kindergarten program. Supplemental tables are appended.
Reviews of Individual Studies PK-K -1
Increasing Pre-Kindergarten Early Literacy Skills in Children with Developmental Disabilities and Delays (2016)
Two hundred and nine children receiving early childhood special education services for developmental disabilities or delays who also had behavioral, social, or attentional difficulties were included in a study of an intervention to increase school readiness, including early literacy skills. Results showed that the intervention had a significant positive effect on children's literacy skills from baseline to the end of summer before the start of kindergarten (d = 0.14). The intervention also had significant indirect effects on teacher ratings of children's literacy skills during the fall of their kindergarten year (ß = 0.09). Additionally, when scores were compared to standard benchmarks, a greater percentage of the children who received the intervention moved from being at risk for reading difficulties to having low risk. Overall, this study demonstrates that a school readiness intervention delivered prior to the start of kindergarten may help increase children's early literacy skills. [This paper was published in "Journal of School Psychology" v57 p15-27 2016.]
Reviews of Individual Studies PK-K -1
Randomized, Controlled Trial of a Comprehensive Program for Young Students with Autism Spectrum Disorder (2016)
This randomized, controlled trial, comparing the Comprehensive Autism Program (CAP) and business as usual programs, studied outcomes for 3-5 year old students with autism spectrum disorder (ASD). Participants included 84 teachers and 302 students with ASD and their parents. CAP utilized specialized curricula and training components to implement specific evidence-based practices both at school and home. A comprehensive set of outcome areas was studied. Hierarchical linear modeling was used to estimate the treatment impact. CAP had small positive impacts on the students' receptive language (effect size of 0.13) and on their social skills as rated by teachers (effect size of 0.19). Treatment effects were moderated by severity of ASD.
Reviews of Individual Studies PK-2 -1
Independent evaluation of the Midwest CPC Expansion Project: Final report (2016)
Reviews of Individual Studies K-2 -1
The Good Behavior Game with Students in Alternative Educational Environments: Interactions between Reinforcement Criteria and Scoring Accuracy (2016)
The good behavior game (GBG) is a class-wide contingency management strategy that involves rewarding teams who engage in low levels of disruptive behavior. The GBG has been found to be effective with neuro-typical individuals from preschool to high school. In Study 1, teachers and experimenters implemented the GBG on alternating days in an alternative educational environment. Descriptive data were collected on method of selecting the maximum point criteria, scoring accuracy, and GBG efficacy. Both versions of the GBG reduced the frequency of target disruptive responses relative to baseline, despite differences in the selection of the maximum point criteria and scoring accuracy across teacher- and experimenter-implemented versions. In Study 2, only teachers implemented the GBG and reinforcement criteria were made more stringent to compensate for low levels of scoring accuracy. The teacher-implemented GBG reduced the total frequency of target responses exhibited by students in two classrooms, despite low scoring accuracy.
Reviews of Individual Studies K-4 -1
Do Live versus Audio-Recorded Narrative Stimuli Influence Young Children's Narrative Comprehension and Retell Quality? (2016)
Purpose: The primary aim of the present study was to examine whether different ways of presenting narrative stimuli (i.e., live narrative stimuli versus audio-recorded narrative stimuli) influence children's performances on narrative comprehension and oral-retell quality. Method: Children in kindergarten (n = 54), second grade (n = 74), and fourth grade (n = 65) were matched on their performance on a standardized oral-language comprehension task and then were randomly assigned to 1 of the 2 conditions that differed in how narrative stimuli were presented to children: live narrative stimuli and audio-recorded narrative stimuli. Results: Kindergartners and 2nd graders in the live condition had higher mean performance on narrative comprehension, with effect sizes of 0.43 and 0.39, respectively, after accounting for age, gender, and school. No differences were found in narrative comprehension for children in 4th grade. Children's oral-retell quality did not differ as a function of condition in any grade. Conclusion: These results suggest that how narrative stimuli are presented to children (i.e., live versus audio-recorded narrative stimuli) may affect children's narrative comprehension, particularly for young children in kindergarten and Grade 2. Implications for assessment and instruction are discussed. [Published in "Language, Speech, and Hearing Services in Schools" (EJ1089445).]
Reviews of Individual Studies 9-12 -1
Effectiveness of Internet-Based Reading Apprenticeship Improving Science Education (&quot;iRAISE&quot;): A Report of a Randomized Experiment in Michigan and Pennsylvania. Research Report (2016)
In 2012, WestEd received a "Development" grant from the U.S. Department of Education's Investing in Innovation (i3) competition to develop and implement Internet-based Reading Apprenticeship Improving Science Education ("iRAISE"). "iRAISE" was implemented in Michigan and Pennsylvania and was provided to over 100 teachers who served approximately 20,000 students during the grant period. This report presents findings from the randomized control trial of "iRAISE," which took place during the 2014-15 school year and investigated the impact of the program on teacher and student outcomes. Data sources for this report include teacher surveys; PD observations and attendance records; school district student records; and an assessment of students' literacy skills. Despite levels of implementation that did not meet the expectations of the program developers, teachers self-reported that they did change their classroom practice as a result of the "iRAISE" program, and impacts of "iRAISE" were greater for students who were performing at lower levels of incoming achievement. Given that "iRAISE" had an impact on teacher practices in literacy instruction and increased benefits for low-achieving students-consistent with positive findings from prior studies, evaluators express confidence in the promise of low-cost, accessible, and high-quality online-only professional Development (PD), addressing the needs of schools struggling to meet the demands of literacy for college and career readiness. Appended are the following: (1) Considerations for Statistical Power; (2) Details of the Approach to Estimating Impacts; (3) Reporting the Results; (4) A Post-Experimental Method to Assessing Impact under Strong Implementation; (5) Fidelity of Implementation; and (6) Teacher Survey Constructs.
Reviews of Individual Studies K -1
Attention to Orthographic and Phonological Word Forms in Vocabulary Instruction for Kindergarten English Learners (2016)
This study examined benefits of connecting meaning, speech, and print in vocabulary learning for kindergarten English learners. Students screened eligible with limited English proficiency were randomly assigned to two instruction conditions. Both groups received direct instruction in high frequency root words. One condition featured added attention to orthographic and phonological word features. Increased attention to the spoken and printed word forms was associated with significantly greater gains in general vocabulary and word reading, and in taught-word spelling. Results suggest features of effective vocabulary instruction for young and English learner students.
Reviews of Individual Studies 5 -1
A cluster randomized controlled trial of the Promoting Alternative THinking Strategies (PATHS®) curriculum. (2016)
Reviews of Individual Studies 6 -1
Examining a Preteaching Framework to Improve Fraction Computation Outcomes among Struggling Learners (2016)
Thirty-two students enrolled in one of four sixth-grade classrooms across two elementary schools participated in this study. Students receiving supplemental and intensive instruction in math and those with math-related disabilities were participants. A treatment and control, pre/postexperimental design was used to examine the effect of preteaching using a gradual instructional sequence on students' accuracy in solving fraction computations. Prior to each unit, students were pretaught three essential prerequisite skills related to the upcoming general education core math unit. Findings indicate that the combination of preteaching using the concrete-representational-abstract instructional sequence can be effective at improving the overall fraction computations of students with or at risk for disabilities.
Reviews of Individual Studies 5 -1
Impact of Math Snacks Games on Students' Conceptual Understanding (2016)
This "Math Snacks" intervention measured 741 fifth grade students' gains in conceptual understanding of core math concepts after game-based learning activities. Teachers integrated four "Math Snacks" games and related activities into instruction on ratios, coordinate plane, number systems, fractions and decimals. Using a randomized, controlled, quasi-experimental design, classrooms were randomly assigned to one of two conditions in a delayed treatment model. First Group A, and then Group B, received 5 weeks of "Math Snacks" intervention in addition to the regular district mathematics curriculum. Using a carefully refined test containing multiple choice and open-ended items, both groups were assessed three times: prior to any interventions, at the end of Phase 1 (when only Group A had received the intervention), and at the end of Phase 2 (when both groups had received the intervention). Students' mean gains over 5 weeks were significantly higher while receiving the "Math Snacks" intervention as compared to the group not receiving the intervention.
Reviews of Individual Studies 5-7 -1
Providing Feedback on Computer-Based Algebra Homework in Middle-School Classrooms (2016)
Homework is transforming at a rapid rate with continuous advances in educational technology. Computer-based homework, in particular, is gaining popularity across a range of schools, with little empirical evidence on how to optimize student learning. The current aim was to test the effects of different types of feedback on computer-based homework. In the study, middle school students completed a computer-based pretest, homework assignment, and posttest containing challenging algebraic problems. On the homework assignment, students were assigned to different feedback conditions. In Experiment 1 (N = 103), students received no feedback or correct-answer feedback after each problem. In Experiment 2 (N = 143), students received (1) no feedback, (2) correct-answer feedback, (3) try-again feedback, or (4) explanation feedback after each problem. For students with low prior knowledge, feedback resulted in better posttest performance than no feedback. However, students with high prior knowledge learned just as much whether they received feedback or not. Results suggest the provision of basic feedback on computer-based homework can benefit novice students' mathematics learning.
Reviews of Individual Studies 4 -1
Impact of achievement of a five-year intensive professional development program in elementary science. (2016)
Reviews of Individual Studies 4 -1
Examining the Average and Local Effects of a Standardized Treatment for Fourth Graders with Reading Difficulties (2016)
The present study used a randomized control trial to examine the effects of a widely used multicomponent Tier 2-type intervention, Passport to Literacy, on the reading ability of 221 fourth graders who initially scored at or below the 30th percentile in reading comprehension. Intervention was provided by research staff to groups of 4-7 students for 30 min, 4 days a week throughout the school year (M = 90.45 lessons). Tier 1 instruction was observed to be of generally high quality and intervention fidelity was strong. Findings revealed small, average effects (ES = -0.14-0.28) in favor of intervention students on standardized measures of comprehension, but no effects on word reading or fluency measures. Exploratory analyses indicated that intervention effects may differ by students' comprehension abilities. Implications for intervention implementation and directions for future research are discussed.
Reviews of Individual Studies 4 -1
Examining the Average and Local Effects of a Standardized Treatment for Fourth Graders with Reading Difficulties (2016)
The present study used a randomized control trial to examine the effects of a widely-used multi-component Tier 2 type intervention, Passport to Literacy, on the reading ability of 221 fourth graders who initially scored at or below the 30th percentile in reading comprehension. Intervention was provided by research staff to groups of 4-7 students for 30 min, 4 days a week throughout the school year (M = 90.45 lessons). Tier 1 instruction was observed to be of generally high quality and intervention fidelity was strong. Findings revealed small, average effects (ES = 0.14 -0.28) in favor of intervention students on standardized measures of comprehension, but no effects on word reading or fluency measures. Exploratory analyses indicated intervention effects may differ by students' comprehension abilities. Implications for intervention implementation and directions for future research are discussed. [This paper was published in "Journal of Research on Educational Effectiveness" (EJ1115336).]
Reviews of Individual Studies 4 -1
Effects from a Randomized Control Trial Comparing Researcher and School-Implemented Treatments with Fourth Graders with Significant Reading Difficulties (2016)
This study examined the effectiveness of a researcher-provided intervention with fourth graders with significant reading difficulties. The intervention emphasized multisyllable word reading, fluent reading of high-frequency words and phrases, vocabulary, and comprehension. To identify the participants, 1,695 fourth-grade students were screened using the Gates-MacGinitie Reading Test, and those whose standard scores were 85 or lower were included in the study (N = 483). Participants were randomly assigned (2:1) to receive either researcher-provided intervention (n = 323) or intervention provided by school personnel (business as usual, BAU) (n = 161). Findings revealed no statistically significant differences between students in the researcher-provided intervention and BAU groups. Using effect sizes as an indicator of impact, students in the researcher-implemented treatment generally outperformed students in the school-implemented treatment (BAU). Examining growth in standard scores, both groups made significant gains in reading outcomes with standard score growth from pretest to posttest of 3 standard score points on decoding, 5 on fluency, and 2.0 to 7 standard score points on reading comprehension measures.
Reviews of Individual Studies 4-5 -1
Investigating Effects of Embedding Collaboration in an Intelligent Tutoring System for Elementary School Students (2016)
Intelligent Tutoring Systems (ITSs) are beneficial for individual students learning in several domains, including mathematics where they have been used to support both secondary and elementary students. Collaborative learning may be beneficial to include in ITSs, particularly for conceptual knowledge. There is little work on collaborative ITSs, and it has mostly focused on older students. We aim to extend this work to elementary school students, by extending an ITS for fractions so it supports collaborative learning. We also build upon our previous work to further investigate the complementary strengths of collaborative and individual learning. In our study, 189 elementary school students worked with a conceptual or a procedural fractions ITS, and either individually or collaboratively. Students in both ITS conditions learned, but there were no differences in learning between individual and collaboration. However, the students working collaboratively spent less time on the tutor, indicating potential benefits of collaborative learning on efficiency in this setting.
Reviews of Individual Studies 4-5 -1
District 75, New York City Department of Education impact evaluation. (2016)
Reviews of Individual Studies 3-8 -1
Achievement Network&apos;s Investing in Innovation Expansion: Impacts on Educator Practice and Student Achievement (2016)
Data-based instructional programs have proliferated in American schools despite limited evidence of their effectiveness in improving educator practice and raising student achievement. We report results from a two-year school-randomized evaluation of the Achievement Network (ANet), a program providing schools with standards-aligned interim assessments and intensive supports for instructional data use. Survey data show that ANet increased teacher satisfaction with the timeliness and clarity of the data they receive and available supports for instructional data-use and caused them to review and use interim assessment data more often. ANet did not, however, affect their confidence in data use or how frequently they differentiated instruction. Student impact estimates show no overall effect on student achievement in English language arts or mathematics. Despite the lack program effects on student achievement, we find that achievement is positively correlated with our survey-based measures of teacher perceptions and practices around instructional data use. Exploratory analyses suggest that the success of ANet in improving teacher practice and student achievement varies with the pre-existing capacity of schools to engage in data-based instruction. Schools rated by program staff as having a high level of readiness to implement the intervention prior to random assignment experienced positive impacts on student achievement, while those rated as a having a low level of readiness experienced negative impacts. The following are appended: (1) School Screener Scoring Rubric; (2) Year 2 School Leader and Teacher Survey Scale Items; and (3) School Leader and Teacher Survey Impact Tables.
Reviews of Individual Studies 3-8 -1
The LASER Model: A Systematic and Sustainable Approach for Achieving High Standards in Science Education. SSEC i3 Validation Final Report of Confirmatory and Exploratory Analyses (2016)
In August 2010, the Smithsonian Science Education Center (SSEC) received a grant of more than $25 million from the U.S. Department of Education's Investing in Innovation (i3) program for a five-year study to validate its Leadership Assistance for Science Education Reform (LASER) model in three very diverse regions of the United States: rural North Carolina, northern New Mexico, and the Houston Independent School District (HISD). This current report focuses on the confirmatory and exploratory research questions submitted to i3 for the two studies conducted for the LASER i3 validation grant, providing clarifying detail related to methodology and instrumentation. The studies were conducted to answer two confirmatory research questions and two exploratory research questions.
Reviews of Individual Studies 6-8 -1
The LASER model: A systematic and sustainable approach for achieving high standards in science education: SSEC i3 Validation Final Report of Confirmatory and Exploratory Analyses [Middle Schools]. (2016)
Reviews of Individual Studies 6-9 -1
Addressing Early Warning Indicators: Interim Impact Findings from the Investing in Innovation (i3) Evaluation of Diplomas Now (2016)
Diplomas Now is a partnership of three national organizations--Talent Development Secondary, City Year, and Communities In Schools--collaborating in an effort to transform urban secondary schools so that fewer students drop out and more graduate ready for postsecondary education and work. With the goal of a continuous system of support through secondary school, the Diplomas Now model seeks to help more students graduate by improving their attendance, behavior, and course performance, particularly in English/language arts and math, during the middle grades and high school. Acting as a representative for the partnership, Johns Hopkins University, home to Talent Development Secondary, was awarded an Investing in Innovation (i3) validation grant by the U.S. Department of Education in 2010 to support the expansion of Diplomas Now from a few schools to more than 30 middle and high schools in more than 10 school districts. The grant funds also support a rigorous random assignment evaluation of the Diplomas Now model, led by MDRC. This report discusses the early impacts of the Diplomas Now model on student and school outcomes at the end of the first and second years of model implementation. It focuses in particular on students during sixth and ninth grades, critical transition years into middle and high school. Accordingly, this report presents the "first-year" impacts of a "multiyear" program. In total, 62 high-needs schools (33 middle schools and 29 high schools) from 11 large urban school districts across the country were recruited to participate in the study starting in either the 2011-2012 or the 2012-2013 school year. Thirty-two of the participating secondary schools were randomly assigned to implement the Diplomas Now model (DN schools), and 30 were assigned to continue with "business as usual" (non-DN schools), either maintaining their existing practices and structures or pursuing other types of school reform. This third report focuses on the early impacts of Diplomas Now on students' attendance, behavior, and course performance measures (the ABC outcomes), separately and in combination, during their first year in middle school or high school over the course of the first two years that the model was implemented in participating schools. Does the implementation of Diplomas Now have an impact on how many students are on a path to high school graduation by the end of their first year of middle school or high school? During that first year, what difference does Diplomas Now make for attendance rates, suspensions and expulsions, and successful course completion? This report also discusses the impact of Diplomas Now on possible precursors to the ABC outcomes, such as the climate of the school, support from parents and the community, and students' attitudes and relationships. Two appendices are included: (1) Samples, Analytic Methods, and Early Outcome Measures; and (2) Supplemental ABC Outcome Findings. [For "Laying Tracks to Graduation: The First Year of Implementing Diplomas Now," see ED546638. For "Moving down the Track: Changing School Practices during the Second Year of Diplomas Now," see ED558491.]
Reviews of Individual Studies 6-8 -1
Evaluation of violence prevention approaches among early adolescents: Moderating effects of disability status and gender (2016)
Reviews of Individual Studies 6-8 -1
An evaluation of the University of Chicago School Mathematics Project: Pre-Transition Mathematics (2016)
Reviews of Individual Studies 9 -1
Helping Students Make the Transition into High School: The Effect of Ninth Grade Academies on Students&apos; Academic and Behavioral Outcomes (2016)
Ninth Grade Academies (NGAs)--also called Freshman Academies--have attracted national attention as a particularly intensive and promising approach for supporting a successful transition for high school freshmen. An NGA is a self-contained learning community for ninth-graders that operates as a school within a school. NGAs have four core structural components: (1) a designated separate space within the high school, (2) a ninth-grade administrator who oversees the academy, (3) a faculty assigned to teach only ninth-grade students, and (4) teachers organized into interdisciplinary teams that have both students and a planning period in common. The theory of action behind NGAs is that when these components are employed together, they interact to create a more personalized learning environment where ninth-grade students feel less anonymous and more individually supported. This, in turn, should help students succeed in school and stay on track to high school graduation. NGAs have shown promising results when employed as part of a whole-school reform model, but in these cases schools have received external support from a developer to create and sustain them. A growing number of schools and districts have been experimenting with NGAs on their own, but the little research that exists on their effectiveness is limited to anecdotal accounts. This study, which is based on a quasi-experimental research design, examines the effect of NGAs on students' progress toward graduation, their academic achievement, and their behavior in several school districts in Florida. The sample for this study includes 27 high schools that created NGAs between 2001-2002 and 2006-2007, along with 16 comparison high schools that serve ninth-grade students with similar characteristics as students in the NGA schools. As context for understanding the impact findings, this study also looks at the extent to which the key features of the NGA model were implemented in the NGA schools in the study and how this differs from the structures and supports in the comparison schools. The key finding is that the NGAs in this study do not appear to have improved students' academic or behavioral outcomes (credit earning, state test scores, course marks, attendance, suspensions, or expulsions). The findings also suggest that it can be difficult for schools to fully implement the components of the NGA model without expert assistance: Three years after their creation, only half the NGAs in the study had all four structural components of the model in place. Nationally, school districts continue to create NGAs, and recent efforts to implement them have incorporated various enhancements that are intended to strengthen and improve their implementation, but little is known about their effectiveness. Because students' experience in ninth grade is an important predictor of their future success, these efforts to create and improve NGAs should be examined in future studies. Appended are: (1) Technical Information; and (2) Beyond the Sunshine State: Ninth Grade Academies in Other School Districts. ["Helping Students Make the Transition into High School: The Effect of Ninth Grade Academies on Students' Academic and Behavioral Outcomes" was written with Janet Quint.]
Reviews of Individual Studies 9 -1
Evaluation of the Rural Math Excel Partnership Project Final Report (2016)
This is the final external evaluation report prepared by SRI International for the Rural Math Excel Partnership (RMEP) project, an investing in innovation (i3) development project funded by the U.S. Department of Education. Operated by Virginia Advanced Study Strategies, Inc. (VASS), the RMEP project included six rural school districts (LEAs) in five Virginia counties as partners. The project goal was to develop and implement a model of shared responsibility among families, math teachers, and communities in rural areas to prepare students enrolled in Algebra I, Geometry, Algebra II, and Algebra Functions and Data Analysis (AFDA) courses for success in advanced high school and postsecondary STEM studies. The long term outcome was for students to leave school ready, at a minimum, to enroll in postsecondary programs focused on technician-level careers in STEM-related fields considered important to the regional rural economy. Due to low levels of implementation by some teachers in project years 1 and 2, in fall 2015 (year 3) the RMEP team focused their supports and services on a group of 24 high-implementation teachers in the seven middle and seven high schools. Key implementation and impact findings were the RMEP team completed five of the six core implementation activities meeting the standard of performance set by the evaluation team; student and family access to technology did not meet performance standards. It was difficult and time consuming to locate students and families in need of tablets and broadband access at the 14 schools and then to provide these individuals with the necessary services in their homes. Furthermore, district firewalls, teacher comfort level with technology, and registration requirements for the MARi online video platform created significant delays for the RMEP project throughout Year 2. By the end of the project's third year, however, RMEP provided technology access to all the students and their families of the 24 teachers. Willingness of individual teachers to perform their role in the model of shared responsibility varied, especially in the number of videos that teachers assigned to students and their efforts to hold Family Math Nights. Although full implementation of the model was restricted to a single semester, there was evidence that this higher level of support was beginning to have positive impacts on the teachers in terms of video assignments and student completion of these assignments. Evaluations from families and students showed that participating in RMEP-related events were useful and worth their time, though attendance was lower than expected for these events. Teachers and community members reported that organizing these events required a large time commitment and that they needed more help in identifying ways to increase attendance. SRI evaluators found that the RMEP project had no impact on students' achievement or attitudes by the end of 2015. Possible reasons included differences between the content knowledge that the Virginia Standards of Learning (SOL) exams assess and the content emphasized by the RMEP project. Evaluators were not able to limit the sample to only those students whose teachers implemented the intervention in the 2015-16 school year (the high-implementing teachers). The small sample size of students may not have been large enough to detect a very small effect. Key model components were not fully implemented until fall 2015, an insufficient time period for the intervention to have a significant impact on the targeted outcomes. Nevertheless, the RMEP project can serve as an illustrative example for other such initiatives, and suggests that similar projects should consider level of participant buy-in, anticipate and be able to troubleshoot technology access issues, and provide enough time as well as staff support for full implementation.
Reviews of Individual Studies 8 -1
Support for Struggling Students in Algebra: Contributions of Incorrect Worked Examples (2016)
Middle school algebra students (N = 125) randomly assigned within classroom to a Problem-solving control group, a Correct worked examples control group, or an Incorrect worked examples group, completed an experimental classroom study to assess the differential effects of incorrect examples versus the two control groups on students' algebra learning, competence expectancy, and sense of belonging to math class. The study also explored whether prior knowledge impacted the effectiveness of the intervention. A greater sense of belonging and competence expectancy predicted greater learning overall. Students' sense of belonging to math and competence expectancies were high at the start of the study and did not increase as a result of the intervention. A significant interaction between prior knowledge and incorrect worked examples on post-test scores revealed that students with low prior knowledge who struggle with learning math benefit most from reflecting on highlighted errors within an incorrect worked examples intervention. The unique contributions of these findings as well as educational implications are discussed. [This article was published in "Learning and Individual Differences," v48 p36-44 May 2016.]
Reviews of Individual Studies 8 -1
Support for Struggling Students in Algebra: Contributions of Incorrect Worked Examples (2016)
Middle school algebra students (N = 125) randomly assigned within classroom to a Problem-solving control group, a Correct worked examples control group, or an Incorrect worked examples group, completed an experimental classroom study to assess the differential effects of incorrect examples versus the two control groups on students' algebra learning, competence expectancy, and sense of belonging to math class. The study also explored whether prior knowledge impacted the effectiveness of the intervention. A greater sense of belonging and competence expectancy predicted greater learning overall. Students' sense of belonging to math and competence expectancies were high at the start of the study and did not increase as a result of the intervention. A significant interaction between prior knowledge and incorrect worked examples on post-test scores revealed that students with low prior knowledge who struggle with learning math benefit most from reflecting on highlighted errors within an incorrect worked examples intervention. The unique contributions of these findings as well as educational implications are discussed. [This article was published in "Learning and Individual Differences," v48 p36-44 May 2016.]
Reviews of Individual Studies 2 -1
Effects of an Interdependent Group Contingency on Engagement in Physical Education (2016)
We examined whether a group contingency increased engagement during elementary school physical education sessions. The intervention employed procedures (explicit instruction, goal setting, and reinforcement) drawn from the first tier of classwide function-related intervention teams (CW-FIT; Wills et al., 2009). Results showed salutary increases in engagement that corresponded with the teacher's implementation.
Reviews of Individual Studies 2-3 -1
Delayed Effects of a Low-Cost and Large-Scale Summer Reading Intervention on Elementary School Children&apos;s Reading Comprehension (2016)
To improve the reading comprehension outcomes of children in high-poverty schools, policymakers need to identify reading interventions that show promise of effectiveness at scale. This study evaluated the effectiveness of a low-cost and large-scale summer reading intervention that provided comprehension lessons at the end of the school year and stimulated home-based summer reading routines with narrative and informational books. We conducted a randomized controlled trial involving 59 elementary schools, 463 classrooms, and 6,383 second and third graders and examined outcomes on the North Carolina End-of-Grade (EOG) reading comprehension test administered nine months after the intervention, in the children's third- or fourth-grade year. We found that on this delayed outcome, the treatment had a statistically significant impact on children's reading comprehension, improving performance by 0.04 SD (standard deviation) overall and 0.05 SD in high-poverty schools. We also found, in estimates from an instrumental variables analysis, that children's participation in home-based summer book reading routines improved reading comprehension. The cost-effectiveness ratio for the intervention compared favorably to existing compensatory education programs that target high-poverty schools.
Reviews of Individual Studies 12-PS -1
Summer Nudging: Can Personalized Text Messages and Peer Mentor Outreach Increase College Going among Low-Income High School Graduates? (2016)
A report released in April 2013 by Benjamin L Castleman of Harvard University and Lindsay C. Page of the Center for Education Policy Research at Harvard University examines the implications of two forms of interventions during the summer between high school and the first year of college on college enrollment. "Summer Nudging: Can Personalized Text Messages and Peer Mentor Outreach Increase College Going Among Low-Income High School Graduates?" details findings that text message reminders and peer mentor outreach programs can be an effective way to mitigate summer attrition. The report details two large-scale randomized trials done in collaboration with three educational agencies: the Dallas Independent School District (Dallas ISD), uAspire (a Boston-based nonprofit organization focused on college affordability), and Mastery Charter Schools (a network of charter schools in the Philadelphia metropolitan area). Castleman and Page reveal the positive impact these low-cost initiatives can have on college enrollment within low-income communities during an increasingly technological era.
Reviews of Individual Studies 12-PS -1
Report to College Bound St. Louis on the Implementation and Impact of the 2014 Summer Melt Intervention Utilizing Bridgit (2015b)
Reviews of Individual Studies 9-12 -1
Science, Technology, Engineering, and Math Education for the 21st Century (STEM21) high school impact evaluation: Final evidence report. (2015, December)
Reviews of Individual Studies 9-12 -1
Online resources for mathematics: Do they affect student learning? (2015)
Reviews of Individual Studies 9-12 -1
The Impact of the Reading Apprenticeship Improving Secondary Education (RAISE) Project on Academic Literacy in High School: A Report of a Randomized Experiment in Pennsylvania and California Schools. Research Report (2015)
The Reading Apprenticeship instructional framework was developed by WestEd's Strategic Literacy Initiative (SLI) two decades ago to help teachers provide the literacy support students need to be successful readers in the content areas. It has since reached over 100,000 teachers in schools across the country, at the middle school, high school, and college levels. The Reading Apprenticeship framework focuses on four interacting dimensions of classroom learning culture: Social, Personal, Cognitive, and Knowledge-Building. These four dimensions are woven into subject-area teaching through metacognitive conversation--conversations about the thinking processes students and teachers engage in as they read. The context in which this all takes place is extensive reading--increased in-class opportunities for students to practice reading complex academic texts in more skillful ways. Teachers also work with students on explicit comprehension strategy instruction, vocabulary and academic language development techniques, text-based discussion, and writing. Reading Apprenticeship is designed to help teachers create classroom cultures in which students feel safe to share reading processes, problems, and solutions. In 2010, WestEd received a "Validation" grant from the Department of Education's Investing in Innovation Fund (i3) competition to scale-up and conduct a randomized controlled trial of the intervention through a project called Reading Apprenticeship Improving Secondary Success (RAISE). RAISE took place in California, Michigan, Utah, Pennsylvania, and Indiana and worked with nearly 2,000 teachers who served approximately 630,000 students during the grant period. This report presents findings from the randomized controlled trial conducted in two of those states: California and Pennsylvania. The report presents key implementation and impact findings from the i3 impact evaluation of the RAISE project. Most of the findings in this report are from the sample of students and data collected during teachers' second year in the study, after treatment teachers had received the full "dose" of professional development delivered over 12 months and could therefore be expected to fully implement Reading Apprenticeship. Data sources for this report include principal, teacher, and student surveys; professional development observations and attendance records; school district student records; and an assessment of students' literacy skills. Overall, the study's findings demonstrate the potential of RAISE to address the paucity of content-specific reading instruction in U.S. secondary schools--especially in science, where the need may be greatest. Appended are the following: (1) Impact Estimation Model; (2) Student Survey Constructs; (3) Teacher Survey Constructs; (4) Analytic Sample Baseline Equivalence; (5) Student Literacy Assessment; (6) Sample Attrition; (7) Additional Impact Analyses for Teacher Mediating Outcomes; (8) Additional Impact Analyses for Student Mediating Outcomes; (9) Additional Impact Analyses for Student Literacy; (10) Fidelity of Implementation Summary; and (11) Context for Program Implementation.
Reviews of Individual Studies 9-12 -1
The Effects of the Good Behavior Game with General-Education High School Students (2015)
The purpose of the present study was to extend previous research by evaluating the effect of the interdependent group contingency procedure known as the Good Behavior Game (GBG) on decreasing disruptive behaviors with general-education high school students. Although many studies exist that have used the GBG to alter behaviors across ages ranging from preschool to adulthood, few studies exist in which the GBG has been used in general-education high school classrooms. The present study used separate ABAB withdrawal designs in three classrooms, with withdrawal and reimplementation in two of the classrooms. All three classrooms demonstrated large effect sizes with clear and substantial decreases in disruptive behaviors during the intervention phases. Teachers found the intervention acceptable, supporting the use of a modified version of the GBG in high school classrooms. Students found it generally acceptable as well, though with some reservations regarding certain aspects of the procedure.
Reviews of Individual Studies K -1
Immediate and Distal Effects of the Good Behavior Game (2015)
The Good Behavior Game (GBG) has been demonstrated to reduce disruptive student behavior during implementation. The effects of playing the GBG on disruption immediately before and after the GBG are unknown. The current study evaluated the effects of the GBG on disruption in 5 kindergarten classes immediately before, during, and after GBG implementation. The GBG reduced disruption during implementation but did not affect rates of disruption during activity periods that preceded or followed the GBG.
Reviews of Individual Studies K-2 -1
The Impact of Highly and Minimally Guided Discovery Instruction on Promoting the Learning of Reasoning Strategies for Basic Add-1 and Doubles Combinations (2015)
A 9-month training experiment was conducted to evaluate the efficacy of highly and minimally guided discovery interventions targeting the add-1 rule (the sum of a number and one is the next number on the mental number list) and doubles relations (e.g., an everyday example of the double 5 + 5 is five fingers on the left hand and five fingers on the right hand make 10 fingers in all) and to compare their impact with regular classroom instruction on adding 1 and the doubles. After pretest, 81 kindergarten to second-grade participants were randomly assigned to one of three training conditions: highly guided add-1 training,highly guided doubles training, or minimally guided add-1 and doubles practice. The highly guided add-1 training served as an active control for the highly guided doubles training and vice versa, and the minimally guided practice condition served to control for the impact of extra practice. ANCOVAs using pretest score and age as covariates indicated that both highly guided and minimally guided interventions were successful in promoting retention and transfer for the relatively salient add-1 rule, but only highly guided training produced transfer for the less-salient doubles relations. The findings indicate that the degree of guidance needed to achieve fluency with different addition reasoning strategies varies.
Reviews of Individual Studies K-12 -1
Exploring the Causal Impact of the McREL Balanced Leadership Program on Leadership, Principal Efficacy, Instructional Climate, Educator Turnover, and Student Achievement (2015)
This study uses a randomized design to assess the impact of the Balanced Leadership program on principal leadership, instructional climate, principal efficacy, staff turnover, and student achievement in a sample of rural northern Michigan schools. Participating principals report feeling more efficacious, using more effective leadership practices, and having a better instructional climate than control group principals. However, teacher reports indicate that the instructional climate of the schools did not change. Furthermore, we find no impact of the program on student achievement. There was an impact of the program on staff turnover, with principals and teachers in treatment schools significantly more likely to remain in the same school over the 3 years of the study than staff in control schools.
Reviews of Individual Studies PK-3 -1
Evaluation of the Florida Master Teacher Initiative: Final Evaluation Findings (2015)
The purpose of this study was to examine the impact of the Florida Master Teacher Initiative (FMTI)--an i3-funded early learning program aimed at improving the quality of teaching and student outcomes in grades PreK through third grade in high need schools. The FMTI schools participated in four program components: (1) a job-embedded graduate degree program with an early childhood specialization, (2) a Teacher Fellows program through which teachers engage in yearlong inquiry projects around their practice, (3) a Principal Fellows program during which principals work together to strengthen their facilitative leadership skills, and (4) Summer Leadership Institutes to review data and engage in action planning. The impact evaluation had two primary goals: (1) to assess the school-level impact of FMTI on teachers and students; and (2) to assess the impact of FMTI on teachers enrolled in the job-embedded early childhood graduate degree program and their students. To achieve the first goal, the evaluation used a cluster random assignment design, in which 40 Miami-Dade County Title I public elementary schools were randomly assigned to the FMTI program or a status-quo control condition. To achieve the second goal, the evaluation used an embedded quasi-experimental design using propensity score matching and difference-in-differences approaches. SRI International administered schoolwide surveys at baseline and in the final year of the grant in both intervention and control schools; conducted classroom observations of job-embedded graduate program teachers and a matched comparison group using the Classroom Assessment Scoring System (CLASS) early in the teachers' first year of the graduate program and a follow-up observation occurred after or near the end of the program, with program teachers and sample of comparison teachers; and gathered student reading and math achievement data on children in kindergarten through fifth grade who were at the 40 study schools at the time of random assignment for a total of more than 10,000 students in the FMTI schools and a similar number of students in the control schools. The study did not find school-level impacts on student achievement or on the majority of outcomes measured through the teacher survey. Analysis of the impact of the job-embedded graduate degree program found a positive difference of 1.7 points for participating teachers in the instructional quality domain of the CLASS compared to matched comparison teachers. The evaluation also found positive and statistically significant results for the graduate program teachers compared to comparison teachers on the teacher survey in the areas of engagement in leadership activities, engagement in governance activities, engagement in outreach activities, self-reported early childhood knowledge, and self-reported general instructional knowledge. No significant differences in math or reading achievement were found for students of the graduate program teachers compared to students of a matched sample of teachers in control schools. The implementation of the FMTI program was not sufficiently robust to definitively determine its effectiveness. FMTI treatment schools that achieved medium or high fidelity of implementation across the three years experienced more positive outcomes. The evaluation has illuminated lessons about how to effectively provide job-embedded professional development to support teacher quality improvement. The following are appended: (1) Methods; (2) Implementation Fidelity; and (3) Impact Estimates.
Reviews of Individual Studies PK-5 -1
Impacts of the Teach for America Investing in Innovation scale-up. (2015)
Reviews of Individual Studies 12-PS -1
Stay late or start early? Experimental evidence on the benefits of college matriculation support from high schools versus colleges (2015)
Reviews of Individual Studies 1-3 -1
Identifying academic demands that occasion problem behaviors for students with behavioral disorders: Illustrations at the elementary school level. (2015)
Reviews of Individual Studies 1-2 -1
Effectiveness of a Universal, Interdependent Group Contingency Program on Children's Academic Achievement: A Countywide Evaluation. (2015)
The Good Behavior Game (GBG) is a universal prevention program designed to increase academic engagement and to decrease disruptive behavior in elementary school-age children. Teachers and other school personnel use interdependent group contingencies to improve students' behavior in the classroom. Previous research indicates the GBG is efficacious in reducing behavior problems; however, little research has examined its effects on academic achievement in real-world settings. In this study, the authors evaluated the PAX GBG, a commercially available version of the GBG, as it is typically administered in elementary schools. The authors examined standardized reading and mathematics scores across one academic year for 949 students enrolled in the GBG or comparison classrooms. Results showed significant but small effects of the GBG on reading and mathematics. Results were greatest for boys, children with lower achievement scores at baseline, and students from more economically disadvantaged school districts. School personnel may find the PAX GBG useful in improving children's behavior and academic skills.
Reviews of Individual Studies 1-2 -1
Exploration of a Blended Learning Approach to Reading Instruction for Low SES Students in Early Elementary Grades (2015)
This study investigated the potential benefits of a blended learning approach on the reading skills of low socioeconomic status students in Grades 1 and 2. Treatment students received English language arts instruction that was both teacher-led and technology-based. Comparisons were made with control students who received the same English language arts instruction without the blended learning component. Results showed significantly greater pretest/posttest gains on a standardized reading assessment for the treatment students compared to the control students. The greatest discrepancy occurred in reading comprehension. A sub-analysis of low-performing English language learner students in the treatment group revealed the largest reading gains. At posttest, these students performed at the level of non-English language learner students in the control group. Results indicated a blended learning approach can be effective in enhancing the reading skills of low socioeconomic students.
Reviews of Individual Studies 1 -1
The Influence of Mathematics Vocabulary Instruction Embedded within Addition Tutoring for First-Grade Students with Mathematics Difficulty (2015)
Researchers and practitioners indicate students require explicit instruction on mathematics vocabulary terms, yet no study has examined the effects of an embedded vocabulary component within mathematics tutoring for early elementary students. First-grade students with mathematics difficulty (MD; n = 98) were randomly assigned to addition tutoring with an embedded vocabulary component, addition tutoring without the embedded vocabulary component, or business-as-usual control. At posttest, students who received addition tutoring without vocabulary demonstrated greater gains than control students on addition fluency. On a measure of mathematics vocabulary, students in the active tutoring conditions demonstrated improved performance on mathematics vocabulary over control students. Results indicate that exposure to addition tutoring with or without an embedded vocabulary component positively improves mathematics vocabulary performance.
Reviews of Individual Studies 1 -1
The Influence of Mathematics Vocabulary Instruction Embedded within Addition Tutoring for First-Grade Students with Mathematics Difficulty (2015)
Researchers and practitioners indicate students require explicit instruction on mathematics vocabulary terms, yet no study has examined the effects of an embedded vocabulary component within mathematics tutoring for early elementary students. First-grade students with mathematics difficulty (MD; n = 98) were randomly assigned to addition tutoring with an embedded vocabulary component, addition tutoring without the embedded vocabulary component, or business-as-usual control. At posttest, students who received addition tutoring without vocabulary demonstrated greater gains than control students on addition fluency. On a measure of mathematics vocabulary, students in the active tutoring conditions demonstrated improved performance on mathematics vocabulary over control students. Results indicate that exposure to addition tutoring with or without an embedded vocabulary component positively improves mathematics vocabulary performance.
Reviews of Individual Studies 1 -1
The Influence of Mathematics Vocabulary Instruction Embedded within Addition Tutoring for First-Grade Students with Mathematics Difficulty (2015)
Researchers and practitioners indicate students require explicit instruction on mathematics vocabulary terms, yet no study has examined the effects of an embedded vocabulary component within mathematics tutoring for early elementary students. First-grade students with mathematics difficulty (MD; n = 98) were randomly assigned to addition tutoring with an embedded vocabulary component, addition tutoring without the embedded vocabulary component, or business-as-usual control. At posttest, students who received addition tutoring without vocabulary demonstrated greater gains than control students on addition fluency. On a measure of mathematics vocabulary, students in the active tutoring conditions demonstrated improved performance on mathematics vocabulary over control students. Results indicate that exposure to addition tutoring with or without an embedded vocabulary component positively improves mathematics vocabulary performance.
Reviews of Individual Studies 1 -1
Math at home adds up to achievement in school. (2015)
Reviews of Individual Studies 1 -1
Does Supplemental Instruction Support the Transition from Spanish to English Reading Instruction for First-Grade English Learners at Risk of Reading Difficulties? (2015)
This study examines the effect of 30 min of small group explicit instruction on reading outcomes for first-grade Spanish-speaking English learners (ELs) at risk of reading difficulties. Participants were 78 ELs from seven schools who were receiving Spanish only, or Spanish and English, whole group reading instruction in first grade. Students were rank-ordered within schools and then randomly assigned to a treatment condition (n = 39) or a comparison condition (n = 39). Students in the treatment condition received instruction on transition elements that supported their transfer of skills from Spanish to English. Students in the comparison condition received Business as Usual instruction from a variety of commercially available programs. Findings indicated that ELs in both conditions made significant gains from pretest to posttest on all reading outcomes even though instruction in the treatment condition focused significantly more on higher order skills (i.e., vocabulary, comprehension, and transition elements) whereas instruction in the comparison condition focused significantly more on lower order skills (i.e., phonics, word work, and sentence reading). Implications for practice and future research are discussed. [This paper was published in "Learning Disability Quarterly" (EJ1119703).]
Reviews of Individual Studies 8 -1
STEM Learning Opportunities Providing Equity (SLOPE): An Investing in Innovation (i3) Grant. Final Evaluation Report (2015)
This five-year evaluation examined the effectiveness of a promising middle-school mathematics intervention funded through an Investing in Innovation (i3) development grant. Evaluation objectives were to: (1) study the impact of an intervention aimed at increasing the academic achievement of students in Algebra I--a gate-keeping course--as measured by student performance on an end-of-year state test in mathematics; and (2) better understand the relationship between intervention impact and implementation fidelity, as measured by levels of compliance by teachers with the study protocol. The intervention was piloted in Year 2 of the grant (2011-12 school year) that was followed by a two-year [randomized control trial] RCT in grant years 3 (2012-13 school year) and 4 (2013-14 school year). Data collected in the RCT years were focused on impact and exploratory analyses, respectively. For the RCT component, 70 Grade 8 Algebra I teachers were recruited from 15 school districts across California. Randomization, conducted by WestEd in spring 2012, was conducted at the teacher level. Students were assigned to classrooms without knowledge of the group membership of teachers (treatment vs. control), using each district's routine placement policies. Fidelity of implementation study was monitored by collecting systematically information from teachers assigned to the treatment condition throughout the course of the study. The contrast of interest was performance on a standardized Algebra I test by students assigned to classrooms taught by treatment teachers compared to performance by students assigned to classrooms taught by control teachers. The final analytic sample for the 2012-13 cohort included 1,384 students assigned to 28 treatment teachers and 1,088 students assigned to 27 control teachers. None of the contrasts showed a statistically significant difference at the 0.05 level. Students who were assigned to classrooms taught by treatment teachers did not perform differently in relation to those assigned to classrooms taught by control teachers. Overall findings from the implementation study indicated that great variability emerged in the ways in which teachers implemented the intervention. The threshold for fidelity was reached with only one component (Instructional Unit #1) of the four studied (three instructional units and professional coaching). The following appendices are included: (1) Logic Model: SLOPE (DEV11) v.13; (2) Teacher Background Survey; (3) Interpreting Intervention Impact through the Lens of Implementation Fidelity: Findings from a Federally Funded Evaluation--Paper Presented at the Annual Meeting of the American Educational Research Association (Chicago, Illinois, April 19, 2015); (4) Implementation Survey for Air Traffic Control; (5) 2012-2013 Measuring Fidelity of Implementation for Algebra I Drop-in Units: DEV11 (SLOPE); (6) Teacher-Level Participation in i3 SLOPE Evaluation (2011-2014); and (7) Findings from Evaluator Study of Implementation: Implementation Year 1.
Reviews of Individual Studies 8 -1
The Use of Structural Behavioral Assessment to Develop Interventions for Secondary Students Exhibiting Challenging Behaviors (2015)
Structural behavioral assessment (SBA) involves a series of heuristic approaches similar to those used with functional behavioral assessment (FBA). It involves assessing contextual variables that precede the occurrence of a behavior. These variables have also been termed antecedents, setting events, or establishing operations. Once these variables have been assessed, contextually based manipulations are developed and implemented, and interventions are developed from the results to reduce or prevent challenging behaviors from occurring. A major advantage of structural assessment is that teachers may find interventions based on the results easy to implement and relevant to the classroom. However, most of the research on SBA has been conducted with younger children with autism spectrum disorders, intellectual disabilities, and those with emotional or behavioral disorders (EBD). Therefore, the purpose of the present study is to extend the research by training a general education teacher to use SBA to develop interventions for secondary students displaying challenging behaviors who are at risk in general education classrooms. An alternating treatments design was used with four at-risk middle school students. Results indicated that a brief SBA can easily be conducted in general education classrooms, and interventions developed from manipulations can not only decrease (a) verbal outbursts (e.g., talking out of turn, arguing, laughing at inappropriate times); (b) inappropriate contact with others (e.g., touching, pushing, hitting, kicking, braiding hair); (c) taking other's belongings; (d) being out of the student's assigned seat without permission; and (e) passing notes but also increase writing and eyes on materials or eyes on the teacher during a language arts class. Implications for practice and future research are described.
Reviews of Individual Studies 9 -1
A report on the effects of the Pearson Literature Program on student language arts skills. (2015)
Reviews of Individual Studies 8 -1
Combined Years 2 (2012-13) and 3 (2013-14) secondary VISTA student level impact analysis: Secondary science SOL achievements with earlier science SOL covariates - Students nested within teachers [8th Grade]. (2015)
Reviews of Individual Studies 7-8 -1
U.S. Department of Education Grant Performance Report (ED-524B): CSR Colorado (2015)
Reviews of Individual Studies 9 -1
Intensive math instruction and educational attainment long-run impacts of double-dose algebra. (2015)
Reviews of Individual Studies 9-10 -1
Thinking, Fast and Slow? Some Field Experiments to Reduce Crime and Dropout in Chicago. NBER Working Paper 21178 (2015)
We present the results of three large-scale randomized controlled trials (RCTs) carried out in Chicago, testing interventions to reduce crime and dropout by changing the decision-making of economically disadvantaged youth. We study a program called Becoming a Man (BAM), developed by the non-profit Youth Guidance, in two RCTs implemented in 2009-10 and 2013-15. In the two studies participation in the program reduced total arrests during the intervention period by 28-35%, reduced violent-crime arrests by 45-50%, improved school engagement, and in the first study where we have follow-up data, increased graduation rates by 12-19%. The third RCT tested a program with partially overlapping components carried out in the Cook County Juvenile Temporary Detention Center (JTDC), which reduced readmission rates to the facility by 21%. These large behavioral responses combined with modest program costs imply benefit-cost ratios for these interventions from 5-to-1 up to 30-to-1 or more. Our data on mechanisms are not ideal, but we find no positive evidence that these effects are due to changes in emotional intelligence or social skills, self-control or "grit," or a generic mentoring effect. We find suggestive support for the hypothesis that the programs work by helping youth slow down and reflect on whether their automatic thoughts and behaviors are well suited to the situation they are in, or whether the situation could be construed differently. [A full list of sponsors of this project can be found on the NBER web site: http://www.nber.org/papers/w21178.ack.]
Reviews of Individual Studies 6-7 -1
Getting from here to there: Testing the effectiveness of an interactive mathematics intervention embedding perceptual learning. (2015)
Reviews of Individual Studies 6 -1
The impact of intensive reading intervention on level of attention in middle school students (2015)
Reviews of Individual Studies 6-12 -1
Case Management for Students at Risk of Dropping Out: Implementation and Interim Impact Findings from the Communities in Schools Evaluation (2015)
Too many students drop out and never earn their high school diploma. For students at risk of dropping out, academic, social, and other supports may help. "Communities In Schools" seeks to organize and provide these supports to at-risk students in the nation's poorest-performing schools, including through "case-managed" services. This report, the first of two from a random assignment evaluation of "Communities In Schools" case management, focuses primarily on the implementation of case management in 28 secondary schools during the 2012-2013 school year. The report also includes interim one-year findings about case management's impact on student outcomes. The report concludes with suggestions for improvement for "Communities In Schools" based mainly on the implementation findings. The next report will present two-year impact findings and more about the implementation of case management in the 2013-2014 school year. Appended to the report are: (1) Statistical Model and Statistical Power; and (2) Sample and Response Analysis.
Reviews of Individual Studies 6-8 -1
EngageME P.L.E.A.S.E impact study results [Middle school]. (2015)
Reviews of Individual Studies 6-8 -1
Schools to Watch: School Transformation Network, a U.S. Deparment of Education Investing in Innovation (i3) Development Grant. Final Evaluation Report (2015)
The Schools to Watch: School Transformation Network Project is a whole school reform model designed to improve the educational practices, experiences, and outcomes of low-performing middle-grades schools. Developed by the National Forum to Accelerate Middle-Grades Reform, the four-year project was funded in 2010 by a U.S. Department of Education Investing in Innovation (i3) development grant. The purpose of the study was to examine the impact of the project on intermediate outcomes such as culture, collaboration, and instructional practices as well as the long term outcome of student achievement. The study employed a quasi-experimental design where two student cohorts were tracked over four years at 34 schools (17 intervention and 17 comparison) in three states. The intervention schools were comprised of persistently low-performing middle-grades schools serving high need students. Comparison schools were selected using key demographics to match to intervention schools. Several process and measurement tools for assessing implementation and intermediate outcomes were used, including surveys, the STW criteria rating rubric, coach's logs, and focus groups. The long term outcome data for the impact study included student English and math achievement scores on annual standardized state assessments. To examine achievement scores between intervention and comparison students, a series of 2-level models (students within schools) were run to assess 8th grade achievement (i.e., after students received all three years of the intervention). Results showed that i3 STW Project schools improved their culture and climate, collaboration practices, leadership practices, STW criteria implementation, and classroom instructional practices. There was no overall intervention effect on either English or math student achievement, however, significant results were found for the highest implemented schools, those project schools that achieved STW designation during the project. The results of the study provide unique insight into the reform process for i3 STW Project schools as well as other middle-grades schools that are struggling to improve. The multiple supports provided by the project combined with the guiding vision of the STW criteria and rubric supported these high need schools to improve contextual factors (i.e., culture, collaboration, leadership, teaching and learning practices), and for a subsample of schools, student achievement. Districts and schools embarking on reform need to focus on collaborative leadership, have a guiding vision, use a continuous improvement model for instructional improvements, and value networking with other schools to gain knowledge. Two appendices are included: (1) Psychometric Properties of the Self-Study Survey Constructs; and (2) Fidelity Matrix for National Forum's STW School Transformation Network Project.
Reviews of Individual Studies 7-12 -1
Year 2 Findings for APTIP impacts on students’ AP performance in cohorts 1 and 2 schools. (2015)
Reviews of Individual Studies 3-5 -1
The Beaverton School District Arts for Learning (A4L) Lessons Project, an Investing in Innovation (i3) Development Grant: Student Impact Findings from Years 1, 2, and 3 (2015)
The purpose of this study was to assess the impact of the Arts for Learning (A4L) Lessons Project on the literacy and life skills of students in grades 3, 4, and 5. A4L Lessons is a supplementary literacy curriculum designed to blend the creativity and discipline of the arts with learning science to raise student achievement in reading and writing, as well as to develop literacy and life skills. A cluster-randomized trial was employed, randomly assigning 32 elementary schools in the Beaverton School District in Oregon to receive the A4L intervention or the status-quo control condition. Participants included approximately 5,700 students in the 16 intervention schools and approximately 6,100 students in the 16 control schools. Nearly 40% of the participants qualified for free/reduced-price lunch, approximately 17% were English language learners, and nearly 50% were racial/ethnic minorities. Achievement on the Oregon Assessment of Knowledge and Skills (OAKS) Reading/Literature test (i.e., the state reading test) were compared for the two groups. Achievement on the Comprehensive Cross Unit (CCU) Assessments (i.e., tests designed specifically to measure the impact of the A4L Lessons Project on literacy and life skills) were compared for a subset of six intervention and six control schools. Results from confirmatory analyses revealed no statistically significant impacts of the A4L Lessons Project on students' achievement on the OAKS Reading/Literature test. The effect sizes based on differences between the treatment and control students on the OAKS Reading/Literature test after one, two, and three years of program participation were very small, ranging from -0.03 to 0.05. Results from exploratory analyses revealed that treatment students in grade 4 scored significantly higher than control students on the CCU Assessment, indicating a positive impact of the A4L Lessons Project on student literacy and life skills. The effect sizes indexing the differences ranged from 0.30 to 0.36 across study years. Results from exploratory analyses using the CCU Assessments with students in grades 3 and 5 did not reach statistical significance, indicating that the A4L Lessons Project did not produce a positive impact on student literacy and life skills in these grades. Further research relying on more dependently sensitive assessments may be needed to better determine the impact of the A4L Lessons on students' literacy achievement. Tables are appended.
Reviews of Individual Studies 3-5 -1
Using a narrative-and play-based activity to promote low-income preschoolers’ oral language, emergent literacy, and social competence. (2015)
Reviews of Individual Studies 3-11 -1
The Data-Driven School Transformation Partnership: A project of the Bay State Reading Institute (BSRI) and 17 Massachusetts elementary schools. (2015)
Reviews of Individual Studies 4-5 -1
Efficacy of Rich Vocabulary Instruction in Fourth- and Fifth-Grade Classrooms (2015)
A multi-cohort cluster randomized trial was conducted to estimate effects of rich vocabulary classroom instruction on vocabulary and reading comprehension. A total of 1,232 fourth- and fifth-grade students from 61 classrooms in 24 schools completed the study. Students received instruction in 140 Tier Two vocabulary words featured in two grade-level novels. Teachers were randomly assigned to either rich vocabulary (treatment) or to business as usual (control). Teachers in the treatment condition allotted 30 minutes per day to the intervention for 14 weeks. Hierarchical linear modeling revealed positive, significant treatment effects on distal and proximal measures of vocabulary and comprehension. However, average distal treatment effects were small (approximate d =0.15) compared with proximal effects (approximate d = 1.24). Observations of teachers' language arts instruction indicated that treatment teachers spent significantly more time on vocabulary and less time on comprehension instruction than did teachers in the control condition. Results support the intensity and depth of the instruction for learning the taught corpus of words, and modest transfer to global vocabulary and comprehension.
Reviews of Individual Studies 4-10 -1
Final impact analysis report WriteUp! (Dev12-13). (2015)
Reviews of Individual Studies 5 -1
The effect of professional development on elementary teachers’ understanding and implementation of reforms-based science instruction. (2015)
Reviews of Individual Studies 5-7 -1
The Baltimore City Schools Middle School STEM Summer Program with VEX Robotics (2015)
In 2011 Baltimore City Schools submitted a successful proposal for an Investing in Innovations (i3) grant to offer a three year (2012-2014) summer program designed to expose rising sixth through eighth grade students to VEX robotics. The i3-funded Middle School Science, Technology, Engineering and Mathematics (STEM) Summer Learning Program was part of a larger Baltimore City STEM summer learning program entitled "Create the Solution" in 2012 and "22nd Century Pioneers" in 2013 and 2014. The five-week summer program offered in 2012, 2013, and 2014 consisted of a half-day of instruction in mathematics and science and a half-day of enrichment activities. The robotics workshop taught students the fundamentals of building robots and provided time for teams to build their own robots and participate in competitions. The larger program offered different enrichment activities such as sports or arts. This report addresses research questions regarding the program's: (1) implementation fidelity; (2) performance goals; (3) impact on student attendance and mathematics achievement outcomes; (4) impact on student aspirations for college, studying STEM subjects in college, and pursuing STEM careers; and (5) impact on measures of teacher effectiveness. The following includes a summary for each: (1) Implementation Fidelity: Instruction in mathematics and robotics was implemented with fidelity all three program years. Implementation fidelity was lower for the professional development in robotics and mathematics components of the program because teacher attendance rates did not meet the thresholds set by City Schools; (2) Enrollment Goals: Most program enrollment goals were not met. Enrollment in the i3-funded program was 193 students in 2012 (goal 400), 384 in 2013 (goal 500), and 386 in 2014 (goal 600). The program sought to enroll 80% low-performing students in mathematics each year, but fell significantly short of this goal despite the district's efforts to reach out to these students. In addition, the program goal of enrolling at least 50% female participants was not met. The program also sought to have at least 80% of students attend at least 70% of the time (17 of the 24 program days), but only 55% of students attended at that rate. The program did meet its goals for recruiting minority (at least 95%) and high poverty students (at least 80%) each year; (3) Program Impacts on Attendance: Found a significant program effect on attendance in the year following the 2012 program. Program students had average attendance rates of 1.4 percentage points higher than the comparison group the year following the program (97.0% vs. 95.6%). An even larger significant program effect for low-achieving students' attendance was found in the year following the 2012 program (96.4% vs. 93.8%). The 2013 program students had slightly but not significantly higher attendance rates than their matched comparison students in the year following the program. The authors also also examined whether there was still a program effect on attendance a year later (2013-14) for the Summer 2012 participants. Program participants had average attendance rates of 1.5 percentage points higher than comparison students (95.2% vs. 93.7%). Among the low-achieving students the attendance difference was 2.4 percentage points (93.6% for program students vs. 91.2% for comparison students). These effects were not statistically significant; (4) Program Impacts on Mathematics Achievement: There were no program effects on mathematics achievement for either the 2012 or 2013 programs; (5) Program Impacts on Student Aspirations: There was no evidence from student survey data that the robotics program had a positive effect on student aspirations to attend college, study STEM subjects in college, or pursue a STEM career for either the 2013 or 2014 programs; and (6) Program Impacts on Teacher Effectiveness: Analyses based on mean instructional effectiveness scores from Spring 2013 and Fall 2013 on the nine components of the district's teacher evaluation tool examined whether teachers who received the summer professional development in 2013 made gains in instructional effectiveness. The difference between program teachers' effectiveness scores before and after the professional development was not statistically significant. Data were not available to examine differences between program teachers and a comparable group of teachers who did not receive the summer professional development. The following are appended: (1) Implementation Fidelity; (2) Performance Goals; and (3) Methodology.
Reviews of Individual Studies 4-8 -1
Developing educators throughout their careers: Evaluation of the Rio Grande Valley Center for Teaching and Leading Excellence. (2015)
Reviews of Individual Studies 6 -1
Effects of Academic Vocabulary Instruction for Linguistically Diverse Adolescents: Evidence from a Randomized Field Trial (2014)
We conducted a randomized field trial to test an academic vocabulary intervention designed to bolster the language and literacy skills of linguistically diverse sixth-grade students (N = 2,082; n = 1,469 from a home where English is not the primary language), many demonstrating low achievement, enrolled in 14 urban middle schools. The 20-week classroom-based intervention improved students' vocabulary knowledge, morphological awareness skills, and comprehension of expository texts that included academic words taught, as well as their performance on a standardized measure of written language skills. The effects were generally larger for students whose primary home language is not English and for those students who began the intervention with underdeveloped vocabulary knowledge.
Reviews of Individual Studies 5-6 -1
Implicit Theories of Writing and Their Impact on Students&apos; Response to a SRSD Intervention (2014)
Background: In the field of intelligence research, it has been shown that some people conceive intelligence as a fixed trait that cannot be changed (entity beliefs), whereas others conceive it as a malleable trait that can be developed (incremental beliefs). What about writing? Do people hold similar implicit theories about the nature of their writing ability? Furthermore, are these beliefs likely to influence students' response to a writing intervention? Aims: We aimed to develop a scale to measure students' implicit theories of writing (pilot study) and to test whether these beliefs influence strategy-instruction effectiveness (intervention study). Sample: In the pilot and intervention studies participated, respectively, 128 and 192 students (Grades 5-6). Method: Based on existing instruments that measure self-theories of intelligence, we developed the Implicit Theories of Writing (ITW) scale that was tested with the pilot sample. In the intervention study, 109 students received planning instruction based on the self-regulated strategy development model, whereas 83 students received standard writing instruction. Students were evaluated before, in the middle, and after instruction. Results: ITW's validity was supported by piloting results and their successful cross-validation in the intervention study. In this, intervention students wrote longer and better texts than control students. Moreover, latent growth curve modelling showed that the more the intervention students conceived writing as a malleable skill, the more the quality of their texts improved. Conclusion: This research is of educational relevance because it provides a measure to evaluate students' implicit theories of writing and shows their impact on response to intervention.
Reviews of Individual Studies 4-5 -1
Comparison of the Effects of Computer-Based Practice and Conceptual Understanding Interventions on Mathematics Fact Retention and Generalization (2014)
The authors' purpose was to determine the effects of computer-based practice and conceptual interventions on computational fluency and word-problem solving of fourth- and fifth-grade students with mathematics difficulties. A randomized pretest-posttest control group design found that students assigned to the computer-based practice intervention group outperformed students in the comparison group on the retention measure. Students assigned to the conceptual intervention did not outperform the comparison group on any of the outcome variables. Implications for instruction and interventions are discussed.
Reviews of Individual Studies 4-5 -1
Comparison of the Effects of Computer-Based Practice and Conceptual Understanding Interventions on Mathematics Fact Retention and Generalization (2014)
The authors' purpose was to determine the effects of computer-based practice and conceptual interventions on computational fluency and word-problem solving of fourth- and fifth-grade students with mathematics difficulties. A randomized pretest-posttest control group design found that students assigned to the computer-based practice intervention group outperformed students in the comparison group on the retention measure. Students assigned to the conceptual intervention did not outperform the comparison group on any of the outcome variables. Implications for instruction and interventions are discussed.
Reviews of Individual Studies 4-5 -1
Comparison of the Effects of Computer-Based Practice and Conceptual Understanding Interventions on Mathematics Fact Retention and Generalization (2014)
The authors' purpose was to determine the effects of computer-based practice and conceptual interventions on computational fluency and word-problem solving of fourth- and fifth-grade students with mathematics difficulties. A randomized pretest-posttest control group design found that students assigned to the computer-based practice intervention group outperformed students in the comparison group on the retention measure. Students assigned to the conceptual intervention did not outperform the comparison group on any of the outcome variables. Implications for instruction and interventions are discussed.
Reviews of Individual Studies 4 -1
Does Working Memory Moderate the Effects of Fraction Intervention? An Aptitude-Treatment Interaction (2014)
This study investigated whether individual differences in working memory (WM) moderate effects of 2 variations of intervention designed to improve at-risk 4th graders' fraction knowledge. We also examined the effects of each intervention condition against a business-as-usual control group and assessed whether children's measurement interpretation of fractions mediated those effects. At-risk students (n = 243) were randomly assigned to control and 2 intervention conditions. The interventions each lasted 12 weeks, with three 30-min sessions per week. The major focus of both intervention conditions was the measurement interpretation of fractions. Across the 2 conditions, only 5 min of each 30-min session differed. One condition completed activities to build fluency with 4 measurement interpretation topics; in the other, activities were completed to consolidate understanding on the same 4 topics. Results revealed a significant aptitude-treatment interaction, in which students with very weak WM learned better with conceptual activities but children with more adequate (but still low) WM learned better with fluency activities. Both intervention conditions outperformed the control group on all outcomes, and improvement in the measurement interpretation of fractions mediated those effects.
Reviews of Individual Studies 3 -1
The Effects of Mathematics Strategy Instruction for Children with Serious Problem-Solving Difficulties (2014)
This study investigated the role of strategy instruction on solution accuracy in children with and without serious math difficulties (MD) in problem solving. Children's posttest solution accuracy was compared on standardized and experimental measures as a function of strategy conditions. Strategy conditions included curriculum materials that gradually increased the number of irrelevant propositions within word problems. Children in Grade 3 (N = 193) were randomly assigned to one of five conditions: materials + verbal strategies (e.g., underlining the question), materials + verbal + visual strategies, materials + visual strategies (e.g., correctly placing numbers in diagrams), materials only-no overt strategies, and an untreated control. Compared to children with MD in the control condition, posttest outcomes for children with MD on standardized measures improved significantly under verbal + visual conditions, whereas posttest scores on the experimental problem-solving measures improved under the materials-only condition. Those strategy conditions found least effective made substantial demands on children's working memory capacity. The authors discuss benefits and limitations of strategy instruction.
Reviews of Individual Studies 3 -1
The Effect of Explicit and Direct Generative Strategy Training and Working Memory on Word Problem-Solving Accuracy in Children at Risk for Math Difficulties (2014)
The purpose of this study was to investigate the effectiveness of explicit, direct, and generative strategy training and working memory capacity (WMC) on mathematical word problem-solving accuracy in elementary schoolchildren. In this study, children in third grade ("N" = 82) identified as at risk for math difficulties (MD) were randomly assigned (within classrooms) to one of three treatment conditions that explicitly directed students' attention to different propositions within word problems--paraphrase question propositions (Restate), paraphrase relevant propositions (Relevant), and paraphrase all propositions (Complete)--or an untreated control condition. A significant treatment by covariate design indicated that generative strategy outcomes were conditional on the level of pretest WMC. A clear advantage in posttest problem-solving accuracy and solution planning was found for the complete generative condition relative to the control condition, but this advantage was conditional on setting WMC to a high level. Although no significant treatment advantages were found for solution accuracy when WMC was set to a low level, treatment advantages relative to the control condition were found for measures of schema activation. The results indicated that the effectiveness of generative strategies among children at risk for MD was directly dependent on the level of WMC.
Reviews of Individual Studies 3 -1
The Effect of Explicit and Direct Generative Strategy Training and Working Memory on Word Problem-Solving Accuracy in Children at Risk for Math Difficulties (2014)
The purpose of this study was to investigate the effectiveness of explicit, direct, and generative strategy training and working memory capacity (WMC) on mathematical word problem-solving accuracy in elementary schoolchildren. In this study, children in third grade ("N" = 82) identified as at risk for math difficulties (MD) were randomly assigned (within classrooms) to one of three treatment conditions that explicitly directed students' attention to different propositions within word problems--paraphrase question propositions (Restate), paraphrase relevant propositions (Relevant), and paraphrase all propositions (Complete)--or an untreated control condition. A significant treatment by covariate design indicated that generative strategy outcomes were conditional on the level of pretest WMC. A clear advantage in posttest problem-solving accuracy and solution planning was found for the complete generative condition relative to the control condition, but this advantage was conditional on setting WMC to a high level. Although no significant treatment advantages were found for solution accuracy when WMC was set to a low level, treatment advantages relative to the control condition were found for measures of schema activation. The results indicated that the effectiveness of generative strategies among children at risk for MD was directly dependent on the level of WMC.
Reviews of Individual Studies 3-8 -1
A Randomized Controlled Trial Validating the Impact of the LASER Model of Science Education on Student Achievement and Teacher Instruction (2014)
Previous research has linked inquiry-based science instruction (i.e., science instruction that engages students in doing science rather than just learning about science) with greater gains in student learning than text-book based methods (Vanosdall, Klentschy, Hedges & Weisbaum, 2007; Banilower, 2007; Ferguson 2009; Bredderman, 1983; Shymansky, Hedges, & Woodworth, 1990). The LASER model, being validated in the current study, has already been the subject of a number of case studies (RMC Research Corporation, 2010; Horizon Research, 2010; Vanosdall et al., 2007). However, experimental studies of the type that might establish a causal link between program implementation, student science learning, and other valued outcomes have yet to be conducted. Only a handful of studies have involved random assignment, and most of these have involved random assignment of students in a relatively small number of classrooms (see Furtak et al. 2009). With support from the U.S. Department of Education's Investing in Innovation Fund (i3), the current validation study of the LASER Model encompasses approximately 60,000 students, 1,900 teachers, and over 140 district administrators and principals. The efficacy of the LASER program has important implications for both research and practice when working with high-poverty schools and districts, who have limited resources and time available for science interventions. LASER's initial success with early learners also demonstrates its potential for reducing the development of chronic, long-term deficiencies and academic problems. One table and one figure are appended.
Reviews of Individual Studies 7 -1
The Effects of Cognitive Strategy Instruction on Math Problem Solving of Middle-School Students of Varying Ability (2014)
The effects of a mathematical problem-solving intervention on students' problem-solving performance and math achievement were measured in a randomized control trial with 1,059 7th-grade students. The intervention, "Solve It!," is a research-based cognitive strategy instructional intervention that was shown to improve the problem-solving performance of 8th-grade students with and without learning disabilities (LD). The purpose of the present study was to determine whether the effectiveness of the intervention could be replicated with younger students. Forty middle schools in a large urban school district were included in the study, with one 7th-grade math teacher participating at each school (after attrition, n = 34). "Solve It!" was implemented by the teachers in their inclusive math classrooms. Problem-solving performance was assessed using curriculum-based math problem-solving measures, which were administered as a pretest and then monthly over the course of the 8-month intervention. Students who received the intervention (n = 644) embedded in the district curriculum showed a significantly greater rate of growth on the curriculum-based measures than students in the comparison group (n = 415) who received the district curriculum only. Results of the Bayesian analyses indicated that the intervention effect was somewhat stronger for low-achieving students than for average-achieving students. Overall, findings from the present study as well as the previous study with 8th-grade students indicate that the intervention was effective across ability groups and is an appropriate program to use in inclusive classrooms with students of varying math ability.
Reviews of Individual Studies 9-12 -1
Addendum to Effectiveness of Cognitive Tutor Algebra I at Scale. Working Paper WR-1050-DEIES (2014)
This addendum to previously published results presents alternative analyses of data from large-scale effectiveness studies of Cognitive Tutor Algebra I in middle schools and high schools. These alternative analyses produce results that are substantively the same as previously reported. We find a significant positive effect of 0.21 standard deviation units for high school students in the second year of the study. An appendix containing additional tables is included. [See the study: "Effectiveness of Cognitive Tutor Algebra I at Scale," "Educational Evaluation and Policy Analysis," v36 n2 p127-144 Jun 2014 at EJ1024233.]
Reviews of Individual Studies 9-10 -1
Blended learning report [Study 1]. (2014)
Reviews of Individual Studies 9 -1
The far-reaching effects of believing people can change: Implicit theories of personality shape stress, health, and achievement during adolescence. (2014)
Reviews of Individual Studies 9 -1
Effects of the Good Behavior Game on classwide off-task behavior in a high school basic algebra resource classroom (2014)
Reviews of Individual Studies 9 -1
A Peer-Led High School Transition Program Increases Graduation Rates among Latino Males (2014)
The authors investigated the impact of a manualized high school transition program, the Peer Group Connection (PGC) program, on the graduation rate at a low-income, Mid-Atlantic high school. The program utilized 12th-grade student peer leaders to create a supportive environment for incoming ninth-grade students. Results of a randomized control trial demonstrated that male students who participated in the program during Grade 9 were significantly more likely to graduate from high school within 4 years than male students in the control group (81% vs. 63%). Findings suggest that peers can be effective in delivering a school-based, social emotional learning intervention and that it is possible to intervene in Grade 9 to influence the probability of high school graduation.
Reviews of Individual Studies 8-12 -1
Effectiveness of Cognitive Tutor Algebra I at Scale (2014)
This article examines the effectiveness of a technology-based algebra curriculum in a wide variety of middle schools and high schools in seven states. Participating schools were matched into similar pairs and randomly assigned to either continue with the current algebra curriculum for 2 years or to adopt Cognitive Tutor Algebra I (CTAI), which uses a personalized, mastery-learning, blended-learning approach. Schools assigned to implement CTAI did so under conditions similar to schools that independently adopt it. Analysis of posttest outcomes on an algebra proficiency exam finds no effects in the first year of implementation, but finds evidence in support of positive effects in the second year. The estimated effect is statistically significant for high schools but not for middle schools; in both cases, the magnitude is sufficient to improve the median student's performance by approximately eight percentile points.
Reviews of Individual Studies 2-3 -1
Implementation of the Good Behavior Game in Classrooms for Children with Delinquent Behavior (2014)
Reviews of Individual Studies 2 -1
How does independent practice of multiple-criteria text influence the reading performance and development of second graders? Learning Disability Quarterly, 37(1), 3–14. (2014)
This study examined the impact of independent practice of multiple-criteria text that targeted high-frequency words, decodability, and meaningfulness. Second-grade students, including at-risk students, were randomly assigned within classroom to a treatment group that read multiple-criteria text ("n" = 34), or contrast group that read authentic literature (i.e., children's books without intentionally imbedded scaffolds; "n" = 28) during daily 30-min independent reading sessions for 10 weeks. Pre-post data analysis indicated no statistically significant group differences, though a moderate effect size of 0.67 was found for the word reading of developing decoders in the treatment group. HLM analyses also provided preliminary evidence that practice with multiple-criteria text may be more effective than practice with authentic literature for developing decoders but not advanced decoders.
Reviews of Individual Studies 2-5 -1
Effects of progress monitoring on math performance of at-risk students (Elementary school sample). (2014)
Reviews of Individual Studies 2-4 -1
Effects of the FITKids randomized controlled trial on executive control and brain function. (2014)
Reviews of Individual Studies 2-6 -1
The Effects of Function-Based Self-Management Interventions on Student Behavior (2014)
Children with emotional and behavioral disorders (E/BD) struggle to achieve social and academic outcomes. Many studies have demonstrated self-management interventions to be effective at reducing problem behavior and increasing positive social and academic behaviors. Functional behavior assessment (FBA) information may be used in designing effective self-management interventions. The purpose of this study was to link self-management procedures to hypothesized behavior function in three children with E/BD. Results demonstrated that self-monitoring (SM) alone could be enhanced using information derived from FBA and that consequences delivered by teachers were less effective than a self-management treatment package.
Reviews of Individual Studies 3 -1
Does Cognitive Strategy Training on Word Problems Compensate for Working Memory Capacity in Children with Math Difficulties? (2014)
Cognitive strategies are important tools for children with math difficulties (MD) in learning to solve word problems. The effectiveness of strategy training, however, depends on working memory capacity (WMC). Thus, children with MD but with relatively higher WMC are more likely to benefit from strategy training, whereas children with lower WMC may have their resources overtaxed. Children in Grade 3 (N = 147) were randomly assigned to 1 of 4 conditions: (a) verbal strategies (e.g., underlining question sentence), (b) visual strategies (e.g., correctly placing numbers in diagrams), (c) verbal plus visual strategies, or (d) an untreated control. In line with the predictions, children with MD and higher WMC benefited from verbal or visual strategies relative to those in the control condition on posttest measures of problem solving, calculation, and operation span. In contrast, cognitive strategies decreased problem-solving accuracy in children with low WMC. Thus, improvement in problem solving and related measures, as well as the impairment in learning outcomes, was moderated by WMC.
Reviews of Individual Studies 3 -1
Does Cognitive Strategy Training on Word Problems Compensate for Working Memory Capacity in Children with Math Difficulties? (2014)
Cognitive strategies are important tools for children with math difficulties (MD) in learning to solve word problems. The effectiveness of strategy training, however, depends on working memory capacity (WMC). Thus, children with MD but with relatively higher WMC are more likely to benefit from strategy training, whereas children with lower WMC may have their resources overtaxed. Children in Grade 3 (N = 147) were randomly assigned to 1 of 4 conditions: (a) verbal strategies (e.g., underlining question sentence), (b) visual strategies (e.g., correctly placing numbers in diagrams), (c) verbal plus visual strategies, or (d) an untreated control. In line with the predictions, children with MD and higher WMC benefited from verbal or visual strategies relative to those in the control condition on posttest measures of problem solving, calculation, and operation span. In contrast, cognitive strategies decreased problem-solving accuracy in children with low WMC. Thus, improvement in problem solving and related measures, as well as the impairment in learning outcomes, was moderated by WMC.
Reviews of Individual Studies 3 -1
Replicating the Effects of a Teacher-Scaffolded Voluntary Summer Reading Program: The Role of Poverty (2014)
A randomized trial involving 19 elementary schools (K-5) was conducted to replicate and extend two previous experimental studies of the effects of a voluntary summer reading program that provided (a) books matched to students' reading levels and interests and (b) teacher scaffolding in the form of end-of-year comprehension lessons. Matched schools were randomly assigned to implement one of two lesson types. Within schools, students were randomly assigned to a control condition or one of two treatment conditions: a basic treatment condition replicating procedures used in the previous studies or an enhanced treatment condition that added teacher calls in the summer. During summer vacation, students in the treatment conditions received two lesson books and eight books matched to their reading level and interests. Overall, there were no significant treatment effects, and treatment effects did not differ across lesson type. However, there was a significant interaction between the treatment conditions and poverty measured at the school level. The effects of the treatments were positive for high-poverty schools (Cohen's d = 0.08 and 0.11, respectively), defined as schools where 75-100% of the students were receiving free or reduced-price lunch (FRL). For moderate-poverty schools (45-74% FRL), the effects of the treatments were negative (Cohen's d = -0.11 and -0.12, respectively). The results underscore the importance of looking at patterns of treatment effects across different contexts, settings, and populations.
Reviews of Individual Studies K-8 -1
Comprehensive Educator Effectiveness Models That Work: Impact of the TAP System on Student Achievement in Louisiana (2014)
TAP™: The System for Teacher and Student Advancement was launched in 1999 as a comprehensive educator effectiveness model to offer career advancement and leadership opportunities for educators, a fair and transparent evaluation process linked to job-embedded professional development and performance-based compensation, which culminate in improved instructional practices and student achievement. This study illustrates the impact of the TAP System in 66 Louisiana schools. These are primarily high-need schools, with average free/reduced price lunch eligibility of 86%, impacting more than 32,000 students each year. The authors report evidence of a positive effect of the TAP System on student achievement using two complementary analysis strategies: (1) They found a significant positive effect of TAP on 2012-13 K-8 Assessment Index scores, controlling for previous achievement, percentage of students receiving free or reduced price lunch, school configuration, school size (number of students), and percentage of English language learners. The 66 TAP schools scored 3.7 points higher on average than non-TAP schools statewide; and (2) They also found that the TAP schools had significantly greater 2012-13 Assessment Index scores than a group of matched control schools. The TAP schools scored 5.5 points higher on average than their matched controls.
Reviews of Individual Studies K-2 -1
Evaluation of the Milwaukee Community Literacy Project/SPARK Program: Interim Findings from the Second Cohort. (2014)
Reviews of Individual Studies K-1 -1
Enhancing the Academic Development of Shy Children: A Test of the Efficacy of INSIGHTS (2014)
This study investigated the efficacy of the INSIGHTS into Children's Temperament intervention in supporting the academic development of shy kindergarten and first-grade children. INSIGHTS is a temperament-based intervention with teacher, parent, and classroom programs. The participants included 345 children from 22 low-income, urban elementary schools who were randomly assigned to INSIGHTS or a supplemental after-school reading program. Growth-curve modeling showed that shy children in INSIGHTS evidenced more rapid growth in critical thinking and math than their shy peers in the attention-control condition during kindergarten and the transition to first grade. The effects of INSIGHTS were partly indirect through improved behavioral engagement. INSIGHTS enhances the academic development of early elementary school children with shy temperaments.
Reviews of Individual Studies 9-12 -1
The impact of Early College High Schools on college readiness and college enrollment. (2013, May)
Reviews of Individual Studies K-2 -1
A (pan-Canadian) cluster randomized control effectiveness trial of the ABRACADABRA web-based literacy program. (2013)
This report describes a cluster randomized control trial (RCT) intervention study of the effectiveness of the ABRACADABRA (ABRA) Web-based literacy system using a classroom-level RCT intervention with 1,067 children in 74 kindergarten and Grade 1 or Grade 1/2 classrooms across Canada. The authors closely followed the CONSORT criteria for executing and reporting high-quality RCT studies. Well-trained teachers delivered the ABRA intervention to their regular classrooms for 20 hr per child over one full semester. At posttest, the ABRA intervention classroom showed significant advantages over controls in phonological blending ability, letter-sound knowledge and, marginally, for phoneme segmentation fluency. A secondary analysis exploring the effects of different levels of program implementation showed that with fidelity of implementation (80% of intervention teachers), advantages were evident at posttests in phonological blending, phoneme segmentation fluency, sight word reading, and letter-sound knowledge. It is concluded that ABRA is an effective resource for key skills associated with early reading. Implications for the role of both Web-based technologies and extended professional development for technology in aiding in the scale-up of evidence-based reading interventions are discussed. (Contains 2 figures and 5 tables.)
Reviews of Individual Studies K-8 -1
The Impact of Indiana's System of Interim Assessments on Mathematics and Reading Achievement (2013)
Interim assessments are increasingly common in U.S. schools. We use high-quality data from a large-scale school-level cluster randomized experiment to examine the impact of two well-known commercial interim assessment programs on mathematics and reading achievement in Indiana. Results indicate that the treatment effects are positive but not consistently significant. The treatment effects are smaller in lower grades (i.e., kindergarten to second grade) and larger in upper grades (i.e., third to eighth grade). Significant treatment effects are detected in Grades 3 to 8, especially in third- and fourth-grade reading and in fifth- and sixth-grade mathematics.
Reviews of Individual Studies PK-12 -1
Findings from a two-year examination of teacher engagement in TAP schools across Louisiana. (2013)
Reviews of Individual Studies 3 -1
Generative Strategies, Working Memory, and Word Problem Solving Accuracy in Children at Risk for Math Disabilities (2013)
This study investigated the role of generative strategies and working memory capacity on word problem solving accuracy in children with math difficulties (MD). Within classrooms, children in Grade 3 with MD ("n" = 69) were randomly assigned to one of three treatment conditions: paraphrase question propositions (Restate), paraphrase relevant propositions (Relevant), and paraphrase all propositions (Complete), or to an untreated control. An additional control group included children without MD ("n" = 22). Mixed regression modeling showed that generative strategies significantly improved posttest scores for children with MD compared with the control condition, but outcomes were related to the type of dependent measures. The Relevant and Complete treatment conditions improved problem-solving accuracy, the Complete condition improved problem component identification, and the Restate and Relevant conditions improved operation span performance when compared with the control conditions. Only the Relevant and Complete generative learning treatments allowed children with MD to catch up to children without MD, but the results were moderated by working memory capacity.
Reviews of Individual Studies 3 -1
Generative Strategies, Working Memory, and Word Problem Solving Accuracy in Children at Risk for Math Disabilities (2013)
This study investigated the role of generative strategies and working memory capacity on word problem solving accuracy in children with math difficulties (MD). Within classrooms, children in Grade 3 with MD ("n" = 69) were randomly assigned to one of three treatment conditions: paraphrase question propositions (Restate), paraphrase relevant propositions (Relevant), and paraphrase all propositions (Complete), or to an untreated control. An additional control group included children without MD ("n" = 22). Mixed regression modeling showed that generative strategies significantly improved posttest scores for children with MD compared with the control condition, but outcomes were related to the type of dependent measures. The Relevant and Complete treatment conditions improved problem-solving accuracy, the Complete condition improved problem component identification, and the Restate and Relevant conditions improved operation span performance when compared with the control conditions. Only the Relevant and Complete generative learning treatments allowed children with MD to catch up to children without MD, but the results were moderated by working memory capacity.
Reviews of Individual Studies 2-8 -1
Effects of Using a Web-Based Individualized Education Program Decision-Making Tutorial (2013)
This study explored the effects of a web-based decision support system ("Tutorial") for writing standards-based Individualized Education Programs (IEPs). A total of 35 teachers and 154 students participated across two academic years. Participants were assigned to one of three intervention groups based on level of "Tutorial" access: Full, Partial, or Comparison. Direct effects of the intervention on procedural and substantive elements of IEPs revealed that, although all groups had initial IEPs of similar quality, the Full Intervention group's post-"Tutorial" IEPs had a significantly higher proportion of substantive items rated as adequate than did the IEPs of other groups. The intervention's indirect effects were examined using student scores on the State Reading Assessment. The Full Intervention group demonstrated a higher rate of reading score gain than the other two groups during the academic year in which the IEP prepared with access to the "Tutorial" was implemented. Implications for educational practices and future research directions are discussed.
Reviews of Individual Studies 2-5 -1
Does the Responsive Classroom Approach Affect the Use of Standards-Based Mathematics Teaching Practices?: Results from a Randomized Controlled Trial (2013)
This study highlights the connections between two facets of teachers' skills--those supporting teachers' mathematical instructional interactions and those underlying social interactions within the classroom. The impact of the Responsive Classroom (RC) approach and use of RC practices on the use of standards-based mathematics teaching practices was investigated in third-grade classrooms. Eighty-eight third-grade teachers from 24 elementary schools in a large suburban district were selected from a sample of teachers participating in a larger randomized-control study. Results showed that teachers at schools assigned randomly to receive training in the RC approach showed higher use of standards-based mathematics teaching practices than teachers in control schools. These findings were supported by analyses using fidelity of implementation: greater adherence to the intervention predicted the use of more standards-based mathematics teaching practices. Findings support the use of the RC approach for creating classroom social environments that facilitate standards-based mathematical practices. (Contains 3 tables and 1 note.)
Reviews of Individual Studies 2-5 -1
Effectiveness of an Individualized Computer-Driven Online Math K-5 Course in Eight California Title I Elementary Schools (2013)
Stanford University's Education Program for Gifted Youth (EPGY) conducted a randomized-treatment experiment during the 2006-2007 school year to test the efficacy, for Title I students, of the technological and individualized EPGY Kindergarten through Grade 5 Mathematics Course Sequence, modified for the Title I schools. Restricting attention to students who were in the top half of the distribution of correct first-exercise attempts (a measure of work and engagement), we found substantial and statistically significant improvements in the 2007 California Standard Math Tests (CST07) scores compared to those of matched control students. Gains in second grade were larger than those in Grades 3 to 5. Less able students, as measured by their 2006 CST mathematics scores, also had, on average, larger gains.
Reviews of Individual Studies 12 -1
Late interventions matter too: The case of college coaching in New Hampshire (NBER Working Paper 19031). (2013)
Reviews of Individual Studies 1-3 -1
Assessing the Effectiveness of First Step to Success: Are Short-Term Results the First Step to Long-Term Behavioral Improvements? (2013)
This article reports on the effectiveness of First Step to Success, a secondary-level intervention appropriate for students in early elementary school who experience moderate to severe behavior problems and are at risk for academic failure. The authors demonstrate the intervention's short-term effects on multiple behavioral and academic outcomes as delivered off-the-shelf in a variety of classrooms and schools across the country--effects that were mitigated by fidelity of implementation. Furthermore, the authors assess the body of evidence on First Step to Success against the standards for effectiveness and widespread dissemination promulgated by the Society for Prevention Research, thereby suggesting directions for further research. (Contains 2 tables and 1 figure.)
Reviews of Individual Studies 1-3 -1
The Effect of the Extinction Procedure in Function-Based Intervention (2013)
In this study, we examined the contribution of the extinction procedure in function-based interventions implemented in the general education classrooms of three at-risk elementary-aged students. Function-based interventions included antecedent adjustments, reinforcement procedures, and function-matched extinction procedures. Using a combined ABC and reversal phase design (A-B-A-B-C-B), a functional relation between the full intervention and dramatically improved levels of on-task behavior were clearly established. On removal of the extinction procedure, on-task behavior rapidly dropped to lower levels. Reinstatement of the full intervention occurred following the partial intervention condition. In every case, on-task levels rapidly improved. Using the "Intervention Rating Profile-15" and "Children's Intervention Rating Profile," acceptability ratings were highest for full intervention. Limitations and implications for further research are presented. (Contains 3 figures and 3 tables.)
Reviews of Individual Studies 1-3 -1
A Written Language Intervention for At-Risk Second Grade Students: A Randomized Controlled Trial of the Process Assessment of the Learner Lesson Plans in a Tier 2 Response-to-Intervention (RtI) Model (2013)
In a randomized controlled trial, 205 students were followed from grades 1 to 3 with a focus on changes in their writing trajectories following an evidence-based intervention during the spring of second grade. Students were identified as being at-risk (n = 138), and then randomized into treatment (n = 68) versus business-as-usual conditions (n = 70). A typical group also was included (n = 67). The writing intervention comprised Lesson Sets 4 and 7 from the Process Assessment of the Learner (PAL), and was conducted via small groups (three to six students) twice a week for 12 weeks in accordance with a response-to-intervention Tier 2 model. The primary outcome was the Wechsler Individual Achievement Test-II Written Expression Scale. Results indicated modest support for the PAL lesson plans, with an accelerated rate of growth in writing skills following treatment. There were no significant moderator effects, although there was evidence that the most globally impaired students demonstrated a more rapid rate of growth following treatment. These findings suggest the need for ongoing examination of evidence-based treatments in writing for young elementary students.
Reviews of Individual Studies 1 -1
Efficacy of a first-grade responsiveness-to-intervention prevention model for struggling readers. (2013)
This randomized control trial examined the efficacy of a multitiered supplemental tutoring program within a first-grade responsiveness-to-intervention prevention model. Struggling first-grade readers (n = 649) were screened and progress monitored at the start of the school year. Those identified as unresponsive to general education Tier 1 (n = 212) were randomly assigned to receive Tier 2 small-group supplemental tutoring (n = 134) or to continue in Tier 1 (n = 78). Progress-monitoring data were used to identify nonresponders to Tier 2 (n = 45), who were then randomly assigned to more Tier 2 tutoring (n = 21) or one-on-one Tier 3 tutoring (n = 24). Tutoring in Tier 3 was the same as in Tier 2 except for the delivery format and frequency of instruction. Results from a latent change analysis indicated nonresponders to Tier 1 who received supplemental tutoring made significantly higher word reading gains compared with controls who received reading instruction only in Tier 1 (effect size = 0.19). However, no differences were detected between nonresponders to Tier 2 who were assigned to Tier 3 versus more Tier 2. This suggests more frequent 1:1 delivery of a Tier 2 standard tutoring program may be insufficient for intensifying intervention at Tier 3. Although supplemental tutoring was effective in bolstering reading performance of Tier 1 nonresponders, only 40% of all Tier 2 students and 53% of Tier 2 responders were reading in the normal range by grade 3. Results challenge the preventive intent of short-term, standard protocol, multitiered supplemental tutoring models. (Contains 2 figures and 7 tables.)
Reviews of Individual Studies 8 -1
Effectiveness of Cognitive Tutor Algebra I at scale [Middle school] (2013)
Reviews of Individual Studies 7-8 -1
The impact of eMINTS professional development on teacher instruction and student achievement: Year 1 report. (2013)
Reviews of Individual Studies 9 -1
The Effect of Read 180 on the Reading Achievement of Struggling Readers in a Large, Public, Urban High School in Northern New Jersey (2013)
This action research study examined the effect of Read 180, a research-based reading intervention program, on the reading achievement among struggling readers in Grades 9-11 as measured by reading clusters on the Language Arts Literacy portion of the High School Proficiency Assessment, final English grades, and Lexile scores. Struggling readers entering high school often fail to meet stringent literacy demands because they lack mastery of the five main components of effective reading. Although many reading intervention programs exist at the elementary level, few are available in high schools; however, increased pressure for improved student performance on state assessments has caused school districts to explore various programs at the high school level. This study contributes to the literature on such programs by investigating the effects of Read 180 on students' reading achievement. The final grades and assessment scores of three cohorts of ninth-grade students (2007-2008, 2008-2009, and 2009-2010; N = 134) were examined in a matched-pair design, matching students in Read 180 (treatment group) with students in the traditional English 9 course (control group). The scores of the Language Arts Literacy portion of the eighth-grade state assessment determined students' placement. Analyses of variance indicated Read 180 participants significantly outperformed nonparticipants on final English 9 grades. Additionally, a t test indicated Read 180 participants from the 2009-2010 cohort significantly increased their reading achievement according to Lexile scores. Significant results occurred during the school year students participated in Read 180. No other statistically significant differences on the reading achievement between the two groups were evident after students exited Read 180. [The dissertation citations contained here are published with the permission of ProQuest LLC. Further reproduction is prohibited without permission. Copies of dissertations may be obtained by Telephone (800) 1-800-521-0600. Web page: http://www.proquest.com/en-US/products/dissertations/individuals.shtml.]
Reviews of Individual Studies 9-12 -1
Effectiveness of Cognitive Tutor Algebra I at scale [High school] (2013)
Reviews of Individual Studies 7-10 -1
Preventing Youth Violence and Dropout: A Randomized Field Experiment. NBER Working Paper No. 19014 (2013)
Improving the long-term life outcomes of disadvantaged youth remains a top policy priority in the United States, although identifying successful interventions for adolescents--particularly males--has proven challenging. This paper reports results from a large randomized controlled trial of an intervention for disadvantaged male youth grades 7-10 from high-crime Chicago neighborhoods. The intervention was delivered by two local non-profits and included regular interactions with a pro-social adult, after-school programming, and--perhaps the most novel ingredient--in-school programming designed to reduce common judgment and decision-making problems related to automatic behavior and biased beliefs, or what psychologists call cognitive behavioral therapy (CBT). We randomly assigned 2,740 youth to programming or to a control group; about half those offered programming participated, with the average participant attending 13 sessions. Program participation reduced violent-crime arrests during the program year by 8.1 per 100 youth (a 44 percent reduction). It also generated sustained gains in schooling outcomes equal to 0.14 standard deviations during the program year and 0.19 standard deviations during the follow-up year, which we estimate could lead to higher graduation rates of 3-10 percentage points (7-22 percent). Depending on how one monetizes the social costs of crime, the benefit-cost ratio may be as high as 30:1 from reductions in criminal activity alone. [A full list of sponsors of this project can be found on NBER's web site: http://www.nber.org/papers/w19014.ack.]
Reviews of Individual Studies 6 -1
The impact of a technology-based mathematics after-school program using ALEKS on student’s knowledge and behaviors. (2013)
Reviews of Individual Studies 3-8 -1
Using Social-Emotional and Character Development to Improve Academic Outcomes: A Matched-Pair, Cluster-Randomized Controlled Trial in Low-Income, Urban Schools (2013)
Background: School-based social-emotional and character development (SECD) programs can influence not only SECD but also academic-related outcomes. This study evaluated the impact of one SECD program, Positive Action (PA), on educational outcomes among low-income, urban youth. Methods: The longitudinal study used a matched-pair, cluster-randomized controlled design. Student-reported disaffection with learning and academic grades, and teacher ratings of academic ability and motivation were assessed for a cohort followed from grades 3 to 8. Aggregate school records were used to assess standardized test performance (for entire school, cohort, and demographic subgroups) and absenteeism (entire school). Multilevel growth-curve analyses tested program effects. Results: PA significantly improved growth in academic motivation and mitigated disaffection with learning. There was a positive impact of PA on absenteeism and marginally significant impact on math performance of all students. There were favorable program effects on reading for African American boys and cohort students transitioning between grades 7 and 8, and on math for girls and low-income students. Conclusions: A school-based SECD program was found to influence academic outcomes among students living in low-income, urban communities. Future research should examine mechanisms by which changes in SECD influence changes in academic outcomes.
Reviews of Individual Studies 3-12 -1
Functional Communication Training without Extinction Using Concurrent Schedules of Differing Magnitudes of Reinforcement in Classrooms (2012)
This study investigated the effects of functional communication training (FCT) implemented with concurrent schedules of differing magnitudes of reinforcement in lieu of extinction to reduce inappropriate behaviors and increase alternative mands. Participants were four adolescent students diagnosed with severe emotional and behavior disorders (SEBD), and mild to severe intellectual disabilities. Functional analyses revealed inappropriate behaviors as escape maintained. During subsequent FCT, the reinforcement provided for inappropriate behaviors was escape from task for 30 s (S[superscript R-]). The reinforcement for the alternative mand was a 30-s escape from task during which access to a preferred activity was provided (S[superscript R-]/PA). Results for three of the participants who had mild to moderate intellectual disabilities were highly successful. Time on task and generalization data also were recorded for two of the participants All sessions were implemented in the participants' natural classrooms by their classroom teachers, without the adverse side effects of extinction. (Contains 2 figures.)
Reviews of Individual Studies 4 -1
Reading Interventions with Varying Instructional Emphases for Fourth Graders with Reading Difficulties (2012)
This study investigated the relative effects of three treatments with varying instructional emphases in reading with a comparison condition. Eighty-seven students in fourth grade with reading impairments were assigned through stratified random assignment to one of four conditions: (a) comprehension emphasis, (b) word study emphasis, (c) emphasis of either comprehension or word study based on the student's pretest reading profile, or (d) school-provided intervention comparison condition. Students in the three researcher-provided treatments received intervention in small groups with a trained tutor for 30 min daily for approximately 28 weeks. Results revealed no statistically significant main effects between conditions on measures of word reading, fluency, vocabulary, or comprehension. Students with limited English proficiency performed significantly better at posttest in all conditions than other students. Discussion addresses the challenges of successfully remediating reading problems with older students with significant reading problems. (Contains 3 tables.)
Reviews of Individual Studies 4 -1
Reading Interventions with Varying Instructional Emphases for Fourth Graders with Reading Difficulties (2012)
This study investigated the relative effects of three treatments with varying instructional emphases in reading with a comparison condition. Eighty-seven students in fourth grade with reading impairments were assigned through stratified random assignment to one of four conditions: (a) comprehension emphasis, (b) word study emphasis, (c) emphasis of either comprehension or word study based on the student's pretest reading profile, or (d) school-provided intervention comparison condition. Students in the three researcher-provided treatments received intervention in small groups with a trained tutor for 30 min daily for approximately 28 weeks. Results revealed no statistically significant main effects between conditions on measures of word reading, fluency, vocabulary, or comprehension. Students with limited English proficiency performed significantly better at posttest in all conditions than other students. Discussion addresses the challenges of successfully remediating reading problems with older students with significant reading problems. (Contains 3 tables.)
Reviews of Individual Studies 4 -1
Reading Interventions with Varying Instructional Emphases for Fourth Graders with Reading Difficulties (2012)
This study investigated the relative effects of three treatments with varying instructional emphases in reading with a comparison condition. Eighty-seven students in fourth grade with reading impairments were assigned through stratified random assignment to one of four conditions: (a) comprehension emphasis, (b) word study emphasis, (c) emphasis of either comprehension or word study based on the student's pretest reading profile, or (d) school-provided intervention comparison condition. Students in the three researcher-provided treatments received intervention in small groups with a trained tutor for 30 min daily for approximately 28 weeks. Results revealed no statistically significant main effects between conditions on measures of word reading, fluency, vocabulary, or comprehension. Students with limited English proficiency performed significantly better at posttest in all conditions than other students. Discussion addresses the challenges of successfully remediating reading problems with older students with significant reading problems. (Contains 3 tables.)
Reviews of Individual Studies 4 -1
Training a General Educator to Use Function-Based Support for Students at Risk for Behavior Disorders (2012)
Function-based support (FBS) is an intervention strategy for decreasing problem behaviors and increasing replacement behaviors through the use of functional behavioral assessment and behavior support planning. Although FBS has been demonstrated to facilitate positive outcomes for children in a variety of educational settings, it has yet to be widely adopted because many schools have limited access to personnel (i.e., school psychologist, behavior specialist) with the expertise to implement it. This series of single-subject studies reports the ongoing development and validation of a method for training general educators to successfully and independently implement FBS for at-risk students in their classrooms. These studies highlight the experiences of one teacher who participated in three training phases and implemented FBS with three at-risk students. Results suggest that training was effective as indicated by knowledge gains regarding FBS principles and procedures, successful mastery and application of FBS practices, positive student outcomes, and favorable teacher and student perceptions of social validity. The implications and limitations of these results, as well as future directions for this line of research, are also discussed. (Contains 3 tables and 4 figures.)
Reviews of Individual Studies 4-5 -1
Findings from a Randomized Experiment of Playworks: Selected Results from Cohort 1 (2012)
Recess periods often lack the structure needed to support physical activity and positive social development (Robert Wood Johnson Foundation 2010). The Playworks program places full-time coaches in low-income schools to provide opportunities for organized play during recess and throughout the school day. Playworks activities are designed to engage students in physical activity, foster social skills related to cooperation and conflict resolution, improve students' ability to focus on class work, decrease behavioral problems and improve school climate. The Robert Wood Johnson Foundation (RWJF) contracted with Mathematica Policy Research and its subcontractor, the John W. Gardner Center for Youth and Their Communities (JGC) at Stanford University, to conduct a rigorous evaluation of Playworks. Twenty-five schools interested in implementing Playworks were randomly assigned to a treatment group that received Playworks in the 2010-2011 school year or to a control group that was not eligible to implement Playworks until the following year. The authors collected data from students, teachers and school staff in spring 2011 to document the implementation of Playworks and assess the impact of the program on key outcomes in six domains: (1) school climate, (2) conflict resolution and aggression, (3) learning and academic performance, (4) recess experience, (5) youth development and (6) student behavior. Ultimately, four additional schools will be added to the study and further analyses will be released. A description of study design and data sources. (Contains 4 exhibits, 15 tables and 2 endnotes.)
Reviews of Individual Studies 4-5 -1
Reducing Developmental Risk for Emotional/Behavioral Problems: A Randomized Controlled Trial Examining the Tools for Getting Along Curriculum (2012)
Researchers have demonstrated that cognitive-behavioral intervention strategies--such as social problem solving--provided in school settings can help ameliorate the developmental risk for emotional and behavioral difficulties. In this study, we report the results of a randomized controlled trial of Tools for Getting Along (TFGA), a social problem-solving universally delivered curriculum designed to reduce the developmental risk for serious emotional or behavioral problems among upper elementary grade students. We analyzed pre-intervention and post-intervention teacher-report and student self-report data from 14 schools, 87 classrooms, and a total of 1296 students using multilevel modeling. Results (effect sizes calculated using Hedges' g) indicated that students who were taught TFGA had a more positive approach to problem solving (g = 0.11) and a more rational problem-solving style (g = 0.16). Treated students with relatively poor baseline scores benefited from TFGA on (a) problem-solving knowledge (g = 1.54); (b) teacher-rated executive functioning (g = 0.35 for Behavior Regulation and 0.32 for Metacognition), and proactive aggression (g = 0.20); and (c) self-reported trait anger (g = 0.17) and anger expression (g = 0.21). Thus, TFGA may reduce risk for emotional and behavioral difficulties by improving students' cognitive and emotional self-regulation and increasing their pro-social choices. (Contains 4 tables.)
Reviews of Individual Studies 6-12 -1
Enhancing the Interpretive Reading and Analytical Writing of Mainstreamed English Learners in Secondary School: Results from a Randomized Field Trial Using a Cognitive Strategies Approach (2012)
In this study, 72 secondary English teachers from the Santa Ana Unified School District were randomly assigned to participate in the Pathway Project, a cognitive strategies approach to teaching interpretive reading and analytical writing, or to a control condition involving typical district training focusing on teaching content from the textbook. Pathway teachers learned how to use an on-demand writing assessment to help mainstreamed English learners understand, interpret, and write analytical essays. In Year 2, treatment effects were replicated on an on-demand writing assessment (d = 0.67) and showed evidence of transfer to improved performance on a standardized writing test (d = 0.10). The results underscore the efficacy of a cognitive strategies reading/writing intervention for mainstreamed English learners (ELs) in the secondary grades. (Contains 1 note, 4 tables, and 3 figures.)
Reviews of Individual Studies 6-8 -1
A Randomized Trial of Motivational Interviewing to Improve Middle School Students' Academic Performance (2012)
Motivational interviewing (MI) is an effective method of promoting change in adults, but research on adolescents is limited. This study tests the efficacy of MI for promoting academic achievement in middle school students. Participants were 103 6th-, 7th-, and 8th-grade students randomly assigned to either a MI (n = 50) or a waitlist control condition (n = 53). Students in the MI condition participated in a single MI session during the 7th or 8th week of the second semester. In comparison to the control group, students who received MI demonstrated significant improvements in their class participation, overall positive academic behavior, and significantly higher 4th quarter math grades. Thus, consistent with other studies finding single session effects of MI, a single MI session can have beneficial effects on academic behaviors. Pending further study and replication of these findings, MI could become an efficient and effective new counseling approach for improving academic performance. (Contains 2 tables.)
Reviews of Individual Studies 6-10 -1
The effects of synchronous online cognitive strategy instruction in writing for students with learning disabilities (Doctoral dissertation) (2012)
Reviews of Individual Studies 7-12 -1
Charter-School Management Organizations: Diverse Strategies and Diverse Student Impacts. Updated Edition (2012)
Charter schools--public schools of choice that are operated autonomously, outside the direct control of local school districts--have become more prevalent over the past two decades. There is no consensus about whether, on average, charter schools are doing better or worse than conventional public schools at promoting the achievement of their students. Nonetheless, one research finding is clear: Effects vary widely among different charter schools. Many educators, policymakers, and funders are interested in ways to identify and replicate successful charter schools and help other public schools adopt effective charter school practices. Charter-school management organizations (CMOs), which establish and operate multiple charter schools, represent one prominent attempt to bring high performance to scale. The National Study of CMO Effectiveness aims to fill the gap in systematic evidence about CMOs, providing the first rigorous nationwide examination of CMOs' effects on students' achievement and attainment. The study includes an examination of the relationships between the practices of individual CMOs and their effects on student achievement, with the aim of providing useful guidance to the field. This updated edition of the report provides key findings from the study on CMO practices, impacts, and the relationships between them. A forthcoming report will explore promising practices in greater depth. This study uses multiple data sources to describe CMOs, assess their impacts on students, and identify practices associated with positive impacts in order to address the following research questions: (1) How quickly are CMOs growing? Which students and areas do they serve and what resources do they use? What are the practices and structures of CMOs? What state policies and other factors appear to influence the location and growth of CMOs?; (2) What are the impacts of CMOs on student outcomes and to what extent do these impacts vary across CMOs?; and (3) Which CMO practices and structures are positively associated with impacts? To examine eligible CMOs and address the research questions, the authors conducted a survey of CMO central office staff, surveys of CMO principals and principals in nearby conventional public schools, a survey of CMO teachers, and site visits to 10 CMOs and 20 schools. In addition, they collected and analyzed school records with data on student characteristics and outcomes (including test scores), and they examined CMO financial records and business plans. Findings include: (1) Comprehensive behavior policies are positively associated with student impacts; (2) Intensive teacher coaching is positively associated with student impacts; (3) CMOs using TFA and teaching fellow teachers have higher impacts, but other staffing decisions are not associated with impacts; (4) CMOs categorized as "data-driven" and "time on task" have larger impacts, on average, than two other categories of CMOs; and (5) Tightness of CMO management is weakly associated with impacts. As is often the case in studies of this kind, some of the interesting findings raise other important questions. The following questions are discussed in this report: (1) To what extent do CMOs produce positive effects on longer term student outcomes?; (2) What explains why some CMOs have negative impacts on test scores?; (3) Which promising strategies should CMOs implement and how should they implement them?; (5) To what extent do CMOs add value compared to independent charter schools?; (6) Are new CMOs using the same strategies and producing the same impacts as more established CMOs?; and (7) What other factors might contribute to CMO impacts? Appended are: (1) Construction and Analysis of Measures Used in Chapter III; (2) Experimental Impacts; (3) Validation of Impact Estimation Approach; (4) Methodology for Estimating CMO and School- Level Impacts on Achievement in Middle- Schools; (5) Baseline Equivalence; (6) Method for Dealing with Grade Repetition; (7) Methodology and Results for CMO Impacts on High School Achievement and Attainment; (8) Impacts on Middle School Test Scores by CMO, Year, and Subject; (9) Comparing CMO and Independent Charter Impacts; (10) Subgroup Impacts; (11) Multiple Comparison Adjustments for Impact Analyses; (12) Methods for Correlating Impacts and CMO Characteristics; and (13) Correlational Analysis Results. Individual chapters contain footnotes. (Contains 56 tables and 49 figures.) [This document was commissioned by NewSchools Venture Fund and written with assistance from Michael Barna, Emily Caffery, Hanley Chiang, John Deke, Melissa Dugger, Emma Ernst, Alena Davidoff-Gore, Eric Grau, Thomas Decker, Mason DeCamillis, Philip Gleason, Amanda Hakanson, Jane Nelson, Antoniya Owens, Julie Redline, Davin Reed, Chris Rodger, Margaret Sullivan, Christina Tuttle, Justin Vigeant, Tiffany Waits, and Clare Wolfendale. For an earlier edition of this report, "The National Study of Charter Management Organization (CMO) Effectiveness. Charter-School Management Organizations: Diverse Strategies and Diverse Student Impacts," see ED526951.]
Reviews of Individual Studies 7-8 -1
Evaluation Report/Impact Study: Virginia Striving Readers Intervention Initiative (VSRII) (2012)
By the end of school year (SY) 2008-2009, Virginia Department of Education (VDOE) applied for and was awarded a four-year Striving Readers grant to implement the "Virginia Striving Readers Intervention Initiative" (VSRII). VSRII proposed to implement a supplemental reading intervention with students in seventh and eighth grades at nine public schools in three school divisions in Virginia. The school division representatives chose to implement "Passport Reading Journeys (PRJ)," an intervention that was already in use in many Virginian schools. "PRJ" had been studied previously in other school districts using quasi-experimental designs, but had not been tested with an experimental study. A total of 913 students were eligible to participate. This report presents provisional findings from the first implementation year of VSRII (SY 2010-2011) and its preliminary impact on participating students. [Written with Kristina Najera, Laura Taylor, and Trina Willard.]
Reviews of Individual Studies 6-8 -1
Washington Striving Readers: Year 1 evaluation report. (2012)
In 2009, the United States Department of Education conducted a competition for a second round of Striving Readers grants. Its dual purpose was to: (1) Raise middle and high school students' literacy levels in Title I-eligible schools with significant numbers of students reading below grade level; and (2) Build a strong, scientific research base for identifying and replicating strategies that improve adolescent literacy skills through a required experimental study design. The Office of Superintendent of Public Instruction (OSPI), Washington's state education agency, joined together with evaluators at Education Northwest to submit a proposal for the competition. Washington state was one of just eight states to be awarded Striving Readers grants in the second round. The grant originally included a planning year, followed by three years of implementation in selected schools. However, Congress eliminated the funding for the program in spring 2011, three-quarters of the way through the first year of implementation. Existing funding was sufficient to complete the first year of program implementation and data collection, but the second and third years of implementation did not take place. Therefore, this Year 1 evaluation report is the only report about the program's implementation and outcomes. Five schools from three districts in Western Washington participated in Washington Striving Readers. Across the five schools, a total of 176 students participated in the treatment condition and 182 students were in the control condition. The program offered 70 hours of professional development for teachers, and all teachers participated in at least 90 percent of these offerings. All teachers also received the intended amount of in-class support, defined as at least 12 visits from a project coach with each visit lasting at least one hour. The study examined four aspects of program implementation: teachers' receipt of the intended professional development, their receipt of in-class coaching, their delivery of the programs as intended, and the completion of all the lessons that were supposed to be covered. Researchers used three different assessments to measure impact: (1) "Gates-MacGinitie Reading Test"; (2) two subtests from the "Woodcock Reading Mastery" assessment--the word attack and word identification subtests; and (3) scores from the "Measure of Student Progress" ("MSP"). Researchers examined the overall impact of Washington Striving Readers using a fixed effects regression model that accounted for the random assignment of students within schools and groups. The findings demonstrated that it is possible to make a statistically significant difference in struggling students' overall literacy achievement in the course of one school year. Students in the Washington Striving Readers intervention performed better on the state reading assessment than did students in the control condition, who did not receive any supplemental reading support. The following are appended: (1) Washington Striving Readers Implementation Measures; (2) Baseline Equivalence of Treatment and Control Groups; and (3) Detailed Regression Analysis Results.
Reviews of Individual Studies 7 -1
An evaluation of the third edition of the University of Chicago School Mathematics Project Transition Mathematics (2012)
Reviews of Individual Studies 7 -1
Report of intent to treat estimates of program impacts on student achievement: New York State English Language Arts Examination. (2012)
Reviews of Individual Studies 9 -1
Year One Evaluation Report/Impact Study: Illinois Striving Readers (2012)
The Illinois Striving Readers (ISR) Project had two purposes: (1) implement a supplemental reading intervention for students in ninth grade who were reading below grade level; and (2) study the impact of the intervention on students' performance on standardized assessments using a randomized control trial design. The Illinois Striving Readers (ISR) project focused on ninth grade students who scored at the bottom two quartiles on the state assessment (grade 8 EXPLORE®). A total of 855 students participated in the project. Of these, 427 students were randomly assigned to the treatment group, with 428 students going to the control group. This report presents findings from the first year of implementation of the Illinois Striving Readers. The report is divided into three parts: (1) describes the intervention as proposed by the developers and the project's logic model; (2) discusses findings from the first implementation year; and (3) presents the analysis of the intervention's impact on student academic performance, as measured by standardized assessments.
Reviews of Individual Studies 9 -1
Year One Evaluation Report/Impact Study: Illinois Striving Readers (2012)
The Illinois Striving Readers (ISR) Project had two purposes: (1) implement a supplemental reading intervention for students in ninth grade who were reading below grade level; and (2) study the impact of the intervention on students' performance on standardized assessments using a randomized control trial design. The Illinois Striving Readers (ISR) project focused on ninth grade students who scored at the bottom two quartiles on the state assessment (grade 8 EXPLORE®). A total of 855 students participated in the project. Of these, 427 students were randomly assigned to the treatment group, with 428 students going to the control group. This report presents findings from the first year of implementation of the Illinois Striving Readers. The report is divided into three parts: (1) describes the intervention as proposed by the developers and the project's logic model; (2) discusses findings from the first implementation year; and (3) presents the analysis of the intervention's impact on student academic performance, as measured by standardized assessments.
Reviews of Individual Studies 8 -1
Effects of Making Sense of SCIENCE[TM] Professional Development on the Achievement of Middle School Students, Including English Language Learners. Final Report. NCEE 2012-4002 (2012)
This study evaluated an approach to professional development for middle school science teachers by closely examining one grade 8 course that embodies that approach. Using a cluster-randomized experimental design, the study tested the effectiveness of the Making Sense of SCIENCE[TM] professional development course on force and motion (Daehler, Shinohara, and Folsom 2011) by comparing outcomes for students of teachers who took the course with outcomes for students of control group of teachers who received only the typical professional development offered in their schools and districts. The study estimated impacts on student science achievement for all grade 8 students in the study sample as well as for the subsample of English language learners. It also estimated impacts on teacher science and pedagogical knowledge. Results for the primary confirmatory analyses indicate that after adjusting for multiple comparisons, there were no statistically significant differences between the test results on science content of students in intervention group classrooms and students in control group classrooms. Intervention group students in neither the full sample (effect size = 0.11) nor the English language learner subsample (effect size = 0.31) scored significantly higher on the ATLAST Test of Force and Motion than did their control group counterparts. Similarly, intervention group students in neither the full sample (effect size = 0.03) nor the English language learner subsample (effect size =0 .09) scored higher on the physical science reporting clusters of the California Standards Test than did their control group counterparts. Results for the intermediate confirmatory analyses indicate that after adjusting for multiple comparisons, teachers who received the professional development course outscored their control group counterparts on the ATLAST Test of Force and Motion for Teachers (effect size = 0.38), as well as on their ratings of confidence in their ability to teach force and motion (effect size = 0.49). With one exception, the study findings were not sensitive to variations in specification of the estimation models. The exception is that, for teacher content knowledge, inclusion of the pretest in the impact analysis model (basic model plus pretest) decreased the point estimate from 9.8 to 6.1 and the effect size from 0.61 to 0.38. In exploratory analyses, the study investigated whether there were differential impacts on student and teacher content knowledge outcomes across the six research sites. The estimated impacts were most pronounced at two of the six sites. For the full sample of students, point estimates for student and teacher content knowledge of force and motion followed exactly the same rank order at all sites. There are three main limitations of this study. First, there was high sample attrition: 48 of the 181 teachers who were randomly assigned to intervention and control groups left the study before data collection was completed. However, there is no evidence that attrition resulted in significant differences at the baseline between the intervention and control samples used in the analysis. Second, the study did not include analyses of classroom implementation of course-related practices. As a result it is not possible to infer whether the lack of student effects is due to a failure of treatment group teachers to modify classroom practices or a failure of modified practices to affect student outcomes. Third, the findings are based on volunteer teachers and students whose parents provided consent. It is possible that the findings would have been different had teachers been required to participate in the intervention, and all students been tested. Appended are: (1) Study power estimates; (2) Procedure for assigning blocks for recruited sample and final analytic sample; (3) Teacher agreement to protect the study; (4) Teacher survey responses related to contamination across groups; (5) Parent consent form; (6) California content standards in physical science reporting clusters; (7) Student data obtained from district administrative records; (8) Survey items used to measure teacher confidence; (9) Course session video recording protocol; (10) Course session attendance sheet; (11) Student test administration instructions for proctors; (12) Teacher test administration instructions for site coordinators; (13) Baseline equivalence of teacher demographics in intervention and control group samples; (14) Class selection worksheet; (15) Sensitivity analysis for nesting of students within teachers or classes within teachers; (16) Impact estimation methods; (17) Missing item--level data; (18) Schedule and content goals of Making Sense of SCIENCE[TM] professional development course on force and motion; and (19) Sensitivity analyses based on different models and analytic samples. (Contains 51 tables, 4 figures and 8 footnotes.)
Reviews of Individual Studies 1-5 -1
The Effects of School Vouchers on College Enrollment: Experimental Evidence from New York City (2012)
In the first study, using a randomized experiment to measure the impact of school vouchers on college enrollment, Matthew Chingos and Paul Peterson, professor of government at Harvard University, examine the college-going behavior through 2011 of students who participated in a voucher experiment as elementary school students in the late 1990s. They find no overall impacts on college enrollment but do find large, statistically significant positive impacts on the college going of African-American students who participated in the study. Their estimates indicate that using a voucher to attend private school increased the overall college enrollment rate among African Americans by 24 percent. The original data for the analysis come from an experimental evaluation of the privately funded New York School Choice Scholarships Foundation Program, which in the spring of 1997 offered three-year scholarships worth up to a maximum of $1,400 annually to as many as 1,000 low-income families. Chingos and Peterson obtained student information that allowed them to identify over 99 percent of the students who participated in the original experiment so that their college enrollment status could be ascertained by means of the college enrollment database maintained by the National Student Clearinghouse for institutions of higher education that serve 96 percent of all students in the United States. In addition to finding impacts on overall college-going for African Americans, the authors report significant increases in full-time college attendance, enrollment in private four-year colleges, and enrollment in selective four-year colleges for this group of students. Observational and Quasi-Experimental Research are appended. (Contains 7 tables and 19 endnotes.)
Reviews of Individual Studies K-8 -1
Training Your Own: The Impact of New York City's Aspiring Principals Program on Student Achievement (2012)
The New York City Leadership Academy represents a unique experiment by a large urban school district to train and develop its own school leaders. Its 14-month Aspiring Principals Program (APP) selects and prepares aspiring principals to lead low-performing schools. This study provides the first systematic evaluation of achievement in APP-staffed schools after 3 or more years. We examine differences between APP principals and those advancing through other routes, the extent to which APP graduates serve and remain in schools, and their relative performance in mathematics and English language arts. On balance, we find that APP principals performed about as well as other new principals. If anything, they narrowed the gap with comparison schools in English language arts but lagged behind in mathematics. (Contains 2 figures, 9 tables, and 23 notes.)
Reviews of Individual Studies K-2 -1
Effects of a Supplemental Vocabulary Program on Word Knowledge and Passage Comprehension (2012)
A cluster randomized trial estimated the effects of a supplemental vocabulary program, Elements of Reading[R]: vocabulary on student vocabulary and passage comprehension in moderate- to high-poverty elementary schools. Forty-four schools participated over a period spanning 2 consecutive school years. At baseline, 1,057 teachers and 16,471 students from kindergarten, first, third, and fourth grade participated. The schools were randomly assigned to either the primary or intermediate grade treatment group. In each group, the nontreatment classrooms provided the control condition. Treatment classrooms used the intervention to supplement their core reading program, whereas control classrooms taught vocabulary business-as-usual. The intervention includes structured, weekly lesson plans for 6 to 8 literary words and aural/oral and written language activities providing multiple exposures and opportunity for use. Hierarchical linear modeling was used to estimate both proximal (Year 1) and distal (Year 2) effects on vocabulary and passage comprehension. The intervention had positive and statistically significant proximal effects but no statistically significant distal effects. The results indicate that the intervention can improve targeted vocabulary and local passage comprehension, but expecting global effects may be overly optimistic. (Contains 13 tables and 2 footnotes.)
Reviews of Individual Studies K-3 -1
A Randomized Trial Examining the Effects of Conjoint Behavioral Consultation and the Mediating Role of the Parent-Teacher Relationship (2012)
The present study is a large-scale randomized trial testing the efficacy of a family-school partnership model (i.e., conjoint behavioral consultation) for promoting behavioral competence and decreasing problem behaviors of students identified by their teachers as disruptive. The focus of this study is on student behavioral outcomes and the potential role of parent-teacher relationships as a mediating variable. Two hundred seven students, from 82 classrooms, and their families and teachers participated. Results indicated that, relative to the control group, students in the conjoint behavioral consultation condition demonstrated greater increases in adaptive behaviors and social skills over the 8-week intervention period. Compared to teachers in the control group, those in the experimental conjoint behavioral consultation condition demonstrated significantly greater change in their reported relationships with parents. Furthermore, improvements in teacher-reported relationships with parents mediated the effects of conjoint behavioral consultation on positive changes in children's behaviors. Interpretation and implications of these findings are discussed. (Contains 4 tables and 2 figures.)
Reviews of Individual Studies K-4 -1
Class-Wide Positive Behavior Support and Group Contingencies: Examining a Positive Variation of the Good Behavior Game (2012)
The Good Behavior Game (GBG) is a powerful group contingency with a history of documented empirical support. The purpose of this study was to compare two interdependent group contingencies, the GBG and a positive variation, the Caught Being Good Game (CBGG), in a school implementing school-wide positive behavior support. A kindergarten and fourth-grade classroom teacher with 17 and 20 students, respectively, implemented both versions of the game in a counterbalanced fashion. Using a withdrawal design, results showed similar effects on disruptive and on-task behaviors. The CBGG is discussed as an effective variation of the GBG that is acceptable to both teachers and students. (Contains 2 figures.)
Reviews of Individual Studies K -1
A comparison of responsive interventions on kindergarteners’ early reading achievement. (2012)
This study compared the effects of Tier 2 reading interventions that operated in response-to-intervention contexts. Kindergarten children (N = 90) who were identified as at risk for reading difficulties were stratified by school and randomly assigned to receive (a) Early Reading Intervention (ERI; Pearson/Scott Foresman, 2004) modified in response to student performance or (b) their schools' typical supplemental reading intervention (regrouping and curriculum pacing adjustments). In both conditions, intervention was provided 30 minutes per day in small groups for approximately 100 sessions. Results indicated no statistically significant group differences on any outcome measures. Between-group effect sizes revealed substantively important differences (Valentine & Cooper, 2003) favoring the ERI responsive condition on multiple measures with effect sizes ranging from 0.35 to 0.59. Overall, findings indicated that the majority of students in both Tier 2 intervention conditions performed above the 30th percentile on posttest measures of word reading measures. (Contains 1 figure and 5 tables.)
Reviews of Individual Studies 9-12 -1
Longer-term impacts of mentoring, educational services, and learning incentives: Evidence from a randomized trial in the United States. (2012)
Reviews of Individual Studies K -1
Fostering At-Risk Kindergarten Children's Number Sense (2012)
A 9-month training experiment evaluated whether computer-assisted discovery learning of arithmetic regularities can facilitate kindergartners' fluency with the easiest sums. After a pretest, kindergartners with at least one risk factor (n = 28) were randomly assigned to either a structured add-0/1 training condition, which focused on recognizing the n + 0/0 + n = n and the n + 1/1 + n = the number-after-n rules, or an active control group. Using pretest fluency as the covariate, ANCOVAs revealed that the structured add-0/1 group significantly outperformed the control group on both practiced and unpracticed (transfer) n + 0/0 + n and n + 1/1 + n items at the delayed posttest and had significantly larger gains in mathematics achievement. Key instructional implications include: Early intervention that targets discovering rules for adding with 0 and 1 and "family-specific" developmental prerequisites is feasible and more effective than typical classroom instruction in promoting fluency with such basic sums. Such rules may be a critically important bridge between informal and formal mathematics. (Contains 8 footnotes, 5 tables, and 4 figures.)
Reviews of Individual Studies K -1
Effects of Supplemental Reading Interventions in Authentic Contexts: A Comparison of Kindergarteners' Response (2011)
This study compared the effects of 2 supplemental interventions on the beginning reading performance of kindergarteners identified as at risk of reading difficulty. Students (N = 206) were assigned randomly at the classroom level either to an explicit/systematic commercial program or to a school-designed practice intervention taught 30 min per day in small groups for approximately 100 sessions. Multilevel hierarchical linear analyses revealed statistically significant effects favoring the explicit/systematic intervention on alphabetic, phonemic, and untimed decoding skills with substantive effect sizes on all measures except word identification and passage comprehension. Group performance did not differ statistically on more advanced reading and spelling skills. Findings support the efficacy of both supplemental interventions and suggest the benefit of the more explicit/systematic intervention for children who are most at risk of reading difficulty. (Contains 6 tables and 1 figure.)
Reviews of Individual Studies K-1 -1
The effectiveness of a technologically facilitated classroom-based early reading intervention. (2011)
The purpose of this study was to evaluate the efficacy of a classroom-teacher-delivered reading intervention for struggling readers called the Targeted Reading Intervention (TRI), designed particularly for kindergarten and first-grade teachers and their struggling students in rural, low-wealth communities. The TRI was delivered via an innovative Web-conferencing system using laptop computers and webcam technology. Seven schools from the southwestern United States were randomly assigned to experimental and control conditions in a cluster randomized design. All children in the study (n = 364) were administered a battery of standardized reading skill tests in the fall and spring of the school year. Intent-to-treat analyses were conducted to estimate mixed models of children's 1-year growth in Word Attack, Letter/Word Identification, Passage Comprehension, and Spelling of Sounds. Results showed that struggling readers from experimental schools outperformed those from control schools on all spring reading outcomes, controlling for fall scores. (Contains 5 tables.)
Reviews of Individual Studies K -1
The Impact of a Comprehensive Tier I Core Kindergarten Program on the Achievement of Students at Risk in Mathematics (2011)
This study examined the efficacy of a core kindergarten mathematics program, ELM, a 120-lesson comprehensive curriculum providing instruction in (a) number operations, (b) geometry, (c) measurement, and (d) vocabulary. ELM is designed to address the learning needs of all students, including at-risk students in the general education or Tier I classroom setting. The study utilized a randomized block design, with 64 classrooms randomly assigned within schools to treatment (ELM) or control (standard district practices) conditions. Measures of achievement were collected at pretest and posttest to measure student achievement. Students did not differ on mathematics assessments at pretest. Gain scores of at-risk treatment students were significantly greater than control peers, and the gains of at-risk treatment students were greater than the gains of peers not at risk, effectively reducing the achievement gap. Implications for Tier I instruction in a Response to Intervention (RTI) model are discussed. (Contains 4 tables.)
Reviews of Individual Studies K-4 -1
Reading and Language Outcomes of a Multiyear Randomized Evaluation of Transitional Bilingual Education (2011)
This article reports the outcomes of a multiyear study comparing the English and Spanish language and reading performance of Spanish-dominant children randomly assigned, beginning in kindergarten, to transitional bilingual education (TBE) or structured English immersion (SEI) for periods of up to 5 years. On the Peabody Picture Vocabulary Test and its Spanish equivalent (Test de Vocabulario en Imagenes Peabody) and on the English and Spanish versions of three Woodcock Reading Scales, first graders in TBE performed significantly better in Spanish and worse in English than did their SEI counterparts. Differences diminished in second and third grades, and by fourth grade, when all students in TBE had transitioned to English-only instruction, there were no significant differences on English reading measures. These findings suggest that Spanish-dominant students learn to read in English equally well in TBE and SEI and that policy should therefore focus on the quality of instruction rather than on the language of instruction for English-language learners. (Contains 1 note and 8 tables.)
Reviews of Individual Studies K-12 -1
Teacher Incentives and Student Achievement: Evidence from New York City Public Schools. NBER Working Paper No. 16850 (2011)
Financial incentives for teachers to increase student performance is an increasingly popular education policy around the world. This paper describes a school-based randomized trial in over two-hundred New York City public schools designed to better understand the impact of teacher incentives on student achievement. I find no evidence that teacher incentives increase student performance, attendance, or graduation, nor do I find any evidence that the incentives change student or teacher behavior. If anything, teacher incentives may decrease student achievement, especially in larger schools. The paper concludes with a speculative discussion of theories that may explain these stark results.
Reviews of Individual Studies K-12 -1
A Big Apple for Educators: New York City's Experiment with Schoolwide Performance Bonuses. Final Evaluation Report. Monograph (2011)
In the 2007-2008 school year, the New York City Department of Education and the United Federation of Teachers jointly implemented the Schoolwide Performance Bonus Program in a random sample of the city's high-needs public schools. The program lasted for three school years, and its broad objective was to improve student performance through school-based financial incentives. The question, of course, was whether it was doing so. To examine its implementation and effects, the department tasked a RAND Corporation-led partnership with the National Center on Performance Incentives at Vanderbilt University to conduct a two-year study of the program that would offer an independent assessment. This report describes the results of our analyses for all three years of the program, from 2007-2008 through 2009-2010. This work built on past research and was guided by a theory of action articulated by program leaders. Researchers examined student test scores; teacher, school staff, and administrator surveys; and interviews with administrators, staff members, program sponsors, and union and district officials. The researchers found that the program did not, by itself, improve student achievement, perhaps in part because conditions needed to motivate staff were not achieved (e.g., understanding, buy-in for the bonus criteria) and because of the high level of accountability pressure all the schools already faced. Individual chapters contain footnotes. (Contains 12 figures and 66 tables.) [Additional funding for this paper was provided by the New York City Fund for Public Schools. For "What New York City's Experiment with Schoolwide Performance Bonuses Tells Us about Pay for Performance. Research Brief," see ED521918.]
Reviews of Individual Studies 1-6 -1
Exercise improves executive function and achievement and alters brain activation in overweight children: A randomized, controlled trial. (2011)
Reviews of Individual Studies 2 -1
Small-group computer-assisted tutoring to improve reading outcomes for struggling first and second graders. (2011)
This study evaluated the relative effects of Tier II computer-assisted tutoring in small groups (Team Alphie) and one-to-one tutoring provided to struggling readers in 33 high-poverty Success for All (SFA) schools. In this year-long study, struggling readers in the Team Alphie schools were tutored in groups of 6. In the control schools, students were tutored using the standard one-to-one tutoring process used in SFA. Analyses of covariance of students' standardized reading scores indicated that the first-grade treatment group significantly outperformed the control group on all 3 reading measures, with no significant differences for second graders. Schools using Team Alphie were able to tutor many more students than the control schools. This study shows that a computer-assisted, small-group tutoring program may be at least as effective as one-to-one tutoring and serve more struggling readers. It may serve as a good example of Tier II instruction in a response to intervention (RTI) model. (Contains 1 table.)
Reviews of Individual Studies 8 -1
Do School-Based Tutoring Programs Significantly Improve Student Performance on Standardized Tests? (2011)
This study used a pre-post, nonequivalent control group design to examine the impact of an in-district, after-school tutoring program on eighth grade students' standardized test scores in language arts and mathematics. Students who had scored in the near-passing range on either the language arts or mathematics aspect of a standardized test at the end of seventh grade were recruited to receive tutoring in either language arts (LA) or mathematics (MA), depending on the area of weakness. An analysis of covariance revealed that both groups of students tutored in LA (n = 23) or MA (n = 20) significantly outperformed a matched control group (p = 0.02 for LA; p = 0.04 for MA). Components of effective after-school academic programs are discussed. (Contains 5 tables.)
Reviews of Individual Studies 9 -1
The Effects of the Good Behavior Game on the Conduct of Regular Education New York City High School Students (2011)
The efficacy of the Good Behavior Game was examined in a multiethnic New York City public high school. Classroom rules were posted and students were divided into two teams. A reinforcement preference questionnaire was used to select daily and weekly prizes. The classroom teacher indicated that he was going to place a check on the board after every rule infraction as he named rule violators and their infractions. Students were also told that the team with the fewest marks at the end of each day would become the daily winners and receive prizes. They were also told that the team with the fewest marks for the week would be recognized as the weekly winners and receive additional prizes. The rate of disruptive behavior was charted across four treatment phases using a reversal design. The game phases were associated with marked reductions in the rate of seat leaving, talking without permission, and aggression. Teacher and student feedback supported the social validity of the procedure. (Contains 1 table and 2 figures.)
Reviews of Individual Studies 7 -1
Middle School Mathematics Professional Development Impact Study: Findings after the Second Year of Implementation. NCEE 2011-4024 (2011)
This is the second and final report of the Middle School Mathematics Professional Development Impact Study, which examines the impact of providing a professional development (PD) program in rational number topics to seventh-grade mathematics teachers. An interim report (Garet et al. 2010) described the findings after one year of PD. The current report documents the impact after providing a second year of PD in a subset of the original participating districts and includes supplemental analyses that use data from both years of the study. The study produced the following core second-year results: (1) The study's PD program was implemented as intended, but teacher turnover limited the average dosage received; (2) At the end of the second year of implementation, the PD program did not have a statistically significant impact on teacher knowledge; and (3) At the end of the second year of implementation, the PD program did not have a statistically significant impact on average student achievement in rational numbers. Appended are: (1) Details of the Study Samples; (2) Details of Data Collection and Analytical Approaches; (3) Supplemental Information on the Design and Implementation of the PD Program; (4) Supporting Tables and Figures for Impact Analyses; and (5) Exploratory Analyses: Approaches and Additional Results. (Contains 6 exhibits, 6 figures, 81 tables and 124 footnotes.) [For "Middle School Mathematics Professional Development Impact Study: Findings after the Second Year of Implementation. Executive Summary. NCEE 2011-4025," see ED519923. For "Middle School Mathematics Professional Development Impact Study: Findings After the First Year of Implementation. NCEE 2010-4009," see ED509306.]
Reviews of Individual Studies 6-9 -1
Striving Readers final evaluation report: Danville, Kentucky. (2011)
Reviews of Individual Studies 6-8 -1
Striving Readers Study: Targeted &amp; Whole-School Interventions -- Year 5 (2011)
This report summarizes the results of the Newark, New Jersey, Striving Readers program for project Years 1, 2, 3, 4, and 5. This report updates one analysis (3 years); the remainder of the impacts and implementation findings are for Year 4. The Striving Readers Grant addresses the unmet needs of middle school students reading 2 or more years below grade level and provides professional development for teachers in all core content areas to help them learn about and use more effective literacy strategies. Nineteen middle schools in Newark are participating in the U.S. Department of Education Striving Readers study. Two components of the project are being evaluated: a targeted intervention and a whole-school intervention. [This report is the product of a collaborative effort involving numerous individuals at Westat and Newark Public Schools.]
Reviews of Individual Studies 6-8 -1
Striving Readers study: Targeted and whole-school interventions—year 5. (2011)
Reviews of Individual Studies 6-11 -1
Better schools, less crime? (2011)
Reviews of Individual Studies 6-8 -1
Longitudinal Investigation of the Curricular Effect: An Analysis of Student Learning Outcomes from the LieCal Project in the United States (2011)
In this article, we present the results from a longitudinal examination of the impact of a "Standards"-based or reform mathematics curriculum (called CMP) and traditional mathematics curricula (called non-CMP) on students' learning of algebra using various outcome measures. Findings include the following: (1) students did not sacrifice basic mathematical skills if they are taught using a "Standards"-based or reform mathematics curriculum like CMP; (2) African American students experienced greater gain in symbol manipulation when they used a traditional curriculum; (3) the use of either the CMP or a non-CMP curriculum improved the mathematics achievement of all students, including students of color; (4) the use of CMP contributed to significantly higher problem-solving growth for all ethnic groups; and (5) a high level of conceptual emphasis in a classroom improved the students' ability to represent problem situations. (However, the level of conceptual emphasis bears no relation to students' problem solving or symbol manipulation skills.) (Contains 12 tables and 3 figures.)
Reviews of Individual Studies 4-8 -1
The Long-Term Impacts of Teachers: Teacher Value-Added and Student Outcomes in Adulthood. NBER Working Paper No. 17699 (2011)
Are teachers' impacts on students' test scores ("value-added") a good measure of their quality? This question has sparked debate largely because of disagreement about (1) whether value-added (VA) provides unbiased estimates of teachers' impacts on student achievement and (2) whether high-VA teachers improve students' long-term outcomes. We address these two issues by analyzing school district data from grades 3-8 for 2.5 million children linked to tax records on parent characteristics and adult outcomes. We find no evidence of bias in VA estimates using previously unobserved parent characteristics and a quasi-experimental research design based on changes in teaching staff. Students assigned to high-VA teachers are more likely to attend college, attend higher-ranked colleges, earn higher salaries, live in higher SES neighborhoods, and save more for retirement. They are also less likely to have children as teenagers. Teachers have large impacts in all grades from 4 to 8. On average, a one standard deviation improvement in teacher VA in a single grade raises earnings by about 1% at age 28. Replacing a teacher whose VA is in the bottom 5% with an average teacher would increase students' lifetime income by more than $250,000 for the average classroom in our sample. We conclude that good teachers create substantial economic value and that test score impacts are helpful in identifying such teachers.
Reviews of Individual Studies 4-9 -1
Charter school performance in Indiana. (2011)
Reviews of Individual Studies 5 -1
Individualizing a Web-Based Structure Strategy Intervention for Fifth Graders&apos; Comprehension of Nonfiction (2011)
In the study, we investigated effects of 2 different versions of a web-based tutoring system to provide 5th-grade students with strategy instruction about text structure, which was an intervention to improve reading comprehension. The design feature assessed varied in individualization of instruction (individualized or standard). The more individually tailored version was developed to provide remediation or enrichment lessons matched to the individual needs of each student. Stratified random assignment was used to compare the effects of 2 versions of the 6-month web-based intervention. Students in the individualized condition made greater improvements from pretest to posttest on a standardized reading comprehension test (d = 0.55) than did students in the standard condition (d = 0.30). Students receiving more individualized instruction demonstrated higher mastery achievement goals when working in the lessons than did students receiving the standard instruction (d = 0.53). Students receiving more individualized instruction showed greater improvement in using signaling, better work in lessons, and more positive posttest attitudes toward computers than did students receiving standard instruction. Students in both conditions improved their recall of ideas from texts and their use of the text structure strategy and comparison signaling words. (Contains 3 footnotes, 16 tables, and 3 figures.)
Reviews of Individual Studies 5 -1
Individualizing a Web-Based Structure Strategy Intervention for Fifth Graders&apos; Comprehension of Nonfiction (2011)
In the study, we investigated effects of 2 different versions of a web-based tutoring system to provide 5th-grade students with strategy instruction about text structure, which was an intervention to improve reading comprehension. The design feature assessed varied in individualization of instruction (individualized or standard). The more individually tailored version was developed to provide remediation or enrichment lessons matched to the individual needs of each student. Stratified random assignment was used to compare the effects of 2 versions of the 6-month web-based intervention. Students in the individualized condition made greater improvements from pretest to posttest on a standardized reading comprehension test (d = 0.55) than did students in the standard condition (d = 0.30). Students receiving more individualized instruction demonstrated higher mastery achievement goals when working in the lessons than did students receiving the standard instruction (d = 0.53). Students receiving more individualized instruction showed greater improvement in using signaling, better work in lessons, and more positive posttest attitudes toward computers than did students receiving standard instruction. Students in both conditions improved their recall of ideas from texts and their use of the text structure strategy and comparison signaling words. (Contains 3 footnotes, 16 tables, and 3 figures.)
Reviews of Individual Studies 5 -1
The Impact of Collaborative Strategic Reading on the Reading Comprehension of Grade 5 Students in Linguistically Diverse Schools. Final Report. NCEE 2011-4001 (2011)
Collaborative Strategic Reading (CSR) is a set of instructional strategies designed to improve the reading comprehension of students with diverse abilities (Klingner and Vaughn 1996). Teachers implement CSR at the classroom level using scaffolded instruction to guide students in the independent use of four comprehension strategies; students apply the strategies to informational text while working in small cooperative learning groups. The current study is a randomized controlled trial (RCT) examining the effect of CSR on student reading comprehension. Within each participating linguistically diverse school, grade 5 social studies classrooms were randomly assigned to either the CSR condition (using CSR when delivering social studies curricula) or to the control condition (a business-as-usual condition). The implementation period was one school year. This study focused on the following confirmatory research question: In linguistically diverse schools, do grade 5 students in CSR classrooms have higher average reading comprehension posttest scores on the Group Reading Assessment and Diagnostic Evaluation (GRADE) than students in control classrooms? In addition, the study examined three exploratory research questions about CSR's effect on two subgroups of students: (1) Do grade 5 former and current English language learner (FC-ELL) students in CSR classrooms have higher average reading comprehension posttest scores on the GRADE than FC-ELL students in control classrooms?; (2) Do grade 5 non-ELL students in CSR classrooms have higher average reading comprehension posttest scores on the GRADE than non-ELL students in control classrooms?; and (3) Does CSR have a differential impact on GRADE reading comprehension posttest scores for grade 5 FC-ELL and non-ELL students? The intent of these exploratory analyses was to examine whether there is an effect for each subgroup separately, as well as whether there is a differential effect between the subgroups. The primary finding of this study is that CSR did not have a statistically significant impact on student reading comprehension. Nine sensitivity analyses--including alternative statistical approaches, an alternative approach for handling missing data, and different sample specifications--showed that the findings were robust to different analytic approaches. Three exploratory analyses were also conducted to examine the effects of CSR on FC-ELL and non-ELL students. Statistically significant effects on student reading comprehension were not identified for either subgroup, and no statistically significant differential impacts were identified. It is often the case that RCTs, because of their greater rigor, do not support the findings of prior quasi-experiments (Glazerman, Levy, and Myers 2002, 2003). With all other design features held constant, randomization yields stronger evidence about program impacts than do quasi-experiments (Boruch 1997; Shadish, Cook, and Campbell 2002). The current investigation evaluated the impact of CSR in an effectiveness trial designed to approximate a district's implementation of CSR. Data on the fidelity of implementation suggest that professional development was generally delivered according to plan. Data on teacher fidelity of CSR implementation showed that 78.8 percent of teachers reported using CSR two or more times a week, as instructed. However, the single observation conducted for each classroom found that 21.6 percent of CSR teachers were using all five core teacher strategies, which the study defined as full procedural fidelity; 56.8 percent of teachers were observed using three or fewer strategies. Appendices include: (1) Identification and exit criteria for English language learner students in Oklahoma and Texas; (2) Assumptions used to determine statistical power and observed power; (3) Random assignment; (4) Analysis of consent rate at baseline; (5) Estimation methods; (6) Frequently asked questions about contamination; (7) Attrition analyses; (8) Response rates for demographic data; (9) Fall and spring teacher surveys; (10) Fall coaching observation form; (11) Multiple imputation; (12) Assigning students to cooperative learning groups; (13) Critical procedural behaviors for Collaborative Strategic Reading strategies; (14) Observer training for the subscale Expository Reading Comprehension observation instrument and interrater reliability; (15) Descriptive statistics on Group Reading Assessment and Diagnostic Evaluation scores; (16) Baseline equivalence results for multiply imputed analytic dataset; and (17) Full analytic output tables. A glossary is included. (Contains 52 tables, 3 figures and 46 footnotes.
Reviews of Individual Studies 5-7 -1
Pearson SuccessMaker reading efficacy study 2010–11 final report. (2011)
Reviews of Individual Studies 6 -1
Impact of the Thinking Reader[R] Software Program on Grade 6 Reading Vocabulary, Comprehension, Strategies, and Motivation: Final Report. NCEE 2010-4035 (2011)
"Thinking Reader" is a software program for students in Grades 5-8 that incorporates elements commonly identified in policy reports as being key components of effective adolescent literacy instruction. This evaluation of the impact of "Thinking Reader" use by Grade 6 students focused on two confirmatory research questions about the effect of the program on two measures of students' reading achievement: (1) What is the effect of "Thinking Reader" on students' reading vocabulary?; and (2) What is the effect of "Thinking Reader" on students' reading comprehension? A statistically significant impact on either outcome measure would signal the program's success. The study also examined whether "Thinking Reader" has an effect on two ancillary, but important, measures of students' approaches to reading: (1) What is the effect of "Thinking Reader" on students' use of reading comprehension strategies?; and (2) What is the effect of "Thinking Reader" on students' motivation to read? This study also addressed four exploratory research questions. These questions investigate whether the impact of the "Thinking Reader" intervention on students' reading achievement varied across subgroups of students formed on the basis of baseline reading vocabulary, baseline reading comprehension, and baseline motivation to read measures: (1) Does the effect of "Thinking Reader" on students' reading vocabulary vary according to their baseline reading vocabulary scores?; (2) Does the effect of "Thinking Reader" on students' reading comprehension vary according to their baseline reading comprehension scores?; (3) Does the effect of "Thinking Reader" on students' reading vocabulary vary according to their baseline reading motivation scores?; (4) Does the effect of "Thinking Reader" on students' reading comprehension vary according to their baseline reading motivation scores? The impact results for the primary research questions indicate that "Thinking Reader" was no more effective than business as usual in improving students' reading vocabulary (effect size of -0.04) or reading comprehension (effect size of 0.03). Results for the ancillary research questions indicate that "Thinking Reader" was also no more effective than business as usual in improving student' use of reading comprehension strategies (effect size of 0.03) or their motivation to read (effect size of -0.03). None of these results are statistically significant. Sensitivity analyses found no changes in the direction or magnitude of the intervention effects. Appendices include: (1) Examples From the "Thinking Reader" Program; (2) Data Collection; (3) Missing Data, Baseline Equivalence of the Analytic Sample, and the Impact Model; (4) Sensitivity Analyses; and (5) Exploratory Analyses. (Contains 89 tables, 10 figures, 6 boxes, 7 exhibits and 51 footnotes.)
Reviews of Individual Studies 6 -1
Chicago Public Schools Striving Readers Initiative: Year Four evaluation report. (2011)
Reviews of Individual Studies 4-5 -1
Classroom Assessment for Student Learning: Impact on Elementary School Mathematics in the Central Region. Final Report. NCEE 2011-4005 (2011)
This study was conducted by the Central Region Educational Laboratory (REL Central) administered by Mid-continent Research for Education and Learning to provide educators and policymakers with rigorous evidence about the potential of Classroom Assessment for Student Learning (CASL) to improve student achievement. CASL is a widely used professional development program in classroom and formative assessment published by the Assessment Training Institute of Pearson Education. Schools were recruited from across Colorado to participate in the study. Colorado was chosen as the target state primarily because it has one of the largest populations in the Central Region from which to recruit schools and because its statewide achievement test is vertically scaled. This cluster randomized trial of the CASL professional development program had sufficient statistical power to detect an impact of at least 0.25 standard deviation on student achievement. An intent-to-treat analysis was conducted to estimate the impact of CASL on student achievement; all schools were included in the analysis and were analyzed as randomized regardless of the level of implementation fidelity. Analysis did not reveal a statistically significant impact of CASL on the school-level average mathematics achievement of grade 4 and grade 5 students. Results from sensitivity analyses revealed that the impact estimates on student achievement were robust to decisions regarding the inclusion of covariates, estimation method, and the treatment of missing data. In other words, design and analysis decisions made by the research team did not change whether the impact results would have been statistically significant. Appendices include: (1) Power analysis; (2) Response rates by data collection wave, instrument, and experimental group; (3) Data collection instruments; (4) Development, reliability, and validity of teacher outcomes; (5) Teacher Assessment Work Sample; (6) Impact analysis models; (7) Calculation of effect sizes; (8) Treatment of missing data; (9) Variance components estimates and intraclass correlations; (10) Raw means and standard deviations; and (11) Complete mixed model results. (Contains 1 box, 4 figures and 56 tables.
Reviews of Individual Studies 3-11 -1
Teacher preparation programs and Teach for America research study. (2011)
Reviews of Individual Studies 3-7 -1
Main Idea Identification with Students with Mild Intellectual Disabilities and Specific Learning Disabilities: A Comparison of Explicit and Basal Instructional Approaches (2011)
Students with high-incidence disabilities struggle with reading comprehension due to difficulties in background knowledge and metacognitive skills, including use of self-monitoring and other strategies. In the United States, these students typically receive the majority of their instruction in general education settings. However, there is little research comparing reading comprehension interventions with the typical basal curricula used in these classrooms. We compared the effects of an explicit reading comprehension intervention to those of a typical language-arts curriculum on upper elementary and middle school students' (n = 38) retells of passages and understanding of main ideas. A 2 x 4 repeated measures multivariate analysis of variance (MANOVA) revealed significant differences between instructional groups. These results indicate systematic and explicit reading comprehension instruction can be delivered successfully to students with high-incidence disabilities in general education settings. (Contains 3 figures and 4 tables.)
Reviews of Individual Studies 3-8 -1
A Multistate District-Level Cluster Randomized Trial of the Impact of Data-Driven Reform on Reading and Mathematics Achievement (2011)
Analyzing mathematics and reading achievement outcomes from a district-level random assignment study fielded in over 500 schools within 59 school districts and seven states, the authors estimate the 1-year impacts of a data-driven reform initiative implemented by the Johns Hopkins Center for Data-Driven Reform in Education (CDDRE). CDDRE consultants work with districts to implement quarterly student benchmark assessments and provide district and school leaders with extensive training on interpreting and using the data to guide reform. Relative to a control condition, in which districts operated as usual without CDDRE services, the data-driven reform initiative caused statistically significant districtwide improvements in student mathematics achievement. The CDDRE intervention also had a positive effect on reading achievement, but the estimates fell short of conventional levels of statistical significance. (Contains 1 figure, 3 tables, and 16 notes.)
Reviews of Individual Studies 3-5 -1
The effectiveness of state certified, graduate degreed, and National Board certified teachers as determined by student growth in reading (Doctoral dissertation). (2010)
Reviews of Individual Studies 3 -1
The Effects of Strategic Counting Instruction, with and without Deliberate Practice, on Number Combination Skill among Students with Mathematics Difficulties (2010)
The primary purpose of this study was to assess the effects of strategic counting instruction, with and without deliberate practice with those counting strategies, on number combination (NC) skill among students with mathematics difficulties (MD). Students (n = 150) were stratified on MD status (i.e., MD alone versus MD with reading difficulty) and site (proximal versus distal to the intervention developer) and then randomly assigned to control (no tutoring) or 1 of 2 variants of NC remediation. Both remediations were embedded in the same validated word-problem tutoring protocol (i.e., Pirate Math). In 1 variant, the focus on NCs was limited to a single lesson that taught strategic counting. In the other variant, 4-6 min of practice per session was added to the other variant. Tutoring occurred for 16 weeks, 3 sessions per week for 20-30 min per session. Strategic counting without deliberate practice produced superior NC fluency compared to control; however, strategic counting with deliberate practice effected superior NC fluency and transfer to procedural calculations compared with both competing conditions. Also, the efficacy of Pirate Math word-problem tutoring was replicated. (Contains 6 tables.)
Reviews of Individual Studies 4-10 -1
The MPCP Longitudinal Educational Growth Study: Third Year Report. SCDP Milwaukee Evaluation Report #15 (2010)
This is the third-year report in a five-year evaluation of the Milwaukee Parental Choice Program (MPCP). The MPCP, which began in 1990, provides government-funded vouchers for low-income children to attend private schools in the City of Milwaukee. The general purposes of the evaluation are to analyze the effectiveness of the MPCP in terms of longitudinal student achievement growth and educational attainment as measured by high school graduation rates. The former will be primarily accomplished by measuring and estimating student growth in achievement as measured by the Wisconsin Knowledge and Concepts Examinations (WKCE) in math and reading in 2006-07, grades 3 through 8 over a five-year period. The latter will be accomplished by following the 2006-07 8th and 9th grade cohorts over a five-year period or longer. The general research design consists of a comparison between a random sample of MPCP students and a matched sample of Milwaukee Public School (MPS) students. This third year report presents results from the November 2008 WKCE tests as second year student achievement growth in MPCP relative to the matched MPS sample. We provide varying descriptive statistics comparing test score means and distributions for math and reading for 2006-07 (baseline year) and 2008-09 (second outcome year) for each sample. The report also analyzes achievement growth using several multivariate techniques and models. The primary finding in all these comparisons is that, in general, there are few statistically significant differences between levels of MPCP and MPS student achievement growth in either math or reading two years after they were carefully matched to each other. In one of the ways of estimating these results, focusing only on those students who have remained in the public or private sector for all three years, private, voucher students are slightly behind MPS students in mathematics achievement growth. The report offers several cautions in interpreting this result against the overwhelming set of results that indicate no difference in achievement growth. Appended are additional tables and study attrition. (Contains 9 tables, 2 figures, and 7 footnotes.) [Additional funding for this project was provided by the Robertson Foundation.]
Reviews of Individual Studies 4 -1
Fourth graders’ growth in reading fluency: A pretest-posttest randomized control study comparing Reading Mastery and Scott Foresman Basal Reading Program. (2010)
Reviews of Individual Studies 5-7 -1
Web-Based Tutoring of the Structure Strategy with or without Elaborated Feedback or Choice for Fifth- and Seventh-Grade Readers (2010)
This study investigated the effects of different versions of Web-based instruction focused on text structure on fifth- and seventh-grade students' reading comprehension. Stratified random assignment was employed in a two-factor experiment embedded within a pretest and multiple posttests design (immediate and four-month delayed posttests). The two factors were type of feedback provided by the Web-based tutor (elaborated vs. simple feedback) and the motivational factor of choice of text topics in practice lessons (student choice of texts vs. no choice). These factors were examined to learn how they affected performance after the six-month, 90-minutes/week intervention. Students who received elaborated feedback performed better on a standardized test of reading comprehension than students who received simple feedback. Learning how to attend to errors from the elaborated feedback tutor yielded large gains in test performance. Simple feedback did not help the least skilled third of readers move from complete lack of competency to competency using the structure strategy with problem-and-solution text. Choice between two topics for practice lessons did not increase reading comprehension. Substantial effects sizes were found from pretest to posttest on various measures of reading comprehension: recall, strategy competence, and standardized reading comprehension test scores. Maintenance of performance over summer break was found for most measures. The study informs research and teaching about Web-based reading tutors, feedback, comprehension, and top-level text structure. (Contains 16 tables, 8 figures and 2 notes.)
Reviews of Individual Studies 5 -1
The Comparative Effects of Function-Based versus Nonfunction-Based Interventions on the Social Behavior of African American Students (2010)
Disproportionality has been a persistent problem in special education for decades. Despite mandates outlined in the Individuals with Disabilities Education Improvement Act (IDEA, 2004), African American students continue to be disproportionately represented in the Emotional Disturbance (ED) category in special education (e.g., Skiba, Poloni-Staudinger, Simmons, Feggins-Azziz, & Chung, 2005). Additionally, African Americans represent the highest percentages of students identified as at risk (Gay, 2000) and receive a disproportionate number of referrals for disciplinary actions (Cartledge & Dukes, 2008) among racial groups. Even though many hypothesized reasons for such disproportionate rates have been researched (e.g., poverty, inherently bad behavior, cultural bias, ineffective behavioral management), the findings are conflicting. Disproportionality among this population continues, and successful educational outcomes are far too infrequent. One promising intervention that can decrease exclusionary practices imposed on African American students and address disproportionality in both special education and disciplinary action is to use functional behavioral assessments and function-based interventions. The effectiveness of FBAs and function-based interventions for students with ED and those at risk for developing ED have been well documented (e.g., Heckaman, Conroy, Fox, & Chait, 2000; Reid & Nelson, 2002). However, only two studies have involved African American students as participants in FBA implementation (i.e., Kamps, Wendland, & Culpepper, 2006; Lo & Cartledge, 2006) and only one included African Americans as a means to address disproportionality (i.e., Lo & Cartledge). Additionally, professional development on FBA has largely been limited to special education personnel only. In order for FBAs to be effective in preventing problem behavior of African American students before they are referred to special education, research on FBA and professional development targeted to general education teachers is critical. This study examined the comparative effects of function-based versus nonfunction-based interventions on the off-task and replacement behavior of African American students at risk for ED and the extent to which general education teachers could implement FBAs with high fidelity. Findings indicated that function-based interventions resulted in higher decreases of off-task behavior than nonfunction-based interventions. Additionally, descriptive results showed that both general education teachers were able to implement FBAs and function-based interventions with high levels of fidelity. Finally, social validity data suggested that teachers felt that FBAs and function-based interventions were of social importance. Teachers' perceptions also changed on the extent to which students had continued needs for disciplinary action and special education services in the ED category. Specifically, teachers felt students were no long in need of special education services or disciplinary action as a result of the function-based interventions. Limitations of the study, suggestions for future research, and implications for practice are also discussed. [The dissertation citations contained here are published with the permission of ProQuest LLC. Further reproduction is prohibited without permission. Copies of dissertations may be obtained by Telephone (800) 1-800-521-0600. Web page: http://www.proquest.com/en-US/products/dissertations/individuals.shtml.]
Reviews of Individual Studies 6-8 -1
Reorganizing the Instructional Reading Components: Could There Be a Better Way to Design Remedial Reading Programs to Maximize Middle School Students with Reading Disabilities&apos; Response to Treatment? (2010)
The primary purpose of this study was to explore if there could be a more beneficial method in organizing the individual instructional reading components (phonological decoding, spelling, fluency, and reading comprehension) within a remedial reading program to increase sensitivity to instruction for middle school students with reading disabilities (RD). Three different modules (Alternating, Integrated, and Additive) of the Reading Achievement Multi-Modular Program were implemented with 90 middle school (sixth to eighth grades) students with reading disabilities. Instruction occurred 45 min a day, 5 days a week, for 26 weeks, for approximately 97 h of remedial reading instruction. To assess gains, reading subtests of the Woodcock Johnson-III, the Gray Silent Reading Test, and Oral Reading Fluency passages were administered. Results showed that students in the Additive module outperformed students in the Alternating and Integrated modules on phonological decoding and spelling and students in the Integrated module on comprehension skills. Findings for the two oral reading fluency measures demonstrated a differential pattern of results across modules. Results are discussed in regards to the effect of the organization of each module on the responsiveness of middle school students with RD to instruction.
Reviews of Individual Studies 6-8 -1
Reorganizing the Instructional Reading Components: Could There Be a Better Way to Design Remedial Reading Programs to Maximize Middle School Students with Reading Disabilities&apos; Response to Treatment? (2010)
The primary purpose of this study was to explore if there could be a more beneficial method in organizing the individual instructional reading components (phonological decoding, spelling, fluency, and reading comprehension) within a remedial reading program to increase sensitivity to instruction for middle school students with reading disabilities (RD). Three different modules (Alternating, Integrated, and Additive) of the Reading Achievement Multi-Modular Program were implemented with 90 middle school (sixth to eighth grades) students with reading disabilities. Instruction occurred 45 min a day, 5 days a week, for 26 weeks, for approximately 97 h of remedial reading instruction. To assess gains, reading subtests of the Woodcock Johnson-III, the Gray Silent Reading Test, and Oral Reading Fluency passages were administered. Results showed that students in the Additive module outperformed students in the Alternating and Integrated modules on phonological decoding and spelling and students in the Integrated module on comprehension skills. Findings for the two oral reading fluency measures demonstrated a differential pattern of results across modules. Results are discussed in regards to the effect of the organization of each module on the responsiveness of middle school students with RD to instruction.
Reviews of Individual Studies 7-10 -1
The effects of Pearson Prentice Hall Literature (2010) on student performance: Efficacy study. (2010)
Reviews of Individual Studies 9 -1
The Enhanced Reading Opportunities study final report: The impact of supplemental literacy courses for struggling ninth-grade readers [Analysis of RAAL] (NCEE 2010-4021). (2010)
According to the National Assessment of Educational Progress (NAEP), just over 70 percent of students nationally arrive in high school with reading skills that are below "proficient"--defined as demonstrating competency over challenging subject matter. Of these students, nearly half do not exhibit even partial mastery of the knowledge and skills that are fundamental to proficient work at grade level. These limitations in literacy skills are a major source of course failure, high school dropout, and poor performance in postsecondary education. While research is beginning to emerge about the special needs of striving adolescent readers, very little is known about effective interventions aimed at addressing these needs. To help fill this gap and to provide evidence-based guidance to practitioners, the U.S. Department of Education initiated the Enhanced Reading Opportunities (ERO) study--a demonstration and rigorous evaluation of supplemental literacy programs targeted to ninth-grade students whose reading skills are at least two years below grade level. As part of this demonstration, 34 high schools from 10 school districts implemented one of two reading interventions: Reading Apprenticeship Academic Literacy (RAAL), designed by WestEd, and Xtreme Reading, designed by the University of Kansas Center for Research on Learning. These programs were implemented in the study schools for two school years. The U.S. Department of Education's (ED) Office of Elementary and Secondary Education (OESE) funded the implementation of these programs, and its Institute of Education Sciences (IES) was responsible for oversight of the evaluation. MDRC--a nonprofit, nonpartisan education and social policy research organization--conducted the evaluation in partnership with the American Institutes for Research (AIR) and Survey Research Management (SRM). The goal of the reading interventions--which consist of a year-long course that replaces a ninth-grade elective class--is to help striving adolescent readers develop the strategies and routines used by proficient readers, thereby improving their reading skills and ultimately, their academic performance in high school. The first two reports for the study evaluated the programs' impact on the two most proximal outcomes targeted by the interventions--students' reading skills and their reading behaviors at the end of ninth grade. This report--which is the final of three reports for this evaluation--examines the impact of the ERO programs on the more general outcomes that the programs hope to affect--students' academic performance in high school (grade point average [GPA], credit accumulation, and state test scores) as well as students' behavioral outcomes (attendance and disciplinary infractions). These academic and behavioral outcomes are examined during the year in which they were enrolled in the ERO programs (ninth grade), as well as the following school year (tenth grade for most students). Appendices include: (1) The ERO Programs and the ERO Teachers; (2) ERO Student Survey Measures; (3) ERO Implementation Fidelity; (4) State Tests Included in the ERO Study; (5) Response Analysis and Baseline Comparison Tables; (6) Technical Notes for Impact Findings; (7) Statistical Power and Minimum Detectable Effect Size; (8) Supplementary Impact Findings; (9) Baseline and Impact Findings, by Cohort; (10) The Association Between Reading Outcomes and Academic Performance in High School; (11) Variation in Impacts Across Sites and Cohorts; (12) Program Costs; and (13) Poststudy Adolescent Literacy Programming in the ERO Schools: Methodology and Additional Findings. (Contains 97 tables, 23 figures, 2 boxes, and 185 footnotes.) [This paper was written with Edmond Wong. For the first-year report, see ED499778. For the second report, see ED503380.]
Reviews of Individual Studies 9 -1
The Enhanced Reading Opportunities study final report: The impact of supplemental literacy courses for struggling ninth-grade readers [Analysis of Xtreme Reading] (NCEE 2010-4021). (2010)
According to the National Assessment of Educational Progress (NAEP), just over 70 percent of students nationally arrive in high school with reading skills that are below "proficient"--defined as demonstrating competency over challenging subject matter. Of these students, nearly half do not exhibit even partial mastery of the knowledge and skills that are fundamental to proficient work at grade level. These limitations in literacy skills are a major source of course failure, high school dropout, and poor performance in postsecondary education. While research is beginning to emerge about the special needs of striving adolescent readers, very little is known about effective interventions aimed at addressing these needs. To help fill this gap and to provide evidence-based guidance to practitioners, the U.S. Department of Education initiated the Enhanced Reading Opportunities (ERO) study--a demonstration and rigorous evaluation of supplemental literacy programs targeted to ninth-grade students whose reading skills are at least two years below grade level. As part of this demonstration, 34 high schools from 10 school districts implemented one of two reading interventions: Reading Apprenticeship Academic Literacy (RAAL), designed by WestEd, and Xtreme Reading, designed by the University of Kansas Center for Research on Learning. These programs were implemented in the study schools for two school years. The U.S. Department of Education's (ED) Office of Elementary and Secondary Education (OESE) funded the implementation of these programs, and its Institute of Education Sciences (IES) was responsible for oversight of the evaluation. MDRC--a nonprofit, nonpartisan education and social policy research organization--conducted the evaluation in partnership with the American Institutes for Research (AIR) and Survey Research Management (SRM). The goal of the reading interventions--which consist of a year-long course that replaces a ninth-grade elective class--is to help striving adolescent readers develop the strategies and routines used by proficient readers, thereby improving their reading skills and ultimately, their academic performance in high school. The first two reports for the study evaluated the programs' impact on the two most proximal outcomes targeted by the interventions--students' reading skills and their reading behaviors at the end of ninth grade. This report--which is the final of three reports for this evaluation--examines the impact of the ERO programs on the more general outcomes that the programs hope to affect--students' academic performance in high school (grade point average [GPA], credit accumulation, and state test scores) as well as students' behavioral outcomes (attendance and disciplinary infractions). These academic and behavioral outcomes are examined during the year in which they were enrolled in the ERO programs (ninth grade), as well as the following school year (tenth grade for most students). Appendices include: (1) The ERO Programs and the ERO Teachers; (2) ERO Student Survey Measures; (3) ERO Implementation Fidelity; (4) State Tests Included in the ERO Study; (5) Response Analysis and Baseline Comparison Tables; (6) Technical Notes for Impact Findings; (7) Statistical Power and Minimum Detectable Effect Size; (8) Supplementary Impact Findings; (9) Baseline and Impact Findings, by Cohort; (10) The Association Between Reading Outcomes and Academic Performance in High School; (11) Variation in Impacts Across Sites and Cohorts; (12) Program Costs; and (13) Poststudy Adolescent Literacy Programming in the ERO Schools: Methodology and Additional Findings. (Contains 97 tables, 23 figures, 2 boxes, and 185 footnotes.) [This paper was written with Edmond Wong. For the first-year report, see ED499778. For the second report, see ED503380.]
Reviews of Individual Studies 9 -1
The Enhanced Reading Opportunities Study Final Report: The Impact of Supplemental Literacy Courses for Struggling Ninth-Grade Readers. NCEE 2010-4021 (2010)
According to the National Assessment of Educational Progress (NAEP), just over 70 percent of students nationally arrive in high school with reading skills that are below "proficient"--defined as demonstrating competency over challenging subject matter. Of these students, nearly half do not exhibit even partial mastery of the knowledge and skills that are fundamental to proficient work at grade level. These limitations in literacy skills are a major source of course failure, high school dropout, and poor performance in postsecondary education. While research is beginning to emerge about the special needs of striving adolescent readers, very little is known about effective interventions aimed at addressing these needs. To help fill this gap and to provide evidence-based guidance to practitioners, the U.S. Department of Education initiated the Enhanced Reading Opportunities (ERO) study--a demonstration and rigorous evaluation of supplemental literacy programs targeted to ninth-grade students whose reading skills are at least two years below grade level. As part of this demonstration, 34 high schools from 10 school districts implemented one of two reading interventions: Reading Apprenticeship Academic Literacy (RAAL), designed by WestEd, and Xtreme Reading, designed by the University of Kansas Center for Research on Learning. These programs were implemented in the study schools for two school years. The U.S. Department of Education's (ED) Office of Elementary and Secondary Education (OESE) funded the implementation of these programs, and its Institute of Education Sciences (IES) was responsible for oversight of the evaluation. MDRC--a nonprofit, nonpartisan education and social policy research organization--conducted the evaluation in partnership with the American Institutes for Research (AIR) and Survey Research Management (SRM). The goal of the reading interventions--which consist of a year-long course that replaces a ninth-grade elective class--is to help striving adolescent readers develop the strategies and routines used by proficient readers, thereby improving their reading skills and ultimately, their academic performance in high school. The first two reports for the study evaluated the programs' impact on the two most proximal outcomes targeted by the interventions--students' reading skills and their reading behaviors at the end of ninth grade. This report--which is the final of three reports for this evaluation--examines the impact of the ERO programs on the more general outcomes that the programs hope to affect--students' academic performance in high school (grade point average [GPA], credit accumulation, and state test scores) as well as students' behavioral outcomes (attendance and disciplinary infractions). These academic and behavioral outcomes are examined during the year in which they were enrolled in the ERO programs (ninth grade), as well as the following school year (tenth grade for most students). Appendices include: (1) The ERO Programs and the ERO Teachers; (2) ERO Student Survey Measures; (3) ERO Implementation Fidelity; (4) State Tests Included in the ERO Study; (5) Response Analysis and Baseline Comparison Tables; (6) Technical Notes for Impact Findings; (7) Statistical Power and Minimum Detectable Effect Size; (8) Supplementary Impact Findings; (9) Baseline and Impact Findings, by Cohort; (10) The Association Between Reading Outcomes and Academic Performance in High School; (11) Variation in Impacts Across Sites and Cohorts; (12) Program Costs; and (13) Poststudy Adolescent Literacy Programming in the ERO Schools: Methodology and Additional Findings. (Contains 97 tables, 23 figures, 2 boxes, and 185 footnotes.) [This paper was written with Edmond Wong. For the first-year report, see ED499778. For the second report, see ED503380.]
Reviews of Individual Studies 9-12 -1
An Experiment to Evaluate the Efficacy of Cognitive Tutor Geometry (2010)
This randomized, controlled field trial estimated the causal impact of a technology-based geometry curriculum on students' geometry achievement, as well as their attitudes toward mathematics and technology. The curriculum combines learner-centered classroom pedagogy with individualized, computer-based student instruction. Conducted over a 3-year period in eight high schools within an urban fringe district, the study found that students assigned to the treatment curriculum scored 19% of a standard deviation lower on the geometry posttest than their counterparts assigned to the district's standard curriculum, but found no statistically significant impact on students' attitudes toward mathematics and technology. Researchers also collected observation and interview data on teachers' instructional practices. These data suggest that many teachers had difficulty implementing the treatment curriculum's learner-centered pedagogy. In fact, observed levels of learner-centered practices were only modestly higher in treatment classes than in control classes. In both treatment and control classes, however, higher levels of learner-centered pedagogy were associated with higher student achievement in geometry. (Contains 4 figures, 10 footnotes, and 5 tables.)
Reviews of Individual Studies 7-8 -1
The Relative Effects of Group Size on Reading Progress of Older Students with Reading Difficulties (2010)
This study reports findings on the relative effects from a yearlong secondary intervention contrasting large-group, small-group, and school-provided interventions emphasizing word study, vocabulary development, fluency, and comprehension with seventh- and eighth-graders with reading difficulties. Findings indicate that few statistically significant results or clinically significant gains were associated with group size or intervention. Findings also indicate that a significant acceleration of reading outcomes for seventh- and eighth-graders from high-poverty schools is unlikely to result from a 50 min daily class. Instead, the findings indicate, achieving this outcome will require more comprehensive models including more extensive intervention (e.g., more time, even smaller groups), interventions that are longer in duration (multiple years), and interventions that vary in emphasis based on specific students' needs (e.g., increased focus on comprehension or word study).
Reviews of Individual Studies 7-8 -1
The Relative Effects of Group Size on Reading Progress of Older Students with Reading Difficulties (2010)
This study reports findings on the relative effects from a yearlong secondary intervention contrasting large-group, small-group, and school-provided interventions emphasizing word study, vocabulary development, fluency, and comprehension with seventh- and eighth-graders with reading difficulties. Findings indicate that few statistically significant results or clinically significant gains were associated with group size or intervention. Findings also indicate that a significant acceleration of reading outcomes for seventh- and eighth-graders from high-poverty schools is unlikely to result from a 50 min daily class. Instead, the findings indicate, achieving this outcome will require more comprehensive models including more extensive intervention (e.g., more time, even smaller groups), interventions that are longer in duration (multiple years), and interventions that vary in emphasis based on specific students' needs (e.g., increased focus on comprehension or word study).
Reviews of Individual Studies 1-6 -1
Enhancing the Effectiveness of Special Education Programming for Children with Attention Deficit Hyperactivity Disorder Using a Daily Report Card (2010)
Children with attention deficit hyperactivity disorder (ADHD) make up a considerable proportion of students who receive special education services in schools. The present study aimed to enhance the outcomes of students with ADHD in special education settings by using a daily report card (DRC). Thirty-three children with ADHD in special education placements were randomly assigned to an intervention condition wherein behavioral consultants worked with the teacher and parent to construct and implement a DRC based on the child's individualized education plan goals and objectives. These children were compared to 30 children in a business as usual control condition. Results indicated positive effects of the DRC on observations of classroom functioning, individualized education plan goal attainment, and teacher ratings of academic productivity and disruptive behavior in the classroom. Further, a greater percentage of children with ADHD in the DRC group were normalized on measures of disruptive behavior and impairment. The intervention did not result in incremental improvement in academic achievement, teacher ratings of ADHD symptoms or impairment, or the student-teacher relationship. The implications of these results for working with children with ADHD in special education settings are discussed. (Contains 5 tables and 1 figure.)
Reviews of Individual Studies 1-5 -1
Pearson Investigations in Numbers, Data, & Space efficacy study: Final report (2010)
Reviews of Individual Studies 2 -1
A Control-Group Comparison of Two Reading Fluency Programs: The Helping Early Literacy with Practice Strategies (HELPS) Program and the Great Leaps K-2 Reading Program (2010)
Reading fluency is a critical component of effective reading instruction for students of early elementary age. However, national data suggest that 40% of U.S. fourth-grade students are nonfluent readers. Implementing evidence-based, time-efficient, and procedurally standardized instructional strategies may help address this problem. This study evaluates the efficacy of two such programs designed to supplement a core reading curriculum for all emerging readers: the Great Leaps K-2 Reading Program, which is currently used in schools throughout the United States, and the Helping Early Literacy With Practice Strategies (HELPS) Program, which was developed for the purposes of this study. Each program was implemented with second grade participants, and each program was evaluated against a wait-list control group. Results indicated that students receiving the HELPS Program scored significantly better than students in the control group across several measures of early reading, with effect sizes ranging from medium to large. No other statistically significant differences were found. Implications of these findings are discussed in terms of increasing the use of evidence-based reading practices in schools. (Contains 3 tables and 2 footnotes.)
Reviews of Individual Studies 1-2 -1
Achievement Effects of Four Early Elementary School Math Curricula: Findings for First and Second Graders. NCEE 2011-4001 (2010)
National achievement data show that elementary school students in the United States, particularly those from low socioeconomic backgrounds, have weak math skills (National Center for Education Statistics 2009). In fact, data show that, even before they enter elementary school, children from disadvantaged backgrounds are behind their more advantaged peers in basic competencies such as number-line ordering and magnitude comparison (Rathburn and West 2004). Furthermore, after a year of kindergarten, disadvantaged students still have less extensive knowledge of mathematics than their more affluent peers (Denton and West 2002). This study examines whether some early elementary school math curricula are more effective than others at improving student math achievement in disadvantaged schools. A small number of curricula, which are based on different approaches for developing student math skills, dominate elementary math instruction--7 curricula make up 91 percent of those used by K-2 educators, according to a 2008 survey (Resnick et al. 2010). Little rigorous evidence exists to support one approach over another, however, which means that research does not provide educators with much useful information when choosing a math curriculum to use. The key findings in this report include the following: (1) Teachers used their assigned curriculum, and the instructional approaches of the four curriculum groups differed as expected; (2) Math instruction varied in other notable ways across the curriculum groups; (3) In terms of student math achievement, the curriculum used by the study schools mattered; and (4) The curriculum used in different contexts also mattered, and some of these findings are consistent with findings based on all students whereas others are not. Appendices include: (1) Data Collection and Response Rates; (2) Teacher-Reported Frequency of Implementing Other Curriculum-Specific Activities; (3) Glossary of Curriculum-Specific Terms; and (4) Constructing the Analyses Samples and Estimating Curriculum Effects. (Contains 82 tables, 7 figures and 97 footnotes.) [For the executive summary, see ED512553.]
Reviews of Individual Studies 11-12 -1
Effects of Problem Based Economics on High School Economics Instruction. Final Report. NCEE 2010-4002 (2010)
Since 1995, the Buck Institute has partnered with university economists and expert teachers to create the Problem Based Economics curriculum. The curriculum was developed to respond to NCEE (National Council on Economic Education) standards, and it is supported by professional development for teachers. This study examines whether the Problem Based Economics curriculum developed by the Buck Institute for Education improves grade 12 students' content knowledge as measured by the Test of Economic Literacy, a test refined by NCEE over decades. Students' problem-solving skills in economics were also examined using a performance task assessment. In addition to the primary focus on student achievement outcomes, the study examined changes in teachers' content knowledge in economics and their pedagogical practices, as well as their satisfaction with the curriculum. From observations in intervention and control classrooms, it did not appear to the research team that having and using the problem-based learning curriculum automatically enforced a more hands-on, exploratory classroom learning style. Additional study in this area might help to refine the pedagogical strategies and allow for additional support and practice for teachers on implementing the curriculum effectively. Appendices include: (1) Study power estimates based on the final analytic samples; (2) Procedure for assigning new strata to the final analytic sample; (3) Scoring procedures for the performance task assessments; (4) Sample test/survey administration guide; (5) Teacher-level baseline equivalence tests; (6) Additional student-level baseline equivalence tests; (7) Estimation methods; (8) Summary statistics of teacher data from teacher surveys; (9) Sensitivity of impact estimates to alternative model specifications; and (10) Explanations for sample attrition. (Contains 7 figures, 35 tables, 2 boxes and 16 footnotes.)
Reviews of Individual Studies K-2 -1
Hispanic English Learners' Responses to Longitudinal English Instructional Intervention and the Effect of Gender: A Multilevel Analysis (2010)
This longitudinal study investigated 196 Hispanic English learners' responses to an English instructional intervention from kindergarten to second grade. The effect of student gender was also examined as a secondary focus. The intervention consisted of ongoing professional development and structured and systematic English intervention during an English as a second language (ESL) block. A multilevel modeling approach revealed that (a) the intervention effect was positive and significant, reflecting a range of phonological awareness, oral language skills, and decoding and reading proficiency, indicating the effectiveness of this intervention, and (b) that boys possessed more expressive vocabulary knowledge upon school entry and acquired receptive vocabulary faster than girls, while both girls and boys attained comparable levels of decoding skills and reading proficiency. We conclude that the effect of instructional intervention is stronger than the effect of gender. More well-planned, scientifically based research is needed to promote the linguistic development of English learners.
Reviews of Individual Studies K-4 -1
Reading and Language Outcomes of a Five-Year Randomized Evaluation of Transitional Bilingual Education (2010)
This paper reports the fifth-year results of a study comparing the English and Spanish language and reading performance of Spanish-dominant children randomly assigned beginning in kindergarten to Transitional Bilingual Education (TBE) or Structured English Immersion (SEI). This is the first randomized study to compare TBE and SEI reading approaches over a period as long as five years. As expected, on the Peabody Picture Vocabulary Test (PPVT) and its Spanish equivalent (TVIP) and on English and Spanish versions of three Woodcock Reading Scales, kindergartners and first graders in TBE performed significantly better in Spanish and worse in English than their SEI counterparts, controlling for PPVT and TVIP. After transitioning to English, TBE children in grades 2-4 scored significantly lower than those in SEI on the measure of receptive vocabulary, the PPVT, but there were no significant differences on most English reading measures. On the Spanish language (TVIP) and reading measures, TBE students scored significantly higher than SEI in grades K-3, but not grade 4. Both groups gained substantially in English receptive language skills over the years. These findings suggest that Spanish-dominant students learn to read in English (as well as Spanish) equally well in TBE and SEI. (Contains 4 tables.)
Reviews of Individual Studies K-8 -1
Teacher Incentive Pay and Educational Outcomes: Evidence from the NYC Bonus Program. Program on Education Policy and Governance Working Papers Series. PEPG 10-07 (2010)
Teacher compensation schemes are often criticized for lacking a performance-based component. Proponents of merit pay argue that linking teacher salaries to student achievement will incentivize teachers to focus on raising student achievement and stimulate innovation across the school system as a whole. In this paper, we utilize a policy experiment conducted in the New York City public school system to explore the effects of one performance-based bonus scheme. We investigate potential impacts of group-based incentive pay over two academic years (2007-2008 and 2008-2009) on a range of outcomes including: teacher effort, student performance in math and reading, and classroom activities, measured through environmental surveys of teachers and students. We also explore impacts on the market for teachers by examining teacher turnover and the qualifications of newly hired teachers. Overall, we find the bonus program had little impact on any of these outcomes. We argue that the lack of bonus program impacts can be explained by the structure of the bonus program. Group bonuses led to free-riding, which significantly reduced the program's incentives. Once we account for free-riding, we find evidence that the program led teachers to increase their effort through a significant reduction in absenteeism. When considering the effectiveness of performance-based teacher pay, the structure of incentives matter. (Contains 11 tables, 3 figures and 24 footnotes.)
Reviews of Individual Studies K-6 -1
Impact of a Social-Emotional and Character Development Program on School-Level Indicators of Academic Achievement, Absenteeism, and Disciplinary Outcomes: A Matched-Pair, Cluster-Randomized, Controlled Trial (2010)
This article reports the effects of a comprehensive elementary school-based social-emotional and character education program on school-level achievement, absenteeism, and disciplinary outcomes utilizing a matched-pair, cluster-randomized, controlled design. The "Positive Action" Hawai'i trial included 20 racially/ethnically diverse schools (M enrollment = 544) and was conducted from the 2002-03 through the 2005-06 academic years. Using school-level archival data, analyses comparing change from baseline (2002) to 1-year posttrial (2007) revealed that intervention schools scored 9.8% better on the TerraNova (2nd ed.) test for reading and 8.8% on math, that 20.7% better in Hawai'i Content and Performance Standards scores for reading and 51.4% better in math, and that intervention schools reported 15.2% lower absenteeism and fewer suspensions (72.6%) and retentions (72.7%). Overall, effect sizes were moderate to large (range = 0.5-1.1) for all of the examined outcomes. Sensitivity analyses using permutation models and random-intercept growth curve models substantiated results. The results provide evidence that a comprehensive school-based program, specifically developed to target student behavior and character, can positively influence school-level achievement, attendance, and disciplinary outcomes concurrently. (Contains 6 tables and 2 figures.)
Reviews of Individual Studies K-6 -1
Impacts of comprehensive teacher induction: Final results from a randomized controlled study (NCEE 2010-4027). (2010)
In 2004, the U.S. Department of Education's Institute of Education Sciences contracted with Mathematica Policy Research to conduct a large-scale evaluation of comprehensive teacher induction. The purpose of the study was to determine whether augmenting the set of services districts usually provide to support beginning teachers with a more comprehensive program improves teacher and student outcomes. This is the study's third and final report on the program's impacts. This report compares retention, achievement, and classroom practices of teachers who were offered comprehensive induction services to teachers who were offered the support normally offered by the school. Teachers assigned to receive comprehensive induction for either one or two years were supported by a full-time mentor who received ongoing training and materials to support the teachers' development. The teachers also were offered monthly professional development sessions and opportunities to observe veteran teachers. The teachers were followed for three years. Data was collected from 1,009 beginning teachers in 418 schools in 17 districts. Districts included in the study were not already offering comprehensive induction services, including paying for full-time mentors. Novice teachers in approximately half of the schools were assigned by lottery to receive comprehensive induction services. In 10 of the districts, these teachers were provided one year of comprehensive induction services; in the remaining 7 districts, the teachers were provided two years of services. Teachers in the schools not assigned to receive comprehensive induction services were provided the support normally offered to novice teachers by the school. Teacher practices were measured via classroom observations conducted in the spring of 2006. Data on teacher retention were collected via surveys administered in the fall of 2006, 2007, and 2008. Student test scores were collected from district administrative records for the 2005-06, 2006-07, and 2007-08 school years. Key findings include: (1) During the comprehensive induction program, treatment teachers received more support than control teachers; (2) The extra induction support for treatment teachers did not translate into impacts on classroom practices in the first year; (3) For teachers who received one year of comprehensive induction, there was no impact on student achievement; (4) For teachers who received two years of comprehensive induction, there was no impact on student achievement in the first two years. In the third year, there was a positive and statistically significant impact on student achievement; and (5) Neither exposure to one year nor exposure to two years of comprehensive induction had a positive impact on retention or other teacher workforce outcomes. The following are appended: (1) Supplemental Information for Chapters II and III; (2) Supplemental Information for Chapter IV; (3) Sensitivity Analyses and Supplemental Information for Chapter V; and (4) Sensitivity Analyses and Supplemental Information for Chapter VI.
Reviews of Individual Studies K-1 -1
Function-Based Planning for Young Children at Risk for Emotional and Behavioral Disorders (2010)
This study examined the efficacy of function-based intervention for young children at-risk for emotional and behavioral disorders (EBD) in inclusive environments. Participants were two kindergarten students and one first-grade student, all of whom exhibited chronic disruptive behavior in the classroom despite previous interventions implemented through their school's existing behavioral support system. The study was conducted across three phases: (a) a descriptive functional behavioral assessment (FBA) was completed for each student, (b) a systematic process was used to construct and then test individualized interventions, and (c) the interventions were then provided to each student during his most problematic classroom activity using a multiple baseline design. Classroom interventions substantially improved the on-task behavior of each student, and social validity ratings by teachers showed strong preference for the function-based intervention over the previously used classroom practices. Implications, limitations, and directions for future research are presented. (Contains 3 tables and 2 figures.)
Reviews of Individual Studies K -1
Classwide Intervention to Manage Disruptive Behavior in the Kindergarten Classroom (2010)
The authors present an investigation of a classwide intervention to reduce disruptive behavior in a kindergarten classroom. Participants included children in 3 kindergarten classrooms and their teachers in an at-risk school district in Northeast Ohio. On the basis of student behaviors and teacher goals, the authors chose the Good Behavior Game plus Plus Merit. A total of 3 teachers implemented the Good Behavior Game Plus Merit in the classroom. The authors used a single-subject reversal design (ABAB) to test experimental control. They collected direct observations of student behavior during each phase of the intervention. Results indicated a decrease in negative, disruptive behavior during intervention. Last, the authors discuss the implications for implementing this intervention in the kindergarten classroom. (Contains 1 table and 1 figure.)
Reviews of Individual Studies 9-12 -1
Findings from the Institute for Student Achievement Outcome Evaluation: Final report. (2010)
Reviews of Individual Studies 9-PS -1
Longer-term impacts of mentoring, educational services, and incentives to learn: Evidence from a randomized trial in the United States (2010)
Reviews of Individual Studies 9-12 -1
The Efficacy of Repeated Reading and Wide Reading Practice for High School Students with Severe Reading Disabilities (2010)
This experimental study was conducted to examine the efficacy of repeated reading and wide reading practice interventions for high school students with severe reading disabilities. Effects on comprehension, fluency, and word reading were evaluated. Participants were 96 students with reading disabilities in grades 9-12. Students were paired within classes and pairs were randomly assigned to one of three groups: repeated reading (N = 33), wide reading (N = 34), or typical instruction (N = 29). Intervention was provided daily for approximately 15-20 minutes for 10 weeks. Results indicated no overall statistically significant differences for any condition, with effect sizes ranging from -0.31 to 0.27. Findings do not support either approach for severely impaired readers at the high school level. We hypothesize that these students require more intensive interventions that include direct and explicit instruction in word- and text-level skills as well as engaged reading practice with effective feedback.
Reviews of Individual Studies 9-12 -1
Writing learning journals: Instructional support to overcome learning-strategy deficits. (2010)
Although writing learning journals is a powerful learning tool, instructional support is needed to overcome deficits in the use of self-regulated learning strategies. In a 2 x 2 experimental design with high-school students (N = 70), we analysed the effects of two modes of instruction (namely, informed prompting and learning-journal example) along with prompts. Informed prompting that provided background information on the prompted strategies enhanced learning in the training and transfer session. A learning-journal example that modelled the application of the strategies primarily fostered the strategy used in the training session and learning in the transfer session. Theoretically, the results provide support for the self-regulation view of writing-to-learn. (Contains 1 figure and 2 tables.)
Reviews of Individual Studies 9-12 -1
Integrating literacy and science instruction in high school biology: Impact on teacher practice, student engagement, and student achievement. (2009)
Reviews of Individual Studies K-5 -1
An Evaluation of Teachers Trained through Different Routes to Certification. Final Report. NCEE 2009-4043 (2009)
This study addresses two questions related to teacher preparation and certification: (1) What are the relative effects on student achievement of teachers who chose to be trained through different routes to certification and how do observed teacher practices vary by chosen route to certification?; and (2) What aspects of certification programs (such as the amount of coursework, the timing of coursework relative to being the lead teacher in the classroom, the core coursework content) are associated with teacher effectiveness? In 63 study schools, every grade that contained at least one eligible alternatively certified (AC) and one eligible traditionally certified (TC) teacher was included. Students in these study grades were randomly assigned to be in the class of an AC or a TC teacher. Students were tested at the beginning of the school year as a baseline measure and at the end of the year as an outcome. Classroom instruction was observed at one point during the year as an outcome. Reported findings include: (1) Both the AC and the TC programs with teachers in the study were diverse in the total instruction they required for their candidates; (2) While teachers trained in TC programs receive all their instruction (and participate in student teaching) prior to becoming regular full-time teachers, AC teachers do not necessarily begin teaching without having received any formal instruction; (3) There were no statistically significant differences between the AC and TC teachers in this study in their average scores on college entrance exams, the selectivity of the college that awarded their bachelor's degree, or their level of educational attainment; (4) There was no statistically significant difference in performance between students of AC teachers and those of TC teachers; (5) There is no evidence from this study that greater levels of teacher training coursework were associated with the effectiveness of AC teachers in the classroom; and (6) There is no evidence that the content of coursework is correlated with teacher effectiveness. Supplementary Technical Information on Data Collection, Response Rates, and Analyses is appended. (Contains 90 footnotes and 28 exhibits.)
Reviews of Individual Studies 10-12 -1
Using linear regression and propensity score matching to estimate the effect of coaching on the SAT. (2009)
Reviews of Individual Studies 1 -1
When Schools Close: Effects on Displaced Students in Chicago Public Schools. Research Report (2009)
Few decisions by a school district are more controversial than the decision to close a school. School staff, students and their families, and even the local community all bear a substantial burden once the decision is made to close a school. Since 2001, Chicago Public Schools (CPS) has closed 44 schools for reasons of poor academic performance or underutilization. Despite the attention that school closings have received in the past few years, very little is known about how displaced students fare after their schools are closed. This report examines the impact that closing schools had on the students who attended these schools. The authors focus on regular elementary schools that were closed between 2001 and 2006 for underutilization or low performance and ask whether students who were forced to leave these schools and enroll elsewhere experienced any positive or negative effects from this type of school move. They look at a number of student outcomes, including reading and math achievement, special education referrals, retentions, summer school attendance, mobility, and high school performance. They also examine characteristics of the receiving schools and ask whether differences in these schools had any impact on the learning experiences of students who transferred into them. The authors report six major findings: (1) Most students who transferred out of closing schools reenrolled in schools that were academically weak; (2) The largest negative impact of school closings on students' reading and math achievement occurred in the year before the schools were closed; (3) Once students left schools slated for closing, on average the additional effects on their learning were neither negative nor positive; (4) Although the school closing policy had only a small overall effect on student test scores, it did affect summer school enrollment and subsequent school mobility; (5) When displaced students reached high school, their on-track rates to graduate were no different than the rates of students who attended schools similar to those that closed; and (6) The learning outcomes of displaced students depended on the characteristics of receiving schools. Overall, they found few effects, either positive or negative, of school closings on the achievement of displaced students. Appended are: (1) School Closings and New Openings; and (2) Data, Analytic Methods, and Variables Used. (Contains 5 tables, 12 figures and 53 endnotes.)[For the (What Works Clearinghouse (WWC) Quick Review of this report, see ED510790.]
Reviews of Individual Studies 11-12 -1
Reengaging High School Dropouts: Early Results of the National Guard Youth ChalleNGe Program Evaluation. Full Report (2009)
High school dropouts face daunting odds of success in a labor market that increasingly rewards education and skills. This report presents very early results from a rigorous, independent evaluation of the National Guard Youth ChalleNGe Program, an intensive residential program that aims to "reclaim the lives" of young people ages 16 to 18 who have dropped out of school. ChalleNGe currently operates in more than half the states. About 75,000 young people have completed the program since the early 1990s. MDRC, a nonprofit, nonpartisan research organization, is conducting the evaluation, along with the MacArthur Foundation's Research Network on Transitions to Adulthood. The 17-month ChalleNGe program is divided into three phases: Pre-ChalleNGe, which is a two-week orientation and assessment period; a 20-week Residential Phase built around eight core components designed to promote positive youth development; and a one-year Postresidential Phase featuring a structured mentoring program. During the first two phases, participants in the program live at the program site, often on a military base. The environment is described as "quasi-military," though there are no requirements for military service. The evaluation uses a random assignment research design. Because there were more qualified applicants than slots, a lottery-like process was used to decide which applicants were admitted to the program. The young people who were admitted (the program group) are being compared over time with those who were not admitted (the control group); any significant differences that emerge between the groups can be attributed to ChalleNGe. About 3,000 young people entered the study in 10 ChalleNGe programs in 2005-2006. Early results find that the program group was much more likely than the control group to have obtained a high school diploma or a General Educational Development certificate (GED). The program group was more likely than the control group to be working and attending college; members of the control group were more likely to have returned to high school. The program group reported better health and higher levels of self-efficacy and were less likely to have been arrested. It is too early to draw any conclusions about the long-term effects of ChalleNGe. Nevertheless, the early results suggest that partway through their ChalleNGe experience, young people in the program group are better positioned to move forward in their transition to adulthood. Results from an 18-month survey will be available in late 2009. This report divides into four chapters. Following an Introduction, Chapter 2 describes the young people who are participating in the study and the ChalleNGe staff. Chapter 3, based largely on visits to the programs, describes how ChalleNGe operates in the participating sites. Sections focus on how participants are recruited and enrolled, the Pre-ChalleNGe Phase, the Residential Phase and the eight core components, and the Postresidential Phase and the mentoring program. Chapter 4 uses data from the ChalleNGe management information system to describe the extent to which program group members participated in ChalleNGe, and also draws from the nine-month survey to present some very early evidence about the program's effects on education, employment, and health outcomes. (Contains 13 tables and 4 figures.) [Additional funding for this report was provided by the MCJ Foundation. For the Executive Summary, see ED504644.]
Reviews of Individual Studies 1-3 -1
Evaluation of Experience Corps: Student reading outcomes. (2009)
Reviews of Individual Studies 2 -1
A Randomized Field Trial of the Fast ForWord Language Computer-Based Training Program (2009)
This article describes an independent assessment of the Fast ForWord Language computer-based training program developed by Scientific Learning Corporation. Previous laboratory research involving children with language-based learning impairments showed strong effects on their abilities to recognize brief and fast sequences of nonspeech and speech stimuli, but generalization of these effects beyond clinical settings and student populations and to broader literacy measures remains unclear. Implementing a randomized field trial in eight urban schools, we generated impact estimates from separate intent-to-treat and treatment-on-the-treated analyses of the literacy outcomes of second- and seventh-grade students who were more generally at risk for poor reading and language outcomes. There were some problems of implementation in the field setting, and the Fast ForWord Language program did not, in general, help students in these eight schools improve their language and reading comprehension test scores. (Contains 6 notes and 10 tables.)
Reviews of Individual Studies 2 -1
Embedding reading comprehension training in content-area instruction. (2009)
This study evaluated the effectiveness of comprehension training embedded in a program that taught science content to 2nd graders. The program included instruction about the structure of compare-contrast expository text, emphasizing clue words, generic questions, graphic organizers, and the close analysis of well-structured text exemplars. This program was compared with a program that focused on the science content but included no compare-contrast training as well as with a no-instruction control. Regular classroom teachers (14 from 4 schools), randomly assigned to treatment, provided the instruction; 215 students (7-8 years old) participated. The study replicated acquisition and transfer effects found in an earlier study, that is, transfer to compare-contrast text with content related and unrelated to the instructional content (with no loss in the amount of science content acquired). The program also led to better performance on written and oral response measures and on 1 of the 2 measures involving authentic (less well-structured) compare-contrast text. These findings support and extend previous findings that explicit instruction in comprehension is effective as early as the primary-grade level. (Contains 6 tables, 1 figure, and 1 footnote.)
Reviews of Individual Studies 2 -1
The Role of Working Memory and Fluency Practice on the Reading Comprehension of Students Who Are Dysfluent Readers (2009)
The authors investigated whether practice in reading fluency had a causal influence on the relationship between working memory (WM) and text comprehension for 155 students in Grades 2 and 4 who were poor or average readers. Dysfluent readers were randomly assigned to repeated reading or continuous reading practice conditions and compared with untreated dysfluent and fluent readers on posttest measures of fluency, word identification, vocabulary, and reading comprehension. Three main findings emerged: (a) The influence of WM on text comprehension was not related to fluency training, (b) dysfluent readers in the continuous-reading condition had higher posttest scores than dysfluent readers in the other conditions on measures of text comprehension but not on vocabulary, and (c) individual differences in WM better predicted posttest comprehension performance than word-attack skills. In general, the results suggested that although continuous reading increased comprehension, fluency practice did not compensate for WM demands. The results were interpreted within a model that viewed reading comprehension processes as competing for a limited supply of WM resources that operate independent of fluency. (Contains 9 tables and 2 notes.)
Reviews of Individual Studies 2 -1
The Role of Working Memory and Fluency Practice on the Reading Comprehension of Students Who Are Dysfluent Readers (2009)
The authors investigated whether practice in reading fluency had a causal influence on the relationship between working memory (WM) and text comprehension for 155 students in Grades 2 and 4 who were poor or average readers. Dysfluent readers were randomly assigned to repeated reading or continuous reading practice conditions and compared with untreated dysfluent and fluent readers on posttest measures of fluency, word identification, vocabulary, and reading comprehension. Three main findings emerged: (a) The influence of WM on text comprehension was not related to fluency training, (b) dysfluent readers in the continuous-reading condition had higher posttest scores than dysfluent readers in the other conditions on measures of text comprehension but not on vocabulary, and (c) individual differences in WM better predicted posttest comprehension performance than word-attack skills. In general, the results suggested that although continuous reading increased comprehension, fluency practice did not compensate for WM demands. The results were interpreted within a model that viewed reading comprehension processes as competing for a limited supply of WM resources that operate independent of fluency. (Contains 9 tables and 2 notes.)
Reviews of Individual Studies 2-4 -1
Improving Reading Fluency and Comprehension in Elementary Students Using Read Naturally (2009)
Difficulty learning how to read is a risk factor for school failure, low grades, behavior problems, juvenile delinquency, truancy, unemployment, jail time, and substance abuse. Reading difficulties are common in the educational setting, afflicting anywhere from 20-40 percent of students. Read Naturally is a computer-based reading program which targets the third "big idea" (i.e., accuracy and fluency with reading). The current study assessed the efficacy of the Read Naturally program in second through fourth grade elementary students in a public elementary school. Additionally, this study assessed whether improving reading abilities resulted in changes in classroom behavior problems or self-esteem. Eighty-two students from a small, public elementary school who were in need of additional reading support, according to the DIBELS Benchmark Assessments, participated in the current study. Students were matched on DIBELS scores, grade, race, and gender and then randomly assigned to either the Read Naturally condition or the Education as Usual condition. Students used the Read Naturally program for 30-45 minutes each day, five days a week, for eight weeks. Results suggested that, throughout the 16 weeks of intervention, significant improvements were generally seen on all of the reading measures over time, regardless of the condition to which students were assigned, although small effect sizes generally favored the Read Naturally intervention. Additionally, students in higher grades generally demonstrated more improvement on the WJ-III Summary Scores, WJ-III Passage Comprehension subscale, and the WJ-III Word Attack subscale, regardless of the condition to which they were assigned. Student measures suggest that Read Naturally does not result in increased self-esteem, even with improvements in academic performance. Behavior measures were inconclusive. Generally, the effects of the Read Naturally intervention appear discernible, but not incremental, suggesting that Read Naturally may not be more efficacious than typical education, but may have benefits in terms of targeting larger groups of students, being individualized to each student, and may allow another way for teachers to target the third "big idea." Future research is warranted. [The dissertation citations contained here are published with the permission of ProQuest LLC. Further reproduction is prohibited without permission. Copies of dissertations may be obtained by Telephone (800) 1-800-521-0600. Web page: http://www.proquest.com/en-US/products/dissertations/individuals.shtml.]
Reviews of Individual Studies 3 -1
Effects of Fact Retrieval Tutoring on Third-Grade Students with Math Difficulties with and without Reading Difficulties (2009)
The purpose of this study was to assess the efficacy of fact retrieval tutoring as a function of math difficulty (MD) subtype, that is, whether students have MD alone (MD-only) or have concurrent difficulty with math and reading (MDRD). Third graders (n = 139) at two sites were randomly assigned, blocking by site and MD subtype, to four tutoring conditions: fact retrieval practice, conceptual fact retrieval instruction with practice, procedural computation/estimation instruction, and control (no tutoring). Tutoring occurred for 45 sessions over 15 weeks for 15-25 minutes per session. Results provided evidence of an interaction between tutoring condition and MD subtype status for assessment of fact retrieval. For MD-only students, students in both fact retrieval conditions achieved comparably and outperformed MD-only students in the control group as well as those in the procedural computation/estimation instruction group. By contrast, for MDRD students, there were no significant differences among intervention conditions.
Reviews of Individual Studies 1 -1
Effectiveness of Reading and Mathematics Software Products: Findings From Two Student Cohorts. NCEE 2009-4041 (2009)
In the No Child Left Behind Act (NCLB), Congress called for the U.S. Department of Education (ED) to conduct a rigorous study of the conditions and practices under which educational technology is effective in increasing student academic achievement. A 2007 report presenting study findings for the 2004-2005 school year, indicated that, after one school year, differences in student test scores were not statistically significant between classrooms that were randomly assigned to use software products and those that were randomly assigned not to use products. School and teacher characteristics generally were not related to whether products were effective. The second year of the study examined whether an additional year of teaching experience using the software products increased the estimated effects of software products on student test scores. The evidence for this hypothesis is mixed. For reading, there were no statistically significant differences between the effects that products had on standardized student test scores in the first year and the second year. For sixth grade math, product effects on student test scores were statistically significantly lower (more negative) in the second year than in the first year, and for algebra I, effects on student test scores were statistically significantly higher in the second year than in the first year. The study also tested whether using any of the 10 software products increased student test scores. One product had a positive and statistically significant effect. Nine did not have statistically significant effects on test scores. Five of the insignificant effects were negative and four were positive. Study findings should be interpreted in the context of design and objectives. The study examined a range of reading and math software products in a range of diverse school districts and schools. But it did not study many forms of educational technology and it did not include many types of software products. How much information the findings provide about the effectiveness of products that are not in the study is an open question. Products in the study also were implemented in a specific set of districts and schools, and other districts and schools may have different experiences with the products. The findings should be viewed as one element within a larger set of research studies that have explored the effectiveness of software products. Three appendixes are included: (1) Second-Year Data Collection and Response Rates; (2) Description of Sample for the 10 Products; and (3) Details of Estimation Methods. (Contains 29 footnotes, 4 figures and 24 tables.
Reviews of Individual Studies 1 -1
Effectiveness of Reading and Mathematics Software Products: Findings From Two Student Cohorts. NCEE 2009-4041 (2009)
In the No Child Left Behind Act (NCLB), Congress called for the U.S. Department of Education (ED) to conduct a rigorous study of the conditions and practices under which educational technology is effective in increasing student academic achievement. A 2007 report presenting study findings for the 2004-2005 school year, indicated that, after one school year, differences in student test scores were not statistically significant between classrooms that were randomly assigned to use software products and those that were randomly assigned not to use products. School and teacher characteristics generally were not related to whether products were effective. The second year of the study examined whether an additional year of teaching experience using the software products increased the estimated effects of software products on student test scores. The evidence for this hypothesis is mixed. For reading, there were no statistically significant differences between the effects that products had on standardized student test scores in the first year and the second year. For sixth grade math, product effects on student test scores were statistically significantly lower (more negative) in the second year than in the first year, and for algebra I, effects on student test scores were statistically significantly higher in the second year than in the first year. The study also tested whether using any of the 10 software products increased student test scores. One product had a positive and statistically significant effect. Nine did not have statistically significant effects on test scores. Five of the insignificant effects were negative and four were positive. Study findings should be interpreted in the context of design and objectives. The study examined a range of reading and math software products in a range of diverse school districts and schools. But it did not study many forms of educational technology and it did not include many types of software products. How much information the findings provide about the effectiveness of products that are not in the study is an open question. Products in the study also were implemented in a specific set of districts and schools, and other districts and schools may have different experiences with the products. The findings should be viewed as one element within a larger set of research studies that have explored the effectiveness of software products. Three appendixes are included: (1) Second-Year Data Collection and Response Rates; (2) Description of Sample for the 10 Products; and (3) Details of Estimation Methods. (Contains 29 footnotes, 4 figures and 24 tables.
Reviews of Individual Studies 1 -1
Effectiveness of Reading and Mathematics Software Products: Findings From Two Student Cohorts. NCEE 2009-4041 (2009)
In the No Child Left Behind Act (NCLB), Congress called for the U.S. Department of Education (ED) to conduct a rigorous study of the conditions and practices under which educational technology is effective in increasing student academic achievement. A 2007 report presenting study findings for the 2004-2005 school year, indicated that, after one school year, differences in student test scores were not statistically significant between classrooms that were randomly assigned to use software products and those that were randomly assigned not to use products. School and teacher characteristics generally were not related to whether products were effective. The second year of the study examined whether an additional year of teaching experience using the software products increased the estimated effects of software products on student test scores. The evidence for this hypothesis is mixed. For reading, there were no statistically significant differences between the effects that products had on standardized student test scores in the first year and the second year. For sixth grade math, product effects on student test scores were statistically significantly lower (more negative) in the second year than in the first year, and for algebra I, effects on student test scores were statistically significantly higher in the second year than in the first year. The study also tested whether using any of the 10 software products increased student test scores. One product had a positive and statistically significant effect. Nine did not have statistically significant effects on test scores. Five of the insignificant effects were negative and four were positive. Study findings should be interpreted in the context of design and objectives. The study examined a range of reading and math software products in a range of diverse school districts and schools. But it did not study many forms of educational technology and it did not include many types of software products. How much information the findings provide about the effectiveness of products that are not in the study is an open question. Products in the study also were implemented in a specific set of districts and schools, and other districts and schools may have different experiences with the products. The findings should be viewed as one element within a larger set of research studies that have explored the effectiveness of software products. Three appendixes are included: (1) Second-Year Data Collection and Response Rates; (2) Description of Sample for the 10 Products; and (3) Details of Estimation Methods. (Contains 29 footnotes, 4 figures and 24 tables.
Reviews of Individual Studies 1 -1
Effectiveness of Reading and Mathematics Software Products: Findings From Two Student Cohorts. NCEE 2009-4041 (2009)
In the No Child Left Behind Act (NCLB), Congress called for the U.S. Department of Education (ED) to conduct a rigorous study of the conditions and practices under which educational technology is effective in increasing student academic achievement. A 2007 report presenting study findings for the 2004-2005 school year, indicated that, after one school year, differences in student test scores were not statistically significant between classrooms that were randomly assigned to use software products and those that were randomly assigned not to use products. School and teacher characteristics generally were not related to whether products were effective. The second year of the study examined whether an additional year of teaching experience using the software products increased the estimated effects of software products on student test scores. The evidence for this hypothesis is mixed. For reading, there were no statistically significant differences between the effects that products had on standardized student test scores in the first year and the second year. For sixth grade math, product effects on student test scores were statistically significantly lower (more negative) in the second year than in the first year, and for algebra I, effects on student test scores were statistically significantly higher in the second year than in the first year. The study also tested whether using any of the 10 software products increased student test scores. One product had a positive and statistically significant effect. Nine did not have statistically significant effects on test scores. Five of the insignificant effects were negative and four were positive. Study findings should be interpreted in the context of design and objectives. The study examined a range of reading and math software products in a range of diverse school districts and schools. But it did not study many forms of educational technology and it did not include many types of software products. How much information the findings provide about the effectiveness of products that are not in the study is an open question. Products in the study also were implemented in a specific set of districts and schools, and other districts and schools may have different experiences with the products. The findings should be viewed as one element within a larger set of research studies that have explored the effectiveness of software products. Three appendixes are included: (1) Second-Year Data Collection and Response Rates; (2) Description of Sample for the 10 Products; and (3) Details of Estimation Methods. (Contains 29 footnotes, 4 figures and 24 tables.
Reviews of Individual Studies 1 -1
Identifying essential instructional components of literacy tutoring for struggling beginning readers. (2009)
This study examined the components of a one-on-one literacy tutoring model to identify the necessary and sufficient elements for helping struggling beginning readers. The tutoring components of interest included word work using manipulative letters, written word work, and a generalization component. Reading assessment data from 100 first-grade students, randomly assigned to four tutoring conditions and a control group, were analyzed. Following the treatment period, groups were evaluated on phonological awareness, sight word knowledge, decoding, and word attack. Results indicated that children who received all of the tutoring components performed better than those in the control condition across all four reading performance indicators under consideration. (Contains 5 tables.)
Reviews of Individual Studies 7-8 -1
The importance of prior knowledge when comparing examples: Influences on conceptual and procedural knowledge of equation solving. (2009)
Comparing multiple examples typically supports learning and transfer in laboratory studies and is considered a key feature of high-quality mathematics instruction. This experimental study investigated the importance of prior knowledge in learning from comparison. Seventh- and 8th-grade students (N = 236) learned to solve equations by comparing different solution methods to the same problem, comparing different problem types solved with the same solution method, or studying the examples sequentially. Unlike in past studies, many students did not begin the study with equation-solving skills, and prior knowledge of algebraic methods was an important predictor of learning. Students who did not attempt algebraic methods at pretest benefited most from studying examples sequentially or comparing problem types, rather than from comparing solution methods. Students who attempted algebraic methods at pretest learned more from comparing solution methods. Students may need sufficient prior knowledge in a domain before they benefit from comparing alternative solution methods. These findings are in line with findings on the expertise-reversal effect. (Contains 2 figures and 6 tables.)
Reviews of Individual Studies 7-9 -1
Accelerated Math evaluation report (Middle school sample). (2009)
Reviews of Individual Studies 8-9 -1
Effectiveness of Reading and Mathematics Software Products: Findings From Two Student Cohorts. NCEE 2009-4041 (2009)
In the No Child Left Behind Act (NCLB), Congress called for the U.S. Department of Education (ED) to conduct a rigorous study of the conditions and practices under which educational technology is effective in increasing student academic achievement. A 2007 report presenting study findings for the 2004-2005 school year, indicated that, after one school year, differences in student test scores were not statistically significant between classrooms that were randomly assigned to use software products and those that were randomly assigned not to use products. School and teacher characteristics generally were not related to whether products were effective. The second year of the study examined whether an additional year of teaching experience using the software products increased the estimated effects of software products on student test scores. The evidence for this hypothesis is mixed. For reading, there were no statistically significant differences between the effects that products had on standardized student test scores in the first year and the second year. For sixth grade math, product effects on student test scores were statistically significantly lower (more negative) in the second year than in the first year, and for algebra I, effects on student test scores were statistically significantly higher in the second year than in the first year. The study also tested whether using any of the 10 software products increased student test scores. One product had a positive and statistically significant effect. Nine did not have statistically significant effects on test scores. Five of the insignificant effects were negative and four were positive. Study findings should be interpreted in the context of design and objectives. The study examined a range of reading and math software products in a range of diverse school districts and schools. But it did not study many forms of educational technology and it did not include many types of software products. How much information the findings provide about the effectiveness of products that are not in the study is an open question. Products in the study also were implemented in a specific set of districts and schools, and other districts and schools may have different experiences with the products. The findings should be viewed as one element within a larger set of research studies that have explored the effectiveness of software products. Three appendixes are included: (1) Second-Year Data Collection and Response Rates; (2) Description of Sample for the 10 Products; and (3) Details of Estimation Methods. (Contains 29 footnotes, 4 figures and 24 tables.
Reviews of Individual Studies 8-9 -1
Effectiveness of Reading and Mathematics Software Products: Findings From Two Student Cohorts. NCEE 2009-4041 (2009)
In the No Child Left Behind Act (NCLB), Congress called for the U.S. Department of Education (ED) to conduct a rigorous study of the conditions and practices under which educational technology is effective in increasing student academic achievement. A 2007 report presenting study findings for the 2004-2005 school year, indicated that, after one school year, differences in student test scores were not statistically significant between classrooms that were randomly assigned to use software products and those that were randomly assigned not to use products. School and teacher characteristics generally were not related to whether products were effective. The second year of the study examined whether an additional year of teaching experience using the software products increased the estimated effects of software products on student test scores. The evidence for this hypothesis is mixed. For reading, there were no statistically significant differences between the effects that products had on standardized student test scores in the first year and the second year. For sixth grade math, product effects on student test scores were statistically significantly lower (more negative) in the second year than in the first year, and for algebra I, effects on student test scores were statistically significantly higher in the second year than in the first year. The study also tested whether using any of the 10 software products increased student test scores. One product had a positive and statistically significant effect. Nine did not have statistically significant effects on test scores. Five of the insignificant effects were negative and four were positive. Study findings should be interpreted in the context of design and objectives. The study examined a range of reading and math software products in a range of diverse school districts and schools. But it did not study many forms of educational technology and it did not include many types of software products. How much information the findings provide about the effectiveness of products that are not in the study is an open question. Products in the study also were implemented in a specific set of districts and schools, and other districts and schools may have different experiences with the products. The findings should be viewed as one element within a larger set of research studies that have explored the effectiveness of software products. Three appendixes are included: (1) Second-Year Data Collection and Response Rates; (2) Description of Sample for the 10 Products; and (3) Details of Estimation Methods. (Contains 29 footnotes, 4 figures and 24 tables.
Reviews of Individual Studies 9-10 -1
Evaluation of LANGUAGE! in Miami-Dade County Public Schools: Final report. (2009)
Reviews of Individual Studies 9 -1
The Enhanced Reading Opportunities Study: Findings from the Second Year of Implementation (2009)
Unfortunately, little is known about school-based interventions that address the needs of struggling adolescent readers. To help fill these gaps in knowledge and to provide evidence-based guidance to practitioners, the U.S. Department of Education initiated the Enhanced Reading Opportunities (ERO) Study--a demonstration and random assignment evaluation of supplemental literacy programs targeted to ninth grade students with limited literacy skills. The demonstration involves 34 high schools from 10 school districts that are implementing one of two supplemental literacy programs: Reading Apprenticeship Academic Literacy (RAAL), designed by WestEd, or Xtreme Reading, designed by the University of Kansas Center for Research on Learning. The programs are supplemental as they consist of a year-long course that replaces a ninth-grade elective class and not a core academic class. They aim to help striving adolescent readers develop and apply the strategies and routines used by proficient readers and to motivate them to read more. The literacy programs were implemented in school years 2005-2006 and 2006-2007, resulting in two cohorts of ninth-grade participants. The U.S. Department of Education's Office of Elementary and Secondary Education (OESE) provided direct support for implementation to the participating schools and districts, while the Institute of Education Sciences has been funding and overseeing the design and execution of the evaluation effort. MDRC, a nonprofit, nonpartisan social policy research organization, is conducting the evaluation in partnership with the American Institutes for Research and Survey Research Management. The study's first report described the first year of implementation of the ERO programs and presented impact findings for the first cohort of ninth-grade students (2005-06). The key impact finding was that overall, the ERO programs improved students' reading comprehension test by 0.09 standard deviation (p-value = 0.019). Although not statistically significant, the estimated impact of each literacy intervention (Xtreme Reading, RAAL) was also 0.09 standard deviation. This conference paper will present findings from the second report for the ERO study, which examined implementation and impacts for the second year of program operation. (Contains 1 table, 1 figure and 10 footnotes.)
Reviews of Individual Studies 7 -1
A Randomized Field Trial of the Fast ForWord Language Computer-Based Training Program (2009)
This article describes an independent assessment of the Fast ForWord Language computer-based training program developed by Scientific Learning Corporation. Previous laboratory research involving children with language-based learning impairments showed strong effects on their abilities to recognize brief and fast sequences of nonspeech and speech stimuli, but generalization of these effects beyond clinical settings and student populations and to broader literacy measures remains unclear. Implementing a randomized field trial in eight urban schools, we generated impact estimates from separate intent-to-treat and treatment-on-the-treated analyses of the literacy outcomes of second- and seventh-grade students who were more generally at risk for poor reading and language outcomes. There were some problems of implementation in the field setting, and the Fast ForWord Language program did not, in general, help students in these eight schools improve their language and reading comprehension test scores. (Contains 6 notes and 10 tables.)
Reviews of Individual Studies 6 -1
The Effects of POWERSOURCE[C] Intervention on Student Understanding of Basic Mathematical Principles. CRESST Report 763 (2009)
This report describes results from field-testing of POWERSOURCE[C] formative assessment alongside professional development and instructional resources. The researchers at the National Center for Research, on Evaluation, Standards, & Student Testing (CRESST) employed a randomized, controlled design to address the following question: Does the use of POWERSOURCE[C] strategies improve 6th-grade student performance on assessments of the key mathematical ideas relative to the performance of a comparison group? Sixth-grade teachers were recruited from 7 districts and 25 middle schools. A total of 49 POWERSOURCE[C] and 36 comparison group teachers and their students (2,338 POWERSOURCE[C], 1,753 comparison group students) were included in the study analyses. All students took a pretest of prerequisite knowledge and a transfer measure of tasks drawn from international tests at the end of the study year. Students in the POWERSOURCE[C] group used sets of formative assessment tasks. POWERSOURCE[C] teachers had exposure to professional development and instructional resources. Results indicated that students with higher pretest scores tended to benefit more from the treatment as compared to students with lower pretest scores. In addition, students in the POWERSOURCE[C] group significantly outperformed control group students on distributive property items and the effect was larger as pretest scores increased. Results, limitations and future directions are discussed. Four appendices are included: (1) Item Analysis Results of POWERSOURCE[C] pretest; (2) POWERSOURCE[C] Pretest questionnaire; (3) POWERSOURCE[C] Pretest questionnaire; and (4) Descriptive Statistics of Posttest scores by District and Treatment, School, Teacher in Between-School Design and Teacher in within-School (W-S) Design. (Contains 12 figures and 29 tables.)
Reviews of Individual Studies 5 -1
Effectiveness of Selected Supplemental Reading Comprehension Interventions: Impacts on a First Cohort of Fifth-Grade Students. NCEE 2009-4032 (2009)
This document reports on the impacts on student achievement for four supplemental reading curricula that use similar overlapping instructional strategies designed to improve reading comprehension in social studies and science text. Fifth-grade reading comprehension for each of three commercially-available curricula (Project CRISS, ReadAbout, and Read for Real) was not significantly different from the control group. The fourth curriculum, Reading for Knowledge, was adapted from Success for All for this study, and had a statistically-significant negative impact on fifth-grade reading comprehension. The study is based on a rigorous experimental design and a large sample that includes 10 districts, 89 schools, 268 teachers, and 6,350 students. During the first year of the study, it was found that over 90 percent (91 to 100 percent) of treatment teachers were trained to use the assigned curriculum, and more than half (56 to 80 percent) reported that they were very well prepared by the training to implement it. Over 80 percent (81 to 91 percent) of teachers reported using their assigned curriculum. Classroom observation data showed that teachers implemented 55 to 78 percent of the behaviors deemed important by the developers for implementing each curriculum. Scores on the three reading comprehension assessments were not statistically significantly higher in schools using the selected reading comprehension curricula. Impacts were correlated with some subgroups defined by student, teacher, and school characteristics. Appendixes include: (1) Random Assignment; (2) Flow of Schools and Students through the Study; (3) Obtaining Parent Consent; (4) Implementation Timeline; (5) Sample Sizes and Response Rates; (6) Creation and Reliability of Classroom Observation and Teacher Survey Measures; (7) Estimating Impacts; (8) Assessing Robustness of the Impacts; (9) Key Descriptive Statistics for Classroom Observation and Fidelity Data; (10) Study Instruments; and (11) Unadjusted Means. (Contains 91 tables, 8 figures, and 78 footnotes.)
Reviews of Individual Studies 5 -1
The Effects of Response Cards on Student and Teacher Behavior during Vocabulary Instruction (2009)
The use of response cards during whole-class English vocabulary instruction was evaluated. Five low-participating students were observed during hand-raising conditions and response-card conditions to observe the effects of response cards on student responding and test scores and teacher questions and feedback. Responding and test scores were higher for all targeted students in the response-card condition. The teacher asked a similar number of questions in both conditions; however, she provided more feedback in the response-card condition. (Contains 1 table and 1 figure.)
Reviews of Individual Studies 6 -1
Effectiveness of Reading and Mathematics Software Products: Findings From Two Student Cohorts. NCEE 2009-4041 (2009)
In the No Child Left Behind Act (NCLB), Congress called for the U.S. Department of Education (ED) to conduct a rigorous study of the conditions and practices under which educational technology is effective in increasing student academic achievement. A 2007 report presenting study findings for the 2004-2005 school year, indicated that, after one school year, differences in student test scores were not statistically significant between classrooms that were randomly assigned to use software products and those that were randomly assigned not to use products. School and teacher characteristics generally were not related to whether products were effective. The second year of the study examined whether an additional year of teaching experience using the software products increased the estimated effects of software products on student test scores. The evidence for this hypothesis is mixed. For reading, there were no statistically significant differences between the effects that products had on standardized student test scores in the first year and the second year. For sixth grade math, product effects on student test scores were statistically significantly lower (more negative) in the second year than in the first year, and for algebra I, effects on student test scores were statistically significantly higher in the second year than in the first year. The study also tested whether using any of the 10 software products increased student test scores. One product had a positive and statistically significant effect. Nine did not have statistically significant effects on test scores. Five of the insignificant effects were negative and four were positive. Study findings should be interpreted in the context of design and objectives. The study examined a range of reading and math software products in a range of diverse school districts and schools. But it did not study many forms of educational technology and it did not include many types of software products. How much information the findings provide about the effectiveness of products that are not in the study is an open question. Products in the study also were implemented in a specific set of districts and schools, and other districts and schools may have different experiences with the products. The findings should be viewed as one element within a larger set of research studies that have explored the effectiveness of software products. Three appendixes are included: (1) Second-Year Data Collection and Response Rates; (2) Description of Sample for the 10 Products; and (3) Details of Estimation Methods. (Contains 29 footnotes, 4 figures and 24 tables.
Reviews of Individual Studies 6 -1
Effectiveness of Reading and Mathematics Software Products: Findings From Two Student Cohorts. NCEE 2009-4041 (2009)
In the No Child Left Behind Act (NCLB), Congress called for the U.S. Department of Education (ED) to conduct a rigorous study of the conditions and practices under which educational technology is effective in increasing student academic achievement. A 2007 report presenting study findings for the 2004-2005 school year, indicated that, after one school year, differences in student test scores were not statistically significant between classrooms that were randomly assigned to use software products and those that were randomly assigned not to use products. School and teacher characteristics generally were not related to whether products were effective. The second year of the study examined whether an additional year of teaching experience using the software products increased the estimated effects of software products on student test scores. The evidence for this hypothesis is mixed. For reading, there were no statistically significant differences between the effects that products had on standardized student test scores in the first year and the second year. For sixth grade math, product effects on student test scores were statistically significantly lower (more negative) in the second year than in the first year, and for algebra I, effects on student test scores were statistically significantly higher in the second year than in the first year. The study also tested whether using any of the 10 software products increased student test scores. One product had a positive and statistically significant effect. Nine did not have statistically significant effects on test scores. Five of the insignificant effects were negative and four were positive. Study findings should be interpreted in the context of design and objectives. The study examined a range of reading and math software products in a range of diverse school districts and schools. But it did not study many forms of educational technology and it did not include many types of software products. How much information the findings provide about the effectiveness of products that are not in the study is an open question. Products in the study also were implemented in a specific set of districts and schools, and other districts and schools may have different experiences with the products. The findings should be viewed as one element within a larger set of research studies that have explored the effectiveness of software products. Three appendixes are included: (1) Second-Year Data Collection and Response Rates; (2) Description of Sample for the 10 Products; and (3) Details of Estimation Methods. (Contains 29 footnotes, 4 figures and 24 tables.
Reviews of Individual Studies 4 -1
Effectiveness of Reading and Mathematics Software Products: Findings From Two Student Cohorts. NCEE 2009-4041 (2009)
In the No Child Left Behind Act (NCLB), Congress called for the U.S. Department of Education (ED) to conduct a rigorous study of the conditions and practices under which educational technology is effective in increasing student academic achievement. A 2007 report presenting study findings for the 2004-2005 school year, indicated that, after one school year, differences in student test scores were not statistically significant between classrooms that were randomly assigned to use software products and those that were randomly assigned not to use products. School and teacher characteristics generally were not related to whether products were effective. The second year of the study examined whether an additional year of teaching experience using the software products increased the estimated effects of software products on student test scores. The evidence for this hypothesis is mixed. For reading, there were no statistically significant differences between the effects that products had on standardized student test scores in the first year and the second year. For sixth grade math, product effects on student test scores were statistically significantly lower (more negative) in the second year than in the first year, and for algebra I, effects on student test scores were statistically significantly higher in the second year than in the first year. The study also tested whether using any of the 10 software products increased student test scores. One product had a positive and statistically significant effect. Nine did not have statistically significant effects on test scores. Five of the insignificant effects were negative and four were positive. Study findings should be interpreted in the context of design and objectives. The study examined a range of reading and math software products in a range of diverse school districts and schools. But it did not study many forms of educational technology and it did not include many types of software products. How much information the findings provide about the effectiveness of products that are not in the study is an open question. Products in the study also were implemented in a specific set of districts and schools, and other districts and schools may have different experiences with the products. The findings should be viewed as one element within a larger set of research studies that have explored the effectiveness of software products. Three appendixes are included: (1) Second-Year Data Collection and Response Rates; (2) Description of Sample for the 10 Products; and (3) Details of Estimation Methods. (Contains 29 footnotes, 4 figures and 24 tables.
Reviews of Individual Studies 4 -1
Effectiveness of Reading and Mathematics Software Products: Findings From Two Student Cohorts. NCEE 2009-4041 (2009)
In the No Child Left Behind Act (NCLB), Congress called for the U.S. Department of Education (ED) to conduct a rigorous study of the conditions and practices under which educational technology is effective in increasing student academic achievement. A 2007 report presenting study findings for the 2004-2005 school year, indicated that, after one school year, differences in student test scores were not statistically significant between classrooms that were randomly assigned to use software products and those that were randomly assigned not to use products. School and teacher characteristics generally were not related to whether products were effective. The second year of the study examined whether an additional year of teaching experience using the software products increased the estimated effects of software products on student test scores. The evidence for this hypothesis is mixed. For reading, there were no statistically significant differences between the effects that products had on standardized student test scores in the first year and the second year. For sixth grade math, product effects on student test scores were statistically significantly lower (more negative) in the second year than in the first year, and for algebra I, effects on student test scores were statistically significantly higher in the second year than in the first year. The study also tested whether using any of the 10 software products increased student test scores. One product had a positive and statistically significant effect. Nine did not have statistically significant effects on test scores. Five of the insignificant effects were negative and four were positive. Study findings should be interpreted in the context of design and objectives. The study examined a range of reading and math software products in a range of diverse school districts and schools. But it did not study many forms of educational technology and it did not include many types of software products. How much information the findings provide about the effectiveness of products that are not in the study is an open question. Products in the study also were implemented in a specific set of districts and schools, and other districts and schools may have different experiences with the products. The findings should be viewed as one element within a larger set of research studies that have explored the effectiveness of software products. Three appendixes are included: (1) Second-Year Data Collection and Response Rates; (2) Description of Sample for the 10 Products; and (3) Details of Estimation Methods. (Contains 29 footnotes, 4 figures and 24 tables.
Reviews of Individual Studies 4-5 -1
eMINTS 2009 Program Evaluation Report: An analysis of the persistence of program impact on student achievement. (2009)
Reviews of Individual Studies 4-5 -1
Dissemination of the Coping Power Program: Importance of Intensity of Counselor Training (2009)
This study examined an important but rarely investigated aspect of the dissemination process: the intensity of training provided to practitioners. Counselors in 57 schools were randomly assigned to 1 of 3 conditions: Coping Power-training plus feedback (CP-TF), Coping Power-basic training (CP-BT), or a comparison condition. CP-TF counselors produced reductions in children's externalizing behavior problems and improvements in children's social and academic skills in comparison to results for target children in both the comparison and the CP-BT conditions. Training intensity was critical for successful dissemination, although the implementation mechanism underlying this effect remains unclear, as condition effects were not significant for completion of session objectives but were significant for the quality of counselors' engagement with children. (Contains 3 tables and 3 footnotes.)
Reviews of Individual Studies 3-5 -1
The Effects of the Extended Foreign Language Programs on Spanish-Language Proficiency and Academic Achievement in English (2009)
This study was conducted to explore the effects of a two-way immersion bilingual program on maintenance/acquisition of Spanish-language proficiency and on reading and mathematics achievement in English over a period of 4 academic years. The researchers used Hierarchical Linear Modeling (HLM) techniques to compare the effects of two different program models on Spanish-language proficiency of participating students from Spanish- and non-Spanish-language backgrounds. In addition, they employed multivariate matching algorithms to construct a comparison group of schools and students that matched program students academically and demographically and then used HLM methods to compare academic achievement in reading and mathematics of students in program and comparison groups. The researchers found that students in the program model that offered Spanish instruction in language arts and one content area performed better in reading comprehension in Spanish than students in the program model that offered only Spanish language arts instruction. The researchers also found that program students exhibited achievement levels in reading and mathematics that were on par with or higher than those of demographically and academically similar students not in the program. In addition, the researchers determined and that average annual learning rates in both academic disciplines were similar for program and comparison students. (Contains 5 figures, 2 footnotes, and 3 tables.)
Reviews of Individual Studies 3-5 -1
The Effects of the Extended Foreign Language Programs on Spanish-Language Proficiency and Academic Achievement in English (2009)
This study was conducted to explore the effects of a two-way immersion bilingual program on maintenance/acquisition of Spanish-language proficiency and on reading and mathematics achievement in English over a period of 4 academic years. The researchers used Hierarchical Linear Modeling (HLM) techniques to compare the effects of two different program models on Spanish-language proficiency of participating students from Spanish- and non-Spanish-language backgrounds. In addition, they employed multivariate matching algorithms to construct a comparison group of schools and students that matched program students academically and demographically and then used HLM methods to compare academic achievement in reading and mathematics of students in program and comparison groups. The researchers found that students in the program model that offered Spanish instruction in language arts and one content area performed better in reading comprehension in Spanish than students in the program model that offered only Spanish language arts instruction. The researchers also found that program students exhibited achievement levels in reading and mathematics that were on par with or higher than those of demographically and academically similar students not in the program. In addition, the researchers determined and that average annual learning rates in both academic disciplines were similar for program and comparison students. (Contains 5 figures, 2 footnotes, and 3 tables.)
Reviews of Individual Studies 4 -1
A Multisite Cluster Randomized Trial of the Effects of CompassLearning Odyssey[R] Math on the Math Achievement of Selected Grade 4 Students in the Mid-Atlantic Region. Final Report. NCEE 2009-4068 (2009)
In an effort to identify instructional methods that might improve mathematics learning at the grade 4 level when used in a variety of educational settings under typical conditions, the REL Mid-Atlantic research team looked for promising, replicable practices that were being used broadly by teachers in U.S. schools, for which research showed promising results but had not been conducted using methodologies that can establish causal relationships. CompassLearning's Odyssey[R] Math product met all of these criteria. Odyssey Math is a computer-based math curriculum developed by CompassLearning, Inc., to improve math learning for K-12 students. The software consists of a web-accessed series of learning activities, assessments, and math tools. These components constitute the basic framework of the software. CompassLearning professional development trainers presented the learning activities, math tools, and assessments as available options to intervention teachers during the summer professional development session. This study was the first randomized controlled trial to assess the impact of Odyssey Math on student achievement. The study had the statistical power needed to detect a 0.20 effect size and was well designed in that comparable groups were created at baseline and maintained through posttesting. Implementation during the school year was documented and shown to be consistent with typical implementation of the Odyssey Math software. The results from the multilevel model with pretest covariates also indicate that Odyssey Math did not yield a statistically significant impact on end-of-year student achievement. This study generated a statistically unbiased estimate of the effect of Odyssey Math on student achievement when implemented in typical school settings with typical teacher and student use. However, the findings apply only to participating schools, teachers, and students because the study used a volunteer sample. Twelve appendices include: (1) Detailed Professional Development Agenda Sessions; (2) Statistical Power Analysis; (3) Probability of Assignment to Study Conditions; (4) Sample Size from Random Assignment to Data Analysis; (5) Teacher Survey, Fall 2007; (6) Observation Protocols; (7) Odyssey Math Sample Screens; (8) Fidelity Observation Comparisons; (9) Model Variance and Intraclass Correlations; (10) Complete Multilevel Model Results for Research Question 1; (11) Comparison of Assumed Population Parameters for Statistical Power (During Planning Phase) with Corresponding Sample Statistics (During Analysis Phase); and (12) Equations for Multilevel Model Analyses. (Contains 3 figures, 22 tables, 10 exhibits, and 23 footnotes.) [This report was prepared for the National Center for Education Evaluation and Regional Assistance, Institute of Education Sciences under contract with Regional Educational Laboratory Mid-Atlantic administered by Pennsylvania State University.]
Reviews of Individual Studies 3-5 -1
The effects of Read Naturally on fluency and reading comprehension: A supplemental service intervention (four-school study) (2008)
Reviews of Individual Studies 3 -1
Remediating Computational Deficits at Third Grade: A Randomized Field Trial (2008)
The major purposes of this study were to assess the efficacy of tutoring to remediate 3rd-grade computational deficits and to explore whether remediation is differentially efficacious depending on whether students experience mathematics difficulty alone or concomitantly with reading difficulty. At 2 sites, 127 students were stratified on mathematics difficulty status and randomly assigned to 4 conditions: word recognition (control) tutoring or 1 of 3 computation tutoring conditions: fact retrieval, procedural computation and computational estimation, and combined (fact retrieval + procedural computation and computational estimation). Results revealed that fact retrieval tutoring enhanced fact retrieval skill, and procedural computation and computational estimation tutoring (whether in isolation or combined with fact retrieval tutoring) enhanced computational estimation skill. Remediation was not differentially efficacious as a function of students' mathematics difficulty status. (Contains 4 tables and 1 footnote.)
Reviews of Individual Studies 3 -1
Remediating Computational Deficits at Third Grade: A Randomized Field Trial (2008)
The major purposes of this study were to assess the efficacy of tutoring to remediate 3rd-grade computational deficits and to explore whether remediation is differentially efficacious depending on whether students experience mathematics difficulty alone or concomitantly with reading difficulty. At 2 sites, 127 students were stratified on mathematics difficulty status and randomly assigned to 4 conditions: word recognition (control) tutoring or 1 of 3 computation tutoring conditions: fact retrieval, procedural computation and computational estimation, and combined (fact retrieval + procedural computation and computational estimation). Results revealed that fact retrieval tutoring enhanced fact retrieval skill, and procedural computation and computational estimation tutoring (whether in isolation or combined with fact retrieval tutoring) enhanced computational estimation skill. Remediation was not differentially efficacious as a function of students' mathematics difficulty status. (Contains 4 tables and 1 footnote.)
Reviews of Individual Studies 4 -1
Using a System of Least Prompts Procedure to Teach Telephone Skills to Elementary Students with Cognitive Disabilities (2008)
Using the telephone to contact others can be an important skill in maintaining friendships with peers. This investigation used a system of least prompts (SLP) procedures to teach two telephone skills to 3 elementary students with cognitive disabilities: (a) placing phone calls and (b) leaving recorded voicemail messages. The SLP procedure was effective in teaching both skills to all 3 students. Results for maintenance and generalization, however, were mixed.
Reviews of Individual Studies 5-12 -1
The Study of Mentoring in the Learning Environment (SMILE): A randomized evaluation of the effectiveness of school-based mentoring (2008)
Reviews of Individual Studies 4-9 -1
High School Students as Mentors: Findings from the Big Brothers Big Sisters School-Based Mentoring Impact Study (2008)
High schools have recently become a popular source of mentors for school-based mentoring (SBM) programs. The high school Bigs program of Big Brothers Big Sisters of America, for example, currently involves close to 50,000 high-school-aged mentors across the country. While the use of these young mentors has several potential advantages, their age raises questions about their capacity to be consistent, positive role models, and, in turn, their potential to yield strong impacts for the youth they mentor. With support from The Atlantic Philanthropies and in collaboration with Big Brothers Big Sisters of America, Public/Private Ventures set out to address these questions using data from our large-scale random assignment impact study of Big Brothers Big Sisters SBM (Herrera, et al. 2007). We found that, on average, high school students were much less effective than adults at yielding impacts for the youth they mentor. However, our research identified several program practices that were linked with longer, stronger and more effective high school mentor relationships. High School Students as Mentors stresses the need for programs with high school volunteers to use the inherent strengths of these volunteers and, at the same time, meet their distinct needs. Big Brothers Big Sisters of America is already initiating most of the changes suggested in the study in its high school Bigs program; it has convened a group of six of its strongest Big Brothers Big Sisters agencies to review these and other findings and share their own experiences and strategies in an effort to strengthen their model. (Contains 41 endnotes, 3 figures and 2 tables.)
Reviews of Individual Studies 6 -1
The Negative Impacts of Starting Middle School in Sixth Grade (2008)
Using administrative data on public school students in North Carolina, we find that sixth grade students attending middle schools are much more likely to be cited for discipline problems than those attending elementary school. That difference remains after adjusting for the socioeconomic and demographic characteristics of the students and their schools. Furthermore, the higher infraction rates recorded by sixth graders who are placed in middle school persist at least through ninth grade. An analysis of end-of-grade test scores provides complementary findings. A plausible explanation is that sixth graders are at an especially impressionable age; in middle school, the exposure to older peers and the relative freedom from supervision have deleterious consequences. These findings are relevant to the current debate over the best school configuration for incorporating the middle grades. Based on our results, we suggest that there is a strong argument for separating sixth graders from older adolescents. (Contains 4 figures, 6 tables and 14 footnotes.)
Reviews of Individual Studies 6-8 -1
Intervention Provided to Linguistically Diverse Middle School Students with Severe Reading Difficulties (2008)
This study investigated the effectiveness of a multicomponent reading intervention implemented with middle school students with severe reading difficulties, all of whom had received remedial and/or special education for several years with minimal response to intervention. Participants were 38 students in grades 6-8 who had severe deficits in word reading, reading fluency, and reading comprehension. Most were Spanish-speaking English language learners (ELLs) with identified disabilities. Nearly all demonstrated severely limited oral vocabularies in English and, for ELLs, in both English and Spanish. Students were randomly assigned to receive the research intervention (n = 20) or typical instruction provided in their school's remedial reading or special education classes (n = 18). Students in the treatment group received daily explicit and systematic small-group intervention for 40 minutes over 13 weeks, consisting of a modified version of a phonics-based remedial program augmented with English as a Second Language practices and instruction in vocabulary, fluency, and comprehension strategies. Results indicated that treatment students did not demonstrate significantly higher outcomes in word recognition, comprehension, or fluency than students who received the school's typical instruction and that neither group demonstrated significant growth over the course of the study. Significant correlations were found between scores on teachers' ratings of students' social skills and problem behaviors and posttest decoding and spelling scores, and between English oral vocabulary scores and scores in word identification and comprehension. The researchers hypothesize that middle school students with the most severe reading difficulties, particularly those who are ELLs and those with limited oral vocabularies, may require intervention of considerably greater intensity than that provided in this study. Further research directly addressing features of effective remediation for these students is needed.
Reviews of Individual Studies 9 -1
The Enhanced Reading Opportunities Study: Early Impact and Implementation Findings. NCEE 2008-4015 (2008)
This report presents early findings from the Enhanced Reading Opportunities (ERO) study--a demonstration and rigorous evaluation of two supplemental literacy programs that aim to improve the reading comprehension skills and school performance of struggling ninth-grade readers. focuses on the first of two cohorts of ninth-grade students who will participate in the study and discusses the impact that the two interventions had on these students' reading comprehension skills through the end of their ninth-grade year. The report also describes the implementation of the programs during the first year of the study and provides an assessment of the overall fidelity with which the participating schools adhered to the program design specified by the developers. The key findings discussed in the report include the following: (1) On average, across the 34 participating high schools, the supplemental literacy programs improved student reading comprehension test scores; (2) Although they are not statistically significant, the magnitudes of the impact estimates for each literacy intervention are the same as those for the full study sample; and (3) Impacts on reading comprehension are larger for the 15 schools where the ERO programs began within six weeks of the start of the school year and implementation was classified as moderately or well aligned with the program model, compared with impacts for the 19 schools where at least one of these conditions was not met. The following are appended: (1) ERO Student Follow-Up Survey Measures; (2) Follow-Up Test and Survey Response Analysis; (3) Statistical Power and Minimum Detectable Effect Size; (4) ERO Implementation Fidelity; (5) Technical Notes for Early Impact Findings; (6) Early Impact Estimates Weighted for Nonresponse; (7) Early Impacts on Supplementary Measures of Reading Achievement and Behaviors; (8) Early Impacts for Student Subgroups; and (9) The Relationship between Early Impacts and First-Year Implementation Issues. (Contains 52 tables, 4 figures, and 121 footnotes.) [This report was prepared for the National Center for Education Evaluation and Regional Assistance, Institute of Education Sciences.]
Reviews of Individual Studies 1 -1
Effectiveness of Reading First for English language learners: Comparison of two programs (Doctoral dissertation, Walden University, 2008). (2008)
Reviews of Individual Studies 3 -1
Reconsidering silent sustained reading: An exploratory study of scaffolded silent reading. (2008)
The purpose of this study was to design, implement, and evaluate the efficacy of scaffolded silent reading (ScSR) compared with the evidence-based practice of guided repeated oral reading (GROR) with feedback on 3rd-grade students' fluency and comprehension growth. Using a mixed-model dominant-less dominant design, the authors collected both quantitative and qualitative data. Quantitative results indicated no significant differences between these 2 forms of reading fluency practice on 3rd-grade students' fluency and comprehension development with the exception of 1 significant difference favoring ScSR on expression of a single passage. Qualitative results indicated that either ScSR or GROR approaches used exclusively tended toward tedium and reduced overall student enjoyment and motivation. The authors discuss how the ScSR approach represents a viable alternative or companion to GROR for promoting 3rd-grade students' reading fluency and comprehension growth. (Contains 3 tables and 2 figures.)
Reviews of Individual Studies 2 -1
The Impact of Two Professional Development Interventions on Early Reading Instruction and Achievement. NCEE 2008-4030 (2008)
To help states and districts make informed decisions about the professional development (PD) they implement to improve reading instruction, the U.S. Department of Education commissioned the Early Reading PD Interventions Study to examine the impact of two research-based PD interventions for reading instruction: (1) a content-focused teacher institute series that began in the summer and continued through much of the school year (treatment A) and (2) the same institute series plus in-school coaching (treatment B). The Early Reading PD Interventions Study used an experimental design to test the effectiveness of the two PD interventions in improving the knowledge and practice of teachers and the reading achievement of their students in high-poverty schools. It focused specifically on second grade reading because (1) this is the earliest grade in which enough districts collect the standardized reading assessment data needed for the study; and (2) later grades involve supplementary instruction, which was outside the scope of the study. The study was implemented in 90 schools in six districts (a total of 270 teachers), with equal numbers of schools randomly assigned in each district to treatment A, treatment B, or the control group, which participated only in the usual PD offered by the district. This design allowed the study team to determine the impact of each of the two PD interventions by comparing each treatment group's outcomes with those of the control group, and also to determine the impact of the coaching above and beyond the institute series by comparing treatment group B with treatment group A This report describes the implementation of the PD interventions tested, examines their impacts at the end of the year the PD was delivered, and investigates the possible lagged effect of the interventions, based on outcomes data collected the year after the PD interventions concluded. The study produced the following results: (1) Although there were positive impacts on teacher's knowledge of scientifically based reading instruction and on one of the three instructional practices promoted by the study PD, neither PD intervention resulted in significantly higher student test scores at the end of the one-year treatment; (2) Added effect of the coaching intervention on teacher practices in the implementation year was not statistically significant; and (3) There were no statistically significant impacts on measured teacher or student outcomes in the year following the treatment. Twelve appendixes are included: (1) Theory of Action and Development for the PD Interventions for the Early Reading PD Interventions Study; (2) Details on the Study Design and Implementation; (3) Details on Teacher Data and Teacher Sample Characteristics; (4) Reading Content and Practices Survey Design and Scales; (5) Classroom Observer Training and Inter-Rater Reliability; (6) Classroom Observation Scales and Descriptive Statistics; (7) Details on Student Data, Sample Characteristics and Achievement Measures; (8) Validation of the Survey Data on Professional Development Participation; (9) Estimation Methods and Hypothesis Testing; (10) Fall 2005 Short-Term Teacher Practice Outcomes; (11) Supporting Tables and Figures for Impact Analyses; and (12) Supplementary Analyses. (Contains 165 footnotes, 35 figures, and 85 tables.)
Reviews of Individual Studies 2-3 -1
Repeated Reading Intervention: Outcomes and Interactions with Readers' Skills and Classroom Instruction (2008)
This study examined effects of a repeated reading intervention, Quick Reads, with incidental word-level scaffolding instruction. Second- and third-grade students with passage-reading fluency performance between the 10th and 60th percentiles were randomly assigned to dyads, which were in turn randomly assigned to treatment (paired tutoring, n = 82) or control (no tutoring, n = 80) conditions. Paraeducators tutored dyads for 30 min per day, 4 days per week, for 15 weeks (November-March). At midintervention, most teachers with students in the study were formally observed during their literacy blocks. Multilevel modeling was used to test for direct treatment effects on pretest-posttest gains as well as to test for unique treatment effects after classroom oral text reading time, 2 pretests, and corresponding interactions were accounted for. Model results revealed both direct and unique treatment effects on gains in word reading and fluency. Moreover, complex interactions between group, oral text reading time, and pretests were also detected, suggesting that pretest skills should be taken into account when considering repeated reading instruction for 2nd and 3rd graders with low to average passage-reading fluency. (Contains 4 tables and 3 figures.)
Reviews of Individual Studies 2 -1
Improved reading skills by students in the Perrysburg Exempted Village Schools who used Fast ForWord® products. (2008)
Reviews of Individual Studies 1-6 -1
Effects of social development intervention in childhood 15 years later. (2008)
Reviews of Individual Studies 1 -1
Response to varying amounts of time in reading intervention for students with low response to intervention. (2008)
Two studies examined response to varying amounts of time in reading intervention for two cohorts of first-grade students demonstrating low levels of reading after previous intervention. Students were assigned to one of three groups that received (a) a single dose of intervention, (b) a double dose of intervention, or (c) no intervention. Examination of individual student response to intervention indicated that more students in the treatment groups demonstrated accelerated learning over time than students in the comparison condition. Students' responses to the single-dose and double-dose interventions were similar over time. Students in all conditions demonstrated particular difficulties with gains in reading fluency. Implications for future research and practice within response to intervention models are provided. (Contains 10 tables and 8 figures.)
Reviews of Individual Studies K-4 -1
Evaluation of the effectiveness of an early literacy program for students with significant developmental disabilities (2008)
This study evaluated the impact of a curriculum called the Early Literacy Skills Builder on the language and early literacy skills of students with significant developmental disabilities. Students in the control group received the ongoing sight word and picture instruction prescribed by their individualized education programs. Results indicate statistically significant interaction effects for the treatment group for two research team-designed measures of early literacy (the Nonverbal Literacy Assessment and a pretest/posttest for the experimental curriculum). Significant interaction effects were also found for two standardized measures (Peabody Picture Vocabulary Test III and Memory for Sentences of the Woodcock Language Proficiency Battery). Implications and future research needs are provided.
Reviews of Individual Studies K-6 -1
Impacts of Comprehensive Teacher Induction: Results from the First Year of a Randomized Controlled Study. NCEE 2009-4034 (2008)
In practice, teacher induction is common, but induction that is intensive, comprehensive, structured, and sequentially delivered in response to teachers' emerging pedagogical needs is less so. Congressional interest in formal, comprehensive teacher induction has grown in recent years. The National Center for Education Evaluation and Regional Assistance within the U.S. Department of Education's (ED) Institute of Education Sciences (IES) contracted with Mathematica Policy Research, Inc. (MPR), to evaluate the impact of structured and intensive teacher induction programs. The study examines whether comprehensive teacher induction programs lead to higher teacher retention rates and other positive teacher and student outcomes as compared to prevailing, generally less comprehensive approaches to supporting new teachers. More specifically, the study is designed to address five research questions on the impacts of teacher induction services: (1) What is the effect of comprehensive teacher induction on the types and intensity of induction services teachers receive compared to the services they receive from the districts' current induction programs?; (2) What are the impacts on teachers' classroom practices?; (3) What are the impacts on student achievement?; (4) What are the impacts on teacher retention?; and (5) What is the impact on the composition of the district's teaching workforce? Statistically significant differences between the treatment and control groups were identified in the amount, types, and content of induction support teachers reported having received, both in the fall and the spring of the intervention year. Although treatment teachers reported receiving more mentoring than did control teachers; were more likely than control teachers to report participating in specific induction activities; and spent more time in certain professional activities than did control teachers during the three months prior to the spring survey, summarized comparisons between treatment and control groups found: (1) No impacts on teacher practices; (2) No positive impacts on student test scores; (3) No impacts on teacher retention; and (4) No positive impacts on composition of district teaching workforce. This report focused on the first year of findings only. The research team is conducting longer term follow-up to include additional collection of test score and teacher mobility data. Eight appendices are included: (1) National Data on Teacher Induction; (2) Analysis Weights; (3) Impact Estimation Methods; (4) Classroom Observation Methods; (5) Reference Tables for Chapter II; (6) Supplemental Tables for Chapter IV; (7) Supplemental Tables for Chapter V; and (8) Supplemental Figures. (Contains 43 footnotes, 15 figures and 101 tables.)
Reviews of Individual Studies 9-12 -1
Rigor &quot;and&quot; Relevance: Enhancing High School Students' Math Skills through Career and Technical Education (2008)
Numerous high school students, including many who are enrolled in career and technical education (CTE) courses, do not have the math skills necessary for today's high-skill workplace or college entrance requirements. This study tests a model for enhancing mathematics instruction in five high school CTE programs (agriculture, auto technology, business and marketing, health, and information technology). The model includes a pedagogy and intense teacher professional development. Volunteer CTE teachers were randomly assigned to an experimental (n = 59) or control (n = 78) group. The experimental teachers worked with math teachers to develop CTE instructional activities that integrated more mathematics into the occupational curriculum. After 1 year of the math-enhanced CTE lessons, students in the experimental classrooms performed equally on technical skills and significantly better than control students on two standardized tests of math ability (TerraNova and ACCUPLACER[R]). (Contains 5 tables, 1 figure, and 9 notes.)
Reviews of Individual Studies 9-12 -1
Taking a Reading/Writing Intervention for Secondary English Language Learners on the Road: Lessons Learned from the Pathway Project (2008)
These two recipients of this year's Alan C. Purves Award reflect on their work (reported in "RTE" Vol. 41, No. 3, pp. 269-303) on "A Cognitive Strategies Approach to Reading and Writing Instruction for English Language Learners in Secondary School" and the lessons they learned from their original research study as they tried to replicate the project in two additional districts outside their service area, to determine if the implications of their study would hold beyond the local context. The Alan C. Purves Award is given to the "RTE" article in the previous volume year judged most likely to impact educational practice. (Contains 1 figure and 4 tables.)
Reviews of Individual Studies K -1
Training Parents to Help Their Children Read: A Randomized Control Trial (2008)
Background: Low levels of literacy and high levels of behaviour problems in middle childhood often co-occur. These persistent difficulties pose a risk to academic and social development, leading to social exclusion in adulthood. Although parent-training programmes have been shown to be effective in enabling parents to support their children's development, very few parent interventions offer a combination of behavioural and literacy training. Aims: This paper (1) reports on a prevention programme which aimed to tackle behaviour and literacy problems in children at the beginning of school, and (2) presents the effects of the intervention on children's literacy. Sample: One hundred and four 5- and 6-year-old children selected from eight schools in an inner city disadvantaged community in London participated in the intervention. Methods: This is a randomized control trial with pre- and post-measurements designed to evaluate the effectiveness of an intervention. The behavioural intervention consisted of the "Incredible Years" group parenting programme combined with a new programme designed to train parents to support their children's reading at home. Results: Analyses demonstrated a significant effect of the intervention on children's word reading and writing skills, as well as parents' use of reading strategies with their children. Conclusion: A structured multicomponent preventive package delivered with attention to fidelity can enable parents to support their children's reading at home and increase their literacy skills. Together with the improvement in child behaviour, these changes could improve the life chances of children in disadvantaged communities.
Reviews of Individual Studies K -1
The Efficacy of Computer-Assisted Instruction for Advancing Literacy Skills in Kindergarten Children (2008)
We examined the benefits of computer-assisted instruction (CAI) as a supplement to a phonics-based reading curriculum for kindergartners in an urban public school system. The CAI program provides systematic exercises in phonological awareness and letter-sound correspondences. Comparisons were made between children in classes receiving a sufficient amount of CAI support and children in matched classes taught by the same teacher but without CAI. The treatment and control groups did not differ on pretest measures of preliteracy skills. There were, however, significant differences between groups on posttest measures of phonological awareness skills particularly for students with the lowest pretest scores. (Contains 2 tables and 1 figure.)
Reviews of Individual Studies 4-5 -1
Improved reading skills by students in the South Madison Community School Corporation who used Fast ForWord® products. (2007b)
Reviews of Individual Studies 3-5 -1
The National Board effect: Does the certification process influence student achievement? (Doctoral dissertation). (2007)
Reviews of Individual Studies 3-8 -1
Evaluation of supplemental education services in Minneapolis Public Schools: An application of matched sample statistical design (2007)
Reviews of Individual Studies 4-8 -1
Functional Assessment-Based Intervention for Selective Mutism (2007)
The process of functional assessment has emerged as an essential component for intervention development. Applications across divergent types of problem behavior, however, remain limited. This study evaluated the applicability of this promising approach to students with selective mutism. Two middle school students served as participants. The functional assessment included indirect and direct methods as well as a specially designed student interview that did not require speech. Individualized interventions were developed and experimentally evaluated. Results indicated that the assessment-based interventions effectively increased speaking in school contexts. (Contains 2 figures.)
Reviews of Individual Studies 5 -1
A study of a specific language arts and mathematics software program: Is there a correlation between usage levels and achievement? (2007)
Reviews of Individual Studies 5 -1
A study of a specific language arts and mathematics software program: Is there a correlation between usage levels and achievement? Unpublished doctoral dissertation, Indiana University of Pennsylvania, Indiana, PA. (2007)
Reviews of Individual Studies 5-8 -1
The effects of the School Renaissance program on student achievement in reading and mathematics. (2007)
Reviews of Individual Studies 6 -1
A Randomized Evaluation of the Success for All Middle School Reading Program (2007)
This article describes a randomized evaluation of The Reading Edge, a reading program for middle school students. The Reading Edge was designed to integrate findings of research on cooperative learning and metacognitive reading strategies into a replicable reading instructional package that could be implemented effectively in Title I middle schools. In this study, 405 sixth graders in two high-poverty, rural middle schools previously unfamiliar with the program were randomly assigned to participate in The Reading Edge or to continue with their existing reading programs. After one year of instruction, observations of classroom use of metacognitive strategies, cooperative learning, goal setting/feedback, and classroom management, showed moderate levels of implementation in Reading Edge classes but little use of metacognitive strategies, cooperative learning, or goal setting/feedback in control classes. Statistically significant differences in student scores on the Vocabulary subscale of the Gates-MacGinitie Reading Test, and marginally significant scores on the Total Achievement score, provide support for the basic reading model, but larger and longer studies are needed to establish the full effects of this approach. (Contains 1 table.)
Reviews of Individual Studies 6 -1
A comparison of the effects of the Accelerated Math program and the Delaware Procedural Fluency Workbook program on academic growth in grade six at X middle school (Unpublished doctoral dissertation) (2007)
Reviews of Individual Studies 9 -1
What evidence matters? A randomized field trial of Cognitive Tutor® Algebra I (2007)
Reviews of Individual Studies 9-12 -1
An investigation of achievement in the AVID (Advancement Via Individual Determination) program at the high school level. (2007)
Reviews of Individual Studies 7-9 -1
The effects of Prentice Hall Literature (Penguin Edition) curriculum on student performance: Randomized control trial final report. (2007)
Reviews of Individual Studies 6-8 -1
An investigation of the effects of a middle school reading intervention on school dropout rates. (2007)
Reviews of Individual Studies 6-PS -1
Comparative Effectiveness of Carnegie Learning's &quot;Cognitive Tutor Bridge to Algebra&quot; Curriculum: A Report of a Randomized Experiment in the Maui School District. Research Report (2007)
Under the "Math Science Partnership Grant," the Maui Hawaii Educational Consortium sought scientifically based evidence for the effectiveness of Carnegie Learning's "Cognitive Tutor[R]" (CT) program as part of the adoption process for pre-Algebra program. During the 2006-2007 school year, the researchers conducted a follow-on study to a previous randomized experiment in the Maui School District of the effectiveness of "CT" in Algebra I. In this second year, the focus was on the newly developed "Bridge to Algebra" program for pre-Algebra. The question being addressed specifically by the research is whether students in classes that use "CT" materials achieve higher scores on the standardized math assessment, as measured by the Northwest Evaluation Association (NWEA) General Math Test, than they would if they had been in a control classroom using the pre-Algebra curricula the Maui schools currently have in place. The researchers found that most students in both "CT" and control groups improved overall on the NWEA General Math Test. They did not find a difference in student performance in math between groups. Their analysis of the Algebraic Operations sub-strand revealed that many students in both groups did not demonstrate the growth in this scale, again with no discernible group differences. However, for Algebraic Operations outcomes, the researchers found a significant interaction between the pre-test and "CT": student scoring low before participating in "CT" got more benefit from the program's algebraic operations instruction than students with high initial scores. (Contains 8 figures, 33 tables, and 14 footnotes.) [For "Comparative Effectiveness of Carnegie Learning's "Cognitive Tutor Bridge to Algebra" Curriculum: A Report of a Randomized Experiment in the Maui School District. Research Summary," see ED538962.]
Reviews of Individual Studies 7-12 -1
Technology's Edge: The Educational Benefits of Computer-Aided Instruction. WP 2007-17 (2007)
Because a significant portion of U.S. students lacks critical mathematic skills, schools across the country are investing heavily in computerized curriculums as a way to enhance education output, even though there is surprisingly little evidence that they actually improve student achievement. In this paper we present results from a randomized study in three urban school districts of a well-defined use of computers in schools: a popular instructional computer program which is designed to teach pre-algebra and algebra. We assess the impact of the program using statewide tests that cover a range of math skills and tests designed specifically to target pre-algebra and algebra skills. We find that students randomly assigned to computer-aided instruction score at least 0.17 of a standard deviation higher on a pre-algebra/algebra test than students randomly assigned to traditional instruction. We hypothesize that the effectiveness arises from increased individualized instruction as the effects appear larger for students in larger classes and those in classes in which students are frequently absent. (Detailed data information is appended. Contains 40 footnotes and 17 tables.)
Reviews of Individual Studies 1 -1
Paraprofessional-Led Phonological Awareness Training with Youngsters at Risk for Reading and Behavioral Concerns (2007)
This study examined the efficacy of a paraprofessional-led supplemental early intervention for first-grade students with poor early literacy skills and behavioral concerns. The goal was to determine if (a) the relatively brief intervention was effective in improving phonological skills, and (b) improvements in academic skills would be accompanied by behavioral and social improvements. The results indicated that the students in the treatment condition experienced significant, lasting increases in phonological awareness and moderate improvement in word attack skills. However, significant collateral effects on social and behavioral performance were not observed. Limitations and directions for future investigation are offered.
Reviews of Individual Studies 1-2 -1
Designing, Implementing, and Evaluating Function-Based Interventions Using a Systematic, Feasible Approach (2007)
Although functional assessment-based interventions have produced desired outcomes in student behavior in applied settings, most of those interventions involved strong, sustained participation with researchers in intervention design, implementation, and assessment. In this article, we describe a systematic approach to designing, implementing, and evaluating function-based interventions that was developed by Umbreit, Ferro, Liaupsin, and Lane (2007) and was implemented using a collaborative process with the teacher as the primary interventionist and assessor. Second, we document two experiments conducted using this systematic approach. Results of both withdrawal designs revealed a functional relation between the intervention procedures and the dependent variables. Further, both interventions were rated as socially valid by the teacher and students. Implications for educational practices are discussed. (Contains 2 figures and 2 tables.)
Reviews of Individual Studies 1-8 -1
Function-Based Interventions for Students Who Are Nonresponsive to Primary and Secondary Prevention Efforts: Illustrations at the Elementary and Middle School Levels (2007)
This article illustrates how to (a) use schoolwide data to monitor student responsiveness to primary and secondary prevention efforts to identify students for tertiary preventions and (b) design, implement, and evaluate a function-based intervention in collaboration with two general education teachers, who served as the primary interventionists. Results demonstrate the feasibility and effectiveness of function-based interventions with students who are nonresponsive to primary and secondary prevention efforts. A clear functional relationship was demonstrated between the introduction of the intervention and changes in student behavior using a changing criterion design at the elementary level and an ABAB withdrawal design at the middle school level. Limitations and directions for future research are offered.
Reviews of Individual Studies 2 -1
Increasing Story Quality through Planning and Revising: Effects on Young Writers with Learning Disabilities (2007)
In this study, supplemental writing instruction in planning and revising was used to improve the stories written by young writers with learning disabilities (LD) and poor writing skills. Six second-grade students practiced a strategy for planning and writing stories using the Self-Regulated Strategy Development (SRSD) approach and then revised their stories after instructor modeling of revising. After learning the strategy and practicing revisions, the students wrote post-instruction stories that were longer, more complete in terms of story grammar elements, and qualitatively better. The students also increased the amount of time they spent planning their stories at post-instruction as well as the number of revisions attempted. (Contains 1 table and 5 figures.)
Reviews of Individual Studies 2-3 -1
Effectiveness of paraeducator-supplemented individual instruction: Beyond basic decoding skills. (2007)
A total of 46 children in Grades 2 and 3 with low word-level skills were randomly assigned to 1 of 2 groups that received supplemental phonics-based reading instruction. One group received intervention October through March (21.5 hours), and one group served as a control from October through March and later received intervention March through May (17.5 hours). Paraeducators trained in a standard treatment protocol provided individual instruction for 30 min per day, 4 days per week. At the March posttest, the early treatment (ET; n = 23) group outperformed the controls (late treatment, LT; n = 20) on reading accuracy and passage fluency. Across both groups, second graders outperformed third graders on these same measures. At the 3-month follow-up, the ET group showed no evidence of decline in reading accuracy, passage fluency, or words spelled; however, 3rd-grade ET students had significantly higher spelling skills compared to 2nd graders. The LT group demonstrated significant growth during their intervention in reading accuracy and spelling, but not passage fluency. When we compared the ET and LT groups on their gains per instructional hour, we found that the ET group made significantly greater gains than the LT group across all 3 measures. The results support the value of paraeducator-supplemented reading instruction for students below grade level in word identification and reading fluency.
Reviews of Individual Studies 2-3 -1
Effects of a fluency-building program on the reading performance of low-achieving second and third grade students. (2007)
This study evaluated the effects of a fluency-based reading program with 15 second and third grade students and 15 matched controls. Gains in oral reading fluency on untrained CBM probes were evaluated using a matched-pairs group-comparison design, whereas immediate and two-day retention gains in oral reading fluency on trained passages were evaluated using an adapted changing criterion design. Increases in WRCM due to training and number of trainings to criterion were also evaluated as a function of pre-training fluency levels. Results showed statistically significant gains on dependent measures for the treatment group, mean increases of two to three grade levels in passages mastered, and an optimal pre-training fluency range of 41-60 WRCM. Implications for fluency-based reading programs are discussed.
Reviews of Individual Studies 2 -1
Repeated reading versus continuous reading: Influences on reading fluency and comprehension. (2007)
An experimental research design was used to examine the effectiveness of a targeted, long-term intervention to promote school completion and reduce dropout among urban high school students with emotional or behavioral disabilities. African American (67%) males (82%) composed a large portion of the sample. This intervention study was a replication of an empirically supported model referred to as check & connect. Study participants included 144 ninth graders, randomly assigned to the treatment or control group. The majority of youth were followed for 4 years, with a subsample followed for 5 years. Program outcomes included lower rates of dropout and mobility, higher rates of persistent attendance and enrollment status in school, and more comprehensive transition plans.
Reviews of Individual Studies K -1
Attributes of effective and efficient kindergarten reading intervention: An examination of instructional time and design specificity. (2007)
A randomized experimental design with three levels of intervention was used to compare the effects of beginning reading interventions on early phonemic, decoding, and spelling outcomes of 96 kindergartners identified as at risk for reading difficulty. The three instructional interventions varied systematically along two dimensions--time and design of instruction specificity--and consisted of (a) 30 min with high design specificity (30/H), (b) 15 min with high design specificity plus 15 min of non-code-based instruction (15/H+15), and (c) a commercial comparison condition that reflected 30 min of moderate design specificity instruction (30/M). With the exception of the second 15 min of the 15/H+15 condition, all instruction focused on phonemic, alphabetic, and orthographic skills and strategies. Students were randomly assigned to one of the three interventions and received 108 thirty-minute sessions of small-group instruction as a supplement to their typical half-day kindergarten experience. Planned comparisons indicated findings of statistical and practical significance that varied according to measure and students' entry-level performance. The results are discussed in terms of the pedagogical precision needed to design and provide effective and efficient instruction for students who are most at risk.
Reviews of Individual Studies K-8 -1
Students in Western Australia improve language and literacy skills: Educator’s briefing. (2007)
Reviews of Individual Studies PK-12 -1
The impact of supplemental educational services participation on student achievement: 2005-06. (2007)
Reviews of Individual Studies K -1
Improved reading skills by students who used Fast ForWord® to Reading Prep. (2006)
Reviews of Individual Studies K -1
Evaluation of the Waterford Early Reading Program in kindergarten 2005–06. (2006)
Background: The Waterford Early Reading Program (WERP), a technology-based program for early elementary grades, was provided through Arizona all day kindergarten funds to kindergarten students in 15 Title I elementary schools in the Tucson Unified School District (TUSD) in the 2005-06 school year. The purpose of this study is to evaluate the reading achievement of kindergartners in the WERP schools and in a Comparison group of 15 schools in the same district. The schools where the WERP was implemented are identified in this report as Schools A-L. The comparison schools are identified as Schools M-AA. Research Design: This evaluation design was a comparison-group study (quasi-experimental design) involving a treatment (WERP) implemented in 15 Title I schools ranked with the highest percentages of students on free/reduced lunch. A Comparison group of 15 schools was selected from those with the next highest percentages of students on free/reduced lunch. The comparison schools did not receive the WERP. Both matching techniques and statistical controls were used to make the groups similar in the analysis. The Dynamic Indicators of Basic Early Literacy Skills (DIBELS) Initial Sound Fluency, Letter Naming Fluency, Word Use Fluency, Phoneme Segmentation Fluency, and Nonsense Word Fluency and the district's Core Curriculum Standard Assessment (CCSA) Reading Test were given as pretests and posttests during the school year. In addition, the amount of time that each kindergartner used the WERP computer software was extracted from the software and used in the analysis. Statistical Analysis: Dependent samples t-tests were used to determine gains for the WERP and Comparison groups, and gain score analysis was used to compare these gains for the WERP and Comparison schools. Analysis of covariance was used to adjust the posttest means for differences on the pretest means of the students. Data were disaggregated by school, gender, ethnicity, pretest achievement quartiles, primary home language, and English language learner (ELL) status in order to determine patterns of achievement among these groups. (Contains 22 tables and 16 figures.)
Reviews of Individual Studies K -1
The Voyager Universal Literacy System: Results from a study of kindergarten students in inner-city schools. (2006)
The evaluation of the Voyager Universal Literacy System[R] was designed to provide a rigorous assessment of the effectiveness of the program with beginning readers. Using a quasi-experimental design, researchers conducted a systematic evaluation of changes in 398 kindergarten students' command of early reading skills in 4 Voyager and 4 comparison schools in 2 inner-city districts in 8 months from 2002 and 2003. The study provides strong evidence of the efficacy of the Voyager program. Overall and for 3 out of the 4 pairs of schools examined, a large and significant difference was found in favor of the Voyager students. Effect sizes of the program ranged from 0.23 to 1.32 in 7 test instruments. In addition, the average scores of Voyager students at the end of kindergarten were largely around the national average, whereas those of comparison students remained below the national average. Using analysis of covariance models, the study found that the Voyager program has statistically significant positive impacts on student achievement in 6 out of 7 assessments. It also shows that the greater the fidelity of the implemented program to the Voyager plan, the larger the gains in literacy scores.
Reviews of Individual Studies 9-12 -1
Striving for Student Success. The Effect of Project GRAD on High School Student Outcomes in Three Urban School Districts (2006)
This report describes the effects of Project Graduation Really Achieves Dreams (GRAD) on student progress at three high schools in Houston (the initiative's original site) and at high schools in two other school districts (Columbus, Ohio, and Atlanta, Georgia). MDRC--a nonprofit, nonpartisan research organization--conducted a third-party evaluation to determine the effects of Project GRAD by comparing the changes in student outcomes at Project GRAD schools with changes at similar, non-Project GRAD schools in the same districts. (A companion report discusses findings for Project GRAD elementary schools.) In general, Project GRAD student outcomes are tracked from the implementation of the first components of the model at each site until the 2002-2003 school year. The key findings of this report are: At Jefferson Davis High School in Houston, the initiative's flagship school, Project GRAD had a statistically significant positive impact on the proportion of students who completed a core academic curriculum on time--that is, received an average grade of 75 out of 100 in their core courses; earned four credits in English, three in math, two in science, and two in social students; and graduated from high school within four years. As Project GRAD expanded into two other Houston high schools, these positive effects on students' academic preparation were not evident. Student outcomes at the newer Project GRAD high schools improved, but generally this progress was matched by progress at the comparison high schools. Improvements in graduation rates at the three Project GRAD Houston high schools were generally matched by improvements in graduation rates at the comparison schools. Looking at early indicators of student success, the initial Project GRAD high schools in Columbus and Atlanta showed improvements in attendance and promotion to tenth grade that appear to have outpaced improvements at the comparison schools, although the differences are only sometimes statistically significant. The following are appended: (1) The Impacts on High School Graduation among All Ninth-Grade Students in Houston; (2) High School Achievement in Houston: Was There Shifting of the Pool of Test-Takers?; and (3) Selecting Comparison Schools. (Contains 3 boxes, 6 tables, and 20 figures.) [Additional supplemental funding for this document was provided by the Lucent Technologies Foundation; and Project GRAD USA.]
Reviews of Individual Studies 9-12 -1
National Assessment of Title I: Interim Report. Volume II: Closing the Reading Gap: First Year Findings from a Randomized Trial of Four Reading Interventions for Striving Readers. NCEE 2006-4002 (2006)
According to the National Assessment of Educational Progress, nearly 4 in 10 fourth graders read below the basic level. These literacy problems get worse as students advance through school and are exposed to progressively more complex concepts and courses. The purpose of this study was to assess the effectiveness of four remedial reading programs in improving the reading skills of 3rd and 5th graders, whether the impacts of the programs vary across students with difference baseline characteristics, and to what extent can this instruction close the reading gap and bring struggling readers within the normal range--relative to the instruction normally provided by their schools. The study took place in elementary schools in 27 districts of the Allegheny Intermediate Unit outside Pittsburgh, PA during the 2003-04 school year. Within each of 50 schools, 3rd and 5th grade students were identified as struggling readers by their teachers. These students were tested and were eligible for the study if they scored at or below the 30th percentile on a word-level reading test and at or above the 5th percentile on a vocabulary test. The final sample contains a total of 742 students. There are 335 3rd graders ? 208 treatment and 127 control students. There are 407 5th graders ? 228 treatment and 179 control students. Four existing programs were used: Spell Read P.A.T., Corrective Reading, Wilson Reading, and Failure Free Reading. Corrective Reading and Wilson Reading were modified to focus only on word-level skills. Spell Read P.A.T. and Failure Free Reading were intended to focus equally on word-level skills and reading comprehension/vocabulary. Teachers received 70 hours of professional development and support during the year. Instruction was delivered in small groups of 3 students, 5 days a week, for a total of 90 hours. Seven measures of reading skill were administered at the beginning and end of the school year to assess student progress: Word Attack, Word Identification Comprehension (Woodcock Reading Mastery Test); Phonemic Decoding Efficiency and Sight Word Efficiency (Test of Word Reading Efficiency); Oral Reading Fluency (Edformation); and Passage Comprehension (Group Reading Assessment and Diagnostic Evaluation). After one year of instruction, there were significant impacts on phonemic decoding, word reading accuracy and fluency, and comprehension for 3rd graders, but not for 5th graders. For third graders in the reading programs, the gap in word attach skills between struggling readers and average readers was reduced by about two-thirds. It was found that reading skills of 3rd graders can be significantly improved through instruction in word-level skills, but not the reading skills of 5th graders. The following are appended: (1) Details of Study Design and Implementation; (2) Data Collection; (3) Weighting Adjustment and Missing Data; (4) Details of Statistical Methods; (5) Intervention Impacts on Spelling and Calculation; (6) Instructional Group Clustering; (7) Parent Survey; (8) Teacher Survey and Behavioral Rating Forms; (9) Instructional Group Clustering; (10) Videotape Coding Guidelines for Each Reading Program; (11) Supporting Tables; (12) Sample Test Items; (13) Impact Estimate Standard Errors and P-Values; (14) Association between Instructional Group Heterogeneity and The Outcome; (15) Teacher Rating Form; (16) School Survey; and (17) Scientific Advisory Board. [This report was produced by the Corporation for the Advancement of Policy Evaluation. Additional support provided by the Barksdale Reading Institute, and the Haan Foundation for Children.]
Reviews of Individual Studies 2-3 -1
An evaluation of two contrasting approaches for improving reading achievement in a large urban district. (2006)
This independent evaluation of 2 commonly used approaches for accelerating reading achievement and reducing inappropriate special education referrals, Success for All (SFA) and Open Court, was conducted in 12 Title I schools in a large urban district in northern California. To compare the effects of these approaches, we collected data on 936 grade 2 and 3 students over 2 years and 5,694 K through 6 students over 3 years to determine academic and special education enrollment outcomes, respectively. Results supported the prediction that students who used Open Court would outperform those who used SFA on mean SAT9 scores in reading and language but not the prediction that SFA would help students in the bottom quartile of SAT9 score higher or reduce demand for special education services more than Open Court. Neither Open Court nor SFA was associated with reductions in special education enrollment rates, except in Title I schools with the least poverty. A follow-up survey of 17 teachers and an analysis of lesson pacing plans suggested why the teachers saw Open Court as superior on academic outcomes and SFA on social outcomes.
Reviews of Individual Studies 2-3 -1
Saxon Elementary Math Program effectiveness study. (2006)
Reviews of Individual Studies 2-3 -1
Paraeducator-Supplemented Instruction in Structural Analysis with Text Reading Practice for Second and Third Graders at Risk for Reading Problems (2006)
Two studies--one quasi-experimental and one randomized experiment--were designed to evaluate the effectiveness of supplemental instruction in structural analysis and oral reading practice for second- and third-grade students with below-average word reading skills. Individual instruction was provided by trained paraeducators in single- and multiletter phoneme-grapheme correspondences; structural analysis of inflected, affixed, and multi-syllable words; exception word reading; and scaffolded oral reading practice. Both studies revealed short-term word level and fluency effects.
Reviews of Individual Studies 2 -1
Increasing Story-Writing Ability through Self-Regulated Strategy Development: Effects on Young Writers with Learning Disabilities (2006)
In this replication study, supplemental writing instruction in strategic planning was used to improve the story writing ability of young writers with learning disabilities (LD) and poor writing skills. Six 2nd-grade students with learning disabilities who experienced difficulty with story writing were taught a strategy for planning and writing stories using the Self-Regulated Strategy Development approach. The effects of the strategy were assessed through a multiple-baseline-across-subjects design. After learning the strategy the stories written by the students at post-instruction and maintenance became more complete, longer, and qualitatively better. In addition, planning time at post-instruction and maintenance increased. Limitations of the study and implications for practice are discussed. (Contains 1 table and 4 figures.)
Reviews of Individual Studies 3 -1
National Assessment of Title I: Interim Report. Volume II: Closing the Reading Gap: First Year Findings from a Randomized Trial of Four Reading Interventions for Striving Readers. NCEE 2006-4002 (2006)
According to the National Assessment of Educational Progress, nearly 4 in 10 fourth graders read below the basic level. These literacy problems get worse as students advance through school and are exposed to progressively more complex concepts and courses. The purpose of this study was to assess the effectiveness of four remedial reading programs in improving the reading skills of 3rd and 5th graders, whether the impacts of the programs vary across students with difference baseline characteristics, and to what extent can this instruction close the reading gap and bring struggling readers within the normal range--relative to the instruction normally provided by their schools. The study took place in elementary schools in 27 districts of the Allegheny Intermediate Unit outside Pittsburgh, PA during the 2003-04 school year. Within each of 50 schools, 3rd and 5th grade students were identified as struggling readers by their teachers. These students were tested and were eligible for the study if they scored at or below the 30th percentile on a word-level reading test and at or above the 5th percentile on a vocabulary test. The final sample contains a total of 742 students. There are 335 3rd graders ? 208 treatment and 127 control students. There are 407 5th graders ? 228 treatment and 179 control students. Four existing programs were used: Spell Read P.A.T., Corrective Reading, Wilson Reading, and Failure Free Reading. Corrective Reading and Wilson Reading were modified to focus only on word-level skills. Spell Read P.A.T. and Failure Free Reading were intended to focus equally on word-level skills and reading comprehension/vocabulary. Teachers received 70 hours of professional development and support during the year. Instruction was delivered in small groups of 3 students, 5 days a week, for a total of 90 hours. Seven measures of reading skill were administered at the beginning and end of the school year to assess student progress: Word Attack, Word Identification Comprehension (Woodcock Reading Mastery Test); Phonemic Decoding Efficiency and Sight Word Efficiency (Test of Word Reading Efficiency); Oral Reading Fluency (Edformation); and Passage Comprehension (Group Reading Assessment and Diagnostic Evaluation). After one year of instruction, there were significant impacts on phonemic decoding, word reading accuracy and fluency, and comprehension for 3rd graders, but not for 5th graders. For third graders in the reading programs, the gap in word attach skills between struggling readers and average readers was reduced by about two-thirds. It was found that reading skills of 3rd graders can be significantly improved through instruction in word-level skills, but not the reading skills of 5th graders. The following are appended: (1) Details of Study Design and Implementation; (2) Data Collection; (3) Weighting Adjustment and Missing Data; (4) Details of Statistical Methods; (5) Intervention Impacts on Spelling and Calculation; (6) Instructional Group Clustering; (7) Parent Survey; (8) Teacher Survey and Behavioral Rating Forms; (9) Instructional Group Clustering; (10) Videotape Coding Guidelines for Each Reading Program; (11) Supporting Tables; (12) Sample Test Items; (13) Impact Estimate Standard Errors and P-Values; (14) Association between Instructional Group Heterogeneity and The Outcome; (15) Teacher Rating Form; (16) School Survey; and (17) Scientific Advisory Board. [This report was produced by the Corporation for the Advancement of Policy Evaluation. Additional support provided by the Barksdale Reading Institute, and the Haan Foundation for Children.]
Reviews of Individual Studies 3 -1
Teaching to Read Naturally: Examination of a fluency training program for third grade students. (2006)
Reviews of Individual Studies 2-4 -1
Teaching Spelling to Students with Learning Disabilities: A Comparison of Rule-Based Strategies versus Traditional Instruction (2006)
This study compared two instructional methods for teaching spelling to elementary students with learning disabilities (LD). Forty-two elementary students with LD were randomly assigned to one of two instructional groups to teach spelling words: (a) a rule-based strategy group that focused on teaching students spelling rules (based on the "Spelling Mastery Level D" program) and (b) a traditional instruction group that provided an array of spelling activities (i.e., introducing the words in the context of story, defining the meaning of the words, sentence writing, and dictionary skill training) to teach spelling words. Daily instructional sessions lasting 30 minutes were conducted for 4 consecutive weeks. Four different word types (i.e., regular, morphological, spelling rule, and irregular) were introduced as instruction progressed. After receiving instruction in one of the instructional groups, the students were compared on scores from unit tests, a standardized test, a sentence-writing test, a transfer test, and a maintenance test. Overall results indicated that the rule-based strategy group using "Spelling Mastery Level D" was more effective in increasing student-spelling performance, particularly for the regular, morphological, and spelling-rule words. The instructional implications of these findings are discussed. (Contains 7 tables.)
Reviews of Individual Studies 1 -1
The Efficacy of Computer-Based Supplementary Phonics Programs for Advancing Reading Skills in At-Risk Elementary Students (2006)
In this study we examined the benefits of computer programs designed to supplement regular reading instruction in an urban public school system. The programs provide systematic exercises for mastering word-attack strategies. Our findings indicate that first graders who participated in the programs made significant reading gains over the school year. Their post-test scores were slightly (but not significantly) greater than the post-test scores of control children who received regular reading instruction without the programs. When analyses were restricted to low-performing children eligible for Title I services, significantly higher post-test scores were obtained by the treatment group compared to the control group. At post-test Title I children in the treatment group performed at levels similar to non-Title I students.
Reviews of Individual Studies 1 -1
Effectiveness of a Spanish Intervention and an English Intervention for English-Language Learners at Risk for Reading Problems (2006)
Two studies of Grade 1 reading interventions for English-language (EL) learners at risk for reading problems were conducted. Two samples of EL students were randomly assigned to a treatment or untreated comparison group on the basis of their language of instruction for core reading (i.e., Spanish or English). In all, 91 students completed the English study (43 treatment and 48 comparison), and 80 students completed the Spanish study (35 treatment and 45 comparison). Treatment students received approximately 115 sessions of supplemental reading daily for 50 minutes in groups of 3 to 5. Findings from the English study revealed statistically significant differences in favor of treatment students on English measures of phonological awareness, word attack, word reading, and spelling (effect sizes of 0.35-0.42). Findings from the Spanish study revealed significant differences in favor of treatment students on Spanish measures of phonological awareness, letter-sound and letter-word identification, verbal analogies, word reading fluency, and spelling (effect sizes of 0.33-0.81).
Reviews of Individual Studies 1 -1
Effectiveness of an English Intervention for First-Grade English Language Learners at Risk for Reading Problems (2006)
A first-grade reading and language development intervention for English language learners (Spanish/English) at risk for reading difficulties was examined. The intervention was conducted in the same language as students' core reading instruction (English). Two hundred sixteen first-grade students from 14 classrooms in 4 schools from 2 districts were screened in both English and Spanish. Forty-eight students (22%) did not pass the screening in both languages and were randomly assigned within schools to an intervention or contrast group; after 7 months, 41 students remained in the study. Intervention groups of 3 to 5 students met daily (50 minutes) and were provided systematic and explicit instruction in oral language and reading by trained bilingual reading intervention teachers. Students assigned to the contrast condition received their school's existing intervention for struggling readers. Intervention students significantly outperformed contrast students on multiple measures of English letter naming, phonological awareness and other language skills, and reading and academic achievement. Differences were less significant for Spanish measures of these domains, though the strongest effects favoring the intervention students were in the areas of phonological awareness and related reading skills.
Reviews of Individual Studies 7-8 -1
Improving student literacy: READ 180 in the Austin Independent School District, 2004–05. (2006)
Reviews of Individual Studies 7 -1
Can brain research and computers improve literacy? A randomized field trial of the Fast ForWord Language computer-based training program. (2006)
Reviews of Individual Studies 6-8 -1
Improving the Reading Comprehension of Middle School Students with Disabilities through Computer-Assisted Collaborative Strategic Reading (2006)
This study investigated the effects of computer-assisted comprehension practice using a researcher-developed computer program, Computer-Assisted Collaborative Strategic Reading (CACSR), with students who had disabilities. Two reading/language arts teachers and their 34 students with disabilities participated. Students in the intervention group received the CACSR intervention, which consisted of 50-min instructional sessions twice per week over 10 to 12 weeks. The results revealed a statistically significant difference between intervention and comparison groups' reading comprehension ability as measured by a researcher-developed, proximal measure (i.e., finding main ideas and question generation) and a distal, standardized measure (i.e., "Woodcock Reading Mastery Test," Passage Comprehension). Effect sizes for all dependent measures favored the CACSR group. Furthermore, a majority of students expressed positive overall perspectives of the CACSR intervention and believed that their reading had improved.
Reviews of Individual Studies 8 -1
I CAN Learn in Orleans parish public schools: Effects on LEAP 8th grade math achievement, 2003–2004. (2006)
Reviews of Individual Studies 6 -1
The Development of Flexibility in Equation Solving (2006)
This paper explores the development of students' knowledge of mathematical procedures. Students' tendency to develop rote knowledge of procedures has been widely commented on. An alternative, more flexible endpoint for the development of procedural knowledge is explored here, where students choose to deviate from established solving patterns on particular problems for greater efficiency. Students with no prior knowledge of formal linear equation solving techniques were taught the basic transformations of this domain. After instruction, students engaged in problem-solving sessions in two conditions. Treatment students completed the "alternative ordering task," where they were asked to re-solve a previously completed problem but using a different ordering of transformations. Those completing alternative ordering tasks demonstrated greater flexibility.
Reviews of Individual Studies 5 -1
Masked Intervention Effects: Analytic Methods for Addressing Low Dosage of Intervention (2006)
This chapter examines how a particular strategy for analyzing evaluation data, intent-to-treat (ITT) analyses, may underestimate the true effects of interventions. Such underestimation of intervention effects can profoundly influence policies for prevention and treatment of children's mental health problems, which can in turn lead to negative consequences for children's healthy development. However, evaluating treatment is a complicated issue because poorer outcomes for some may be due to characteristics of the participants, such as low motivation or chaotic family conditions, rather than qualities of the intervention. ITT analyses purposely ignore these nonrandom sources of variance. Using ITT analyses, evaluations of programs to reduce oppositional defiant disorders and conduct disorders in children and adolescents have consistently revealed that cognitive-behavioral interventions have the most promise and clearest evidence for efficacy, with effect sizes on outcome analyses in the moderate to large range (from 0.3 to over 1.0). These interventions usually involve behavioral parent training but also can include social problem-solving skills training, anger management training, and social skills training with the children. Using analyses of the effects of an intervention designed to reduce children's externalizing behavior problems and thus their risk for later delinquency and substance use as an example, the authors compare how propensity analyses and three types of complier average causal effect (CACE) analyses fare in comparison to traditional ITT analyses and often-used as-treated analyses. Although these techniques have been presented as an alternative and possible improvement, analyses of compliance have not considered the consequences of how the criteria for compliance are determined for a particular intervention, nor do they account for whether the compliance analyses produce different effects at different levels of compliance. Therefore, the present example also compares two levels of compliance, one representing a criterion of at least minimal compliance with the intervention and a second representing a high level of attendance and compliance. The general conclusion as a result of comparing these multiple strategies is that how one specifies parents' compliance in an evaluation design for a preventive intervention affects the interpretation of findings of program efficacy. The authors suggest that future research should aggressively pursue methods for setting optimal thresholds in analytic approaches that extend beyond ITT. (Contains 1 table.)
Reviews of Individual Studies 5 -1
National Assessment of Title I: Interim Report. Volume II: Closing the Reading Gap: First Year Findings from a Randomized Trial of Four Reading Interventions for Striving Readers. NCEE 2006-4002 (2006)
According to the National Assessment of Educational Progress, nearly 4 in 10 fourth graders read below the basic level. These literacy problems get worse as students advance through school and are exposed to progressively more complex concepts and courses. The purpose of this study was to assess the effectiveness of four remedial reading programs in improving the reading skills of 3rd and 5th graders, whether the impacts of the programs vary across students with difference baseline characteristics, and to what extent can this instruction close the reading gap and bring struggling readers within the normal range--relative to the instruction normally provided by their schools. The study took place in elementary schools in 27 districts of the Allegheny Intermediate Unit outside Pittsburgh, PA during the 2003-04 school year. Within each of 50 schools, 3rd and 5th grade students were identified as struggling readers by their teachers. These students were tested and were eligible for the study if they scored at or below the 30th percentile on a word-level reading test and at or above the 5th percentile on a vocabulary test. The final sample contains a total of 742 students. There are 335 3rd graders ? 208 treatment and 127 control students. There are 407 5th graders ? 228 treatment and 179 control students. Four existing programs were used: Spell Read P.A.T., Corrective Reading, Wilson Reading, and Failure Free Reading. Corrective Reading and Wilson Reading were modified to focus only on word-level skills. Spell Read P.A.T. and Failure Free Reading were intended to focus equally on word-level skills and reading comprehension/vocabulary. Teachers received 70 hours of professional development and support during the year. Instruction was delivered in small groups of 3 students, 5 days a week, for a total of 90 hours. Seven measures of reading skill were administered at the beginning and end of the school year to assess student progress: Word Attack, Word Identification Comprehension (Woodcock Reading Mastery Test); Phonemic Decoding Efficiency and Sight Word Efficiency (Test of Word Reading Efficiency); Oral Reading Fluency (Edformation); and Passage Comprehension (Group Reading Assessment and Diagnostic Evaluation). After one year of instruction, there were significant impacts on phonemic decoding, word reading accuracy and fluency, and comprehension for 3rd graders, but not for 5th graders. For third graders in the reading programs, the gap in word attach skills between struggling readers and average readers was reduced by about two-thirds. It was found that reading skills of 3rd graders can be significantly improved through instruction in word-level skills, but not the reading skills of 5th graders. The following are appended: (1) Details of Study Design and Implementation; (2) Data Collection; (3) Weighting Adjustment and Missing Data; (4) Details of Statistical Methods; (5) Intervention Impacts on Spelling and Calculation; (6) Instructional Group Clustering; (7) Parent Survey; (8) Teacher Survey and Behavioral Rating Forms; (9) Instructional Group Clustering; (10) Videotape Coding Guidelines for Each Reading Program; (11) Supporting Tables; (12) Sample Test Items; (13) Impact Estimate Standard Errors and P-Values; (14) Association between Instructional Group Heterogeneity and The Outcome; (15) Teacher Rating Form; (16) School Survey; and (17) Scientific Advisory Board. [This report was produced by the Corporation for the Advancement of Policy Evaluation. Additional support provided by the Barksdale Reading Institute, and the Haan Foundation for Children.]
Reviews of Individual Studies 5 -1
National Assessment of Title I: Interim Report. Volume II: Closing the Reading Gap: First Year Findings from a Randomized Trial of Four Reading Interventions for Striving Readers. NCEE 2006-4002 (2006)
According to the National Assessment of Educational Progress, nearly 4 in 10 fourth graders read below the basic level. These literacy problems get worse as students advance through school and are exposed to progressively more complex concepts and courses. The purpose of this study was to assess the effectiveness of four remedial reading programs in improving the reading skills of 3rd and 5th graders, whether the impacts of the programs vary across students with difference baseline characteristics, and to what extent can this instruction close the reading gap and bring struggling readers within the normal range--relative to the instruction normally provided by their schools. The study took place in elementary schools in 27 districts of the Allegheny Intermediate Unit outside Pittsburgh, PA during the 2003-04 school year. Within each of 50 schools, 3rd and 5th grade students were identified as struggling readers by their teachers. These students were tested and were eligible for the study if they scored at or below the 30th percentile on a word-level reading test and at or above the 5th percentile on a vocabulary test. The final sample contains a total of 742 students. There are 335 3rd graders ? 208 treatment and 127 control students. There are 407 5th graders ? 228 treatment and 179 control students. Four existing programs were used: Spell Read P.A.T., Corrective Reading, Wilson Reading, and Failure Free Reading. Corrective Reading and Wilson Reading were modified to focus only on word-level skills. Spell Read P.A.T. and Failure Free Reading were intended to focus equally on word-level skills and reading comprehension/vocabulary. Teachers received 70 hours of professional development and support during the year. Instruction was delivered in small groups of 3 students, 5 days a week, for a total of 90 hours. Seven measures of reading skill were administered at the beginning and end of the school year to assess student progress: Word Attack, Word Identification Comprehension (Woodcock Reading Mastery Test); Phonemic Decoding Efficiency and Sight Word Efficiency (Test of Word Reading Efficiency); Oral Reading Fluency (Edformation); and Passage Comprehension (Group Reading Assessment and Diagnostic Evaluation). After one year of instruction, there were significant impacts on phonemic decoding, word reading accuracy and fluency, and comprehension for 3rd graders, but not for 5th graders. For third graders in the reading programs, the gap in word attach skills between struggling readers and average readers was reduced by about two-thirds. It was found that reading skills of 3rd graders can be significantly improved through instruction in word-level skills, but not the reading skills of 5th graders. The following are appended: (1) Details of Study Design and Implementation; (2) Data Collection; (3) Weighting Adjustment and Missing Data; (4) Details of Statistical Methods; (5) Intervention Impacts on Spelling and Calculation; (6) Instructional Group Clustering; (7) Parent Survey; (8) Teacher Survey and Behavioral Rating Forms; (9) Instructional Group Clustering; (10) Videotape Coding Guidelines for Each Reading Program; (11) Supporting Tables; (12) Sample Test Items; (13) Impact Estimate Standard Errors and P-Values; (14) Association between Instructional Group Heterogeneity and The Outcome; (15) Teacher Rating Form; (16) School Survey; and (17) Scientific Advisory Board. [This report was produced by the Corporation for the Advancement of Policy Evaluation. Additional support provided by the Barksdale Reading Institute, and the Haan Foundation for Children.]
Reviews of Individual Studies 5 -1
National Assessment of Title I: Interim Report. Volume II: Closing the Reading Gap: First Year Findings from a Randomized Trial of Four Reading Interventions for Striving Readers. NCEE 2006-4002 (2006)
According to the National Assessment of Educational Progress, nearly 4 in 10 fourth graders read below the basic level. These literacy problems get worse as students advance through school and are exposed to progressively more complex concepts and courses. The purpose of this study was to assess the effectiveness of four remedial reading programs in improving the reading skills of 3rd and 5th graders, whether the impacts of the programs vary across students with difference baseline characteristics, and to what extent can this instruction close the reading gap and bring struggling readers within the normal range--relative to the instruction normally provided by their schools. The study took place in elementary schools in 27 districts of the Allegheny Intermediate Unit outside Pittsburgh, PA during the 2003-04 school year. Within each of 50 schools, 3rd and 5th grade students were identified as struggling readers by their teachers. These students were tested and were eligible for the study if they scored at or below the 30th percentile on a word-level reading test and at or above the 5th percentile on a vocabulary test. The final sample contains a total of 742 students. There are 335 3rd graders ? 208 treatment and 127 control students. There are 407 5th graders ? 228 treatment and 179 control students. Four existing programs were used: Spell Read P.A.T., Corrective Reading, Wilson Reading, and Failure Free Reading. Corrective Reading and Wilson Reading were modified to focus only on word-level skills. Spell Read P.A.T. and Failure Free Reading were intended to focus equally on word-level skills and reading comprehension/vocabulary. Teachers received 70 hours of professional development and support during the year. Instruction was delivered in small groups of 3 students, 5 days a week, for a total of 90 hours. Seven measures of reading skill were administered at the beginning and end of the school year to assess student progress: Word Attack, Word Identification Comprehension (Woodcock Reading Mastery Test); Phonemic Decoding Efficiency and Sight Word Efficiency (Test of Word Reading Efficiency); Oral Reading Fluency (Edformation); and Passage Comprehension (Group Reading Assessment and Diagnostic Evaluation). After one year of instruction, there were significant impacts on phonemic decoding, word reading accuracy and fluency, and comprehension for 3rd graders, but not for 5th graders. For third graders in the reading programs, the gap in word attach skills between struggling readers and average readers was reduced by about two-thirds. It was found that reading skills of 3rd graders can be significantly improved through instruction in word-level skills, but not the reading skills of 5th graders. The following are appended: (1) Details of Study Design and Implementation; (2) Data Collection; (3) Weighting Adjustment and Missing Data; (4) Details of Statistical Methods; (5) Intervention Impacts on Spelling and Calculation; (6) Instructional Group Clustering; (7) Parent Survey; (8) Teacher Survey and Behavioral Rating Forms; (9) Instructional Group Clustering; (10) Videotape Coding Guidelines for Each Reading Program; (11) Supporting Tables; (12) Sample Test Items; (13) Impact Estimate Standard Errors and P-Values; (14) Association between Instructional Group Heterogeneity and The Outcome; (15) Teacher Rating Form; (16) School Survey; and (17) Scientific Advisory Board. [This report was produced by the Corporation for the Advancement of Policy Evaluation. Additional support provided by the Barksdale Reading Institute, and the Haan Foundation for Children.]
Reviews of Individual Studies 5 -1
National Assessment of Title I: Interim Report. Volume II: Closing the Reading Gap: First Year Findings from a Randomized Trial of Four Reading Interventions for Striving Readers. NCEE 2006-4002 (2006)
According to the National Assessment of Educational Progress, nearly 4 in 10 fourth graders read below the basic level. These literacy problems get worse as students advance through school and are exposed to progressively more complex concepts and courses. The purpose of this study was to assess the effectiveness of four remedial reading programs in improving the reading skills of 3rd and 5th graders, whether the impacts of the programs vary across students with difference baseline characteristics, and to what extent can this instruction close the reading gap and bring struggling readers within the normal range--relative to the instruction normally provided by their schools. The study took place in elementary schools in 27 districts of the Allegheny Intermediate Unit outside Pittsburgh, PA during the 2003-04 school year. Within each of 50 schools, 3rd and 5th grade students were identified as struggling readers by their teachers. These students were tested and were eligible for the study if they scored at or below the 30th percentile on a word-level reading test and at or above the 5th percentile on a vocabulary test. The final sample contains a total of 742 students. There are 335 3rd graders ? 208 treatment and 127 control students. There are 407 5th graders ? 228 treatment and 179 control students. Four existing programs were used: Spell Read P.A.T., Corrective Reading, Wilson Reading, and Failure Free Reading. Corrective Reading and Wilson Reading were modified to focus only on word-level skills. Spell Read P.A.T. and Failure Free Reading were intended to focus equally on word-level skills and reading comprehension/vocabulary. Teachers received 70 hours of professional development and support during the year. Instruction was delivered in small groups of 3 students, 5 days a week, for a total of 90 hours. Seven measures of reading skill were administered at the beginning and end of the school year to assess student progress: Word Attack, Word Identification Comprehension (Woodcock Reading Mastery Test); Phonemic Decoding Efficiency and Sight Word Efficiency (Test of Word Reading Efficiency); Oral Reading Fluency (Edformation); and Passage Comprehension (Group Reading Assessment and Diagnostic Evaluation). After one year of instruction, there were significant impacts on phonemic decoding, word reading accuracy and fluency, and comprehension for 3rd graders, but not for 5th graders. For third graders in the reading programs, the gap in word attach skills between struggling readers and average readers was reduced by about two-thirds. It was found that reading skills of 3rd graders can be significantly improved through instruction in word-level skills, but not the reading skills of 5th graders. The following are appended: (1) Details of Study Design and Implementation; (2) Data Collection; (3) Weighting Adjustment and Missing Data; (4) Details of Statistical Methods; (5) Intervention Impacts on Spelling and Calculation; (6) Instructional Group Clustering; (7) Parent Survey; (8) Teacher Survey and Behavioral Rating Forms; (9) Instructional Group Clustering; (10) Videotape Coding Guidelines for Each Reading Program; (11) Supporting Tables; (12) Sample Test Items; (13) Impact Estimate Standard Errors and P-Values; (14) Association between Instructional Group Heterogeneity and The Outcome; (15) Teacher Rating Form; (16) School Survey; and (17) Scientific Advisory Board. [This report was produced by the Corporation for the Advancement of Policy Evaluation. Additional support provided by the Barksdale Reading Institute, and the Haan Foundation for Children.]
Reviews of Individual Studies 5 -1
National Assessment of Title I: Interim Report. Volume II: Closing the Reading Gap: First Year Findings from a Randomized Trial of Four Reading Interventions for Striving Readers. NCEE 2006-4002 (2006)
According to the National Assessment of Educational Progress, nearly 4 in 10 fourth graders read below the basic level. These literacy problems get worse as students advance through school and are exposed to progressively more complex concepts and courses. The purpose of this study was to assess the effectiveness of four remedial reading programs in improving the reading skills of 3rd and 5th graders, whether the impacts of the programs vary across students with difference baseline characteristics, and to what extent can this instruction close the reading gap and bring struggling readers within the normal range--relative to the instruction normally provided by their schools. The study took place in elementary schools in 27 districts of the Allegheny Intermediate Unit outside Pittsburgh, PA during the 2003-04 school year. Within each of 50 schools, 3rd and 5th grade students were identified as struggling readers by their teachers. These students were tested and were eligible for the study if they scored at or below the 30th percentile on a word-level reading test and at or above the 5th percentile on a vocabulary test. The final sample contains a total of 742 students. There are 335 3rd graders ? 208 treatment and 127 control students. There are 407 5th graders ? 228 treatment and 179 control students. Four existing programs were used: Spell Read P.A.T., Corrective Reading, Wilson Reading, and Failure Free Reading. Corrective Reading and Wilson Reading were modified to focus only on word-level skills. Spell Read P.A.T. and Failure Free Reading were intended to focus equally on word-level skills and reading comprehension/vocabulary. Teachers received 70 hours of professional development and support during the year. Instruction was delivered in small groups of 3 students, 5 days a week, for a total of 90 hours. Seven measures of reading skill were administered at the beginning and end of the school year to assess student progress: Word Attack, Word Identification Comprehension (Woodcock Reading Mastery Test); Phonemic Decoding Efficiency and Sight Word Efficiency (Test of Word Reading Efficiency); Oral Reading Fluency (Edformation); and Passage Comprehension (Group Reading Assessment and Diagnostic Evaluation). After one year of instruction, there were significant impacts on phonemic decoding, word reading accuracy and fluency, and comprehension for 3rd graders, but not for 5th graders. For third graders in the reading programs, the gap in word attach skills between struggling readers and average readers was reduced by about two-thirds. It was found that reading skills of 3rd graders can be significantly improved through instruction in word-level skills, but not the reading skills of 5th graders. The following are appended: (1) Details of Study Design and Implementation; (2) Data Collection; (3) Weighting Adjustment and Missing Data; (4) Details of Statistical Methods; (5) Intervention Impacts on Spelling and Calculation; (6) Instructional Group Clustering; (7) Parent Survey; (8) Teacher Survey and Behavioral Rating Forms; (9) Instructional Group Clustering; (10) Videotape Coding Guidelines for Each Reading Program; (11) Supporting Tables; (12) Sample Test Items; (13) Impact Estimate Standard Errors and P-Values; (14) Association between Instructional Group Heterogeneity and The Outcome; (15) Teacher Rating Form; (16) School Survey; and (17) Scientific Advisory Board. [This report was produced by the Corporation for the Advancement of Policy Evaluation. Additional support provided by the Barksdale Reading Institute, and the Haan Foundation for Children.]
Reviews of Individual Studies 4-6 -1
Effects of prior attention training on child dyslexics’ response to composition instruction. (2006)
Reviews of Individual Studies 3-5 -1
2005 Scott Foresman–Addison Wesley Elementary Math randomized control trial: Final report. (2006)
Reviews of Individual Studies 3-5 -1
Increasing student achievement in writing through teacher inquiry: An evaluation of professional development impact. (2006)
Reviews of Individual Studies 3-5 -1
National Assessment of Title I: Interim Report. Volume II: Closing the Reading Gap: First Year Findings from a Randomized Trial of Four Reading Interventions for Striving Readers. NCEE 2006-4002 (2006)
According to the National Assessment of Educational Progress, nearly 4 in 10 fourth graders read below the basic level. These literacy problems get worse as students advance through school and are exposed to progressively more complex concepts and courses. The purpose of this study was to assess the effectiveness of four remedial reading programs in improving the reading skills of 3rd and 5th graders, whether the impacts of the programs vary across students with difference baseline characteristics, and to what extent can this instruction close the reading gap and bring struggling readers within the normal range--relative to the instruction normally provided by their schools. The study took place in elementary schools in 27 districts of the Allegheny Intermediate Unit outside Pittsburgh, PA during the 2003-04 school year. Within each of 50 schools, 3rd and 5th grade students were identified as struggling readers by their teachers. These students were tested and were eligible for the study if they scored at or below the 30th percentile on a word-level reading test and at or above the 5th percentile on a vocabulary test. The final sample contains a total of 742 students. There are 335 3rd graders ? 208 treatment and 127 control students. There are 407 5th graders ? 228 treatment and 179 control students. Four existing programs were used: Spell Read P.A.T., Corrective Reading, Wilson Reading, and Failure Free Reading. Corrective Reading and Wilson Reading were modified to focus only on word-level skills. Spell Read P.A.T. and Failure Free Reading were intended to focus equally on word-level skills and reading comprehension/vocabulary. Teachers received 70 hours of professional development and support during the year. Instruction was delivered in small groups of 3 students, 5 days a week, for a total of 90 hours. Seven measures of reading skill were administered at the beginning and end of the school year to assess student progress: Word Attack, Word Identification Comprehension (Woodcock Reading Mastery Test); Phonemic Decoding Efficiency and Sight Word Efficiency (Test of Word Reading Efficiency); Oral Reading Fluency (Edformation); and Passage Comprehension (Group Reading Assessment and Diagnostic Evaluation). After one year of instruction, there were significant impacts on phonemic decoding, word reading accuracy and fluency, and comprehension for 3rd graders, but not for 5th graders. For third graders in the reading programs, the gap in word attach skills between struggling readers and average readers was reduced by about two-thirds. It was found that reading skills of 3rd graders can be significantly improved through instruction in word-level skills, but not the reading skills of 5th graders. The following are appended: (1) Details of Study Design and Implementation; (2) Data Collection; (3) Weighting Adjustment and Missing Data; (4) Details of Statistical Methods; (5) Intervention Impacts on Spelling and Calculation; (6) Instructional Group Clustering; (7) Parent Survey; (8) Teacher Survey and Behavioral Rating Forms; (9) Instructional Group Clustering; (10) Videotape Coding Guidelines for Each Reading Program; (11) Supporting Tables; (12) Sample Test Items; (13) Impact Estimate Standard Errors and P-Values; (14) Association between Instructional Group Heterogeneity and The Outcome; (15) Teacher Rating Form; (16) School Survey; and (17) Scientific Advisory Board. [This report was produced by the Corporation for the Advancement of Policy Evaluation. Additional support provided by the Barksdale Reading Institute, and the Haan Foundation for Children.]
Reviews of Individual Studies 3 -1
Improved reading skills by students in the Lancaster County School District who used Fast ForWord® to Reading 2. (2005b)
Reviews of Individual Studies 2-4 -1
Final report: A study on the effectiveness of the 2004 Scott Foresman–Addison Wesley Elementary Math program. (2005)
Reviews of Individual Studies 2 -1
Fluency Formula second grade study, Long Island, New York 2003-2004: Evaluation research on the effectiveness of Fluency Formula. (2005)
Reviews of Individual Studies 1-5 -1
The relationship between using Saxon Elementary and Middle School Math and student performance on Georgia statewide assessments. (2005)
Reviews of Individual Studies 2-3 -1
Improved reading skills by students in Seminole County School District who used Fast ForWord® to Reading 1 and 2. (2005)
Reviews of Individual Studies 1 -1
The effects of theoretically different instruction and student characteristics on the skills of struggling readers. (2005)
This study investigated the effectiveness of combining enhanced classroom instruction and intense supplemental intervention for struggling readers in first grade. Further, it compared two supplemental interventions derived from distinct theoretical orientations, examining them in terms of effects on academic outcomes and whether children's characteristics were differentially related to an instructional intervention. One intervention (Proactive Reading) was aligned with behavioral theory and was derived from the model of Direct Instruction. The other intervention (Responsive Reading) was aligned with a cognitive theory and was derived from a cognitive-apprenticeship model. These interventions were provided to small groups of first-grade students at risk for reading difficulties. Students were assessed on various reading and reading-related measures associated with success in beginning reading. Results indicated that (a) first-grade students who were at risk for reading failure and who received supplemental instruction in the Responsive or Proactive interventions scored higher on measures of reading and reading-related skills than students who received only enhanced classroom instruction, (b) enhanced classroom instruction appeared to promote high levels of reading growth for many children at risk for reading failure, (c) the two interventions were essentially equally effective even though they reflected different theoretical perspectives, and (d) children's characteristics did not differentially predict the effectiveness of an intervention.
Reviews of Individual Studies 1 -1
Progress in Mathematics ©2006: Grade 1 pre-post field test evaluation study. (2005)
Reviews of Individual Studies 1 -1
Responding to Nonresponders: An Experimental Field Trial of Identification and Intervention Methods (2005)
First graders (N = 323) participated in an evidence-based classwide reading program (Peer-Assisted Learning Strategies; PALS). A dual-discrepancy approach was used to identify 56 children whose reading performance and growth rates were substantially below those of average readers, indicating they were not responding sufficiently to PALS. This approach reliably distinguished among unresponsive at-risk, responsive at-risk, and average-performing readers. Nonresponders were assigned randomly to one of three increasingly individualized treatments: PALS, Modified PALS, or tutoring by an adult. No statistically significant between-group differences on reading-related measures were found. Effect sizes (between .30 and .50) comparing groups and proportions of nonresponders following treatment suggest that tutoring was most promising for reducing unresponsiveness.
Reviews of Individual Studies 3-5 -1
Effects of the Accelerated Reader on reading performance of third, fourth, and fifth-grade students in one western Oregon elementary school (Doctoral dissertation). (2005)
Reviews of Individual Studies 3-12 -1
Connect with Kids: 2004–2005 Study Results for Kansas and Missouri. (2005)
Reviews of Individual Studies 3-5 -1
Can Teacher Quality Be Effectively Assessed? National Board Certification as a Signal of Effective Teaching (2005)
In this paper, we describe the results a study assessing the relationship between the certification of teachers by the National Board for Professional Teaching Standards (NBPTS) and elementary level student achievement. We examine whether NBPTS assesses the most effective applicants, whether certification by NBPTS serves as a signal of teacher quality, and whether completing the NBPTS assessment process serves as catalyst for increasing teacher effectiveness. We find consistent evidence that NBPTS is identifying the more effective teacher applicants and that National Board Certified Teachers are generally more effective than teachers who never applied to the program. The statistical significance and magnitude of the "NBPTS effect," however, differs significantly by grade level and student type. We do not find evidence that the NBPTS certification process itself does anything to increase teacher effectiveness. Data tables are appended. (Contains 7 tables, 1 figure, and 49 endnotes.)
Reviews of Individual Studies 4 -1
Short-term effects of a literature-based character education program among fourth grade students: Report to the Young People's Press, Inc. (2005)
Reviews of Individual Studies 4-8 -1
A study of the relationship between the National Board Certification status of teachers and students’ achievement: Technical report. (2005)
Reviews of Individual Studies 4-8 -1
Balanced, Strategic Reading Instruction for Upper-Elementary and Middle School Students with Reading Disabilities: A Comparative Study of Two Approaches (2005)
This study compared the use of two supplemental balanced and strategic reading interventions that targeted the decoding, fluency, and reading comprehension of upper-elementary and middle school students with reading disabilities (RD). All students had significant delays in decoding, fluency, comprehension, and language processing. Two comparable, intensive tutorial treatments differed only in the degree of explicitness of the comprehension strategy instruction. Overall, there was meaningful progress in students' reading decoding, fluency, and comprehension. Gains in formal measures of word attack and reading fluency after five weeks of intervention translated into grade-equivalent gains of approximately half a school year. Analysis of the trends in the daily informal fluency probes translated into a weekly gain of 1.28 correct words per minute. The more explicit comprehension strategy instruction was more effective than the less explicit treatment. Findings are discussed in light of the question of how to maximize the effects of reading interventions for older children with RD.
Reviews of Individual Studies 4-6 -1
Accelerated Math in grades 4 through 6: evaluation of an experimental program in 15 schools in North Rhine-Westphalia. (2005)
Reviews of Individual Studies 4-5 -1
The Effects of Developmental Mentoring and High School Mentors' Attendance on Their Younger Mentees' Self-Esteem, Social Skills, and Connectedness (2005)
Far more has been written about the possible outcomes of cross-age mentoring than about actual outcomes and the processes that lead to change. This study examined the effect of mentors' attendance on their mentees' outcomes after six months of developmental mentoring. Developmental mentoring is a structured, cross-age peer mentoring program designed to promote children's development by facilitating connectedness. In this randomized study of 73 Caucasian, rural youth, multiple analyses of covariance revealed that connectedness to school and parents at posttest were significantly greater for mentees than for the comparison group. Regression analyses revealed that changes in self-esteem, social skills, and behavioral competence were highly related to mentors' attendance, suggesting relational processes accounted for more change than did exposure to program curricula. However, the relationship between mentors' inconsistent attendance and mentees' decline in self-esteem and behavioral competence suggests that absent mentors may do more harm than good. (Contains 4 tables.)
Reviews of Individual Studies 4-8 -1
Performance of District 23 students participating in Scholastic READ 180. (2005)
Reviews of Individual Studies 7-9 -1
An evaluation of the second edition of UCSMP Transition Mathematics. (2005)
Reviews of Individual Studies 6 -1
The relationship between using Saxon Middle School Math and student performance on Texas statewide assessments [Sample 3]. (2005)
Reviews of Individual Studies 6-8 -1
The relationship between using Saxon Middle School Math and student performance on Texas statewide assessments [Sample 1]. (2005)
Reviews of Individual Studies 9-12 -1
Making progress toward graduation. (2005)
In low-performing public high schools in U.S. cities, high proportions of students drop out, students who stay in school typically do not succeed academically, and efforts to make substantial reforms often meet with little success. The Talent Development High School model is a comprehensive school reform initiative that has been developed to address these challenges. Targeting some of the most troubled schools in the country, the model seeks to raise the expectations of teachers and students and to prepare all students for postsecondary education and employment. MDRC, a nonpartisan, nonprofit education and social policy research organization, conducted an independent, third-party evaluation of Talent Development. This rigorous evaluation focuses on the first five high schools to begin using the model in the School District of Philadelphia. The evaluation follows 20 cohorts of ninth-grade students for up to four years of high school using a comparative interrupted time series research design. Appended are: (1) Tables for First-Time Ninth-Grade Students; and (2) Tables for Repeating Ninth-Grade Students. (Contains 16 tables, 9 figures, and 3 boxes.)[Dissemination of MDRC publications is also supported by Starr Foundation.]
Reviews of Individual Studies 9-12 -1
Scaling up First Things First: The challenge of scaling up educational reform. (2005)
Reviews of Individual Studies K-1 -1
The effect of Earobics (TM) Step 1, software on student acquisition of phonological awareness skills. (2005)
Reviews of Individual Studies K -1
Learning new words from storybooks: An efficacy study with at-risk kindergartners. (2005)
Purpose: The extant literature suggests that exposure to novel vocabulary words through repeated readings of storybooks influences children's word learning, and that adult elaboration of words in context can accelerate vocabulary growth. This study examined the influence of small-group storybook reading sessions on the acquisition of vocabulary words for at-risk kindergartners, and the impact of word elaboration on learning. An additional goal was to study differential responses to treatment for children with high versus low vocabulary skill. Method: Using a pretest-posttest comparison group research design, 57 kindergartners were randomly assigned to a treatment (n=29) or comparison (n=28) group. Children were also differentiated into high (n=31) versus low (n=26) vocabulary skill groups using scores on a standardized receptive vocabulary test. Children in the treatment group completed 20 small-group storybook reading sessions during which they were exposed to 60 novel words randomly assigned to non-elaborated and elaborated conditions. Pre- and posttest examined the quality of children's definitions for the 60 novel words. Results: Overall, word-learning gains were modest. Children in the treatment group made significantly greater gains in elaborated words relative to children in the comparison group; no influence of storybook reading exposure was seen for non-elaborated words. Children with low vocabulary scores made the greatest gains on elaborated words. Clinical Implications: Suggestions are offered for using storybooks as a clinical tool for fostering vocabulary development. As an efficacy study, results should inform future applied research on word learning for at-risk children.
Reviews of Individual Studies K -1
Narrative Development in Bilingual Kindergarteners: Can Arthur Help? (2005)
This study examined the effects of the children's TV program Arthur on the development of narrative skills over an academic year for Spanish-speaking English-language learners. In October, February, and June of their kindergarten year, children were asked to tell a story, in English, prompted by 3 pictures. Before the 2nd and 3rd assessments, half of the 108 children were randomly assigned to view Arthur 3 times a week during school hours, and the other half, which formed the control group, viewed the children's program Between the Lions on the same schedule. Individual growth modeling analysis showed that children who viewed Arthur had steeper growth trajectories than those who viewed Between the Lions. Boys displayed better English narrative skills than girls but no difference in narrative growth rate. The results suggest that certain educational TV programs can assist in some aspects of the language development of bilingual children.
Reviews of Individual Studies 1 -1
Beginning reading intervention as inoculation or insulin: First-grade reading performance of strong responders to kindergarten intervention. (2004b)
This study examined the first-grade reading progress of children who participated in an intensive beginning reading intervention in kindergarten. Specifically, the study investigated whether kindergarten intervention could prevent first-grade reading difficulties, or produce an "inoculation" effect, for some children under certain instructional conditions. Participants included children at risk for developing reading difficulties who received a 7-month beginning reading intervention in kindergarten. In October of first grade, 59 children who had achieved criterion levels on measures of phonological awareness and alphabetic knowledge were randomly assigned to one of two types of first-grade reading instruction: (a) code-based classroom instruction and a supplemental maintenance intervention, or (b) only code-based classroom instruction. February posttest measures assessed oral reading fluency, word reading, nonword reading, and comprehension. Between-group analyses indicated that instructional groups did not differ on any posttest measure. The students' absolute levels of achievement were compared to national and local normative samples. These results indicated that between 75% and 100% of students in both conditions attained posttest levels and demonstrated growth comparable to their average-achieving peers. These results support the hypothesis that strong responders to kindergarten intervention can experience an inoculation effect through the middle of first-grade with research-validated classroom reading instruction.
Reviews of Individual Studies 4 -1
Improved Ohio Reading Proficiency Test scores by students in the Springfield City School District who used Fast ForWord® products. (2004a)
Reviews of Individual Studies 3-6 -1
Putting Computerized Instruction to the Test: A Randomized Evaluation of a ''Scientifically Based'' Reading Program (2004)
Although schools across the country are investing heavily in computers in the classroom, there is surprisingly little evidence that they actually improve student achievement. In this paper, we present results from a randomized study of a well-defined use of computers in schools: a popular instructional computer program, known as Fast ForWord, which is designed to improve language and reading skills. We assess the impact of the program on students having difficulty learning to read using four different measures of language and reading ability. Our estimates suggest that while use of the computer program may improve some aspects of students' language skills, it does not appear that these gains translate into a broader measure of language acquisition or into actual readings skills.
Reviews of Individual Studies 3 -1
The Effects of a Peer-Mediated Positive Behavior Support Program on Socially Appropriate Classroom Behavior (2004)
This study explored the results of aligning functional behavioral assessment (FBA) information with positive behavior support plans (PBS plans) designed with consideration for teacher acceptability. The independent variable had the three major components of a package, including assessment and planning (FBA), training (teachers, students, and peers) and student interventions (PBS plans). The student PBS plans included a combination of selfmonitoring, teacher-peer mediated support, and positive reinforcement including praise and a token economy. Same age peers were used as change agents to mediate these PBS plans that had been designed for 2 male third grade students who were at-risk for social and academic failure. The effects of this package were examined in relationship to a response class of socially appropriate classroom behaviors. Single subject ABAB designs were used to evaluate the student interventions. The at-risk students showed immediate, marked improvement in their socially appropriate classroom behavior; treatment gains maintained as reinforcement was thinned. Social validity was measured by social comparison with a normative sample of same-aged students and subjectively by the teachers, students, and peers who participated.
Reviews of Individual Studies 5 -1
Closing the Gap: Addressing the Vocabulary Needs of English-Language Learners in Bilingual and Mainstream Classrooms (2004)
Gaps in reading performance between Anglo and Latino children are associated with gaps in vocabulary knowledge. An intervention was designed to enhance fifth graders' academic vocabulary. The meanings of academically useful words were taught together with strategies for using information from context, from morphology, from knowledge about multiple meanings, and from cognates to infer word meaning. Among the principles underlying the intervention were that new words should be encountered in meaningful text, that native Spanish speakers should have access to the text's meaning through Spanish, that words should be encountered in varying contexts, and that word knowledge involves spelling, pronunciation, morphology, and syntax as well as depth of meaning. Fifth graders in the intervention group showed greater growth than the comparison group on knowledge of the words taught, on depth of vocabulary knowledge, on understanding multiple meanings, and on reading comprehension. The intervention effects were as large for the English-language learners (ELLs) as for the English-only speakers (EOs), though the ELLs scored lower on all pre- and posttest measures. The results show the feasibility of improving comprehension outcomes for students in mixed ELLEO classes, by teaching word analysis and vocabulary learning strategies.
Reviews of Individual Studies 4-5 -1
The Coping Power Program for Preadolescent Aggressive Boys and Their Parents: Outcome Effects at the 1-Year Follow-Up. (2004)
This study evaluates the effects of the Coping Power Program with at-risk preadolescent boys at the time of transition from elementary school to middle school. Aggressive boys were randomly assigned to receive only the Coping Power child component, the full Coping Power Program with parent and child components, or a control condition. Results indicated that the Coping Power intervention produced lower rates of covert delinquent behavior and of parent-rated substance use at the 1-year follow-up than did the control cell, and these intervention effects were most apparent for the full Coping Power Program with parent and child components. Boys also displayed teacher-rated behavioral improvements in school during the follow-up year, and these effects appeared to be primarily influenced by the Coping Power child component.
Reviews of Individual Studies 6 -1
Implementation study of Exploring Motion and Forces (2003–2004) (SCALE-uP Report No. 5). (2004)
Reviews of Individual Studies 5 -1
Evaluation of KidBiz3000: Bayonne study final report. (2004)
Reviews of Individual Studies 7 -1
Implementation study of The Real Reasons for Seasons (2003–2004): SCALE-uP Report No. 4. (2004)
Reviews of Individual Studies 6-8 -1
Evaluation of a two-year middle-school physical education intervention: M-SPAN. (2004)
Reviews of Individual Studies 7-8 -1
The Talent Development Middle School Model: Context, Components, and Initial Impacts on Students' Performance and Attendance (2004)
The Talent Development Middle School model was created to make a difference in struggling urban middle schools. The model is part of a trend in school improvement strategies whereby whole-school reform projects aim to improve performance and attendance outcomes for students through the use of major changes in both the organizational structure and the educational processes of middle schools. The models that function in this way--broadly referred to as "comprehensive school reform (CSR) models"--have been developed both nationally and locally, and they receive support from a combination of federal, state, and local funding as well as from private foundations. Talent Development has been a key target of federal resources earmarked for expanding the use of CSR initiatives in middle schools. The model reflects many of the core principles embedded in the CSR movement. School-level structural changes, for example, create more personalized learning environments for students and teachers; curricular changes improve the rigor of coursework and raise teachers' and students' expectations; and professional development for teachers fills gaps in both content knowledge and pedagogy. The findings in this report--which offers an initial assessment of the first and most intensive effort at scaling up the use of the Talent Development Middle School model--indicate that Talent Development had a positive impact on eighth-grade math achievement and exhibited modest impacts on attendance rates. At the same time, the model produced an inconsistent pattern of impacts on eighth-grade reading and had few significant impacts on outcomes for seventh-grade students. This assessment is based on an innovative analytic methodology that relies on a combination of before-and-after and comparison-schools methods. Although the findings offer hope that the Talent Development model can improve academic outcomes, at least in math, for middle school students, more data collection and analysis are needed before definite conclusions can be drawn. A subsequent report will track outcomes for two additional years of implementation and will provide a clearer picture of the potential for improvements in middle school achievement to lead to greater persistence in high school and, eventually, to graduation. Appended are: (1) Tables for Eighth-Grade Students in Early-Implementing Schools; and (2) Tables for Seventh-Grade Students in Early-Implementing Schools. (Contains 4 boxes, 11 figures, and 13 tables.) [Dissemination of MDRC publications is also supported by Starr Foundation.]
Reviews of Individual Studies 8 -1
Comparison of I CAN Learn and traditionally-taught 8th grade general math student performance on the California Standards Test, Spring 2004. (2004)
Reviews of Individual Studies 8 -1
Comparison of I CAN Learn and traditionally-taught 8th grade student performance on the Georgia criterion-referenced competency test. (2004)
Reviews of Individual Studies 1-3 -1
Sustained Effects of the PATHS Curriculum on the Social and Psychological Adjustment of Children in Special Education (2004)
In this study, the authors examined the long-term effectiveness of the PATHS (Promoting Alternative THinking Strategies) curriculum on the adjustment of school-age children with special needs. The PATHS curriculum focuses on promoting children's emotional development, self-regulation, and social problem-solving skills. Eighteen special education classrooms were randomly assigned to treatment and control conditions in this controlled trial. Teachers received both training and ongoing consultation and provided PATHS to students in Grades 1 through 3. Data were collected before the intervention and for 3 successive years. Growth curve analysis indicated that the intervention reduced the rate of growth of teacher-reported internalizing and externalizing behaviors 2 years after the intervention and produced a sustained reduction in depressive symptoms reported by the children. Discussion focuses on the need for social-emotional learning (SEL) programs in special education and factors that can promote SEL among children with special needs.
Reviews of Individual Studies 2-4 -1
A Comparison of &quot;Reading Mastery Fast Cycle&quot; and &quot;Horizons Fast Track A-B&quot; on the Reading Achievement of Students with Mild Disabilities (2004)
This study examined the reading gains of students with mild disabilities who were taught with one of two programs: "Horizons Fast Track A-B" (Engelmann, Engelmann, & Seitz-Davis, 1997) or "Reading Mastery Fast Cycle" (Engelmann & Bruner, 1995). A quasi-experimental design with preexisting groups was used to examine changes from pretest to posttest. Results revealed a pattern of small differences favoring "Reading Mastery Fast Cycle" on measures of decoding; however, these differences were not statistically significant. Both programs were effective in producing statistically significant improvements in word attack, comprehension, letter and word identification, phonemic awareness, and print awareness skills. Participating teachers agreed that both programs were effective; however, anecdotal information from teacher interviews suggested that all participating teachers preferred "Horizons Fast Track." (Contains 4 tables.)
Reviews of Individual Studies 1-6 -1
Migrant Students with Limited English Proficiency: Can Fast ForWord Language? Make a Difference in Their Language Skills and Academic Achievement? (2004)
This study evaluated the efficacy of the computer-assisted intervention program known as Fast ForWord Language? in a sample of migrant students in Grades 1 through 6 who were native Spanish speakers. Fast ForWord Language? combines intensive training in multiple receptive English language skills with adaptive acoustic waveform lengthening and amplification to purportedly accelerate the English language learning skills of children who are nonnative English language speakers. Students either were randomly assigned to a treatment or no-contact control condition or were matched on grade, English language proficiency, and nonverbal IQ. All students were assessed in five domains before and immediately after the 4- to 8-week intervention: (a) spoken English language proficiency; (b) oral language competency; (c) phonological awareness; (d) basic reading skills; and (e) classroom behavior. Except for performance on a measure of sight-word recognition, on which children in the treatment group achieved a significantly greater gain than those in the control group, changes in test scores from pretest to posttest were equivalent for the two groups. However, when students who were least fluent in spoken English in each group were compared, the children in the treatment group demonstrated superior gains in expressive language, sight-word recognition, and pseudoword decoding. Thus, Fast ForWord Language? had a substantial, albeit limited impact on the oral language skills and reading performance of migrant children in this study. However, due to methodological weaknesses and limited treatment fidelity, the study results must be interpreted cautiously.
Reviews of Individual Studies 2-5 -1
Effects of Two Tutoring Programs on the English Reading Development of Spanish-English Bilingual Students (2004)
Spanish-dominant bilingual students in grades 2-5 were tutored 3 times per week for 40 minutes over 10 weeks, using 2 English reading interventions. Tutoring took place from February through April of 1 school year. One, Read Well, combined systematic phonics instruction with practice in decodable text, and the other, a revised version of Read Naturally, consisted of repeated reading, with contextualized vocabulary and comprehension instruction. The progress of tutored students (n = 51) was compared to that of nontutored classmates (n = 42) using subtests of the Woodcock Reading Mastery Tests-Revised. Students who received systematic phonics instruction made significant progress in word identification but not in word attack or passage comprehension. There were no significant effects for students in the repeated reading condition.
Reviews of Individual Studies 2-5 -1
Large-scale evaluation of student achievement in districts using Houghton Mifflin. (2004)
Reviews of Individual Studies 9-PS -1
The impacts of regular Upward Bound: Results from the third follow-up data collection (MPR Reference No. 8464-600) (2004)
Policymakers have long been concerned about the disparities in college attendance between more and less advantaged groups of students. Upward Bound is one of the largest and longest running federal programs designed to help economically disadvantaged students prepare for, enter and succeed in college. Since December 1991, Mathematica Policy Research, Inc., (MPR) has been conducting the national evaluation of Upward Bound for the U.S. Department of Education (ED). The evaluation has focused on program implementation issues and the effects of the program on student outcomes. The "impact study" is designed to measure the impacts or effects of regular Upward Bound on student outcomes, and it is based on a longitudinal evaluation in which eligible applicants from a nationally representative sample of projects were randomly assigned to Upward Bound or to a control group. The results in this document are based on the national evaluation's third follow-up data collection, which was completed in 2000. Because the entire sample of students was beyond high school age by that time, the report includes updated findings on the effects of Upward Bound on high school outcomes. In addition, based on data covering the first few years after sample members left high school, the report addresses the following research questions: (1) What effect does Upward Bound have on students' postsecondary experiences? (2) Who benefits most from Upward Bound? and (3) What is the association between staying in Upward Bound and student outcomes? Findings in this report suggest that for the average student, Upward Bound: (1) increased the number of high school math credits earned by participants; (2) did not affect other measures of high school academic preparation; (3) may have increased enrollment at four-year institutions; and (4) did not affect enrollment at postsecondary institutions more generally when all types of postsecondary institutions are considered. Appended are: (1) Sample Design Unit Nonresponse and Weights; (2) Baseline Characteristics of the Treatment and Control Groups, Third Follow-Up Survey Respondents; (3) Program Effects and Standard Errors; (4) The Effect of Upward Bound on High School Outcomes by Selected Subgroups; (5) The Effect of Upward Bound on College Engagement by Selected Subgroups; (6) Methods Used to Estimate the Effects of Additional Upward Bound Participation; (7) Weighted Standard Deviations for All Outcome Variables; (8) Data Collection; and (9) Sample Sizes and Standard Errors for Reported Impact Estimates. (Contains 29 tables and 3 figures.)
Reviews of Individual Studies PK-2 -1
Treating Children With Early-Onset Conduct Problems: Intervention Outcomes for Parent, Child, and Teacher Training (2004)
Families of 159, 4- to 8-year-old children with oppositional defiant disorder (ODD) were randomly assigned to parent training (PT); parent plus teacher training (PT + TT); child training (CT); child plus teacher training (CT + TT); parent, child, plus teacher training (PT + CT + TT); or a waiting list control. Reports and independent observations were collected at home and school. Following the 6-month intervention, all treatments resulted in significantly fewer conduct problems with mothers, teachers, and peers compared to controls. Children's negative behavior with fathers was lower in the 3 PT conditions than in control. Children showed more prosocial skills with peers in the CT conditions than in control. All PT conditions resulted in less negative and more positive parenting for mothers and less negative parenting for fathers than in control. Mothers and teachers were also less negative than controls when children received CT. Adding TT to PT or CT improved treatment outcome in terms of teacher behavior management in the classroom and in reports of behavior problems.
Reviews of Individual Studies K-3 -1
Outcomes report: Los Angeles Unified School District, California. (2003)
Reviews of Individual Studies K -1
A study between Voyager and control schools in Orange County, Florida 2002-2003. (2003)
Reviews of Individual Studies K -1
Integration of letter–sound correspondences and phonological awareness skills of blending and segmenting: A pilot study examining the effects of instructional sequence on word reading for kindergarten children with low phonological awareness. (2003)
Reviews of Individual Studies K-1 -1
Dissemination of an evidence-based prevention innovation for aggressive children living in culturally diverse, urban neighborhoods:The Early Risers effectiveness study. (2003)
Reviews of Individual Studies 2-5 -1
Technical report: Houghton Mifflin California math performance evaluation. (2003)
Reviews of Individual Studies 1 -1
An investigation of the effects of a comprehensive reading intervention on the beginning reading skills of first graders at risk for emotional and behavioral disorders (Doctoral dissertation, University of Nebraska–Lincoln, 2003). (2003)
Reviews of Individual Studies 8 -1
The effects of metacognitive training versus worked-out examples on students’ mathematical reasoning. (2003)
Reviews of Individual Studies 6-8 -1
Evaluating the Lions-Quest Skills for Adolescence drug education program: Second-year behavior outcomes. (2003)
Reviews of Individual Studies 6-8 -1
Student Team Reading and Writing: A Cooperative Learning Approach to Middle School Literacy Instruction. (2003)
Developed and evaluated a middle school literacy program designed to meet the needs of urban early adolescents. Findings from evaluation in two schools implementing the Student Team Reading and Writing program and three comparison schools indicated higher achievement for program participants. (SLD)
Reviews of Individual Studies 4-5 -1
The relationship between National Board certification for teachers and student achievement (Doctoral dissertation). (2003)
Reviews of Individual Studies 3-4 -1
Technical report: Evaluation of the Too Good for Drugs Elementary School Prevention Program. (2003)
Reviews of Individual Studies 3-8 -1
Fast ForWord® evaluation, 2002–03 (Eye on Evaluation, E&R Report No. 03. 24). (2003)
Reviews of Individual Studies 5 -1
The Effects of Development Mentoring on Connectedness and Academic Achievement. (2002)
Report of a 1-year longitudinal study of development monitoring, a program in which high-school students mentor elementary-school students. Findings suggest that the program promoted connectedness to parents, school, and the future, and improved spelling skills. (Contains 30 references.) (AUTHOR/WFA)
Reviews of Individual Studies 7-8 -1
Explicitly Teaching Strategies, Skills, and Knowledge: Writing Instruction in Middle School Classrooms. (2002)
In the present study, middle school students were directly taught strategies that facilitated the execution of writing processes, skills, and knowledge involved in planning, drafting, and revising text. Students in the experimental treatment condition produced essays that were longer, contained more mature vocabulary, and were qualitatively better. (Contains 57 references and 4 tables.) (GCP)
Reviews of Individual Studies 6-7 -1
Patterns of change in the social-cognitive development of middle school children following a school-based multicultural literature program. (2002)
Reviews of Individual Studies 6-7 -1
Student attainment in the Connected Mathematics curriculum. (2002)
Reviews of Individual Studies 8 -1
Evaluation of the I CAN Learn mathematics classroom: Second year of implementation (2001–2002 school year). (2002)
Reviews of Individual Studies 1 -1
An evaluation of a computer-based phonological awareness training program: Effects on phonological awareness, reading and spelling. (2002)
Reviews of Individual Studies 1 -1
Enhancing First-Grade Children's Mathematical Development with Peer-Assisted Learning Strategies. (2002)
Examines the effects of a dyadic peer-mediated treatment, Peer-Assisted Learning Strategies (PALS), on first-grade children's mathematics development. Results indicated that treatment implementation was strong; teachers judged PALS to be effective and generally feasible; and students with and without disabilities, at all points along the achievement continuum, benefited from PALS. Implications for research and practice are discussed. (Contains 35 references and 3 tables.) (GCP)
Reviews of Individual Studies 2 -1
Accelerating reading trajectories: The effects of dynamic research-based instruction. (2002)
Reviews of Individual Studies K-2 -1
The Early Risers longitudinal prevention trial: Examination of 3-year outcomes in aggressive children with intent-to-treat and as-intended analyses. (2002)
Reviews of Individual Studies K -1
Is reading important in reading-readiness programs? A randomized field trial with teachers as program implementers. (2001)
Examined effectiveness and feasibility of phonological awareness training, with and without a beginning decoding component. Teachers were assigned randomly to three groups: control, phonological awareness training, and phonological awareness training with beginning decoding instruction and practice. Group differences were identified at the end of kindergarten and remained, although diminished, in the fall of the next year. (BF)
Reviews of Individual Studies K -1
Evaluation of a Rime-based Reading Program with Shuswap and Heiltsuk First Nations Prereaders. (2001)
Examines the utility of teaching reading using rime-based reading strategies with prereaders. Measures rhyming, phoneme identity, letter-sound knowledge, phonological working memory, First Nations language speaking ability, and reading. Concludes that progress in phonological awareness and word reading can be enhanced in prereaders by adding experience with rime-based strategies to the reading program. (SG)
Reviews of Individual Studies 1 -1
The Effects of Peer-Assisted Literacy Strategies for First-Grade Readers with and without Additional Mini-Skills Lessons. (2001)
A study involving 28 teachers found Peer-Assisted Literacy Strategies (PALS) enhanced reading performance of first-grade students, although not equally for all learner types. Students who were low-achieving who participated in both PALS and teacher-directed small-group mini-lessons benefited more greatly than students who participated only in PALS. (Contains references.) (CR)
Reviews of Individual Studies 8 -1
Evaluation of the I CAN Learn® mathematics classroom: First year of implementation (2000–2001 school year). (2001)
Reviews of Individual Studies 9-12 -1
Career Academies: Impacts on Students' Initial Transitions to Post-Secondary Education and Employment. (2001)
Career academies are characterized by these three basic features: a school-within-a-school organizational structure, curricula that combine academic and career or technical courses based on a career theme, and partnerships with local employers. In a 10-year longitudinal study of the academy model, begun in 1993 in 9 schools around the country, some 1,700 academy applicants in the 8th or 9th grade were randomly assigned to their high schools' academy or any other high school program. The evaluation found, as of the year after scheduled high school graduation, that although the career academies enhanced the high school experiences of their students in ways that were consistent with the reform's short-term goals, these positive effects did not translate into changes in high school graduation rates or initial transitions to postsecondary education and jobs. Other key findings included: (1) the academies had little influence on course content, classroom instructional practices, and standardized test scores; (2) for students at high risk of dropping out, the academies increased the likelihood of staying in school through 12th grade, improved attendance, and increased number of credits earned; and (3) relative to similar students nationally, both studied groups had high rates of high school graduation, college enrollment, and employment. The results suggest that career academies should consider expanding their efforts to recruit students who may not be motivated to enroll in academies on their own, to provide college counseling, and to increase teacher professional development activities in order to improve curriculum and instruction. (Contains 25 references, 10 figures, and 6 tables.) (KC)
Reviews of Individual Studies 9-10 -1
Evaluation of the Cognitive Tutor Algebra I program (Unpublished manuscript). (2001)
Reviews of Individual Studies 5 -1
Improving the Classroom Behavior of Students with Emotional and Behavioral Disorders Using Individualized Curricular Modifications. (2001)
This study evaluated assessment-based curricular modifications designed to improve the classroom behavior of two elementary school students with emotional and behavioral disorders. Functional assessment data led to individualized modifications of assignments. Evaluation indicated the modifications resulted in reduced problem behavior and increased task engagement by each boy. Results are related to new legal requirements for behavioral interventions. (Contains references.) (Author/DB)
Reviews of Individual Studies 4-5 -1
The Two-Year Evaluation of the Three-Year Direct Instruction Program in an Urban Public School System. (2000)
Starting with the 1997-1998 school year, the Direct Instruction Reading/Language Arts Program was implemented in three elementary schools in a northwest urban public school system as a 3-year pilot study to improve the academic performance of at-risk students. Direct Instruction (DI) is aimed at providing effective learning for low-achieving elementary school students from disadvantaged backgrounds. DI was first implemented in 1968 at the University of Oregon in Eugene as part of Project Follow Through. Although the national evaluation of Project Follow Through favors the DI model in terms of both short- and long-term program effects, the findings from DI programs implemented across the United States are not always consistent. This study examines DI program effects on the reading ability of urban elementary school students at three grade levels who had been in the program for 2 consecutive years. Subjects were 93 fourth graders, 71 fifth graders, and 81 sixth graders. The evaluation reveals mixed findings. Performance of sixth grade DI schools was lower than that of sixth graders in control schools. (Contains 4 tables, 3 figures, and 22 references.) (SLD)
Reviews of Individual Studies 3-6 -1
Effects of the Child Development Project on students' drug use and other problem behaviors. (2000)
Reviews of Individual Studies 3-5 -1
A study of the effects of Everyday Mathematics on student achievement of third-, fourth-, and fifth-grade students in a large north Texas urban school district (Doctoral dissertation). (2000)
Reviews of Individual Studies 6 -1
The effects of the Too Good for Drugs prevention program on students' substance use intentions and risk and protective factors. (2000)
Reviews of Individual Studies 6-8 -1
Connected Mathematics and the Texas Assessment of Academic Skills (Doctoral dissertation). (2000)
Reviews of Individual Studies 7-10 -1
The effects of intensive computer-based language intervention on language functioning and reading achievement in language-impaired adolescents (Doctoral dissertation). (2000)
Reviews of Individual Studies 1-2 -1
When Less May Be More: A 2-Year Longitudinal Evaluation of a Volunteer Tutoring Program Requiring Minimal Training. (2000)
Describes "Start Making a Reader Today" (SMART), a volunteer tutoring program that helps K-2 students at risk of reading difficulties. Finds that the program improved students' word reading, reading fluency, and word comprehension, though level of performance at end of second grade was still much lower than that of average-achieving students. Discusses issues regarding volunteer training and involvement. (SR)
Reviews of Individual Studies 2-8 -1
Effecting Superior Achievement Using Curriculum-based Measurement: The Importance of Individual Progress Monitoring. (2000)
Special education teachers (N=22) monitored the mathematics progress of 42 students (grades 2-8) with mild to moderate disabilities (mostly learning disabilities) for 20 weeks using curriculum-based measurement (CBM). Evaluation of instructional adjustments based on individual CBM results found that students whose instruction had been individually adjusted performed significantly better on a global achievement test than comparison students. (Contains references.) (DB)
Reviews of Individual Studies K-3 -1
The Efficacy of Supplemental Instruction in Decoding Skills for Hispanic and Non-Hispanic Students in Early Elementary School. (2000)
A study evaluated the effects of supplemental reading instruction for 256 students in kindergarten through Grade 3 (158 Hispanic). Children who received the supplemental reading instruction performed significantly better on measures of word attack, word identification, oral reading fluency, vocabulary, and reading comprehension after 15 to 16 months of instruction. (Contains extensive references.) (Author/CR)
Reviews of Individual Studies 12 -1
The impact of computer-assisted coaching on the elevation of twelfth-grade students’ SAT scores (Doctoral dissertation). (1999)
Reviews of Individual Studies 1 -1
Proximal impact of two first-grade preventive interventions on the early risk behaviors for later substance abuse, depression, and anti-social behavior. (1999)
Reviews of Individual Studies 7-8 -1
Effects of goal setting and strategy use on the writing performance and self-efficacy of students with writing and learning problems. (1999)
Reviews of Individual Studies 7-8 -1
Self-Regulated Strategy Instruction in Regular Education Settings: Improving Outcomes for Students with and without Learning Disabilities. (1999)
Middle-school students with (n=6) and without (n=16) learning disabilities were taught a strategy for planning and writing expository essays using the Self-Regulated Strategy Development approach to instruction. Positive results were found for students with and without learning disabilities. Students' papers became longer, more complete, and improved in quality. (Author/CR)
Reviews of Individual Studies 5 -1
Teaching Students with Learning Disabilities To Mindfully Plan When Writing. (1999)
Three fifth graders with learning disabilities received instruction designed to help them incorporate three common planning strategies into their current approach to writing. Students learned to set goals, brainstorm ideas, and sequence their ideas while writing stories and completing assignments. The schematic structure of stories improved, and papers became longer. (Author/CR)
Reviews of Individual Studies 5-6 -1
Self-Regulated Strategy Development and the Writing Process: Effects on Essay Writing and Attributions. (1998)
The Self-Regulated Strategy Development model was used to assist six elementary students with learning disabilities develop a strategy for planning and writing essays, self-regulation, and positive attributions regarding effort and strategy use. Instruction had a positive effect on students' approach to writing, writing performance, and attributions for writing. (Author/CR)
Reviews of Individual Studies 5 -1
A study of Lessons in Character: The effect of moral development curriculum upon moral judgment. (1998)
Reviews of Individual Studies 4-10 -1
Does mentoring work? An impact study of the Big Brothers/Big Sisters Program (1998)
Reviews of Individual Studies 8 -1
Impacts of dropout prevention programs [Middle School Leadership Program - Albuquerque, NM]: Final report. A research report from the School Dropout Demonstration Assistance Program evaluation (1998)
Reviews of Individual Studies 9-10 -1
Impacts of dropout prevention programs [Horizon High Schools - Las Vegas, NV]: Final report. A research report from the School Dropout Demonstration Assistance Program evaluation. (1998)
Reviews of Individual Studies 9-12 -1
Impacts of dropout prevention programs [Jobs for Youth - Boston, MA]: Final report. A research report from the School Dropout Demonstration Assistance Program evaluation. (1998)
Reviews of Individual Studies 7-8 -1
Impacts of dropout prevention programs: Final report. (1998)
Reviews of Individual Studies 7 -1
Impacts of dropout prevention programs: Final report. (1998)
Reviews of Individual Studies 6-8 -1
Impacts of dropout prevention programs [Early Identification and Intervention Project - Rockford, IL]: Final report. A research report from the School Dropout Demonstration Assistance Program evaluation. (1998)
Reviews of Individual Studies 6-8 -1
Impacts of dropout prevention programs [Up with Literacy - Long Beach, CA]: Final report. A research report from the School Dropout Demonstration Assistance Program evaluation. (1998)
Reviews of Individual Studies 6-8 -1
Impacts of dropout prevention programs: Final report [Project ACCEL - Newark, NJ]. A research report from the School Dropout Demonstration Assistance Program evaluation. (1998)
Reviews of Individual Studies 6-8 -1
Impacts of dropout prevention programs: Final report. (1998)
Reviews of Individual Studies 1-2 -1
Evaluation of elementary school school-wide programs: Clover Park School District year 2: 1997–98. (1998)
Reviews of Individual Studies 1-3 -1
Evaluation of Success for All programs: Little Rock School District year 1: 1997-1998. (1998)
Reviews of Individual Studies K-2 -1
Longitudinal study of student literacy achievement in different Title I school-wide programs in Fort Wayne Community Schools Year 2: First grade results. (1998)
Reviews of Individual Studies K -1
First Step to Success: An Early Intervention Approach for Preventing School Antisocial Behavior. (1998)
Reports results of a four-year study involving 46 at-risk kindergartners that was designed to develop and evaluate a combined home and school intervention approach to preventing school antisocial behavior. Results indicated a measurable intervention effect for participants and persistence of gains into the primary grades. (Author/CR)
Reviews of Individual Studies K -1
Success for All evaluation: 1997–1998 Tigard-Tualatin School District. (1998)
Reviews of Individual Studies 9-12 -1
The final evaluation of Lions-Quest’s Skills for Action. (1998)
Reviews of Individual Studies 9-12 -1
Helping high-risk youth: Results from the alternative schools demonstration program [Stockton study]. (1997)
Reviews of Individual Studies 9-12 -1
Helping high-risk youth: Results from the alternative schools demonstration program [Wichita study]. (1997)
Reviews of Individual Studies 9-12 -1
Helping high-risk youths: Results from the alternative schools demonstration program [Cincinnati study]. (1997)
Reviews of Individual Studies 1 -1
The Effectiveness of One-to-One Tutoring by Community Tutors for At-Risk Beginning Readers. (1997)
Twenty at-risk first graders received 30 minutes of individual instruction from community tutors four days a week for up to 23 weeks. Subjects outperformed the control group on all reading, decoding, spelling and segmenting, and writing measures. Tutors who implemented the program with a high degree of fidelity achieved significant effect sizes in each reading skill area. (Author/DB)
Reviews of Individual Studies 11-12 -1
The Effects of Test Preparation Activities on ACT Assessment Scores. (1997)
"Test preparation" activities can range from simple practice to in-depth instruction, but most of these activities use some form of test familiarization, drill and practice with feedback, training in strategies for specific item types, and general test-taking, subject-matter review, and skill development exercises. Two experiments were conducted to study the effects of test preparation on results from the American College Testing program (ACT) Assessment. In the first experiment, a random sample of 10% was selected from one students who took the ACT between October 1, 1994 and September 20, 1995 (69,251 students). These students had answered test preparation questions as part of the information they supplied for the ACT. Gender, ethnic/racial, and family income differences in test preparation were also examined. Almost half of the students had engaged in some form of test preparation, with lower income and minority students reporting engaging in combinations of activities more than other student groups. The types of test preparation studied had little impact on student performance, with only practice tests showing a positive, although small, impact. The second study considered students who had taken the ACT more than once in the time period of the previous study. The sample consisted of 126,253 repeaters. The same information was obtained and the same analyses performed. Over half of these repeat test takers engaged in some type of test preparation before the second ACT, but results suggest that test preparation activities have only a minimal impact on increasing the second ACT Assessment scores beyond gains from simply retaking the test. Results overall suggest that test preparation activities have little impact on scores. (Contains six tables and eight references.) (SLD)
Reviews of Individual Studies 11-12 -1
Youth Corps: Promising strategies for young people and their communities. (1997)
Reviews of Individual Studies 1 -1
Evaluation of elementary school school-wide programs: Clover Park School District, year 1: 1996-97. (1997)
Reviews of Individual Studies 8 -1
Effects of a generative instructional design strategy on learning mathematics and on attitudes towards achievement. (1997)
Reviews of Individual Studies 5 -1
Strategy Instruction in Planning: Effects on the Writing Performance and Behavior of Students with Learning Difficulties. (1997)
A study of three fifth-grade students with learning disabilities examined the effectiveness of a strategy deigned to help them become more reflective when writing opinion essays. Following the instruction, students wrote essays that were longer, provided more support for their premise, and were qualitatively better. (Author/CR)
Reviews of Individual Studies 1 -1
An investigation of three approaches to teaching phonological awareness to first-grade students and the effects on word recognition (Doctoral dissertation). (1996)
Reviews of Individual Studies 11-12 -1
LEAP: Three-Year Impacts of Ohio's Welfare Initiative To Improve School Attendance among Teenage Parents. Ohio's Learning, Earning, and Parenting Program. (1996)
This report presents the fourth-year findings on the effectiveness of Ohio's Learning, Earning, and Parenting (LEAP) Program, a statewide welfare initiative that uses financial incentives and penalties to promote school attendance by pregnant and parenting teenagers on welfare. The report looks at LEAP's effects on school completion, employment, welfare receipt, and other outcomes for a subsample of teens in 7 of the 12 counties 3 years after they were determined to be eligible for LEAP. The results differ sharply for teens who were and were not enrolled in school when they qualified for LEAP. For initially enrolled teens, LEAP increased school completion (although primarily Graduate Equivalency Degree completion) by almost 20 percent and increased employment by over 40 percent. For dropouts, there was no increase in school completion or employment, despite a high degree of sanctioning. Overall, fewer teens remained on welfare, although the receipt rates were still very high. In Cleveland, but not in the other large cities, LEAP substantially increased high school graduation rates, suggesting the importance of both providing special services to keep teens in school and setting restrictions on leaving high school to enter a GED program. Most of the data are from a survey of 913 teens (446 in the program group and 467 in the control group) and from school-outcome records for 4,325 program participants. A total of 26 tables and 8 figures are included. Appendices contain supplemental tables and figures. A list of selected publications by Manpower Demonstration Research Corporation is included. (Contains 28 references.) (LMI)
Reviews of Individual Studies 1-4 -1
The effects of multi-component, assessment-based curricular modifications on the classroom behavior of children with emotional and behavioral disorders. (1996)
Reviews of Individual Studies 2-4 -1
Acquisition and Transfer Effects of Classwide Peer-Assisted Learning Strategies in Mathematics for Students with Varying Learning Histories. (1995)
Examines the effects of classwide peer-assisted learning strategies (PALS) in mathematics incorporating the use of curriculum-based measurement on acquisition and transfer learning of three types of students (average-achieving student, low-achieving students, and students with a learning disability). Analysis of variance indicates superior mathematics growth for students in PALS condition. (Author/JDM)
Reviews of Individual Studies 2-4 -1
Final report: 1994–1995 Success for All Program in Fort Wayne, Indiana. (1995)
Reviews of Individual Studies 5 -1
An investigation of the effects of reciprocal teaching on fifth graders’ comprehension and comprehension monitoring. (1995)
Reviews of Individual Studies 8 -1
Reciprocal Teaching of Reading Comprehension in a New Zealand High School. (1995)
Presents an experimental evaluation of a trial implementation of reciprocal teaching procedures by high school teachers to address reading comprehension deficits. Forty-six students were exposed to 1 of 3 conditions: 12-16 reciprocal teaching sessions, 6-8 sessions, or no treatment. Significant gains were observed with students in the extended program. (JBJ)
Reviews of Individual Studies 8 -1
Modifying Activities to Produce Functional Outcomes: Effects on the Problem Behaviors of Students with Disabilities. (1995)
This article describes positive effects of modifying curricular activities in accordance with the individual interests of three elementary students with disabilities (including autism, mental retardation, and emotional/behavioral disorder). Students exhibited less problem behavior and more on-task responding in the modified activity condition. (DB)
Reviews of Individual Studies K-4 -1
A comparison of Reading Recovery to Project READ. (1995)
Reviews of Individual Studies K-6 -1
Improving the Conduct of Students with Behavioral Disorders by Incorporating Student Interests into Curricular Activities. (1995)
Systematic curricular accommodations reduced the problem behaviors of four elementary students with behavioral disorders. Assessments identified student interests and curricular assignments associated with high levels of problem behavior. Curricular modification was then implemented. Results support adaptations that incorporate student interests to decrease undesirable and increase desirable behaviors. (Author/DB)
Reviews of Individual Studies 9-12 -1
Using Worked Examples as an Instructional Support in the Algebra Classroom. (1994)
In 2 experiments with 74 high school students, subjects studied worked examples while learning how to translate English expressions into algebraic equations. Those using worked examples outperformed the control group on posttests, made fewer errors, completed work more rapidly, and required less assistance from the teacher. (SLD)
Reviews of Individual Studies 5 -1
Using Assessment-Based Curricular Intervention to Improve the Classroom Behavior of a Student with Emotional and Behavioral Challenges. (1994)
A case study of an elementary school child with emotional and behavioral problems illustrates a process of descriptive assessment, functional assessment, and assessment-based intervention. The descriptive information generated hypotheses about variables maintaining the problem behavior which were then tested in the classroom environment. Interventions were successful in increasing on-task behavior. (Author/DB)
Reviews of Individual Studies 2-6 -1
The effects of classroom-based follow-up assistance on mainstream reading and language arts instruction (Doctoral dissertation, University of Washington, 1994). (1994)
Reviews of Individual Studies 3 -1
Implementing Cooperative Learning: A Field Study Evaluating Issues for School-Based Consultants. (1994)
Implemented structured cooperative-learning strategy for reading, Cooperative Integrated Reading and Composition (CIRC), in nine third-grade classes (n=198) and compared with nine control group classes (n=194). CIRC group outgained controls on Reading Comprehension as measured by California Achievement Test. When groups were divided into reading levels, significant differences were found for lower group that favored CIRC. (Author/NB)
Reviews of Individual Studies 4-6 -1
An investigation into the application of the reciprocal teaching procedure to enhance reading comprehension with educationally at-risk Vietnamese-American pupils (Doctoral dissertation, University of California–Berkeley, 1993). (1993)
Reviews of Individual Studies 4-5 -1
The effectiveness of Project Read on the reading achievement of students with learning disabilities. (1993)
Reviews of Individual Studies 4 -1
Using Peer Response Groups with Limited English Proficient Writers. (1993)
Effects of heterogeneous peer response groups (heterogeneous for language proficiency and ability) on the writing of limited-English-proficient (LEP) students was investigated in fourth-grade language arts classes. After one month, significant improvements on two measures of fluency were found for LEP students assigned to peer response groups, but overall quality of compositions produced did not differ. (TD)
Reviews of Individual Studies 4-5 -1
Incorporating Strategy Instruction within the Writing Process in the Regular Classroom: Effects on the Writing of Students with and without Learning Disabilities. (1993)
Examines the effectiveness of imbedding strategy instruction in the context of a process approach to writing. Finds that the strategy instructional procedures had a positive effect on the fourth- and fifth-grade students' writing, for both students with and without a learning disability. Shows that, overall, improvements in story quality were maintained and generalized by all of the students. (SR)
Reviews of Individual Studies PK-K -1
Interaction between Early Intervention Curricula and Student Characteristics. (1993)
One hundred sixty-four children (ages 3-7) with mild to moderate disabilities participated in a Mediated Learning or Direct Instruction early intervention program. No main effect intergroup differences were found on cognitive, language, and motor measures. Higher performing students gained more from Direct Instruction whereas lower performing students gained more from Mediated Learning. (Author/JDD)
Reviews of Individual Studies 5-6 -1
Improving the Mathematical Problem-Solving Skills of Students with Learning Disabilities: Self-Regulated Strategy Development. (1992)
Four fifth and sixth grade students with learning disabilities were taught a strategy for comprehending word problems and devising appropriate solutions. Following instruction performance on mixed sets of addition and subtraction word problems improved. Although generalization to a different setting occurred, maintenance was mixed. (Author/DB)
Reviews of Individual Studies 8 -1
Skill performance comparability of two algebra programs on an eighth-grade population. (1992)
Reviews of Individual Studies 8-9 -1
Summer Training and Education Program (STEP): Report on long-term impacts. (1992)
Reviews of Individual Studies 6 -1
Using student team reading and student team writing in middle schools: Two evaluations. (1992)
Reviews of Individual Studies 2-8 -1
Effects of Curriculum-Based Measurement and Consultation on Teacher Planning and Student Achievement in Mathematics Operations. (1991)
The effects of on-going curriculum-based measurement of student growth and expert system instructional consultation on teacher planning and student achievement in mathematics operations were studied for 33 elementary teachers assigned to one control or 2 experimental groups. Each teacher worked with two learning disabled or emotionally disturbed students. (SLD)
Reviews of Individual Studies 2-5 -1
Direct Instruction in Math Word Problems: Students with Learning Disabilities. (1991)
This study compared the effectiveness of 3 procedures for teaching 62 elementary students with learning disabilities to identify the correct algorithm in solving addition and subtraction word problems. The group receiving strategy teaching and sequencing practice problems and the group receiving strategy teaching only scored higher than sequencing-only students. (Author/JDD)
Reviews of Individual Studies 5-7 -1
Teaching Rural Students with Learning Disabilities: A Paraphrasing Strategy to Increase Comprehension of Main Ideas. (1990)
Among 68 rural learning-disabled students in grades 5-7 having moderate decoding fluency and high decoding accuracy, a paraphrasing cognitive strategy increased reading comprehension of main ideas more effectively than repeated readings or control training. Paraphrasing plus repeated readings was no more effective than paraphrasing alone. Contains 26 references. (SV)
Reviews of Individual Studies 5-8 -1
Improving the reading comprehension of middle school students through reciprocal teaching and semantic mapping strategies (Doctoral dissertation (1990)
Reviews of Individual Studies 4-7 -1
Reciprocal Teaching Improves Standardized Reading-Comprehension Performance in Poor Comprehenders. (1990)
Students in fourth and seventh grade who were poor comprehenders were taught prediction, clarification, question generation, and summarization using scaffolding instruction. Performance on a standardized comprehension test improved for the students who received the instruction. (PCB)
Reviews of Individual Studies K -1
Effect of Early Literacy Intervention on Kindergarten Achievement. Technical Report No. 520. (1990)
A study examined whether a beneficial effect on children's literacy development accrues from the use of the Little Books with kindergarten children, and identified differential effects on kindergarten achievement according to treatment type, community status, and school type. From a sample of 40 Newfoundland schools, schools were grouped into rural village (drawing students from one small community), rural collector (drawing students from several small communities), and urban, and four schools were randomly selected from each grouping. Schools were assigned randomly to one of the treatment groups (Little Books used in the home only, Little Books used in the home and school, Little Books used in the school only, and control). Complete pretest and posttest data were obtained for 309 children. Quantitative analyses showed the children entering kindergarten in this study to be at risk of school failure. On average, urban kindergartners scored higher on all measures, and village and collector students scored about the same. Differences in posttest means were not related clearly to treatment. However, the Metropolitan Reading Readiness Pretest x Treatment interaction, which showed that the lowest achieving students profited most from the Little Books when they were used at home only, and the highest achieving students profited most from the Little Books when they used them in school only, helps to support the hypothesis that the home has a crucial role to play in literacy development. (Three tables of data are included and 16 references are attached.) (Author/MG)
Reviews of Individual Studies K-4 -1
Effects of an elementary school program to enhance prosocial behavior on children's cognitive-social problem-solving skills and strategies. (1989)
Reviews of Individual Studies 6 -1
Improving Learning Disabled Students' Skills at Composing Essays: Self-Instructional Strategy Training. (1989)
The study with three sixth-grade learning-disabled students found that a self-instructional strategy to facilitate the generation, framing, and planning of argumentative essays had a positive effect on the students' writing performance and self-efficacy. Effects were maintained over time and transferred to a new setting and new writing genre. (Author/DB)
Reviews of Individual Studies 8-12 -1
The effect of metacognitive strategy instruction on the problem-solving skills of disadvantaged/handicapped vocational students. (1989)
Reviews of Individual Studies 2-9 -1
Effects of alternative goal structures within curriculum-based measurement. (1989)
Reviews of Individual Studies 6 -1
Teaching Children about Revision in Writing. (1987)
A study investigated the effects of direct instruction in the process of revision on students' knowledge of the revision process, their ability to make revisions on paper, and the quality of their writing. Subjects, 30 sixth grade students, were divided into an experimental and a control group. The experimental group received instruction in the revision process while the control group read quality literature. After instruction, all subjects wrote a brief story. The next day, subjects were given an opportunity to revise their stories and to write another draft. Experimental group subjects were interviewed about potential revisions while control group subjects received no advice. The main variables analyzed were the number of areas suggested for revision, the average specificity of suggested changes, the total number of revisions made, and the quality scores obtained for the first and final draft. Results indicated that instruction did affect knowledge of the revision process and enhance revision efforts. Specifically, findings showed (1) that when compared to the control treatment, direct instruction in the process of revision did affect aspects of sixth graders' knowledge of the revision process; (2) that the instruction affected efforts to make revisions on paper, though there were no differential effects on types of revisions made; and (3) that the revision instruction affected the quality of the children's stories across drafts--judgments of quality for the experimental group increased substantially, while the same judgments for the control group remained relatively stable. (Six pages of references are included.) (JD)
Reviews of Individual Studies 3-5 -1
The effectiveness of cross-level peer involvement in the acquisition of English as a second language by Spanish-speaking migrant children (Doctoral dissertation). (1987)
Reviews of Individual Studies 8 -1
Analyses of eighth grade math texts and achievement. (1986)
Reviews of Individual Studies 7-9 -1
Transition mathematics field study. (1986)
Reviews of Individual Studies 9 -1
A quasi-experimental study of Saxon’s Incremental Development Model and its effects on student achievement in first-year algebra (Unpublished doctoral dissertation). (1984)

Connect With the WWC

loading
back to top