Keyword

Filters
Publication Date
1
2
59
152
270
Topic
106
85
24
31
9
87
Populations
16
14
Product Type
12
54
202
10
Grade Level
270
270
Evidence Tier
43
45
40
2
161
Locale
52
42
118

Search Results

268 Results filtered by:
Product Type Grade Level Highest Evidence Tier Name (Release Date)
Practice Guide 4-9 1
Providing Reading Interventions for Students in Grades 4–9 (March 2022)
This practice guide provides four evidence-based recommendations that teachers can use to deliver reading interventions to meet the needs of their students.
Practice Guide 6-12 1
Preventing Dropout in Secondary Schools (September 2017)
This practice guide provides school educators and administrators with four evidence-based recommendations for reducing dropout rates in middle and high schools and improving high school graduation rates. Each recommendation provides specific, actionable strategies; examples of how to implement the recommended practices in schools; advice on how to overcome potential obstacles; and a description of the supporting evidence.
Practice Guide 5-12 1
Teaching Secondary Students to Write Effectively (November 2016)
This practice guide presents three evidence-based recommendations for helping students in grades 6–12 develop effective writing skills. Each recommendation includes specific, actionable guidance for educators on implementing practices in their classrooms. The guide also summarizes and rates the evidence supporting each recommendation, describes examples to use in class, and offers the panel’s advice on how to overcome potential implementation obstacles. This guide is geared towards administrators and teachers in all disciplines who want to help improve their students’ writing.
Practice Guide 6-12 2
Teaching Strategies for Improving Algebra Knowledge in Middle and High School Students (April 2015)
This practice guide provides three recommendations for teaching algebra to students in middle school and high school. Each recommendation includes implementation steps and solutions for common roadblocks. The recommendations also summarize and rate supporting evidence. This guide is geared toward teachers, administrators, and other educators who want to improve their students’ algebra knowledge.
Practice Guide 8-12 3
Helping Students Navigate the Path to College: What High Schools Can Do (September 2009)
Access to higher education remains a challenge for many students who face academic and informational barriers to college entry.
Practice Guide K-12 3
Structuring Out-of-School Time to Improve Academic Achievement (July 2009)
Out-of-school time programs can enhance academic achievement by helping students learn outside the classroom.
Practice Guide 7-12 3
Dropout Prevention (August 2008)
Geared toward educators, administrators, and policymakers, this guide provides recommendations that focus on reducing high school dropout rates.
Practice Guide 5-12 3
Improving Adolescent Literacy: Effective Classroom and Intervention Practices (August 2008)
This guide presents strategies that classroom teachers and specialists can use to increase the reading ability of adolescent students.
Practice Guide K-PS 3
Encouraging Girls in Math and Science (September 2007)
The objective of this guide is to provide teachers with specific recommendations that can be carried out in the classroom without requiring systemic change.
Practice Guide K-PS 3
Organizing Instruction and Study to Improve Student Learning (September 2007)
This guide includes a set of concrete actions relating to the use of instructional and study time that are applicable to subjects that demand a great deal of content learning, including social studies, science, and mathematics.
Practice Guide 2-12 4
Using Student Achievement Data to Support Instructional Decision Making (September 2009)
This guide offers five recommendations to help educators effectively use data to monitor students’ academic progress and evaluate instructional practices.
Practice Guide K-12 4
Turning Around Chronically Low-Performing Schools (May 2008)
This guide identifies practices that can improve the performance of chronically low-performing schools—a process commonly referred to as creating "turnaround schools."
Intervention Report 5-12 1
Knowledge is Power Program (KIPP) (Charter Schools) (January 2018)
The Knowledge Is Power Program (KIPP) is a nonprofit network of more than 200 public charter schools educating early childhood, elementary, middle, and high school students. Every KIPP school obtains approval to operate from a charter school authorizer. Students, parents, and teachers must sign a commitment to abide by a set of responsibilities, including high behavioral and disciplinary expectations. KIPP also has an active alumni network and set of partnerships with scholarship organizations to help guide former students through college. KIPP schools have an extended school day and an extended school year compared with traditional public schools. When demand for enrollment exceeds enrollment capacity at a KIPP school, student admission is based upon a lottery. Funding for KIPP schools comes primarily through public federal, state, and local finances, along with supplemental funding through charitable donations from foundations and individuals.
Intervention Report 9-12 1
Dual Enrollment Programs (Transition to College) (February 2017)
Dual enrollment programs allow high school students to take college courses and earn college credits while still attending high school. Such programs, also referred to as dual credit or early college programs, are designed to boost college access and degree attainment, especially for students typically underrepresented in higher education. Dual enrollment programs support college credit accumulation and degree attainment via at least three mechanisms. First, allowing high school students to experience college-level courses helps them prepare for the social and academic requirements of college while having the additional supports available to high school students; this may reduce the need for developmental coursework. Second, students who accumulate college credits early and consistently are more likely to attain a college degree. Third, many dual enrollment programs offer discounted or free tuition, which reduces the overall cost of college and may increase the number of low socioeconomic status students who can attend and complete college.
Intervention Report 4-10 1
READ 180® (Adolescent Literacy) (November 2016)
READ 180® is a reading program designed for struggling readers who are reading 2 or more years below grade level. It combines online and direct instruction, student assessment, and teacher professional development. READ 180® is delivered in 90-minute sessions that include whole-group instruction, three small-group rotations, and whole-class wrap-up. Small-group rotations include individualized instruction using an adaptive computer application, small-group instruction, and independent reading. READ 180® is designed for students in elementary through high school.
Intervention Report K-12 1
Teach for America (Teacher Training, Evaluation, and Compensation) (August 2016)
Teach For America (TFA) is a highly selective route to teacher certification that aims to place non-traditionally trained teachers in high-need public schools. Many TFA teachers hold bachelors’ degrees from selective colleges and universities, in fields outside of education. TFA teachers commit to teach for at least 2 years. TFA teachers receive 5–7 weeks of in-person training over the summer before they begin teaching, then continue to receive professional development and one-on-one coaching from TFA while teaching, in addition to support provided by their schools and districts. As full-time employees of the public schools where they work, TFA teachers receive the same salary and benefits as other first- or second-year teachers in their school or district.
Intervention Report 8-PS 1
Cognitive Tutor® Algebra I (Secondary Mathematics) (June 2016)
Cognitive Tutor®, published by Carnegie Learning, is a math curricula that combines textbooks and interactive software.
Intervention Report 7-12 2
Reading Apprenticeship® (Study Review Protocol) (January 2023)
Reading Apprenticeship® is a professional development program that aims to help teachers improve their students’ literacy skills. The program also aims to improve student social-emotional learning outcomes such as belonging, social awareness, growth mindset, and self-efficacy. Reading Apprenticeship® trains teachers to model reading comprehension strategies and help students practice these strategies in their classrooms.
Intervention Report 6-12 2
Pathway to Academic Success (Pathway Project) (English Language Learners) (November 2021)
The Pathway to Academic Success Project trains teachers to improve the reading and writing abilities of English learners who have an intermediate level of English proficiency by incorporating cognitive strategies into reading and writing instruction. The cognitive strategies include goal setting, tapping prior knowledge, asking questions, making predictions, articulating and revising understanding of text, and evaluating writing.
Intervention Report 2-9 2
Achieve3000 (Adolescent Literacy) (February 2018)
Achieve3000® is a supplemental online literacy program that provides nonfiction reading content to students in grades preK–12 and focuses on building phonemic awareness, phonics, fluency, reading comprehension, vocabulary, and writing skills. Achieve3000® is designed to help students advance their nonfiction reading skills by providing differentiated online instruction. Teachers use the program with an entire class but the assignments are tailored to each student’s reading ability level. For example, teachers assign an article and related activities to an entire class; the program then tailors the version of the article to each student by automatically increasing the difficulty of text when a student is ready for more challenging text. Achieve3000® provides lessons that follow a five-step routine: (1) respond to a Before Reading Poll, (2) read an article, (3) answer activity questions, (4) respond to an After Reading Poll, and (5) answer a Thought Question. Progress reports and student usage data, provided by the online tool, enable teachers to track both whole-class and individual student progress. The program is designed for diverse student groups, including general education students, struggling readers in need of intensive tutoring, and English learners.
Intervention Report K-12 3
McREL Balanced Leadership (School Leadership Review Protocol ) (March 2020)
Balanced Leadership® is a professional development program for school principals and other current and aspiring school leaders in schools serving kindergarten through grade 12. School leaders participate in professional development sessions with trained facilitators over one or two years, practice what they learn between sessions, and can receive additional coaching and online support. McREL International, the company that developed the Balanced Leadership® program, based the framework and content of the professional development on research identifying key actions and behaviors of school leaders that are associated with improved student outcomes.
Intervention Report 7-11 3
Facilitating Long-term Improvements in Graduation and Higher Education for Tomorrow (FLIGHT) (Transition to College) (April 2019)
FLIGHT is a program based on partnership of a private non-profit (Taking Stock in Children) and local educational agencies with the goal of increasing the extent to which low-income students with academic promise are prepared for, enrolled in, and successful in college. Specifically, FLIGHT provides school-based mentoring, college prep, and wrap-around services for at-risk students who show potential to be successful in postsecondary education endeavors.
Intervention Report 9-12 3
Green Dot Public Schools (Charter Schools) (January 2018)
Green Dot Public Schools is a nonprofit organization that operates more than 20 public charter middle and high schools in California, Tennessee, and Washington. The Green Dot Public Schools are regulated and monitored by the local school district, but operate outside of the district’s direct control. The Green Dot Public Schools model emphasizes high quality teaching, strong school leadership, a curriculum that prepares students for college, and partnerships with the community. Any student may enroll in a Green Dot Public School if there is space available. Many Green Dot Public Schools operate with unionized teachers and staff. Several of the Green Dot Public Schools were chartered in existing public schools which were performing below district or community expectations. Funding for Green Dot Public Schools operations comes through public federal, state, and local finances, while some transformations of existing district-run schools into charter schools have been funded partly by private foundations.
Intervention Report 2-10 3
Self-Regulated Strategy Development (Students with a Specific Learning Disability) (November 2017)
Self-Regulated Strategy Development (SRSD) is an intervention designed to improve students’ academic skills through a six-step process that teaches students specific academic strategies and self-regulation skills. The practice is especially appropriate for students with learning disabilities. The intervention begins with teacher direction and ends with students independently applying the strategy, such as planning and organizing ideas before writing an essay. More specifically, the six steps involve the teacher providing background knowledge, discussing the strategy with the student, modeling the strategy, helping the student memorize the strategy, supporting the strategy, and then watching as the student independently performs the strategy. A key part of the process is teaching self-regulation skills, such as goal-setting and self-monitoring, which aim to help students apply the strategy without guidance. The steps can be combined, changed, reordered, or repeated, depending on the needs of the student. The SRSD model can be used with students in grades 2 through 12 in individual, small group, or whole classroom settings.
Intervention Report 7-10 3
University of Chicago School Mathematics Project (UCSMP) Multiple Courses (Secondary Mathematics) (May 2016)
UCSMP is a core mathematics curriculum that emphasizes problem solving, real-world applications, and the use of technology. The curriculum is based on a student-centered approach with a focus on active learning that incorporates reading and uses a flexible lesson organization.
Intervention Report 9-12 3
Career Academies (Dropout Prevention) (September 2015)
Career Academies are school-within-school programs operating in high schools. Students in Career Academies take both career-related and academic courses and acquire work experience through partnerships with local employers.
Intervention Report 6-12 3
MyTeachingPartner–Secondary (Teacher Training, Evaluation, and Compensation) (June 2015)
MyTeachingPartner–Secondary (MTP-S) is a professional development program that aims to increase student learning and development through improved teacher–student interactions. Through the program, middle and high school teachers access a video library featuring examples of high-quality interactions and receive individualized, web-based coaching approximately twice per month during the school year. MTP-S uses the secondary school version of the Classroom Assessment Scoring System®–Secondary (CLASS-S) to define and observe effective teaching practices.
Intervention Report 9-12 3
Check & Connect (Dropout Prevention) (May 2015)
Check & Connect is a dropout prevention strategy that relies on close monitoring of school performance, mentoring, case management, and other supports. The program has two main components: “Check” and “Connect.” The Check component is designed to continually assess student engagement through close monitoring of student performance and progress indicators. The Connect component involves program staff giving individualized attention to students, in partnership with school personnel, family members, and community service providers. Students enrolled in Check & Connect are assigned a “monitor” who regularly reviews their performance (in particular, whether students are having attendance, behavior, or academic problems) and intervenes when problems are identified. The monitor also advocates for students, coordinates services, provides ongoing feedback and encouragement, and emphasizes the importance of staying in school.
Intervention Report 5-12 3
Repeated Reading (Students with Learning Disabilities) (May 2014)
Repeated reading is an academic practice that aims to increase oral reading fluency. Repeated reading can be used with students who have developed initial word reading skills but demonstrate inadequate reading fluency for their grade level. During repeated reading, a student sits in a quiet location with a teacher and reads a passage aloud at least three times. Typically, the teacher selects a passage of about 50 to 200 words in length. If the student misreads a word or hesitates for longer than 5 seconds, the teacher reads the word aloud, and the student repeats the word correctly. If the student requests help with a word, the teacher reads the word aloud or provides the definition. The student rereads the passage until he or she achieves a satisfactory fluency level.
Intervention Report 5-9 3
Reading Plus® (Adolescent Literacy) (September 2010)
Reading Plus® is a web-based reading intervention that uses technology to provide individualized scaffolded silent reading practice for students in grades 3 and higher. Reading Plus® aims to develop and improve students’ silent reading fluency, comprehension, and vocabulary. Reading Plus® is designed to adjust the difficulty of the content and duration of reading activities so that students proceed at a pace that corresponds to their reading skill level. The intervention includes differentiated reading activities, computer-based reading assessments, tools to monitor student progress, ongoing implementation support, and supplemental offline activities.
Intervention Report 9-10 3
Core-Plus Mathematics (High School Mathematics) (September 2010)
Core-Plus Mathematics is a 4-year curriculum that replaces the traditional sequence with courses that each feature interwoven strands of algebra and functions, statistics and probability, geometry and trigonometry, and discrete mathematics. The curriculum emphasizes mathematical modeling, using technology to emphasize reasoning with multiple representations (verbal, numerical, graphical, and symbolic) and to focus on goals in which mathematical thinking and problem solving are central. Instructional materials promote active learning and teaching centered around collaborative small-group investigations of problem situations, followed by teacher-led whole-class summarizing activities that lead to analysis, abstraction, and further application of underlying mathematical ideas.
Intervention Report K-10 3
Fast ForWord® (Adolescent Literacy) (August 2010)
Fast ForWord® is a computer-based reading program intended to help students develop and strengthen the cognitive skills necessary for successful reading and learning. The program, which is designed to be used 30 to 100 minutes a day, five days a week, for 4 to 16 weeks, includes two components.
Intervention Report 7-12 3
Reading Apprenticeship® (Adolescent Literacy) (July 2010)
Reading Apprenticeship® is a professional development program that aims to help teachers improve their students’ literacy skills. The program also aims to improve student social-emotional learning outcomes such as belonging, social awareness, growth mindset, and self-efficacy. Reading Apprenticeship® trains teachers to model reading comprehension strategies and help students practice these strategies in their classrooms.
Intervention Report 9-12 3
High School Redirection (Dropout Prevention) (April 2007)
High School Redirection is an alternative high school program for youth considered at risk of dropping out. The program emphasizes basic skills development (with a particular focus on reading skills) and offers limited extra-curricular activities. The schools operate in economically disadvantaged areas and serve students who have dropped out in the past, who are teen parents, who have poor test scores, or who are over-age for their grade. To foster a sense of community, the schools are small, and teachers are encouraged to act as mentors as well as instructors.
Intervention Report 7-9 3
ALAS (Dropout Prevention) (October 2006)
ALAS (Spanish for “wings”) is an intervention for middle and high school students that is designed to address student, school, family, and community factors that affect dropping out. Each student is assigned a counselor/mentor who monitors attendance, behavior, and academic achievement. The counselor/mentor provides feedback and coordinates interventions and resources to students, families, and teachers. Counselors/mentors also serve as advocates for students and intervene when problems are identified. Students are trained in problem-solving, self-control, and assertiveness skills. Parents are trained in parent-child problem solving, how to participate in school activities, and how to contact teachers and school administrators to address issues.
Intervention Report 3-12 3
Connect with Kids (Character Education) (September 2006)
Connect with Kids aims to promote prosocial attitudes and positive behavior of elementary (grades 3–5) and secondary (grades 6–12) school students by teaching core character values. Lesson plans include videos, story summaries, discussion questions, student games, and activities for both core and supplemental character traits. The classroom curriculum is reinforced by a website component and schoolwide and community outreach components. The program can be incorporated into an existing curriculum or used as a standalone program. The school or teacher decides on the number of character traits covered in each session, so the program duration may vary from one semester to an entire academic year.
Intervention Report 9-12 3
Too Good for Drugs and Violence (TGFD & V) (Character Education) (September 2006)
Too Good for Drugs and Violence is designed to promote high school students’ pro-social skills, positive character traits, and violence- and drug-free norms. The curriculum consists of 14 core lessons, as well as an additional 12 lessons that can be infused into other subject areas (such as English, science, and social studies). Teachers participate in 10 staff development lessons. The program includes optional elements of family and community involvement.
Intervention Report K-10 3
Fast ForWord® (English Language Learners) (September 2006)
Fast ForWord® is a computer-based reading program intended to help students develop and strengthen the cognitive skills necessary for successful reading and learning. The program, which is designed to be used 30 to 100 minutes a day, five days a week, for 4 to 16 weeks, includes two components.
Intervention Report 6-9 -1
University of Chicago School Mathematics Project (UCSMP) Transitions/Pre-transitions Math (Primary Mathematics) (May 2021)
University of Chicago School Mathematics Project (UCSMP) is a core mathematics curriculum that includes materials and a routinized instructional approach with an option for teacher training. The curriculum uses an inquiry-based approach with a focus on active learning where students frequently engage in hands-on activities and small-group activities. Pre-Transition Mathematics teaches arithmetic, algebra, geometry, probability, and statistics. Transition Mathematics teaches more advanced arithmetic, algebra, and geometry, and connects these areas to measurement, probability, and statistics.
Intervention Report 9 -1
Xtreme Reading (Adolescent Literacy) (March 2021)
Xtreme Reading is a supplemental literacy curriculum designed to improve the literacy skills of struggling students in grades 6 to 12. The curriculum is primarily designed to help students improve their vocabulary, decoding, fluency, and reading comprehension skills. To ensure a productive learning environment, students initially learn social skills associated with creating a supportive learning community, including how to participate in certain class activities (for example, whole-group discussion, small-group work, partner work, transitions). They also participate in a motivational program whereby they discuss their hopes and dreams for the future and set personal goals related to reading and other life areas. The Xtreme Reading program includes teacher-led whole-group instruction, cooperative group work, paired practice, and independent practice.
Intervention Report 6-9 -1
Passport Reading Journeys (Adolescent Literacy) (November 2019)
Passport Reading Journeys is a supplemental literacy curriculum designed to help improve reading comprehension, vocabulary, word study, and writing skills of struggling readers in grades 6–12. Lessons incorporate both teacher-led instruction and technology, including whole-class and small-group instruction, independent reading, video segments, and independent computer-based practice. The curriculum includes a series of two-week, ten-lesson instructional sequences on topics in science, math, fine art, literature, and social studies. Each sequence is themed as an expedition or journey for students.
Intervention Report 2-9 -1
Achieve3000 (Beginning Reading) (February 2018)
Achieve3000® is a supplemental online literacy program that provides nonfiction reading content to students in grades preK–12 and focuses on building phonemic awareness, phonics, fluency, reading comprehension, vocabulary, and writing skills. Achieve3000® is designed to help students advance their nonfiction reading skills by providing differentiated online instruction. Teachers use the program with an entire class but the assignments are tailored to each student’s reading ability level. For example, teachers assign an article and related activities to an entire class; the program then tailors the version of the article to each student by automatically increasing the difficulty of text when a student is ready for more challenging text. Achieve3000® provides lessons that follow a five-step routine: (1) respond to a Before Reading Poll, (2) read an article, (3) answer activity questions, (4) respond to an After Reading Poll, and (5) answer a Thought Question. Progress reports and student usage data, provided by the online tool, enable teachers to track both whole-class and individual student progress. The program is designed for diverse student groups, including general education students, struggling readers in need of intensive tutoring, and English learners.
Intervention Report 2-9 -1
Accelerated Math® (Primary Mathematics) (December 2017)
Accelerated Math®, published by Renaissance Learning, is a software tool that provides practice problems for students in grades K–12 and provides teachers with reports to monitor student progress. Accelerated Math® creates individualized student assignments, scores the assignments, and generates reports on student progress. The software is typically used with the math curriculum being used in the classroom to add practice for students and help teachers differentiate instruction through the program’s progress-monitoring data.
Intervention Report 2-9 -1
Accelerated Math® (Secondary Mathematics) (December 2017)
Accelerated Math®, published by Renaissance Learning, is a software tool that provides practice problems for students in grades K–12 and provides teachers with reports to monitor student progress. Accelerated Math® creates individualized student assignments, scores the assignments, and generates reports on student progress. The software is typically used with the math curriculum being used in the classroom to add practice for students and help teachers differentiate instruction through the program’s progress-monitoring data.
Intervention Report 7-10 -1
Prentice Hall/Pearson Literature (c)2007, 2010, 2012, 2015 (Adolescent Literacy) (November 2017)
Prentice Hall/Pearson Literature© (2007–15) is an English language arts curriculum designed for students in grades 6–12 that focuses on building reading, vocabulary, literary analysis, and writing skills. It uses passages from fiction and nonfiction texts, poetry, and contemporary digital media. The curriculum is based on a textbook. The publisher also provides online components and other materials that enable teachers to provide personalized assignments, monitor students’ progress, and score writing assignments, enrich instruction, or provide additional practice to supplement the textbook.
Intervention Report 6-12 -1
TNTP Teaching Fellows (Teacher Training, Evaluation, and Compensation) (June 2017)
TNTP Teaching Fellows is a highly selective route to teacher certification that aims to prepare people to teach in high-need public schools. The program recruits professionals seeking to change careers and recent college graduates who are not certified teachers. TNTP Teaching Fellows expects its participants to teach for many years, but does not require them to make a minimum time commitment to teaching. Program participants complete online coursework and receive 5–7 weeks of in-person training focused on foundational teaching skills during the summer before they begin teaching. They must demonstrate mastery of these core skills to be eligible to teach. They receive continued professional development and coaching from TNTP Teaching Fellows during their first year of teaching, and additional support provided by their schools and districts. As full-time employees of the public schools in which they work, new TNTP Teaching Fellows teachers receive the same salary and benefits as other beginning teachers in their school district.
Intervention Report 9-12 -1
Cognitive Tutor® Geometry (Secondary Mathematics) (June 2016)
Cognitive Tutor®, published by Carnegie Learning, is a math curricula that combines textbooks and interactive software.
Intervention Report 6-9 -1
Saxon Algebra I (Secondary Mathematics) (May 2016)
Saxon Math is a textbook series covering grades K–12 based on incremental development and continual review of mathematical concepts to give students time to learn and practice concepts throughout the year. The program is built on the premise that students learn best when instruction is incremental and explicit, previously learned concepts are continually reviewed, and assessment is frequent and cumulative. At each grade level, math concepts are introduced, reviewed, and practiced over time in order to move students from understanding to fluency.
Intervention Report PK-12 -1
TAP: The System for Teacher and Student Advancement (Teacher Training, Evaluation, and Compensation) (July 2015)
TAP™ (formerly known as the Teacher Advancement Program) is a comprehensive educator effectiveness program that aims to improve student achievement through supports and incentives that attract, retain, develop, and motivate effective teachers. The program provides teachers with leadership opportunities and associated salary increases; ongoing, school-based professional development; rigorous evaluations; and annual performance bonuses based on a combination of teacher value added to student achievement and observations of their classroom teaching.
Intervention Report 4-12 -1
Reciprocal Teaching (Students with Learning Disabilities) (November 2013)
Reciprocal teaching is an interactive instructional practice that aims to improve students’ reading comprehension by teaching strategies to obtain meaning from a text. The teacher and students take turns leading a dialogue regarding segments of the text. Students discuss with their teacher how to apply four comprehension strategies—generating questions, summarizing, clarifying, and predicting—to passages of text. During the early stages of reciprocal teaching, the teacher assumes primary responsibility for modeling how to use these strategies. As students become more familiar with the strategies, there is a gradual shift toward student responsibility for talking through the application of the strategies to the text.
Intervention Report K-10 -1
Fast ForWord® (Beginning Reading) (March 2013)
Fast ForWord® is a computer-based reading program intended to help students develop and strengthen the cognitive skills necessary for successful reading and learning. The program, which is designed to be used 30 to 100 minutes a day, five days a week, for 4 to 16 weeks, includes two components.
Intervention Report 9-10 -1
LANGUAGE!® (Adolescent Literacy) (February 2013)
LANGUAGE!® is a language arts intervention designed for struggling learners in grades 3–12 who score below the 40th percentile on standardized literacy tests. The curriculum integrates English literacy acquisition skills into a six-step lesson format. During a daily lesson, students work on phonemic awareness and phonics (word decoding), word recognition and spelling (word encoding), vocabulary and morphology (word meaning), grammar and usage (understanding the form and function of words in context), listening and reading comprehension, and speaking and writing.
Intervention Report 9-12 -1
Check & Connect (Children Identified With or at Risk for an Emotional Disturbance) (October 2011)
Check & Connect is a dropout prevention strategy that relies on close monitoring of school performance, mentoring, case management, and other supports. The program has two main components: “Check” and “Connect.” The Check component is designed to continually assess student engagement through close monitoring of student performance and progress indicators. The Connect component involves program staff giving individualized attention to students, in partnership with school personnel, family members, and community service providers. Students enrolled in Check & Connect are assigned a “monitor” who regularly reviews their performance (in particular, whether students are having attendance, behavior, or academic problems) and intervenes when problems are identified. The monitor also advocates for students, coordinates services, provides ongoing feedback and encouragement, and emphasizes the importance of staying in school.
Intervention Report 5-12 -1
Repeated Reading (Middle School Mathematics) (April 2011)
Repeated reading is an academic practice that aims to increase oral reading fluency. Repeated reading can be used with students who have developed initial word reading skills but demonstrate inadequate reading fluency for their grade level. During repeated reading, a student sits in a quiet location with a teacher and reads a passage aloud at least three times. Typically, the teacher selects a passage of about 50 to 200 words in length. If the student misreads a word or hesitates for longer than 5 seconds, the teacher reads the word aloud, and the student repeats the word correctly. If the student requests help with a word, the teacher reads the word aloud or provides the definition. The student rereads the passage until he or she achieves a satisfactory fluency level.
Intervention Report 4-12 -1
Reciprocal Teaching (Adolescent Literacy) (September 2010)
Reciprocal teaching is an interactive instructional practice that aims to improve students’ reading comprehension by teaching strategies to obtain meaning from a text. The teacher and students take turns leading a dialogue regarding segments of the text. Students discuss with their teacher how to apply four comprehension strategies—generating questions, summarizing, clarifying, and predicting—to passages of text. During the early stages of reciprocal teaching, the teacher assumes primary responsibility for modeling how to use these strategies. As students become more familiar with the strategies, there is a gradual shift toward student responsibility for talking through the application of the strategies to the text.
Intervention Report 9-12 -1
Advancement Via Individual Determination (AVID) (Adolescent Literacy) (September 2010)
AVID is a college-readiness program whose primary goal is to prepare middle and high school students for enrollment in 4-year colleges through increased access to and support in advanced courses. The program, which focuses on underserved, middle-achieving students (defined as students earning B, C, and even D grades), places students in college preparatory classes (e.g., honors and Advancement Placement classes) while providing academic support through a daily elective period and ongoing tutorials.
Intervention Report 4-10 -1
Read 180® (Students with Learning Disabilities) (July 2010)
READ 180® is a reading program designed for struggling readers who are reading 2 or more years below grade level. It combines online and direct instruction, student assessment, and teacher professional development. READ 180® is delivered in 90-minute sessions that include whole-group instruction, three small-group rotations, and whole-class wrap-up. Small-group rotations include individualized instruction using an adaptive computer application, small-group instruction, and independent reading. READ 180® is designed for students in elementary through high school.
Intervention Report 8-9 -1
Summer Training and Education Program (STEP) (Dropout Prevention) (May 2009)
Summer Training and Education Program (STEP) is a summer employment, academic remediation, and life skills program intended to reduce school dropout rates by addressing summer learning loss and preventing teen parenthood. The program serves low-income 14- and 15-year-olds who have tested below grade level in either reading or math. The program is integrated into the federal summer jobs program and is offered as sessions of 6–8 weeks in two consecutive summers. It includes part-time summer work at minimum wage, a daily reading and math curriculum, and “life skills and opportunities” classes that focus on topics such as sexual behavior, drug use, careers, and community involvement.
Intervention Report 9-12 -1
Middle College High School (Dropout Prevention) (March 2009)
Middle College High Schools are alternative high schools located on college campuses that aim to help at-risk students complete high school and encourage them to attend college. The schools offer a project-centered, interdisciplinary curriculum with an emphasis on team teaching, individualized attention, and development of critical thinking skills. Students are also offered support services, including specialized counseling, peer support, and career experience opportunities.
Intervention Report 9-12 -1
First Things First (Dropout Prevention) (January 2008)
First Things First is a reform model intended to transform elementary, middle, and high schools serving significant proportions of economically disadvantaged students. Its three main components are: (1) “small learning communities” of students and teachers; (2) a family and student advocate system that pairs staff members and students to monitor and support progress, and that serves as a bridge between the school and family; and (3) instructional improvements to make classroom teaching more rigorous and engaging and more closely aligned with state standards and assessments.
Intervention Report 9-12 -1
Project GRAD (Dropout Prevention) (July 2007)
Project “Graduation Really Achieves Dreams” (GRAD) is an initiative for students in economically disadvantaged communities that aims to reduce dropping out and increase rates of college enrollment and graduation by increasing reading and math skills, improving behavior in school, and providing a service safety net. At the high school level, Project GRAD provides 4-year college scholarships and summer institutes to promote attending and completing high school. Project GRAD also provides services in the elementary and middle schools that feed into the participating high schools.
Intervention Report 9-12 -1
Quantum Opportunity Program (Dropout Prevention) (July 2007)
The Quantum Opportunity Program (QOP) is an intensive and comprehensive program for high school-aged youth that offers case management, mentoring, tutoring, and other education and support services. The program also offers financial incentives for participation in program activities. Participants enter QOP in grade 9 and can receive services for 4–5 years, even if they drop out of school or move to another district.
Intervention Report 9-12 -1
Talent Development High Schools (Dropout Prevention) (July 2007)
Talent Development High Schools is a school reform model for restructuring large high schools with persistent attendance and discipline problems, poor student achievement, and high dropout rates. The model includes both structural and curriculum reforms. It calls for schools to reorganize into small “learning communities”—including ninth-grade academies for first-year students and career academies for students in upper grades—to reduce student isolation and anonymity. It also emphasizes high academic standards and provides all students with a college preparatory academic sequence.
Intervention Report 9-10 -1
Core-Plus Mathematics (Middle School Mathematics) (July 2007)
Core-Plus Mathematics is a 4-year curriculum that replaces the traditional sequence with courses that each feature interwoven strands of algebra and functions, statistics and probability, geometry and trigonometry, and discrete mathematics. The curriculum emphasizes mathematical modeling, using technology to emphasize reasoning with multiple representations (verbal, numerical, graphical, and symbolic) and to focus on goals in which mathematical thinking and problem solving are central. Instructional materials promote active learning and teaching centered around collaborative small-group investigations of problem situations, followed by teacher-led whole-class summarizing activities that lead to analysis, abstraction, and further application of underlying mathematical ideas.
Intervention Report 7-9 -1
Transition Mathematics (Middle School Mathematics) (March 2007)
Transition Mathematics aims to increase applied arithmetic, pre-algebra, and pre-geometry skills in students in grades 7–12 . This 1-year curriculum also addresses general application to different wordings of problems, types of numbers, and contexts for problems and aims to promote mathematical reading skills. The curriculum uses the University of Chicago School Mathematics Project (UCSMP) textbook. The sequence of the topics intends to assist the transition from arithmetic to algebra and geometry.
Intervention Report 9-12 -1
Lions Quest -- Skills for Action (Character Education) (September 2006)
Lions Quest Skills for Action, a program to build positive character values and life and citizenship skills for students in grades 9–12, includes classroom lessons and service learning. The program includes more than 100 lessons focused around 26 personal, social, and thinking skills. Program length ranges from one semester to 4 years. Students explore personal stories highlighting values and behavior through teachers’ questions, group discussion, and resource pages in the curricular materials. For service learning, students perform school-based or community-based projects and reflect on their experiences. Optional components include a student magazine, an Advisory Team, and supplemental units on drug use prevention.
Reviews of Individual Studies 7-9 1
Evaluation of the College, Career, and Community Writers Program: Findings from the i3 Scale-up Grant. Technical Report. (2021)
Reviews of Individual Studies 9-11 1
Bridging the School-to-Work Divide: Interim Implementation and Impact Findings from New York City’s P-TECH 9-14 Schools. (2020)
This study offers initial impact and implementation findings from the first rigorous evaluation of the model, evaluating the first seven P-TECH 9-14 schools that opened in New York City. The study leverages the random lottery process created by the New York City High School Admissions System to identify impacts. The majority of the students in the sample who participated in the admissions lotteries were academically below proficiency in both math and English language arts (ELA) prior to entering high school.
Reviews of Individual Studies 9-12 1
What Happens When You Combine High School and College? The Impact of the Early College Model on Postsecondary Performance and Completion (2020)
Early colleges are a new model of schooling in which the high school and college experiences are merged, shortening the total amount of time a student spends in school. This study uses a lottery-based experimental design to examine the impact of the model on longer term outcomes, including attainment of a postsecondary credential and academic performance in 4-year institutions. Results show that a significantly higher proportion of early college students were attaining postsecondary credentials. The results also show that early college students were completing their degrees more rapidly but that their performance in 4-year institutions was still comparable with the control students. [For the corresponding grantee submission, see ED604350.]
Reviews of Individual Studies 9-PS 1
Bridging the School-to-Work Divide: Interim Implementation and Impact Findings from New York City's P-TECH 9-14 Schools. (2020)
The New York City P-TECH Grades 9-14 schools represent an education model that ties together the secondary, higher education, and workforce systems as a way to improve outcomes in both domains. The distinguishing feature of the P-TECH 9-14 model, as it is referred to in this report, is a partnership between a high school, a local community college, and one or more employer partners that focuses on preparing students for both college and careers -- not one or the other -- within a six-year timeframe. Education and workforce development are traditionally seen as separate spheres of influence with multiple transition points that students have been left to navigate largely on their own (for example, high school to postsecondary, and postsecondary to the workforce). P-TECH 9-14 is designed to seamlessly assist student navigation of those points -- supporting student success and mitigating the potential for students to fall through the cracks. P-TECH 9-14 schools collaborate with local colleges to provide students with an opportunity to earn a high school diploma (within four years) followed by a cost-free, industry-recognized associate's degree. During the six-year program, employer partners support P-TECH 9-14 schools by providing students with work-based learning experiences such as internships, mentoring, and job shadowing. By design, the P-TECH 9-14 model offers students the opportunity to participate in focused and accelerated high school pathways, early college, and career-focused activities. This study offers initial impact and implementation findings from the first rigorous evaluation of the model, evaluating the first seven P-TECH 9-14 schools that opened in New York City. The study leverages the random lottery process created by the New York City High School Admissions System to identify impacts. The majority of the students in the sample who participated in the admissions lotteries were academically below proficiency in both math and English language arts (ELA) prior to entering high school. [This report was written with Fernando Medina. For the executive summary, see ED605313.]
Reviews of Individual Studies 9-PS 1
What Happens When You Combine High School and College? The Impact of the Early College Model on Postsecondary Performance and Completion. (2020)
Early colleges are a new model of schooling in which the high school and college experiences are merged, shortening the total amount of time a student spends in school. This study uses a lottery-based experimental design to examine the impact of the model on longer term outcomes, including attainment of a postsecondary credential and academic performance in 4-year institutions. Results show that a significantly higher proportion of early college students were attaining postsecondary credentials. The results also show that early college students were completing their degrees more rapidly but that their performance in 4-year institutions was still comparable with the control students.
Reviews of Individual Studies 9-12 1
Building bridges to life after high school: Contemporary career academies and student outcomes. (2019)
Reviews of Individual Studies 9-12 1
Early College, Continued Success: Longer-Term Impact of Early College High Schools. (2019)
Building on a previous randomized experiment of the impact of Early Colleges (ECs) (Berger et al., 2013), this follow-up study assessed longer-term impacts of ECs on students' postsecondary outcomes 6 years after expected high school graduation. It also explored the extent to which students' high school experiences mediate EC impacts. Specifically, this study addressed three research questions: (1) Did EC students have better postsecondary outcomes (i.e., college enrollment and degree attainment) than control students? (2) Did the impacts of ECs vary by student background characteristics (i.e., gender, race/ethnicity, low-income status, and prior mathematics and English language arts [ELA] achievement)? and (3) Were the impacts of ECs mediated by students' high school experiences (i.e., college credit accrual during high school, instructional rigor, college-going culture, and student supports)? To answer these questions for the follow-up study, the authors analyzed 4 more years of postsecondary outcome data from the StudentTracker Service at the National Student Clearinghouse for students participating in the EC admission lotteries that were the basis of the previous impact study. They also analyzed data on student background characteristics from administrative records and data on high school experiences from a student survey administered in the previous impact study 5 or 6 years after students entered the ninth grade. [To view the earlier report, "Early College, Early Success: Early College High School Initiative Impact Study," see ED577243.]
Reviews of Individual Studies 9 1
A national experiment reveals where a growth mindset improves achievement. (2019)
Reviews of Individual Studies 9 1
Building Assets and Reducing Risks (BARR) Validation Study Final Report (2019)
Reviews of Individual Studies 7-12 1
UC Irvine Writing Project’s Pathway to Academic Success program: An Investing in Innovation (i3) validation grant evaluation. Technical report. (2017)
Reviews of Individual Studies 9 1
I3 BARR Validation Study (2017)
Reviews of Individual Studies 9-PS 1
Smoothing the Transition to Postsecondary Education: The Impact of the Early College Model (2017)
Developed in response to concerns that too few students were enrolling and succeeding in postsecondary education, early college high schools are small schools that blur the line between high school and college. This article presents results from a longitudinal experimental study comparing outcomes for students accepted to an early college through a lottery process with outcomes for students who were not accepted through the lottery and enrolled in high school elsewhere. Results show that treatment students attained significantly more college credits while in high school, and graduated from high school, enrolled in postsecondary education, and received postsecondary credentials at higher rates. Results for subgroups are included.
Reviews of Individual Studies 9-PS 1
Smoothing the Transition to Postsecondary Education: The Impact of the Early College Model (2017)
Developed in response to concerns that too few students were enrolling and succeeding in postsecondary education, early college high schools are small schools that blur the line between high school and college. This article presents results from a longitudinal experimental study comparing outcomes for students accepted to an early college through a lottery process with outcomes for students who were not accepted through the lottery and enrolled in high school elsewhere. Results show that treatment students attained significantly more college credits while in high school, and graduated from high school, enrolled in postsecondary education, and received postsecondary credentials at higher rates. Results for subgroups are included. [This paper was published in the "Journal of Research on Educational Effectiveness" (EJ1135800)]
Reviews of Individual Studies 9 1
i3 BARR validation study impact findings: Cohort 1. (2016)
Reviews of Individual Studies 6-11 1
Texting Parents: Evaluation report and executive summary. (2016)
This report presents the findings from an efficacy trial and process evaluation of the Parent Engagement Programme (PEP). The PEP was a school-level intervention designed to improve pupil outcomes by engaging parents in their children's learning. The programme was developed collaboratively by research teams from the University of Bristol and Harvard University and was delivered between September 2014 and July 2015. The study was conducted by the Centre for Effective Education, Queen's University Belfast between February 2014 and February 2016. The trial involved 15,697 students in Years 7, 9, and 11 from 36 English secondary schools, with schools sending an average of 30 texts to each parent over the period of the trial. The developers of the intervention managed its delivery to ensure optimal implementation. It was a cluster randomised controlled trial with randomisation at the Key Stage level, designed to determine the impact of the intervention on the academic outcomes of students in English, maths, and science, and the impact on absenteeism. A process evaluation used focus groups, telephone surveys, interviews, and an online survey to provide data on implementation and to capture the perceptions and experiences of participating parents, pupils, and teachers. Key conclusions include: (1) Children who had the intervention experienced about one month of additional progress in maths compared to other children. This positive result is unlikely to have occurred by chance; (2) Children who had the intervention had reduced absenteeism compared to other children. This positive result is unlikely to have occurred by chance; (3) Children who had the intervention appeared to experience about one month of additional progress in English compared to other children. However, analysis suggests that this finding might have been affected by bias introduced by missing data, so evaluators cannot reliably draw this conclusion. There is no evidence to suggest that the intervention had an impact on science attainment; (4) Schools embraced the programme and liked its immediacy and low cost. Many respondents felt that the presence of a dedicated coordinator would be valuable to monitor the accuracy and frequency of texts. Schools should consider whether they would be able to provide this additional resource; and (5) The vast majority of parents were accepting of the programme, including the content, frequency, and timing of texts. [Note: The post-reporting appendix was added in June 2017.]
Reviews of Individual Studies 9 1
The Building Assets-Reducing Risks Program: Replication and expansion of an effective strategy to turn around low-achieving schools. Final report. (2015)
The Building Assets Reducing Risks (BARR) Model BARR is a comprehensive model that addresses the challenges that are part of the 9th grade transition year. BARR employs eight different school-wide and individual strategies that are built on positive relationships and ongoing monitoring of student data. In 2010, BARR received an Investing in Innovation (i3) Development grant from the US Department of Education to replicate BARR and conduct a randomized controlled trial to test its effectiveness. This report details the final results of the i3 Development grant. A large suburban high school in southern California participated in a within-school Randomized Controlled Trial (RCT) of the BARR Model. A total of 555 9th grade students were randomly assigned to BARR and non-BARR conditions. At the end of the RCT year, BARR students had earned significantly more core course credits, higher grade point averages, and had a lower course failure rate than non-BARR students. BARR students also earned significantly higher standardized test scores on the Northwest Education Association's (NWEA) Measures of Academic Progress (MAP) scores in mathematics and reading than did non-BARR students after one year of implementation; specifically an average of two years of growth in mathematics, compared to one year of decline in the non-BARR condition. In the second and third years of the grant, BARR was implemented in the entire 9th grade, and the core course failure rate continued to decline. In addition, the achievement gap between Hispanic and non-Hispanic students closed by year two of implementation and remained closed in year three. Implementation fidelity of the BARR model was achieved in year one, and continued to improve over the second and third years of the study. BARR was also implemented in two smaller rural high schools in Maine. Decreases in core course failure rate, increases in grade point averages, and increases in standardized test scores in reading, language, and mathematics were achieved if the BARR model was implemented with fidelity. BARR teachers reported improved relationships with students, increased ability to perceive student strengths, use of data to improve student performance, better communication with administration, less isolation, and better problem solving of problematic student issues. Results were seen for both new and veteran teachers. The following are appended: (1) Attrition for credits earned, NWEA Reading, NWEA Mathematics; (2) Baseline Measurement--Group Data; (3) Mean number of core credits and NWEA scores by study group, gender and Hispanic origin; (4) Regression models predicting core credits earned, spring NWEA Mathematics scores, and spring NWEA Reading scores; (5) Reported findings--group data and estimates; (6) OLS Regressions for proficiency groups; (7) Core credits by gender and Hispanic origin over 3 years; (8) Fidelity ratings for key components of the BARR program; and (9) Teacher survey results.
Reviews of Individual Studies 9-10 1
Not too late: Improving academic outcomes for disadvantaged youth (Working paper WP-15-01) (2015)
Reviews of Individual Studies 9-PS 1
Smoothing the transition to postsecondary education: The impact of the Early College Model (2015)
Developed in response to concerns that too few students were enrolling and succeeding in postsecondary education, early college high schools are small schools that blur the line between high school and college. This article presents results from a longitudinal experimental study comparing outcomes for students accepted to an early college through a lottery process with outcomes for students who were not accepted through the lottery and enrolled in high school elsewhere. Results show that treatment students attained significantly more college credits while in high school, and graduated from high school, enrolled in postsecondary education, and received postsecondary credentials at higher rates. Results for subgroups are included. [This paper was published in the "Journal of Research on Educational Effectiveness" (EJ1135800)]
Reviews of Individual Studies 9-12 1
Early college, continued success: Early college high school initiative impact study. (2014)
Reviews of Individual Studies 5-12 1
Stand and deliver: Effects of Boston’s charter high schools on college preparation, entry, and choice. (2014)
One of the most important questions in education research is whether the gains from interventions for which perceived short-term success can be sustained. The possibility of short-lived impacts is especially relevant for research on charter schools, where charter operators who face high-stakes assessments have an incentive to "teach to the test." The fact that charters are subject to intense scrutiny and evaluation may even create incentives for cheating (Jacob and Levitt, 2003), strategic instruction (Jacob, 2007), and a focus on small groups of students that are pivotal for official accountability measures (Neal and Schanzenbach, 2010). The purpose of this paper is to assess the impact of attendance at Boston's charter high schools on outcomes where the link with human capital and future earnings seems likely to be sustained and strong. Specifically, the authors focus on outcomes that are either essential to or facilitate post-secondary schooling: high school graduation, the attainment of state competency thresholds, scholarship qualification, Advanced Placement (AP) and SAT scores, college enrollment, and college persistence. Importantly, most of these outcomes are less subject to strategic manipulation than are the state's test-based assessments. As in earlier work, the research design implemented here exploits randomized enrollment lotteries at oversubscribed charter schools. The resulting estimates are likely to provide reliable measures of average causal effects for charter applicants. Six tables are appended.
Reviews of Individual Studies 9 1
Building assets and reducing risks whole ninth-grade strategy reduces coursework failure for students of color. (2013, April/May)
Reviews of Individual Studies 9 1
Early college, early success: Early College High School Initiative impact study. (2013)
In 2002, the Bill & Melinda Gates Foundation launched the Early College High School Initiative (ECHSI) with the primary goal of increasing the opportunity for underserved students to earn a postsecondary credential. To achieve this goal, Early Colleges provide underserved students with exposure to, and support in, college while they are in high school. Early Colleges partner with colleges and universities to offer all students an opportunity to earn an associate's degree or up to two years of college credits toward a bachelor's degree during high school at no or low cost to the students. The underlying assumption is that engaging underrepresented students in a rigorous high school curriculum tied to the incentive of earning college credit will motivate them and increase their access to additional postsecondary education and credentials after high school. Since 2002, more than 240 Early Colleges have opened nationwide. This study focused on the impact of Early Colleges. It addressed two questions: (1) Do Early College students have better outcomes than they would have had at other high schools?; and (2) Does the impact of Early Colleges vary by student background characteristics (e.g., gender and family income)? To answer these questions, the authors conducted a lottery-based randomized experiment, taking advantage of the fact that some Early Colleges used lotteries in their admissions processes. By comparing the outcomes for students who participated in admissions lotteries and were offered enrollment with the outcomes for students who participated in the lotteries but were not offered enrollment, they can draw causal conclusions about the impact of Early Colleges. The primary student outcomes for this study were high school graduation, college enrollment, and college degree attainment. The authors also examined students' high school and college experiences. Data on student background characteristics and high school outcomes came from administrative records from schools, districts, and states; data on college outcomes came from the National Student Clearinghouse (NSC); and data on high school and college experiences and intermediate outcomes such as college credit accrual came from a student survey. The authors assessed the impact of Early Colleges on these outcomes for a sample of 10 Early Colleges that did the following: (1) Enrolled students in grades 9-12 and had high school graduates in the study years (2005-2011); (2) Used lotteries as part of the admission processes in at least one of the study cohorts (students who entered ninth grade in 2005-06, 2006-07, or 2007-08); and (3) Retained the lottery records. Eight of the 10 Early Colleges in the study were included in the student survey. The overall study sample included 2,458 students and the survey sample included 1,294 students. The study extended through three years past high school.
Reviews of Individual Studies 6-12 1
The effectiveness of secondary math teachers from Teach For America and the Teaching Fellows programs (NCEE 2013-4015). (2013)
Teach For America (TFA) and the Teaching Fellows programs are an important and growing source of teachers of hard-to-staff subjects in high-poverty schools, but comprehensive evidence of their effectiveness has been limited. This report presents findings from the first large-scale random assignment study of secondary math teachers from these programs. The study separately examined the effectiveness of TFA and Teaching Fellows teachers, comparing secondary math teachers from each program with other secondary math teachers teaching the same math courses in the same schools. The study focused on secondary math because this is a subject in which schools face particular staffing difficulties.The study had two main findings, one for each program studied: (1) TFA teachers were more effective than the teachers with whom they were compared. On average, students assigned to TFA teachers scored 0.07 standard deviations higher on end-of-year math assessments than students assigned to comparison teachers, a statistically significant difference. This impact is equivalent to an additional 2.6 months of school for the average student nationwide; and (2) Teaching Fellows were neither more nor less effective than the teachers with whom they were compared. On average, students of Teaching Fellows and students of comparison teachers had similar scores on end-of-year math assessments. By providing rigorous evidence on the effectiveness of secondary math teachers from TFA and the Teaching Fellows programs, the study can shed light on potential approaches for improving teacher effectiveness in hard-to-staff schools and subjects. The study findings can provide guidance to school principals faced with the choice of hiring teachers who have entered the profession via different routes to certification. The findings can also aid policymakers and funders of teacher preparation programs by providing information on the effectiveness of teachers from various routes to certification that use different methods to identify, attract, train, and support their teachers. Seven appendixes present: (1) Supplementary Technical Information on Study Design and Data Collection; (2) Supplementary Information on Analytic Methods; (3) Supplementary Information on Teach For America and Teaching Fellows Programs; (4) Teach For America and Teaching Fellows Teachers Compared with Comparison Teachers by Entry Route (Alternative or Traditional); (5) Supplementary Information on Teach For America and Teaching Fellows Teachers Compared with Comparison Teachers; (6) Supplementary Analyses of the Impacts of Teach For America and Teaching Fellows Teachers; and (7) Supplementary Findings on Factors Associated with Teacher Effectiveness. (Contains 96 tables, 21 figures, and 30 footnotes.)
Reviews of Individual Studies 9-12 1
Early college, early success: Early college high school initiative impact study. (2013)
In 2002, the Bill & Melinda Gates Foundation launched the Early College High School Initiative (ECHSI) with the primary goal of increasing the opportunity for underserved students to earn a postsecondary credential. To achieve this goal, Early Colleges provide underserved students with exposure to, and support in, college while they are in high school. Early Colleges partner with colleges and universities to offer all students an opportunity to earn an associate's degree or up to two years of college credits toward a bachelor's degree during high school at no or low cost to the students. The underlying assumption is that engaging underrepresented students in a rigorous high school curriculum tied to the incentive of earning college credit will motivate them and increase their access to additional postsecondary education and credentials after high school. Since 2002, more than 240 Early Colleges have opened nationwide. This study focused on the impact of Early Colleges. It addressed two questions: (1) Do Early College students have better outcomes than they would have had at other high schools?; and (2) Does the impact of Early Colleges vary by student background characteristics (e.g., gender and family income)? To answer these questions, the authors conducted a lottery-based randomized experiment, taking advantage of the fact that some Early Colleges used lotteries in their admissions processes. By comparing the outcomes for students who participated in admissions lotteries and were offered enrollment with the outcomes for students who participated in the lotteries but were not offered enrollment, they can draw causal conclusions about the impact of Early Colleges. The primary student outcomes for this study were high school graduation, college enrollment, and college degree attainment. The authors also examined students' high school and college experiences. Data on student background characteristics and high school outcomes came from administrative records from schools, districts, and states; data on college outcomes came from the National Student Clearinghouse (NSC); and data on high school and college experiences and intermediate outcomes such as college credit accrual came from a student survey. The authors assessed the impact of Early Colleges on these outcomes for a sample of 10 Early Colleges that did the following: (1) Enrolled students in grades 9-12 and had high school graduates in the study years (2005-2011); (2) Used lotteries as part of the admission processes in at least one of the study cohorts (students who entered ninth grade in 2005-06, 2006-07, or 2007-08); and (3) Retained the lottery records. Eight of the 10 Early Colleges in the study were included in the student survey. The overall study sample included 2,458 students and the survey sample included 1,294 students. The study extended through three years past high school.
Reviews of Individual Studies 9-12 1
Sustained progress: New findings about the effectiveness and operation of small public high schools of choice in New York City. (2013)
In 2002, New York City embarked on an ambitious and wide-ranging series of education reforms. At the heart of its high school reforms were three interrelated changes: the institution of a district wide high school choice process for all rising ninth-graders, the closure of 31 large, failing high schools with an average graduation rate of 40 percent, and the opening of more than 200 new small high schools. Over half of the new small schools created between the fall of 2002 and the fall of 2008 were intended to serve students in some of the district's most disadvantaged communities and are located mainly in neighborhoods where large, failing high schools had been closed. MDRC has previously released two reports on these "small schools of choice," or SSCs (so called because they are small, are academically nonselective, and were created to provide a realistic choice for students with widely varying academic backgrounds). Those reports found marked increases in progress toward graduation and in graduation rates for the cohorts of students who entered SSCs in the falls of 2005 and 2006. The second report also found that the increase in graduation rates applied to every student subgroup examined, and that SSC graduation effects were sustained even after five years from the time sample members entered high school. This report updates those previous findings with results from a third cohort of students, those who entered ninth grade in the fall of 2007. In addition, for the first time it includes a look inside these schools through the eyes of principals and teachers, as reported in interviews and focus groups held at the 25 SSCs with the strongest evidence of effectiveness. In brief, the report's findings are: (1) SSCs in New York City continue to markedly increase high school graduation rates for large numbers of disadvantaged students of color, even as graduation rates are rising at the schools with which SSCs are compared; (2) The best evidence that exists indicates that SSCs may increase graduation rates for two new subgroups for which findings were not previously available: special education students and English language learners. However, given the still-limited sample sizes for these subgroups, the evidence will not be definitive until more student cohorts can be added to the analysis; and (3) Principals and teachers at the 25 SSCs with the strongest evidence of effectiveness strongly believe that academic rigor and personal relationships with students contribute to the effectiveness of their schools. They also believe that these attributes derive from their schools' small organizational structures and from their committed, knowledgeable, hardworking, and adaptable teachers. Appended are: (1) Sample, Data, and Analysis; (2) Estimated Effects of Winning a Student's First SSC Lottery; (3) 2008 Requirements for Proposals to Create New SSCs Specified by the New York City Department of Education; and (4) Documentation for Interviews and Focus Groups.
Reviews of Individual Studies 9-12 1
Information and college access: Evidence from a randomized field experiment (NBER Working Paper No. 18551). (2012)
High school students from disadvantaged high schools in Toronto were invited to take two surveys, about three weeks apart. Half of the students taking the first survey were also shown a 3 minute video about the benefits of post secondary education (PSE) and invited to try out a financial-aid calculator. Most students' perceived returns to PSE were high, even among those not expecting to continue. Those exposed to the video, especially those initially unsure about their own educational attainment, reported significantly higher expected returns, lower concerns about costs, and expressed greater likelihood of PSE attainment. The two online surveys are appended.
Reviews of Individual Studies 9 1
Expanding the start of the college pipeline: Ninth-grade findings from an experimental study of the impact of the Early College High School Model. (2012)
Early college high schools are a new and rapidly spreading model that merges the high school and college experiences and that is designed to increase the number of students who graduate from high school and enroll and succeed in postsecondary education. This article presents results from a federally funded experimental study of the impact of the early college model on Grade 9 outcomes. Results show that, as compared to control group students, a statistically significant and substantively higher proportion of treatment group students are taking core college preparatory courses and succeeding in them. Students in the treatment group also have statistically significantly higher attendance and lower suspension rates than students in the control group. (Contains 10 footnotes, 5 tables and 1 figure.)
Reviews of Individual Studies 6-10 1
Striving Readers: Impact study and project evaluation report—Wisconsin Department of Public Instruction (with Milwaukee Public Schools). (2012)
American Institutes for Research (AIR) conducted an evaluation of the effect on struggling readers of implementing the READ 180 reading intervention in five participating schools in Milwaukee Public Schools (MPS) under a Striving Readers grant from the U.S. Department of Education. The evaluation used an experimental design in order to produce a rigorous estimate of the impact of the READ 180 intervention on measures of reading achievement for struggling students. The evaluation also explored implementation fidelity and the contexts and conditions of implementation that may extend or limit the intervention's effects. To measure program impact on students' academic performance in reading, AIR analyzed student achievement data collected from the Northwest Evaluation Association (NWEA) Measures of Academic Progress (MAP) benchmark assessment. AIR also administered a student survey to assess the impact on student engagement and self-efficacy for reading. This report asked the following research questions: (1) Does the READ 180 reading intervention improve students' academic performance in reading?; (2) With what fidelity did the program implement the professional development model and what factors mediated the level of implementation?; and (3) With what fidelity did classroom intervention teachers implement READ 180 and what factors mediated the level of implementation?
Reviews of Individual Studies 6-12 1
A randomized experiment of a cognitive strategies approach to text-based analytical writing for mainstreamed Latino English language learners in grades 6 to 12. (2011)
This study reports Year 1 findings from a multisite cluster randomized controlled trial of a cognitive strategies approach to teaching text-based analytical writing for mainstreamed Latino English language learners (ELLs) in 9 middle schools and 6 high schools. There were 103 English teachers stratified by school and grade and then randomly assigned to the Pathway Project professional development intervention or control group. The Pathway Project trains teachers to use a pretest on-demand writing assessment to improve text-based analytical writing instruction for mainstreamed Latino ELLs who are able to participate in regular English classes. The intervention draws on well-documented instructional frameworks for teaching mainstreamed ELLs. Such frameworks emphasize the merits of a cognitive strategies approach that supports these learners' English language development. Pathway teachers participated in 46 hrs of training and learned how to apply cognitive strategies by using an on-demand writing assessment to help students understand, interpret, and write analytical essays about literature. Multilevel models revealed significant effects on an on-demand writing assessment (d = 0.35) and the California Standards Test in English language arts (d = 0.07). (Contains 1 figure, 7 tables and 4 footnotes.)
Reviews of Individual Studies 9 1
The Enhanced Reading Opportunities Study Final Report: The Impact of Supplemental Literacy Courses for Struggling Ninth-Grade Readers. (2010)
According to the National Assessment of Educational Progress (NAEP), just over 70 percent of students nationally arrive in high school with reading skills that are below "proficient"--defined as demonstrating competency over challenging subject matter. Of these students, nearly half do not exhibit even partial mastery of the knowledge and skills that are fundamental to proficient work at grade level. These limitations in literacy skills are a major source of course failure, high school dropout, and poor performance in postsecondary education. While research is beginning to emerge about the special needs of striving adolescent readers, very little is known about effective interventions aimed at addressing these needs. To help fill this gap and to provide evidence-based guidance to practitioners, the U.S. Department of Education initiated the Enhanced Reading Opportunities (ERO) study--a demonstration and rigorous evaluation of supplemental literacy programs targeted to ninth-grade students whose reading skills are at least two years below grade level. As part of this demonstration, 34 high schools from 10 school districts implemented one of two reading interventions: Reading Apprenticeship Academic Literacy (RAAL), designed by WestEd, and Xtreme Reading, designed by the University of Kansas Center for Research on Learning. These programs were implemented in the study schools for two school years. The U.S. Department of Education's (ED) Office of Elementary and Secondary Education (OESE) funded the implementation of these programs, and its Institute of Education Sciences (IES) was responsible for oversight of the evaluation. MDRC--a nonprofit, nonpartisan education and social policy research organization--conducted the evaluation in partnership with the American Institutes for Research (AIR) and Survey Research Management (SRM). The goal of the reading interventions--which consist of a year-long course that replaces a ninth-grade elective class--is to help striving adolescent readers develop the strategies and routines used by proficient readers, thereby improving their reading skills and ultimately, their academic performance in high school. The first two reports for the study evaluated the programs' impact on the two most proximal outcomes targeted by the interventions--students' reading skills and their reading behaviors at the end of ninth grade. This report--which is the final of three reports for this evaluation--examines the impact of the ERO programs on the more general outcomes that the programs hope to affect--students' academic performance in high school (grade point average [GPA], credit accumulation, and state test scores) as well as students' behavioral outcomes (attendance and disciplinary infractions). These academic and behavioral outcomes are examined during the year in which they were enrolled in the ERO programs (ninth grade), as well as the following school year (tenth grade for most students). Appendices include: (1) The ERO Programs and the ERO Teachers; (2) ERO Student Survey Measures; (3) ERO Implementation Fidelity; (4) State Tests Included in the ERO Study; (5) Response Analysis and Baseline Comparison Tables; (6) Technical Notes for Impact Findings; (7) Statistical Power and Minimum Detectable Effect Size; (8) Supplementary Impact Findings; (9) Baseline and Impact Findings, by Cohort; (10) The Association Between Reading Outcomes and Academic Performance in High School; (11) Variation in Impacts Across Sites and Cohorts; (12) Program Costs; and (13) Poststudy Adolescent Literacy Programming in the ERO Schools: Methodology and Additional Findings. (Contains 97 tables, 23 figures, 2 boxes, and 185 footnotes.) [This paper was written with Edmond Wong. For the first-year report, see ED499778. For the second report, see ED503380.]
Reviews of Individual Studies 9 1
The enhanced reading opportunity study final report: The impact of supplemental literacy courses for struggling ninth-grade readers (NCEE 2010-4021). (2010)
According to the National Assessment of Educational Progress (NAEP), just over 70 percent of students nationally arrive in high school with reading skills that are below "proficient"--defined as demonstrating competency over challenging subject matter. Of these students, nearly half do not exhibit even partial mastery of the knowledge and skills that are fundamental to proficient work at grade level. These limitations in literacy skills are a major source of course failure, high school dropout, and poor performance in postsecondary education. While research is beginning to emerge about the special needs of striving adolescent readers, very little is known about effective interventions aimed at addressing these needs. To help fill this gap and to provide evidence-based guidance to practitioners, the U.S. Department of Education initiated the Enhanced Reading Opportunities (ERO) study--a demonstration and rigorous evaluation of supplemental literacy programs targeted to ninth-grade students whose reading skills are at least two years below grade level. As part of this demonstration, 34 high schools from 10 school districts implemented one of two reading interventions: Reading Apprenticeship Academic Literacy (RAAL), designed by WestEd, and Xtreme Reading, designed by the University of Kansas Center for Research on Learning. These programs were implemented in the study schools for two school years. The U.S. Department of Education's (ED) Office of Elementary and Secondary Education (OESE) funded the implementation of these programs, and its Institute of Education Sciences (IES) was responsible for oversight of the evaluation. MDRC--a nonprofit, nonpartisan education and social policy research organization--conducted the evaluation in partnership with the American Institutes for Research (AIR) and Survey Research Management (SRM). The goal of the reading interventions--which consist of a year-long course that replaces a ninth-grade elective class--is to help striving adolescent readers develop the strategies and routines used by proficient readers, thereby improving their reading skills and ultimately, their academic performance in high school. The first two reports for the study evaluated the programs' impact on the two most proximal outcomes targeted by the interventions--students' reading skills and their reading behaviors at the end of ninth grade. This report--which is the final of three reports for this evaluation--examines the impact of the ERO programs on the more general outcomes that the programs hope to affect--students' academic performance in high school (grade point average [GPA], credit accumulation, and state test scores) as well as students' behavioral outcomes (attendance and disciplinary infractions). These academic and behavioral outcomes are examined during the year in which they were enrolled in the ERO programs (ninth grade), as well as the following school year (tenth grade for most students). Appendices include: (1) The ERO Programs and the ERO Teachers; (2) ERO Student Survey Measures; (3) ERO Implementation Fidelity; (4) State Tests Included in the ERO Study; (5) Response Analysis and Baseline Comparison Tables; (6) Technical Notes for Impact Findings; (7) Statistical Power and Minimum Detectable Effect Size; (8) Supplementary Impact Findings; (9) Baseline and Impact Findings, by Cohort; (10) The Association Between Reading Outcomes and Academic Performance in High School; (11) Variation in Impacts Across Sites and Cohorts; (12) Program Costs; and (13) Poststudy Adolescent Literacy Programming in the ERO Schools: Methodology and Additional Findings. (Contains 97 tables, 23 figures, 2 boxes, and 185 footnotes.) [This paper was written with Edmond Wong. For the first-year report, see ED499778. For the second report, see ED503380.]
Reviews of Individual Studies 9 1
The enhanced reading opportunity study final report: The impact of supplemental literacy courses for struggling ninth-grade readers (NCEE 2010-4021). (2010)
According to the National Assessment of Educational Progress (NAEP), just over 70 percent of students nationally arrive in high school with reading skills that are below "proficient"--defined as demonstrating competency over challenging subject matter. Of these students, nearly half do not exhibit even partial mastery of the knowledge and skills that are fundamental to proficient work at grade level. These limitations in literacy skills are a major source of course failure, high school dropout, and poor performance in postsecondary education. While research is beginning to emerge about the special needs of striving adolescent readers, very little is known about effective interventions aimed at addressing these needs. To help fill this gap and to provide evidence-based guidance to practitioners, the U.S. Department of Education initiated the Enhanced Reading Opportunities (ERO) study--a demonstration and rigorous evaluation of supplemental literacy programs targeted to ninth-grade students whose reading skills are at least two years below grade level. As part of this demonstration, 34 high schools from 10 school districts implemented one of two reading interventions: Reading Apprenticeship Academic Literacy (RAAL), designed by WestEd, and Xtreme Reading, designed by the University of Kansas Center for Research on Learning. These programs were implemented in the study schools for two school years. The U.S. Department of Education's (ED) Office of Elementary and Secondary Education (OESE) funded the implementation of these programs, and its Institute of Education Sciences (IES) was responsible for oversight of the evaluation. MDRC--a nonprofit, nonpartisan education and social policy research organization--conducted the evaluation in partnership with the American Institutes for Research (AIR) and Survey Research Management (SRM). The goal of the reading interventions--which consist of a year-long course that replaces a ninth-grade elective class--is to help striving adolescent readers develop the strategies and routines used by proficient readers, thereby improving their reading skills and ultimately, their academic performance in high school. The first two reports for the study evaluated the programs' impact on the two most proximal outcomes targeted by the interventions--students' reading skills and their reading behaviors at the end of ninth grade. This report--which is the final of three reports for this evaluation--examines the impact of the ERO programs on the more general outcomes that the programs hope to affect--students' academic performance in high school (grade point average [GPA], credit accumulation, and state test scores) as well as students' behavioral outcomes (attendance and disciplinary infractions). These academic and behavioral outcomes are examined during the year in which they were enrolled in the ERO programs (ninth grade), as well as the following school year (tenth grade for most students). Appendices include: (1) The ERO Programs and the ERO Teachers; (2) ERO Student Survey Measures; (3) ERO Implementation Fidelity; (4) State Tests Included in the ERO Study; (5) Response Analysis and Baseline Comparison Tables; (6) Technical Notes for Impact Findings; (7) Statistical Power and Minimum Detectable Effect Size; (8) Supplementary Impact Findings; (9) Baseline and Impact Findings, by Cohort; (10) The Association Between Reading Outcomes and Academic Performance in High School; (11) Variation in Impacts Across Sites and Cohorts; (12) Program Costs; and (13) Poststudy Adolescent Literacy Programming in the ERO Schools: Methodology and Additional Findings. (Contains 97 tables, 23 figures, 2 boxes, and 185 footnotes.) [This paper was written with Edmond Wong. For the first-year report, see ED499778. For the second report, see ED503380.]
Reviews of Individual Studies 9-12 1
Career academies: Long-term impacts on labor market autcomes, educational attainment, and transitions to adulthood. (2008)
Career Academies offer high schools--particularly those in urban communities that struggle to keep students in school and to prepare them for post-secondary education and employment opportunities--a systematic approach to addressing a range of challenges. Typically serving between 150 and 200 students from grades 9 or 10 through grade 12, Career Academies have three distinguishing features: (1) they are organized as small learning communities to create a more supportive, personalized learning environment; (2) they combine academic and career and technical curricula around a career theme to enrich teaching and learning; and (3) they establish partnerships with local employers to provide career awareness and work-based learning opportunities for students. There are estimated to be more than 2,500 Career Academies across the country, operating either as a single program or as multiple programs within a larger high school. This report examines the impact that Career Academies have had on the educational attainment and post-secondary labor market experiences of young people through the four years following their scheduled graduation from high school. It is based on survey data collected from 1,458 young people in the Career Academies Evaluation study sample (about 85 percent of whom are either Hispanic or African-American). Findings included: (1) the Career Academies substantially improved the labor market prospects of young men, a group that has experienced a severe decline in real earnings in recent years; (2) the Career Academies had no significant impacts (positive or negative) on the labor market outcomes for young women; (3) Overall, the Career Academies served as viable pathways to a range of post-secondary education opportunities, but they do not appear to have been more effective than options available to the non-Academy group; and (4) The positive labor market impacts were concentrated among Academy group members who were at high or medium risk of dropping out of high school when they entered the programs. The findings demonstrate the feasibility of improving labor market preparation and successful school-to-work transitions without compromising academic goals and preparation for college. (Contains 10 exhibits.) [Report written with Judith Scott-Clayton. Dissemination of MDRC publications is also supported by Starr Foundation.]
Reviews of Individual Studies 9-12 1
Promoting school completion of urban secondary youth with emotional or behavioral disabilities. (2005)
According to the National Assessment of Educational Progress, nearly 4 in 10 fourth graders read below the basic level. These literacy problems get worse as students advance through school and are exposed to progressively more complex concepts and courses. The purpose of this study was to assess the effectiveness of four remedial reading programs in improving the reading skills of 3rd and 5th graders, whether the impacts of the programs vary across students with difference baseline characteristics, and to what extent can this instruction close the reading gap and bring struggling readers within the normal range--relative to the instruction normally provided by their schools. The study took place in elementary schools in 27 districts of the Allegheny Intermediate Unit outside Pittsburgh, PA during the 2003-04 school year. Within each of 50 schools, 3rd and 5th grade students were identified as struggling readers by their teachers. These students were tested and were eligible for the study if they scored at or below the 30th percentile on a word-level reading test and at or above the 5th percentile on a vocabulary test. The final sample contains a total of 742 students. There are 335 3rd graders ? 208 treatment and 127 control students. There are 407 5th graders ? 228 treatment and 179 control students. Four existing programs were used: Spell Read P.A.T., Corrective Reading, Wilson Reading, and Failure Free Reading. Corrective Reading and Wilson Reading were modified to focus only on word-level skills. Spell Read P.A.T. and Failure Free Reading were intended to focus equally on word-level skills and reading comprehension/vocabulary. Teachers received 70 hours of professional development and support during the year. Instruction was delivered in small groups of 3 students, 5 days a week, for a total of 90 hours. Seven measures of reading skill were administered at the beginning and end of the school year to assess student progress: Word Attack, Word Identification Comprehension (Woodcock Reading Mastery Test); Phonemic Decoding Efficiency and Sight Word Efficiency (Test of Word Reading Efficiency); Oral Reading Fluency (Edformation); and Passage Comprehension (Group Reading Assessment and Diagnostic Evaluation). After one year of instruction, there were significant impacts on phonemic decoding, word reading accuracy and fluency, and comprehension for 3rd graders, but not for 5th graders. For third graders in the reading programs, the gap in word attach skills between struggling readers and average readers was reduced by about two-thirds. It was found that reading skills of 3rd graders can be significantly improved through instruction in word-level skills, but not the reading skills of 5th graders. The following are appended: (1) Details of Study Design and Implementation; (2) Data Collection; (3) Weighting Adjustment and Missing Data; (4) Details of Statistical Methods; (5) Intervention Impacts on Spelling and Calculation; (6) Instructional Group Clustering; (7) Parent Survey; (8) Teacher Survey and Behavioral Rating Forms; (9) Instructional Group Clustering; (10) Videotape Coding Guidelines for Each Reading Program; (11) Supporting Tables; (12) Sample Test Items; (13) Impact Estimate Standard Errors and P-Values; (14) Association between Instructional Group Heterogeneity and The Outcome; (15) Teacher Rating Form; (16) School Survey; and (17) Scientific Advisory Board. [This report was produced by the Corporation for the Advancement of Policy Evaluation. Additional support provided by the Barksdale Reading Institute, and the Haan Foundation for Children.]
Reviews of Individual Studies 9-12 1
Career Academies: Impacts on labor market outcomes and educational attainment. (2004)
Career Academies offer high schools--particularly those in urban communities that struggle to keep students in school and to prepare them for post-secondary education and employment opportunities--a systematic approach to addressing a range of challenges. Typically serving between 150 and 200 students from grades 9 or 10 through grade 12, Career Academies have three distinguishing features: (1) they are organized as small learning communities to create a more supportive, personalized learning environment; (2) they combine academic and career and technical curricula around a career theme to enrich teaching and learning; and (3) they establish partnerships with local employers to provide career awareness and work-based learning opportunities for students. There are estimated to be more than 2,500 Career Academies across the country, operating either as a single program or as multiple programs within a larger high school. This report examines the impact that Career Academies have had on the educational attainment and post-secondary labor market experiences of young people through the four years following their scheduled graduation from high school. It is based on survey data collected from 1,458 young people in the Career Academies Evaluation study sample (about 85 percent of whom are either Hispanic or African-American). Findings included: (1) the Career Academies substantially improved the labor market prospects of young men, a group that has experienced a severe decline in real earnings in recent years; (2) the Career Academies had no significant impacts (positive or negative) on the labor market outcomes for young women; (3) Overall, the Career Academies served as viable pathways to a range of post-secondary education opportunities, but they do not appear to have been more effective than options available to the non-Academy group; and (4) The positive labor market impacts were concentrated among Academy group members who were at high or medium risk of dropping out of high school when they entered the programs. The findings demonstrate the feasibility of improving labor market preparation and successful school-to-work transitions without compromising academic goals and preparation for college. (Contains 10 exhibits.) [Report written with Judith Scott-Clayton. Dissemination of MDRC publications is also supported by Starr Foundation.]
Reviews of Individual Studies 9-12 2
Creating a Future-oriented Culture in High School: The Impact of the College and Career Readiness Expansion (CCRE) Project. (2021)
Reviews of Individual Studies 9-PS 2
Indiana and Minnesota students who focused on career and technical education in high school: Who are they, and what are their college and employment outcomes? REL 2021-090. (2021)
In Indiana and Minnesota the state education agency, state higher education agency, and the state workforce agency have collaborated to develop career and technical education courses intended to improve high school students' college and career readiness. These agencies partnered with the Regional Educational Laboratory Midwest to examine whether high school graduates in each state who completed a large number of career and technical education courses in a single career-oriented program of study (concentrators) had different college and workforce outcomes from graduates who completed fewer (samplers) or no career and technical education courses (nonparticipants). The study found that in the 2012/13-2017/18 graduation cohorts, male graduates were more likely to be concentrators than female graduates, and graduates who received special education services were more likely to be concentrators than those who did not receive services. Graduates who were not proficient in reading in grade 8 also were more likely to become concentrators than those who were proficient. Graduates who attended urban and suburban schools were more likely than students who attended town and rural schools to be nonparticipants. Concentrators were less likely than samplers and nonparticipants with similar characteristics to enroll in college, but the differences reflect mainly enrollment in four-year colleges. Concentrators were more likely to enroll in two-year colleges. Concentrators also were less likely than similar samplers and nonparticipants to complete a bachelor's degree within four to six years. Finally, compared with similar samplers and nonparticipants, concentrators were employed at higher rates in the first five years after high school and had higher earnings. [For the study brief, see ED613045; for the study snapshot, see ED613046; and for the appendixes, see ED613050.]
Reviews of Individual Studies 9-PS 2
The effects of accelerated college credit programs on educational attainment in Rhode Island. REL 2021–103. (2021)
This study examined participation in accelerated college credit programs dual enrollment, concurrent enrollment, and Advanced Placement courses in Rhode Island high schools to understand their effects on educational attainment in the 2013/14 grade 9 cohort. The state, which has funded and promoted these opportunities for students to earn college credit during high school over the past five years, sought evidence of the programs' effects on participants' high school graduation rates, postsecondary enrollment rates, and enrollment rates in developmental education courses in college. The study found that male, economically disadvantaged, and racial/ethnic minority students were underrepresented in accelerated college credit programs. Participation in these programs had positive effects on students' rates of high school graduation and postsecondary enrollment. Among students in the cohort who enrolled in Rhode Island public colleges, participation was associated with lower rates of developmental education course enrollment in the first year of college. The effects of participating in an accelerated college credit program were similar for economically disadvantaged students and for their peers. [For the Study Snapshot, see ED612888. For the appendices, see ED612890.]
Reviews of Individual Studies 9-PS 2
The impact of career and technical education on postsecondary outcomes in Nebraska and South Dakota. REL 2021-087. (2021)
Education leaders in Nebraska and South Dakota partnered with the Regional Educational Laboratory Central to examine how completing a sequence of career and technical education (CTE) courses in high school affects students' rates of on-time high school graduation and their rates of postsecondary education enrollment and completion within two and five years. The study found that CTE concentrators (students who complete a sequence of CTE courses aligned to a specific career field such as manufacturing or education and training) were 7 percentage points more likely than non-CTE concentrators to graduate from high school on time and 10 percentage points more likely to enroll in any type of postsecondary education within two years of their expected high school graduation year. The study also found that CTE concentrators were 3 percentage points more likely than non-CTE concentrators to earn a postsecondary award, such as a professional certificate, diploma, or associate's or bachelor's degree, within five years of their expected high school graduation year. CTE concentrators were 4 percentage points more likely than non-CTE concentrators to obtain up to an associate's degree as their highest postsecondary award within five years of their expected high school graduation year but 1 percentage point less likely to obtain a bachelor's degree or higher. [For the appendixes, see ED612631; for the study brief, see ED612632; for the study snapshot, see ED612633.]
Reviews of Individual Studies 9-PS 2
AVID participation in high school and post-secondary success: An evaluation and cost analysis. (2020)
The purpose of this study is to evaluate the Advancement Via Individual Determination (AVID) program and to derive estimates of program costs. We used the Coarsened Exact Matching approach to match AVID students with non-AVID students on 40 baseline characteristics. After matching, we estimated group differences in high-school graduation and college enrollment. We used the ingredients method to estimate program costs and calculated cost-effectiveness ratios by the duration of participation. Findings indicate that students who complete at least one AVID elective have higher high school graduation and college enrollment rates than comparable non-AVID students. We discuss how AVID compares to other college outreach programs in terms of costs and effects.
Reviews of Individual Studies 9-12 2
2015 Collaborative Regional Education (CORE) i3 Validation Study: Implementation and Impact Study Results. Final Report (2020)
Purpose: The purpose of this two-year study was to assess the impact of the CORE program, a model that integrates technology and active learning modules in high schools by providing multi-disciplinary teams of teachers and administrators with professional development and resources to support the development of students' non-cognitive skills and increase their college and career readiness. A fidelity of implementation study was also conducted to assess the seven key program components were being implemented as intended. Methods: This Randomized Control Trial (RCT) study followed a cohort of 9th and 10th grade high school students in 28 treatment and control schools; students completed the CWRA+ assessment and non-cognitive skills, engagement, and self-efficacy scales at three timepoints. Using the hierarchical linear model (HLM), the study assessed one-year program impact and two-year program impact. The two-year program impact model suffered a high attrition (due to COVID19) and the study became a quasi-experimental design (QED) study after propensity score matching analysis was applied. Results: Findings highlight how students at CORE schools showed increased scores across the two-year program intervention. Specifically, standardized effects on CWRA+ scores, the non-cognitive skills scale, engagement scale, and efficacy scale were respectively, 0.22, 0.22, 0.23, and 0.32. The effect size for the efficacy scale (0.32) was large enough to be considered important. To selectively mention exploratory findings, the level of program exposure both in terms of whether students were enrolled in the program-trained teachers' courses and whether teachers participated in PD activities seemed correlated with a higher growth in student's CWRA+ scores. Another set of exploratory findings implied that the program impact may interact with demographic characteristics of students. Findings demonstrate a need for further testing of differences between student subgroups based on demographics, as well as the importance of buy-in from program implementers to provide the customized PD support that educators and partners at rural schools need to more effectively serve their students. The exploratory findings suggested that the program exposure of teachers and students may be a key to enhance the CORE program impact. [This report was submitted by the ICF Evaluation Team.]
Reviews of Individual Studies 3-12 2
Illustrating the Promise of Community Schools: An Assessment of the Impact of the New York City Community Schools Initiative. (2020)
Reviews of Individual Studies 3-12 2
A Team-Based Leadership Intervention in New York City Schools: An Evaluation of the Targeted Intensive School Support Program (2020)
In 2013, the NYC Leadership Academy (NYCLA) developed a leadership intervention--the Targeted Intensive School Support (TISS) program--in collaboration with the New York City Department of Education (NYC DOE) to support schools that were facing particular challenges. NYCLA asked the RAND Corporation to provide an independent evaluation of the program's implementation and effects, and those findings are detailed in this report. The TISS program consisted of five key components: (1) teaming and collaborative training in aligned preservice preparation programs for a principal and assistant principal (AP); (2) coplacement of a principal and AP into an NYC DOE school; (3) team-based coaching to support the principal and AP; (4) 328 hours of extended coaching over the first three years after placement; and (5) use of a diagnostic process to guide goal setting and coaching according to school needs. Implementation findings suggest that only two of the five key components were implemented with fidelity. A propensity weighting approach was used to compare schools with TISS principals to other schools with new principals trained through residency-based preservice programs who did not participate in TISS. Findings suggest no statistically significant differences between TISS schools and comparison schools on measures of student achievement, school culture, and principal retention. TISS schools underperformed relative to comparison schools on the measure of chronic student absenteeism. [Sponsored by NYC Leadership Academy through a subgrant from the U.S. Department of Education.]
Reviews of Individual Studies 9-12 2
Improving High Schools through STEM Early College Strategies: The Impact of the STEM Early College Expansion Partnership (SECEP) (2019)
The STEM Early College Expansion Project is an effort to integrate STEM strategies with the early college model and implement this in comprehensive high schools. This report summarizes findings from two separate quasi-experimental impact studies of the model in Michigan and Connecticut. Results from Michigan showed statistically significant impacts on enrollment in college-level courses and on attainment of college credits. Treatment schools in Michigan also had descriptively lower dropout rates. The Connecticut impact study had challenges with the study design that resulted in an inability to make clear causal claims about the impact.
Reviews of Individual Studies 9-12 2
Evaluating a Unit Aimed at Helping Students Understand Matter and Energy for Growth and Activity (2019)
To support implementation of the "Next Generation Science Standards," we designed a high school biology unit, "Matter and Energy for Growth and Activity" (MEGA), that engages students in explaining physical and life science phenomena using evidence, models, and science ideas about matter and energy changes within systems and transfers between systems. The unit's promise was evaluated using a randomized control trial (RCT) involving fifteen teachers from two schools. Teachers were randomly assigned to implement either the MEGA unit or district-developed activities that targeted the same learning goals. Pre- and post-tests were administered, and the data were analyzed using Rasch modeling and hierarchical linear modeling. Here we describe the unit and report on RCT results. Our data showed that, when controlling for pretest score, gender, language, and ethnicity, students in the treatment group performed better on the post-test than the students in the comparison group, indicating the MEGA unit has promise in improving students' understanding. We also discuss a number of challenges that arose when developing and evaluating the unit.
Reviews of Individual Studies 9-12 2
Evaluation of the We the People Program: Student Knowledge (2018)
Reviews of Individual Studies 6-12 2
Evaluation of the James Madison Legacy Project: Cohort 2 Student Knowledge (2018)
Reviews of Individual Studies 2-12 2
Can Restorative Practices Improve School Climate and Curb Suspensions? An Evaluation of the Impact of Restorative Practices in a Mid-Sized Urban School District. Research Report. RR-2840-DOJ. (2018)
Across the country, school districts, their stakeholders, and policymakers have become increasingly concerned about suspensions, particularly about suspending students from elementary school and disproportionately suspending ethnic/racial minority students. Suspended students are less likely to graduate, possibly because they miss the instructional time they need to advance academically. Restorative practices have gained buy-in in the education community as a strategy to reduce suspension rates. Proactively improving relationships among students and staff and building a sense of community in classrooms and schools may make students less inclined to misbehave. And addressing severe misbehavior through a restorative approach may help students realize the impacts of their actions and make them less likely to offend again. This study of the implementation of restorative practices in the Pittsburgh Public Schools district (PPS) in school years 2015-16 and 2016-17 represents one of the first randomized controlled trials of the effects of restorative practices on classroom and school climates and suspension rates. The authors examined a specific restorative practices program -- the International Institute for Restorative Practices' SaferSanerSchools™ Whole-School Change program -- implemented in a selected group of PPS schools under a program called Pursuing Equitable and Restorative Communities, or PERC. The researchers found that PERC achieved several positive effects, including an improvement in overall school climates (as rated by teachers), a reduction in overall suspension rates, and a reduction in the disparities in suspension rates between African American and white students and between low- and higher-income students. Key Findings: Effects of the Pursuing Equitable and Restorative Communities (PERC) program in Pittsburgh Public Schools: (1) Implementation of restorative practices through PERC improved overall school climates, as rated by teachers; (2) Implementation of restorative practices reduced the average suspension rate: During the study period, average suspension rates decreased in both PERC and non-PERC schools, but rates decreased more in PERC schools; (3) Suspension rates of African American students and of those from low-income families also went down in PERC schools, shrinking the disparities in suspension rates between African American and white students and between low- and higher-income students; (4) Academic outcomes did not improve in PERC schools, and actually worsened for grades 6-8; and (5) Arrest rates among PERC schools did not decrease. Recommendations: (1) Given the constraints on teachers' time, emphasize restorative practices that can be woven into the school day; (2) Ensure that school leaders understand and can model restorative practices, including by providing mandatory professional development, books and other materials, and coaching on restorative practices; (3) Establish a mechanism for school staff to meet at least once per month as a professional learning community on restorative practices; (4) Ensure that leaders at the district level can coordinate this work; (5) Set, and update, clear expectations regarding the use of restorative practices; and (6) Implement data collection systems to collect accurate information on all types of behavioral incidents and remedies.
Reviews of Individual Studies 4-11 2
The effects of statewide private school choice on college enrollment and graduation (2017)
Although several studies have documented the effects of statewide private school choice programs on student test scores, this report is the first to examine the effects of one of these programs on college enrollment and graduation. Using data from the Florida Tax Credit (FTC) Scholarship program, we find that low-income Florida students who attended private schools using an FTC scholarship enrolled in and graduated from Florida colleges at a higher rate than their public school counterparts. [Additional support for this study was provided by the Bill and Susan Oberndorf Foundation and Kate and Bill Duhamel.]
Reviews of Individual Studies 6-12 2
Leveraging technology to engage parents at scale: Evidence from a randomized controlled trial. (2017)
Reviews of Individual Studies 7-12 2
Reducing achievement gaps in academic writing for Latinos and English learners in grades 7–12. (2016)
This study reports 2 years of findings from a randomized controlled trial designed to replicate and demonstrate the efficacy of an existing, successful professional development program, the Pathway Project, that uses a cognitive strategies approach to text-based analytical writing. Building on an earlier randomized field trial in a large, urban, low socioeconomic status (SES) district in which 98% of the students were Latino and 88% were mainstreamed English learners (ELs) at the intermediate level of fluency, the project aimed to help secondary school students, specifically Latinos and mainstreamed ELs, in another large, urban, low-SES district to develop the academic writing skills called for in the rigorous Common Core State Standards for English Language Arts. The Pathway Project draws on well-documented instructional frameworks that support approaches that incorporate strategy instruction to enhance students' academic literacy. Ninety-five teachers in 16 secondary schools were stratified by school and grade and then randomly assigned to the Pathway or control group. Pathway teachers participated in 46 hr of training to help students write analytical essays. Difference-in-differences and regression analyses revealed significant effects on student writing outcomes in both years of the intervention (Year 1, d = 0.48; Year 2, d = 0.60). Additionally, Pathway students had higher odds than control students of passing the California High School Exit Exam in both years.
Reviews of Individual Studies 9 2
The Causal Effects of Cultural Relevance: Evidence from an Ethnic Studies Curriculum (CEPA Working Paper No.16-01) (2016)
An extensive theoretical and qualitative literature stresses the promise of instructional practices and content aligned with the cultural experiences of minority students. Ethnic studies courses provide a growing but controversial example of such "culturally relevant pedagogy." However, the empirical evidence on the effectiveness of these courses is limited. In this study, we estimate the causal effects of an ethnic studies curriculum piloted in several San Francisco high schools. We rely on a "fuzzy" regression discontinuity design based on the fact that several schools assigned students with eighth-grade GPAs below a threshold to take the course in ninth grade. Our results indicate that assignment to this course increased ninth-grade student attendance by 21 percentage points, GPA by 1.4 grade points, and credits earned by 23. These surprisingly large effects are consistent with the hypothesis that the course reduced dropout rates and suggest that culturally relevant teaching, when implemented in a supportive, high-fidelity context, can provide effective support to at-risk students.
Reviews of Individual Studies 9-PS 2
Charter schools’ effects on long-term attainment and earnings. (2016)
Since their inception in 1992, the number of charter schools has grown to more than 6,800 nationally, serving nearly three million students. Various studies have examined charter schools' impacts on test scores, and a few have begun to examine longer-term outcomes including graduation and college attendance. This paper is the first to estimate charter schools' effects on earnings in adulthood, alongside effects on educational attainment. Using data from Florida, we first confirm previous research (Booker et al., 2011) that students attending charter high schools are more likely to graduate from high school and enroll in college. We then examine two longer-term outcomes not previously studied in research on charter schools--college persistence and earnings. We find that students attending charter high schools are more likely to persist in college, and that in their mid-20s they experience higher earnings.
Reviews of Individual Studies 9-12 2
Understanding the effect of KIPP as it scales: Volume I, Impacts on achievement and other outcomes. Final report of KIPP’s Investing in Innovation grant evaluation [High School]. (2015)
KIPP (Knowledge is Power Program) is a national network of public charter schools whose stated mission is to help underserved students enroll in and graduate from college. Prior studies (see Tuttle et al. 2013) have consistently found that attending a KIPP middle school positively affects student achievement, but few have addressed longer-term outcomes and no rigorous research exists on impacts of KIPP schools at levels other than middle school. In this first high-quality study to rigorously examine the impacts of the network of KIPP public charter schools at all elementary and secondary grade levels, Mathematica found that KIPP schools have positive impacts on student achievement, particularly at the elementary and middle school levels. In addition, the study found positive impacts on student achievement for new entrants to the KIPP network in high school. For students continuing from a KIPP middle school, KIPP high schools' impacts on student achievement are not statistically significant, on average (in comparison to students who did not have the option to attend a KIPP high school and instead attended a mix of other non-KIPP charter, private, and traditional public high schools). Among these continuing students, KIPP high schools have positive impacts on several aspects of college preparation, including more discussions about college, increased likelihood of applying to college, and more advanced coursetaking. This report provides detailed findings and also includes the following appendices: (1) List of KIPP Schools In Network; (2) Detail on Survey Outcomes; (3) Cumulative Middle and High School Results; (4) Detailed Analytic Methods: Elementary School (Lottery-Based Analyses); (5) Detailed Analytic Methods: Middle School (Lottery-Based Analyses); (6) Understanding the Effects of KIPP As It Scales Mathematica Policy Research; (7) Detailed Analytic Methods: Middle School (Matched-Student Analyses); (8) Detailed Analytic Methods: High School (Matched-Student Analyses); (9) Detailed Analytic Methods: High School (Matched-School Analyses); and (10) Detailed Tables For What Works Clearinghouse Review. [For the executive summary, see ED560080; for the focus brief, see ED560043.]
Reviews of Individual Studies 9-12 2
Measuring the causal effect of National Math + Science Initiative’s College Readiness Program (CRESST Report No. 847). (2015)
Reviews of Individual Studies 9-10 2
Taking stock of the California Linked Learning District Initiative. Sixth-year evaluation report. (2015)
Reviews of Individual Studies 9-12 2
Academic impacts of career and technical schools. (2015)
This study presents findings from three cohorts of students--the classes of 2003, 2004, and 2005, in the School District of Philadelphia--that were admitted to the district's career and technical education (CTE) schools through a randomized lottery process. This study takes advantage of this so-called "'natural experiment' to compare high school academic outcomes for" lottery applicants who were admitted with those for students who did not receive an acceptance. Results find that CTE students had significantly better outcomes in terms of graduation rates, credit accumulation, and the successful completion of the college preparatory mathematics sequence algebra 1, algebra 2, and geometry. Results for other outcomes such as the completion of science and foreign language course sequences, overall grade point average, and mathematics and reading comprehension achievement, were inconsistent across cohorts and statistical tests, neither favoring nor against students accepted to CTE schools.
Reviews of Individual Studies 7-10 2
Impact of the National Writing Project’s College-Ready Writers Program on teachers and students. (2015)
Reviews of Individual Studies 6-12 2
Enhancing secondary school instruction and student achievement: Replication and extension of the My Teaching Partner-Secondary intervention (2015)
My Teaching Partner-Secondary (MTP-S) is a web-mediated coaching intervention, which an initial randomized trial, primarily in middle schools, found to improve teacher-student interactions and student achievement. Given the dearth of validated teacher development interventions showing consistent effects, we sought to both replicate and extend these findings with a modified version of the program in a predominantly high school population, and in a more urban, sociodemographically diverse school district. MTP-S produced substantial gains in student achievement across 86 secondary school classrooms involving 1,194 students. Gains were robust across subject areas and equivalent to moving the average student from the 50th to the 59th percentile in achievement scores. Results suggest that MTP-S can enhance student outcomes across diverse settings and implementation modalities.
Reviews of Individual Studies 3-12 2
The effects of teacher entry portals on student achievement (2014)
The current teacher workforce is younger, less experienced, more likely to turnover, and more diverse in preparation experiences than the workforce of two decades ago. Research shows that inexperienced teachers are less effective, but we know little about the effectiveness of teachers with different types of preparation. In this study, we classify North Carolina public school teachers into "portals"--fixed and mutually exclusive categories that capture teachers' formal preparation and qualifications upon first entering the profession--and estimate the adjusted average test score gains of students taught by teachers from each portal. Compared with undergraduate-prepared teachers from in-state public universities, (a) out-of-state undergraduate-prepared teachers are less effective in elementary grades and high school, (b) alternative entry teachers are less effective in high school, and (c) Teach For America corps members are more effective in STEM subjects and secondary grades.
Reviews of Individual Studies 9-12 2
Exploring variation in the impact of dual-credit coursework on postsecondary outcomes: A quasi-experimental analysis of Texas students. (2014)
Despite the growing popularity of dual-credit courses as a college readiness strategy, numerous reviews of the literature have noted a number of important limitations of the research on the effects of dual-credit on student postsecondary outcomes. This study addressed these gaps in the literature by estimating the impact of dual-credit courses on postsecondary access, first-to-second year persistence, and eventual college attainment, and overcame many of the methodological limitations of previous studies. The study utilized a statewide longitudinal data system (SLDS), allowing us to track an entire cohort of students through their transition into postsecondary statewide. Propensity score matching was used in order to reduce the self-selection bias associated with high achieving students being more likely to take dual-credit courses. We explored how the number of dual-credit courses students complete and the subject of the courses influences their impact. We also compared the effects of dual-credit to alternative advanced courses. Our results suggest that dual-credit is a promising strategy for increasing the likelihood of students accessing, persisting through, and completing a degree in postsecondary, and is possibly even more impactful than advanced coursework. However, significant variation in the benefit of dual-credit exists.
Reviews of Individual Studies K-12 2
Early progress: Interim research on personalized learning. (2014)
Reviews of Individual Studies K-12 2
Preparing principals to raise student achievement: Implementation and effects of the New Leaders Program in ten districts. (2014)
New Leaders is a nonprofit organization with a mission to ensure high academic achievement for all students by developing outstanding school leaders to serve in urban schools. Its premise is that a combination of preparation and improved working conditions for principals, especially greater autonomy, would lead to improved student outcomes. Its approach involves both preparing principals and partnering with school districts and charter management organizations (CMOs) to improve the conditions in which its highly trained principals work. As part of the partnerships, New Leaders agrees to provide carefully selected and trained principals who can be placed in schools that need principals and to provide coaching and other support after those principals are placed. The districts and CMOs agree to establish working conditions that support, rather than hinder, the principals' efforts to improve student outcomes. This report describes how the New Leaders program was implemented in partner districts, and it provides evidence of the effect that New Leaders has on student achievement. [The research in this report was produced within RAND Education. For the appendices that accompany this report, see ED561154. For the research brief, "Principal Preparation Matters: How Leadership Development Affects Student Achievement. Research Brief," see ED561155.]
Reviews of Individual Studies 9-12 2
The impact of dual enrollment on college degree attainment: Do low-SES students benefit? (2013)
Dual enrollment in high school is viewed by many as one mechanism for widening college admission and completion of low-income students. However, little evidence demonstrates that these students discretely benefit from dual enrollment and whether these programs narrow attainment gaps vis-a-vis students from middle-class or affluent family backgrounds. Using the National Longitudinal Study of 1988 ("N"= 8,800), I find significant benefits in boosting rates of college degree attainment for low-income students while holding weaker effects for peers from more affluent backgrounds. These results remain even with analyses from newer data of college freshman of 2004. I conduct sensitivity analyses and find that these results are robust to relatively large unobserved confounders. However, expanding dual enrollment programs would modestly reduce gaps in degree attainment. (Contains 1 note and 4 tables.)
Reviews of Individual Studies 9-12 2
Evaluation of Green Dot’s Locke Transformation Project: Findings for Cohort 1 and 2 students (CRESST Report 815). (2012)
With funding from the Bill and Melinda Gates Foundation, CRESST conducted a multi-year evaluation of a major school reform project at Alain Leroy Locke High School, historically one of California's lowest performing secondary schools. Beginning in 2007, Locke High School transitioned into a set of smaller, Green Dot Charter High Schools, subsequently referred to as Green Dot Locke (GDL) in this report. Based on 9th grade students who entered GDL in 2007 and 2008 respectively, CRESST used a range of student outcomes to monitor progress of the GDL transformation. The CRESST evaluation, employing a strong quasi-experimental design with propensity score matching, found statistically significant, positive effects for the GDL transformation including improved achievement, school persistence, and completion of college preparatory courses. Appended are: (1) Demographic Characteristics and Achievement of the Freshmen at GDL and LAUSD; (2) Cohort Specific Descriptives; and (3) General Descriptives. (Contains 17 figures, 43 tables and 6 footnotes.)
Reviews of Individual Studies 9 2
Springfield-Chicopee School Districts Striving Readers (SR) program final report Years 1–5: Evaluation of implementation and impact. (2012)
This evaluation report presents implementation and impact findings to date regarding the Striving Readers grant as implemented by the Springfield and Chicopee Public School Districts. Any questions regarding this final report should be directed to the Office of Elementary and Secondary Education (OESE) at the U.S. Department of Education. There were 25,213 students enrolled in Springfield and 7,845 in Chicopee in the 2010-11 school year. The districts differed in terms of student demographics as well as in size. In Springfield, 88% to 92% of the students were designated as minority in the participating schools as compared to 25% to 35% in Chicopee. Over three-quarters of the students in Springfield were also eligible for free or reduced lunch (80% to 84%) as compared to approximately one half in Chicopee (44% to 51%). [This report was prepared by the Research & Evaluation Division at the Education Alliance at Brown University.]
Reviews of Individual Studies 9 2
Springfield-Chicopee School District's Striving Readers (SR) program. Final report years 1–5: Evaluation of implementation and impact. (2012)
This evaluation report presents implementation and impact findings to date regarding the Striving Readers grant as implemented by the Springfield and Chicopee Public School Districts. Any questions regarding this final report should be directed to the Office of Elementary and Secondary Education (OESE) at the U.S. Department of Education. There were 25,213 students enrolled in Springfield and 7,845 in Chicopee in the 2010-11 school year. The districts differed in terms of student demographics as well as in size. In Springfield, 88% to 92% of the students were designated as minority in the participating schools as compared to 25% to 35% in Chicopee. Over three-quarters of the students in Springfield were also eligible for free or reduced lunch (80% to 84%) as compared to approximately one half in Chicopee (44% to 51%). [This report was prepared by the Research & Evaluation Division at the Education Alliance at Brown University.]
Reviews of Individual Studies 9-12 2
Making a difference? The effects of Teach For America in high school. (2011)
Teach For America (TFA) selects and places graduates from the most competitive colleges as teachers in the lowest-performing schools in the country. This paper is the first study that examines TFA effects in high school. We use rich longitudinal data from North Carolina and estimate TFA effects through cross-subject student and school fixed effects models. We find that TFA teachers tend to have a positive effect on high school student test scores relative to non-TFA teachers, including those who are certified in field. Such effects offset or exceed the impact of additional years of experience and are particularly strong in science. (Contains 1 figure, 14 tables and 14 footnotes.)
Reviews of Individual Studies 6-12 2
An interaction-based approach to enhancing secondary school instruction and student achievement. (2011)
Improving teaching quality is widely recognized as critical to addressing deficiencies in secondary school education, yet the field has struggled to identify rigorously evaluated teacher-development approaches that can produce reliable gains in student achievement. A randomized controlled trial of My Teaching Partner-Secondary--a Web-mediated approach focused on improving teacher-student interactions in the classroom--examined the efficacy of the approach in improving teacher quality and student achievement with 78 secondary school teachers and 2237 students. The intervention produced substantial gains in measured student achievement in the year following its completion, equivalent to moving the average student from the 50th to the 59th percentile in achievement test scores. Gains appeared to be mediated by changes in teacher-student interaction qualities targeted by the intervention. [For a related What Works Clearinghouse Intervention Report, see ED557783.]
Reviews of Individual Studies 9-12 2
Transforming the high school experience: How New York City’s new small schools are boosting student achievement and graduation rates. (2010)
Over the last decade, New York City has been the site of a systemwide high school reform effort that is unprecedented in its scope and pace. Since 2002, the school district has closed more than 20 failing high schools, opened more than 200 new secondary schools, and implemented a centralized high school admission process in which approximately 80,000 students a year indicate their school preferences from a wide-ranging choice of programs. At the heart of these reforms lie the new schools that in this report are called "small schools of choice" (SSCs)--small, academically nonselective, public high schools that were opened between 2002 and 2008. Serving approximately 100 students per grade in grades 9 through 12 and open to students at all levels of academic achievement, the SSCs in this study were created to serve the district's most disadvantaged and historically underserved students. Prior to the 2002-2003 school year, these students would have had little option but to enroll in one of the city's large, zoned high schools when they made the transition from eighth to ninth grade. Many of the large schools were low-performing, with graduation rates below 50 percent. This report presents encouraging findings from an unusually large and rigorous study, supported by the Bill & Melinda Gates Foundation, of the effects of SSCs on students' academic achievement in high school. SSCs have a substantial positive impact on the transition into high school during ninth grade, according to data using all four cohorts: (1) SSC enrollees were 10.8 percentage points more likely than the students who enrolled in other schools to earn 10 or more credits during their first year--73.1 percent compared with 62.3 percent; (2) SSC enrollees were 7.8 percentage points less likely to fail more than one core subject (39 percent compared with 46.8 percent); (3) Combining these two indicators, 58.5 percent of SSC enrollees were on track to graduate in four years compared with 48.5 percent of their counterparts who attended a different type of school--a 10 percentage point difference; and (4) During the first year of high school, SSC enrollees earn almost one full credit more (0.9 credit) toward graduation than do their control group counterparts. These positive effects on the transition into high school during ninth grade were seen among nearly all subgroups as defined by students' academic proficiency, socioeconomic status, race/ethnicity, and gender. For all students, second- and third-year follow-up data indicate that these effects are sustained and/or increased as they continue through high school. For the "first" cohort of students (the only cohort for whom there are four years of follow-up data), the evidence indicates that SSC improvements in students' academic progress and school engagement during the early years of high school translate into higher rates of on-time graduation after four years: (1) SSCs increase overall graduation rates by 6.8 percentage points, from 61.9 percent for students who attend schools other than SSCs to 68.7 percent for SSC enrollees; (2) A majority of the SSC effect on graduation rates reflects an increase in receipt of New York State Regents diplomas. For this type of diploma, students must pass a series of Regents examinations with a score of 65 points or above and pass all of their required courses; and (3) SSCs increase the proportion of students (by 5.3 percentage points) who passed the English Regents with a score of 75 points or higher, the threshold for exempting incoming students at the City University of New York from remedial courses. They did not have an effect on math Regents exams. (Contains 2 tables and 4 footnotes.) [For the full report, "Transforming the High School Experience: How New York City's New Small Schools Are Boosting Student Achievement and Graduation Rates," see ED511106.]
Reviews of Individual Studies 9 2
Instructional sensitivity of a complex language arts performance assessment. (2007)
Validation of assessments intended to improve instruction and learning should include evidence of instructional sensitivity. This study investigated the instructional sensitivity of a standards-based ninth-grade performance assessment that required students to write an essay about conflict in a literary work. Before administering the assessment, teachers of 886 ninth-grade students were randomly assigned to one of three instructional groups: literary analysis, organization of writing, and teacher-selected instruction. Despite the short duration of instruction (8 class periods), results support the instructional sensitivity of the assessment in two ways: Instruction on literary analysis significantly improved students' ability to analyze and describe conflicts in literature, and instruction on the organization of writing led to significantly higher scores on measures of coherence and organization. (Contains 9 tables. Appended are: (1) Example of Writing Group Lesson; (2) Example of Literary Analysis Group Lesson; (3) The English-Language Arts Grade 9 Performance Assessment Rubric; and (4) CRESST/LAUSD Instructional Sensitivity Study Score Sheet.)
Reviews of Individual Studies 6-12 2
A cognitive strategies approach to reading and writing instruction for English language learners in secondary school. (2007)
This study was conducted by members of a site of the California Writing Project in partnership with a large, urban, low-SES school district where 93% of the students speak English as a second language and 69% are designated Limited English Proficient. Over an eight-year period, a relatively stable group of 55 secondary teachers engaged in ongoing professional development implemented a cognitive strategies approach to reading and writing instruction, making visible for approximately 2000 students per year the thinking tools experienced readers and writers access in the process of meaning construction. The purpose of the study was to assess the impact of this approach on the reading and writing abilities of English language learners (ELLs) in all 13 secondary schools in the district. Students receiving cognitive strategies instruction significantly out-gained peers on holistically scored assessments of academic writing for seven consecutive years. Treatment-group students also performed significantly better than control-group students on GPA, standardized tests, and high-stakes writing assessments. Findings reinforce the importance of having high expectations for ELLs; exposing them to a rigorous language arts curriculum;explicitly teaching, modeling and providing guided practice in a variety of strategies to help students read and write about challenging texts; and involving students as partners in a community of learners. What distinguishes the project is its integrity with respect to its fidelity to three core dimensions: Teachers and students were exposed to an extensive set of cognitive strategies and a wide array of curricular approaches to strategy use (comprehensiveness) in a manner designed to cultivate deep knowledge and application of those strategies in reading and writing (density) over an extended period of time (duration). The consistency of positive outcomes on multiple measures strongly points to the efficacy of using this approach with ELLs. Appended are: (1) Great Expectations Writing Prompt; and (2) Student Models. (Contains 1 note, 5 tables, and 6 figures.)
Reviews of Individual Studies 9 2
Improving student literacy in the Phoenix Union High School District 2003–04 and 2004–05: Final report. (2006)
Reviews of Individual Studies 9-10 2
Improving student literacy in the Phoenix Union High School District 2003–04 and 2004–05: Final report. (2006)
Reviews of Individual Studies 9-12 3
Massachusetts Innovation Pathway & Early College Pathway Program Evaluation (2020)
Reviews of Individual Studies 9-12 3
Effectiveness of "Enhanced Units": A Report of a Randomized Experiment in California and Virginia. Research Report (2019)
Empirical Education Inc. is the independent evaluator of SRI International's 2014 Investing in Innovation (i3) Development grant called Redesigning Secondary Courses to Improve Academic Outcomes for Adolescents with Disabilities and Other Underperforming Adolescents. The goal of the grant is to develop "Enhanced Units" that combine research-based content enhancement routines, collaboration strategy, and technology components for secondary U.S. History and biology classes. This report presents findings of a randomized control trial (RCT) during the 2017-18 school year. The RCT measured the impact of "Enhanced Units" on higher order content skills (as measured through unit tests) in high school biology and U.S. History classes in three districts in Virginia and California. SRI, the Center for Applied Special Education Technology (CAST), and their research and practitioner partners developed "Enhanced Units" (EU) with the goal of integrating research-based content enhancement routines with technological enhancements to improve student content learning and higher order reasoning, especially for students with disabilities or other learning challenges. This study also documents the extent to which the core components of EU were implemented with fidelity. The authors provide descriptive results on classroom practices (as measured by teacher surveys) and contextual factors that support or hinder implementation (as described during teacher interviews). Future improvements to EU should focus on answering the question: "What is/are the best way(s) for teachers to present SIM routines to their students, particularly for students with learning challenges through SIM intervention?"
Reviews of Individual Studies 9-12 3
Impact Evaluation of "UNISON": "U"plifting "N"on-Cognitive Skills and "I"nnovation through "S"tudent "O"pportunity "N"etworks (2019)
"UNISON" was an Investing in Innovation (i3) development grant funded by the Office of Innovation and Improvement, U.S. Department of Education to Take Stock in Children (TSIC), a state-wide, 501(c)(3) non-profit, private-public partnership in Florida. UNISON provided a whole school mentoring approach and focused on developing students' non-cognitive skills with a focus on improving academic success and attainment thereby impacting graduation rates in low-performing schools. Intervention strategies included a whole-school culture program with clubs and activities focused on sustaining the culture of kindness and compassion, BARR teacher training, block meetings, and implementation of the I-Time curricula, TSIC 1:1 mentoring, group mentoring, summer Leadership Institute, and parent engagement. The grant funded a collective impact coordinator for each county and a college success coach in each school. "UNISON" targeted three treatment schools in northeast Florida, and the impact study included 15 comparison schools using a comparative short interrupted time series (CSITS) to measure the effect on graduation rates after three years of intervention strategies. Using the publicly available graduation rate data from the Florida Department of Education website, baseline equivalence was established based on rural/urban county designations and baseline graduation rates from 2014-15 prior to the intervention. The study found a statistically significant positive difference in the one urban and two rural treatment schools compared to the six urban and nine rural "business-as-usual" comparison schools. The treatment schools gained almost 20 percentage points in their graduation rate during the three-year intervention from 72.43% to 91.73%, while comparison schools moved from 72.98% to 83.40%. [The report was written for Take Stock in Children.]
Reviews of Individual Studies 9-12 3
Evaluation of Learning by Making i3 Project: STEM Success for Rural Schools (2018)
The Learning by Making (LbyM) project is funded by the U.S. Department of Education's Investing in Innovation Fund (i3). As a five-year development project (2014-2018), Sonoma State University (SSU), in partnership with high-need schools and districts, has been developing an innovative, integrated high school Science, Technology, Engineering, and Mathematics (STEM) curriculum. The curriculum consists of Disciplinary Core Ideas (DCIs) in earth science and biology as described in the Next Generation Science Standards (NGSS, 2013) and utilizes an easy-to-use Logo programming language that conducts data transfer and network communications in support of student-designed investigations. The purpose of this study is to understand how LbyM is implemented in high school classrooms in rural environments, to observe the influences of this curriculum on student learning and engagement, and to explore how teachers' instructional practices and technological capacities evolve while using the curriculum. The study used a quasi-experimental design. One hundred thirty-seven students were recruited to enroll in eight LbyM STEM classes in six participating high schools. Three of the participating high schools are small schools, and it is not possible to find comparison students from these small schools. Therefore, all comparison students were recruited from the larger schools, with a total of 141 comparison students from six classrooms in three out of six participating high schools. The results from the study indicated that the LbyM curriculum that was developed by SSU helped teachers integrate NGSS and project-based learning into classroom instruction. Teachers reported spending more instructional time supporting students to collect, organize, display, and present data. Students were highly engaged with the LbyM curriculum and demonstrated increased confidence and problem solving stamina. Teachers reported that some students who typically struggle to participate in class exhibited higher levels of participation in LbyM and even demonstrated leadership. They also reported that some students with special needs, while still requiring extra attention, remained engaged with the curriculum and were even quicker to complete certain activities than the other students. The LbyM curriculum was positively associated with significant gains in students' science content knowledge. It helped low-achieving students improve math understanding.
Reviews of Individual Studies 9-12 3
Randomized evaluation of peer support arrangements to support the inclusion of high school students with severe disabilities (2016)
Enhancing the social and learning experiences of students with severe disabilities in inclusive classrooms has been a long-standing focus of research, legislative, and advocacy efforts. The authors used a randomized controlled experimental design to examine the efficacy of peer support arrangements to improve academic and social outcomes for 51 students with severe disabilities in high school general education classrooms. Paraprofessionals or special educators recruited, trained, and supported 106 peers to provide individualized academic and social assistance to students with severe disabilities throughout one semester. Compared to students exclusively receiving adult-delivered support (n = 48), students participating in peer support arrangements experienced increased interactions with peers, increased academic engagement, more progress on individualized social goals, increased social participation, and a greater number of new friendships. Moreover, an appreciable proportion of relationships lasted one and two semesters later after the intervention had concluded. These findings challenge prevailing practices for supporting inclusive education and establish the efficacy and social validity of peer support arrangements as a promising alternative to individually assigned paraprofessional support.
Reviews of Individual Studies 9-12 3
The Quantum Opportunities Program: A randomized control evaluation (2015)
Reviews of Individual Studies 9-12 3
Effects of Multimedia Vocabulary Instruction on Adolescents with Learning Disabilities (2015)
The purpose of this experimental study is to investigate the effects of using content acquisition podcasts (CAPs), an example of instructional technology, to provide vocabulary instruction to adolescents with and without learning disabilities (LD). A total of 279 urban high school students, including 30 with LD in an area related to reading, were randomly assigned to one of four experimental conditions with instruction occurring at individual computer terminals over a 3-week period. Each of the four conditions contained different configurations of multimedia-based instruction and evidence-based vocabulary instruction. Dependent measures of vocabulary knowledge indicated that students with LD who received vocabulary instruction using CAPs through an explicit instructional methodology and the keyword mnemonic strategy significantly outperformed other students with LD who were taught using the same content, but with multimedia instruction that did not adhere to a specific theoretical design framework. Results for general education students mirrored those for students with LD. Students also completed a satisfaction measure following instruction with multimedia and expressed overall agreement that CAPs are useful for learning vocabulary terms.
Reviews of Individual Studies 7-12 3
FLIGHT final evaluation report: Facilitating long-term improvements in graduation and higher education for tomorrow. (2015)
Reviews of Individual Studies 9-11 3
Experimental study of a self-determination intervention for youth in foster care (2013)
Reviews of Individual Studies 9 3
The impact of curriculum-based professional development on science instruction: Results from a cluster-randomized trial. (2011)
This research is part of a larger, IES-funded study titled: "Measuring the Efficacy and Student Achievement of Research-based Instructional Materials in High School Multidisciplinary Science" (Award # R305K060142). The larger study seeks to use a cluster-randomized trial design, with schools as the unit of assignment, to make causal inferences about the effect of treatment on both students and teachers. The research described in this report addresses the following research question associated with path "a" in Figure 1: (1) What is the mean difference in teacher outcome (i.e., instruction) across the treatment groups? (a) What is the effect size (practical significance)? (b) Is the difference statistically significant at the alpha = 0.05 level?; and (2) If practically or statistically significant differences in instruction exist across treatment groups, to what extent can the differences be attributed to the treatment (instructional materials and PD)? The research takes place in both suburban and rural high schools in the state of Washington. In particular, the suburban schools are clustered near Seattle/Tacoma and the rural schools are clustered near Yakima. The data from this analysis suggest that the PD treatment was more effective in fostering reform-oriented science instruction, on average, than was the extant PD experienced by the business-as-usual comparison group. This difference was both statistically and practically significant. Applying this result to the authors' hypothesis of mediation, they now have confidence that one of the causal paths (path a) that are necessary to argue mediation is trustworthy. Further study of path b is necessary to understand whether instruction is serving as a mediator of the treatment effect. That said, there is evidence in the literature suggesting that the possibility of a significant b path is quite real. For example, Hedges and Hedberg (2007) found that in school-level interventions, a considerable amount of the variance in outcomes was attributable to teacher and /or classroom effects. Threats to internal validity that are noteworthy include limitations in the authors' confidence that the post-intervention differences in RTOP scores were not pre-existing (i.e., not attributable to the treatment). Unfortunately, they did not have a baseline RTOP measure that could have served as a covariate in the main effect analysis of treatment. Use of such a covariate would have likely provided a more precise estimate of the treatment effect. Further, because the comparison group received business-as-usual PD, this experience was highly variable across teachers. The research team has only cursory knowledge of the nature and duration of extant PD experienced by the comparison group. As such, there is limited clarity in the PD experiences to which the treatment is being compared. In the context of an efficacy trial, external validity (i.e., generalizability) of findings is not paramount. However, it should be noted again that the authors' sampling approach was not random. Therefore, they are cautious not to suggest that their treatment effect estimates would generalize far beyond their sample of rural and suburban schools in Washington state. (Contains 1 figure and 6 tables.)
Reviews of Individual Studies 9-12 3
Same-Language-Subtitling (SLS): Using subtitled music video for reading growth. (2009)
Reviews of Individual Studies 9-12 3
Cognitive Tutor Algebra I: Evaluation of results (1993–1994). (2008)
Reviews of Individual Studies 6-10 3
Help with English Language Proficiency “HELP” program evaluation of sheltered instruction multimedia lessons. (2005)
Reviews of Individual Studies 4-11 -1
Unconditional Education Year 1 Evaluation Report. (n.d.)
Reviews of Individual Studies 9-12 -1
Report to NETWORK Steering Committee and the USDOE Office of Innovation and Improvement as part of the Investing in Innovation (i3) Grant Program Evaluation: Analysis and Summary (Five Year) (N.D.)
Reviews of Individual Studies 1-12 -1
Multiple choice: Charter school performance in 16 states. (June 2009)
Reviews of Individual Studies 1-12 -1
The effects of the Louisiana Scholarship Program on student achievement and college entrance. (2021)
The Louisiana Scholarship Program (LSP) offers publicly funded vouchers to moderate- and low-income students in low-performing public schools to enroll in participating private schools. Established in 2008 as a pilot program in New Orleans, the LSP expanded statewide in 2012. Drawing upon the random lotteries that placed students in LSP schools, we estimate the causal impact of using an LSP voucher to enroll in a private school on student achievement on the state accountability assessments in math, English Language Arts, and science over a four-year period, as well as on the likelihood of enrolling in college. The results from our primary analytic sample indicate substantial negative achievement impacts, especially in math, that diminish after the first year but persist after four years. In contrast, when considering the likelihood of students entering college, we observe no statistically significant difference between scholarship users and their control counterparts.
Reviews of Individual Studies 7-12 -1
Evaluation Report: Investing in Innovation Pathways to Success (2021)
Reviews of Individual Studies 9 -1
Effects of cross-age peer mentoring program within a randomized controlled trial (2021)
Reviews of Individual Studies 9-PS -1
Optimal college financial aid: Theory and evidence on free college, early commitment, and merit aid from an eight-year randomized trial (EdWorkingPaper: 21-393). (2021)
Reviews of Individual Studies 9-12 -1
What Happens When You Combine High School and College? The Impact of the Early College Model on Postsecondary Performance and Completion (2020)
Early colleges are a new model of schooling in which the high school and college experiences are merged, shortening the total amount of time a student spends in school. This study uses a lottery-based experimental design to examine the impact of the model on longer term outcomes, including attainment of a postsecondary credential and academic performance in 4-year institutions. Results show that a significantly higher proportion of early college students were attaining postsecondary credentials. The results also show that early college students were completing their degrees more rapidly but that their performance in 4-year institutions was still comparable with the control students. [For the corresponding grantee submission, see ED604350.]
Reviews of Individual Studies 7-12 -1
The Pathway to Academic Success: Scaling Up a Text-Based Analytical Writing Intervention for Latinos and English Learners in Secondary School (2020)
This study reports findings from a multisite cluster randomized controlled trial designed to validate and scale up an existing successful professional development program that uses a cognitive strategies approach to text-based analytical writing. The Pathway to Academic Success Project worked with partner districts affiliated with 4 National Writing Project (NWP) sites in southern California. Informed by a wide body of research on the efficacy of strategy instruction to enhance students' academic literacy, the intervention aimed to help secondary school students, particularly Latinos and mainstreamed English learners, to develop the academic writing skills called for in the rigorous Common Core State Standards for English Language Arts. Two hundred thirty teachers from partner districts affiliated with the NWP sites were stratified by school and grade and then randomly assigned to the treatment or control group. Treatment teachers participated in 46 hrs of training and learned how to apply cognitive strategies by using an on-demand writing assessment to help students understand, interpret, and write analytical essays about nonfiction texts. Multilevel models revealed significant effects on a holistic measure of an on-demand writing assessment (d = 0.32) as well as on 4 analytic attributes: content (d = 0.31), structure (d = 0.29), fluency (d = 0.27), and conventions (d = 0.32). Four dimensions of scaling up--spread, reform ownership, depth, and sustainability--are also discussed.
Reviews of Individual Studies 8-9 -1
Impact Study Evaluation of the Rural Math Innovation Network (RMIN) i3 Development Project (2020)
The Rural Math Innovation Network (RMIN) is a 4-year project that launched in January 2017 after receiving a $2.9 million Investing in Innovation (i3) development grant from the U.S. Department of Education (ED) and matching funds from the private sector. Virginia Ed Strategies and rural local education agencies (LEAs) in Virginia are implementing a project using a networked improvement community (NIC) of Pre-Algebra and Algebra 1 teachers to incorporate social-emotional learning (SEL) factors of academic self-efficacy and growth mindset into lesson plans for teaching career readiness math competencies. During Year 1, the project established Memos of Understanding with 18 school divisions in southwest and southside Virginia, which enabled math teachers within these divisions to submit applications to participate in the project. At the end of Year 1, December 2017, the project had a 38-member teacher cohort across 25 schools. By the end of Year 2 (January 1 - December 31, 2018), the cohort included 30 teachers (19 middle school teachers and 11 high school teachers) across 20 schools (12 middle schools and 8 high schools) within 16 participating divisions (several teachers dropped out of the project in Year 2 and a few teachers were added). During Year 3 (January 1 - December 31, 2019), several more teachers dropped out of the project, resulting in 26 teachers (17 middle school and 9 high school) across 18 schools within 15 participating divisions. Sixteen of the 26 teachers are located in the southside region, with the remaining 10 teachers located in the southwest region of Virginia One of the i3 requirements is to have an external evaluation conducted of the project; development grants must include both an implementation study and an impact study. To fulfill this requirement, Virginia Ed Strategies hired ICF to conduct an independent evaluation of the RMIN project throughout the 4-year period. The evaluation includes three components: a formative study to provide ongoing feedback about participants' reactions, learning, behaviors, and results; an implementation study focusing on how well the structural and programmatic aspects of the RMIN project are implemented, as well as facilitating or impeding factors; and an impact study to determine the extent to which the project impacts high-need students' math achievement. Previously in Year 2, the evaluation team recruited 10 comparison teachers across rural Virginia school divisions who were also teaching either Pre-Algebra or Algebra 1 (no school has both a participating and comparison teacher). The purpose of this report is to summarize key findings from the impact study. The primary audience is the RMIN project staff at Virginia Ed Strategies; secondary audiences include ED and other interested stakeholders. Although the impact study was designed originally to include students from the 2018-19 and 2019-20 school years, the COVID-19 pandemic in spring 2020 led to school closings and no administration of the statewide Standards of Learning (SOL) math assessment. Therefore, the impact study is based solely on the one year of SOL data. Findings are presented for the impact data and framed by the evaluation questions. Conclusions are presented below. Impact on student achievement. The one-year program impact on students' SOL scores was estimated and the results did not find evidence that the RMIN program significantly improved students' SOL performance. The program impact from the Pre-Algebra sample was negative, but it was not statistically significant, and the effect size was small. The program impact from the Algebra I analysis was positive but not statistically significant, and the effect size was small.
Reviews of Individual Studies 4-11 -1
The Next Generation of State Reforms to Improve their Lowest Performing Schools: An Evaluation of North Carolina's School Transformation Initiative (2019)
In contrast to prior federally mandated school reforms, the Every Student Succeeds Act (ESSA) allows states more discretion in reforming their lowest performing schools, removes requirements to disrupt the status quo, and does not allocate substantial additional funds. Using a regression discontinuity design, we evaluate a state turnaround initiative aligned with ESSA requirements. We find the effect on student test score growth was not significant in year one and -0.13 in year two. Also in year two, we find that teachers in turnaround schools were 22.5 percentage points more likely to turn over. Teacher turnover appears to have been voluntary rather than the result of strategic staffing decisions.
Reviews of Individual Studies PK-12 -1
Parents at the Center: Final Parent Leadership Institute Evaluation Report (2019)
The Parent Leadership Institute (PLI) of Children's Aid (CA), funded via a 2013 Investing in Innovation (i3) development grant operated between the 2014-15 through 2018-19 school years. Key goals of the PLI included: (1) improving the capacity of parents to effectively engage in the school community in support of their child; and (2) increasing the capacity of school staff to create and support environments which are welcoming to and supportive of the active engagement of parents as key members of the school community. Through implementation of the PLI, CA expanded its partnership with six schools located in the South Bronx community of Morrisania, an area characterized by high levels of poverty, health disparities, and crime, and low levels of academic achievement and attainment among both children and adults. This report serves as the final report on this phase of the PLI and includes an exploration of implementation during year 4 (2016-17 school year) and analyses of quantitative data on student academic performance. [This report was prepared for Children's Aid New York.]
Reviews of Individual Studies K-12 -1
A state-wide quasi-experimental effectiveness study of the scale-up of school-wide Positive Behavioral Interventions and Supports (2019)
The three-tiered Positive Behavioral Interventions and Supports (PBIS) framework promotes the development of systems and data analysis to guide the selection and implementation of evidence based practices across multiple tiers. The current study examined the effects of universal (tier 1) or school-wide PBIS (SW-PBIS) in one state's scale-up of this tier of the framework. Annual propensity score weights were generated to examine the longitudinal effects of SW-PBIS from 2006–07 through 2011–12. School-level archival and administrative data outcomes were examined using panel models with an autoregressive structure. The sample included 1316 elementary, middle, and high schools. Elementary schools trained in SW-PBIS demonstrated statistically significantly lower suspensions during the fourth and fifth study years (i.e., small effect size) and higher reading and math proficiency rates during the first two study years as well as in one and two later years (i.e., small to large effect sizes), respectively. Secondary schools implementing SW-PBIS had statistically significantly lower suspensions and truancy rates during the second study year and higher reading and math proficiency rates during the second and third study years. These findings demonstrate medium effect sizes for all outcomes except suspensions. Given the widespread use of SW-PBIS across nearly 26,000 schools in the U.S., this study has important implications for educational practices and policies.
Reviews of Individual Studies 9-12 -1
Building college and career pathways for high school students: Youth CareerConnect [RCT]. (2019)
Reviews of Individual Studies 9 -1
Writing Instruction and Technology in the Classroom: Supporting Teachers with the Drive to Write Program (2019)
Around the country, high school teachers are being called upon to improve student writing, but they often lack the tools and requisite know-how to make a difference. An ambitious new program called Drive to Write is attempting to change that. This report describes an evaluation of the program's implementation in 11 public high schools in New York City during the 2017-2018 school year. Key findings include: (1) The program rolled out as intended throughout the 2017-2018 school year. Coaches tailored their feedback for teachers and helped them focus on writing instruction by using technology to support workflow and data to guide their approach to individual students. Overall, teachers expressed a high rate of satisfaction with, and adoption of, the tools and support provided by Drive to Write; (2) Teachers customized their use of technology tools and writing instruction to suit the needs of their students and the constraints of their classroom. Nevertheless, practices related to writing and technology use among the 15 program teachers in the 11 Drive to Write schools were similar to those of the 17 teachers in 12 comparison schools. Teachers in program schools, however, exhibited greater understanding of, and proficiency with, higher-level writing instruction; and (3) It is unclear whether the program had a positive effect on student writing after one academic year of implementation. The analytic sample included 1,008 program students and 936 comparison students. Several factors could have dampened early effects, such as comparable writing improvement among all students during ninth-grade, similar technology practices between program and comparison students, or a sample of schools too small to detect modest effects. It could also be that the assessment score outcome may reflect student skill at timed test taking (which all schools address), rather than the intervention's core focus on intensive writing composition (on which program schools spent dedicated time). This evaluation contributes to the growing literature that highlights the support teachers require to integrate new technology and data tools into their instructional routines, the role of individualized coaching for teachers, and the sustainability of data-driven teacher feedback to students. An understanding of these elements can lead to better implementation of writing programs in high schools across the country and, potentially, improved student writing.
Reviews of Individual Studies 9-10 -1
Efficacy of a high school extensive reading intervention for English learners with reading difficulties. (2019)
This study examined the effects of Reading Intervention for Adolescents, a 2-year extensive reading intervention targeting current and former English learners identified as struggling readers based on their performance on the state accountability assessment. Students who enrolled at three participating urban high schools were randomly assigned to the Reading Intervention for Adolescents treatment condition (n = 175) or a business-as-usual comparison condition. Students assigned to the treatment condition participated in the intervention for approximately 50 min daily for 2 school years in lieu of a school-provided elective course, which business-as-usual students took consistent with typical scheduling. Findings revealed significant effects for the treatment condition on sentence-level fluency and comprehension (g = 0.18) and on a proximal measure of vocabulary learning (g = .41), but not on standardized measures of word reading, vocabulary, or reading comprehension (g range: -0.09 to 0.06). Post hoc moderation analyses investigated whether initial proficiency levels interacted with treatment effects. On sentence-level fluency and comprehension and on vocabulary learning, initial scores were significantly associated with treatment effects—however, in opposite directions. Students who scored low at baseline on sentence reading and comprehension scored relatively higher at posttest on that measure, whereas students who scored high at baseline on the proximal vocabulary measure scored relatively higher at posttest on that measure. The discussion focuses on the difficulty of remediating persistent reading difficulties in high school, particularly among English learners, who are often still in the process of acquiring academic proficiency in English.
Reviews of Individual Studies 9 -1
An Efficacy Study of a Ninth-Grade Early Warning Indicator Intervention (2019)
Building on previous research showing how well ninth-grade student behaviors predict on-time high school graduation, this experimental study investigates the impact of a ninth-grade intervention on student attendance and course passing. The study, conducted in 41 geographically and demographically diverse high schools within a single state, evaluates the effects of placing a half-time staff member in high schools to implement the Early Warning Intervention (EWI) Team model designed to monitor ninth-grade early warning indicators and provide timely interventions. Analyses based on the prespecified student outcomes of attendance rate and percentage of ninth-grade course credits earned indicated no statistically significant impact of the intervention. On secondary outcome variables, results indicated that students in treatment schools were significantly less likely than control school students to be chronically absent. The difference between treatment and control school students on dichotomous measures of course failure were not statistically significant. The widespread dissemination of research and best practices related to early warning systems and ninth-grade interventions likely accounted for low levels of contrast between treatment and control school practices and outcomes.
Reviews of Individual Studies 9-12 -1
Transforming Comprehensive High Schools into Early Colleges: The Impacts of the Early College Expansion Partnership (2018)
Reviews of Individual Studies 9-12 -1
Project RISE final report (2018)
Reviews of Individual Studies 3-10 -1
Impact Evaluation of "INSPIRE: Infusing Innovative STEM Practices into Rigorous Education" (2018)
"INSPIRE" is an Investing in Innovation (i3) development grant funded by the Office of Innovation and Improvement, U.S. Department of Education. "INSPIRE" provides an innovative integrated K-12 STEM pipeline approach focused on STEM course content and instructional redesign. The INSPIRE model was implemented in Cabarrus County Schools (CCS), which is among the largest school systems in North Carolina, serving nearly 30,000 students in 39 schools. The impact evaluation included two studies that examined the effect of INSPIRE on mathematics and science achievement as measured by North Carolina standardized End-of-Grades assessments. The elementary study (Study 1) used a three-year, longitudinal, single-cohort quasi-experimental design (QED) to assess the impact of INSPIRE on math achievement at the end of 5th grade after two years of program exposure. The secondary study (Study 2) used an individual-level, longitudinal, randomized controlled trial (RCT) with blocking by school level and cohort to assess the effects of INSPIRE on math and science achievement at the end of 7th and 10th grades after two years of program exposure. For both studies, we compared the outcomes of INSPIRE students with similar students from schools that did not offer a STEM program. For the elementary study, propensity score matching (PSM) was used to match INSPIRE elementary students and comparison student samples at baseline (on pre-test math achievement scores, gender, minority status, and economically disadvantaged status) and baseline equivalence was established all pre-test assessment measures; this study met What Works Clearinghouse (WWC) Group Design Standards with Reservations. For the secondary study, the overall and differential attrition rates were low based on the WWC attrition standards (WWC, 2017); this study met WWC Group Design Standards without Reservations. The results of the elementary study indicated a statistically significant difference between the "INSPIRE" treatment group and the business-as-usual comparison group on the math achievement outcome. Comparison students reported a statistically significant higher increase in math achievement than "INSPIRE" students. Results of the secondary study indicated no statistically significant difference between the "INSPIRE" treatment group and the business-as-usual comparison group on the math and science achievement outcome. The duration of students' exposure to INSPIRE, fidelity of implementation, alignment between PBL instruction and NC standardized assessments, and contextual factors that might have weakened the intervention strength relative to business-as-usual conditions are discussed as possible factors that account for these findings. The report concludes with suggestions for future research and implications for education policy.
Reviews of Individual Studies 6-12 -1
Evaluation of Education Connections: Supporting teachers with standards-based instruction for English learners in mainstream classrooms. Final report. (2018)
Reviews of Individual Studies 8-Not reported -1
2013 Collaborative Regional Education (CORE) i3 study (2018)
Reviews of Individual Studies 8-10 -1
An evaluation of the Positive Action program for youth violence prevention: From schools to summer camps. (2018)
Reviews of Individual Studies 4-Not reported -1
Mentoring Early Career Teachers in Urban Alaska: Impact Findings from the Investing in Innovation (i3) Evaluation of the Alaska Statewide Mentor Project Urban Growth Opportunity (2017)
In 2011, the University of Alaska Fairbanks (UAF) received an Investing in Innovation (i3) Grant through the U.S. Department of Education. UAF applied for the grant to expand the predominantly rural-serving Alaska Statewide Mentor Project (ASMP) to urban settings. ASMP is a professional development initiative that supplies fully released, highly trained mentors to early career teachers (ECTs). UAF's i3 grant, The Urban Growth Opportunity (UGO), included five districts: Anchorage, Fairbanks North Star Borough, Kenai Peninsula Borough, Matanuska-Susitna Borough, and Sitka. This is the final report for the grant conducted over four years (2011 2012 to 2014 2015). The research team randomly assigned 556 ECTs to treatment (UGO) and business as usual (BAU) groups. UGO ECTs received an ASMP mentor for two years; BAU ECTs received their districts' business as usual support that varied by district and included content coaches without mentoring support and non-ASMP instructional mentoring support. Researchers conducted impact, implementation, and intervention studies. The impact study included seven outcomes: teacher retention; teacher instructional practice as measured by the three Classroom Assessment Scoring System (CLASS®) domains (Emotional Support, Classroom Organization, and Instructional Support); and student achievement in reading, writing, and mathematics as measured by the state assessment. While UGO ECTs were retained as teachers in Alaska public schools at higher rates than BAU ECTs, the difference was not statistically significant. There were no statistically significant differences between UGO and BAU ECTs on instructional practices as measured by CLASS®. Finally, student achievement was generally higher for students of UGO ECTs, but differences in achievement were statistically significant only for some student groups: primary reading students and secondary math students who were White, Hispanic, Alaskan Native, or two or more races. Results from the implementation study, conducted over three of the four years of implementation, found ASMP implemented UGO with fidelity across all components: mentor recruitment and assignment, mentor participation in professional development, mentor interaction with their ECTs, and mentors' use of formative assessment tools. Results from the intervention study identified two types of mentor-mentee dyads: Gliders and Sliders, with gliders engaging in longer conversations, focused more explicitly on instruction and students, responding to each other more often, and engaging as peers more frequently than the slider dyads.
Reviews of Individual Studies 4-12 -1
Impact of TNTP’s Teaching Fellows in urban school districts (2017)
Reviews of Individual Studies 9-10 -1
Getting Students on Track for Graduation: Impacts of the Early Warning Intervention and Monitoring System after One Year. REL 2017-272 (2017)
Reviews of Individual Studies 9-10 -1
The struggle to pass algebra: Online vs. face-to-face credit recovery for at-risk urban students. (2017)
Students who fail algebra are significantly less likely to graduate on time, and algebra failure rates are consistently high in urban districts. Identifying effective credit recovery strategies is critical for getting students back on track. Online courses are now widely used for credit recovery, yet there is no rigorous evidence about the relative efficacy of online versus face-to-face credit recovery courses. To address this gap, this study randomly assigned 1,224 ninth graders who failed algebra in 17 Chicago public high schools to take an online or face-to-face algebra credit recovery course. Compared to students in face-to-face credit recovery, students in online credit recovery reported that the course was more difficult, were less likely to recover credit, and scored lower on an algebra posttest. There were no statistically significant differences by condition on any outcomes measured during the second year of high school (standardized mathematics test and algebra subtest scores, likelihood of passing subsequent math classes, cumulative math credits, or on-track rates). The benefits and challenges of online learning for credit recovery are discussed in light of the findings to date.
Reviews of Individual Studies 9-11 -1
Variables and constants: a2i accessing algebra through inquiry (Final report) (2017)
Reviews of Individual Studies 9-12 -1
Effectiveness of Internet-Based Reading Apprenticeship Improving Science Education ("iRAISE"): A Report of a Randomized Experiment in Michigan and Pennsylvania. Research Report (2016)
In 2012, WestEd received a "Development" grant from the U.S. Department of Education's Investing in Innovation (i3) competition to develop and implement Internet-based Reading Apprenticeship Improving Science Education ("iRAISE"). "iRAISE" was implemented in Michigan and Pennsylvania and was provided to over 100 teachers who served approximately 20,000 students during the grant period. This report presents findings from the randomized control trial of "iRAISE," which took place during the 2014-15 school year and investigated the impact of the program on teacher and student outcomes. Data sources for this report include teacher surveys; PD observations and attendance records; school district student records; and an assessment of students' literacy skills. Despite levels of implementation that did not meet the expectations of the program developers, teachers self-reported that they did change their classroom practice as a result of the "iRAISE" program, and impacts of "iRAISE" were greater for students who were performing at lower levels of incoming achievement. Given that "iRAISE" had an impact on teacher practices in literacy instruction and increased benefits for low-achieving students-consistent with positive findings from prior studies, evaluators express confidence in the promise of low-cost, accessible, and high-quality online-only professional Development (PD), addressing the needs of schools struggling to meet the demands of literacy for college and career readiness. Appended are the following: (1) Considerations for Statistical Power; (2) Details of the Approach to Estimating Impacts; (3) Reporting the Results; (4) A Post-Experimental Method to Assessing Impact under Strong Implementation; (5) Fidelity of Implementation; and (6) Teacher Survey Constructs.
Reviews of Individual Studies 9 -1
Helping students make the transition into high school: The effect of ninth grade academies on students' academic and behavioral outcomes (2016)
Ninth Grade Academies (NGAs)--also called Freshman Academies--have attracted national attention as a particularly intensive and promising approach for supporting a successful transition for high school freshmen. An NGA is a self-contained learning community for ninth-graders that operates as a school within a school. NGAs have four core structural components: (1) a designated separate space within the high school, (2) a ninth-grade administrator who oversees the academy, (3) a faculty assigned to teach only ninth-grade students, and (4) teachers organized into interdisciplinary teams that have both students and a planning period in common. The theory of action behind NGAs is that when these components are employed together, they interact to create a more personalized learning environment where ninth-grade students feel less anonymous and more individually supported. This, in turn, should help students succeed in school and stay on track to high school graduation. NGAs have shown promising results when employed as part of a whole-school reform model, but in these cases schools have received external support from a developer to create and sustain them. A growing number of schools and districts have been experimenting with NGAs on their own, but the little research that exists on their effectiveness is limited to anecdotal accounts. This study, which is based on a quasi-experimental research design, examines the effect of NGAs on students' progress toward graduation, their academic achievement, and their behavior in several school districts in Florida. The sample for this study includes 27 high schools that created NGAs between 2001-2002 and 2006-2007, along with 16 comparison high schools that serve ninth-grade students with similar characteristics as students in the NGA schools. As context for understanding the impact findings, this study also looks at the extent to which the key features of the NGA model were implemented in the NGA schools in the study and how this differs from the structures and supports in the comparison schools. The key finding is that the NGAs in this study do not appear to have improved students' academic or behavioral outcomes (credit earning, state test scores, course marks, attendance, suspensions, or expulsions). The findings also suggest that it can be difficult for schools to fully implement the components of the NGA model without expert assistance: Three years after their creation, only half the NGAs in the study had all four structural components of the model in place. Nationally, school districts continue to create NGAs, and recent efforts to implement them have incorporated various enhancements that are intended to strengthen and improve their implementation, but little is known about their effectiveness. Because students' experience in ninth grade is an important predictor of their future success, these efforts to create and improve NGAs should be examined in future studies. Appended are: (1) Technical Information; and (2) Beyond the Sunshine State: Ninth Grade Academies in Other School Districts. ["Helping Students Make the Transition into High School: The Effect of Ninth Grade Academies on Students' Academic and Behavioral Outcomes" was written with Janet Quint.]
Reviews of Individual Studies 6-9 -1
Addressing early warning indicators interim impact findings from the Investing in Innovation (i3) evaluation of Diplomas Now. (2016)
Diplomas Now is a partnership of three national organizations--Talent Development Secondary, City Year, and Communities In Schools--collaborating in an effort to transform urban secondary schools so that fewer students drop out and more graduate ready for postsecondary education and work. With the goal of a continuous system of support through secondary school, the Diplomas Now model seeks to help more students graduate by improving their attendance, behavior, and course performance, particularly in English/language arts and math, during the middle grades and high school. Acting as a representative for the partnership, Johns Hopkins University, home to Talent Development Secondary, was awarded an Investing in Innovation (i3) validation grant by the U.S. Department of Education in 2010 to support the expansion of Diplomas Now from a few schools to more than 30 middle and high schools in more than 10 school districts. The grant funds also support a rigorous random assignment evaluation of the Diplomas Now model, led by MDRC. This report discusses the early impacts of the Diplomas Now model on student and school outcomes at the end of the first and second years of model implementation. It focuses in particular on students during sixth and ninth grades, critical transition years into middle and high school. Accordingly, this report presents the "first-year" impacts of a "multiyear" program. In total, 62 high-needs schools (33 middle schools and 29 high schools) from 11 large urban school districts across the country were recruited to participate in the study starting in either the 2011-2012 or the 2012-2013 school year. Thirty-two of the participating secondary schools were randomly assigned to implement the Diplomas Now model (DN schools), and 30 were assigned to continue with "business as usual" (non-DN schools), either maintaining their existing practices and structures or pursuing other types of school reform. This third report focuses on the early impacts of Diplomas Now on students' attendance, behavior, and course performance measures (the ABC outcomes), separately and in combination, during their first year in middle school or high school over the course of the first two years that the model was implemented in participating schools. Does the implementation of Diplomas Now have an impact on how many students are on a path to high school graduation by the end of their first year of middle school or high school? During that first year, what difference does Diplomas Now make for attendance rates, suspensions and expulsions, and successful course completion? This report also discusses the impact of Diplomas Now on possible precursors to the ABC outcomes, such as the climate of the school, support from parents and the community, and students' attitudes and relationships. Two appendices are included: (1) Samples, Analytic Methods, and Early Outcome Measures; and (2) Supplemental ABC Outcome Findings. [For "Laying Tracks to Graduation: The First Year of Implementing Diplomas Now," see ED546638. For "Moving down the Track: Changing School Practices during the Second Year of Diplomas Now," see ED558491.]
Reviews of Individual Studies 9 -1
Evaluation of the Rural Math Excel Partnership Project Final Report (2016)
The Virginia Advanced Study Strategies, Inc. (VASS) created the Rural Math Excel Partnership (RMEP) Project to develop a rural workforce qualified for science, technology, engineering, and math (STEM) jobs in their local communities. The RMEP Project is funded by an Investing in Innovation (I3) development grant from the U.S. Department of Education and was implemented from 2013 to 2015. The RMEP Project included 14 schools across six rural Virginia Local Education Agencies (LEAs) in five counties. The goal of the RMEP Project was to develop and implement a model of shared responsibility among families, teachers, and communities in rural areas to prepare students to be successful in advanced high school and postsecondary STEM studies. The long-term outcome was for students to leave school ready, at a minimum, to enroll in a certificate program for a technician-level career in STEM-related fields. The RMEP Project had six core implementation activities: (1) a gap analysis and development of a Math Advanced Study (MAS) guide, (2) professional development (PD) and ongoing coaching for participating teachers, (3) a Family Math Night (FMN), conducted by teachers (4) a project website and social media presence, (5) community-based STEM events, and (6) access to technology for students.
Reviews of Individual Studies 9-12 -1
Science, Technology, Engineering, and Math Education for the 21st Century (STEM21) high school impact evaluation: Final evidence report. (2015, December)
Reviews of Individual Studies 9-12 -1
Online resources for mathematics: Do they affect student learning? (2015)
Reviews of Individual Studies 9-12 -1
The Impact of the Reading Apprenticeship Improving Secondary Education (RAISE) Project on Academic Literacy in High School: A Report of a Randomized Experiment in Pennsylvania and California Schools. Research Report (2015)
The Reading Apprenticeship instructional framework was developed by WestEd's Strategic Literacy Initiative (SLI) two decades ago to help teachers provide the literacy support students need to be successful readers in the content areas. It has since reached over 100,000 teachers in schools across the country, at the middle school, high school, and college levels. The Reading Apprenticeship framework focuses on four interacting dimensions of classroom learning culture: Social, Personal, Cognitive, and Knowledge-Building. These four dimensions are woven into subject-area teaching through metacognitive conversation--conversations about the thinking processes students and teachers engage in as they read. The context in which this all takes place is extensive reading--increased in-class opportunities for students to practice reading complex academic texts in more skillful ways. Teachers also work with students on explicit comprehension strategy instruction, vocabulary and academic language development techniques, text-based discussion, and writing. Reading Apprenticeship is designed to help teachers create classroom cultures in which students feel safe to share reading processes, problems, and solutions. In 2010, WestEd received a "Validation" grant from the Department of Education's Investing in Innovation Fund (i3) competition to scale-up and conduct a randomized controlled trial of the intervention through a project called Reading Apprenticeship Improving Secondary Success (RAISE). RAISE took place in California, Michigan, Utah, Pennsylvania, and Indiana and worked with nearly 2,000 teachers who served approximately 630,000 students during the grant period. This report presents findings from the randomized controlled trial conducted in two of those states: California and Pennsylvania. The report presents key implementation and impact findings from the i3 impact evaluation of the RAISE project. Most of the findings in this report are from the sample of students and data collected during teachers' second year in the study, after treatment teachers had received the full "dose" of professional development delivered over 12 months and could therefore be expected to fully implement Reading Apprenticeship. Data sources for this report include principal, teacher, and student surveys; professional development observations and attendance records; school district student records; and an assessment of students' literacy skills. Overall, the study's findings demonstrate the potential of RAISE to address the paucity of content-specific reading instruction in U.S. secondary schools--especially in science, where the need may be greatest. Appended are the following: (1) Impact Estimation Model; (2) Student Survey Constructs; (3) Teacher Survey Constructs; (4) Analytic Sample Baseline Equivalence; (5) Student Literacy Assessment; (6) Sample Attrition; (7) Additional Impact Analyses for Teacher Mediating Outcomes; (8) Additional Impact Analyses for Student Mediating Outcomes; (9) Additional Impact Analyses for Student Literacy; (10) Fidelity of Implementation Summary; and (11) Context for Program Implementation.
Reviews of Individual Studies K-12 -1
Exploring the causal impact of the McREL Balanced Leadership Program on leadership, principal efficacy, instructional climate, educator turnover, and student achievement. (2015)
This study uses a randomized design to assess the impact of the Balanced Leadership program on principal leadership, instructional climate, principal efficacy, staff turnover, and student achievement in a sample of rural northern Michigan schools. Participating principals report feeling more efficacious, using more effective leadership practices, and having a better instructional climate than control group principals. However, teacher reports indicate that the instructional climate of the schools did not change. Furthermore, we find no impact of the program on student achievement. There was an impact of the program on staff turnover, with principals and teachers in treatment schools significantly more likely to remain in the same school over the 3 years of the study than staff in control schools.
Reviews of Individual Studies 9 -1
Intensive math instruction and educational attainment long-run impacts of double-dose algebra. (2015)
Reviews of Individual Studies 9-10 -1
Thinking, fast and slow? Some field experiments to reduce crime and dropout in Chicago. (2015)
We present the results of three large-scale randomized controlled trials (RCTs) carried out in Chicago, testing interventions to reduce crime and dropout by changing the decision-making of economically disadvantaged youth. We study a program called Becoming a Man (BAM), developed by the non-profit Youth Guidance, in two RCTs implemented in 2009-10 and 2013-15. In the two studies participation in the program reduced total arrests during the intervention period by 28-35%, reduced violent-crime arrests by 45-50%, improved school engagement, and in the first study where we have follow-up data, increased graduation rates by 12-19%. The third RCT tested a program with partially overlapping components carried out in the Cook County Juvenile Temporary Detention Center (JTDC), which reduced readmission rates to the facility by 21%. These large behavioral responses combined with modest program costs imply benefit-cost ratios for these interventions from 5-to-1 up to 30-to-1 or more. Our data on mechanisms are not ideal, but we find no positive evidence that these effects are due to changes in emotional intelligence or social skills, self-control or "grit," or a generic mentoring effect. We find suggestive support for the hypothesis that the programs work by helping youth slow down and reflect on whether their automatic thoughts and behaviors are well suited to the situation they are in, or whether the situation could be construed differently. [A full list of sponsors of this project can be found on the NBER web site: http://www.nber.org/papers/w21178.ack.]
Reviews of Individual Studies 9 -1
A report on the effects of the Pearson Literature Program on student language arts skills. (2015)
Reviews of Individual Studies 7-12 -1
Year 2 Findings for APTIP impacts on students’ AP performance in cohorts 1 and 2 schools. (2015)
Reviews of Individual Studies 6-12 -1
Case management for students at risk of dropping out: Implementation and interim impact findings from the Communities in Schools evaluation. (2015)
Too many students drop out and never earn their high school diploma. For students at risk of dropping out, academic, social, and other supports may help. "Communities In Schools" seeks to organize and provide these supports to at-risk students in the nation's poorest-performing schools, including through "case-managed" services. This report, the first of two from a random assignment evaluation of "Communities In Schools" case management, focuses primarily on the implementation of case management in 28 secondary schools during the 2012-2013 school year. The report also includes interim one-year findings about case management's impact on student outcomes. The report concludes with suggestions for improvement for "Communities In Schools" based mainly on the implementation findings. The next report will present two-year impact findings and more about the implementation of case management in the 2013-2014 school year. Appended to the report are: (1) Statistical Model and Statistical Power; and (2) Sample and Response Analysis.
Reviews of Individual Studies 3-11 -1
The Data-Driven School Transformation Partnership: A project of the Bay State Reading Institute (BSRI) and 17 Massachusetts elementary schools. (2015)
Reviews of Individual Studies 4-10 -1
Final impact analysis report WriteUp! (Dev12-13). (2015)
Reviews of Individual Studies 9 -1
A peer-led high school transition program increases graduation rates among Latino males. (2014)
The authors investigated the impact of a manualized high school transition program, the Peer Group Connection (PGC) program, on the graduation rate at a low-income, Mid-Atlantic high school. The program utilized 12th-grade student peer leaders to create a supportive environment for incoming ninth-grade students. Results of a randomized control trial demonstrated that male students who participated in the program during Grade 9 were significantly more likely to graduate from high school within 4 years than male students in the control group (81% vs. 63%). Findings suggest that peers can be effective in delivering a school-based, social emotional learning intervention and that it is possible to intervene in Grade 9 to influence the probability of high school graduation.
Reviews of Individual Studies 8-12 -1
Effectiveness of Cognitive Tutor Algebra I at scale (high school experiment). (2014)
This article examines the effectiveness of a technology-based algebra curriculum in a wide variety of middle schools and high schools in seven states. Participating schools were matched into similar pairs and randomly assigned to either continue with the current algebra curriculum for 2 years or to adopt Cognitive Tutor Algebra I (CTAI), which uses a personalized, mastery-learning, blended-learning approach. Schools assigned to implement CTAI did so under conditions similar to schools that independently adopt it. Analysis of posttest outcomes on an algebra proficiency exam finds no effects in the first year of implementation, but finds evidence in support of positive effects in the second year. The estimated effect is statistically significant for high schools but not for middle schools; in both cases, the magnitude is sufficient to improve the median student's performance by approximately eight percentile points.
Reviews of Individual Studies 9-10 -1
Blended learning report [Study 1]. (2014)
Reviews of Individual Studies 9 -1
The far-reaching effects of believing people can change: Implicit theories of personality shape stress, health, and achievement during adolescence. (2014)
Reviews of Individual Studies 9-12 -1
Addendum to effectiveness of Cognitive Tutor Algebra I at scale (Working Paper WR-1050-DEIES) (high school experiment). (2014)
This addendum to previously published results presents alternative analyses of data from large-scale effectiveness studies of Cognitive Tutor Algebra I in middle schools and high schools. These alternative analyses produce results that are substantively the same as previously reported. We find a significant positive effect of 0.21 standard deviation units for high school students in the second year of the study. An appendix containing additional tables is included. [See the study: "Effectiveness of Cognitive Tutor Algebra I at Scale," "Educational Evaluation and Policy Analysis," v36 n2 p127-144 Jun 2014 at EJ1024233.]
Reviews of Individual Studies 9-12 -1
The impact of Early College High Schools on college readiness and college enrollment. (2013, May)
Reviews of Individual Studies K-12 -1
The system for teacher and student advancement: An evaluation of achievement and engagement in Louisiana. (2013)
Reviews of Individual Studies PK-12 -1
Findings from a two-year examination of teacher engagement in TAP schools across Louisiana. (2013)
Reviews of Individual Studies 9-12 -1
Effectiveness of Cognitive Tutor Algebra I at scale [High school] (2013)
Reviews of Individual Studies 9 -1
The effect of READ 180 on the reading achievement of struggling readers in a large, public, urban high school in northern New Jersey (Doctoral dissertation). (2013)
This action research study examined the effect of Read 180, a research-based reading intervention program, on the reading achievement among struggling readers in Grades 9-11 as measured by reading clusters on the Language Arts Literacy portion of the High School Proficiency Assessment, final English grades, and Lexile scores. Struggling readers entering high school often fail to meet stringent literacy demands because they lack mastery of the five main components of effective reading. Although many reading intervention programs exist at the elementary level, few are available in high schools; however, increased pressure for improved student performance on state assessments has caused school districts to explore various programs at the high school level. This study contributes to the literature on such programs by investigating the effects of Read 180 on students' reading achievement. The final grades and assessment scores of three cohorts of ninth-grade students (2007-2008, 2008-2009, and 2009-2010; N = 134) were examined in a matched-pair design, matching students in Read 180 (treatment group) with students in the traditional English 9 course (control group). The scores of the Language Arts Literacy portion of the eighth-grade state assessment determined students' placement. Analyses of variance indicated Read 180 participants significantly outperformed nonparticipants on final English 9 grades. Additionally, a t test indicated Read 180 participants from the 2009-2010 cohort significantly increased their reading achievement according to Lexile scores. Significant results occurred during the school year students participated in Read 180. No other statistically significant differences on the reading achievement between the two groups were evident after students exited Read 180. [The dissertation citations contained here are published with the permission of ProQuest LLC. Further reproduction is prohibited without permission. Copies of dissertations may be obtained by Telephone (800) 1-800-521-0600. Web page: http://www.proquest.com/en-US/products/dissertations/individuals.shtml.]
Reviews of Individual Studies 7-10 -1
Preventing youth violence and dropout: A randomized field experiment. (2013)
Improving the long-term life outcomes of disadvantaged youth remains a top policy priority in the United States, although identifying successful interventions for adolescents--particularly males--has proven challenging. This paper reports results from a large randomized controlled trial of an intervention for disadvantaged male youth grades 7-10 from high-crime Chicago neighborhoods. The intervention was delivered by two local non-profits and included regular interactions with a pro-social adult, after-school programming, and--perhaps the most novel ingredient--in-school programming designed to reduce common judgment and decision-making problems related to automatic behavior and biased beliefs, or what psychologists call cognitive behavioral therapy (CBT). We randomly assigned 2,740 youth to programming or to a control group; about half those offered programming participated, with the average participant attending 13 sessions. Program participation reduced violent-crime arrests during the program year by 8.1 per 100 youth (a 44 percent reduction). It also generated sustained gains in schooling outcomes equal to 0.14 standard deviations during the program year and 0.19 standard deviations during the follow-up year, which we estimate could lead to higher graduation rates of 3-10 percentage points (7-22 percent). Depending on how one monetizes the social costs of crime, the benefit-cost ratio may be as high as 30:1 from reductions in criminal activity alone. [A full list of sponsors of this project can be found on NBER's web site: http://www.nber.org/papers/w19014.ack.]
Reviews of Individual Studies 7-12 -1
Charter-school management organizations: Diverse strategies and diverse student impacts. (2012)
Charter schools--public schools of choice that are operated autonomously, outside the direct control of local school districts--have become more prevalent over the past two decades. There is no consensus about whether, on average, charter schools are doing better or worse than conventional public schools at promoting the achievement of their students. Nonetheless, one research finding is clear: Effects vary widely among different charter schools. Many educators, policymakers, and funders are interested in ways to identify and replicate successful charter schools and help other public schools adopt effective charter school practices. Charter-school management organizations (CMOs), which establish and operate multiple charter schools, represent one prominent attempt to bring high performance to scale. The National Study of CMO Effectiveness aims to fill the gap in systematic evidence about CMOs, providing the first rigorous nationwide examination of CMOs' effects on students' achievement and attainment. The study includes an examination of the relationships between the practices of individual CMOs and their effects on student achievement, with the aim of providing useful guidance to the field. This updated edition of the report provides key findings from the study on CMO practices, impacts, and the relationships between them. A forthcoming report will explore promising practices in greater depth. This study uses multiple data sources to describe CMOs, assess their impacts on students, and identify practices associated with positive impacts in order to address the following research questions: (1) How quickly are CMOs growing? Which students and areas do they serve and what resources do they use? What are the practices and structures of CMOs? What state policies and other factors appear to influence the location and growth of CMOs?; (2) What are the impacts of CMOs on student outcomes and to what extent do these impacts vary across CMOs?; and (3) Which CMO practices and structures are positively associated with impacts? To examine eligible CMOs and address the research questions, the authors conducted a survey of CMO central office staff, surveys of CMO principals and principals in nearby conventional public schools, a survey of CMO teachers, and site visits to 10 CMOs and 20 schools. In addition, they collected and analyzed school records with data on student characteristics and outcomes (including test scores), and they examined CMO financial records and business plans. Findings include: (1) Comprehensive behavior policies are positively associated with student impacts; (2) Intensive teacher coaching is positively associated with student impacts; (3) CMOs using TFA and teaching fellow teachers have higher impacts, but other staffing decisions are not associated with impacts; (4) CMOs categorized as "data-driven" and "time on task" have larger impacts, on average, than two other categories of CMOs; and (5) Tightness of CMO management is weakly associated with impacts. As is often the case in studies of this kind, some of the interesting findings raise other important questions. The following questions are discussed in this report: (1) To what extent do CMOs produce positive effects on longer term student outcomes?; (2) What explains why some CMOs have negative impacts on test scores?; (3) Which promising strategies should CMOs implement and how should they implement them?; (5) To what extent do CMOs add value compared to independent charter schools?; (6) Are new CMOs using the same strategies and producing the same impacts as more established CMOs?; and (7) What other factors might contribute to CMO impacts? Appended are: (1) Construction and Analysis of Measures Used in Chapter III; (2) Experimental Impacts; (3) Validation of Impact Estimation Approach; (4) Methodology for Estimating CMO and School- Level Impacts on Achievement in Middle- Schools; (5) Baseline Equivalence; (6) Method for Dealing with Grade Repetition; (7) Methodology and Results for CMO Impacts on High School Achievement and Attainment; (8) Impacts on Middle School Test Scores by CMO, Year, and Subject; (9) Comparing CMO and Independent Charter Impacts; (10) Subgroup Impacts; (11) Multiple Comparison Adjustments for Impact Analyses; (12) Methods for Correlating Impacts and CMO Characteristics; and (13) Correlational Analysis Results. Individual chapters contain footnotes. (Contains 56 tables and 49 figures.) [This document was commissioned by NewSchools Venture Fund and written with assistance from Michael Barna, Emily Caffery, Hanley Chiang, John Deke, Melissa Dugger, Emma Ernst, Alena Davidoff-Gore, Eric Grau, Thomas Decker, Mason DeCamillis, Philip Gleason, Amanda Hakanson, Jane Nelson, Antoniya Owens, Julie Redline, Davin Reed, Chris Rodger, Margaret Sullivan, Christina Tuttle, Justin Vigeant, Tiffany Waits, and Clare Wolfendale. For an earlier edition of this report, "The National Study of Charter Management Organization (CMO) Effectiveness. Charter-School Management Organizations: Diverse Strategies and Diverse Student Impacts," see ED526951.]
Reviews of Individual Studies 6-12 -1
Enhancing the interpretative reading and analytical writing of mainstreamed English learners in secondary school: Results from a randomized field trial using a cognitive strategies approach. (2012)
In this study, 72 secondary English teachers from the Santa Ana Unified School District were randomly assigned to participate in the Pathway Project, a cognitive strategies approach to teaching interpretive reading and analytical writing, or to a control condition involving typical district training focusing on teaching content from the textbook. Pathway teachers learned how to use an on-demand writing assessment to help mainstreamed English learners understand, interpret, and write analytical essays. In Year 2, treatment effects were replicated on an on-demand writing assessment (d = 0.67) and showed evidence of transfer to improved performance on a standardized writing test (d = 0.10). The results underscore the efficacy of a cognitive strategies reading/writing intervention for mainstreamed English learners (ELs) in the secondary grades. (Contains 1 note, 4 tables, and 3 figures.)
Reviews of Individual Studies 6-10 -1
A randomized controlled trial of the impact of the Fusion Reading intervention on reading achievement and motivation for adolescent struggling readers. (2012)
This study estimates the effect of one year of Fusion Reading implementation, a multistrategy intervention, builds on the work of the Strategic Instruction Model's Learning Strategies Curriculum and Xtreme Reading by integrating some of the same strategies (e.g., paraphrasing, visual imagery, and self-questioning for information acquisition; mnemonics for information study; and writing and error monitoring for information expression), focusing on reading, and extending the time frame from 1 to 2 years in duration. Specifically, the study addressed the following: (1) What are the intent-to-treat impacts of the Fusion Reading intervention on the reading outcomes and motivation to read of struggling readers after receipt of 1 year of the intervention?; (2) For which students are the interventions most and least effective?; and (3) In what ways are implementation factors associated with impacts (or lack of impacts) on reading and motivation outcomes? The authors conducted a randomized controlled trial to estimate the effect of Fusion Reading on struggling readers in grades 6 through 10. Students in the intervention condition received the Fusion Reading intervention as a supplemental reading intervention in the 2010-11 school year, whereas students in the control condition engaged in nonliteracy, "business-as-usual" activities. After one year of implementation of a two year intervention, the authors learned that when vocabulary, paraphrasing and word study strategies are explicitly taught by following a specific instructional routine supported by motivation strategies (e.g., setting goals and reading text relevant for the age group), word reading outcomes will significantly improve compared to control middle and high school students. Future research is needed to fully understand whether the intended two year intervention will improve struggling adolescent's reading comprehension outcomes. Appended are: (1) References; and (2) Tables and Figures. (Contains 2 figures and 5 tables.)
Reviews of Individual Studies 6-10 -1
The effects of synchronous online cognitive strategy instruction in writing for students with learning disabilities (Doctoral dissertation) (2012)
Reviews of Individual Studies 9 -1
Year one evaluation report/impact study: Illinois Striving Readers (2012)
The Illinois Striving Readers (ISR) Project had two purposes: (1) implement a supplemental reading intervention for students in ninth grade who were reading below grade level; and (2) study the impact of the intervention on students' performance on standardized assessments using a randomized control trial design. The Illinois Striving Readers (ISR) project focused on ninth grade students who scored at the bottom two quartiles on the state assessment (grade 8 EXPLORE®). A total of 855 students participated in the project. Of these, 427 students were randomly assigned to the treatment group, with 428 students going to the control group. This report presents findings from the first year of implementation of the Illinois Striving Readers. The report is divided into three parts: (1) describes the intervention as proposed by the developers and the project's logic model; (2) discusses findings from the first implementation year; and (3) presents the analysis of the intervention's impact on student academic performance, as measured by standardized assessments.
Reviews of Individual Studies 9 -1
Year One evaluation report/impact study: Illinois Striving Readers. (2012)
The Illinois Striving Readers (ISR) Project had two purposes: (1) implement a supplemental reading intervention for students in ninth grade who were reading below grade level; and (2) study the impact of the intervention on students' performance on standardized assessments using a randomized control trial design. The Illinois Striving Readers (ISR) project focused on ninth grade students who scored at the bottom two quartiles on the state assessment (grade 8 EXPLORE®). A total of 855 students participated in the project. Of these, 427 students were randomly assigned to the treatment group, with 428 students going to the control group. This report presents findings from the first year of implementation of the Illinois Striving Readers. The report is divided into three parts: (1) describes the intervention as proposed by the developers and the project's logic model; (2) discusses findings from the first implementation year; and (3) presents the analysis of the intervention's impact on student academic performance, as measured by standardized assessments.
Reviews of Individual Studies 9-12 -1
Longer-term impacts of mentoring, educational services, and learning incentives: Evidence from a randomized trial in the United States. (2012)
Reviews of Individual Studies 9 -1
The impact of curriculum-based professional development on science instruction: Results from a cluster-randomized trial. (2011, March)
This research is part of a larger, IES-funded study titled: "Measuring the Efficacy and Student Achievement of Research-based Instructional Materials in High School Multidisciplinary Science" (Award # R305K060142). The larger study seeks to use a cluster-randomized trial design, with schools as the unit of assignment, to make causal inferences about the effect of treatment on both students and teachers. The research described in this report addresses the following research question associated with path "a" in Figure 1: (1) What is the mean difference in teacher outcome (i.e., instruction) across the treatment groups? (a) What is the effect size (practical significance)? (b) Is the difference statistically significant at the alpha = 0.05 level?; and (2) If practically or statistically significant differences in instruction exist across treatment groups, to what extent can the differences be attributed to the treatment (instructional materials and PD)? The research takes place in both suburban and rural high schools in the state of Washington. In particular, the suburban schools are clustered near Seattle/Tacoma and the rural schools are clustered near Yakima. The data from this analysis suggest that the PD treatment was more effective in fostering reform-oriented science instruction, on average, than was the extant PD experienced by the business-as-usual comparison group. This difference was both statistically and practically significant. Applying this result to the authors' hypothesis of mediation, they now have confidence that one of the causal paths (path a) that are necessary to argue mediation is trustworthy. Further study of path b is necessary to understand whether instruction is serving as a mediator of the treatment effect. That said, there is evidence in the literature suggesting that the possibility of a significant b path is quite real. For example, Hedges and Hedberg (2007) found that in school-level interventions, a considerable amount of the variance in outcomes was attributable to teacher and /or classroom effects. Threats to internal validity that are noteworthy include limitations in the authors' confidence that the post-intervention differences in RTOP scores were not pre-existing (i.e., not attributable to the treatment). Unfortunately, they did not have a baseline RTOP measure that could have served as a covariate in the main effect analysis of treatment. Use of such a covariate would have likely provided a more precise estimate of the treatment effect. Further, because the comparison group received business-as-usual PD, this experience was highly variable across teachers. The research team has only cursory knowledge of the nature and duration of extant PD experienced by the comparison group. As such, there is limited clarity in the PD experiences to which the treatment is being compared. In the context of an efficacy trial, external validity (i.e., generalizability) of findings is not paramount. However, it should be noted again that the authors' sampling approach was not random. Therefore, they are cautious not to suggest that their treatment effect estimates would generalize far beyond their sample of rural and suburban schools in Washington state. (Contains 1 figure and 6 tables.)
Reviews of Individual Studies K-12 -1
Teacher incentives and student achievement: Evidence from New York City Public Schools (NBER Working Paper No. 16850). (2011)
Financial incentives for teachers to increase student performance is an increasingly popular education policy around the world. This paper describes a school-based randomized trial in over two-hundred New York City public schools designed to better understand the impact of teacher incentives on student achievement. I find no evidence that teacher incentives increase student performance, attendance, or graduation, nor do I find any evidence that the incentives change student or teacher behavior. If anything, teacher incentives may decrease student achievement, especially in larger schools. The paper concludes with a speculative discussion of theories that may explain these stark results.
Reviews of Individual Studies K-12 -1
A big apple for educators: New York City’s experiment with schoolwide performance bonuses. (2011)
In the 2007-2008 school year, the New York City Department of Education and the United Federation of Teachers jointly implemented the Schoolwide Performance Bonus Program in a random sample of the city's high-needs public schools. The program lasted for three school years, and its broad objective was to improve student performance through school-based financial incentives. The question, of course, was whether it was doing so. To examine its implementation and effects, the department tasked a RAND Corporation-led partnership with the National Center on Performance Incentives at Vanderbilt University to conduct a two-year study of the program that would offer an independent assessment. This report describes the results of our analyses for all three years of the program, from 2007-2008 through 2009-2010. This work built on past research and was guided by a theory of action articulated by program leaders. Researchers examined student test scores; teacher, school staff, and administrator surveys; and interviews with administrators, staff members, program sponsors, and union and district officials. The researchers found that the program did not, by itself, improve student achievement, perhaps in part because conditions needed to motivate staff were not achieved (e.g., understanding, buy-in for the bonus criteria) and because of the high level of accountability pressure all the schools already faced. Individual chapters contain footnotes. (Contains 12 figures and 66 tables.) [Additional funding for this paper was provided by the New York City Fund for Public Schools. For "What New York City's Experiment with Schoolwide Performance Bonuses Tells Us about Pay for Performance. Research Brief," see ED521918.]
Reviews of Individual Studies 6-11 -1
Better schools, less crime? (2011)
Reviews of Individual Studies 3-11 -1
Teacher preparation programs and Teach for America research study. (2011)
Reviews of Individual Studies 4-9 -1
Charter school performance in Indiana. (2011)
Reviews of Individual Studies 7-10 -1
Portland Public Schools' Striving Readers Program: Year 5 Evaluation Report (2011)
Portland Public Schools (PPS), the largest school district in Oregon, serves more than 46,000 students in regular and special programs. More than 2,900 classroom teachers address the needs of a diverse student population (44% minority, 46% low income, 14% special education, 9% English language learners). A district needs assessment in fall 2005 revealed that 13 of Portland's 85 regular schools were eligible to participate in the Striving Readers program. Four of the high schools and 5 of the middle schools determined that they could meet the program's research requirements. All 9 schools had at each grade level a significant number of students who were at least 2 years behind in reading achievement; all received Title I funding; and none had achieved Adequate Yearly Progress under No Child Left Behind at the time of the Striving Readers application. School leaders expected the Striving Readers program to impact more than 6,400 students and 450 teachers in the 9 participating schools. After examining adolescent reading programs and studying the research on adolescent literacy, Portland Public Schools selected the Strategic Instruction Model Content Literacy Continuum developed by the University of Kansas' Center for Research on Learning to improve teacher instruction and student reading achievement in the participating middle and high schools. This report summarizes Year 1 (2006-2007), Year 2 (2007-2008), Year 3 (2008-2009), Year 4 (2009-2010), and Year 5 (2010-2011) of implementation of the targeted intervention for students reading at least 2 years below grade level in Grades 7-10 and the whole school intervention designed to help all students in Grades 6-12 learn the critical content in all curricular areas.
Reviews of Individual Studies 6-9 -1
Striving Readers final evaluation report: Danville, Kentucky. (2011)
Reviews of Individual Studies 7-12 -1
Implementation and impact of the targeted and whole school interventions, summary of Year 4 (2009-2010): San Diego United School District, California. (2011)
Reviews of Individual Studies 8-12 -1
Striving Readers Year 5 project evaluation report: Ohio—An addendum to the Year 4 report. (2011)
Reviews of Individual Studies 9 -1
The acquisition of problem- solving skills in mathematics: How animations can aid understanding of structural problem features and solution procedures. (2010, September)
In this paper the augmentation of worked examples with animations for teaching problem-solving skills in mathematics is advocated as an effective instructional method. First, in a cognitive task analysis different knowledge prerequisites are identified for solving mathematical word problems. Second, it is argued that so called hybrid animations would be most effective for acquiring these prerequisites, because they show the continuous transition from a concrete, but superficial problem representation to a more abstract, mathematical problem model that forms a basis for solving a problem. An experiment was conducted, where N = 32 pupils from a German high school studied either only text-based worked examples explaining different problem categories from the domain of algebra or worked examples augmented with hybrid animations. Learners with hybrid animations showed superior problem-solving performance for problems of different transfer distance relative to those in the text-only condition.
Reviews of Individual Studies 9 -1
The Enhanced Reading Opportunities study final report: The impact of supplemental literacy courses for struggling ninth-grade readers [Analysis of RAAL] (NCEE 2010-4021). (2010)
According to the National Assessment of Educational Progress (NAEP), just over 70 percent of students nationally arrive in high school with reading skills that are below "proficient"--defined as demonstrating competency over challenging subject matter. Of these students, nearly half do not exhibit even partial mastery of the knowledge and skills that are fundamental to proficient work at grade level. These limitations in literacy skills are a major source of course failure, high school dropout, and poor performance in postsecondary education. While research is beginning to emerge about the special needs of striving adolescent readers, very little is known about effective interventions aimed at addressing these needs. To help fill this gap and to provide evidence-based guidance to practitioners, the U.S. Department of Education initiated the Enhanced Reading Opportunities (ERO) study--a demonstration and rigorous evaluation of supplemental literacy programs targeted to ninth-grade students whose reading skills are at least two years below grade level. As part of this demonstration, 34 high schools from 10 school districts implemented one of two reading interventions: Reading Apprenticeship Academic Literacy (RAAL), designed by WestEd, and Xtreme Reading, designed by the University of Kansas Center for Research on Learning. These programs were implemented in the study schools for two school years. The U.S. Department of Education's (ED) Office of Elementary and Secondary Education (OESE) funded the implementation of these programs, and its Institute of Education Sciences (IES) was responsible for oversight of the evaluation. MDRC--a nonprofit, nonpartisan education and social policy research organization--conducted the evaluation in partnership with the American Institutes for Research (AIR) and Survey Research Management (SRM). The goal of the reading interventions--which consist of a year-long course that replaces a ninth-grade elective class--is to help striving adolescent readers develop the strategies and routines used by proficient readers, thereby improving their reading skills and ultimately, their academic performance in high school. The first two reports for the study evaluated the programs' impact on the two most proximal outcomes targeted by the interventions--students' reading skills and their reading behaviors at the end of ninth grade. This report--which is the final of three reports for this evaluation--examines the impact of the ERO programs on the more general outcomes that the programs hope to affect--students' academic performance in high school (grade point average [GPA], credit accumulation, and state test scores) as well as students' behavioral outcomes (attendance and disciplinary infractions). These academic and behavioral outcomes are examined during the year in which they were enrolled in the ERO programs (ninth grade), as well as the following school year (tenth grade for most students). Appendices include: (1) The ERO Programs and the ERO Teachers; (2) ERO Student Survey Measures; (3) ERO Implementation Fidelity; (4) State Tests Included in the ERO Study; (5) Response Analysis and Baseline Comparison Tables; (6) Technical Notes for Impact Findings; (7) Statistical Power and Minimum Detectable Effect Size; (8) Supplementary Impact Findings; (9) Baseline and Impact Findings, by Cohort; (10) The Association Between Reading Outcomes and Academic Performance in High School; (11) Variation in Impacts Across Sites and Cohorts; (12) Program Costs; and (13) Poststudy Adolescent Literacy Programming in the ERO Schools: Methodology and Additional Findings. (Contains 97 tables, 23 figures, 2 boxes, and 185 footnotes.) [This paper was written with Edmond Wong. For the first-year report, see ED499778. For the second report, see ED503380.]
Reviews of Individual Studies 9 -1
The Enhanced Reading Opportunities study final report: The impact of supplemental literacy courses for struggling ninth-grade readers [Analysis of Xtreme Reading] (NCEE 2010-4021). (2010)
According to the National Assessment of Educational Progress (NAEP), just over 70 percent of students nationally arrive in high school with reading skills that are below "proficient"--defined as demonstrating competency over challenging subject matter. Of these students, nearly half do not exhibit even partial mastery of the knowledge and skills that are fundamental to proficient work at grade level. These limitations in literacy skills are a major source of course failure, high school dropout, and poor performance in postsecondary education. While research is beginning to emerge about the special needs of striving adolescent readers, very little is known about effective interventions aimed at addressing these needs. To help fill this gap and to provide evidence-based guidance to practitioners, the U.S. Department of Education initiated the Enhanced Reading Opportunities (ERO) study--a demonstration and rigorous evaluation of supplemental literacy programs targeted to ninth-grade students whose reading skills are at least two years below grade level. As part of this demonstration, 34 high schools from 10 school districts implemented one of two reading interventions: Reading Apprenticeship Academic Literacy (RAAL), designed by WestEd, and Xtreme Reading, designed by the University of Kansas Center for Research on Learning. These programs were implemented in the study schools for two school years. The U.S. Department of Education's (ED) Office of Elementary and Secondary Education (OESE) funded the implementation of these programs, and its Institute of Education Sciences (IES) was responsible for oversight of the evaluation. MDRC--a nonprofit, nonpartisan education and social policy research organization--conducted the evaluation in partnership with the American Institutes for Research (AIR) and Survey Research Management (SRM). The goal of the reading interventions--which consist of a year-long course that replaces a ninth-grade elective class--is to help striving adolescent readers develop the strategies and routines used by proficient readers, thereby improving their reading skills and ultimately, their academic performance in high school. The first two reports for the study evaluated the programs' impact on the two most proximal outcomes targeted by the interventions--students' reading skills and their reading behaviors at the end of ninth grade. This report--which is the final of three reports for this evaluation--examines the impact of the ERO programs on the more general outcomes that the programs hope to affect--students' academic performance in high school (grade point average [GPA], credit accumulation, and state test scores) as well as students' behavioral outcomes (attendance and disciplinary infractions). These academic and behavioral outcomes are examined during the year in which they were enrolled in the ERO programs (ninth grade), as well as the following school year (tenth grade for most students). Appendices include: (1) The ERO Programs and the ERO Teachers; (2) ERO Student Survey Measures; (3) ERO Implementation Fidelity; (4) State Tests Included in the ERO Study; (5) Response Analysis and Baseline Comparison Tables; (6) Technical Notes for Impact Findings; (7) Statistical Power and Minimum Detectable Effect Size; (8) Supplementary Impact Findings; (9) Baseline and Impact Findings, by Cohort; (10) The Association Between Reading Outcomes and Academic Performance in High School; (11) Variation in Impacts Across Sites and Cohorts; (12) Program Costs; and (13) Poststudy Adolescent Literacy Programming in the ERO Schools: Methodology and Additional Findings. (Contains 97 tables, 23 figures, 2 boxes, and 185 footnotes.) [This paper was written with Edmond Wong. For the first-year report, see ED499778. For the second report, see ED503380.]
Reviews of Individual Studies 9 -1
The enhanced reading opportunity study final report: The impact of supplemental literacy courses for struggling ninth-grade readers. (2010)
According to the National Assessment of Educational Progress (NAEP), just over 70 percent of students nationally arrive in high school with reading skills that are below "proficient"--defined as demonstrating competency over challenging subject matter. Of these students, nearly half do not exhibit even partial mastery of the knowledge and skills that are fundamental to proficient work at grade level. These limitations in literacy skills are a major source of course failure, high school dropout, and poor performance in postsecondary education. While research is beginning to emerge about the special needs of striving adolescent readers, very little is known about effective interventions aimed at addressing these needs. To help fill this gap and to provide evidence-based guidance to practitioners, the U.S. Department of Education initiated the Enhanced Reading Opportunities (ERO) study--a demonstration and rigorous evaluation of supplemental literacy programs targeted to ninth-grade students whose reading skills are at least two years below grade level. As part of this demonstration, 34 high schools from 10 school districts implemented one of two reading interventions: Reading Apprenticeship Academic Literacy (RAAL), designed by WestEd, and Xtreme Reading, designed by the University of Kansas Center for Research on Learning. These programs were implemented in the study schools for two school years. The U.S. Department of Education's (ED) Office of Elementary and Secondary Education (OESE) funded the implementation of these programs, and its Institute of Education Sciences (IES) was responsible for oversight of the evaluation. MDRC--a nonprofit, nonpartisan education and social policy research organization--conducted the evaluation in partnership with the American Institutes for Research (AIR) and Survey Research Management (SRM). The goal of the reading interventions--which consist of a year-long course that replaces a ninth-grade elective class--is to help striving adolescent readers develop the strategies and routines used by proficient readers, thereby improving their reading skills and ultimately, their academic performance in high school. The first two reports for the study evaluated the programs' impact on the two most proximal outcomes targeted by the interventions--students' reading skills and their reading behaviors at the end of ninth grade. This report--which is the final of three reports for this evaluation--examines the impact of the ERO programs on the more general outcomes that the programs hope to affect--students' academic performance in high school (grade point average [GPA], credit accumulation, and state test scores) as well as students' behavioral outcomes (attendance and disciplinary infractions). These academic and behavioral outcomes are examined during the year in which they were enrolled in the ERO programs (ninth grade), as well as the following school year (tenth grade for most students). Appendices include: (1) The ERO Programs and the ERO Teachers; (2) ERO Student Survey Measures; (3) ERO Implementation Fidelity; (4) State Tests Included in the ERO Study; (5) Response Analysis and Baseline Comparison Tables; (6) Technical Notes for Impact Findings; (7) Statistical Power and Minimum Detectable Effect Size; (8) Supplementary Impact Findings; (9) Baseline and Impact Findings, by Cohort; (10) The Association Between Reading Outcomes and Academic Performance in High School; (11) Variation in Impacts Across Sites and Cohorts; (12) Program Costs; and (13) Poststudy Adolescent Literacy Programming in the ERO Schools: Methodology and Additional Findings. (Contains 97 tables, 23 figures, 2 boxes, and 185 footnotes.) [This paper was written with Edmond Wong. For the first-year report, see ED499778. For the second report, see ED503380.]
Reviews of Individual Studies 9-12 -1
Findings from the Institute for Student Achievement Outcome Evaluation: Final report. (2010)
Reviews of Individual Studies 9-12 -1
An experiment to evaluate the efficacy of Cognitive Tutor geometry. (2010)
This randomized, controlled field trial estimated the causal impact of a technology-based geometry curriculum on students' geometry achievement, as well as their attitudes toward mathematics and technology. The curriculum combines learner-centered classroom pedagogy with individualized, computer-based student instruction. Conducted over a 3-year period in eight high schools within an urban fringe district, the study found that students assigned to the treatment curriculum scored 19% of a standard deviation lower on the geometry posttest than their counterparts assigned to the district's standard curriculum, but found no statistically significant impact on students' attitudes toward mathematics and technology. Researchers also collected observation and interview data on teachers' instructional practices. These data suggest that many teachers had difficulty implementing the treatment curriculum's learner-centered pedagogy. In fact, observed levels of learner-centered practices were only modestly higher in treatment classes than in control classes. In both treatment and control classes, however, higher levels of learner-centered pedagogy were associated with higher student achievement in geometry. (Contains 4 figures, 10 footnotes, and 5 tables.)
Reviews of Individual Studies K-12 -1
Evaluation of the DC Opportunity Scholarship Program: Final report (NCEE 2010-4018). (2010)
The District of Columbia School Choice Incentive Act of 2003, passed by Congress in January 2004, established the first federally funded, private school voucher program in the United States. Since that time, more than 8,400 students have applied for what is now called the DC Opportunity Scholarship Program (OSP), and a rigorous evaluation of the Program, mandated by Congress, has been underway. This last formal report from the ongoing evaluation describes the impacts of the Program at least four years after families who applied and were given the option to move from a public school to a participating private school of their choice. The research priorities for the evaluation were shaped largely by the primary topics of interest specified in the statute. This legislative mandate led the evaluators to focus on the following research questions: (1) What is the impact of the Program on student academic achievement? (2) What is the impact of the Program on other student measures? (3) What effect does the Program have on school safety and satisfaction? (4) What is the effect of attending private versus public schools? (5) To what extent is the Program influencing public schools and expanding choice options for parents in Washington, DC? These research questions are consistent with the topics that scholars and policymakers have identified as important questions of interest surrounding private school scholarship programs. The report found that that the Program had mixed longer-term effects on participating students and their parents, including: (1) No conclusive evidence that the OSP affected student achievement overall, or for the high-priority group of students who applied from "schools in need of improvement"; (2) The Program significantly improved students' chances of graduating from high school, according to parent reports. Overall, 82 percent of students offered scholarships received a high school diploma, compared to 70 percent of those who applied but were not offered scholarships. This graduation rate improvement also held for the subgroup of OSP students who came from "schools in need of improvement."; and (3) Although parents had higher satisfaction and rated schools as safer if their child was offered or used an OSP scholarship, students reported similar ratings for satisfaction and safety regardless of whether they were offered or used a scholarship. Appendices include: (1) Research Methodology; (2) Benjamini-Hochberg Adjustments for Multiple Comparisons; (3) Sensitivity Testing; (4) Relationship Between Attending a Private School and Key Outcomes; (5) Detailed ITT Tables; (6) Exploration of Whether Parents Get What They Seek From School Choice; (7) To What Extent Are Treatment Effects of the OSP Observed Across the Outcome Test-Score Distribution? Quantile Regression Analysis of the OSP; and (8) Intermediate Outcome Measures. (Contains 99 tables, 31 figures, and 61 footnotes.)
Reviews of Individual Studies PK-12 -1
Toward reduced poverty across generations: Early findings from New York City's conditional cash transfer program. (2010)
Aimed at low-income families in six of New York City's highest-poverty communities, Family Rewards ties cash rewards to a pre-specified set of activities and outcomes thought to be critical to families' short- and long-term success in the areas of children's education, family preventive health care, and parents' employment. The purpose of this project is to experimentally evaluate the effects of this three-year innovative holistic conditional cash transfer (CCT) initiative. This paper presents initial findings from an ongoing and comprehensive evaluation of Family Rewards. It examines the program's implementation in the field and families' responses to it during the first two of its three years of operations, and early findings on the program's impacts on children's educational processes and outcomes. More specifically, this paper addresses the following questions: (1) What are the effects of ONYC-Family Rewards on family income, poverty, and financial hardship?; (2) What are the effects of ONYC-Family Rewards on use of health care and health insurance?; (3) What are the effects of ONYC-Family Rewards on parents' employment and educational attainment?; and (4) What are the effects of ONYC-Family Rewards on children's educational outcomes? Overall, this study shows that, despite an extraordinarily rapid start-up, the program was operating largely as intended by its second year. Although many families struggled with the complexity of the program, most were substantially engaged with it and received a large amount of money for meeting the conditions it established. Specifically, nearly all families (98 percent) earned at least some rewards in both program years, with payments averaging more than $6,000 during the first two program years combined. The program reduced current poverty and hardship; increased savings; increased families' continuous use of health insurance coverage and increased their receipt of medical care; and increased employment in jobs that are not covered by the unemployment insurance (UI) system but reduced employment in UI-covered jobs. The program has had mixed success in improving children's academic performance specifically. Contrary to expectations, Family Rewards did not affect school attendance or annual standardized test scores in Math and English Language Arts (ELA) for either group of youngest children, but did lead to notable gains for a group of more academically prepared high school students. The program also had important effects on several key proposed mediators of the intervention. However, these effects vary by parents with different age groups of children. Appended are: (1) References; and (2) Tables and Figures. (Contains 2 tables.)
Reviews of Individual Studies 9-12 -1
Writing learning journals: Instructional support to overcome learning-strategy deficits. (2010)
Although writing learning journals is a powerful learning tool, instructional support is needed to overcome deficits in the use of self-regulated learning strategies. In a 2 x 2 experimental design with high-school students (N = 70), we analysed the effects of two modes of instruction (namely, informed prompting and learning-journal example) along with prompts. Informed prompting that provided background information on the prompted strategies enhanced learning in the training and transfer session. A learning-journal example that modelled the application of the strategies primarily fostered the strategy used in the training session and learning in the transfer session. Theoretically, the results provide support for the self-regulation view of writing-to-learn. (Contains 1 figure and 2 tables.)
Reviews of Individual Studies 9-PS -1
Longer-term impacts of mentoring, educational services, and incentives to learn: Evidence from a randomized trial in the United States (2010)
Reviews of Individual Studies 9-12 -1
The efficacy of repeated reading and wide reading practice for high school students with severe reading disabilities. (2010)
This experimental study was conducted to examine the efficacy of repeated reading and wide reading practice interventions for high school students with severe reading disabilities. Effects on comprehension, fluency, and word reading were evaluated. Participants were 96 students with reading disabilities in grades 9-12. Students were paired within classes and pairs were randomly assigned to one of three groups: repeated reading (N = 33), wide reading (N = 34), or typical instruction (N = 29). Intervention was provided daily for approximately 15-20 minutes for 10 weeks. Results indicated no overall statistically significant differences for any condition, with effect sizes ranging from -0.31 to 0.27. Findings do not support either approach for severely impaired readers at the high school level. We hypothesize that these students require more intensive interventions that include direct and explicit instruction in word- and text-level skills as well as engaged reading practice with effective feedback.
Reviews of Individual Studies 4-10 -1
The MPCP Longitudinal Educational Growth Study third year report (SCDP Milwaukee Evaluation Report #15). (2010)
This is the third-year report in a five-year evaluation of the Milwaukee Parental Choice Program (MPCP). The MPCP, which began in 1990, provides government-funded vouchers for low-income children to attend private schools in the City of Milwaukee. The general purposes of the evaluation are to analyze the effectiveness of the MPCP in terms of longitudinal student achievement growth and educational attainment as measured by high school graduation rates. The former will be primarily accomplished by measuring and estimating student growth in achievement as measured by the Wisconsin Knowledge and Concepts Examinations (WKCE) in math and reading in 2006-07, grades 3 through 8 over a five-year period. The latter will be accomplished by following the 2006-07 8th and 9th grade cohorts over a five-year period or longer. The general research design consists of a comparison between a random sample of MPCP students and a matched sample of Milwaukee Public School (MPS) students. This third year report presents results from the November 2008 WKCE tests as second year student achievement growth in MPCP relative to the matched MPS sample. We provide varying descriptive statistics comparing test score means and distributions for math and reading for 2006-07 (baseline year) and 2008-09 (second outcome year) for each sample. The report also analyzes achievement growth using several multivariate techniques and models. The primary finding in all these comparisons is that, in general, there are few statistically significant differences between levels of MPCP and MPS student achievement growth in either math or reading two years after they were carefully matched to each other. In one of the ways of estimating these results, focusing only on those students who have remained in the public or private sector for all three years, private, voucher students are slightly behind MPS students in mathematics achievement growth. The report offers several cautions in interpreting this result against the overwhelming set of results that indicate no difference in achievement growth. Appended are additional tables and study attrition. (Contains 9 tables, 2 figures, and 7 footnotes.) [Additional funding for this project was provided by the Robertson Foundation.]
Reviews of Individual Studies 2-9 -1
Financial incentives and student achievement: Evidence from randomized trials (NBER Working Paper 15898). (2010)
This paper describes a series of school-based randomized trials in over 250 urban schools designed to test the impact of financial incentives on student achievement. In stark contrast to simple economic models, our results suggest that student incentives increase achievement when the rewards are given for inputs to the educational production function, but incentives tied to output are not effective. Relative to popular education reforms of the past few decades, student incentives based on inputs produce similar gains in achievement at lower costs. Qualitative data suggest that incentives for inputs may be more effective because students do not know the educational production function, and thus have little clue how to turn their excitement about rewards into achievement. Several other models, including lack of self-control, complementary inputs in production, or the unpredictability of outputs, are also consistent with the experimental data.
Reviews of Individual Studies 1-12 -1
Effectiveness of reading and mathematics software products: Findings from two student cohorts. (2009)
In the No Child Left Behind Act (NCLB), Congress called for the U.S. Department of Education (ED) to conduct a rigorous study of the conditions and practices under which educational technology is effective in increasing student academic achievement. A 2007 report presenting study findings for the 2004-2005 school year, indicated that, after one school year, differences in student test scores were not statistically significant between classrooms that were randomly assigned to use software products and those that were randomly assigned not to use products. School and teacher characteristics generally were not related to whether products were effective. The second year of the study examined whether an additional year of teaching experience using the software products increased the estimated effects of software products on student test scores. The evidence for this hypothesis is mixed. For reading, there were no statistically significant differences between the effects that products had on standardized student test scores in the first year and the second year. For sixth grade math, product effects on student test scores were statistically significantly lower (more negative) in the second year than in the first year, and for algebra I, effects on student test scores were statistically significantly higher in the second year than in the first year. The study also tested whether using any of the 10 software products increased student test scores. One product had a positive and statistically significant effect. Nine did not have statistically significant effects on test scores. Five of the insignificant effects were negative and four were positive. Study findings should be interpreted in the context of design and objectives. The study examined a range of reading and math software products in a range of diverse school districts and schools. But it did not study many forms of educational technology and it did not include many types of software products. How much information the findings provide about the effectiveness of products that are not in the study is an open question. Products in the study also were implemented in a specific set of districts and schools, and other districts and schools may have different experiences with the products. The findings should be viewed as one element within a larger set of research studies that have explored the effectiveness of software products. Three appendixes are included: (1) Second-Year Data Collection and Response Rates; (2) Description of Sample for the 10 Products; and (3) Details of Estimation Methods. (Contains 29 footnotes, 4 figures and 24 tables.
Reviews of Individual Studies 8-9 -1
Effectiveness of reading and mathematics software products [Cognitive Tutor]: Findings from two student cohorts (NCEE 2009-4041). (2009)
In the No Child Left Behind Act (NCLB), Congress called for the U.S. Department of Education (ED) to conduct a rigorous study of the conditions and practices under which educational technology is effective in increasing student academic achievement. A 2007 report presenting study findings for the 2004-2005 school year, indicated that, after one school year, differences in student test scores were not statistically significant between classrooms that were randomly assigned to use software products and those that were randomly assigned not to use products. School and teacher characteristics generally were not related to whether products were effective. The second year of the study examined whether an additional year of teaching experience using the software products increased the estimated effects of software products on student test scores. The evidence for this hypothesis is mixed. For reading, there were no statistically significant differences between the effects that products had on standardized student test scores in the first year and the second year. For sixth grade math, product effects on student test scores were statistically significantly lower (more negative) in the second year than in the first year, and for algebra I, effects on student test scores were statistically significantly higher in the second year than in the first year. The study also tested whether using any of the 10 software products increased student test scores. One product had a positive and statistically significant effect. Nine did not have statistically significant effects on test scores. Five of the insignificant effects were negative and four were positive. Study findings should be interpreted in the context of design and objectives. The study examined a range of reading and math software products in a range of diverse school districts and schools. But it did not study many forms of educational technology and it did not include many types of software products. How much information the findings provide about the effectiveness of products that are not in the study is an open question. Products in the study also were implemented in a specific set of districts and schools, and other districts and schools may have different experiences with the products. The findings should be viewed as one element within a larger set of research studies that have explored the effectiveness of software products. Three appendixes are included: (1) Second-Year Data Collection and Response Rates; (2) Description of Sample for the 10 Products; and (3) Details of Estimation Methods. (Contains 29 footnotes, 4 figures and 24 tables.
Reviews of Individual Studies 8-9 -1
Effectiveness of reading and mathematics software products [Larson Algebra I]: Findings from two student cohorts (NCEE 2009-4041) (2009)
In the No Child Left Behind Act (NCLB), Congress called for the U.S. Department of Education (ED) to conduct a rigorous study of the conditions and practices under which educational technology is effective in increasing student academic achievement. A 2007 report presenting study findings for the 2004-2005 school year, indicated that, after one school year, differences in student test scores were not statistically significant between classrooms that were randomly assigned to use software products and those that were randomly assigned not to use products. School and teacher characteristics generally were not related to whether products were effective. The second year of the study examined whether an additional year of teaching experience using the software products increased the estimated effects of software products on student test scores. The evidence for this hypothesis is mixed. For reading, there were no statistically significant differences between the effects that products had on standardized student test scores in the first year and the second year. For sixth grade math, product effects on student test scores were statistically significantly lower (more negative) in the second year than in the first year, and for algebra I, effects on student test scores were statistically significantly higher in the second year than in the first year. The study also tested whether using any of the 10 software products increased student test scores. One product had a positive and statistically significant effect. Nine did not have statistically significant effects on test scores. Five of the insignificant effects were negative and four were positive. Study findings should be interpreted in the context of design and objectives. The study examined a range of reading and math software products in a range of diverse school districts and schools. But it did not study many forms of educational technology and it did not include many types of software products. How much information the findings provide about the effectiveness of products that are not in the study is an open question. Products in the study also were implemented in a specific set of districts and schools, and other districts and schools may have different experiences with the products. The findings should be viewed as one element within a larger set of research studies that have explored the effectiveness of software products. Three appendixes are included: (1) Second-Year Data Collection and Response Rates; (2) Description of Sample for the 10 Products; and (3) Details of Estimation Methods. (Contains 29 footnotes, 4 figures and 24 tables.
Reviews of Individual Studies 7-12 -1
Technology’s edge: The educational benefits of computer-aided instruction. (2009)
Because a significant portion of U.S. students lacks critical mathematic skills, schools across the country are investing heavily in computerized curriculums as a way to enhance education output, even though there is surprisingly little evidence that they actually improve student achievement. In this paper we present results from a randomized study in three urban school districts of a well-defined use of computers in schools: a popular instructional computer program which is designed to teach pre-algebra and algebra. We assess the impact of the program using statewide tests that cover a range of math skills and tests designed specifically to target pre-algebra and algebra skills. We find that students randomly assigned to computer-aided instruction score at least 0.17 of a standard deviation higher on a pre-algebra/algebra test than students randomly assigned to traditional instruction. We hypothesize that the effectiveness arises from increased individualized instruction as the effects appear larger for students in larger classes and those in classes in which students are frequently absent. (Detailed data information is appended. Contains 40 footnotes and 17 tables.)
Reviews of Individual Studies 7-9 -1
Accelerated Math evaluation report (Middle school sample). (2009)
Reviews of Individual Studies K-12 -1
Evaluation of the DC Opportunity Scholarship Program: Impacts after three years (NCEE 2009-4050). (2009)
The "District of Columbia School Choice Incentive Act of 2003," passed by the Congress in January 2004, established the first federally funded, private school voucher program in the United States. The purpose of the new scholarship program was to provide low-income residents, particularly those whose children attend schools in need of improvement or corrective action under the "Elementary and Secondary Education Act," with "expanded opportunities to attend higher performing schools in the District of Columbia" (Sec. 303). As part of this legislation, the Congress mandated a rigorous evaluation of the impacts of the Program, now called the "DC Opportunity Scholarship Program" (OSP). This report presents findings from the evaluation on the impacts three years after families who applied were given the option to move from a public school to a participating private school of their choice. The evaluation is based on a randomized controlled trial design that compares the outcomes of eligible applicants randomly assigned to receive (treatment group) or not receive (control group) a scholarship through a series of lotteries. The main findings of the evaluation so far include: (1) After 3 years, there was a statistically significant positive impact on reading test scores, but not math test scores; (2) The OSP had a positive impact overall on parents' reports of school satisfaction and safety, but not on students' reports; (3) This same pattern of findings holds when the analysis is conducted to determine the impact of using a scholarship rather than being offered a scholarship; (4) The OSP improved reading achievement for 5 of the 10 subgroups examined; and (5) No achievement impacts were observed for five other subgroups of students, including those who entered the Program with relative academic disadvantage. Six appendices are included: (1) Research Methodology; (2) Benjamini-Hochberg Adjustments for Multiple Comparisons; (3) Sensitivity Testing; (4) Detailed ITT Tables; (5) Relationship Between Attending a Private School and Key Outcomes; and (6) Intermediate Outcome Measures.. (Contains 115 footnotes, 15 figures and 129 tables.) [For Executive Summary, see ED504784. For "Evaluation of the DC Opportunity Scholarship Program: Impacts after Two Years", see ED501696. For "Evaluation of the DC Opportunity Scholarship Program: Impacts after One Year", see ED497154.]
Reviews of Individual Studies 9-12 -1
Integrating literacy and science instruction in high school biology: Impact on teacher practice, student engagement, and student achievement. (2009)
Reviews of Individual Studies 9 -1
The Enhanced Reading Opportunities study: Findings from the second year of implementation (NCEE 2009-4036). (2009)
Unfortunately, little is known about school-based interventions that address the needs of struggling adolescent readers. To help fill these gaps in knowledge and to provide evidence-based guidance to practitioners, the U.S. Department of Education initiated the Enhanced Reading Opportunities (ERO) Study--a demonstration and random assignment evaluation of supplemental literacy programs targeted to ninth grade students with limited literacy skills. The demonstration involves 34 high schools from 10 school districts that are implementing one of two supplemental literacy programs: Reading Apprenticeship Academic Literacy (RAAL), designed by WestEd, or Xtreme Reading, designed by the University of Kansas Center for Research on Learning. The programs are supplemental as they consist of a year-long course that replaces a ninth-grade elective class and not a core academic class. They aim to help striving adolescent readers develop and apply the strategies and routines used by proficient readers and to motivate them to read more. The literacy programs were implemented in school years 2005-2006 and 2006-2007, resulting in two cohorts of ninth-grade participants. The U.S. Department of Education's Office of Elementary and Secondary Education (OESE) provided direct support for implementation to the participating schools and districts, while the Institute of Education Sciences has been funding and overseeing the design and execution of the evaluation effort. MDRC, a nonprofit, nonpartisan social policy research organization, is conducting the evaluation in partnership with the American Institutes for Research and Survey Research Management. The study's first report described the first year of implementation of the ERO programs and presented impact findings for the first cohort of ninth-grade students (2005-06). The key impact finding was that overall, the ERO programs improved students' reading comprehension test by 0.09 standard deviation (p-value = 0.019). Although not statistically significant, the estimated impact of each literacy intervention (Xtreme Reading, RAAL) was also 0.09 standard deviation. This conference paper will present findings from the second report for the ERO study, which examined implementation and impacts for the second year of program operation. (Contains 1 table, 1 figure and 10 footnotes.)
Reviews of Individual Studies 9-10 -1
Evaluation of LANGUAGE! in Miami-Dade County Public Schools: Final report. (2009)
Reviews of Individual Studies 9 -1
Exploring the relative effectiveness of reading interventions for high school students. (2008, March)
The purpose of this research was to explore the relative effectiveness of intensive reading interventions for struggling high school readers. A yearlong randomized control study was conducted to estimate causal effects, as measured by the criterion-referenced state assessment test, for 1,265 ninth-grade students in 89 classes across 7 high schools in a large school district. Students in the high risk group and the moderate risk group were randomly assigned to one of four intensive reading interventions (three new interventions and a "business as usual" control condition.) Results indicated that for all four interventions, gains made by students in the high risk group exceeded the benchmark for expected annual growth. For the moderate risk group, random effects mixed modeling showed that reliable differences were observed in the state outcome gain scores between two of the intensive interventions and the "business as usual" control condition (Glass's adjusted [delta] = 0.27, 0.30). (Contains 3 tables.)
Reviews of Individual Studies 9 -1
The Enhanced Reading Opportunities Study: Early impact and implementation findings (NCEE report no. 2008-4015) [Xtreme Reading]. (2008)
This report presents early findings from the Enhanced Reading Opportunities (ERO) study--a demonstration and rigorous evaluation of two supplemental literacy programs that aim to improve the reading comprehension skills and school performance of struggling ninth-grade readers. focuses on the first of two cohorts of ninth-grade students who will participate in the study and discusses the impact that the two interventions had on these students' reading comprehension skills through the end of their ninth-grade year. The report also describes the implementation of the programs during the first year of the study and provides an assessment of the overall fidelity with which the participating schools adhered to the program design specified by the developers. The key findings discussed in the report include the following: (1) On average, across the 34 participating high schools, the supplemental literacy programs improved student reading comprehension test scores; (2) Although they are not statistically significant, the magnitudes of the impact estimates for each literacy intervention are the same as those for the full study sample; and (3) Impacts on reading comprehension are larger for the 15 schools where the ERO programs began within six weeks of the start of the school year and implementation was classified as moderately or well aligned with the program model, compared with impacts for the 19 schools where at least one of these conditions was not met. The following are appended: (1) ERO Student Follow-Up Survey Measures; (2) Follow-Up Test and Survey Response Analysis; (3) Statistical Power and Minimum Detectable Effect Size; (4) ERO Implementation Fidelity; (5) Technical Notes for Early Impact Findings; (6) Early Impact Estimates Weighted for Nonresponse; (7) Early Impacts on Supplementary Measures of Reading Achievement and Behaviors; (8) Early Impacts for Student Subgroups; and (9) The Relationship between Early Impacts and First-Year Implementation Issues. (Contains 52 tables, 4 figures, and 121 footnotes.) [This report was prepared for the National Center for Education Evaluation and Regional Assistance, Institute of Education Sciences.]
Reviews of Individual Studies 9-12 -1
Taking a reading/writing intervention for secondary English language learners on the road: Lessons learned from the Pathway Project. (2008)
These two recipients of this year's Alan C. Purves Award reflect on their work (reported in "RTE" Vol. 41, No. 3, pp. 269-303) on "A Cognitive Strategies Approach to Reading and Writing Instruction for English Language Learners in Secondary School" and the lessons they learned from their original research study as they tried to replicate the project in two additional districts outside their service area, to determine if the implications of their study would hold beyond the local context. The Alan C. Purves Award is given to the "RTE" article in the previous volume year judged most likely to impact educational practice. (Contains 1 figure and 4 tables.)
Reviews of Individual Studies 9-12 -1
Rigor and relevance: Enhancing high school students’ math skills through career and technical education. (2008)
Numerous high school students, including many who are enrolled in career and technical education (CTE) courses, do not have the math skills necessary for today's high-skill workplace or college entrance requirements. This study tests a model for enhancing mathematics instruction in five high school CTE programs (agriculture, auto technology, business and marketing, health, and information technology). The model includes a pedagogy and intense teacher professional development. Volunteer CTE teachers were randomly assigned to an experimental (n = 59) or control (n = 78) group. The experimental teachers worked with math teachers to develop CTE instructional activities that integrated more mathematics into the occupational curriculum. After 1 year of the math-enhanced CTE lessons, students in the experimental classrooms performed equally on technical skills and significantly better than control students on two standardized tests of math ability (TerraNova and ACCUPLACER[R]). (Contains 5 tables, 1 figure, and 9 notes.)
Reviews of Individual Studies 4-9 -1
High school students as mentors: Findings from the Big Brothers Big Sisters school-based mentoring impact study. (2008)
High schools have recently become a popular source of mentors for school-based mentoring (SBM) programs. The high school Bigs program of Big Brothers Big Sisters of America, for example, currently involves close to 50,000 high-school-aged mentors across the country. While the use of these young mentors has several potential advantages, their age raises questions about their capacity to be consistent, positive role models, and, in turn, their potential to yield strong impacts for the youth they mentor. With support from The Atlantic Philanthropies and in collaboration with Big Brothers Big Sisters of America, Public/Private Ventures set out to address these questions using data from our large-scale random assignment impact study of Big Brothers Big Sisters SBM (Herrera, et al. 2007). We found that, on average, high school students were much less effective than adults at yielding impacts for the youth they mentor. However, our research identified several program practices that were linked with longer, stronger and more effective high school mentor relationships. High School Students as Mentors stresses the need for programs with high school volunteers to use the inherent strengths of these volunteers and, at the same time, meet their distinct needs. Big Brothers Big Sisters of America is already initiating most of the changes suggested in the study in its high school Bigs program; it has convened a group of six of its strongest Big Brothers Big Sisters agencies to review these and other findings and share their own experiences and strategies in an effort to strengthen their model. (Contains 41 endnotes, 3 figures and 2 tables.)
Reviews of Individual Studies 5-12 -1
The Study of Mentoring in the Learning Environment (SMILE): A randomized evaluation of the effectiveness of school-based mentoring (2008)
Reviews of Individual Studies 5-9 -1
Reading improvement report: Miami-Dade regions II and III. (2008)
Reviews of Individual Studies 6-9 -1
Desert Sands Unified School District, CA. (2008)
Reviews of Individual Studies 6-PS -1
Comparative effectiveness of Carnegie Learning’s Cognitive Tutor Algebra I curriculum: A report of a randomized experiment in the Maui School District. (2007)
Under the "Math Science Partnership Grant," the Maui Hawaii Educational Consortium sought scientifically based evidence for the effectiveness of Carnegie Learning's "Cognitive Tutor[R]" (CT) program as part of the adoption process for pre-Algebra program. During the 2006-2007 school year, the researchers conducted a follow-on study to a previous randomized experiment in the Maui School District of the effectiveness of "CT" in Algebra I. In this second year, the focus was on the newly developed "Bridge to Algebra" program for pre-Algebra. The question being addressed specifically by the research is whether students in classes that use "CT" materials achieve higher scores on the standardized math assessment, as measured by the Northwest Evaluation Association (NWEA) General Math Test, than they would if they had been in a control classroom using the pre-Algebra curricula the Maui schools currently have in place. The researchers found that most students in both "CT" and control groups improved overall on the NWEA General Math Test. They did not find a difference in student performance in math between groups. Their analysis of the Algebraic Operations sub-strand revealed that many students in both groups did not demonstrate the growth in this scale, again with no discernible group differences. However, for Algebraic Operations outcomes, the researchers found a significant interaction between the pre-test and "CT": student scoring low before participating in "CT" got more benefit from the program's algebraic operations instruction than students with high initial scores. (Contains 8 figures, 33 tables, and 14 footnotes.) [For "Comparative Effectiveness of Carnegie Learning's "Cognitive Tutor Bridge to Algebra" Curriculum: A Report of a Randomized Experiment in the Maui School District. Research Summary," see ED538962.]
Reviews of Individual Studies 7-9 -1
The effects of Prentice Hall Literature (Penguin Edition) curriculum on student performance: Randomized control trial final report. (2007)
Reviews of Individual Studies PK-12 -1
The impact of supplemental educational services participation on student achievement: 2005-06. (2007)
Reviews of Individual Studies 9-12 -1
An investigation of achievement in the AVID (Advancement Via Individual Determination) program at the high school level. (2007)
Reviews of Individual Studies 9-12 -1
Making a difference? The effects of Teach for America in high school (CALDER Working Paper 17). (2007)
This research investigates the relative effectiveness (in terms of student tested achievement) of Teach for America (TFA) teachers, and examines the validity of the criticisms of TFA. Specifically, the authors look at TFA teachers in secondary schools, and especially in math and science, where considerable program growth is planned over the next few years. Using individual level student data linked to teacher data in North Carolina, the authors estimate the effects of having a TFA teacher compared to a traditional teacher on student performance. The North Carolina data they employ are uniquely suited for this type of analysis because it includes end of course (EOC) testing for students across multiple subjects. This allows them to employ statistical methods that attempt to account for the nonrandom nature of student assignments to classes/teachers, which have been shown to lead to biased estimates of the impact of teacher credentials (Clotfelter, Ladd, and Vigdor, 2007a; Goldhaber, 2007). The findings show that TFA teachers are more effective, as measured by student exam performance, than traditional teachers. Moreover, the authors suggest that the TFA effect, at least in the grades and subjects investigated, exceeds the impact of additional years of experience, implying that TFA teachers are more effective than experienced secondary school teachers. The positive TFA results are robust across subject areas, but are particularly strong for math and science classes. An appendix is included. (Contains 1 figure, 12 tables, 1 exhibit and 14 footnotes.) [This report was supported by the Steven L. Merrill Family Foundation.]
Reviews of Individual Studies 9 -1
What evidence matters? A randomized field trial of Cognitive Tutor® Algebra I (2007)
Reviews of Individual Studies 9-12 -1
Striving for student success: The effect of Project GRAD on high school student outcomes in three urban school districts. (2006)
According to the National Assessment of Educational Progress, nearly 4 in 10 fourth graders read below the basic level. These literacy problems get worse as students advance through school and are exposed to progressively more complex concepts and courses. The purpose of this study was to assess the effectiveness of four remedial reading programs in improving the reading skills of 3rd and 5th graders, whether the impacts of the programs vary across students with difference baseline characteristics, and to what extent can this instruction close the reading gap and bring struggling readers within the normal range--relative to the instruction normally provided by their schools. The study took place in elementary schools in 27 districts of the Allegheny Intermediate Unit outside Pittsburgh, PA during the 2003-04 school year. Within each of 50 schools, 3rd and 5th grade students were identified as struggling readers by their teachers. These students were tested and were eligible for the study if they scored at or below the 30th percentile on a word-level reading test and at or above the 5th percentile on a vocabulary test. The final sample contains a total of 742 students. There are 335 3rd graders ? 208 treatment and 127 control students. There are 407 5th graders ? 228 treatment and 179 control students. Four existing programs were used: Spell Read P.A.T., Corrective Reading, Wilson Reading, and Failure Free Reading. Corrective Reading and Wilson Reading were modified to focus only on word-level skills. Spell Read P.A.T. and Failure Free Reading were intended to focus equally on word-level skills and reading comprehension/vocabulary. Teachers received 70 hours of professional development and support during the year. Instruction was delivered in small groups of 3 students, 5 days a week, for a total of 90 hours. Seven measures of reading skill were administered at the beginning and end of the school year to assess student progress: Word Attack, Word Identification Comprehension (Woodcock Reading Mastery Test); Phonemic Decoding Efficiency and Sight Word Efficiency (Test of Word Reading Efficiency); Oral Reading Fluency (Edformation); and Passage Comprehension (Group Reading Assessment and Diagnostic Evaluation). After one year of instruction, there were significant impacts on phonemic decoding, word reading accuracy and fluency, and comprehension for 3rd graders, but not for 5th graders. For third graders in the reading programs, the gap in word attach skills between struggling readers and average readers was reduced by about two-thirds. It was found that reading skills of 3rd graders can be significantly improved through instruction in word-level skills, but not the reading skills of 5th graders. The following are appended: (1) Details of Study Design and Implementation; (2) Data Collection; (3) Weighting Adjustment and Missing Data; (4) Details of Statistical Methods; (5) Intervention Impacts on Spelling and Calculation; (6) Instructional Group Clustering; (7) Parent Survey; (8) Teacher Survey and Behavioral Rating Forms; (9) Instructional Group Clustering; (10) Videotape Coding Guidelines for Each Reading Program; (11) Supporting Tables; (12) Sample Test Items; (13) Impact Estimate Standard Errors and P-Values; (14) Association between Instructional Group Heterogeneity and The Outcome; (15) Teacher Rating Form; (16) School Survey; and (17) Scientific Advisory Board. [This report was produced by the Corporation for the Advancement of Policy Evaluation. Additional support provided by the Barksdale Reading Institute, and the Haan Foundation for Children.]
Reviews of Individual Studies 9-12 -1
The Quantum Opportunity Program demonstration: Final impacts. (2006)
Low-income students and students whose parents have not attended college typically are less likely than middle- and upper-income students to complete high school and attend college, and are thus less likely to reap the benefits of attending college. Lack of information, resources, and exposure to others who have navigated the college process may be substantial hurdles for these students. Federal financial aid is available through Pell Grants, college tuition tax credits, and student loan programs, but low-income students may not be taking full advantage of these sources. Even low-income students with high educational aspirations may find the financial aid and college application processes overwhelming and discouraging. The Talent Search program primarily provides information on the types of high school courses students should take to prepare for college and on the financial aid available to pay for college. The program also helps students access financial aid through applications for grants, loans, and scholarships, and orients students to different types of colleges and the college application process. After a two-year implementation study, the U.S. Department of Education's Policy and Program Studies Service selected Mathematica Policy Research Inc. (MPR) in 2000 to assess the effect of Talent Search in selected states. The study team opted to compile data from administrative records from many sources, including program, state, and federal records, to evaluate the effectiveness of federal education programs, partly as a test of whether such an evaluation was feasible. The study also yielded useful information about the effectiveness of the Talent Search program. It included an analysis of the effectiveness of the Talent Search program in Florida, Indiana, and Texas. The study team's analysis was based on administrative data compiled in these three states and a quasi-experimental design to create matched comparison groups. The findings presented in this report suggest that assisting low-income students who have college aspirations to overcome information barriers--an important objective of the Talent Search program--may be effective in helping these students achieve their aspirations. Practical information--direct guidance on how to complete applications for financial aid and admission to college and what a college campus looks and feels like--may have been one of the key services that Talent Search projects delivered. Appended are: (1) Chapter Tables; and (2) Compilation of Data Sources and Feasibility of Evaluations Based on Administrative Records. (Contains 38 tables and 15 figures.)
Reviews of Individual Studies 9-12 -1
Scaling up First Things First: The challenge of scaling up educational reform. (2005)
Reviews of Individual Studies 9-12 -1
Making progress toward graduation. (2005)
In low-performing public high schools in U.S. cities, high proportions of students drop out, students who stay in school typically do not succeed academically, and efforts to make substantial reforms often meet with little success. The Talent Development High School model is a comprehensive school reform initiative that has been developed to address these challenges. Targeting some of the most troubled schools in the country, the model seeks to raise the expectations of teachers and students and to prepare all students for postsecondary education and employment. MDRC, a nonpartisan, nonprofit education and social policy research organization, conducted an independent, third-party evaluation of Talent Development. This rigorous evaluation focuses on the first five high schools to begin using the model in the School District of Philadelphia. The evaluation follows 20 cohorts of ninth-grade students for up to four years of high school using a comparative interrupted time series research design. Appended are: (1) Tables for First-Time Ninth-Grade Students; and (2) Tables for Repeating Ninth-Grade Students. (Contains 16 tables, 9 figures, and 3 boxes.)[Dissemination of MDRC publications is also supported by Starr Foundation.]
Reviews of Individual Studies 7-9 -1
An evaluation of the second edition of UCSMP Transition Mathematics. (2005)
Reviews of Individual Studies 3-12 -1
Connect with Kids: 2004–2005 Study Results for Kansas and Missouri. (2005)
Reviews of Individual Studies 9-PS -1
The impacts of regular Upward Bound: Results from the third follow-up data collection (MPR Reference No. 8464-600) (2004)
Policymakers have long been concerned about the disparities in college attendance between more and less advantaged groups of students. Upward Bound is one of the largest and longest running federal programs designed to help economically disadvantaged students prepare for, enter and succeed in college. Since December 1991, Mathematica Policy Research, Inc., (MPR) has been conducting the national evaluation of Upward Bound for the U.S. Department of Education (ED). The evaluation has focused on program implementation issues and the effects of the program on student outcomes. The "impact study" is designed to measure the impacts or effects of regular Upward Bound on student outcomes, and it is based on a longitudinal evaluation in which eligible applicants from a nationally representative sample of projects were randomly assigned to Upward Bound or to a control group. The results in this document are based on the national evaluation's third follow-up data collection, which was completed in 2000. Because the entire sample of students was beyond high school age by that time, the report includes updated findings on the effects of Upward Bound on high school outcomes. In addition, based on data covering the first few years after sample members left high school, the report addresses the following research questions: (1) What effect does Upward Bound have on students' postsecondary experiences? (2) Who benefits most from Upward Bound? and (3) What is the association between staying in Upward Bound and student outcomes? Findings in this report suggest that for the average student, Upward Bound: (1) increased the number of high school math credits earned by participants; (2) did not affect other measures of high school academic preparation; (3) may have increased enrollment at four-year institutions; and (4) did not affect enrollment at postsecondary institutions more generally when all types of postsecondary institutions are considered. Appended are: (1) Sample Design Unit Nonresponse and Weights; (2) Baseline Characteristics of the Treatment and Control Groups, Third Follow-Up Survey Respondents; (3) Program Effects and Standard Errors; (4) The Effect of Upward Bound on High School Outcomes by Selected Subgroups; (5) The Effect of Upward Bound on College Engagement by Selected Subgroups; (6) Methods Used to Estimate the Effects of Additional Upward Bound Participation; (7) Weighted Standard Deviations for All Outcome Variables; (8) Data Collection; and (9) Sample Sizes and Standard Errors for Reported Impact Estimates. (Contains 29 tables and 3 figures.)
Reviews of Individual Studies 9 -1
Get the Picture?! Final Evaluation Report (10/21/2020)
The purpose of this study was to determine the effectiveness of Get the Picture?! in improving the overall college/career readiness of 900 students with disabilities in each of the nine participating treatment high schools in nine rural, high poverty Kentucky school districts after four years of implementation. This quasi-experimental study followed the 9th grade cohort of students with disabilities in the nine treatment and 18 matched control schools over four school years, 2015-16 through 2018-19. Through the development of self-determination skills, the goal of the intervention was to increase the number of students with disabilities who achieved the state standard for College and/or Career Readiness by meeting established benchmarks on State/National assessments and/or completion of a recognized industry certification in each of the nine participating schools. For the confirmatory analyses, there were two outcome variables in two different outcome domains: (a) Transition Ready, a binary "Yes"/"No" variable [Transition Readiness domain], and (b) the cumulative number of in-school suspensions (a continuous variable) [Self-management behaviors domain]. For the confirmatory analyses, outcome data were examined using two-level Hierarchical Linear Models (HLM) (for Cumulative In-School Suspensions) and Hierarchical Generalized Linear Models (HGLM) (for Transition Ready) to account for the nested structure of the data (i.e., students nested within schools). Overall, after four years of implementation, Get the Picture?! was able to demonstrate a statistically significant positive impact on the Transition Readiness of participating 9th grade cohort students compared to controls. Treatment students had statistically significantly higher odds of being Transition Ready, and were more than twice as likely to achieve Transition Readiness status compared to control students. However, while the confirmatory study showed the intervention was also able to reduce the total number of in-school suspensions for treatment students relative to controls, the outcome was indeterminate (i.e., not statistically significant). The following are appended: (a) Kentucky Department of Education Revised Transition Readiness Standards, and (b) Fidelity of Implementation Final Report.

Connect With the WWC

loading
back to top