WWC review of this study

District 75, New York City Department of Education impact evaluation.

Horowitz, R. (2016). New York, NY: Columbia University.

  • Quasi-Experimental Design
     examining 
    157
     Students
    , grades
    4-5

Reviewed: November 2017

No statistically significant positive
findings
Meets WWC standards with reservations
English language arts achievement outcomes—Substantively important positive effect found for the domain
Outcome
measure
Comparison Period Sample Intervention
mean
Comparison
mean
Significant? Improvement
    index
Evidence
tier

New York State Alternative Assessment (Reading)

Everyday Arts for Special Education (EASE) vs. Business as usual

1 Year

Full sample;
157 students

N/A

N/A

No

--
General Mathematics Achievement outcomes—Indeterminate effect found for the domain
Outcome
measure
Comparison Period Sample Intervention
mean
Comparison
mean
Significant? Improvement
    index
Evidence
tier

New York State Alternative Assessment (Math)

Everyday Arts for Special Education (EASE) vs. Business as usual

1 Year

Full sample;
157 students

N/A

N/A

No

--


Evidence Tier rating based solely on this study. This intervention may achieve a higher tier when combined with the full body of evidence.

Characteristics of study sample as reported by study author.


  • 15% English language learners

  • Urban
    • B
    • A
    • C
    • D
    • E
    • F
    • G
    • I
    • H
    • J
    • K
    • L
    • P
    • M
    • N
    • O
    • Q
    • R
    • S
    • V
    • U
    • T
    • W
    • X
    • Z
    • Y
    • a
    • h
    • i
    • b
    • d
    • e
    • f
    • c
    • g
    • j
    • k
    • l
    • m
    • n
    • o
    • p
    • q
    • r
    • s
    • t
    • u
    • x
    • w
    • y

    New York

Setting

The setting of the study was 8 district 75 schools in New York City. District 75 is an organizational structure across the entire city that encompasses students who require special services (not a geographical district). The intervention occurred in 28 sites. There were 18 comparison sites. Teachers received the training intervention through a series of professional development workshops and extensive in-school support.The 'EASE' schools were 'sites' within many schools that included students with 4 categories of disabilities (i.e. emotional disturbance, autism spectrum, intellectual disabilities, and multiple disabilities).

Study sample

Students in the study were all from one of 10 schools within the New York City District 75 public schools. District 75 is an organizational structure across the entire city that encompasses student who require special services (it is not a geographical district). All of the students in the sample were in one of the following categories of disabilities: autism spectrum, emotional disturbance, intellectual disabilities, and multiple disabilities. Among the 23,000 students within all of District 75, 71% were eligible for Title I support, 86% were from minority populations, 15% were English Language Learners, and 60% were assessed on New York State alternate academic achievement standards.

Intervention Group

The treatment group included teachers of students with disabilities, who received a series of extensive professional development workshops in learning strategies across multiple arts disciplines, including music, dance, visual arts, and theater. There were four key program components: 1) full-day professional development workshops where teachers and administrators meet with teaching artists for full-day workshops, 2) collaborative classroom modeling where teaching artists collaborate with teachers in the classroom to implement curricula, 3) on-site professional development where teaching artists conduct 45-minute on-site sessions with teachers, and 4) classroom instruction where teachers address an Individual Education Plan (IEP) goal through use of an EASE activity.

Comparison Group

Students in the comparison condition were from some the same schools within District 75. The comparison condition received 'business-as-usual' and were not exposed to any EASE program activities.

Support for implementation

Five cohorts of teachers were involved in the training. In year one, teachers received beginner level support. In year two, teachers received intermediate level of support. In year 3, teachers received advanced level support. In years 4 and 5, selected teachers became mentors. At the beginner level, teachers learned to implement the intervention with extensive support from teaching artists. This included four full-day workshops per teacher, 20 in-class teaching artist visits per class, and twenty 45 minute sessions of onsite professional development per teacher. At the intermediate level, teachers implemented the intervention with new students, taking more responsibility from teaching artists. This stage included 2 full-day workshops per teacher, 16 in-class teaching artists visits per class, and sixteen 45-minute sessions per teacher. At the advanced level, teachers implemented the intervention with new students and required minimal support from teaching artists. Teacher ratings were submitted weekly for 23 weeks. Teachers were also asked to provide qualitative examples of behaviors that indicated progress in each indicator. The assessments were conducted online using ArtsResearch software, which was developed to expedite timely responses by teachers. The teachers, who had the best understanding of the students’ disabilities, determined progress in each area. Teachers also received professional development in developing criteria and rating students.

 

Your export should download shortly as a zip archive.

This download will include data files for study and findings review data and a data dictionary.

Connect With the WWC

loading
back to top