About the Accountability in the ESSA Era Alliance
The Every Student Succeeds Act (ESSA) gives states discretion to design their school accountability systems while mandating that they incorporate measures in addition to proficiency on state assessments. States must select those measures, which can include any of a wide range of indicators of student success or school quality. This alliance brings together state education agencies and interested staff from school districts, supporting them in developing and refining indicators of school and student performance.
What Stakeholders Say
Developing and Validating Socio-Emotional Learning Measures
- Brandee Tate, formerly with the District of Columbia Public Schools
- Elizabeth Kim, District of Columbia Public Schools
The REL Mid-Atlantic: Accountability in the ESSA Era Research Alliance
Development of a School Survey and Index as a School Performance Measure in Maryland: A REL–MSDE Research Partnership (803 KB)
This project expanded on previous work with Maryland on measuring school climate. In this follow-on work, the REL worked with MSDE to build its internal capacity to effectively employ the newly developed measure of school climate and its associated index by analyzing data from the spring 2019 survey. REL staff worked with MSDE staff to build skills to independently validate and revise the survey, develop a school climate index, and develop school-level reports on the student and staff surveys.
NJDOE requested the REL’s assistance to support and help develop the department's capacity to interpret measures of school-level performance before and after the shortening of its statewide student assessments. The REL is examining school-level variation in school performance measures over time to assess the extent to which the change in assessment is related to the reliability of school-level measures.
This study will assist DCPS by exploring the properties and uses of data from their districtwide survey of social and emotional learning (SEL). The survey assesses a range of SEL competencies, including perseverance, self-management, self-efficacy, social awareness, rigorous expectations, and sense of belonging. The study will analyze existing administrative and survey data for students, parents, and teachers who were eligible to complete the survey. The results will help inform how DCPS can effectively use its data to reach and track progress towards its time-sensitive strategic goals.
The study’s key research questions are:
- How do SEL competencies evolve with age and grade for different types of students?
- To what extent do SEL competencies and individual students’ growth in SEL competencies vary within and across schools?
- How do SEL measures complement other data that DCPS has access to for predicting future outcomes related to its strategic goals, such as test scores, graduation, absences, and successful re-enrollment?
- How do survey-based SEL measures align between various types of respondents (students, parents, and teachers)?
The REL is conducting a descriptive and simulation-based analysis to examine how specific aspects of the accountability system rules in two mid-Atlantic states affect the types of schools identified for support for student subgroups. Specifically, middle schools are more likely to be identified for TSI for their students with disabilities (SWD) subgroups than are other combinations of subgroup and school level. The study seeks to explain this pattern by examining the following research questions:
- Do more middle school students with disabilities (SWDs) take state assessments than do SWDs in elementary and high schools?
- How do average scores on accountability indicators for the SWD subgroup compare to average indicator scores for all students? Does the magnitude of the performance gap differ by school level?
The design of information displays like school report cards can have a substantial effect on users. The REL is working with the District of Columbia Office of the State Superintendent of Education to test the impacts of different design factors. In this experiment, participants will view report cards that can vary in the factors we are investigating. Each participant can view up to two visually distinct report card designs. Across the entire sample, we will examine all possible combinations of design choices. After displaying each report card, we will measure parents' comprehension of information presented in the report card and their self-reported evaluations of the designs. The findings from this study will provide evidence of how different school report card designs affect usability.
REL researchers will explore the properties of Pennsylvania’s school climate surveys with the aim of developing a summary index of school climate that could be calculated for each school. This project will provide diagnostic information that is useful to local educators in their school improvement efforts.
The REL provided support to the Pennsylvania Department of Education (PDE) to develop its capacity on analytic issues related to chronic absenteeism, one of PDE’s School Quality and Student Success indicators identified in the state’s ESSA plan. This project improved PDE staff’s knowledge about how other state ESSA plans measure chronic absenteeism; about how well Pennsylvania’s measure usefully differentiates among schools; and about how potential variations in the planned measure of chronic absenteeism would alter the list of identified schools. The REL taught PDE staff to conduct their own analyses of their measures, enhancing their ability to inform potential decisions on the refinement of the state’s measures in future years.
Like other states across the country, Maryland is including additional measures of school performance, such as a measure of school climate, in its ESSA plan. The REL assisted the Maryland State Department of Education (MSDE) with selecting and refining school climate surveys for school staff, parents, and students. The REL provided coaching and technical support towards analyzing pilot survey data and interpreting survey results.
School Climate Infographic (3.15 MB)
School climate data can drive school improvement. This REL infographic discusses why school climate is important and how school climate can be measured.
The REL assisted the District of Columbia Public Schools (DCPS) in its analysis of data from a survey designed to assess SEL competencies and helped DCPS develop reliable and valid scales and indices of the resulting data. Review a recent presentation to learn more about this work.
During the workshop, the REL consolidated and disseminated evidence on best practices for communicating school performance data to parents, taxpayers, educators, and other stakeholders through online school report cards. The workshop focused on three themes: (1) content, (2) design, and (3) process. A recording and highlights of the workshop can be found here.
|Name||Title||Organizational affiliation||Organization location|
|Chandra Haislet||Director of Accountability and Data Systems||Maryland State Department of Education||Maryland|
|Rosemary Hughes||Special Advisor to the Secretary on School Improvement||Pennsylvania Department of Education||Pennsylvania|
|Chantel Janiszewski||Accountability and Performance Management||Delaware Department of Education||Delaware|
|Donna Johnson||Strategic Planning & Performance Officer/ Director of Accountability||Office of the State Superintendent of Education||District of Columbia|
|Jessica Merville||Director of Performance Management||New Jersey Department of Education||New Jersey|
|Gene Pinkard, Jr.||Assistant Director, Practice and Leadership||The Aspen Institute||District of Columbia|
|Adam Schott||Special Assistant to the Secretary||Pennsylvania Department of Education||Pennsylvania|
|Dara Shaw||Executive Director, Research and Strategic Data Use||Maryland State Department of Education||Maryland|
- Help develop, refine, analyze, and interpret school climate measures.
- Assess the extent to which high school equivalency measures predict student outcomes.
- Develop thoughtful and strategic ways of using school-climate measures in accountability frameworks and school improvement.
- Explore school performance measures to enhance the breadth and depth of accountability frameworks.
- Provide a forum to share lessons about the design, development, and implementation of accountability systems and measures to improve their efficacy.
Using Transparency to Create Accountability When School Buildings Are Closed and Tests Are Cancelled
Tue Apr 07 2020
The Future of School Accountability: Not Set in Stone
Mon Nov 04 2019
Developing School Climate Surveys for Statewide Accountability in Maryland
Thu Jan 24 2019
Creating Effective School Report Card Websites: Content, Design, and Process
Tue Sep 04 2018