Inside IES Research

Notes from NCER & NCSER

What We are Learning from Research Using NAEP Mathematics Response Process Data

Three students (two using tablets, one using a laptop) sitting at a library table

The National Assessment of Educational Progress (NAEP) is the largest nationally representative and ongoing assessment of subject knowledge among students in public and private schools in the United States. On the 2017 eighth grade mathematics assessment, 38% of students without disabilities scored at the NAEP Proficient level or above while 25% scored below the NAEP Basic level. However, for students with disabilities, math achievement levels were much worse. Only about 9% of students with disabilities scored at the NAEP Proficient level or above whereas 69% scored below the NAEP Basic level. In response to this gap, in 2021, the National Center for Special Education Research (NCSER) released a funding opportunity to coincide with the release of the 2017 Grade 8 NAEP Mathematics response process data. NCSER intended to support research that explores how learners with disabilities interact with the NAEP digital assessment to better support these learners in test-taking environments and determine whether and how that information could be used to inform instructional practices. There is much to learn from research on NAEP process data for understanding test-taking behaviors and achievement of learners with disabilities. Below we showcase the latest findings from currently funded research and encourage more investigators to conduct research with newly released process data.

Since 2017, administrations of NAEP have captured a variety of response process data, including keystrokes as learners progress through the assessment, how learners use the available tools (such as the calculator), and how accommodations (for example, text-to-speech or more time to complete the assessment) affect performance. Besides score data, NAEP datasets also include survey data from learners, teachers, and schools, and information on test item characteristics and student demographics (including disability). Together, these data provide a unique opportunity for researchers to conduct an in-depth investigation of the test-taking behavior and the mathematics competencies of learners with disabilities compared to their peers without disabilities.  

In July 2021, IES awarded two grants to conduct research using NAEP process data. The results of these projects are expected to improve the future development and administration of digital learning assessments, identify needed enhancements to mathematics instruction, and highlight areas where further research is needed.  Although these projects are ongoing, we would like to highlight findings from one of the funded projects awarded to SRI International and led by principal investigator Xin Wei  entitled Analysis of NAEP Mathematics Process, Outcome, and Survey Data to Understand Test-Taking Behavior and Mathematics Performance of Learners with Disabilities.

The findings from this study, recently published in Autism, is an example of the power of process data to shed new light on learners with disabilities. Focusing on autistic students, Xin Wei and her team analyzed data from 15 items on the NAEP math assessment, their response time in seconds, their score on the items (including partially correct scoring), and survey data related to their enjoyment, interest, and persistence in math. They also analyzed the content of each item using Flesch Reading Ease scores to measure the reading difficulty level of the item. Finally, they rated each item based on the complexity of any social context of the item, as prior research has shown that these contexts can be more challenging for autistic students. They conducted statistical analyses to compare the performance of autistic students with extended time accommodations, autistic students without accommodations, and general education peers. The researchers were not only looking for any areas of weakness, but also areas of strength. Previous studies have demonstrated that autistic people frequently excel in abstract spatial reasoning and calculation tasks, relying more on visual-mental representations than verbal ones.

The findings showed that in comparison to their general education peers, unaccommodated autistic students scored higher and solved math problems involving the identification of figures more quickly. Unaccommodated autistic students were also faster than their general education peers at solving the following types of math items: comparing measures using unit conversions, mentally rotating a triangle, interpreting linear equations, and constructing data analysis plots. Although autistic students who used the extended-time accommodation were lower performing than the other two groups, they had a higher accuracy rate on items involving identifying figures and calculating the diameter of a circle. Both groups of autistic students seem to perform poorer on word problems. Researchers concluded that the linguistic complexity could be one of the reasons that autistic students struggle with math word problems; however, there were two word problems with which they seemed to struggle despite the fact that they were not linguistically complex. It turns out that the items were rated as having substantial social context complexity. The researchers also looked at the student survey data on what types of math they enjoyed more and found they had more enjoyment working with shapes and figures and less enjoyment for solving equations.

The researchers recommend incorporating meta-cognitive and explicit schema instruction during mathematics instruction to aid autistic students in understanding real-life math word problems. They also recommend that assessment developers consider simplifying the language and social context of math word problems to make the assessment more equitable, fair, and accessible for autistic students. Because the autistic student population is particularly heterogenous, more research is required to better understand how to improve instructional strategies for them.

IES plans to release the same type of process data from the 2017 Grade 4 NAEP Mathematics at the end of this summer. We encourage researchers to request these process data to conduct research to understand test-taking behavior and performance of students with disabilities at the elementary school level. For a source of funding for the work, consider applying to the current Special Education Research Grants competition. Here are some important resources to support your proposal writing:

This blog was authored by Sarah Brasiel (Sarah.Brasiel@ed.gov), program officer at NCSER, and Juliette Gudknecht, summer data science intern at IES and graduate student at Teachers College, Columbia University. IES encourages special education researchers to use NAEP response process data for research under the Exploration project type within our standard Special Education Research Grants Program funding opportunity.   

Inspiring and Teaching Girls to Code with Time Tails

The Department of Education’s Small Business Innovation Research Program (SBIR), which IES administers, funds the research, development, and evaluation of new, commercially viable education technology products. Time Tails is an online game intended to prepare middle and high school students for success in postsecondary education and career pathways in computer science. The game, which introduces students to coding within the context of computer game design, was developed as part of the SBIR project Coding Bridge: Bridging Computer Science for Girls. In this interview blog, game developers Grace Collins and Carrie Linden of Liminal eSports (now called Snowbright Studio) discuss Time Tails and the importance of inspiring female-identifying students to code.   

 

 

What is Time Tails?

Carrie:

Time Tails is a series of digital games funded by the U.S. Department of Education and the Tides Foundation to help provide learners of all ages with an entry point into learning game design. Each episode transports you to a different point in history, where you help Ari and Zoe (two rad cartoon cats from the 1980s) fix glitches in history while also learning and practicing 3D game development and game design skills. The games are packed full of 80s’ puns, humor, references to salmon (it is a game about cats, after all), and story, while also encouraging players to learn about some amazing folx that sometimes get left out of history class textbooks.

Grace:

For me, Time Tails is a tool. It’s that missing bridge. Imagine you have a student who is interested in design who has been playing around in Scratch for years. When you show them Unity or Unreal game engines (popular game architectures), they may balk at the complexity of them. Time Tails breaks down those complex interfaces into digestible components that gives students the confidence and interest in making the jump across the gap. We’re continuing to release new Time Tails episodes every six months or so, adding new historical periods and new technical concepts. 

Thanks to our partnership with Unity, we’ve also been able to create an entire year’s curriculum for AP Computer Science Principles aligned to College Board’s standards and the International Society for Technology in Education (ISTE) standards.

What inspired you to create Time Tails?

Grace:

I was teaching computer science at an all-girls school in Cleveland, and the lack of resources for my students was just painfully obvious. There are a lot of generic coding resources, but when I went looking for something that could creatively inspire them and also lay the foundation for a career in game development or real-time 3D development, I was always coming up short.

Some of the first iterations of Time Tails were done right there in my classroom as I asked my students what they cared about (underrepresented female and LGBTQ+ figures in history), what they liked (cats), and even how different colors make them more or less likely to engage with learning content. When learning software pops up and it’s all steel gray and black, my students would look at it and say, “That looks like it’s for my brother.” They knew, and we know too, who the audience is for some of these tools out there. Time Tails tries to do all of that differently.

Carrie:

When you look at data on who is currently working in the computer science and game development industries, you will find that men are overwhelmingly the ones with active roles in the field. When we looked at where these drop off points were for girls in computer science career pathways, we found some interesting things. Girls were often leaving coding and computer science before they made it to high school, and most schools offered little in computer science and coding instruction during that gap between entry level software (like Scratch) and full game development platforms (like Unity). There was clearly a need for something to bridge that gap between tools used by younger kids and professional developers. There was also a need for those tools to be welcoming to female identifying and gender diverse youth as they are the ones falling out of the career.

What elements of Time Tails are uniquely tailored to female-identifying students? 

Carrie:

We decided to build Time Tails around narrative. As you progress, you get pulled into the written story and learn more about our feline heroes Ari and Zoe along with the people that they are helping. 

Humor, color, and charm also all tested well with our target audience compared to the typically dry YouTube tutorials and guides that you see out there that covers similar material. We packed our game full of ’80s puns and silly jokes, seasonal allergies (relatable), and made sure that each level was filled with colorful art and adorable characters. More often than not, these characters are strong women from history whose stories don't frequently make it into the textbooks. Our leading cats are female identifying and nonbinary, making Time Tails the first ever learning game featuring a canonically nonbinary character.

Grace:

It can be hard sometimes reading interpretations of our work. Adults will come in saying that the game looks too young or too childish. They want it to be more mature. They want darker colors and a more serious take. We can’t speak for everyone, but when we tested this game, that’s just not what teen girls wanted. They already had a lot of anxiety about getting into computer science in the first place. They’re VERY aware that it’s a masculine dominated field. They need that entry point that says it’s okay to be silly. They need to see others like themselves throughout history making waves. It’s been really heart-warming to see teens playing it, and even more so when their parent sits down with them to explain all of the 80s’ references. Those have been great moments as we’ve been out there testing this game.

What advice can you give other game developers who focus on female-identifying students?

Carrie:

Representation matters. If you can showcase the work that female-identifying folx are doing in the games industry, then you really should. Too often we see the tech and games industry primarily focusing on the women working (super important!) community management roles, but we also need to see highlights of the work done by female identifying developers, writers, quality assurance staff, producers, and more. Highlight all the roles and not just the ones that the industry has already decided are a “good fit” for women in tech and games. 

Grace:

My main advice to any developer is to involve your audience early and often. Have teens give you feedback on art, characters, concepts, everything. And don’t be afraid to see that those teens don’t agree. Be bold and brave in serving the students that you are trying to reach. Stay true to your vision and your audience.

What are the next steps for Time Tails and Snowbright Studio?

Carrie:

Time Tails is currently available on Steam. One purchase gets you access to all current episodes along with additional episodes releasing every six months or so. We are working with our partner, FableVision, to publish a version that allows for classroom licensing on their FableVision Games platform as well.

Grace:

Snowbright is also very active in the tabletop game industry, publishing cozy mystery role-playing games (RPGs) as well as card and board games. Our most recent Cozy Companion magazine actually took Ari and Zoe on a brand-new adventure to 1966 West Virginia as they learned about pollinators and cryptids in a mini-tabletop RPG.


Grace Collins (they/them) is the Founder/CEO of Snowbright Studio, a Cleveland-based LGBTBE certified game studio dedicated to publishing heartwarming games and experiences. Grace previously led games and education policy at the US Department of Education and later coordinated federal game policy across the executive branch. Prior to serving at the Department, they managed and developed educational game projects at the Smithsonian Institution. Grace has taught computer science and game design at multiple levels and was profiled by the Associated Press for founding the first esports team in the nation at an all-girls’ high school.

Carrie Linden (she/they) is the Communications Manager at Snowbright Studio, handling social media, websites, and the creation of official copy for the organization. Carrie has a Master’s in Education and seven years of experience teaching in LGBTQ+ friendly public-school programs and has her Certificate of Esports Management from UC Irvine. Carrie is an active member in the gaming and content creation community.

This blog is part of a 3-part Inside IES Research blog series on sexual orientation and gender identity in education research in observance of Pride month. The other posts discuss the feedback from the IES LGBTQI+ Listening and Learning session and encourage researchers to submit FY 2024 applications focused on the educational experiences and outcomes of LGBTQI+ identifying students.

This blog was produced by Katina Stapleton (Katina.Stapleton@ed.gov), NCER program officer and co-chair of the IES Diversity Council.

Developing the Vanderbilt Assessment of Leadership in Education (VALED)

As education accountability policies continue to hold school leaders responsible for the success of their schools, it is crucial to assess and develop leadership throughout the school year. In honor of the IES 20th Anniversary, we are highlighting NCER’s investment in leadership measures. This guest blog discusses the Vanderbilt Assessment of Leadership in Education (VALED). The VALED team was led by Andy Porter and included Ellen Goldring, Joseph Murphy and Steve Elliott, all at Vanderbilt University at the time. Other important contributors to the work are Xiu Cravens, Morgan Polikoff, Beth Minor Covay, and Henry May. The VALED was initially developed with funding from the Wallace Foundation and then further developed and validated with funding from IES.

What motivated your team to develop VALED?

There is currently widespread agreement that school principals have a major impact on schools and student achievement. However, at the time we developed VALED, we noticed that there were limited research-based instruments to measure principal leadership effectiveness aligned to both licensure standards and rooted in the evidence base. Prior to the VALED, principal leadership evaluation focused primarily on managerial tasks. However, we believed that principal leadership centered on improving teaching and learning, school culture, and community and parent engagement (often called learning-centered leadership) is at the core of leadership effectiveness.

What does VALED measure?

The VALED is a multi-rater assessment of learning-centered leadership behaviors. The principal, his/her supervisor, and teachers in the school complete it, which is why VALED is sometimes referred to as a 360 assessment or multi-source feedback.

VALED measures six core components and six key processes that define learning-centered leadership. The core components are high standards for student learning, rigorous curriculum, quality instruction, culture of learning and professional behavior, connections to external communities, and performance accountability. The key processes are planning, implementing, supporting, communicating, monitoring, and advocating.

How is the VALED different from other school leadership assessments?

The VALED is unique because it focuses on school leadership behaviors aligned to school improvement and school effectiveness, incorporates feedback and input from those who collaborate closely with the principal, includes a self- assessment, acknowledges the distributed work of leadership in a school, and has strong psychometric properties. We think there are several elements that contribute to the uniqueness of the instrument.

First, VALED is based on what we have learned from scholarship and academic research rather than less robust frameworks such as personal opinions and or unrepresentative samples. The VALED was crafted from concepts identified as important in that knowledge and understanding. The VALED model is based upon knowledge about connections between leadership and learning and provides a good deal of the required support for the accuracy, viability, and stability of the instrument.

Second, principals rarely receive data-based feedback, even though feedback is essential for growth and improvement. The rationale behind multi-source or 360-degree feedback is that information regarding leadership efficacy resides within the shared experiences of teachers and supervisors, collaborating with the principal, rather than from any one source alone. Data that pinpoint gaps between principal’s own self-assessment, and their teachers’ and supervisors’ ratings of their leadership effectiveness can serve as powerful motivators for change.

Finally, in contrast to some other leadership measures, VALED has undergone extensive psychometric development and testing. We conducted a sorting study to investigate content validity and a pilot study where we addressed ceiling effects, and cognitive interviews to refine wording. We also conducted a known group study that showed the tool’s ability to reliably distinguish principals, test-retest reliability, convergent-divergent validity, and principal value-added to student achievement. As part of this testing, we identified several key properties of VALED. The measure—  

  • Works well in a variety of settings and circumstances
  • Is construct valid
  • Is reliable
  • Is feasible for widespread use
  • Provides accurate and useful reporting of results
  • Is unbiased
  • Yields a diagnostic profile for summative and formative purposes
  • Can be used to measure progress over time in the development of leadership
  • Predicts important outcomes
  • Is part of a comprehensive assessment of the effectiveness of a leader's behaviors

What is the influence of VALED on education leadership research and practice?

VALED is used in schools and districts across the US and internationally for both formative and evaluative purposes to support school leadership development. For example, Baltimore City Public Schools uses VALED as a component of their School Leader Evaluations. VALED has also spurred studies on principal evaluation, including the association between evaluation, feedback and important school outcomes, the implementation of principal evaluation, and its uses to support principal growth and development. In addition, it provides a reliable and valid instrument for scholars to use in their studies as a measure of leadership effectiveness.


Andy Porter is professor emeritus of education at the Pennsylvania State University. He has published widely on psychometrics, student assessment, education indicators, and research on teaching.

Ellen Goldring is Patricia and Rodes Hart Chair, professor of education and leadership at Vanderbilt University. Her research interests focus on the intersection of education policy and school improvement with emphases on education leadership.

Joseph Murphy is an emeritus professor of education and the former Frank W. Mayborn Chair of Education at Peabody College, Vanderbilt University. He has published widely on school improvement, with special emphasis on leadership and policy and has been led national efforts to develop leadership standards. 

Produced by Katina Stapleton (Katina.Stapleton@ed.gov), program officer for NCER’s education leadership portfolio.

 
 
 

The Comprehensive Assessment of Leadership for Learning: How We Can Support School Leaders to Improve Learning for All Students

As educational accountability policies continue to hold school leaders responsible for the success of their schools, it is crucial to assess and develop leadership throughout the school year. In honor of School Principals’ Day and the IES 20th Anniversary, we are highlighting NCER’s investment in formative leadership measures. In this guest blog, researchers Rich Halverson and Carolyn Kelley from the University of Wisconsin-Madison and Mark Blitz from the Wisconsin Center for Education Products and Services discuss the development and evolution of their IES-funded Comprehensive Assessment of Leadership for Learning (CALL).

What is CALL?

CALL is a survey tool based on a distributed leadership model that emphasizes the work of leaders rather than their positions or identities. In 2008, we led a team of researchers at the University of Wisconsin-Madison to identify the key leadership tasks necessary for school improvement, regardless of who made the tasks happen. The CALL survey invites each educator in a school to assess the degree to which these core tasks are conducted, then aggregates these responses to provide a school-level portrait of the state of leadership practice in their school.

How was CALL developed?

Our CALL team relied on over 30 years of research on leadership for school improvement to name about 100 key tasks in five domains of practice. The team then worked over a year with expert educators and leaders to articulate these tasks into survey items phrased in language that teachers would readily understand as describing the work that happens every day in their schools. We designed each item to assess the presence and quality of leadership practices, policies, and programs known to improve school quality and student learning. We validated the survey with qualitative and quantitative analyses of survey content, structure, and reliability.

What inspired you to develop CALL?

We believed a measure like CALL is necessary in the era of data-driven decision-making. Educators are inundated by accountability and contextual data about their schools, but they are left on their own for data to help them understand how to develop and implement the strategies, policies, and programs that support student success. Traditional school data systems leave a hole where feedback matters most for educators–at the practice-level where the work of leaders and educators unfolds. That is the hole that CALL is designed to fill.

How is the CALL different from other leadership surveys?

Traditional surveys include items that invite educators to rate their leaders on important tasks using Likert scale measures. The results of these surveys produce scores that allow leaders to be rated and compared. But, as a school leader, it is hard to know what to do with a 3.5 score on an item like “My principal is an effective instructional leader.” CALL items are designed differently. Each CALL item response represents a distinct level of practice, so respondents can learn about optimum practices simply by taking the survey. If the collected responses by educators in your school averaged a “2” on one of the items, the description of the next level practice (“3”) clearly articulates an improvement goal.

In addition, our online CALL reporting tools provide formative feedback by allowing users to compare item and domain scores between academic departments and grade levels, as well as across schools. The reports name specific areas of strength and improvement, and also suggest research-driven strategies and resources leaders can use to improve specific aspects of leadership.

How did CALL transition into a commercial measure?

The CALL project provides a model of how IES-funded research can have broad impact in schools around the country. We are thrilled that CALL developed into the rare educational survey that was embraced by the people who tested it as well as the research community. Many of our development partners asked about whether they could continue with CALL as the survey took on new life as a commercial product after our grant ended.

The Wisconsin Center for Education Products and Services (WCEPS) provided us with the business services and the support to bring CALL to market. CALL became a WCEPS partner in 2014 and has since developed into a successful leadership and school improvement resource. Under the leadership of WCEPS’s Mark Blitz, the CALL model became a framework to build successful collaborations with learning and research organizations across the country.

Leading professional learning groups such as WestEd, WIDA, the Southern Regional Education Board, and the Georgia Leadership Institute for School Improvement worked with Mark and the WCEPS team to build customized CALL-based formative feedback systems for their clients. Research partners at East Carolina University, Teachers College, and the University of Illinois at Chicago used CALL to collect baseline data on leadership practices for school improvement and principal preparation projects. CALL has also developed customized versions of the survey to support leadership for personalized learning (CALL PL) and virtual learning (Long Distance CALL). These partnerships have provided opportunities for hundreds of schools and thousands of educators to experience the CALL model of formative feedback to improve teaching and learning in schools.

What’s the next step for CALL?

In 2021, the CALL project entered a new era of leadership for equity. With the support of the Wallace Foundation, we created CALL for Equity Centered Leadership (CALL-ECL) to provide school districts with feedback on the leadership practices that create more equitable schools. CALL-ECL is part of a $100 million+ Wallace Foundation initiative to transform how districts across the country develop partnerships to prepare and support a new generation of equity-centered leaders. According to Wallace Research Director Bronwyn Bevan, “The foundation is excited about CALL-ECL because it will help leaders identify the organizational routines that sustain inequality and replace them with routines that help all students thrive.”

Our $8 million, six-year CALL-ECL project will document the development of these new preparation and support program, and will create a new CALL survey as an information tool to describe and assess equity-centered leadership practices. We believe that by 2027, CALL-ECL will be able to share the practices of equity-centered leadership developed through the Wallace initiatives with districts and schools around the world. Our hope is that CALL-ECL will give school leaders and leadership teams the data they need to continually evolve toward better opportunities and outcomes for all young people.


Richard Halverson is the Kellner Family Chair of Urban Education and Professor of Educational Leadership and Policy Analysis in the UW-Madison School of Education. He is also a co-director of the Comprehensive Assessment of Leadership for Learning and leads the Wallace Foundation Equity-Centered Leadership Pipeline research project.

 

Carolyn Kelley is a distinguished professor in the Department of Educational Leadership and Policy Analysis. Dr. Kelley’s research focuses on strategic human resources management in schools, including teacher compensation, principal and teacher evaluation, and leadership development.

 

Mark Blitz is the project director of the Comprehensive Assessment of Leadership for Learning (CALL) at the Wisconsin Center for Education Products & Services.

 

 

This blog was produced by Katina Stapleton (Katina.Stapleton@ed.gov), program officer for NCER’s education leadership portfolio.

 
 
 

Smooth Sailing Using the Neurodiversity Paradigm: Developing Positive Classrooms Experiences for Autistic Students

In honor of Autism Awareness Month, we’d like to highlight an IES-funded research project on autism spectrum disorder and discuss how the current framework of neurodiversity informs this research. In recent years, the neurodiversity paradigm has been an increasingly popular way of viewing autism and other neurodevelopmental conditions. Neurodiversity is a term coined in the late 1990s by Judy Singer to refer to natural human variation in neurotypes. Neurodivergent individuals diverge from the norm, usually with conditions such as autism, attention-deficit hyperactivity disorder, or dyslexia. Rather than focusing on deficits, this paradigm supports a strength-based view of these conditions while still acknowledging individual challenges. For this blog, we interviewed Dr. Jan Blacher and Dr. Abbey Eisenhower, principal investigators who created a professional development (PD) program supporting general education teachers of students on the autism spectrum. In the interview below, the researchers describe how their PD program works and how it uses the neurodiversity paradigm to strengthen relationships between autistic students and their teachers.

What is Smooth Sailing and what led you to develop it?

Headshot of Dr. Abbey EisenhowerHeadshot of Dr. Jan Blacher

Smooth Sailing is the nickname for our PD for general education teachers in kindergarten through second grade who have at least one student on the autism spectrum in their classrooms. The catalyst for the program was the findings from our previous project on student-teacher relationships, indicating that teachers are central to facilitating positive school experiences, especially for autistic students. Warm, positive student-teacher relationships are predictive of academic engagement and social adjustment.

The program provides coaching-based support for teachers, equips them with strategies for building strong relationships with autistic students, and enables them to expand on their students' strengths and interests in the classroom. Developed by educators, clinicians, and researchers in partnership with teachers and autistic individuals, Smooth Sailing uses an autism-affirming, neurodiversity perspective throughout the program.

What makes this program unique?                                                                                                                

Smooth Sailing recognizes the importance of relationships—especially student-teacher relationships—in making school a positive and welcoming place for students.

Our program prioritizes a neurodiversity perspective on autism: We recognize autism as a set of differences that are part of the diversity of human experience. In order to best support autistic students, we must provide an affirming context that embraces their strengths and differences. This approach contrasts with a deficit-based model, which focuses on changing children and their behaviors. The deficit model could impair relationships between students and their teachers, making academic engagement and social adjustment worse.

Finally, Smooth Sailing is unique for centering on autistic people as key contributors to shaping program content so that the program reflects the lived realities of autistic students.

What have you learned while developing and testing the Smooth Sailing intervention?

We have learned several important lessons:

(1) During the initial research for our intervention, findings indicated that only 8% of general education teachers in the study had received any professional training in autism. This provides a clear-cut mandate for more autism-focused training for these educators.

(2) After the intervention, general education teachers endorsed three key Smooth Sailing strategies for reaching out to their autistic students: (a) identifying interests, (b) celebrating talents, and (c) having one-on-one time to form stronger relationships. We learned that these simple strategies are ones every teacher can adopt to create more inclusive classrooms and cultivate stronger relationships with students, especially autistic students.

(3) Overall, teachers who received the Smooth Sailing PD experienced significant improvements in the quality of their relationships with autistic students, including higher student-teacher closeness and lower student-teacher conflict, compared to teachers who had not received the program. Thus, in addition to other positive outcomes for teachers and children, we learned that our brief program (12 hours over 4 weeks) was sufficient for moving the needle on the critical construct of student-teacher relationship quality.

How does respect for neurodiversity inform the Smooth Sailing intervention and your philosophies as researchers?

One key factor that has been transformative to the resulting Smooth Sailing program has been our close consultation with current and former autistic students. As part of developing the Smooth Sailing program for teachers, our research team interviewed many autistic adolescents and adults about their school experiences, their advice for teachers, and their opinions on making schools more affirming and inclusive. In addition, we closely engaged autistic adults as expert consultants during our program development process. These consultants advised on teacher-focused content, reviewed materials, and weighed in on program changes.

The rich information we learned from the interviews and intensive consultation substantially impacted the content of the resulting program. To offer one example, these interviews showed us the outsized power of a positive student-teacher relationship, even with just one teacher, in making school a bearable place for autistic students.

Because many autistic students describe their school experiences as ableist and marginalizing, our team's programming aims to disrupt these school problems by building strong student-teacher relationships and fostering teachers' understanding of autism through an affirming, neurodiversity-informed lens. By incorporating first-person perspectives of autistic students and adults in its creation and content, our programs affirm the lived realities of autistic students. 

What needs are still unmet for general education teachers working with autistic students?

We have heard from teachers and administrators at all K-12 levels—high school, middle school, and later elementary school—that they would like access to similar autism-focused PD programs targeted to the student age ranges they teach. We think that creating a school culture that affirms neurodiversity starts by fostering understanding between students and all school staff, not just primary classroom teachers.  

What's next for the Smooth Sailing project?

We hope to expand the Smooth Sailing PD program to the early childhood education context. Unfortunately, our research has shown that, by the time they enter elementary school, one out of every six autistic children has been expelled from a preschool or childcare program. Viewed through a social justice lens, this preschool expulsion is an educational equity issue.

Early childhood educators are key to improving these early school experiences. We believe that preschool and childcare educators can be catalysts in providing an inclusive environment by forming strong relationships with autistic and neurodivergent children. That said, most early childhood educators report having no professional training in autism, feeling underprepared to meet the needs of autistic children, and wanting more support for inclusion. We hope that programs like Smooth Sailing can be applied to support educators working with preschool-age children who are autistic or neurodivergent, many of whom are not yet diagnosed, so that their first school experiences can be enriching and inclusive.

Jan Blacher is a distinguished research professor in the School of Education and the director of the SEARCH Family Autism Research Center at the University of California, Riverside. Abbey Eisenhower is an associate professor in the Psychology Department at the University of Massachusetts, Boston.   

This blog was authored by Juliette Gudknecht, an intern at IES, along with Emily Weaver (Emily.Weaver@ed.gov), program officer at NCSER with oversight of the portfolio of autism grants.