IES Blog

Institute of Education Sciences

ED/IES SBIR: Advancing Research to Practice at Scale in Education

This image depicts a young girl with headphones holding onto a mic that is attached.

The Department of Education and Institute of Education Sciences Small Business Innovation Research Program (known as ED/IES SBIR), funds projects to develop and evaluate new education technology products that ready to be widely deployed to address pressing educational needs.

In advance of IES Innovation Day at the ED Games Expo on September 21, 2023 at the Kennedy Center REACH in Washington, DC, this blog features a series of ED/IES SBIR awards that were funded for the purpose of creating education technology to ready previously funded evidence-based products for use at scale. Two of the projects highlighted below, one led by Jay Connor of Learning Ovations and the other by Clark McKown of xSEL Labs, will be featured as part of panels. This event is open to the public. Register for the Expo here.


Over its 20-year history, ED/IES SBIR has been well known for stimulating pioneering firms, such as Filament Games, Future EngineersPocketLab, and Schell Games, to create entrepreneurial and novel education technology products. ED/IES SBIR has also established a track record for investing in a different set of projects—ones that facilitate the uptake of innovations originally developed in university or laboratory settings. This is important because even when researcher-developed innovations (for example, models, programs, and tools) are shown to have evidence for impact, many are not delivered at scale, preventing learners from fully benefiting from these innovations.

Examples of ED/IES SBIR Research to Practice Projects

Over the past two decades, ED/IES SBIR projects have provided useful models for how researchers can navigate and overcome the research-to-practice gap. ED/IES SBIR has made several awards to projects that were originally researcher-initiated, many through IES research grants. These researchers either founded a small business or partnered with an existing small business to develop and commercialize new education technology products to advance research to practice at scale in education.

The short descriptions of these projects below include links to IES website pages with additional information on the unique project models. These projects converted findings from research into scalable, education technology delivered interventions, added new components to existing research-based prototypes to enable feasible implementation and to improve the user experience, and upgraded technology systems to handle large numbers of users across numerous sites.

  • Learning Ovations: Through a series of IES and NIH funded research, Dr. Carol Connor led an academic team to develop a personalized early learning assessment, the A2i, and demonstrated its efficacy for improving literacy outcomes through multiple trials. To ready the A2i for use in larger numbers of settings and to improve data processing and reporting, Learning Ovations won an ED/IES SBIR award to upgrade the underlying data architecture and create automated supports and functionalities. In 2022, Scholastic acquired Learning Ovations, with plans for the A2i to be integrated into its suite of products. See the Learning Ovations Success Story for more information.
  • Mindset Works: Through an IES research grant in 2002 and with funding from other sources, Dr. Carol Dweck led a research team to develop the concept of the growth mindset—the understanding that ability and intelligence can develop with effort and learning. Lisa Blackwell, a member of the research team, founded Mindset Works and won a 2010 ED/IES SBIR award to develop training modules and animated lessons to deploy this instructional model through a multi-media website. A research grant funded in 2015 tested and demonstrated the efficacy of the technology-delivered Growth Mindset Intervention to improve outcomes of struggling learners. See the Mindset Works Success Story for more information.
  • Nimble Assessment Systems: Through IES and other grants, Dr. Michael Russell led team of researchers to conducted foundational research and develop and validation of new forms of assessment. Informed by this research, Nimble Assessment Systems developed NimbleTools with an award from a ED/IES SBIR, a set of universally designed accommodation tools to improve accessibility of assessments for students with disabilities. Measured Progress acquired Nimble Assessment Systems, and the product was integrated into its suite of products for state and district assessments. See the Nimble Tools Success Story for more information.
  • Children’s Progress: Through NIH grants, Dr. Eugene Galanter led a research team to create a computer-based assessment that adapted to how a student responded to each question and delivered individualized narratives for each student. With awards from NIH SBIR and ED/IES SBIR, Children’s Progress developed a commercial version of the computer-adaptive dynamic assessment (CPAA) for early childhood in literacy and math. In 2012, Northwest Evaluation Association (NWEA) acquired Children’s Progress, with the assessment technology incorporated into the NWEA’s assessment platform and used at scale. See the Children’s Progress Success Story for more information.
  • Teachley: Through IES and NSF funded research, Dr. Herb Ginsburg led an academic team to develop prototype software programs for children from preschool to grade 3 to practice mathematics. In 2011, three members of the research team founded a small business, Teachley, which won ED/IES SBIR awards to extend the research model into easily playable, engaging, and widely used math game apps. See the Teachley Success Story for more information.
  • Analytic Measures: With funding from IES, Dr. Jaren Bernstein led a research team to develop prototypes of automated oral reading fluency assessments that were administered to students during the NAEP and other national assessments by IES’s National Center for Education Statistics. Analytic Measures won ED/IES SBIR awards (here and here) to develop the school-ready version of these assessments. In 2022, Google acquired the intellectual property of the assessments with plans to incorporate the tools into its suite of products for education. See this Analytic Measures Success Story more information.
  • Lightning Squad: Through awards from ED’s Office of Education Research and Improvement (now IES) and the Office of Elementary and Secondary Education, Drs. Nancy Madden and Bob Slavin led a research team to develop a model to make tutoring more cost-effective. With awards from ED/IES SBIR, Sirius Thinking partnered with Success For All to develop a mixed online and face-to-face multimedia intervention for struggling readers in grades 1 to 3. The program is now in wide-scale use in schools and in tutoring programs. See the Lightning Squad Success Story for more information.
  • Apprendis: With research grants from IES and other sources, Dr. Janice Gobert led teams at Worcester Polytechnic Institute and Rutgers University to develop and evaluated Inq-ITS (Inquiry Intelligent Tutoring System) virtual labs for students in grades 4 to 10. Apprendis was founded in order to commercialize InqITS and won an ED/IES SBIR award to develop a teacher alert system that generates real-time insights to inform instruction. InqITS is currently in wide-scale use.
  • Common Ground Publishing: Through IES and other grants, Drs. Bill Cope and Mary Kalantzis led a team of researchers to conduct research on new forms of technology-delivered formative assessment for student writing. A technology-based company spun out of a university tech-transfer office, Common Ground Publishing, and won ED/IES SBIR awards (here and here) to develop CGScholar based on this research. CGScholar is an AI-based digital media learning management system designed to support student writing, learning, and formative assessment, which has been in wide-scale use for several years.  See the CGScholar Success Story for more information.
  • xSEL Labs: With funding from IES, Dr. Clark McKown led a team led to develop screening assessments for social and emotional learning and conducted research to demonstrate the efficacy of the tool. xSEL Labs was founded to commercialize the assessments, and with an ED/IES SBIR award, is developing a platform to support educators and administrators using research-based SEL assessments. In 2023, 7 Mindsets acquired xSEL Labs was acquired to commercialize the platform at scale.

A New Program Area at ED/IES SBIR to Continue Advancing Research to Practice
With a history of awards to advance research to practice, ED/IES SBIR created a new program area in 2022 called Direct to Phase II to invest in more projects to develop commercially viable education technology products to ready existing evidence-based research for use at scale. The program resulted in one award (see here) in 2022. Please see the ED/IES SBIR solicitation page for information on the next opportunity for funding through its FY2024 program.


Stay tuned for updates on Twitter, Facebook, and LinkedIn as ED/IES SBIR continues to support projects to advance research to practice at scale.

Edward Metz (Edward.Metz@ed.govis a research scientist and the program manager for the Small Business Innovation Research Program at the US Department of Education’s Institute of Education Sciences.

 

2023 ED Games Expo – Showcasing Special Education Technology for Learning

Students draw on tablets at a previous ED Games Expo

The 9th annual ED Games Expo will take place in Washington, DC, at the John F. Kennedy Center for the Performing Arts REACH on September 20 and 21, 2023 (Agenda). The Expo is a public showcase of game-changing education technology (EdTech) innovations developed through programs at the U.S. Department of Education’s Institute of Education Sciences (IES) and across the federal government. There will be a Showcase of Special Education and Technology products on September 21 from 8:30 am to 12:30 pm in Studio F of the REACH building (Agenda/Overview). The showcase will focus on accessibility and inclusion, with special speakers and demonstrations from 30 developers.

With artificial intelligence (AI) tools and products are spreading across schools and other learning contexts, it is important to maintain a focus on accessibility and inclusion in the development of these technologies. Accessibility needs to be considered from the beginning stages of design/development of technology, including digital games and learning technology. This showcase will highlight product developers doing just that!

The showcase starts with three thought leaders with expertise in this field who will share their ideas for what we can do now to make sure these special education and assistive technology innovations can be disseminated to have impact at scale and be sustained over time.

Headshot of Lauren Allen



Laura Allen, head of strategy and programs for Accessibility and Disability Inclusion at Google, works to improve the accessibility and usability of Google products and processes and to make Google a more accessible place for people with disabilities.

 


Headshot of Erin Mote

Erin Mote, executive director and co-founder of InnovateEDU, is a recognized leader in mobile and broadband technology and has spent much of her career focused on expanding access to technology in the United States and abroad.

 

 

Headshot of Kevin Custer



Kevin Custer is a founding principal at Arc Capital Development, an early-stage venture firm for education and special needs healthcare markets that has invested and managed more than $18 million in companies that provide products and technology for educators and people with special needs, especially autistic individuals.

 

We will host two panels with developers funded by the Office of Special Education and Rehabilitation Services (OSERS) of technology for accessibility, including:

In addition to the talks on special education technology products funded by SBIR, OSERS and its Office of Special Education Programs, and other federal agencies, the showcase will feature live demonstrations of the following 11 innovations funded by the National Center for Special Education Research (NCSER):

Many of these products will also be demonstrated the night before at the ED Expo Public Event, held Wednesday, September 20, from 5:30 to 8:30 pm (Register Here). This event is open to the public (including families) where they can meet with developers and test out the innovations.

After the Special Education Technology Showcase, there will be office hours on September 21 from 3:00 to 5:30 pm where people can meet with developers and representatives from over 40 government offices that invest in and support EdTech initiatives, as well as dozens of national education organizations that lead initiatives to support EdTech innovation, research, and commercialization. Sarah Brasiel, program officer for NCSER’s projects focusing on technology for special education, will be at a table during office hours and happy to talk to you about our NCSER funding opportunities.

Space is limited for the Showcase of Special Education Technology, so please Register Here!

This blog was authored by Sarah Brasiel (Sarah.Brasiel@ed.gov), program officer at NCSER.

 

 

Spotlight on FY 2023 Early Career Grant Awardees: Word-Level Reading Disabilities

NCSER is excited to share the work of our three new Early Career Development and Mentoring Grants Program principal investigators (PI). The aim of this grant program is to support early career scholars in their academic career trajectories as they pursue research in special education. Through a series of interview blogs, each PI will share their research interests, advice for other early career scholars, and desired impact within the field of special education.

The first scholar we are spotlighting is Kelly Williams, assistant professor in communication sciences and special education at the University of Georgia (formerly at Indiana University). Dr. Williams received a grant to develop an intervention to support reading and spelling outcomes for adolescents with word-level reading disabilities (WLRD).

How did you become interested in this area of research?         

Headshot of Dr. Kelly Williams

I originally became interested in research on WLRD through my experience as a high school special education teacher in rural Georgia where I taught English literature and composition to students with mild to moderate disabilities. Most of my students had difficulty reading and spelling words accurately and automatically, which significantly impacted their performance both in and out of school. In school, my students struggled to complete grade-level coursework, which, in turn, affected their ability to graduate with a regular high school diploma. Outside of school, my students had difficulty with tasks such as completing job applications that required extensive amounts of reading. Although I was well prepared to provide classroom accommodations and modifications for my students, I found that I lacked the knowledge and skills to provide intensive interventions that would help improve basic reading and spelling skills. These experiences ultimately led me to pursue my doctorate in special education with an emphasis on learning disabilities.

What advice do you have for other early career researchers?

I think it is important for early career researchers to collaborate with various stakeholders throughout the entire research process. Although many of my ideas stem from my own experiences as a teacher, I have found that listening to various perspectives has helped me identify problems, brainstorm potential solutions, and design practical interventions that will improve outcomes for students with disabilities. Sustaining effective interventions requires us to think about how we can involve students, teachers, administrators, parents/caregivers, schools, and other community members in research.

What broader impact are you hoping to achieve with your research?

We know low reading achievement is associated with numerous negative outcomes across domains (social, emotional, behavioral, academic, economic). My hope is that this project will provide secondary teachers with a feasible and practical intervention to improve reading outcomes for older students with WLRD, which, in turn, may help prevent or ameliorate the effects of these negative consequences. Ultimately, I envision that this intervention could be used independently or as part of a multi-component reading intervention for secondary students with WLRD.

How will this intervention be distinct from other reading and spelling interventions?

There are two ways that this intervention is distinct from other word reading and spelling interventions. First, this intervention will embed spelling instruction within word reading, which is not currently happening in research or practice for secondary students with WLRD. Many existing programs teach spelling in isolation or through rote memorization, despite a large body of research demonstrating a connection between spelling and word reading. Second, the proposed intervention will emphasize a flexible approach to multisyllabic word reading instead of teaching formal syllable division rules. The goal of this approach is to reduce cognitive load, thereby improving the ability to accurately and automatically read and spell words.

Thank you, Kelly Williams, for your thoughtful insights and commitment to improving reading and spelling among students with word-level reading disabilities. NCSER looks forward to following your work as you progress in developing this intervention.

This blog was produced by Emilia Wenzel, NCSER intern and graduate student at University of Chicago. Katie Taylor (Katherine.Taylor@ed.gov) is the program officer for NCSER’s Early Career Development and Mentoring program.

The Regional Educational Lab Program: Making a Difference in Educator Recruitment and Retention

Torrence Williams, Director of Teacher Advancement at the Associated Professional Educators of Louisiana, leads a professional learning module training for Louisiana’s New Teacher Experience program.
Torrence Williams, director of teacher advancement at the Associated Professional Educators of Louisiana, leads a professional learning module training for Louisiana’s New Teacher Experience program.

The Regional Educational Labs (REL) program, operated by the U.S. Department of Education’s Institute of Education Sciences (IES), supports state education agencies, schools and school districts, and institutions of higher education nationwide in using data and evidence-based practice to improve opportunities and outcome for learners. Operating in all 50 states, the District of Columbia, Puerto Rico, and the U.S. Territories and Freely Associated States of the Pacific region, the REL program brings together the expertise of local communities, top-tier education researchers, and education scientists at IES’s National Center for Education Evaluation and Regional Assistance (NCEE) to address the most vexing problems of education policy and practice in states and regions—on demand and free of charge.

It's not exactly breaking news that many schools in our country struggle to fill vacancies in their teacher workforce. This past fall, IES’s National Center for Education Statistics surveyed public school leaders about staffing challenges as they began the 2022-23 school year. The statistics were sobering: 45 percent of schools reported having at least one vacant position more than one month into the school year, and more than 25 percent of schools reported multiple vacancies. Worryingly, our most underserved students were experiencing this crisis most acutely, with roughly 60 percent of schools in high-poverty neighborhoods or with a high-minority student body reporting at least one vacancy. While all of us anxiously await data on the 2023-24 school year—which should be available later this year—RELs and their state and local partners are working to strengthen all aspects of the teacher pipeline.

In the second of a four-part blog series, we highlight four REL research and development projects that address educator recruitment and retention. Each demonstrates how RELs are leveraging their distinct capacity for innovation, rigorous research, and authentic partnership to deliver locally focused and evidence-based supports to the regions, states, and communities they serve.

REL Northwest: Examining Strategies to Improve Teacher Recruitment and Retention in Rural Alaska

Like many rural school districts across the nation, Alaska’s Lower Kuskokwim School District (LKSD) is experiencing a persistent and pressing need to attract and retain educators. Near the start of the 2022-23 school year, 78 positions—nearly one-quarter of all teaching positions in the district—remained unfilled. New teachers were often recruited to the district from other countries such as the Philippines, leading to low retention rates and a constant churn of new educators. Faced with this persistent, high-stakes problem, leadership at LKSD decided to partner with REL Northwest to discover research-based solutions to their teacher recruitment and retention crisis.

REL Northwest is partnering with LKSD to identify evidence-based strategies and tools to continuously monitor and improve working conditions with the goal of increasing teacher retention. To do that, LKSD plans to implement the recommendation of strengthening teacher working conditions from the state's Teacher Retention and Recruitment Plan. As a first step in this partnership, REL Northwest staff reviewed and summarized research on working conditions and teacher retention to identify eight factors that may influence a teacher's decision to stay or leave.  

Lower Kuskokwim leaders decided to focus on activities to identify how changes related to three of those factors—supportive school leadership, available time for teachers, and community engagement—may improve working conditions. The first activity will adapt existing LKSD data sources and develop a research-informed tool to monitor teacher perceptions of school leadership and collect further data to inform the district’s action plan.

Staff also identified a school leadership responsibility unique to their district that may affect teacher trust: managing teacher housing. Housing is a major challenge, not only in remote villages without road access, but in many areas of the country. REL Northwest led partners through an activity to brainstorm how school leaders could improve housing and develop a theory of action for how those strategies would improve working conditions and promote retention. The strategies included establishing realistic housing expectations for new teachers, revising the process for leader evaluation of housing needs, and changing the budgeting process to make maintenance needs and upgrades easier. As a result of the work, district leaders are designing a program that allows teachers to apply for district funding to make simple housing upgrades, such as changes in lighting or painting.

REL Central: Strengthening the Teacher Pipeline in South Dakota to alleviate Teacher Shortages

Like many states, South Dakota is experiencing a teacher shortage that has worsened in recent years. Late last year, SDDOE partnered with REL Central to support one component of their response to this challenge: developing new pathways into teaching for candidates such as paraprofessionals and other South Dakota residents who have interest in entering the teacher workforce. Initially, the work focused on the design and implementation of a teacher apprenticeship program designed to support paraprofessionals as they acquire their teaching degrees and as they are mentored to become certified teachers.

In March, REL Central began work with SDDOE on a fast-turnaround project to support the development of a survey for paraprofessionals about their interest in the pilot apprenticeship program and the types of supports they seek from mentor teachers. Within a matter of weeks, the survey was developed and administered to paraprofessionals statewide. With survey data in hand indicating that hundreds of South Dakota paraprofessionals were interested in such a program, the pilot was expanded by SDDOE to support additional slots starting in fall 2023. In the coming months, REL Central will work with SDDOE to further refine this program by incorporating research evidence from other “Grow Your Own” teacher workforce programs on the components of effective mentoring and by helping the state to generate, collect, analyze, and use data from participants to inform further improvements to the pilot apprenticeship program.

REL Pacific: Strengthening the teacher workforce in Palau

The Republic of Palau, like many school systems, has experienced challenges in recruiting and retaining enough teachers to provide every student with a high-quality education. The geographic isolation of Palau compounds these challenges. Many local Palauan teachers do not have a four-year college degree or are teaching outside of their area of certification. As was the case in Alaska’s Lower Kuskokwim School District, one solution has been to bring in teachers from out of the country to fill vacancies; however, the turnover rate of these teachers is very high. The Palau Partnership to Support Teacher Effectiveness–– a collaboration with the Palau Ministry of Education (MOE), Palau Community College (PCC), six private schools, and REL Pacific ––is focused on building more sustainable solutions. 

The long-term goals of the partnership include Palau private schools adopting a teacher effectiveness measurement system to support, develop, and retain effective teachers; Palau private schools adopting a systemwide instructional coaching process for improving teacher effectiveness; and Palau MOE and PCC reviewing data on the effects of teacher education programs and making implementation adjustments so that their available resources may be used more effectively and efficiently. 

REL Pacific is supporting partner schools to realize their goals by drawing from resources on indicators of successful teacher recruitment and retention as well as best practices of effective teaching. REL Pacific is providing schools training and coaching on data-driven decision-making and plan-do-study-act (PDSA) cycles in the context of the schools’ goals to improve literacy instruction through developing systemic supports for teachers. By incorporating ways of measuring best practices of effective teaching into the schools’ instructional coaching processes, each school will be better able to enact systemic change to address its specific teacher development and retention needs. Additionally, an applied research study is underway that will describe teacher pathways and certification patterns. The findings from this descriptive study will inform future efforts of Palau’s education community to address the new teacher certification requirements and overall educator shortage crisis.

REL Southwest: Partnering to support early career and aspiring teachers in Louisiana

Louisiana’s educator shortage is compounded with low retention rates for early-career teachers. Teachers with 2–5 years of experience left public schools in 2020 at a rate of 30 percent, compared with 17 percent of teachers with 6–10 years of experience. REL Southwest and the Louisiana Department of Education (LDOE) have formed the Supporting Early Career and Aspiring Teachers (SECAT) partnership to improve supports for novice and aspiring teachers. Through the SECAT partnership, REL Southwest aims to strengthen LDOE’s capacity to use evidence to refine new initiatives that support early career and aspiring teachers, such as the New Teacher Experience program and the Louisiana Pre-Educator Pathway, the state’s largest “Grow Your Own” program. This work builds from a previous partnership between REL Southwest and LDOE focused on exploring and evaluating the early impacts of Louisiana’s Believe and Prepare teacher residency program.  

The work of the SECAT partnership kicked off this past spring. Over the next five years, REL Southwest will work with LDOE and school systems in Louisiana to strengthen their capacity to generate and use evidence to refine existing programs for early career and aspiring teachers. In the first year of the partnership, REL Southwest and LDOE partners plan to focus on technical assistance that builds LDOE’s capacity for evaluating the New Teacher Experience. In future years of the partnership, REL Southwest will study LDOE’s efforts to support new and aspiring teachers. Along the way, REL Southwest will share important takeaways, resources, and policy implications related to teacher recruitment and retention learned through the partnership with Louisiana.

Stay tuned for part three of our “Making a Difference” series, focused on school accountability systems. As always, my (virtual) door is open if you have questions about the work highlighted in this blog, or anything else on REL Program. Just email me at chris.boccanfuso@ed.gov.

What We are Learning from Research Using NAEP Mathematics Response Process Data

Three students (two using tablets, one using a laptop) sitting at a library table

The National Assessment of Educational Progress (NAEP) is the largest nationally representative and ongoing assessment of subject knowledge among students in public and private schools in the United States. On the 2017 eighth grade mathematics assessment, 38% of students without disabilities scored at the NAEP Proficient level or above while 25% scored below the NAEP Basic level. However, for students with disabilities, math achievement levels were much worse. Only about 9% of students with disabilities scored at the NAEP Proficient level or above whereas 69% scored below the NAEP Basic level. In response to this gap, in 2021, the National Center for Special Education Research (NCSER) released a funding opportunity to coincide with the release of the 2017 Grade 8 NAEP Mathematics response process data. NCSER intended to support research that explores how learners with disabilities interact with the NAEP digital assessment to better support these learners in test-taking environments and determine whether and how that information could be used to inform instructional practices. There is much to learn from research on NAEP process data for understanding test-taking behaviors and achievement of learners with disabilities. Below we showcase the latest findings from currently funded research and encourage more investigators to conduct research with newly released process data.

Since 2017, administrations of NAEP have captured a variety of response process data, including keystrokes as learners progress through the assessment, how learners use the available tools (such as the calculator), and how accommodations (for example, text-to-speech or more time to complete the assessment) affect performance. Besides score data, NAEP datasets also include survey data from learners, teachers, and schools, and information on test item characteristics and student demographics (including disability). Together, these data provide a unique opportunity for researchers to conduct an in-depth investigation of the test-taking behavior and the mathematics competencies of learners with disabilities compared to their peers without disabilities.  

In July 2021, IES awarded two grants to conduct research using NAEP process data. The results of these projects are expected to improve the future development and administration of digital learning assessments, identify needed enhancements to mathematics instruction, and highlight areas where further research is needed.  Although these projects are ongoing, we would like to highlight findings from one of the funded projects awarded to SRI International and led by principal investigator Xin Wei  entitled Analysis of NAEP Mathematics Process, Outcome, and Survey Data to Understand Test-Taking Behavior and Mathematics Performance of Learners with Disabilities.

The findings from this study, recently published in Autism, is an example of the power of process data to shed new light on learners with disabilities. Focusing on autistic students, Xin Wei and her team analyzed data from 15 items on the NAEP math assessment, their response time in seconds, their score on the items (including partially correct scoring), and survey data related to their enjoyment, interest, and persistence in math. They also analyzed the content of each item using Flesch Reading Ease scores to measure the reading difficulty level of the item. Finally, they rated each item based on the complexity of any social context of the item, as prior research has shown that these contexts can be more challenging for autistic students. They conducted statistical analyses to compare the performance of autistic students with extended time accommodations, autistic students without accommodations, and general education peers. The researchers were not only looking for any areas of weakness, but also areas of strength. Previous studies have demonstrated that autistic people frequently excel in abstract spatial reasoning and calculation tasks, relying more on visual-mental representations than verbal ones.

The findings showed that in comparison to their general education peers, unaccommodated autistic students scored higher and solved math problems involving the identification of figures more quickly. Unaccommodated autistic students were also faster than their general education peers at solving the following types of math items: comparing measures using unit conversions, mentally rotating a triangle, interpreting linear equations, and constructing data analysis plots. Although autistic students who used the extended-time accommodation were lower performing than the other two groups, they had a higher accuracy rate on items involving identifying figures and calculating the diameter of a circle. Both groups of autistic students seem to perform poorer on word problems. Researchers concluded that the linguistic complexity could be one of the reasons that autistic students struggle with math word problems; however, there were two word problems with which they seemed to struggle despite the fact that they were not linguistically complex. It turns out that the items were rated as having substantial social context complexity. The researchers also looked at the student survey data on what types of math they enjoyed more and found they had more enjoyment working with shapes and figures and less enjoyment for solving equations.

The researchers recommend incorporating meta-cognitive and explicit schema instruction during mathematics instruction to aid autistic students in understanding real-life math word problems. They also recommend that assessment developers consider simplifying the language and social context of math word problems to make the assessment more equitable, fair, and accessible for autistic students. Because the autistic student population is particularly heterogenous, more research is required to better understand how to improve instructional strategies for them.

IES plans to release the same type of process data from the 2017 Grade 4 NAEP Mathematics at the end of this summer. We encourage researchers to request these process data to conduct research to understand test-taking behavior and performance of students with disabilities at the elementary school level. For a source of funding for the work, consider applying to the current Special Education Research Grants competition. Here are some important resources to support your proposal writing:

This blog was authored by Sarah Brasiel (Sarah.Brasiel@ed.gov), program officer at NCSER, and Juliette Gudknecht, summer data science intern at IES and graduate student at Teachers College, Columbia University. IES encourages special education researchers to use NAEP response process data for research under the Exploration project type within our standard Special Education Research Grants Program funding opportunity.