IES Blog

Institute of Education Sciences

AI-Augmented Learning for Individuals with Disabilities: New Funding Opportunity, Current Research, and the Potential for Improving Student Outcomes

This March, IES Director Mark Schneider released a blog in which he discussed exploring a partnership with the National Science Foundation (NSF) to encourage scientists with expertise in AI and related fields to address the important post-pandemic need for accelerating learning. IES is now excited to announce our resulting participation in NSF’s National Artificial Intelligence (AI) Research Institutes—Accelerating Research, Transforming Society, and Growing the American Workforce solicitation. In this blog, we describe this new funding opportunity, provide examples of existing NCSER-funded research in this area, and highlight the potential for such research to further improve outcomes for learners with disabilities.

 Artificial Intelligence Research Funding Opportunity

With funding from the American Rescue Plan, NCSER plans to support research under Theme 6, Track B: AI-Augmented Learning for Individuals with Disabilities. Proposals must discuss how the work will respond to the needs of learners with or at risk for a disability in an area where the COVID-19 pandemic has further widened existing gaps and/or resulted in decreased access and opportunities for students with disabilities to learn and receive support services. Please review the solicitation, the webinar (November 16), and the frequently asked questions for more information. Interested applicants should note the primary focus of this institute:

The primary focus of an institute in AI-Augmented Learning includes research and development of AI-driven innovations to radically improve human learning and education. Achievement and opportunity gaps, particularly for learners from disadvantaged or underserved communities, have always been present, but COVID-19 has exacerbated them. Institute plans for this theme should address and measure outcomes with direct education impact, in both the short- and long- term, that have practical significance to educators, parents, or other decision-makers. Plans must also directly address algorithmic bias, model transparency, security and data privacy in the support of learning.”

Current NCSER-Funded Grants Applying Artificial Intelligence and Machine Learning

Prior to the new collaboration between IES and NSF, NCSER funded several grants that apply artificial intelligence and machine learning approaches, including those described below.

With a 2018 NCSER grant, Dr. Maithilee Kunda and her team at Vanderbilt University are building on a technology-based intervention known as Betty’s Brain. This computer-based instructional program for middle school science, designed with the support of a 2006 NCER grant, allows students to teach a computer agent to understand certain concepts, increasing their own knowledge and understanding. Dr. Kunda and her team are developing a new game called Film Detective, which is designed to improve theory of mind (ToM) reasoning in adolescents with autism spectrum disorder (ASD). More information about this project can be found in this IES blog.

With a 2021 NCSER grant, Dr. Patrick Kennedy and his team at University of Oregon are using machine learning to validate a well-known assessment, Dynamic Indicators of Basic Early Literacy Skills, 8th Edition® (DIBELS 8) as a screener for dyslexia. As of 2020, 47 states require that students be screened for dyslexia in early elementary school and many states use DIBELS for this screening. However, it remains to be validated for this purpose. To address the validity of the DIBELS for screening, this research team is using machine learning approaches to predict and classify scores in relation to a pre-defined target. This will allow the research team to draw conclusions about the validity of the DIBELS 8 for dyslexia screening. These conclusions will be disseminated widely to state and local education agencies and other stakeholders.

The Potential of AI for Improving Outcomes for Learners with Disabilities

In addition to the work that IES is funding, AI has already demonstrated potential for improving outcomes for learners with disabilities in many other ways:

  • AI has been used to support children with ASD who have difficulties understanding people’s emotions, with AI-driven apps and robots helping students practice emotion recognition and other social skills.
  • AI has informed the development of algorithms that can help those involved in assessment identify disabilities in students, such as ASD, specific learning disabilities (dyslexia, dysgraphia, and dyscalculia), and attention-deficit/hyperactivity disorder (ADHD).
  • AI-embedded interventions have included error analysis to inform instruction and personalized feedback in spelling and math for students with disabilities.

Despite these advancements, there appear to be persistent gaps in AI research for students with disabilities, such as AI for students with intellectual and developmental disabilities. This is an especially important area of work because many of these learners have multiple disabilities and/or serious health conditions. For example, children with intellectual and developmental disabilities who also have hearing loss or visual impairment have compounded challenges. Some students with Down syndrome also have hearing loss and other health complications, such as cardiac issues. AI affords an opportunity to integrate health information across different applications to improve the quality of life for these students. These technological solutions can assist in managing information about the students and communicating health information between teachers, physicians, and caregivers.

AI has the potential to transform special education. We hope that this NCSER-NSF partnership will encourage researchers to be creative in planning projects that move the field of AI forward as well as provide innovative solutions to support learners with disabilities.

This blog was co-authored by Sarah Brasiel (Sarah.Brasiel@ed.gov), program officer at NCSER and Bennett Lunn (Bennett.lunn@ed.gov), Truman-Albright Fellow for NCSER and the National Center for Education Research (NCER). IES encourages special education researchers to partners with experts in Artificial Intelligence to submit to this NSF AI Institute solicitation 22-502 to increase the evidence base on use of AI for this population.

Film Detective: How an AI-powered Game Aims to Improve Outcomes for Students with ASD

Artificial intelligence (AI) is poised to revolutionize the way humans live, even in ways yet unseen, and education is no exception. IES funds research at the cutting edge of technology and education science, and, as Director Mark Schneider has recently pointed out, AI may eventually serve to help educators identify, assess, and support students with disabilities. In 2018, NCSER awarded funding to Dr. Maithilee Kunda of Vanderbilt University to do just that.

Dr. Kunda and her team are developing a new game called Film Detective to improve theory of mind (ToM) reasoning in adolescents with autism spectrum disorder (ASD). ToM reasoning is the ability to infer the mental state of others, allowing us to understand and predict behavior based on our perception of their beliefs, intentions, and desires. The game builds on a technology-based intervention known as Betty’s Brain. Developed with support from a NCER grant, Betty’s Brain is a computer-based instructional program for middle school science that allows students to teach a computer agent to understand certain concepts. By teaching the agent, students grew their own knowledge and understanding. Dr. Kunda and her team are building on this software by adapting the learning-by-teaching model to improve ToM reasoning in neurodiverse students. (For more on Dr. Kunda’s perspective on the importance of neurodiversity, see this blog.)

The Film Detective game takes students through an interactive storyline in which they must help a scientist from the year 3021 “decode” the way people in today’s world behave in a series of films. The stakes are high as students help a scientist unlock a time machine by retrieving codes hidden in films by an evil scientist—aptly named Von Klepto—who has stolen items from the Museum of Human History. By teaching the computer agent—the player’s robot sidekick (named T.O.M.)—how to identify modern behaviors, the student develops their own ToM reasoning. The Film Detective storyline is a product of the creative talents of several Vanderbilt creative writing students, and the game mechanics were designed with insights of college students with ASD themselves. With the help of post-doctoral student and project lead, Roxanne Rashedi, the project team has used participatory design and qualitative methods to better tailor the game to the community for which it is intended. By working closely with students with ASD and their families, the project team was able to refine the original Betty’s Brain structure with new reward structures and storylines that balance the challenge of the game with the frustration that students can feel playing the game.

Screen shot of the Film Detective’s theatre and time machine room
Film Detective’s Theatre and Time Machine Room (illustration by Kayla Stark)

Every part of the project draws on the diverse expertise of the team, and the inclusion of a variety of perspectives has been crucial to informing the project’s development. The team includes experts from Vanderbilt’s School of Engineering and the Vanderbilt Medical Center’s Treatment and Research Institute for Autism Spectrum Disorders (TRIAD), with Dr. Kunda and students in computer science and psychology providing insights in cognitive science and artificial intelligence. The joining of expertise in artificial intelligence, clinical psychology, and educational psychology has allowed the team to merge theoretical perspectives on ToM development with conceptions of knowledge representation and modeling in computational systems. This approach offers the team a unique framework for understanding the development of social reasoning skills in students with ASD. Beyond the theoretical, the team has also leveraged artificial intelligence to evaluate how students progress through the game, using advanced data mining techniques and eye-tracking-enabled user studies to better understand how students with ASD can develop greater ToM reasoning through learning-by-teaching.

Film Detective’s hallway to concessions
Film Detective’s Hallway to Concessions (illustration by Kayla Stark)

The work that has gone into Film Detective exemplifies the ways that novel research that combines technological advancement and diverse perspectives can lead to important innovations in the education sciences. While Film Detective is still under development (it is currently being user tested, and readers are encouraged to sign up to take part here), IES is eager to see what will come out of this exciting collaboration.

Dr. Maithilee Kunda is the director of the Laboratory for Artificial Intelligence and Visual Analogical Systems and a faculty investigator for the Frist Center for Autism and Innovation at Vanderbilt University. This blog was written and edited by Bennett Lunn, Truman-Albright Fellow for the National Center for Education Research and the National Center for Special Education Research.

IES Funds Innovations Across the Age Spectrum for Students with ADHD

Nearly 10% of all children in the United States have at one time been diagnosed with attention-deficit/hyperactivity disorder (ADHD)—over 6 million children, according to the Centers for Disease Control and Prevention. As the name implies, ADHD can lead children to have primary problems with attention, hyperactive behavior, or both. Over the past two years, NCER and NCSER have awarded more than $12 million to four projects focusing on children and youth with ADHD through their primary grant competitions, from preschool to high school.

Comparing Virtual and In-Person Sessions for Parents of Young Children

Photo of George DuPaulPhoto of Lee KernDeveloped with NCSER funding, the Promoting Engagement with ADHD Pre-Kindergartners (PEAK) program has preliminary evidence of positive impacts on parent and child outcomes. Building on these findings, Principal Investigators (PIs) George DuPaul and Lee Kern are now testing the efficacy of the intervention with both face-to-face and online delivery methods. PEAK gives parents information on ADHD and a host of strategies, including behavioral management and response, reading and math skill development, and communication with school personnel to aid in the transition to kindergarten. The research team is comparing the face-to-face version, online version, and a control group without PEAK to determine the efficacy of the intervention and comparative efficacy between each method of delivery. They will also determine whether effects are maintained for up to 24 months after the end of the parent sessions.

English Language Learners (ELLs) in Early Elementary Grades

Photo of Nicole Schatz

PI Nicole Schatz and her team are addressing a gap in existing research: very few interventions for the development of language and reading skills in ELL students are tailored to those who also have disabilities, particularly for ELL students with behavior disorders such as ADHD. Their 2021 NCSER-funded study will examine whether language and behavioral interventions, delivered independently or combined, improve learning outcomes for kindergarten and first grade ELLs with or at risk for ADHD. The research team will examine the impact of one of these three interventions: 1) an educational language intervention involving small-group, interactive reading; 2) a behavioral classroom intervention; and 3) a combined intervention in which students receive both the language intervention and the behavioral classroom intervention.

Academic and Social Effects of Sluggish Cognitive Tempo (SCT) in Elementary and Middle School

Photo of Stephen Becker

SCT is an attention disorder associated with symptoms similar to ADHD, such as excessive daydreaming, mental confusion, seeming to be "in a fog,” and slowed behavior/thinking. In this recent extension of PI Stephen Becker’s initial NCER grant, he explores how SCT is associated with academic and social impairments over development. The research team will collect measures of student engagement and organization, withdrawal and social awareness, and contextual factors like student-teacher relationship and school climate. The yearly observations will follow cohorts of 2nd-5th graders through their 5th-8th grade years, half with and half without SCT.

Peer Support from Upperclassmen for 9th Graders with ADHD

Photo of Margaret Sibley

Sometime in adolescence, there tends to be a shift from the influence of parents and teachers to the influence of peers. With their recent grant from NCER, researchers Margaret Sibley and Joseph Raiker will be testing Sibley’s peer-intervention program, Students Taking Responsibility and Initiative through Peer-Enhanced Support (STRIPES). Developed with IES funding, STRIPES was designed to support students with ADHD by leveraging successful peer influence to address organization, time management, and planning. Supervised by a campus staff member, 11th and 12th grade students who have demonstrated academic and social competencies mentor 9th grade students with ADHD. These older peers are trained to help with goal setting, strategies for completing homework and organization, and maintenance of skills once the program is finished.

Stay tuned for findings and lessons learned from these newly funded studies.

Written by Julianne Kasper, Virtual Student Federal Service Intern at IES and graduate student in Education Policy & Leadership at American University.

Disability Research Informed by Researcher’s Experience as a Person with a Visual Impairment: An Interview with Dr. Rosenblum

As part of our recognition of National Disability Employment Awareness Month (NDEAM), we asked IES-funded researcher L. Penny Rosenblum how having a disability impacted the development of her career as a special education researcher.

As a person with a visual impairment, how have your background and experiences shaped your scholarship and career?

Photo of L. Penny Rosenblum, PhD I have a congenital visual impairment, so I have had low vision all my life. When I began my undergraduate studies, I quickly realized that I wanted to become a teacher of students with visual impairments (TVI). Once I began work, I came to the realization that I could have a larger and more sustaining impact on the education of students with visual impairments if I prepared TVIs. After earning my doctorate, I first was faculty at Florida State University and then at the University of Arizona. The combination of my own experiences as a child and adult with a visual impairment coupled with my experiences teaching children and then preparing TVIs worked together to shape my research agenda.

What got you interested in a career in special education research?

During my master’s program at Peabody College of Vanderbilt University, I was hired to enter data for a research study. I saw a pattern in the data others had not noticed and I shared this observation with the lead researcher and his doctoral students. This was a pivotal moment for me and sparked an interest in research. When I began my doctoral program and started to learn more about research methods and how outcomes can be used to shape intervention and policy, I was hooked!

What has been the biggest challenge you have encountered and how did you overcome the challenge?

As a researcher, the biggest challenge is funding. I was funded by “soft money” (funding through external sources) at the University of Arizona for 2 decades, the last 7.5 of which were primarily with funding from NCSER. During my career in academia, colleagues and I spent countless hours writing grants. I wish there were more efficient mechanisms to fund research so that researchers can spend more time engaged in research and less time chasing dollars to do research.

How does your research contribute to a better understanding of how to support students with disabilities?

I engage in research that directly impacts students with visual impairments. I was privileged to serve as a project director for two related NCSER projects: AnimalWatch-VI Suite: A comprehensive program for increasing access to science and math for students with visual impairments and An Intervention to Provide Youth with Visual Impairments with Strategies to Access Graphical Information in Math Word Problems. Through these projects we developed materials to support students at the middle school math level to build their skills with the ultimate goal of having more students with visual impairments enter STEM careers. More specifically, the first project developed and tested an instructional program that teaches students with visual impairment computation, fractions, and variables and expressions through solving math word problems embedded in an environmental science context; the second one developed and tested a program to teach students to locate and understand information in graphics that accompany math problems using tactile graphics and accessible image descriptions. I am proud that the materials we developed are available through the American Printing House for the Blind. Our two apps are available at no cost!

In your area of research, what do you see as the greatest research needs or recommendations to improve the career outcomes of students with disabilities?

We live in a digital world and until we have addressed the issue of universal access, students with visual impairments will continue to be at a disadvantage. If you’re at a disadvantage in K-12 education, then you’re not going to be as well prepared as others for post-secondary education and employment. I’d like to see research funding that addresses access issues and the development of technologies and tools to level the playing field for all students.

How can the broader education research community better support the careers and scholarship of researchers with disabilities?

Mentorship is so important to me. I have been fortunate in my journey to have some amazing mentors, including Dr. Carole R. Beal who was a principal investigator on the two NCSER-funded projects described above. Dr. Beal was always willing to discuss accommodations I needed due to my visual impairment and to work with me to find solutions. She mentored me in research methodology and professional writing. Researchers, whether they have a disability or not, need to mentor the next generation. I think this is even more important if an emerging scholar has a disability or is from another marginalized group.

What advice would you give to emerging scholars with disabilities who are pursuing a career in education research?

When I think about advice, I again immediately go back to mentorship. I encourage emerging scholars to seek out mentors, both with and without disabilities and in and outside their professional field. I also think it is important to seek out and take advantage of opportunities that come your way, and not wait for someone to come to you. The more networking you can do, the more doors that will open for you. If you’re passionate about your field and your work, people will quickly look beyond your disability and focus on your commitment and skills as a researcher.

L. Penny Rosenblum, PhD is the owner of Vision for Independence, LLC. She has more than 35 years of experience in the field of visual impairment.

This year, Inside IES Research is publishing a series of interviews (see here and here) showcasing a diverse group of IES-funded education researchers and fellows that are making significant contributions to education research, policy, and practice. This NDEAM blog post was produced by Katina Stapleton (Katina.Stapleton@ed.gov), co-Chair of the IES Diversity and Inclusion Council and NCER Program Officer, and Amy Sussman (Amy.Sussman@ed.gov), NCSER Program Officer. See this related NDEAM blog post by NCSER Program Officer Akilah Swinton Nelson (Akilah.Nelson@ed.gov) for information about IES Research on improving career readiness and employment outcomes for students with disabilities.

IES Research on Improving Career Readiness and Employment Outcomes for Students with Disabilities

Group of three students in vocational education and training for electronics

Accessibility to job opportunities has long been a challenge for individuals with disabilities. In 2020, people with disabilities had a much higher unemployment rate (12.6%) than those without a disability (7.9%). To raise awareness about disability employment issues and celebrate the contributions of workers with disabilities, National Disability Employment Awareness Month (NDEAM) is held every October. The 2021 theme for NDEAM is “America’s Recovery: Powered by Inclusion,” which underscores the importance of ensuring that people with disabilities have access to employment as the nation recovers from the pandemic.

NCSER supports research related to career readiness and employment for students with disabilities through the Transition to Postsecondary Education, Career, and/or Independent Living (Transition) research program. Since its inception in 2006, NCSER has invested over $58 million in the Transition program and the portfolio has grown to 38 research grants. To encourage additional research in the important but under-studied area, NCSER also competed the Career and Technical Education for Students with Disabilities (CTE) special topic in FY 2019 and FY 2020, awarding three research grants totaling around $3 million.

Below are examples of recently funded Transition and CTE studies that are exploring, developing, or evaluating programs, policies, and practices aimed to help improve career readiness and employment outcomes for students with disabilities.

NCSER also plans to support additional research for students with disabilities with a new grant competition, Research to Accelerate Pandemic Recovery in Special Education, funded through the American Rescue Plan. This grant competition will fund research that addresses pandemic recovery, including recovery relevant to career readiness.

For more information about NDEAM as well as ideas for celebrating this month, please see https://www.dol.gov/agencies/odep/initiatives/ndeam.

Written by Akilah Swinton Nelson, Program Officer at National Center for Special Education Research. For more information about the Transition to Postsecondary Education, Career, and/or Independent Living and Career and Technical Education for Students with Disabilities topic areas, contact Akilah at akilah.nelson@ed.gov.