Inside IES Research

IES widely supports and disseminates high-quality research focusing on science, technology, engineering, and mathematics (STEM) through NCER and NCSER. To celebrate National STEM Day on November 8 and every day, we highlight some of the work that NCER and NCSER have supported over the years in the various STEM areas, as well as opportunities for funding future work. Additional information about IES’s investment in STEM education can also be found on our STEM topic page.

Science

• Researchers developed ChemVLab+ an online chemistry intervention that allows high school students to perform experiments and analyze data in a flexible, multimedia virtual chemistry lab environment. The online modules promote conceptual understanding and science inquiry skills aligned to the Next Generation Science Standards. The chemistry activities are freely available on the project website.
• Researchers are developing Words as Tools, an intervention for emergent bilingual adolescents that is designed for use in English as a second language classes to promote development of metalinguistic awareness with science vocabulary. The lessons, being developed with a lens of culturally sustaining pedagogy, are intended to help build knowledge of essential science words as well as how words work in science.
• Researchers are evaluating the efficacy of an integrated science and literacy curriculum (ISLC) designed to engage first grade students in scientific investigations at a level appropriate for young learners. ISLC addresses the challenges of language and literacy development by ensuring that the language of science is brought forward and explicitly addressed in an integrated approach.
• Through Project MELVA-S, researchers are developing an online formative assessment that measures the science vocabulary knowledge of Latinx bilingual students with different levels of English and Spanish language proficiencies. Results from the assessment can be used to monitor the progress of individual students, help teachers differentiate language and vocabulary instruction, and provide additional science vocabulary supports.

Technology

• Using The Foos by codeSpark, researchers are exploring computational thinking processes in grades 1 and 3 through a series of classroom-based studies.
• Researchers are evaluating the efficacy of the CAL-KIBO curriculum, an educational robotics program designed for use with early elementary school-aged students to examine its impact on computational thinking, fluid reasoning, and math achievement.
• Researchers are systematically investigating how specific features of immersive virtual reality (IVR) can be used to improve student outcomes in science learning. In particular, the researchers are exploring how visual and auditory IVR design features can enhance affective state and cognitive processing in general and for specific subgroups of learners.
• Researchers are developing and testing TaylorAI, an artificial intelligence formative feedback and assessment system for hands-on science investigations to help build student competence as they engage in laboratory activities.
• In partnership with the National Science Foundation, IES is co-funding two National Artificial Intelligence (AI) Institutes. Under NCER, the Institute for Inclusive and Intelligent Technologies for Education (INVITE) is developing artificial intelligence (AI) tools and approaches to support behavioral and affective skills (for example, persistence, academic resilience, and collaboration) to improve learning in STEM education. Under NCSER, the AI Institute for Exceptional Education (AI4ExceptionalEd) is using multiple cutting-edge AI methodologies to create the technology to assist speech-language pathologists with identifying students in need of speech and language services and delivering individualized interventions.

Engineering

• Researchers are developing an innovative teacher professional learning intervention called Elevating Engineering with Multilingual Learners that is intended to help grade 3-5 teachers develop the knowledge and skills they need to effectively teach engineering to English learners and all students through culturally and linguistically responsive pedagogies and engineering instruction.
• Product developers and researchers are developing and testing NEWTON-AR, an augmented reality (AR) application-based engineering, computer science, and STEM puzzle game for children in kindergarten to grade 3. Intended for use in classrooms, after-school programs, and at home, NEWTON-AR will combine AR, engineering, simulation, making, and programming into a sandbox game where students create, modify, simulate, prototype, and test contraptions to solve puzzle challenges.

Mathematics

• Researchers have developed and tested for efficacy of Fusion, a first-grade intervention aimed at developing understanding of whole numbers for students at risk for mathematics learning disabilities. It is designed as a program for schools using a multi-tiered approach to instruction that provides increasingly intense levels of instruction based on the results of frequent progress monitoring of students.
• Researchers tested for efficacy of Pirate Math Equation Quest, a word problem-solving intervention for third grade students with mathematics difficulties, including students with or at risk for mathematics learning disabilities.
• Researchers assessed the efficacy of Interleaved mathematics practice, an intervention that rearranges math practice problems so that 1) different kinds of math problems are mixed together, which improves learning, and 2) problems of the same kind are distributed across multiple assignments, which improves retention. A new systematic replication study is also now underway to further examine the efficacy of interleaved mathematics practice.
• Researchers have conducted several impact studies (one conducted with grade 7 students in Maine and replication study conducted in North Carolina) of ASSISTments, a free web-based program that provides immediate feedback to students and teachers on homework. ASSISTments can be used with any commercial or locally developed math curriculum, and teachers can assign "mastery" problem sets that organize practice to facilitate the achievement of proficiency.  

STEM Education Research Funding Opportunities

Research grant funding opportunities focusing on STEM education can be found across several programs and competitions. Currently, there are several active funding opportunities where training or research with a STEM education focus would fit:  

• Early Career Development and Mentoring Program for Education Research – Contact: Jennifer.Schellinger@ed.gov; Deadline: January 11, 2024
• Early Career Development and Mentoring Program for Faculty at Minority-Serving Institutions (MSIs) – Contact: Katina.Stapleton@ed.gov; Deadline: January 11, 2024
• Extending the Reach of the Career and Technical Education (CTE) Research Network – Contact: Corinne.Alfeld@ed.gov;  Deadline: January 11, 2024
• Digital Learning Platforms to Enable Efficient Education Research Network – Contact: Erin.Higgins@ed.gov; Deadline: January 11, 2024  

More information on these fundings opportunities can also be found at: https://ies.ed.gov/funding/

This blog was written by Sarah Brasiel (sarah.brasiel@ed.gov), program officer at NCSER and Christina Chhin (christina.chhin@ed.gov), program officer at NCER.

In honor of Attention Deficit Hyperactivity Disorder (ADHD) Awareness Month, we would like to share an interview with Dr. Gregory Fabiano, who has been investigating the enhancement of Individual Education Programs (IEPs) for children with ADHD using daily report cards (DRC). The DRC provides a way to provide feedback to students, parents, and teachers on behavioral and social IEP goals on a daily basis. In the interview below, Dr. Fabiano shares how ADHD impacts student outcomes and how linking the DRC to IEP goals can improve social and academic outcomes above and beyond what an IEP alone can do.

What do we already know about how ADHD impacts academic and social outcomes in children in elementary school? How does this motivate your own research?

Like all people, individuals with ADHD have areas of strengths and weaknesses. If you wanted to create a situation where a person with ADHD is more likely to demonstrate weaknesses, you would likely construct a situation like an academic classroom—long periods of time where individuals are asked to complete rote tasks, attend to lectures, and follow strict rules about where they should be, what they can say, and when they can say it. The situation is highly likely to exacerbate challenges with staying on task and being productive. Through our team’s work with so many children with ADHD, we have seen first-hand how hard their caregivers and teachers work to support them and the good they can do when they are successful. That is why we are motivated to develop approaches to help every child with ADHD who may struggle in school.

The DRC has been used with students with ADHD for a while now. What can you tell us of the history of this intervention?

The DRC has been around since the 1960s when it was used by scholars such as Jon Bailey and colleagues at the University at Kansas and then by Dan and Sue O’Leary and their graduate student Bill Pelham at Stony Brook University. Since that time, the DRC has been disseminated to schools. It has the advantage of being practical and easy to understand across caregivers, educators, and the child. Throughout its use over the past 50 years, it has always included the same active ingredients: (1) clearly specified behavioral goals with objective criteria for meeting goals (for example, completes assigned work within time given, has no more than three instances of interruptions during the science lesson); (2) provision of progress feedback throughout the day; (3) daily communication between the teacher, caregiver, and child by sending the report home; and (4) contingent rewards provided at home for goals achieved.

What does a DRC introduce to a child’s IEP that can improve academic and social outcomes relative to an IEP without a DRC? 

Research, including our own work, has suggested that IEPs for children with ADHD may under-represent social/behavioral goals and objectives. They are even less effective at providing specific, ongoing evidence-based interventions for a student with ADHD. When the DRC is linked to IEP goals and objectives on a daily basis, educators and others are better able to focus their own attention on the most important areas of need. Further, it is flexible enough to quickly add worthy goals that may not have been on the IEP.

We think that the DRC is especially important at the elementary school level, where school is a particularly formative educational experience. We emphasize positive daily goals and contingent rewards for meeting goals. And because the DRC is implemented just for the one day, students start with a clean slate at the onset of each school day.

What impact do you hope that your study of the DRC intervention will have on the field, and for students with ADHD and their IEPs in particular?

One of the sobering findings of our IES-funded study was that the comparison group, which included special education as usual, did not improve in the main outcomes assessed at the end of the year. This leads our team to believe that we need to do much more to support students with ADHD on a daily and ongoing basis, beyond simply drafting an IEP. Because most students with ADHD spend the majority of their day in general education settings, even if they have an IEP, the DRC serves as a bridge to promote continuity and consistency of behavioral support across school personnel and across school days.

Is there anything else you would like to share about your project? 

It is important to note that some children with ADHD progress through school and find their footing successfully in college and/or career. Yet, we know from long-term follow-up studies that the educational outcomes for many with ADHD are poor. These outcomes do not occur suddenly, but instead are caused by the accumulation of negative school experiences. It is important to acknowledge that establishing an IEP alone is unlikely to influence these negative outcomes. It is the everyday support and intervention received by the child with ADHD in the classroom that makes the difference. Caregivers, educators, and the child must work together daily to make progress, celebrate successes, and problem solve to address any continued areas of need. The DRC is one way to do this and we are hopeful the field will continue to develop innovative ways to support individuals with ADHD using a competency-building approach.

This blog was authored by Skyler Fesagaiga, a Virtual Student Federal Service intern for NCSER and graduate student at the University of California, San Diego. Jackie Buckley, NCSER program officer, manages this grant.

This final post in our series of NCSER blogs highlighting the recently funded Early Career Development and Mentoring Grants Program principal investigators features an interview with Sara Estrapala, assistant research professor in special education at the University of Missouri, Columbia. Dr. Estrapala is conducting research aimed at improving self-regulation of high school students with disabilities and challenging behavior.

How did you become interested in research on self-regulation among high school students with disabilities? 

I worked in a high school as a special education paraeducator prior to my doctoral program and really enjoyed working with that student population. I was responsible for helping students manage themselves in their general education classes. This experience led me to wonder whether there were ways to teach students—particularly those with challenging behaviors— to be more self-sufficient. When I started my doctoral program, I worked on an IES-funded project to develop a self-monitoring app and witnessed the incredible impact that self-monitoring can have on student classroom behaviors. My classroom and research experiences merged into a line of research on self-regulation development for high school students with disabilities.

What is the broader challenge in education that you hope your study will address?

High schools are notoriously difficult settings in which to conduct behavior intervention research, due to increased demands on student and teacher time for academics, organizational complexity (for example, multiple teachers, classrooms, academic departments), and misconceptions about behavior supports for high school aged students. As such, there is a relatively limited literature base for researchers and practitioners related to behavior interventions or supports for high school students. I hope to develop an effective intervention specifically for this context and developmental level while also learning how to effectively conduct rigorous research in this complex and challenging environment. Ultimately, I aim to contribute to our collective knowledge about how to help support high school students with disabilities and challenging behavior. 

What sets apart your self-regulation intervention from other interventions that have been studied?

The most unique aspect of the self-regulation intervention that I am developing is that students have ownership over their self-regulation plan. Typically, students are provided with a self-regulation or self-management plan that is developed by an adult—such as their teacher, counselor, or behavior specialist—with very little opportunity for input. Because self-regulation interventions involve a lot of decisions (such as identifying target behaviors, goals, self-monitoring, and self-evaluation plans), there are numerous opportunities to ask students what they think will improve their classroom behavior. My goal is to develop a framework for teaching students how to identify and define their own behaviors that might be reducing their learning or classroom performance as well as replacement behaviors that will enable them to achieve greater academic success. I believe that including students in the decision-making process will help them better learn why self-regulation is important and how it can help them reach meaningful goals.

What advice do you have for other early career researchers?

Network. Network. Network. Find a variety of colleagues to work with, including those with similar and advanced years of research and practice. I find working with other researchers helps prevent feeling isolated and increases my motivation to keep pushing forward. Joining professional organizations and attending their social events has helped me meet peers with similar research experience and create a network for collaboration. This process also created opportunities for me to meet the faculty mentors of my peers, which, in turn, has helped me establish a larger network of mid- and late-career researchers.

Sara Estrapala demonstrates passion and insight in her research promoting self-regulation among high school students with disabilities. NCSER looks forward to following her career trajectory and the development of this exciting project.

This blog was produced by Emilia Wenzel, NCSER intern and graduate student at University of Chicago. Katherine Taylor is the program officer for NCSER’s Early Career Development and Mentoring program.

The Institute of Education Sciences (IES) held two Learning Acceleration Challenges during the 2022–23 school year, designed to incentivize innovation in math and science. The Math Prize sought school-based, digital interventions to significantly improve math outcomes, specifically in fractions, for upper elementary school students with or at risk for a disability that affects math performance. An unprecedented number of students are performing below grade level in core academic subjects according to the most recent data from the National Assessment of Educational Progress. In response to this problem, the grand prize required interventions to reach an effect size equal to or exceeding 0.77 on a broad measure of math achievement, the NWEA® MAP™ Growth math assessment. The challenge included two phases: In Phase 1, intervention providers submitted information on their interventions and research plans for implementing and testing their interventions under routine conditions. In Phase 2, selected research teams (finalists) were given $25,000 to implement and test their interventions with a shot at receiving the grand prize.

There were four submissions scored by a panel of judges during Phase 1. Two teams were selected to proceed to Phase 2 of the challenge to implement their intervention in schools: The DRUM (Digital Rational Number) Intervention and the ExploreLearning’s Reflex + Frax intervention. These two interventions were implemented in schools between November 2022 and April 2023 and participating students completed the NWEA MAP Growth math assessment before and after implementation. At the completion of Phase 2, the judging panel scored the Phase 2 submissions according to a rigorous set of criteria that included impact (as evaluated by a randomized controlled trial), cost effectiveness, scalability, and sustainability. Based on the scores received by the finalists, the panel did not recommend awarding any Phase 2 Prizes.

We recognize this challenge was an ambitious and rapid effort to improve math achievement. With the knowledge gained from this challenge, we hope to continue to design opportunities that encourage transformative, innovative change within education. While disappointing, these results shed light on some of the challenges of targeting ambitious improvements in student math achievement:

• The implementation hurdles experienced by both teams reinforce the difficulties of conducting research in schools, especially in the current post-pandemic era climate. In the present circumstances, many schools face extra strains that may make it challenging to implement new interventions, as is required during an RCT.
• It has historically been, and continues to be, difficult to create accelerated growth in math achievement for students who are with or at risk for disabilities that affect math performance. An improvement in line with the challenge’s 0.77 effect size criterion for the grand prize would substantially lessen the average achievement gap between students with disabilities and their nondisabled peers—and would be no small feat!
• Barriers still exist to implementation of a technology-based intervention. For intervention developers, the cost and time required to create a digital intervention can be very large. For schools, the necessary infrastructure and acceptance of digital interventions is not always present.
• Researching interventions within schools takes a lot of time and resources. Sometimes getting answers to our most pressing educational problems takes time, despite the best efforts of those involved to accelerate this process. The results of this competition underscore the continued need for research to support the significant difficulties of this population of learners.

Thank you to all who participated. We would also like to thank Luminary Labs, the contractor providing support for the IES Learning Acceleration Challenges and the two strong partners they included in the work: NWEA and Abt Associates. We appreciate NWEA’s support in conducting the evaluation of the effects of the intervention on the MAP Growth assessment and Abt Associates for their technical assistance during the Phase 2 implementation. We also appreciate all their work to collect and summarize data to understand what we can learn from the challenges and recommendations from other open innovation initiatives to inform future similar work at IES.

If you have an intervention or an idea for an intervention that could accelerate math achievement for students with or at risk for disabilities, you are encouraged to learn more about additional funding opportunities at IES, and contact Sarah Brasiel, program officer for NCSER’s STEM topic area.

This blog was written by Britta Bresina, NCSER program officer.

Schoolwide discipline policies are meant to reduce disruptions to student learning. However, research reveals that the use of exclusionary discipline policies and practices, involving in- and out-of-school suspension and expulsion, could lead to long-term harmful outcomes for students who are frequently excluded from learning environments. Exclusionary discipline increases the risk of academic failure, school dropout, and socioemotional and mental health problems. Importantly, research also indicates that students with disabilities are disproportionately likely to be subject to exclusionary policies. According to 2017-18 data from the Department of Education’s Office of Civil Rights, students with disabilities comprised approximately 13% of total school K-12 enrollment, yet receive about 25% of one or more out-of-school suspensions and 23% of all school expulsions. This pattern of school discipline demonstrates a pressing concern in modern education, requiring educators to explore systematic changes in current practice.

NCSER has been funding research projects that address school discipline for students with or at risk for disability, either directly or indirectly through interventions aimed at improving behavior. This blog features some examples of this work in elementary school, ranging from more focused student-level interventions to schoolwide efforts.

Timothy Lewis (University of Missouri, Columbia) and his colleagues are currently conducting a study aimed at evaluating the effectiveness of a behavioral intervention program called Check-in/Check-out. This intervention works to improve the social, emotional, and academic behavior of students at risk for emotional behavior disorder (EBD). Previous studies on Check-in/Check-out evaluated the intervention using single-case design research and small n group designs. This study expands the evidence base on Check-in/Check-out by employing a randomized controlled trial and assessing cost-effectiveness. Taking place in midwestern elementary schools, selected students at risk of EBD “check-in” with an intervention facilitator about daily behavioral goals. Students receive feedback and points (derived from a preestablished point system) from their teachers throughout the day about the extent to which they are meeting these goals. “Check-out” occurs at the end of the day, when points are recorded and the student takes this information home in a daily progress report. Results from this research project may offer insight on ways Check-in/Check-out can redirect student behavior at early stages, thus harboring the potential to decrease discipline rates among students with disabilities.

Carl Sumi at SRI International and his colleagues at the University of Florida evaluated the effectiveness of the Tools for Getting Along intervention, which focuses on educators rather than on individual students. Tools for Getting Along is designed to help teachers enhance social problem solving in their classrooms so that students and teachers can work together to improve behavior and decrease disciplinary action. Prior research revealed that among this intervention’s positive effects, some of the strongest impacts were on behavior regulation and problem-solving knowledge for students with or at risk for disabilities, specifically those with behavioral needs. This effectiveness study expanded upon this research by incorporating more locations with more diversity and using an independent evaluation team to conduct the randomized controlled trial within the context of a routine school environment. The research team recently concluded the study, reporting preliminary findings of significant positive impact of the intervention on teacher report of student social skills, behavioral regulation, emotional regulation, cognitive regulation, and executive functions, as well as student self-report of problem-solving knowledge. Ultimately, these changes in student behavior can lead to decreases in referrals for student discipline.

On broader, systems-level, Jeong Hoon Choi (University of Kansas) is testing a program, Resources Aligned and Integrated for Student Equity, that may help combat disproportionate exclusionary disciplinary practices. This intervention helps educator teams use data to better align and integrate general and special education resources to help students whose needs are not met through the universally and additionally provided instruction of the school. Embedded within a multi-tiered system of supports model, the intervention helps systematize team processes and decisions for those students with the most complex needs. Grade-level educator teams will participate in training, practice, and coaching to implement the practices, and the school district will receive technical assistance to help them sustain the intervention in their schools. The randomized controlled trial aims to determine whether schools receiving this intervention have better student academic and well-being outcomes, including reduced office discipline referrals and suspensions.

Kent McIntosh and Erik Girvan (University of Oregon) are addressing disproportionate disciplinary practices through more of a racial equity lens with a training targeting implicit bias among teachers. Project ReACT is a professional development program in which teachers are trained and coached over time to (a) identify specific situations where implicit bias likely occurred in discipline decisions by examining their own school discipline data with school leadership, (b) revise current discipline processes to better meet the needs of students from underserved and over-excluded groups, and (c) design strategies for teachers to minimize implicit bias in school discipline decisions. The research team assessed how exclusionary discipline rates changed in racially and ethnically diverse urban and rural elementary schools in several districts across the country. Using a randomized controlled trial, matching schools based on existing levels of inequities, the research team found that schools receiving the intervention experienced significant decreases in racial disparities in school discipline and office referrals for Black students.

NCSER investments in these projects demonstrate the commitment to finding effective, evidence-based solutions for improving behavior problems, and therefore reducing school discipline rates, for students with disabilities. While research continues to strive toward improving equity in this area, school leaders can also follow the guidelines issued by the Department of Education Office of Civil Rights and Office of Special Education and Rehabilitative Services to ensure fair treatment and access to services for students with disabilities regarding disciplinary measures.

This blog was authored by Isabelle Saillard, student volunteer for NCSER and undergraduate at the University of Virginia. Jackie Buckley is the program officer for NCSER’s Social, Emotional, and Behavioral Competence portfolio.