Inside IES Research

IES widely supports and disseminates high-quality research focusing on science, technology, engineering, and mathematics (STEM) through NCER and NCSER. To celebrate National STEM Day on November 8 and every day, we highlight some of the work that NCER and NCSER have supported over the years in the various STEM areas, as well as opportunities for funding future work. Additional information about IES’s investment in STEM education can also be found on our STEM topic page.

Science

• Researchers developed ChemVLab+ an online chemistry intervention that allows high school students to perform experiments and analyze data in a flexible, multimedia virtual chemistry lab environment. The online modules promote conceptual understanding and science inquiry skills aligned to the Next Generation Science Standards. The chemistry activities are freely available on the project website.
• Researchers are developing Words as Tools, an intervention for emergent bilingual adolescents that is designed for use in English as a second language classes to promote development of metalinguistic awareness with science vocabulary. The lessons, being developed with a lens of culturally sustaining pedagogy, are intended to help build knowledge of essential science words as well as how words work in science.
• Researchers are evaluating the efficacy of an integrated science and literacy curriculum (ISLC) designed to engage first grade students in scientific investigations at a level appropriate for young learners. ISLC addresses the challenges of language and literacy development by ensuring that the language of science is brought forward and explicitly addressed in an integrated approach.
• Through Project MELVA-S, researchers are developing an online formative assessment that measures the science vocabulary knowledge of Latinx bilingual students with different levels of English and Spanish language proficiencies. Results from the assessment can be used to monitor the progress of individual students, help teachers differentiate language and vocabulary instruction, and provide additional science vocabulary supports.

Technology

• Using The Foos by codeSpark, researchers are exploring computational thinking processes in grades 1 and 3 through a series of classroom-based studies.
• Researchers are evaluating the efficacy of the CAL-KIBO curriculum, an educational robotics program designed for use with early elementary school-aged students to examine its impact on computational thinking, fluid reasoning, and math achievement.
• Researchers are systematically investigating how specific features of immersive virtual reality (IVR) can be used to improve student outcomes in science learning. In particular, the researchers are exploring how visual and auditory IVR design features can enhance affective state and cognitive processing in general and for specific subgroups of learners.
• Researchers are developing and testing TaylorAI, an artificial intelligence formative feedback and assessment system for hands-on science investigations to help build student competence as they engage in laboratory activities.
• In partnership with the National Science Foundation, IES is co-funding two National Artificial Intelligence (AI) Institutes. Under NCER, the Institute for Inclusive and Intelligent Technologies for Education (INVITE) is developing artificial intelligence (AI) tools and approaches to support behavioral and affective skills (for example, persistence, academic resilience, and collaboration) to improve learning in STEM education. Under NCSER, the AI Institute for Exceptional Education (AI4ExceptionalEd) is using multiple cutting-edge AI methodologies to create the technology to assist speech-language pathologists with identifying students in need of speech and language services and delivering individualized interventions.

Engineering

• Researchers are developing an innovative teacher professional learning intervention called Elevating Engineering with Multilingual Learners that is intended to help grade 3-5 teachers develop the knowledge and skills they need to effectively teach engineering to English learners and all students through culturally and linguistically responsive pedagogies and engineering instruction.
• Product developers and researchers are developing and testing NEWTON-AR, an augmented reality (AR) application-based engineering, computer science, and STEM puzzle game for children in kindergarten to grade 3. Intended for use in classrooms, after-school programs, and at home, NEWTON-AR will combine AR, engineering, simulation, making, and programming into a sandbox game where students create, modify, simulate, prototype, and test contraptions to solve puzzle challenges.

Mathematics

• Researchers have developed and tested for efficacy of Fusion, a first-grade intervention aimed at developing understanding of whole numbers for students at risk for mathematics learning disabilities. It is designed as a program for schools using a multi-tiered approach to instruction that provides increasingly intense levels of instruction based on the results of frequent progress monitoring of students.
• Researchers tested for efficacy of Pirate Math Equation Quest, a word problem-solving intervention for third grade students with mathematics difficulties, including students with or at risk for mathematics learning disabilities.
• Researchers assessed the efficacy of Interleaved mathematics practice, an intervention that rearranges math practice problems so that 1) different kinds of math problems are mixed together, which improves learning, and 2) problems of the same kind are distributed across multiple assignments, which improves retention. A new systematic replication study is also now underway to further examine the efficacy of interleaved mathematics practice.
• Researchers have conducted several impact studies (one conducted with grade 7 students in Maine and replication study conducted in North Carolina) of ASSISTments, a free web-based program that provides immediate feedback to students and teachers on homework. ASSISTments can be used with any commercial or locally developed math curriculum, and teachers can assign "mastery" problem sets that organize practice to facilitate the achievement of proficiency.  

STEM Education Research Funding Opportunities

Research grant funding opportunities focusing on STEM education can be found across several programs and competitions. Currently, there are several active funding opportunities where training or research with a STEM education focus would fit:  

• Early Career Development and Mentoring Program for Education Research – Contact: Jennifer.Schellinger@ed.gov; Deadline: January 11, 2024
• Early Career Development and Mentoring Program for Faculty at Minority-Serving Institutions (MSIs) – Contact: Katina.Stapleton@ed.gov; Deadline: January 11, 2024
• Extending the Reach of the Career and Technical Education (CTE) Research Network – Contact: Corinne.Alfeld@ed.gov;  Deadline: January 11, 2024
• Digital Learning Platforms to Enable Efficient Education Research Network – Contact: Erin.Higgins@ed.gov; Deadline: January 11, 2024  

More information on these fundings opportunities can also be found at: https://ies.ed.gov/funding/

This blog was written by Sarah Brasiel (sarah.brasiel@ed.gov), program officer at NCSER and Christina Chhin (christina.chhin@ed.gov), program officer at NCER.

The Department of Education’s Small Business Innovation Research Program (SBIR), which IES administers, funds the research, development, and evaluation of new, commercially viable education technology products. In this guest blog, Abi Olukeye of Smart Girl HQ discusses the inspiration behind her recently completed SBIR project, Dear Smart Girl, and the importance of helping girls envision themselves in STEM Careers.

What is Dear Smart Girl?

Our Dear Smart Girl platform is a learning experience that combines online interactive game-based learning curriculum with offline engaging activity kits and personalized STEM learning recommendations to enable elementary-aged girls achieve STEM career literacy by age 12. Our Dear Smart Girl platform is the only STEM career education platform on the market with an ecosystem of products with a research-driven design featuring age-appropriate, experienced-based informal learning content designed to facilitate STEM discovery, self-efficacy, and fluency for young female-identifying learners.

Through our Dear Smart Girl digital platform, we transform the way girls perceive and engage in STEM learning pathways by providing an innovative multi-stage learning experience.

Learning begins in the whimsical town of Ingenia, where learners are immersed into a digital world that is designed to capture aesthetics and themes that resonate with female-identifying students. Learners begin by selecting a storyline, each of which is associated with a STEM career and features a project-based problem-solving activity. Along the way, students gain new vocabulary and fluency with the subject area being exposed to them. In stage two, learners take their new skills offline and work to complete the real-life version of their game project using our complementary Dear Smart Girl project kit. These two stages of learning combine powerfully to strategically introduce, challenge, and engage young girls in STEM career exploration that builds their confidence and literacy in STEM pathways.

What inspired you to create the Dear Smart Girl platform?

The idea was born out of personal need. I started observing that at about age 3 my daughters were often describing toys and activities as either “boy things” or “girl things.” I was really stunned to see how early biases develop and felt strongly about finding ways to balance out their views. My first instincts were to find more toys and activities that would appeal to them and activities that would expose them broadly. And I fully anticipated that a quick internet search would surface plenty of options. I was so wrong. Not only were there limited options, most of what I found did not appeal to my daughters in terms of type of activity and aesthetics.

Reflecting on my own experience as someone who has a STEM degree and was, at the time, working at a global manufacturing firm leading technical projects, I decided to dive into the research about girls and STEM. I discovered that although women participate equally in the labor force, they only make up 28% of the STEM workforce. In addition, early adolescence tends to be when girls lean away from STEM at a higher rate than their male peers. That inspired me to work with other talented and passionate people to build products and facilitate experiences and help young female-identifying learning achieve STEM career literacy by age 12.

What are the types of STEM careers featured in Dear Smart Girl and why did you choose them?

Our pilot career module is an electrical engineering module, but over the course of the next two years, we are working to add five more game modules featuring chemical science, mechanical engineering, biology, software development and product designer careers. We select careers based on science standards being taught in 4th–7th grade. Our goal is to take topical themes and relate them to their real-world applications while also putting them in the context of the career domains that features the scientific concept and related skills. We also working to align to the National Career Clusters framework, which supports Career Technical Education (CTE) programs. 

What elements of Dear Smart Girl are uniquely tailored to female-identifying students?

We tailor our product to help sustain interest in STEM Career pathways in the following ways.

• We are intentional about selecting and mapping careers in ways that show real-world relevance. Anecdotally, we find that when learners are excited about what they are building, they are more engaged and motivated to learn the skills needed to accomplish their goal.
• We optimize our projects to create an experience that is a perfect blend of learning a new technical skill and creative design. According to Microsoft research on closing the STEM gap, 91% of girls describe themselves as creatives. When girls learn about how real-world STEM jobs can be used to help the world, their perception of the creativity and positive impact of STEM careers can more than double.
• We use beautiful illustrations, colors, and imagery to creative engaging worlds and digital environment rich with representation for diverse female-identifying students.

What advice can you give technology developers who focus on female-identifying students?
For developers working on products designed for female-identifying students, I recommend a collaborative development approach. We co-create every career module we work on with students to get feedback early and often. While it is easy to fall for stereotypical storylines, female-identifying students have diverse needs, interests, and learning styles that should be celebrated with well-designed learning platforms.

What are the next steps for Dear Smart Girl?

We are so excited to have been recently award a phase 2 award to expand and commercialize our career exploration modules. Over next two years, we will develop and launch five additional career modules, expand educator tools, build in extension activities, and launch to CTE programs across the country.

Abi Olukeye is the founder and CEO of Smart Girl HQ, a company dedicated to closing the gender gap for females in the STEM pipeline by increasing the number of positive experiences young girls have with STEM early in their learning journey. Her vision is to create an ecosystem of products that when used together are a powerful catalyst for sustaining long-term engagement in STEM for young girls. Her work has been supported by National Science Foundation and the Department of Education through Small Business Innovation Research (SBIR) Awards, the NC Idea Foundation, and the Vela Education Fund. Abi is the chair of the board of CSEdResearch.org and a past member of the Computer Science K12 Standards Committee for North Carolina. She holds a bachelor’s degree in computer science from Virginia Tech and MBA from Indiana University. She and her husband live in Charlotte, NC and have two young daughters who greatly inspire her work.

This blog was produced by Katina Stapleton (Katina.Stapleton@ed.gov), co-chair of the IES Diversity Council.

The Institute of Education Sciences (IES) held two Learning Acceleration Challenges during the 2022–23 school year, designed to incentivize innovation in math and science. The Math Prize sought school-based, digital interventions to significantly improve math outcomes, specifically in fractions, for upper elementary school students with or at risk for a disability that affects math performance. An unprecedented number of students are performing below grade level in core academic subjects according to the most recent data from the National Assessment of Educational Progress. In response to this problem, the grand prize required interventions to reach an effect size equal to or exceeding 0.77 on a broad measure of math achievement, the NWEA® MAP™ Growth math assessment. The challenge included two phases: In Phase 1, intervention providers submitted information on their interventions and research plans for implementing and testing their interventions under routine conditions. In Phase 2, selected research teams (finalists) were given $25,000 to implement and test their interventions with a shot at receiving the grand prize.

There were four submissions scored by a panel of judges during Phase 1. Two teams were selected to proceed to Phase 2 of the challenge to implement their intervention in schools: The DRUM (Digital Rational Number) Intervention and the ExploreLearning’s Reflex + Frax intervention. These two interventions were implemented in schools between November 2022 and April 2023 and participating students completed the NWEA MAP Growth math assessment before and after implementation. At the completion of Phase 2, the judging panel scored the Phase 2 submissions according to a rigorous set of criteria that included impact (as evaluated by a randomized controlled trial), cost effectiveness, scalability, and sustainability. Based on the scores received by the finalists, the panel did not recommend awarding any Phase 2 Prizes.

We recognize this challenge was an ambitious and rapid effort to improve math achievement. With the knowledge gained from this challenge, we hope to continue to design opportunities that encourage transformative, innovative change within education. While disappointing, these results shed light on some of the challenges of targeting ambitious improvements in student math achievement:

• The implementation hurdles experienced by both teams reinforce the difficulties of conducting research in schools, especially in the current post-pandemic era climate. In the present circumstances, many schools face extra strains that may make it challenging to implement new interventions, as is required during an RCT.
• It has historically been, and continues to be, difficult to create accelerated growth in math achievement for students who are with or at risk for disabilities that affect math performance. An improvement in line with the challenge’s 0.77 effect size criterion for the grand prize would substantially lessen the average achievement gap between students with disabilities and their nondisabled peers—and would be no small feat!
• Barriers still exist to implementation of a technology-based intervention. For intervention developers, the cost and time required to create a digital intervention can be very large. For schools, the necessary infrastructure and acceptance of digital interventions is not always present.
• Researching interventions within schools takes a lot of time and resources. Sometimes getting answers to our most pressing educational problems takes time, despite the best efforts of those involved to accelerate this process. The results of this competition underscore the continued need for research to support the significant difficulties of this population of learners.

Thank you to all who participated. We would also like to thank Luminary Labs, the contractor providing support for the IES Learning Acceleration Challenges and the two strong partners they included in the work: NWEA and Abt Associates. We appreciate NWEA’s support in conducting the evaluation of the effects of the intervention on the MAP Growth assessment and Abt Associates for their technical assistance during the Phase 2 implementation. We also appreciate all their work to collect and summarize data to understand what we can learn from the challenges and recommendations from other open innovation initiatives to inform future similar work at IES.

If you have an intervention or an idea for an intervention that could accelerate math achievement for students with or at risk for disabilities, you are encouraged to learn more about additional funding opportunities at IES, and contact Sarah Brasiel, program officer for NCSER’s STEM topic area.

This blog was written by Britta Bresina, NCSER program officer.

As part of the IES 20^th Anniversary celebration, we are continuing to highlight projects that exemplify research conducted through an equity lens. For this blog, we asked Carol Martin (Arizona State University) to discuss her IES-funded project focused on exploring associations between gender integration in classrooms and student academic engagement and performance in elementary school grades.    

What motivated your team to study the relation between gender integration in classrooms and academic outcomes?

Think about the last time you watched children playing with their peers. Did you notice how the children formed groups, with boys hanging out and talking to other boys, and girls doing the same with other girls? This is a common pattern: Children (and adults) tend to seek out others like themselves. Classic research from the 1970s demonstrated that this used to be common in classrooms, but in over 50 years, there has been almost no research confirming that this pattern might still be happening in contemporary U.S. classrooms.

Our IES-funded team set off to see if it was still occurring, and if so, whether this pattern might limit academic success. We hypothesized that if a student does not feel a sense of belonging or comfort with most students in their class, the school environment is unlikely to be conducive for learning and engagement. In contrast, when students feel comfortable and accepted by most of their peers in the classroom, learning and motivation at school should be enhanced.

What are your research findings?

In our research involving 3^rd- to 5^th-grade students in the Phoenix metro area in Arizona, we began with questions about how to best measure what we are calling gender integration (GI).  We acknowledge that gender is fluid and not a binary of women/girls and men/boys; however, most children in elementary school have stereotypes about these two groups, so it made sense to us to focus on these groups.

In one study, to measure GI, we asked every student how often they interacted with every other student in class. When we looked at these scores by classroom, we found that gender segregation is strong even today. Out of the 26 classrooms included in the study, 24 showed higher levels of interactions among same-gender peers in working groups as compared to what was seen in mixed-gender groups. In addition, we found that feeling included by other-gender peers early in the school year contributed to later improved feelings about school, and this mattered more than did feeling included by same-gender peers.

We recently finished a study in which we examined whether GI is related to academic outcomes such as math and science self-concepts and STEM achievement. We found that GI measured in the fall semester was related to STEM achievement, measured in the spring semester, through improved STEM academic beliefs. We thought it might be the case that this pattern would be found for girls but not boys because of the stereotyped nature of STEM; however, both girls and boys showed this pattern.

Based on your preliminary research findings, what advice would you give to teachers or school leaders?

First off, it is clear that gender segregation is still very strong today. As such, it is important for teachers (and other adults) to be mindful of the need to encourage students to develop relationships with diverse classmates. Teachers can intentionally shape interactions within their classes in a variety of ways. One is by student seating arrangements, and another is in choices of how students are grouped to work together. Teachers can also ensure that students recognize the value of having diverse peer experiences by letting students know that interacting with others who differ from themselves is useful and beneficial. Also, there are relatively simple strategies such as “buddy up” in which teachers mindfully pair students for classwork, which has been shown to help students to mingle more widely with others and to learn from them.

How does your research contribute to a better understanding of the importance of diversity, equity, and inclusion in education?

Every aspect of our work is related to the importance of diversity, equity, and inclusion in education. We study the importance of having diverse classrooms (mixed-gender in our case) and breaking down barriers that separate people from each other but stress that this diversity matters only when it is perceived as inclusive and fosters a sense of belonging. For some students, additional supports might be needed to feel included, and we hope to identify which students may need these additional supports and what types of support they need to promote equity in classrooms around issues of social belongingness. When these pieces come together, students are supported, and the learning environment is greatly enhanced.

What are the next steps for your research team?

We are interested in expanding our work to consider other individual characteristics of students and how those relate to GI and academic success. For instance, once all our data are amassed, we intend to examine race and ethnic differences in GI. Furthermore, we are interested in assessing how gender beliefs and identity of students relate to their academic success. In future work, we are interested in exploring in-depth how interventions such as buddying strategies work in classrooms, and how to promote more diverse interactions and classroom experiences that promote optimal academic and social competence.

This blog was produced by Christina Chhin, NCER (christina.chhin@ed.gov).

International and national assessment data show that many U.S. students struggle with mathematics, and there continues to be a gap between students with and without disabilities. The recent 2022 NAEP mathematics results continue to showcase these disparities, which have been further exacerbated as a result of the COVID-19 pandemic, particularly for lower-performing students and students of color.

In honor of Mathematics and Statistics Awareness Month, we want to highlight the research IES is supporting to improve mathematics achievement and access to educational opportunities for all learners, especially learners who have been historically underserved and underrepresented in STEM education.

IES is supporting research through its discretionary grant competitions to measure, explore, develop, and evaluate effective mathematics programs, practices, and policies for all students, including those with or at risk for disabilities. Here are a few highlights of some new research supported by IES:

• Interleaved Mathematics Practice – Bryan Matlen (WestEd) and colleagues are conducting a systematic replication of a highly promising mathematics learning intervention, interleaved practice, in 7th grade classrooms. With the interleaved practice intervention, some of the assigned math practice problems are rearranged so that problems of different kinds are mixed together, which improves learning, and problems of the same kind are distributed across multiple assignments, which improves retention. Numerous studies in the laboratory and classroom have demonstrated that merely rearranging practice problems so that the students receive a higher dose of interleaved practice can dramatically boost scores on measures of learning. This replication study will determine whether this promising intervention can improve math learning and achievement and whether the intervention can scale to a widely-used online intervention that currently reaches tens of thousands of students in diverse settings.
• Educational Technology Approaches to K-12 Mathematics – Jennifer Morrison (Johns Hopkins University) and colleagues are conducting a meta-analysis of rigorous evaluations of approaches that use technology to improve student mathematics achievement in grades K to 12. Using meta-analytic techniques, the team will be identifying conditions under which various types of technology applications are most effective in teaching mathematics. The results will provide researchers and education leaders with up-to-date information on effective uses of technology, including computer assisted instruction, cooperative learning, intelligent tutoring systems, games, simulations, virtual reality, inquiry/discovery, project-based learning, and media-infused instruction.
• Specialized Intervention to Reach All Learners - Sarah Powell (University of Texas at Austin) and colleagues are conducting an initial efficacy evaluation of Math SPIRAL, an educator-provided mathematics intervention for students identified as needing intervention services through state achievement testing in grades four and five. Educators are provided with an evidence-based word problem intervention (Pirate Math Equation Quest), associated professional development, and coaching to support implementation and address the needs of their learners who are struggling in math. The research team will evaluate the impact of Math SPIRAL on mathematics outcomes for upper elementary students identified as being with or at risk for a disability. The results will provide information on the efficacy of Math SPIRAL as a tool to accelerate the learning of students in need of math intervention.
• Math and Reading Acquisition Co-Adaptive System – Jess Gropen (Center for Applied Special Technology), Steve Ritter (Carnegie Learning), and their research team are iteratively developing and studying a set of individualized reading supports for students embedded within an adaptive mathematics learning system (MATHia) and an associated teacher application (LiveLab). Heuristics will determine when reading supports or scaffolds should be provided or recommended to students. In addition, adaptive supports for teachers will alert them when students are likely exhibiting reading challenges and provide recommendations for intervention. The findings will determine whether these reading supports that can be embedded into a variety of digital and/or adaptive math tools to decrease reading challenges and increase students' ability to engage effectively with math. The findings and generated technical resources (such as design assets and heuristics) will be Creative Commons licensed and made available through GitHub for use by other developers.

In August 2022, IES also launched the Learning Acceleration Challenge (LAC) Math Prize to identify and award school-based, digital interventions that significantly improve math outcomes for upper elementary school students with or at risk for a disability that affects math performance. Interventions for the Math Prize needed to specifically focus on fractions and could also include prerequisite skills such as whole numbers and operations. Two interventions are currently competing for the math prize and the winner will be announced Fall 2023.

In addition, IES has developed Practice Guides with evidence-based recommendations for educators to address challenges in their classrooms and schools. A list of the mathematics focused Practice Guides can be found here.

This blog was written by Christina Chhin (christina.chhin@ed.gov), NCER; Sarah Brasiel (sarah.brasiel@ed.gov), NCSER; and Britta Bresina (britta.bresina@ed.gov), NCSER.