IES Blog

Research on how people learn is critical for informing the design of effective education technology products. To design products that improve student learning, we need to understand how students approach solving problems, the information they need to adopt optimal solution strategies, the skills that underlie success in particular academic domains, the best ways to arrange information on a screen to guide student attention to relevant information, and the best study strategies for optimizing learning and retention. Through its research grants programs, IES has invested in research projects to develop and test education technology products based in the science of learning.

The 2021 ED Games Expo, which takes place virtually from June 1-5, features a number of these products, and you can learn more about them through a mix of live and pre-recorded sessions and videos. Most are ready to demo now. Students and educators can send questions about the research, game-play, or ed tech experience directly to the participating researchers. Here are just a few of the many ways you can interact with IES-funded researchers at the Expo:

1. The Virtual Learning Lab (VLL) will be hosting a live, virtual session on Friday, June 4^th from 4:00-5:30pm Eastern Time to celebrate their 5-year research collaboration to explore precision education in the context of algebra instruction. The VLL developed an AI-powered video recommendation system that personalizes math instruction within Math Nation. The researchers measured student ability and engagement, detected effects of virtual learning environment usage on achievement, and identified characteristics of effective online tutoring. The session will feature short talks and opportunities for Q&A: 

• A Video Recommendation System for Algebra (Walter Leite, University of Florida)
• Reinforcement Learning for Enhancing Collaborative Problem Solving (Guojing Zhou, University of Colorado Boulder)
• Natural Language Processing for VLE Research (Danielle McNamara, Arizona State University)
• Identifying Pedagogical Conversational Patterns in Online Algebra Learning (Jinnie Shin, University of Florida)
• Scaling Items and Persons for Obtaining Ability Estimates in VLEs (A. Corinne Huggins-Manley, University of Florida)
• Measuring Student Ability from Single- and Multiple-Attempt Practice Assessments in VLEs (Ziying Li, University of Florida)
• Detecting Careless Responding to Assessment Items in VLEs (Sanaz Nazari, University of Florida)
• Personalization, Content Exposure, and Fairness in Assessment (Daniel Katz, University of California, Santa Barbara)
• Fair AI in VLEs (Chenglu Li, University of Florida)

2. The ED Games Expo YouTube Playlist, which will be posted on June 1^st on the event page, features 26 products developed with IES grant funding. For ed tech products informed by research on how people learn, check out the products funded through the Cognition and Student Learning topic:

• Graspable Math allows math teachers to assign interactive algebra tasks and turns equations into tangible objects that middle school and high school students can manipulate to practice and explore. Teachers can follow live, step-by-step, student work.
• eBravo Boulder Reading Intervention is a self-paced personalized reading comprehension curriculum that teaches secondary students the problem-solving skills good readers use to learn from challenging texts, in this case in the science discipline of ecology. Reading strategies and exercises are guided by well-researched models of reading comprehension, helping students build deep, durable, and reusable knowledge from text. 
• iSTART and Writing Pal are interventions designed for middle school students, high school students, and young adults improve their reading and writing skills. Within these interventions, students play games to practice reading comprehension and writing strategies.
• All You Can Eat, Gwakkamole, and CrushStations are part of a suite of Executive Function skill-building games, designed to improve student shifting, inhibitory control, and working memory respectively.

We hope you can join us for this exciting event in June to learn more about and try out all the research-based products ready to be used in our nation’s schools. For more information on the featured resources and online events, please see this blog.

Written by Erin Higgins (Erin.Higgins@ed.gov), Program Officer for the Cognition and Student Learning program, National Center for Education Research

This May as we recognize National Mental Health Awareness Month, schools around the country are welcoming students and educators back for in-person instruction after more than a year of remote or hybrid teaching and learning. One issue schools must consider during this transition back is the increase in mental health concerns among adults, young adults, and adolescents this past year. Here at IES, we support research that explores, develops, and tests innovative, field-initiated approaches to support mental health in schools and classrooms. This new IES blog series will explore school-based mental health by looking at IES-funded research that helps answer the five Ws:

• Why school-based mental health? The first blog in the series will consider the benefits of school-based mental health such as providing increased access to services, especially for children of color, and potentially counteracting the stigma some associate with mental health treatment.

• What can schools do to support the mental health of their students and staff? The second blog in the series will highlight several projects that are developing innovative new ways to provide mental health services in school settings.

• When during the school day can schools implement these mental health practices so that they do not compete with the academic/instructional goals of school? The third blog in the series will highlight a variety of projects that delve into the implementation challenges inherent to providing school-based mental health services and support.

• Who in the school should implement these mental health practices? The fourth blog in the series will explore the critical scale up challenge for schools of having staff with adequate time who can be appropriately trained to provide mental health supports to students.

• Where can these mental health practices be implemented? The final blog in the series will investigate the implementation challenges of different education settings (PreK, elementary, middle, high school, postsecondary) for school-based mental health programs and practices.  

See these blogs for more information about some of the school-based mental health research supported through the two IES research centers, the National Center for Education Research (NCER) and the National Center for Special Education Research (NCSER).  

Written by Emily Doolittle (Emily.Doolittle@ed.gov), NCER Team Lead for Social Behavioral Research at IES

In 2018, Dr. Allison Master and co-PI Andrew Meltzoff were awarded a grant, Gender Stereotypes in STEM: Exploring Developmental Patterns for Prevention. This 4-year project explores how and when gender stereotypes about STEM career pathways emerge. The study also seeks to identify ways to mitigate the effects of such stereotypes, such as whether a growth mindset can lead to changes in student attitudes and outcomes toward STEM. As an undergraduate student majoring in microbiology at UCLA, Yuri Lin, virtual intern at NCER, was interested in learning more about gender inequalities and stereotypes in STEM education. She recently had a chance to talk with Dr. Master about her research and its implications for increasing STEM participation among women.

How is American culture affecting the STEM gender gap, and how does the US compare to other countries on this issue?

When children grow up in American culture, they see lots of TV shows and books where mathematicians, scientists, and engineers are men. STEM-based toys are also heavily marketed toward boys rather than girls. Some countries have begun changing the portrayal of gender stereotypes in the media. For example, the UK’s Advertising Standards Authority has recently started banning TV commercials that reinforce gender stereotypes. Some cross-national studies have shown that gender-STEM stereotypes favoring men are linked to women’s lower success and participation in STEM. The United States is one of many Western countries in which women have more equality and freedom to choose their careers but are much less likely to choose STEM careers than men. We still have a lot of work to do in the United States to break down barriers for women in STEM, and we need to focus on helping girls and women see the value in choosing pathways into STEM.

Why do you think it is important to examine growth mindset as a potential way to reduce the effects of stereotypes and increase STEM interest in students?

Growth mindsets are beliefs that personal characteristics can be changed, through effort or the right strategies. This is contrasted with fixed mindsets, which are beliefs that those characteristics can’t be changed. Growth mindsets are particularly helpful for struggling students. Students who have a growth mindset remain focused on learning rather than looking smart, believe effort is important, and stay resilient even when they experience setbacks. These attitudes translate into putting forth more effort and determination, which lead to greater success. In our project, we want to know if a growth mindset can help girls stay motivated in computer science, a subject that can have a steep learning curve. Girls in particular often get discouraged when they feel that they don’t have what it takes to succeed in STEM. We hope that teaching girls to have a growth mindset will protect them from these negative stereotypes and increase their confidence in themselves and their sense of belonging in computer science.

Considering that your project includes students from grades 1 to 12, how do you plan to share your findings with teachers, students, and policymakers? Are there differences in how you might communicate the information for different age groups?

As a developmental psychologist, I think it’s important to communicate the information about different age groups to everyone! It can be very valuable to frame student motivation in the broader context of how students are growing and changing. Students start to endorse stereotypes about computer science and engineering very early—Grades 1-3—so elementary school is a great time to start counteracting stereotypes by showing a broad representation of who enjoys and succeeds in STEM. We start to see big gender gaps in computer science interest during middle school, so this is a great time to have girls participate in fun and engaging coding classes. And we’ve already noted how important it is for girls in high school to have a growth mindset in their STEM classes.

We have different goals for communicating with teachers, parents, and policymakers. We know that teachers are very busy, so we try to condense things into the most important practical tips. We’ve made short videos and infographics about our research for teachers. For policymakers, we write policy briefs, which combines our research with other findings that are relevant to education policy. And when we talk to parents, we try to focus on the importance of the experiences they provide for their kids. We really value spreading the word about our research to make sure it reaches people who can use it to make a difference. For more information and access to the various resources, please visit the I AM Lab website.

Allison Master, PhD (@AllisonMaster), a developmental psychologist and an assistant professor at the University of Houston, has conducted extensive research on the development of motivation and identity in STEM education. 

Written by Yuri Lin (ylin010101@g.ucla.edu), intern for the Institute of Education Sciences and a Microbiology, Immunology, and Molecular Genetics major at UCLA.

In 2020, Andrei Cimpian, along with co-PIs Sapna Cheryan, Joseph Cimpian, and Sarah Lubienski, were awarded a grant for “Boys Have It; Girls Have to Work for It”: The Development and Consequences of Gender Stereotypes About Natural Talent vs. Effort in Mathematics. The goal of this project is threefold: 1) to explore the origins of the gender stereotype that girls achieve in math due to effort and boys achieve in math due to natural talent, 2) to investigate the consequences of these stereotypes, and 3) to identify ways of reducing the negative effects of these stereotypes on mathematics outcomes. In this blog, we interviewed Dr. Andrei Cimpian on his inspiration and insights on this research, as well as his plans to disseminate the findings to education practitioners.

What spurred your research, and what prior research was foundational for this current study? 

The co-PIs and I were inspired to do this research because we were struck by the contrast between two sets of facts. On the one hand, girls do better in school than boys from kindergarten to grade 12. Women also obtain more bachelor’s and graduate degrees than men. On the other hand, we as a society still think of men as more brilliant and genius-like than women. For example, participants in a 2018 study referred more male than female acquaintances for a job that they were told requires natural smarts¹. When the same job was said to require a strong work ethic instead, participants referred equal numbers of women and men.

Of course, societal views of women and men have changed quite a bit over the last century. With respect to general competence, women are now equal with men in the eyes of the American public. But the stereotype that associates “raw,” high-level intellectual talent with men more than women seems to have resisted change. Why?

Our research is testing a promising hypothesis: It is possible that people give different explanations for women’s and men’s intellectual successes, explaining men’s competence as being due primarily to their inborn intellectual talent and women’s as being due to their efforts. This effort-vs.-talent stereotype “explains away” women’s achievements by attributing them to a quality—perseverance—that is less valued in American culture than natural ability.

Versions of this explanatory stereotype have been documented in adults, but our project will provide its first systematic investigation among children. In particular, we will investigate the effort-vs.-talent stereotype in the domain of mathematics because innate ability is particularly valued in this domain¹, which might make this stereotype especially consequential.

What are some examples of language or behavior that might suggest an individual holds a particular stereotype? Are there potential ways of mitigating the negative effects of stereotypes?

The best example of this stereotype that I can think of—and this is in fact the anecdote that crystallized our team’s interest in this topic—was recounted by co-PI Joseph Cimpian in a recent piece for The Brookings Institution (emphasis is mine):

About five years ago, while Sarah [Lubienski] and I were faculty at the University of Illinois, we gathered a small group of elementary teachers together to help us think through […] how we could intervene on the notion that girls were innately less capable than boys. One of the teachers pulled a stack of papers out of her tote bag, and spreading them on the conference table, said, “Now, I don’t even understand why you’re looking at girls’ math achievement. These are my students’ standardized test scores, and there are absolutely no gender differences. See, the girls can do just as well as the boys if they work hard enough.” Then, without anyone reacting, it was as if a light bulb went on. She gasped and continued, “Oh my gosh, I just did exactly what you said teachers are doing,” which is attributing girls’ success in math to hard work while attributing boys’ success to innate ability. She concluded, “I see now why you’re studying this.”

In terms of what can be done to mitigate the effects of this stereotype, our project will investigate a potential strategy: normalizing effort by making it clear to students that everyone (not just particular groups) needs to work hard to learn math. This message reframes what is viewed as necessary for success in math away from the belief that natural talent is key, thereby undercutting the power of effort-vs.-talent stereotypes.

The current study focuses on elementary school students in grades 1 through 4. What was the motivation for choosing this specific age group?

In general, gender stereotypes about intellectual ability seem to emerge quite early. For instance, girls as young as 6 and 7 are less likely than boys to associate being “really, really smart” with members of their own gender. For this reason, we think it is really important to focus on young children—we need to understand when effort-vs.-talent stereotypes first take root!

“Catching” these stereotypes when they first arise is also important for intervention purposes. If left unchecked, the effects of effort-vs.-talent stereotypes may snowball over time (for example, differences in the types of careers that young women and men are motivated to pursue).

What plans do you have to disseminate the findings of this research in ways that will be useful for education practitioners? 

We are mindful of the importance of getting this research into the hands of teachers so that they can use it in practice. We hope to write articles on this work for media outlets that draw educationally oriented audiences. To reach parents as well, we will coordinate with popular media outlets to disseminate the results of this work to general audiences. More generally, we will make every effort to ensure that the findings have maximal societal impact, raising awareness of effort-vs.-talent stereotypes among parents, educators, and the general public.

Andrei Cimpian, PhD (@AndreiCimpian), Professor of Psychology at New York University, has conducted extensive research on children’s conceptual development, explanations, and motivation in school.

Written by Yuri Lin (ylin010101@g.ucla.edu), intern for the Institute of Education Sciences.

Photo credit: Brian Stauffer

IES values and encourage collaborations between researchers and practitioners to ensure that research findings are relevant, accessible, feasible, and useful. In FY 2014, Dr. Karen Thompson was awarded a grant for The Oregon English Learner Alliance: A Partnership to Explore Factors Associated with Variation in Outcomes for Current and Former English Learners in Oregon to determine best practices to support academic achievement among current and former English learners. Dr. Thompson and her colleagues wrote a guest blog post describing the work that the partnership undertook to better understand and improve the performance of English learners in Oregon. In this blog, we interviewed Dr. Thompson—three years after the end of the grant—to get her perspectives on the partnership, outcomes of their work, and where things currently stand.

What was the purpose of your research and what led you to do this work?

When I came to Oregon from California in 2012, there was growing momentum in the state to better understand and meet the needs of the state’s multilingual student population, particularly students classified as English learners (ELs). The state had developed an ambitious EL strategic plan, which included a variety of goals and action steps, such as identifying model programs and sharing best practices. I noticed that Oregon did not have publicly available information about the state’s former EL students. In prior work, other researchers and I had demonstrated that analyzing data only about students currently classified as English learners without also analyzing data about former EL students can provide incomplete and misleading information. Therefore, for Oregon to realize its goals and truly understand which programs and practices were most effectively educating its multilingual students, the state needed to make changes to its data systems. This was the seed that led to the Oregon Department of Education/Oregon State University English Language Learner Partnership. Our first goal was to simply determine how many former EL students there were in the state. Then, once the state had created a flag to identify former EL students, we were able to conduct a wide range of analyses to better understand opportunities and outcomes for both current and former EL students in ways that have informed state reporting practices and policy decisions.

How does this research differ from other work in the field? Why do you think partnerships with practitioners were necessary to carry out the work?

When we began our partnership, collecting and analyzing information about both current and former EL students was not common. Happily, more and more researchers and education agencies have now adopted these approaches, and we think our partnership has helped play a role in this important and illuminating shift.  

It was crucial to conduct this work via partnerships between researchers and practitioners. Practitioner partners had deep knowledge of the state’s current data systems, along with knowledge about which reporting and analysis practices could shift to incorporate new information about current and former EL students. Research partners had the bandwidth to conduct additional analyses and to lead external dissemination efforts. Our regular partnership meetings enabled our work to evolve in response to new needs. 

What do you think was the most important outcome of your work and why?

I think the most important outcome of our work is that educators across Oregon now have information about both their current and former English learner students and can use this data to inform policy and practice decisions. Other analyses we conducted have also informed state actions. For example, our analysis of how long it takes Oregon EL students to develop English proficiency and exit EL services informed the state’s EL progress indicator under the Every Student Succeeds Act.

What are the future directions for this work?

Our IES-funded partnership led to funding from the Spencer Foundation to do further research about EL students with disabilities in Oregon, which has impacted practices in the state. In addition, I am excited to be one of the collaborators in the new IES-funded National Research and Development Center to Improve Education for Secondary English Learners (PI: Aída Walquí, WestEd). As part of the Center’s research, I am working with colleagues at the University of Oregon and the University of California, Los Angeles to analyze malleable factors impacting content-course access and achievement for secondary EL students. We are collaborating with four states in this work, and as in our ODE/OSU partnership, we will be analyzing data for both current and former EL students. At a policy level, colleagues and I are involved in conversations about how data collection and reporting at the federal level could also incorporate analysis of data for both current and former EL students, including ways this might inform future reauthorizations of the Elementary and Secondary Education Act.

---

Dr. Karen Thompson is an Associate Professor at the College of Education at Oregon State University. Her research focuses on how curriculum and instruction, teacher education and policy interact to share the classroom experiences of K-12 multilingual students.

Written by Helyn Kim (Helyn.Kim@ed.gov), Program Officer for English Learner Program, National Center for Education Research.