Inside IES Research

States and localities have discretion over gifted programs, but surprisingly little large-scale research compares the education environments of students in gifted programs to high-achieving, non-gifted students or investigates how these learning environments vary across districts. In this guest blog, Ben Backes, James Cowan, and Dan Goldhaber discuss their IES-funded exploration study, where they  use administrative and survey data to describe the relationship between gifted participation and access to educational resources across nearly 300 school districts in Washington State.

Gifted Access and Participation in Washington

The underrepresentation of low-income and minority students in gifted programs has attracted attention because identification procedures often include nomination or referral processes requiring subjective evaluation of student ability. Nationally, low-income and non-White students are significantly less likely to participate in gifted programs. To better understand who is in these gifted programs in Washington State, we are investigating participation in gifted programs by student race/ethnicity and socioeconomic status in grades 4–12. Consistent with prior studies, relative to White students, we observe Asian students being more likely to be found in gifted programs, while Black, Hispanic, and free and reduced-price lunch students are less likely to receive gifted services. Washington districts frequently use universal screening policies, and the Black-White and Hispanic-White gifted gaps disappear once statistical adjustments for prior test scores are used. We find little association between use of modifications for underrepresented minorities or low-income students—as reported by district coordinators—and gifted participation.

In sum, we find consistent evidence of disparities in access to gifted programs conditional on student achievement in Washington for low-income students, but less consistent evidence of disparities by student race/ethnicity. However, we only observe data on student academic aptitude beginning in third grade, and many classification decisions are made before this time. There may be disparities in initial gifted classification decisions for younger students.

Unsurprisingly, participation in gifted programs does affect student learning environments. Gifted students are much more likely to sit in classrooms with other high-achieving students and in more homogenous classrooms. These differences persist even after limiting the sample to high achievers. These patterns are most pronounced in elementary school. Gifted students are taught by more qualified teachers in elementary and middle school, as measured by experience, licensure test scores, and educational attainment. However, these effects are very small.

Differences Across Districts and Program Types

We find that although gifted students do tend to take more advanced courses with higher-achieving peers, there is considerable variation in the design of gifted programming across school districts.

• Although school districts tend to assign gifted students to more advanced academic tracks, we find that these effects are mostly concentrated in large urban and suburban districts. The estimated gifted effects on access to more advanced courses are typically much smaller in the western and eastern school districts in smaller cities and rural areas of the state.
• Larger, higher income districts in cities and suburbs operate gifted programs that provide more significant changes in learning environments. Students in these programs are more likely to share classrooms with other gifted students and with high-achieving students, and—in the case of large districts—sit in smaller classrooms with more qualified teachers.
• The structure of gifted programming also influences the type of instructional approaches districts employ. Self-contained gifted programs—where students are assigned to specialized classrooms for most of their instruction—report using a broad array of acceleration strategies. However, about one third of gifted students participate in programs offered through services in regular classrooms, where independent study, supplemental instruction, and flexible ability grouping appear to be important strategies.
• Well under half of districts have established gifted curricula for math or ELA. About 20% of gifted students are districts that report having a districtwide math curriculum and 25% are in districts that report having districtwide ELA curriculum. This finding is consistent with another study that surveyed districts in three states.

What’s Next?

There is a growing body of empirical literature providing causal estimates of the effect of gifted participation on student achievement which generally uses administrative data from a single school district. The results from this study of gifted programs across an entire state suggest that district-specific gifted programming effects are likely to vary substantially as the nature of the programs vary substantially across districts. This implies both that we should be cautious about generalizing based on district-level studies and that the variation in findings across studies may be indicative of true variation in program effectiveness. In the next stage of this project, we plan to investigate the extent to which this heterogeneity generates differences in the relationship between gifted participation and student achievement.

Ben Backes is a Senior Economist with CALDER at the American Institutes for Research.

James Cowan is a Senior Researcher with CALDER at the American Institutes for Research.

Dan Goldhaber is the Director of CALDER at the American Institutes for Research and CEDR at the University of Washington.

Virtually every school district in the United States educates a child whose parent or guardian is serving in the Armed Forces. This May for Military Appreciation Month we asked Timothy Cavell, University of Arkansas, and Renée Spencer, Boston University, to discuss their IES-funded project on school supports for military-connected students.

What motivated your team to study military-connected students?

We got interested in studying military-connected students through our work on youth mentoring. We saw the potential for school-based mentoring to offer a measured response to the needs of military-connected students who are generally resilient but who, at times, need extra support. With funding from IES, we developed a system for delivering school-based mentoring that was anchored by a district-level military student mentoring coordinator who forged home-school-community action teams composed of school staff, military parents, and community leaders. This project heightened our sensitivity to the high mobility that characterizes military-connected families. These students experience 6 to 9 moves during their K-12 years—a mobility rate 3 times that of non-military children. Our current IES project, the Active-Duty Military Families and School Supports (ADMFSS) study, looks beyond mentoring to explore other kinds of supports that might benefit highly mobile military students and parents. We want to know how school supports might foster school connectedness for military students and parents.

What are your preliminary research findings?

We’re still in the early phases of data analysis and working on manuscripts for publication, but we can share a few things we’ve learned so far. Our findings are based on collecting three waves of parent and student data across two separate cohorts of elementary and middle school students (N = 532).

• Personal connections seem to matter most to military connected students and parents. Of the many types of school supports we measured, including things like welcoming practices and social and emotional learning supports, students rated having teachers help new students feel welcome when they first move into the school as most important. Parents rated ongoing communication with the school as most important.
• School supports likely matter. In preliminary analyses of our data, we’re finding associations between measures of school support and academic and psychosocial functioning. Parents who reported receiving school supports they considered important also reported higher quality parent-teacher relationships, stronger perceptions that schools were welcoming of military families, and less parenting stress compared to parents who reported receiving fewer school supports they considered important. Students who reported receiving school supports they considered important reported feeling more connected to school, higher academic efficacy, higher school engagement, and greater family support than students who reported receiving fewer supports they considered important. Although military-connected parents often noted a preference for not being treated differently from civilian families, they do appreciate school supports geared specifically for military-connected students. Some examples include an orientation, open house, or school tour at the beginning of the school year; lunchtime groups specifically for military-connected students; and access to the military family life counselor.

Based on your preliminary research, what advice would you give schools on how to best support military-connected students?

Most military families seem to weather the stresses and strains of multiple moves, but there are times when these families and students need additional support. The majority of military-connected students attend civilian schools where teachers often lack understanding of and appreciation for military family culture. We learned from our work that military-connected parents greatly appreciate when school staff acknowledge the distinct nature of military family life and “see” their family’s sacrifice. Simply recognizing the distinct challenges and sacrifices these families encounter can go a long way, and small accommodations (for example, not penalizing students for being absent on the day an active-duty parent returns from deployment) are highly valued.  

What has been the most rewarding aspect of this project for you as a PI?

Without a doubt, it’s the level of appreciation expressed by the families who participated in our study. We were surprised that many felt our study was an effort to see the challenges faced by military-connected students, a group often considered the most invisible within a school. It is meaningful to engage in work that touches the lives of families who make important sacrifices to serve our country.

What are the next steps for your research team?

We just received recommendation for funding from the Department of Defense to develop and conduct an initial evaluation of a digital tool that can be used to support the school transitions of military-connected students in the elementary and middle school grades. This tool will capture information about the transitioning military student that is catalogued in a teacher-friendly e-dossier that parents can share with new teachers before the student arrives in their classroom.

We hope this tool will empower military-connected parents to act with greater agency when their family moves, and their student makes yet another school transition. By sharing this information with the new school, it provides military-connected students with just-in-time support and receiving teachers with just-in-time training about military family life and the needs of this new student.

Renée Spencer is a professor at the Boston University School of Social Work. Her research is rooted in relational perspectives of human development and much of her work focuses on distinguishing factors that facilitate positive and meaningful youth mentoring relationships from those that contribute to mentoring going awry. Dr. Spencer’s research highlights the importance of tailoring mentoring to the specific needs of special populations of youth, such as systems-involved and military-connected youth.

Tim Cavell is a professor in the Department of Psychological Science at the University of Arkansas. His research focuses on the role of parents, teachers, and mentors in selective interventions for children who are highly aggressive or chronically bullied. Dr. Cavell also examines school-based strategies to support elementary school students from military families.

This interview blog is part of a larger IES blog series on diversity, equity, inclusion and accessibility (DEIA) in the education sciences. It was produced by IES program officer Vinita Chhabra (Vinita.Chhabra@ed.gov), parent of military-connected students. For more information about the study, please contact the program officer Katina Stapleton (Katina.Stapleton@ed.gov).

This year, Inside IES Research is publishing a series of blogs showcasing a diverse group of IES-funded education researchers and fellows that are making significant contributions to education research, policy, and practice. For Asian American and Pacific Islander Heritage Month, we asked researcher Mingyu Feng, a senior research associate at WestED, to discuss her career journey. Dr. Feng serves as principal investigator of the IES-funded ASSISTments and MathSpring efficacy studies, which examine the effects of intelligent tutoring systems, data-driven instruction, and formative assessment on student learning outcomes.

How did you become interested in a career in education research? How have your background and experiences shaped your scholarship and career?

When I first came from China to the United States to pursue a PhD in computer science, I wasn’t thinking of having a career in education research. My goal was to become a computer scientist who plays with algorithms and codes every day. Then, I was surprised to learn how many U.S. students trailed their peers academically in a highly developed country like America. The 2002 NAEP data indicated that only 30% of 8^th graders were at or above the proficient level in reading or math. My first thought when I saw that statistic was, “There must be a way to help these students.”

I pursued a PhD in intelligent tutoring systems at Worcester Polytechnic Institute out of a desire to leverage technology to boost student learning. An intelligent tutoring system (ITS) is a computer system that aims to automatically provide immediate and customized instruction, feedback, or intervention to learners. Building ITSs requires a highly interdisciplinary field, where computer technology intersects with artificial intelligence, data mining, learning sciences, cognitive sciences, and education. As a graduate student, I developed systems and analyzed student learning data. I built upon my prior math knowledge from studying engineering and taught myself statistical modeling and learned about experimental design methods. I was also fortunate to be able to visit classrooms and work directly with educators and students to understand how critical it is for a student to receive needed support and for a computer system to be effectively integrated into an educator’s classroom routine. This experience inspired me to pursue a career in applied education research. Since then, my research career has focused on the development and research of education technologies and conducting rigorous evaluations of their impact on learning or practices in authentic education settings.

What has been the biggest challenge you have encountered, and how did you overcome the challenge?

As a first-generation immigrant, I haven’t directly experienced the U.S. K-12 and college education system and was initially less familiar with U.S. policies and practices. I asked a lot of “naïve” questions—What’s the difference between a public school and a charter school? How does a district decide the adoption of a supplemental program or a core curriculum? Does 5^th grade belong to elementary school or middle school? Does a teacher or a school have discretion regarding instructional practices? It was a long and steep learning curve, but I found connecting directly with students, educators, administrators, and policymakers to be beneficial for learning about the education system. Listening to their needs, observing classrooms, and discussing research and findings in a meaningful way with practitioners provided me with the context and inspiration I needed as a researcher. When I saw an exhausted teacher running around to put out fires in the classroom, or a frustrated student staring at the computer screen, I knew there was still a long way for us edtech developers and researchers to go.

I also recognized that my cultural background and resulting perspective on education could be both a challenge and an asset. In many East and Southeast Asian cultures, Confucian ideals such as respect for elders, deferred gratification, and discipline are strong influences. Traditionally, Asian parents teach their children to value educational achievement, respect authority, feel responsibility for relatives, and show self-control. These perspectives were infused in my upbringing and influenced my approach to understanding education in the United States where diverse cultures thrive. I worked to gain perspective-taking skills to understand situations from other positions, to consider other beliefs, experiences, and viewpoints.

How can the broader education research community better support the careers and scholarship of researchers from underrepresented groups?

Early exposure to research and opportunities can be quite helpful. My doctoral training expanded my view of career options beyond academia and helped me see the value of applied research and the impact research can have on practices.

Recently, IES has advocated specifically for inclusion of emerging scholars from underrepresented groups in RFAs and during the reviewing process. That’s a great way to support scholars from these groups. Just for fun, I skimmed the list of 1,500 PIs of IES funded grants and found about 50 first or last names resembling Asian names. With acknowledgement of this less-than-rigorous approach, this very rough estimate of 3-4% suggests there are not a whole lot of IES PIs with Asian heritage. Therefore, I really appreciate the increased attention and encouragement IES has given to addressing underrepresentation in the education research community and would love to meet more scholars like me at the PI meetings.

In addition, I’d encourage project directors to think more creatively when considering institutional partnerships, building a staff team, or forming an advisory board. By including collaborators or advisors from underrepresented groups, the team benefits from the breadth of talent, perspectives, and skills that arise from diversity.

What advice would you give to emerging scholars from underrepresented, minoritized groups that are pursuing a career in education research?

My first piece of advice is to be confident and brave. Believe in yourself and in the value you bring to the table. Sometimes, this means stretching outside your comfort zone or persevering towards a goal you are passionate about. In Chinese culture, modesty is viewed as a virtue. I’ve always been told “modesty helps one go forward” and “silence is golden.” Yet, I’d encourage emerging scholars from minoritized groups to put their best selves forward and display their pride. 

My second piece of advice is to find someone you trust, a mentor or an advisor, who will show you how to navigate the field and provide guidance for your academic and career advancement. A great mentor can show you your strengths and weaknesses, encourage and advocate for you, and support your growth by creating opportunities and connecting you with collaborators. For someone from underrepresented groups, I found it is best to have someone who can speak up for you when you are not present in the room.

Mingyu Feng is a senior research associate with WestEd’s Learning and Technology team. She leads large-scale grants focused on leveraging education technologies to transform science and mathematics instruction to improve student learning.

Produced by Wai Chow (Wai-Ying.Chow@ed.gov), program officer for the Effective Instruction grant program within the National Center for Education Research.

The National Center for Education Research convened a virtual technical working group (TWG) of education policy leaders and researchers to discuss strategies for improving K-12 education systems and policy research funded by NCER. The official summary is now posted on the IES website. This blog post provides a snapshot of that summary.

What are the most pressing education systems and policy issues in need of research?

Prior to the meeting, TWG members were asked to identify what policy topics need evidence to inform their decision making, and they identified over 20 issues of pressing concern. The top-identified education policy issues, with at least 3 nominations across both policy leader and researcher groups, are listed below (with the number of nominations in parentheses).

• Equitable access to high quality instruction (13)
• Education technology and online instruction (11)
• Equity in school and student funding (10)
• Diversity of teachers and equity of pay (8)
• Socio-emotional learning (SEL), relationships and student engagement (8)
• Leader Professional Development (6)
• Teacher professional development (5)
• Better capacity for data analysis management, communication (5)
• Early childhood education (5)
• Career preparation/advising/transitions (5)
• Culturally relevant pedagogy/anti-racism/anti-bias (3)
• Special education/English Learners (3)
• Covid-related learning loss (3)

The discussion during the meeting focused on a broad range of policy, research, and dissemination issues, which did not always align with the above issues. NCER staff organized the themes from the day’s discussion below to highlight where the TWG members expressed general consensus. More detail about each area can be found in the full TWG summary on the IES website.

• Understanding and Addressing Inequity in Education Systems: The TWG members agreed that the most pressing issue is equity. The COVID-19 pandemic exacerbated and revealed systemic inequity, which affects students who are from racial/ethnic minority backgrounds, low-income households, or other marginalized groups.
• Improving Use of and Access to Education Technology and High-Quality Online Instruction: With the heavy reliance on online instruction throughout the pandemic, COVID-19 has created new urgency for closing the digital divide. In addition to understanding how systems support or impede access to education technology, TWG members also noted a need for education research focused on questions of teaching and learning in remote and hybrid environments, including professional development and systems-level support for both teachers and students for using and engaging with technology.
• Recruiting and Retaining a Diverse Teaching Workforce: TWG members noted that teacher shortages, especially in high poverty districts, have been a concern for years, and that there is a need for evidence on how to make access to high quality teachers more equitable. Researchers could examine how recruitment strategies can diversify the teacher workforce through strategies such as incentives specifically for teacher candidates of color and adopting culturally relevant practices.
• Providing Access to Student and Educator Mental Health Supports: TWG members observed that COVID-19 has been stressful for students, parents, and educators. Remote learning appears to prevent many students from connections that support emotional and behavioral health and to increase the vulnerability of students with high-risk home environments. Research and research syntheses are needed to guide policymakers on what works best in allocating resources to meet student and educator mental health needs and how to connect with community resources and improve systems of support beyond the school.
• Engaging and Re-Engaging Students: Chronic absenteeism is a major problem in many schools, exacerbated by the pandemic. TWG members pointed out that a key policy question for many LEAs and SEAs is how to re-engage these “missing” students. Researchers can help education leaders understand what evidence-based interventions are available to re-engage students and begin to address disparities in pandemic learning loss.
• Preparing K-12 Students for Careers: TWG members agreed that researchers, policymakers, and educators should engage and collaborate more frequently with employers to inform what career-aligned experiences should be offered to students in school. Research could contribute to understanding how best to support local communities of practice that include schools, businesses, intermediaries, and community-based organizations with the shared goal of preparing students for careers.
• Modernizing Assessments: TWG members agreed that education systems should be modernized to assess and address basic skills and learning needs quickly, such as with interim or formative assessments. Research is needed to understand how to use assessment for both accountability purposes as well as to support diagnosis and student progress monitoring. Additionally, research is needed to guide educators on authentic and performance-based assessments.
• Improving Data-Driven Decision-Making in Schools: TWG members noted that education researchers could provide guidance on identifying a set of core variables, systematically collecting data and metrics, and building data sharing platforms and data agreements. TWG members pointed out that, in many cases, education agencies and educators do not necessarily need more data but more training to build capacity to analyze and use the data they have.
• Examining Education Finance: TWG members noted that research can generate high-quality information to help policymakers understand how school systems could leverage financial resources to help the most underserved learners and communities. TWG participants noted that a key question for which additional evidence is needed is how much funding is needed to provide the breadth of services, including wraparound services, required to support learning in the poorest schools.
• Creating Adaptive Education Systems: COVID-19 has shown that education systems must better prepare for emergencies, and TWG members worried that the pandemic will have a lasting effect on student achievement and attainment. The COVID-19 pandemic has provided the education and research community with an opportunity to learn from what went well, what did not, and to propose strategies to put in place to ensure rapid responses to future emergencies and moments of crisis.

How can NCER better support research on education systems/policy issues?

NCER staff asked for recommendations on improving its engagement with education systems and policy work. TWG member recommendations are organized according to five themes.

• Support a Systems Approach to Systems and Policy Research: TWG members recommended that NCER encourage researchers to untangle and understand broader, dynamic education systems and processes, and to develop methods that capture and account for changing contexts. The TWG encouraged an interdisciplinary approach with different stakeholder perspectives, methods, and measures to move the field forward.
• Encourage Partnerships with Key Stakeholders: TWG members felt that the relevance of research proposals could be increased with more collaboration between researchers and education leaders. Partnership between researchers and practitioners is one strategy for increasing the local relevance of research and its applicability to specific local questions.
• Support Rapid Research to Practice Efforts: TWG members agreed that education policy research results should be disseminated to the field quickly. Rapid cycle evaluation methods, such as plan-do-study-act continuous quality improvement approaches can help to inform policy solutions, and while not nimble enough to support quick turnaround studies, NCER funding may be appropriate for continuous improvement methods that are applied within a longer-term research project.
• Disseminate Information that is Useful to Policymakers: TWG members agreed that NCER research results should be relevant and presented in easy-to-read formats tailored for specific stakeholder audiences. To address this issue, IES can create easy-to-understand research syntheses, as education leaders do not have time or training to comb through the results of individual studies. In addition, TWG members identified a need for research on what is needed for practitioners to translate research to practice, to support decision making, and to address barriers to implementation.
• Attend to Equity in Grantmaking and Research Focus: TWG members were concerned about equity in grantmaking and broadening participation in the research process. One way to address this is to provide more structured technical assistance to ensure applicants new to IES funding develop competitive research proposals. Active outreach can also help to encourage experts most likely to address equity research questions to apply. TWG members also pointed out that interdisciplinary research teams could help unearth embedded inequities in data collection, measures, and models.

In addition to the ideas discussed above, TWG members suggested specific ideas for how NCER could support research that leads to policy and systems improvement. These are too numerous to include here, but they are described in full in the TWG summary report.

For questions about this blog or the TWG summary, please contact Corinne.Alfeld@ed.gov, NCER Program Officer for the Improving Education Systems topic.

The college pipeline from start to finish is an extraordinarily complex process with numerous decision points, options, and obstacles. Students from advantaged social backgrounds are more likely than those from disadvantaged backgrounds to attend schools and colleges staffed with advisers and support staff that have time and resources to assist them. They may also draw on relationships with family, adults in their communities, or knowledgeable peers for assistance in navigation decisions. For students without such supports, the sequence of choices may become so overwhelming that they respond by delaying decisions or making poor choices that lead to sizable delays in their degree progression. With these challenges in mind, IES has funded three information and advising initiatives that draw on insights from researchers, practitioners, and the research literature.

Technical Working Group Meeting

In July 2019, NCER convened a technical working group of 14 researchers and practitioners for a set of conversations structured around three intervention strategies that have garnered substantial attention over the last 5 years: nudges and other light-touch informational campaigns; intensive, proactive coaching and advising; and comprehensive approaches that comprise advising and other supports such as technology and financial incentives. Researchers and practitioners shared perceptions about the effectiveness of each strategy, its relevance to targeted student populations, and conditions for implementation. At the end of the day, working group members provided recommendations (see the Technical Working Group Meeting Summary for a full list), including the following:  

• Institutions should help determine what strategies get tested, apply for research grants, and participate in the research as it progresses.
• Research is needed that addresses the large amount of information that students face and that identifies the types of information that students respond to and act on.
• Replication studies should be designed to measure the effectiveness of promising intervention strategies for specific student groups, with the goal of enhancing effectiveness and cost-effectiveness.

Practice Guide on Effective Advising for Postsecondary Students

In October 2021, the What Works Clearinghouse (WWC) released a Practice Guide on Effective Advising for Postsecondary Students. The practice guide includes four evidence-based recommendations designed for an audience of administrators and staff at community colleges, 4-year institutions, and other public or private technical colleges who are responsible for designing and/or delivering advising to students:

• Intentionally design and deliver comprehensive, integrated advising that incorporates academic and non-academic supports to empower students to reach their educational goals.
• Transform advising to focus on the development of sustained, personalized relationships with individual students throughout their college career.
• Use mentoring and coaching to enhance comprehensive, integrated advising in ways that support students’ achievement and progression.
• Embed positive incentives in intentionally designed advising structures to encourage student participation and continued engagement.

Gap Analysis of Information and Advising Research and Practice

In March 2020, the Lead Team of the College Completion Network began a project aimed at identifying gaps in the research evidence base for information and advising strategies. The project is organized into three parts:

1. A systematic review of the research literature, documenting evidence of the effect of information and advising policies, practices, and programs on student outcomes
2. A scan of information and advising policies, practices, and programs that colleges use to improve student outcomes
3. A gap analysis to compare the findings from the scan to the findings from the systematic review to look for effective practices that are not widely implemented and promising practices in the field that have not been evaluated

The team plans to report its full set of findings by December 2021. College Completion Network study descriptions are available here: https://collegecompletionnetwork.org/studies.

This blog is the second in a blog series on Effective Postsecondary Interventions that highlights interventions with evidence of effectiveness generated through IES-funded research. For the first blog in the series, please see here.

Written by James Benson (James.Benson@ed.gov), a Program Officer for Postsecondary Education within NCER’s Policy and Systems Division, and Felicia Sanders (Felicia.Sanders@ed.gov), a Program Officer for the What Works Clearinghouse within NCEE’s Knowledge Use Division.