Inside IES Research

Schoolwide discipline policies are meant to reduce disruptions to student learning. However, research reveals that the use of exclusionary discipline policies and practices, involving in- and out-of-school suspension and expulsion, could lead to long-term harmful outcomes for students who are frequently excluded from learning environments. Exclusionary discipline increases the risk of academic failure, school dropout, and socioemotional and mental health problems. Importantly, research also indicates that students with disabilities are disproportionately likely to be subject to exclusionary policies. According to 2017-18 data from the Department of Education’s Office of Civil Rights, students with disabilities comprised approximately 13% of total school K-12 enrollment, yet receive about 25% of one or more out-of-school suspensions and 23% of all school expulsions. This pattern of school discipline demonstrates a pressing concern in modern education, requiring educators to explore systematic changes in current practice.

NCSER has been funding research projects that address school discipline for students with or at risk for disability, either directly or indirectly through interventions aimed at improving behavior. This blog features some examples of this work in elementary school, ranging from more focused student-level interventions to schoolwide efforts.

Timothy Lewis (University of Missouri, Columbia) and his colleagues are currently conducting a study aimed at evaluating the effectiveness of a behavioral intervention program called Check-in/Check-out. This intervention works to improve the social, emotional, and academic behavior of students at risk for emotional behavior disorder (EBD). Previous studies on Check-in/Check-out evaluated the intervention using single-case design research and small n group designs. This study expands the evidence base on Check-in/Check-out by employing a randomized controlled trial and assessing cost-effectiveness. Taking place in midwestern elementary schools, selected students at risk of EBD “check-in” with an intervention facilitator about daily behavioral goals. Students receive feedback and points (derived from a preestablished point system) from their teachers throughout the day about the extent to which they are meeting these goals. “Check-out” occurs at the end of the day, when points are recorded and the student takes this information home in a daily progress report. Results from this research project may offer insight on ways Check-in/Check-out can redirect student behavior at early stages, thus harboring the potential to decrease discipline rates among students with disabilities.

Carl Sumi at SRI International and his colleagues at the University of Florida evaluated the effectiveness of the Tools for Getting Along intervention, which focuses on educators rather than on individual students. Tools for Getting Along is designed to help teachers enhance social problem solving in their classrooms so that students and teachers can work together to improve behavior and decrease disciplinary action. Prior research revealed that among this intervention’s positive effects, some of the strongest impacts were on behavior regulation and problem-solving knowledge for students with or at risk for disabilities, specifically those with behavioral needs. This effectiveness study expanded upon this research by incorporating more locations with more diversity and using an independent evaluation team to conduct the randomized controlled trial within the context of a routine school environment. The research team recently concluded the study, reporting preliminary findings of significant positive impact of the intervention on teacher report of student social skills, behavioral regulation, emotional regulation, cognitive regulation, and executive functions, as well as student self-report of problem-solving knowledge. Ultimately, these changes in student behavior can lead to decreases in referrals for student discipline.

On broader, systems-level, Jeong Hoon Choi (University of Kansas) is testing a program, Resources Aligned and Integrated for Student Equity, that may help combat disproportionate exclusionary disciplinary practices. This intervention helps educator teams use data to better align and integrate general and special education resources to help students whose needs are not met through the universally and additionally provided instruction of the school. Embedded within a multi-tiered system of supports model, the intervention helps systematize team processes and decisions for those students with the most complex needs. Grade-level educator teams will participate in training, practice, and coaching to implement the practices, and the school district will receive technical assistance to help them sustain the intervention in their schools. The randomized controlled trial aims to determine whether schools receiving this intervention have better student academic and well-being outcomes, including reduced office discipline referrals and suspensions.

Kent McIntosh and Erik Girvan (University of Oregon) are addressing disproportionate disciplinary practices through more of a racial equity lens with a training targeting implicit bias among teachers. Project ReACT is a professional development program in which teachers are trained and coached over time to (a) identify specific situations where implicit bias likely occurred in discipline decisions by examining their own school discipline data with school leadership, (b) revise current discipline processes to better meet the needs of students from underserved and over-excluded groups, and (c) design strategies for teachers to minimize implicit bias in school discipline decisions. The research team assessed how exclusionary discipline rates changed in racially and ethnically diverse urban and rural elementary schools in several districts across the country. Using a randomized controlled trial, matching schools based on existing levels of inequities, the research team found that schools receiving the intervention experienced significant decreases in racial disparities in school discipline and office referrals for Black students.

NCSER investments in these projects demonstrate the commitment to finding effective, evidence-based solutions for improving behavior problems, and therefore reducing school discipline rates, for students with disabilities. While research continues to strive toward improving equity in this area, school leaders can also follow the guidelines issued by the Department of Education Office of Civil Rights and Office of Special Education and Rehabilitative Services to ensure fair treatment and access to services for students with disabilities regarding disciplinary measures.

This blog was authored by Isabelle Saillard, student volunteer for NCSER and undergraduate at the University of Virginia. Jackie Buckley is the program officer for NCSER’s Social, Emotional, and Behavioral Competence portfolio.

NCSER continues its series spotlighting the recently funded Early Career Development and Mentoring Grants Program principal investigators with an interview with Ana Dueñas, assistant professor in special education at San Diego State University. Dr. Dueñas is conducting research aimed at improving outcomes for Latine transborder caregivers and their young children with or at risk for autism. We are pleased that this blog also honors Hispanic Heritage Month. 

How did you become interested in studying early intervention for Latine children on the autism spectrum?

As a first-generation Mexican cis-gender woman who was raised in a bicultural transborder community alongside the San Diego/Tijuana border, I learned to navigate a shifting identity—speaking English and Spanish fluently to feel accepted by both communities and managing schooling and housing across borders. Like many other children of Mexican immigrants, I served as a translator, social worker, and advocate for my parents. These experiences, along with my sensitivity to the unique needs of this population, inform how I approach community-engaged research. I am also very aware of how the biases that my education and training in special education and applied behavior analysis influence my approach to intervention research, particularly in light of the history of deficit-driven rhetoric and a medical model of disability in these fields. I aim to be mindful of the power differential that is often associated with higher education, social class, and researcher institutions in my interactions with the families I support.

My interest in building partnerships with Latine caregivers of children with autism began 10 years ago. Earlier in my career, I was a social worker for the California Regional Centers, a non-profit organization that provides services, advocacy, and support to individuals with developmental disabilities and their families. There I gained firsthand awareness of the behavioral health disparities faced by historically minoritized families (delayed diagnosis and access to culturally relevant services). Now, as a junior faculty member and researcher, I bring these experiences to my work and hope to form genuine relationships with the Latine community to better inform autism intervention research.

What are some of the unique challenges and needs of your study population?

I hope to understand these issues in depth more throughout this project. What we know from the literature about the Latine community more broadly is that they face significant disparities in access to timely diagnosis and treatment for their autistic children. This racial disparity is exacerbated in rural communities, or “service deserts” like the Imperial Valley of California, where this project is situated. The transborder community as a subgroup of the larger Latine community has very specific needs that may create a mismatch in evidence-based practices. Some points of mismatch are logistical and environmental—living and working across borders—which may lead to limited compliance, attendance, or engagement in intervention. Other points of mismatch may occur because Latine families may have a history of working with staff that lack cultural competence and therefore have few positive experiences receiving early intervention services. Further, though my project doesn’t focus on families who are undocumented, transborder families may be dealing with unique issues related to immigration status—threats of deportation, housing insecurity, and limited access to physical and mental healthcare. 

What broader impact are you hoping to achieve with your research?

Through my research, I hope to address the behavioral education disparities among marginalized populations, as they undermine the quality of life and opportunities for autistic children and their families, particularly among families exposed to vulnerable circumstances. My study addresses one small component of the many disparities that occur across a continuum from identification to treatment to improve the match between evidence-based interventions and the specific needs of marginalized individuals. Many interventions were developed with minimal input from ethnic and/or racially marginalized communities. Though there continues to be an implementation fidelity versus cultural adaptation debate, without sensitivity and responsiveness to the unique needs of communities, interventions may fail to be adopted. In my work, I begin with an assessment to ensure that the intervention is relevant to community needs and desires.

What advice do you have for other early career researchers?

Don’t give up. Understand and harness your value. Follow your instinct. Seek mentorship.

Ana Dueñas demonstrates passion and meaningful personal connection to her research. We are excited to follow her work and see what lies ahead in her academic career trajectory in special education.

This blog was produced by Emilia Wenzel, NCSER intern and graduate student at University of Chicago. Katherine Taylor (Katherine.Taylor@ed.gov) is the program officer for NCSER’s Early Career Development and Mentoring program.

For the first time, IES is hosting IES Innovation Day as part of the 9^th annual ED Games Expo. This full day event of engaging panel sessions, taking place Thursday, September 21, 2023, from 9:00 AM to 3:15 PM, will highlight IES’s investments in advanced research and development. The day will feature—

• Lightning talks from IES-funded project teams who have developed and conducted research on education technology (EdTech) innovations
• Sessions on modernizing the research and development infrastructure and preparing to scale evidence-based products
• Demos of IES-funded EdTech products
• An afternoon session with IES Director Mark Schneider focused on the Institute’s vision for achieving transformative impact at scale
• Remarks by the White House Office of Science and Technology Policy Director, Arati Prabhakar

IES Innovation Day is one of the many events taking place at the 2023 ED Games Expo this September 19-22 at the Kennedy Center REACH and at locations across Washington, DC. The ED Games Expo is the public showcase of game changing EdTech innovations created through more than 50 programs at the IES, the U.S. Department of Education, and across government. This multi-day event engages a broad audience, including EdTech developers and researchers, organizations across the education ecosystem, students and educators, members of the public including families and children, and representatives and leaders from Federal agencies and offices.

Register to attend these free events:

• ED Games Expo for the Public – Wednesday, September 20, 5:30 PM to 8:30 PM
• IES Innovation Day and Expo Office Hours – Thursday, September 21, 9:00 AM to 6:00 PM

Can’t make it to the Expo in-person? Join through a livestreamed Science is Cool virtual event on Thursday, September 21 from 12:00 PM to 5:00 PM Eastern Time. Speakers at the virtual event will include EdTech developers and STEM education experts who will discuss their classroom interventions and share how they used art and design in creating them.

The Pathways to the Education Sciences Program was designed to inspire students from groups that have been historically underrepresented in doctoral study to pursue careers in education research. Gabriel Lorenzo Aguilar, who participated in the IES-funded University of Texas San Antonio (UTSA) Pathways program focused on P-20 pipeline issues, is the first Pathways fellow to be offered a tenure track position at a university. Gabriel, who is currently finishing his doctoral program in English at the Pennsylvania State University, recently accepted a tenure-track position in the Technical Writing and Professional Design program at the University of Texas at Arlington. Growing up in the barrios of South Texas, Gabriel brings a working-class, migrant-community, and undocumented-community perspective to academia. His research and teaching center the problems of communities who are in dire need of aid and assistance and who rely on technical communication in life-critical situations, especially migrants, refugees, and asylees. In recognition of Hispanic Heritage Month, we asked Gabriel to reflect on his career journey and the experiences of Hispanics scholars.

How have your background and experiences shaped your scholarship and career in using technical communication to improve the lives of vulnerable populations, such as migrants and refugees?

My grandmother was an undocumented migrant. Growing up in the Lower Rio Grande Valley (RGV) of South Texas, I saw how much community came to help not only my grandmother but other undocumented people. I saw firsthand the generosity, commitment, and sacrifice all of us in our neighborhoods made to make sure we had everything we needed.

That level of sacrifice required communication between the community, nonprofits, and others. I saw younger generations provide translation services to their grandparents, making sure that the older generation understood how to get resources such as Medicaid or subsidized utilities. It was only after I went to college that I learned that this communication had a name: technical communication. Broadly speaking, the field of technical communication focuses on making technical information understandable to a wide variety of audiences. It can include things like instructions on how to submit applications for aid or forms for service but has recently expanded to include the communication of marginalized peoples. The types of technical communication we did in the barrios were not included in broader discussions. So, I made it a mission of mine in graduate school to bring the kind of technical communication from marginalized populations into the mainstreams of research and practice.

My past projects looked into helping humanitarian organizations better translate for Mexican migrant populations. Future projects are tackling similar issues with the general population in the RGV and how citizens communicate with one another to form coalitions for change. In any case, my background and experiences help me see technical communication as a field that can improve the lives of my community.

How did participation in the UTSA P20 Pathways program shape your career journey?

Quite frankly, the UTSA Pathways program made my career journey. I struggled a lot in undergrad. I noticed that my peers that excelled were usually white and from more affluent school districts. They seemed to know everything while the rest of us, especially those from the RGV, were behind.

The UTSA Pathways program helped me understand there is a place for scholars like me: those from disenfranchised backgrounds with the passion to help communities in need. While in the program, I learned to recognize disparities in education outcomes—that inequity stems from lack of resources and structural issues such as racism. The program empowered me to see education as a means to tackle such issues.

The program also shaped my understanding of what it means to be an educator: patient, accessible, and demonstrative. I was the undergraduate who didn’t understand the material, who felt too small to ask for help. I’ve learned to recognize the tells of that kind of student—students who often experience the world like I do as a student of color from a working-class background. I try to approach these students first, establishing clear channels of communication and accessibility.

What advice would you give education researchers who wish to work with migrant and refugee communities?

These communities need resources, not predatory researchers. My advice would be to be reflexive on what you give and take when working with a migrant community. There is a long history of researchers extracting data from a marginalized population only to leave that community once their findings are peer reviewed and published. I encourage researchers to practice humanitarian values in their research and practice; that is, to work on the immediate needs of the community, write about those interventions, and then collect data on that immediate work. This way, the community can get the resources they need from a researcher that is actively engaged in improving their quality of life.

How can the broader education research community better support the careers and scholarship of Hispanic students and researchers?

The broader education research community must understand the conditions that many Hispanic students and researchers face in academia, especially Hispanics of color from working class backgrounds. My advice would be to practice patience and grace with Hispanic students. I’ll give an example. I worked with a nontraditional Hispanic student at Penn State who was brilliant but lacked confidence in his writing. He grew up in the Dominican Republic and was in the United States pursuing a degree as a middle-aged adult. His professors that semester heavily criticized his writing: some of the criticism was constructive, some was racist. The constructive criticism demonstrated the flaws of his writing and offered solutions to consider. The racist criticism questioned this student’s belonging in academia, often referring to his misunderstanding of U.S. and English language writing conventions.

Of course, Hispanic students and researchers are not a monolith. We come from all walks of life, some of us more privileged than others. Nonetheless, those with power in the education research community must understand the obstacles that Hispanic students face when navigating higher education.

What advice would you give Hispanic students and scholars who wish to pursue a career in education research?

Understand that the halls of academe weren’t built for us, especially Hispanics of color from working-class backgrounds. I’ve experienced my fair share of microaggressions and blatant racism. Most of the time, these aggressions come from a place of misunderstanding on how our experiences, communities, and culture shape our perspectives of the world. The fight to get our problems recognized, our perspectives respected, and our voices heard can seem never ending. But when I look back at the previous generations of Hispanics in academia, I can really appreciate the positive changes that have come.

My advice would be to accept that you alone cannot change education research. Our generation of scholarship might do little to change education research. It might do a lot. But the momentum is here. The community is here, and with that community, real change can come.

This guest blog is part of a series in recognition of Hispanic Heritage Month. It was produced by Katina Stapleton (Katina.Stapleton@ed.gov), co-Chair of the IES Diversity and Inclusion Council. She is also the program officer for the Pathways to the Education Sciences Research Training Program.

The Department of Education and Institute of Education Sciences Small Business Innovation Research Program (known as ED/IES SBIR), funds projects to develop and evaluate new education technology products that ready to be widely deployed to address pressing educational needs.

In advance of IES Innovation Day at the ED Games Expo on September 21, 2023 at the Kennedy Center REACH in Washington, DC, this blog features a series of ED/IES SBIR awards that were funded for the purpose of creating education technology to ready previously funded evidence-based products for use at scale. Two of the projects highlighted below, one led by Jay Connor of Learning Ovations and the other by Clark McKown of xSEL Labs, will be featured as part of panels. This event is open to the public. Register for the Expo here.

Over its 20-year history, ED/IES SBIR has been well known for stimulating pioneering firms, such as Filament Games, Future Engineers, PocketLab, and Schell Games, to create entrepreneurial and novel education technology products. ED/IES SBIR has also established a track record for investing in a different set of projects—ones that facilitate the uptake of innovations originally developed in university or laboratory settings. This is important because even when researcher-developed innovations (for example, models, programs, and tools) are shown to have evidence for impact, many are not delivered at scale, preventing learners from fully benefiting from these innovations.

Examples of ED/IES SBIR Research to Practice Projects

Over the past two decades, ED/IES SBIR projects have provided useful models for how researchers can navigate and overcome the research-to-practice gap. ED/IES SBIR has made several awards to projects that were originally researcher-initiated, many through IES research grants. These researchers either founded a small business or partnered with an existing small business to develop and commercialize new education technology products to advance research to practice at scale in education.

The short descriptions of these projects below include links to IES website pages with additional information on the unique project models. These projects converted findings from research into scalable, education technology delivered interventions, added new components to existing research-based prototypes to enable feasible implementation and to improve the user experience, and upgraded technology systems to handle large numbers of users across numerous sites.

• Learning Ovations: Through a series of IES and NIH funded research, Dr. Carol Connor led an academic team to develop a personalized early learning assessment, the A2i, and demonstrated its efficacy for improving literacy outcomes through multiple trials. To ready the A2i for use in larger numbers of settings and to improve data processing and reporting, Learning Ovations won an ED/IES SBIR award to upgrade the underlying data architecture and create automated supports and functionalities. In 2022, Scholastic acquired Learning Ovations, with plans for the A2i to be integrated into its suite of products. See the Learning Ovations Success Story for more information.
• Mindset Works: Through an IES research grant in 2002 and with funding from other sources, Dr. Carol Dweck led a research team to develop the concept of the growth mindset—the understanding that ability and intelligence can develop with effort and learning. Lisa Blackwell, a member of the research team, founded Mindset Works and won a 2010 ED/IES SBIR award to develop training modules and animated lessons to deploy this instructional model through a multi-media website. A research grant funded in 2015 tested and demonstrated the efficacy of the technology-delivered Growth Mindset Intervention to improve outcomes of struggling learners. See the Mindset Works Success Story for more information.
• Nimble Assessment Systems: Through IES and other grants, Dr. Michael Russell led team of researchers to conducted foundational research and develop and validation of new forms of assessment. Informed by this research, Nimble Assessment Systems developed NimbleTools with an award from a ED/IES SBIR, a set of universally designed accommodation tools to improve accessibility of assessments for students with disabilities. Measured Progress acquired Nimble Assessment Systems, and the product was integrated into its suite of products for state and district assessments. See the Nimble Tools Success Story for more information.
• Children’s Progress: Through NIH grants, Dr. Eugene Galanter led a research team to create a computer-based assessment that adapted to how a student responded to each question and delivered individualized narratives for each student. With awards from NIH SBIR and ED/IES SBIR, Children’s Progress developed a commercial version of the computer-adaptive dynamic assessment (CPAA) for early childhood in literacy and math. In 2012, Northwest Evaluation Association (NWEA) acquired Children’s Progress, with the assessment technology incorporated into the NWEA’s assessment platform and used at scale. See the Children’s Progress Success Story for more information.
• Teachley: Through IES and NSF funded research, Dr. Herb Ginsburg led an academic team to develop prototype software programs for children from preschool to grade 3 to practice mathematics. In 2011, three members of the research team founded a small business, Teachley, which won ED/IES SBIR awards to extend the research model into easily playable, engaging, and widely used math game apps. See the Teachley Success Story for more information.
• Analytic Measures: With funding from IES, Dr. Jaren Bernstein led a research team to develop prototypes of automated oral reading fluency assessments that were administered to students during the NAEP and other national assessments by IES’s National Center for Education Statistics. Analytic Measures won ED/IES SBIR awards (here and here) to develop the school-ready version of these assessments. In 2022, Google acquired the intellectual property of the assessments with plans to incorporate the tools into its suite of products for education. See this Analytic Measures Success Story more information.
• Lightning Squad: Through awards from ED’s Office of Education Research and Improvement (now IES) and the Office of Elementary and Secondary Education, Drs. Nancy Madden and Bob Slavin led a research team to develop a model to make tutoring more cost-effective. With awards from ED/IES SBIR, Sirius Thinking partnered with Success For All to develop a mixed online and face-to-face multimedia intervention for struggling readers in grades 1 to 3. The program is now in wide-scale use in schools and in tutoring programs. See the Lightning Squad Success Story for more information.
• Apprendis: With research grants from IES and other sources, Dr. Janice Gobert led teams at Worcester Polytechnic Institute and Rutgers University to develop and evaluated Inq-ITS (Inquiry Intelligent Tutoring System) virtual labs for students in grades 4 to 10. Apprendis was founded in order to commercialize InqITS and won an ED/IES SBIR award to develop a teacher alert system that generates real-time insights to inform instruction. InqITS is currently in wide-scale use.
• Common Ground Publishing: Through IES and other grants, Drs. Bill Cope and Mary Kalantzis led a team of researchers to conduct research on new forms of technology-delivered formative assessment for student writing. A technology-based company spun out of a university tech-transfer office, Common Ground Publishing, and won ED/IES SBIR awards (here and here) to develop CGScholar based on this research. CGScholar is an AI-based digital media learning management system designed to support student writing, learning, and formative assessment, which has been in wide-scale use for several years.  See the CGScholar Success Story for more information.
• xSEL Labs: With funding from IES, Dr. Clark McKown led a team led to develop screening assessments for social and emotional learning and conducted research to demonstrate the efficacy of the tool. xSEL Labs was founded to commercialize the assessments, and with an ED/IES SBIR award, is developing a platform to support educators and administrators using research-based SEL assessments. In 2023, 7 Mindsets acquired xSEL Labs was acquired to commercialize the platform at scale.

A New Program Area at ED/IES SBIR to Continue Advancing Research to Practice
With a history of awards to advance research to practice, ED/IES SBIR created a new program area in 2022 called Direct to Phase II to invest in more projects to develop commercially viable education technology products to ready existing evidence-based research for use at scale. The program resulted in one award (see here) in 2022. Please see the ED/IES SBIR solicitation page for information on the next opportunity for funding through its FY2024 program.

Stay tuned for updates on Twitter, Facebook, and LinkedIn as ED/IES SBIR continues to support projects to advance research to practice at scale.

Edward Metz (Edward.Metz@ed.gov) is a research scientist and the program manager for the Small Business Innovation Research Program at the US Department of Education’s Institute of Education Sciences.