Inside IES Research

Notes from NCER & NCSER

Spotlight on FY 2023 Early Career Grant Awardees: Word-Level Reading Disabilities

NCSER is excited to share the work of our three new Early Career Development and Mentoring Grants Program principal investigators (PI). The aim of this grant program is to support early career scholars in their academic career trajectories as they pursue research in special education. Through a series of interview blogs, each PI will share their research interests, advice for other early career scholars, and desired impact within the field of special education.

The first scholar we are spotlighting is Kelly Williams, assistant professor in communication sciences and special education at the University of Georgia (formerly at Indiana University). Dr. Williams received a grant to develop an intervention to support reading and spelling outcomes for adolescents with word-level reading disabilities (WLRD).

How did you become interested in this area of research?         

Headshot of Dr. Kelly Williams

I originally became interested in research on WLRD through my experience as a high school special education teacher in rural Georgia where I taught English literature and composition to students with mild to moderate disabilities. Most of my students had difficulty reading and spelling words accurately and automatically, which significantly impacted their performance both in and out of school. In school, my students struggled to complete grade-level coursework, which, in turn, affected their ability to graduate with a regular high school diploma. Outside of school, my students had difficulty with tasks such as completing job applications that required extensive amounts of reading. Although I was well prepared to provide classroom accommodations and modifications for my students, I found that I lacked the knowledge and skills to provide intensive interventions that would help improve basic reading and spelling skills. These experiences ultimately led me to pursue my doctorate in special education with an emphasis on learning disabilities.

What advice do you have for other early career researchers?

I think it is important for early career researchers to collaborate with various stakeholders throughout the entire research process. Although many of my ideas stem from my own experiences as a teacher, I have found that listening to various perspectives has helped me identify problems, brainstorm potential solutions, and design practical interventions that will improve outcomes for students with disabilities. Sustaining effective interventions requires us to think about how we can involve students, teachers, administrators, parents/caregivers, schools, and other community members in research.

What broader impact are you hoping to achieve with your research?

We know low reading achievement is associated with numerous negative outcomes across domains (social, emotional, behavioral, academic, economic). My hope is that this project will provide secondary teachers with a feasible and practical intervention to improve reading outcomes for older students with WLRD, which, in turn, may help prevent or ameliorate the effects of these negative consequences. Ultimately, I envision that this intervention could be used independently or as part of a multi-component reading intervention for secondary students with WLRD.

How will this intervention be distinct from other reading and spelling interventions?

There are two ways that this intervention is distinct from other word reading and spelling interventions. First, this intervention will embed spelling instruction within word reading, which is not currently happening in research or practice for secondary students with WLRD. Many existing programs teach spelling in isolation or through rote memorization, despite a large body of research demonstrating a connection between spelling and word reading. Second, the proposed intervention will emphasize a flexible approach to multisyllabic word reading instead of teaching formal syllable division rules. The goal of this approach is to reduce cognitive load, thereby improving the ability to accurately and automatically read and spell words.

Thank you, Kelly Williams, for your thoughtful insights and commitment to improving reading and spelling among students with word-level reading disabilities. NCSER looks forward to following your work as you progress in developing this intervention.

This blog was produced by Emilia Wenzel, NCSER intern and graduate student at University of Chicago. Katie Taylor (Katherine.Taylor@ed.gov) is the program officer for NCSER’s Early Career Development and Mentoring program.

Lasting Lessons from my IES Predoctoral Interdisciplinary Research Training Fellowship

The Predoctoral Interdisciplinary Research Training Program in the Education Sciences was established by IES to increase the number of well-trained PhD students who are prepared to conduct rigorous and relevant education research. In honor of the IES 20th Anniversary, we asked Dr. Shayne Piasta, our first IES Outstanding Predoctoral Award Winner, to discuss the impact of her IES fellowship on her career as a reading researcher.

 

The IES predoctoral fellowship supported me and my research career in so many ways. One profound influence stemmed from its interdisciplinary nature. My training program focused on reading and operated at the intersection of psychology and education, with mentors and research experiences spanning these and other disciplines. I am still realizing how fortunate I was to benefit from this program and how it has influenced my scholarly career.

In taking education, policy, and psychology courses, I witnessed different approaches and research methods—sometimes overlapping or complementary and sometimes contradictory. As an undergraduate psychology major, I initially took issue with the non-causal methods in a program and policy evaluation course and did not fully understand the contribution of assorted qualitative approaches featured in many education courses. Yet being exposed to these different ways of thinking and researching made me a better scholar. It forced me to wrestle with foundational issues in education research, identify my own position as a researcher, and—with help from training program mentors—realize the benefits and limitations of various research methods.

The ability to communicate with an array of education scholars and stakeholders has proved invaluable. My fellow trainees included former teachers and principals seeking reading education and educational leadership doctorates as well as those pursuing clinical, development, and cognitive psychology degrees. Many of the psychology trainees had worked with children in schools, summer camps, or clinical settings. Talking with these peers, along with program faculty, broadened my perspectives on educational topics and enhanced my understanding of the complexity of education systems. Sharing perspectives and experiences also helped me understand the different communication styles—and vocabulary—various stakeholders use. As a result, I learned to connect with all those invested in improving reading outcomes for children and to write for multiple audiences. This also led to my first partnership with a local Tallahassee school and my very first (very small) grant.

I attribute my faculty position at The Ohio State University (OSU) to the interdisciplinary mindset that my training instilled. Back when I was initially applying to graduate school, I had noted the multiple disciplines contributing to reading scholarship. Some of the researchers I admired and hoped to work with were clinical, cognitive, educational, or school psychologists. Others were in educational leadership, communication/speech-language pathology, elementary/reading education, or special education.

Both the IES training program and subsequent position at OSU supported network building and ensuing collaborative research projects. Travel funding as a graduate student allowed me to attend various conferences, where program faculty generously introduced me and my cohort to the multidisciplinary “who’s who” of reading scholarship. I was awestruck being in the same room as prominent senior scholars, never mind interacting with them. As a faculty member in a Department of Teaching and Learning, I continue to interact with colleagues and students from a variety of education-related backgrounds and perspectives. It is through contributing to this department and guiding preservice teachers and budding education scholars that I believe I am achieving my impact.

In addition to interacting with senior scholars, these opportunities also allowed me to network with graduate and postgraduate students, who are now my colleagues, peers, collaborators, and friends. Together, we have implemented interdisciplinary grants and written manuscripts. We have put together conference symposia and established a multidisciplinary organization for supporting women- and non-binary-identifying education scholars across disciplines (POWER; Providing Opportunities for Women in Education Research). We have formed writing and accountability groups and helped each other navigate our careers. These relationships—along with others built during my time at OSU—continue to support and sustain me, and my scholarly trajectory would likely have been very different without them.

Through these varied experiences, I learned how to administer assessments to children and follow them over time, develop family and teacher surveys, conduct and reliably code classroom observations, manage and analyze longitudinal and multilevel data, and conduct and write grants to fund research projects that answered different questions using different designs. I am proud that to date I have collaborated on exploration, development, efficacy, replication, effectiveness, and measurement research projects. In working across projects, I also witnessed the different ways that faculty engage in leadership, mentoring, and lab/project management. This provided the foundation for the culture, structure, and processes of my own Early Literacy and Learning Lab (EL3).

As I progress in my career, I am cognizant of these and many other affordances of my training. A continuing goal of mine is to try to recreate these opportunities for students and early career scholars. Our EL3 team is multidisciplinary—investigators, staff, students, and postdoctoral scholars have backgrounds in elementary and early childhood education, psychology, measurement and statistics, speech-hearing sciences, special education, policy, and more. We engage in interdisciplinary research projects that engage internal and external colleagues from similarly varied backgrounds, involve partnerships with local early childhood organizations and elementary schools, and employ an array of quantitative, mixed, and multiple methods approaches.

As a lab, we work to create a positive, collaborative community in which varied perspectives and disagreement are welcome and viewed as discussion opportunities. This is epitomized in one current project, in which we jokingly but proudly announced “I dissent!” when offering alternative viewpoints (and whose team members will soon be receiving t-shirts with this phrase).

Through my research, teaching, and service, I strive to continually improve in supporting students as they learn of different research methods, experience on different research projects, and write for different audiences. I lean on my OSU colleagues and professional network to assist students seeking out multiple mentors. I hope I am as generous as my own mentors were in facilitating conference networking and other opportunities. In these ways, I hope that I can pay forward all that I gained through my IES fellowship to the next generation of educational researchers.


Dr. Shayne Piasta was an IES predoctoral fellow in the Florida State University Predoctoral Interdisciplinary Research Training program. She is currently professor of reading and literacy in early and middle childhood within the College of Education and Human Ecology at The Ohio State University. She is also a faculty associate for the Crane Center for Early Childhood Research and Policy. Her research focuses on early literacy development and how it is best supported during preschool and elementary years.

In addition to receiving the Outstanding Predoctoral Fellow award from IES, Dr. Piasta has received the Presidential Early Career Award for Scientists and Engineers and the Dina Feitelson Research Award from the International Reading Association.

This blog was produced training program officer Katina Stapleton (Katina.Stapleton@ed.gov) and is part of a larger series on the IES research training programs.

A Conversation about the Learning Sciences and Human-AI Interaction with Outstanding Predoctoral Fellow Ken Holstein

Each year, the Institute of Education Sciences (IES) recognizes an outstanding fellow from its Predoctoral Interdisciplinary Research Training Programs in the Education Sciences for academic accomplishments and contributions to education research. The 2020 awardee, Ken Holstein, completed his PhD at Carnegie Mellon University and is currently an assistant professor in the Human-Computer Interaction Institute at Carnegie Mellon University, where he directs a research lab focused on human-AI interaction.

Recently, we caught up with Dr. Holstein and asked him to discuss his research on human-computer interaction (HCI) and his experiences as a scholar.

 

How did you become interested in human-computer interaction and learning sciences research?

I have long been fascinated with human learning and expertise. As an undergraduate, I worked on research in computational cognitive science, with a focus on understanding how humans are often able to learn so much about the world from so little information (relative to state-of-the-art machine learning systems). Originally, I had planned on a career conducting basic research to better understand some of our most remarkable and mysterious cognitive capabilities. However, as I neared graduation, I became increasingly interested in pursuing research with more immediate potential for positive real-world impact. The fields of HCI and the learning sciences were a perfect fit to my interests. These areas provided opportunities to study how to support and enhance human learning and expertise in real-world settings, using a bricolage of research methods from a wide range of disciplines. 

Much of your lab’s research focuses on how humans and AI systems can augment each other’s abilities and learn from each other. What are the most promising applications of these ideas for education research and vice versa? 

I see a lot of potential for AI systems to augment the abilities of human teachers and tutors. In my PhD research, I worked with middle and high school teachers to understand their experiences working with AI-based tutoring software in their classrooms, and to co-design and prototype new possibilities together. Overall, teachers saw many opportunities to redesign AI tutoring software with the aim of augmenting and amplifying their own abilities as teachers, beyond simply automating instructional interactions with students. My research explored a small subset of these design directions, but there is a very rich design space that has yet to be explored.

In general, I believe that to design technologies that can effectively augment the abilities of human workers, such as teachers, it is critical to first understand what unique expertise and abilities they bring to the table as humans, which complement the capabilities of AI systems. This understanding can then inform the design of AI systems that explicitly support and draw upon the strengths of human workers (co-augmentation), and that can both learn from workers’ knowledge and support their professional learning (co-learning).

While I’ve described so far about ways the concepts of co-augmentation and co-learning can be applied to education research, I am also very excited about the opposite direction. I think that research on human-AI complementarity, AI-augmented work, and AI-assisted decision-making can benefit greatly by drawing upon ideas from education and the learning sciences. A lot of the research that we’re currently working on in my group involves bringing theories and approaches from the learning sciences to bear on open challenges in this space. To give just one example: there is a body of research that aims to design systems that support human-AI complementarity—configurations of humans and AI systems that yield better outcomes than working alone. So far, this research tends to focus on human ability as if it were static, rather than centering human learning. I believe this is a major missed opportunity, given that the human ability to learn and adapt based on incredibly scarce data is at the core of many of our most impressive capabilities relative to modern AI systems.

What advice would you give to emerging scholars that are pursuing a career in human-computer interaction? 

The field of human-computer interaction brings together a wide range of different topics, disciplines, research methods, and ways of knowing. As a junior scholar, this breadth can be both exciting and overwhelming. To navigate the overwhelm, I think it can be helpful to think about the forms of impact you would like your work to have. For example, are you interested in changing the way a research community thinks about a given topic? Are you interested in creating new technologies that can empower a particular group of people to do something that they could not have (easily) done otherwise? Are you interested in informing public policy with your research? Or are you interested in some combination of all of the above? Oftentimes, I have seen junior scholars in HCI start from a specific project idea, without having a clear sense of what impacts on the world their project might have if it is successful. Working “backwards” by considering and discussing desired impacts of research earlier on in the process can help to productively guide choices of research questions, methods, and lenses.


This blog was produced by IES training program officer Katina Stapleton (Katina.Stapleton@ed.gov). It is part of an Inside IES Research blog series showcasing a diverse group of IES-funded education fellows that are making significant contributions to education research, policy, and practice.

Intersecting Identities: Advancing Research for Racialized English Learners

This year, Inside IES Research is publishing a series of blogs showcasing a diverse group of IES-funded education researchers and fellows that are making significant contributions to education research, policy, and practice. In recognition of Asian American and Pacific Islander Heritage Month, in this interview blog we asked Ben Le, an IES Predoctoral Fellow at New York University and a team member of the IES-funded R&D Center on the Success of English Learners (CSEL), to discuss his career journey and research interests.

How have your background and experiences shaped your scholarship and career in studying diversity, equity, and inclusion in education?

My research interests center around how race/ethnicity and language intersect to create unique privileges and discrimination. I hope my research can explore different ways we can support racially and linguistically marginalized students in schools, allowing them to bring their complete selves into the classroom and to help them thrive without having to give up their familial and communal languages.

Growing up in the United States as a Vietnamese-Mexican man has motivated me to look for new ways that we can conceptualize barriers for linguistically and racially marginalized students. While English learners (ELs) are currently the primary focus of my research, I’d like to recognize that I have never been classified as an EL.

I have been fortunate enough to be part of the IES-funded NYU Predoctoral Interdisciplinary Research Training (IES-PIRT) program, which has provided me the opportunity to  further explore and better understand racialized ELs’ access and opportunity in the classroom. My hope is that my IES-PIRT training will prepare me to work closely with local communities and organizations to enact change in our school systems. Ideally, we can build systems that truly support linguistically and racially marginalized students while offering them both access and opportunity that prepares them for life after school.

Can you tell us about your current IES-funded project?

As part of the CSEL R&D Center work, I am using a quantitative intersectional lens to highlight the importance of race/ethnicity for the diverse group of ELs in New York City public schools. I am particularly interested in how patterns of high school and college outcomes for current and former ELs vary based on race/ethnicity and gender. Focusing on 6-year graduation rates, I disaggregated my sample by race/ethnicity, gender, and ever-EL status (whether the student has ever been classified as an EL) to compare the probabilities across these subgroups and look for differential probabilities of being an ever-EL and a specific race/ethnicity. I focused on the two largest racial/ethnic groups of ELs in New York City, Asian Pacific Islander (PI) and Latine. For example, I compared the probability to graduate within 4 years between never-EL Asian/ (PI) young women to ever-EL Latino young men.

Interestingly, results, which were presented at the 2022 American Educational Research Association Annual Meeting, show that student probabilities for 6-year graduation are primarily organized by race/ethnicity, with Asian/PI students outperforming Latine students. Additionally, young women tend to outperform young men of their same racial/ethnic group, and in general, ever-EL status seems to matter even more for young men than young women. But these patterns do not explain away the racial/ethnic disparities seen in this New York City data. While ever-EL status matters, on aggregate, the ever-EL and never-EL differences primarily exist within racial/ethnic and gender subgroups. For example, never-EL Asian/PI young men outperform ever-EL Asian/PI young men, but ever-EL Asian/PI young men still outperform never-EL Latina young women.

Through my research, I hope to highlight the diversity and nuance within this ever-EL population, not to argue that ever-EL status does not matter. Instead, these findings have only motivated me to continue centering race/ethnicity and gender in future analyses for ELs.

What do you see as the greatest research needs to improve the relevance of education research for diverse communities of students and families?

From my perspective, we need to center the voices and concerns of these communities, families, and students in our data collection and analysis. I think it is essential to be involved with the families and meet them where they are to find effective solutions that benefit the communities we strive to serve. We need to make sure we are uplifting underserved families’ voices instead of talking over them. Relatedly, we need data and data collection to reflect the nuances and intricacies we are trying to discuss. Hopefully, future data collection can more accurately reflect the identities of the students we study. For example, I hope we can move away from collecting data as “male/female” and have a more expansive understanding of gender identities and not reify the gender binary.

What advice would you give to graduate students from underrepresented, minoritized groups that are pursuing a career in education research?

My first piece of advice would be to remember your own lived experiences and try to remind yourself that you do deserve to be in your graduate program. It’s easy to feel imposter syndrome—I think a lot of us do. Historically, academia and these programs were not made for us, and sadly, there is still a lot of work to be done, so that we don’t need to change to fit into these spaces. Still, these institutions and research fields benefit from our voices and perspectives. Remembering that these programs need us and that our experiences matter may be easier said than done, but I find it helpful to surround myself with fellow critical scholars and peers both within and outside of academia.

Secondly, finding community and support from peers and mentors has been absolutely crucial for my research and mental health. Doctoral programs aren’t easy; you are constantly being challenged intellectually and then you have to put your ideas and work out to be judged and critiqued. Being able to lean on friends and mentors for emotional support and to challenge and refine your research ideas is key to having a good and productive experience. I am super fortunate at NYU, through my sociology of education program and the IES-PIRT program, to have found such a caring community and supportive mentors, while also being pushed and challenged to pursue better and more critical work.


Produced by Helyn Kim (Helyn.Kim@ed.gov), program officer for the English Learners portfolio, NCER.

 

Studying Child Welfare and Foster Care Policy in the Context of Education Research

In honor of National Foster Care Awareness Month, we asked economist Dr. Max Gross, researcher at Mathematica and former IES Predoctoral Fellow at University of Michigan, to discuss how his career journey and experiences inspired his research on children and youth who encounter the child welfare system.

What inspired you to become an education researcher?

My goal as a researcher is to promote the well-being of children, youth, and families, particularly those who have been historically underserved or marginalized. I became an education researcher specifically because going to school is one of the few experiences almost everyone shares in the United States. This means schools are a place where policy can have a significant influence.

I think of my work on child welfare and foster care as education research because students bring their whole selves to school. Students who have not had enough to eat or who experience housing instability and homelessness are unlikely to reach their full academic potential. In this way, nutrition policy is education policy; housing policy is education policy; and for my research, child welfare and foster care policy are education policy.

How have your background and experiences shaped your scholarship and career in studying children and youth who encounter the child welfare system?

I recognized a crucial gap in education research early into graduate school. There was an enormous amount of information available to researchers on what happens in schools but far less on the factors outside of school that influence student trajectories. Education data systems include how often students show up to school, who their teachers are, and how well they do in their classes. Coming from a family with three generations of social workers, I knew that what happens outside of school hours—which education data lack—also contributes to success, particularly for students with adverse childhood experiences.

I had the privilege to join an interdisciplinary team of researchers working to integrate data from the education and child welfare systems through the IES Predoctoral Training Program at the University of Michigan. As part of my fellowship, I partnered with University of Michigan colleagues from the Education Policy Initiative, Youth Policy Lab, and Child and Adolescent Data Lab to link information from the Michigan Department of Education and the Michigan Department of Health and Human Services. This opened the door to exploring previously unanswerable questions about the reach of child welfare systems and the effects of education and child welfare policies.

We discovered that children’s encounters with the child welfare system were shockingly common. One out of every five public school students in Michigan—in some school districts, more than half of all students—had been subject to a formal investigation into child abuse or neglect by the time they reached grade 3. These statistics were even higher for Black students and students from low-income households. We also found a strong association between contact with the child welfare system and experiences in school. These students were more likely to receive special education services, be held back a grade, and score lower on math and reading tests.

My training as an applied economist pushed me to critically examine the relationship between child welfare interventions and experiences in school. Did child welfare interventions themselves cause students to fare worse in school? Or were broader circumstances responsible, such as the reasons that triggered involvement with the child welfare system in the first place? My dissertation focused on how the most far-reaching child welfare intervention—removing a child from their home and placing them in foster care—influences their educational outcomes.

What are you researching now?

I partner with child welfare and education agencies to study how their policies and programs influence the lives of children, youth, and families. For example, I recently led an evaluation of a parent education program in Arizona that sought to prevent child maltreatment and foster care placements. I also contribute to a study of a coach-like case management program in Colorado to prevent homelessness among youth and young adults with child welfare histories and an evaluation of a training and coaching program to help preschool teachers support children with diverse needs. In addition, I enjoy working with agencies to strengthen their research and evaluation capacity, harnessing the power of the data they already collect to better understand the effectiveness of their programs.

What do you see as the greatest research needs or recommendations to improve the relevance of education research for children and youth who encounter the child welfare system?

Critical education issues that affect children and youth who encounter the child welfare system are understudied. At the front end of the child welfare system, the law requires teachers and education personnel to report suspected child abuse and neglect. School staff are consistently among the most frequent reporters of maltreatment. Child welfare agencies are sometimes less likely to substantiate reports from education personnel compared to other mandatory reporters, however. Researchers should examine the training that school staff receive in identifying abuse and neglect and whether they overreport maltreatment. At the back end, education policies can support or inhibit the well-being of students who have experienced abuse and neglect and students in foster care. Researchers should explore trauma-informed teaching practices and school-based behavioral health services. Efforts to promote stability for students in foster care, who might transfer schools when their placements change, also deserve more research attention. Education and child welfare policymakers must work together to securely share data for researchers to study these topics.

Education researchers should also make their research more relevant for children and youth who encounter the child welfare system. Just like we seek feedback from subject matter and methodological experts to increase rigor, partnering with experts with lived experience throughout the research process will strengthen our work. As another example, we must make our research accessible for diverse audiences, including those who are involved with the systems that we study.

What advice would you give education researchers who wish to study children and youth who encounter the child welfare system?

Education researchers should first recognize that they have already been studying children and youth who encounter the child welfare system even if they have not realized it. More than one-third of children nationwide are subject to a formal child welfare investigation before their 18th birthday, and 5 percent are placed in foster care. How might the prevalence of these adverse childhood experiences shape your findings?

I would also encourage education researchers to engage with many disciplines. Read studies published in journals outside of your field. Discuss your research with experts who use different tools and approaches to address similar questions. Present your findings to interdisciplinary audiences. Promoting the well-being of children and youth who encounter the child welfare system requires bringing together diverse perspectives.


Max Gross is a researcher at Mathematica where he specializes in quantitative evaluation design and analysis, particularly of programs and policies geared toward historically underserved children and families. Currently, he supports the city of Philadelphia’s child welfare agency to strengthen its evaluation capacity and contributes to the design of the Youth At-Risk of Homelessness evaluation of a coach-like case management system for youth and young adults in foster care.

This blog was produced by Katina Stapleton (Katina.Stapleton@ed.gov), program officer for IES predoctoral training program.