IES Blog

Each year, the Institute of Education Sciences (IES) recognizes an outstanding fellow from its Predoctoral Interdisciplinary Research Training Programs in the Education Sciences for academic accomplishments and contributions to education research. The 2020 awardee, Ken Holstein, completed his PhD at Carnegie Mellon University and is currently an assistant professor in the Human-Computer Interaction Institute at Carnegie Mellon University, where he directs a research lab focused on human-AI interaction.

Recently, we caught up with Dr. Holstein and asked him to discuss his research on human-computer interaction (HCI) and his experiences as a scholar.

How did you become interested in human-computer interaction and learning sciences research?

I have long been fascinated with human learning and expertise. As an undergraduate, I worked on research in computational cognitive science, with a focus on understanding how humans are often able to learn so much about the world from so little information (relative to state-of-the-art machine learning systems). Originally, I had planned on a career conducting basic research to better understand some of our most remarkable and mysterious cognitive capabilities. However, as I neared graduation, I became increasingly interested in pursuing research with more immediate potential for positive real-world impact. The fields of HCI and the learning sciences were a perfect fit to my interests. These areas provided opportunities to study how to support and enhance human learning and expertise in real-world settings, using a bricolage of research methods from a wide range of disciplines. 

Much of your lab’s research focuses on how humans and AI systems can augment each other’s abilities and learn from each other. What are the most promising applications of these ideas for education research and vice versa? 

I see a lot of potential for AI systems to augment the abilities of human teachers and tutors. In my PhD research, I worked with middle and high school teachers to understand their experiences working with AI-based tutoring software in their classrooms, and to co-design and prototype new possibilities together. Overall, teachers saw many opportunities to redesign AI tutoring software with the aim of augmenting and amplifying their own abilities as teachers, beyond simply automating instructional interactions with students. My research explored a small subset of these design directions, but there is a very rich design space that has yet to be explored.

In general, I believe that to design technologies that can effectively augment the abilities of human workers, such as teachers, it is critical to first understand what unique expertise and abilities they bring to the table as humans, which complement the capabilities of AI systems. This understanding can then inform the design of AI systems that explicitly support and draw upon the strengths of human workers (co-augmentation), and that can both learn from workers’ knowledge and support their professional learning (co-learning).

While I’ve described so far about ways the concepts of co-augmentation and co-learning can be applied to education research, I am also very excited about the opposite direction. I think that research on human-AI complementarity, AI-augmented work, and AI-assisted decision-making can benefit greatly by drawing upon ideas from education and the learning sciences. A lot of the research that we’re currently working on in my group involves bringing theories and approaches from the learning sciences to bear on open challenges in this space. To give just one example: there is a body of research that aims to design systems that support human-AI complementarity—configurations of humans and AI systems that yield better outcomes than working alone. So far, this research tends to focus on human ability as if it were static, rather than centering human learning. I believe this is a major missed opportunity, given that the human ability to learn and adapt based on incredibly scarce data is at the core of many of our most impressive capabilities relative to modern AI systems.

What advice would you give to emerging scholars that are pursuing a career in human-computer interaction? 

The field of human-computer interaction brings together a wide range of different topics, disciplines, research methods, and ways of knowing. As a junior scholar, this breadth can be both exciting and overwhelming. To navigate the overwhelm, I think it can be helpful to think about the forms of impact you would like your work to have. For example, are you interested in changing the way a research community thinks about a given topic? Are you interested in creating new technologies that can empower a particular group of people to do something that they could not have (easily) done otherwise? Are you interested in informing public policy with your research? Or are you interested in some combination of all of the above? Oftentimes, I have seen junior scholars in HCI start from a specific project idea, without having a clear sense of what impacts on the world their project might have if it is successful. Working “backwards” by considering and discussing desired impacts of research earlier on in the process can help to productively guide choices of research questions, methods, and lenses.

This blog was produced by IES training program officer Katina Stapleton (Katina.Stapleton@ed.gov). It is part of an Inside IES Research blog series showcasing a diverse group of IES-funded education fellows that are making significant contributions to education research, policy, and practice.

This year, Inside IES Research is publishing a series of blogs showcasing a diverse group of IES-funded education researchers and fellows that are making significant contributions to education research, policy, and practice. In recognition of Asian American and Pacific Islander Heritage Month, in this interview blog we asked Ben Le, an IES Predoctoral Fellow at New York University and a team member of the IES-funded R&D Center on the Success of English Learners (CSEL), to discuss his career journey and research interests.

How have your background and experiences shaped your scholarship and career in studying diversity, equity, and inclusion in education?

My research interests center around how race/ethnicity and language intersect to create unique privileges and discrimination. I hope my research can explore different ways we can support racially and linguistically marginalized students in schools, allowing them to bring their complete selves into the classroom and to help them thrive without having to give up their familial and communal languages.

Growing up in the United States as a Vietnamese-Mexican man has motivated me to look for new ways that we can conceptualize barriers for linguistically and racially marginalized students. While English learners (ELs) are currently the primary focus of my research, I’d like to recognize that I have never been classified as an EL.

I have been fortunate enough to be part of the IES-funded NYU Predoctoral Interdisciplinary Research Training (IES-PIRT) program, which has provided me the opportunity to  further explore and better understand racialized ELs’ access and opportunity in the classroom. My hope is that my IES-PIRT training will prepare me to work closely with local communities and organizations to enact change in our school systems. Ideally, we can build systems that truly support linguistically and racially marginalized students while offering them both access and opportunity that prepares them for life after school.

Can you tell us about your current IES-funded project?

As part of the CSEL R&D Center work, I am using a quantitative intersectional lens to highlight the importance of race/ethnicity for the diverse group of ELs in New York City public schools. I am particularly interested in how patterns of high school and college outcomes for current and former ELs vary based on race/ethnicity and gender. Focusing on 6-year graduation rates, I disaggregated my sample by race/ethnicity, gender, and ever-EL status (whether the student has ever been classified as an EL) to compare the probabilities across these subgroups and look for differential probabilities of being an ever-EL and a specific race/ethnicity. I focused on the two largest racial/ethnic groups of ELs in New York City, Asian Pacific Islander (PI) and Latine. For example, I compared the probability to graduate within 4 years between never-EL Asian/ (PI) young women to ever-EL Latino young men.

Interestingly, results, which were presented at the 2022 American Educational Research Association Annual Meeting, show that student probabilities for 6-year graduation are primarily organized by race/ethnicity, with Asian/PI students outperforming Latine students. Additionally, young women tend to outperform young men of their same racial/ethnic group, and in general, ever-EL status seems to matter even more for young men than young women. But these patterns do not explain away the racial/ethnic disparities seen in this New York City data. While ever-EL status matters, on aggregate, the ever-EL and never-EL differences primarily exist within racial/ethnic and gender subgroups. For example, never-EL Asian/PI young men outperform ever-EL Asian/PI young men, but ever-EL Asian/PI young men still outperform never-EL Latina young women.

Through my research, I hope to highlight the diversity and nuance within this ever-EL population, not to argue that ever-EL status does not matter. Instead, these findings have only motivated me to continue centering race/ethnicity and gender in future analyses for ELs.

What do you see as the greatest research needs to improve the relevance of education research for diverse communities of students and families?

From my perspective, we need to center the voices and concerns of these communities, families, and students in our data collection and analysis. I think it is essential to be involved with the families and meet them where they are to find effective solutions that benefit the communities we strive to serve. We need to make sure we are uplifting underserved families’ voices instead of talking over them. Relatedly, we need data and data collection to reflect the nuances and intricacies we are trying to discuss. Hopefully, future data collection can more accurately reflect the identities of the students we study. For example, I hope we can move away from collecting data as “male/female” and have a more expansive understanding of gender identities and not reify the gender binary.

What advice would you give to graduate students from underrepresented, minoritized groups that are pursuing a career in education research?

My first piece of advice would be to remember your own lived experiences and try to remind yourself that you do deserve to be in your graduate program. It’s easy to feel imposter syndrome—I think a lot of us do. Historically, academia and these programs were not made for us, and sadly, there is still a lot of work to be done, so that we don’t need to change to fit into these spaces. Still, these institutions and research fields benefit from our voices and perspectives. Remembering that these programs need us and that our experiences matter may be easier said than done, but I find it helpful to surround myself with fellow critical scholars and peers both within and outside of academia.

Secondly, finding community and support from peers and mentors has been absolutely crucial for my research and mental health. Doctoral programs aren’t easy; you are constantly being challenged intellectually and then you have to put your ideas and work out to be judged and critiqued. Being able to lean on friends and mentors for emotional support and to challenge and refine your research ideas is key to having a good and productive experience. I am super fortunate at NYU, through my sociology of education program and the IES-PIRT program, to have found such a caring community and supportive mentors, while also being pushed and challenged to pursue better and more critical work.

Produced by Helyn Kim (Helyn.Kim@ed.gov), program officer for the English Learners portfolio, NCER.

In honor of National Foster Care Awareness Month, we asked economist Dr. Max Gross, researcher at Mathematica and former IES Predoctoral Fellow at University of Michigan, to discuss how his career journey and experiences inspired his research on children and youth who encounter the child welfare system.

What inspired you to become an education researcher?

My goal as a researcher is to promote the well-being of children, youth, and families, particularly those who have been historically underserved or marginalized. I became an education researcher specifically because going to school is one of the few experiences almost everyone shares in the United States. This means schools are a place where policy can have a significant influence.

I think of my work on child welfare and foster care as education research because students bring their whole selves to school. Students who have not had enough to eat or who experience housing instability and homelessness are unlikely to reach their full academic potential. In this way, nutrition policy is education policy; housing policy is education policy; and for my research, child welfare and foster care policy are education policy.

How have your background and experiences shaped your scholarship and career in studying children and youth who encounter the child welfare system?

I recognized a crucial gap in education research early into graduate school. There was an enormous amount of information available to researchers on what happens in schools but far less on the factors outside of school that influence student trajectories. Education data systems include how often students show up to school, who their teachers are, and how well they do in their classes. Coming from a family with three generations of social workers, I knew that what happens outside of school hours—which education data lack—also contributes to success, particularly for students with adverse childhood experiences.

I had the privilege to join an interdisciplinary team of researchers working to integrate data from the education and child welfare systems through the IES Predoctoral Training Program at the University of Michigan. As part of my fellowship, I partnered with University of Michigan colleagues from the Education Policy Initiative, Youth Policy Lab, and Child and Adolescent Data Lab to link information from the Michigan Department of Education and the Michigan Department of Health and Human Services. This opened the door to exploring previously unanswerable questions about the reach of child welfare systems and the effects of education and child welfare policies.

We discovered that children’s encounters with the child welfare system were shockingly common. One out of every five public school students in Michigan—in some school districts, more than half of all students—had been subject to a formal investigation into child abuse or neglect by the time they reached grade 3. These statistics were even higher for Black students and students from low-income households. We also found a strong association between contact with the child welfare system and experiences in school. These students were more likely to receive special education services, be held back a grade, and score lower on math and reading tests.

My training as an applied economist pushed me to critically examine the relationship between child welfare interventions and experiences in school. Did child welfare interventions themselves cause students to fare worse in school? Or were broader circumstances responsible, such as the reasons that triggered involvement with the child welfare system in the first place? My dissertation focused on how the most far-reaching child welfare intervention—removing a child from their home and placing them in foster care—influences their educational outcomes.

What are you researching now?

I partner with child welfare and education agencies to study how their policies and programs influence the lives of children, youth, and families. For example, I recently led an evaluation of a parent education program in Arizona that sought to prevent child maltreatment and foster care placements. I also contribute to a study of a coach-like case management program in Colorado to prevent homelessness among youth and young adults with child welfare histories and an evaluation of a training and coaching program to help preschool teachers support children with diverse needs. In addition, I enjoy working with agencies to strengthen their research and evaluation capacity, harnessing the power of the data they already collect to better understand the effectiveness of their programs.

What do you see as the greatest research needs or recommendations to improve the relevance of education research for children and youth who encounter the child welfare system?

Critical education issues that affect children and youth who encounter the child welfare system are understudied. At the front end of the child welfare system, the law requires teachers and education personnel to report suspected child abuse and neglect. School staff are consistently among the most frequent reporters of maltreatment. Child welfare agencies are sometimes less likely to substantiate reports from education personnel compared to other mandatory reporters, however. Researchers should examine the training that school staff receive in identifying abuse and neglect and whether they overreport maltreatment. At the back end, education policies can support or inhibit the well-being of students who have experienced abuse and neglect and students in foster care. Researchers should explore trauma-informed teaching practices and school-based behavioral health services. Efforts to promote stability for students in foster care, who might transfer schools when their placements change, also deserve more research attention. Education and child welfare policymakers must work together to securely share data for researchers to study these topics.

Education researchers should also make their research more relevant for children and youth who encounter the child welfare system. Just like we seek feedback from subject matter and methodological experts to increase rigor, partnering with experts with lived experience throughout the research process will strengthen our work. As another example, we must make our research accessible for diverse audiences, including those who are involved with the systems that we study.

What advice would you give education researchers who wish to study children and youth who encounter the child welfare system?

Education researchers should first recognize that they have already been studying children and youth who encounter the child welfare system even if they have not realized it. More than one-third of children nationwide are subject to a formal child welfare investigation before their 18th birthday, and 5 percent are placed in foster care. How might the prevalence of these adverse childhood experiences shape your findings?

I would also encourage education researchers to engage with many disciplines. Read studies published in journals outside of your field. Discuss your research with experts who use different tools and approaches to address similar questions. Present your findings to interdisciplinary audiences. Promoting the well-being of children and youth who encounter the child welfare system requires bringing together diverse perspectives.

Max Gross is a researcher at Mathematica where he specializes in quantitative evaluation design and analysis, particularly of programs and policies geared toward historically underserved children and families. Currently, he supports the city of Philadelphia’s child welfare agency to strengthen its evaluation capacity and contributes to the design of the Youth At-Risk of Homelessness evaluation of a coach-like case management system for youth and young adults in foster care.

This blog was produced by Katina Stapleton (Katina.Stapleton@ed.gov), program officer for IES predoctoral training program.

In recognition of Black History Month, we asked Dr. Wynetta Lee, Professor, School Administration Program and PI of the IES-funded Research Institute for Scholars of Equity (RISE) Pathways training program at North Caroline Central University (NCCU), to discuss the roles of historically black colleges and universities (HBCUs) and mentoring in the development of the next generation of education researchers.

In this photo, RISE fellows visit VEST, the University of Virginia’s IES-funded predoctoral training program. Pictured in the front row starting 4^th from the left are RISE PI Wynetta Lee, VEST PI Sara Rimm-Kauffman, and RISE PI Marta Sanchez (deceased). 

How have HBCUs shaped your scholarship and career?

I am fortunate to be a third-generation college student—both of my parents and one grandparent attended HBCUs. That makes me a product of HBCUs even though I did not attend one as a student.  During my childhood, my teachers were also trained at HBCUs.  At the risk of dating myself, it is important to note that I was born at a time and in a place where education was mandated by law to be delivered in segregated spaces. This system of education certainly carried a long list of undesirable outcomes. 

I have heard it said that education is a social process, and I count myself as privileged to start my educational journey in an environment that was nurturing and inclusive, yet individualistic when needed. During my elementary school days, everyone in my educational community treated me as if I were their protégé. I had my own village of mentors—all of whom were on the same page when it came to my future. My mentors prepared me for the inevitable experience of desegregation and remained connected to me over my lifetime. They taught me that solid relationships are based on mutual trust, respect, and benefits. They also taught me that not all relationships are the same, yet there is something to be learned from each relationship if you pay attention.

In college, I found another village of mentors who were trained at HBCUs, and they too were on the same page when it came to my future. These scholars mentored me to degree completion and beyond. They gently but clearly pushed me toward graduate education and a career in higher education. They saw potential in me that I did not see in myself. This set me on a path to center my work around issues of educational equity and educational experiences in college.

Professionally, most of my academic career has been at HBCUs. What I have come to appreciate about HBCUs is that the ideal of “students first” is more than a phrase; it is a pillar of campus culture. HBCU students are not simply seen as brains waiting to be filled with knowledge. Rather, I have found that HBCUs operate as a community committed to addressing the academic, social, emotional, financial, and spiritual needs of students within their respective resources, which creates a natural environment for creating a village of mentoring.

What has been the biggest challenge you have encountered, and how did you overcome the challenge?

I have had many experiences with being in the minority and with being “the only one” in a variety of contexts. I would say that the biggest recurring challenge I have encountered in higher education is being judged by people’s perceptions rather than by my skills. There are many things that helped me to overcome this challenge, such as having grit, choosing a positive outlook, and mentally playing out possible reactions to their likely conclusion prior to reacting to the challenge.  However, I think the mentoring relationships that I have been part of over the years is what helped and continues to help me most. Receiving advice from a mentor you trust and who knows you well is an invaluable asset.

What advice would you give to emerging scholars from underrepresented, minoritized groups that are pursuing a career in education research?

My best advice is to develop a community of mentors. Seek out an education researcher to be one of your mentors. It is important to know that pursuing a career in education research does not need to be a solitary journey on a one-way highway. Mentors will help you in ways that you do not know you need and can connect you with opportunities. Also, do not underestimate the value of peer mentors. They have shared experiences with you and perspectives that can give you clarity, and they can be a strong source of support.

How does your research contribute to a better understanding of the importance of diversity, equity, and inclusion in education?

I am privileged to serve as the principal investigator for RISE at NCCU, which is an HBCU in Durham, NC. RISE seeks to develop a cadre of future researchers who know the rules of rigor and ethics in social science research and can pursue research through a culturally competent lens. While not all RISE fellows may ultimately pursue a career in education research, each will be aware of the importance of diversity, equity, and inclusion in education and can push for it from their respective worlds of work.

How can the broader education research community better support the careers and scholarship of researchers from underrepresented groups?

The broader education research community can better support the careers and scholarship of researchers from underrepresented groups by making it a priority to do so and investing resources.   

It is important to spread the word that education research is a viable career choice. Students from underrepresented groups are often first-generation college students. These students know about careers in education because they engaged with teachers, principals, and counselors prior to college. However, the students I have encountered over the years—including graduate students—know nothing about a career in education research. People cannot pursue what they do not know.

Mentoring is the cornerstone of RISE. Our mentors share what fellows need to know for success through teaching, sharing experiences, providing opportunities, and through the development of mutually beneficial relationships that are safe spaces. Creating more formal and informal mentorship opportunities within the education research field is crucial to supporting the careers of all scholars, but particularly those from underrepresented groups.

Finally, the broader education research community can also better support the careers and scholarship of researchers from underrepresented groups by being more welcoming of those who do pursue education research careers and by inviting collaborative relationships as they evolve professionally.

Produced by Katina Stapleton (Katina.Stapleton@ed.gov), co-Chair of the IES Diversity and Inclusion Council. She is also the program officer for the Pathways to the Education Sciences Research Training Program and the new Early Career Mentoring Program for Faculty at Minority Serving Institutions, the two IES training programs for minority serving institutions.

In honor of Thanksgiving, NCER and NCSER would like to express their gratitude to all of the student volunteer interns that are giving their time and talents to help us understand and communicate about education research. In our third blog about these interns, we are highlighting our diversity, equity, inclusion, and accessibility (DEIA) interns. These interns come to us through the Virtual Student Federal Service program and are being mentored by Katina Stapleton (NCER).

Audrey Im (she/her)

I am from the Bay Area in California and am currently a UCLA undergraduate majoring in political science and minoring in professional writing and film. Ever since I was young, my dream profession was to be a teacher—the process of sharing knowledge with other people is thrilling for me. I was lucky enough to have great teachers with distinct, effective teaching styles, and I knew that somewhere along the road, I wanted to have the same effect on another generation of students as those teachers had on me. Currently, I am focused on learning how to write in a manner that makes information accessible.

Fun Fact: I love writing poetry! Recently, I've been doing a monthly poetry project where I write a poem using only song lyrics from my favorite tunes of the month. It's been very fun and challenging. I would highly recommend trying it out!

Zaakirah Rahman

I’m currently a senior at the City College of New York pursuing a bachelor’s degree in English education and a minor in sociology. I was born and raised in Queens, so I’ve been a part of the New York City school system for as long as I can remember. This has helped fuel my passion for pursuing education as a career. School has contributed a lot to my life, from teaching me what I know to even being a second home at times. I’d like to give back through being in the classroom myself and enacting real change. I currently work at the New York Public Library as a page, a job that is suited to my love for reading. Additionally, I’m the outreach chair for the New York chapter of an organization called MIST (Muslim Interscholastic Tournament), where we organize an annual tournament with various competitions for high school students. The tournament itself champions helping students bring out the best in themselves, and my role helps me meet all kinds of people to share this experience.

Fun Fact: I love photography and am owner to an ever-growing collection of cameras.