IES Blog

As part of the IES 20^th Anniversary, NCER is reflecting on the past, present, and future of adult education research. In this blog, Dr. Aydin Durgunoglu, Distinguished Global Professor Emeritus at the University of  Minnesota-Duluth, reflects on how her life and training have influenced her work. Dr. Durgunoglu is the principal investigator on Content-Integrated Language Instruction for Adults with Technology Support, one of the six research projects that comprise the CREATE Adult Skills Research Network.  As part of this network, Dr. Durgunoglu and her team are focusing on the needs of adult English learners and on U.S. history and civics education, such as what might be taught as part of Integrated English Literacy and Civics Education programs. Hers is the first grant NCER has funded that is focusing on this area for this population.

Please describe your IES project.

My colleagues and I are developing a curriculum called CILIA-T (Content-Integrated Language Instruction for Adults with Technology Support). We are embedding English instruction into U.S. History and Civics content and providing technology supports for both students and teachers as part of the curriculum. Our goal is to provide a complete and integrated resource that can be used by teachers with varying levels of experience in English as a Second Language (ESL), civics/U.S. history and citizenship classes.

What motivates you to do this work?

Two of my motivations are my background as an English learner and immigrant and my training as a cognitive psychologist.

I started learning English when I was 12 in an immersion-based approach. I recall some of the struggles I had such as misunderstanding that “you may sit down” was a full sentence in English because, in Turkish, the single word oturun has a similar meaning to the English sentence. This realization along with both Turkish and American experiences helped me to see the importance of culture, language, and instruction.

As a cognitive psychologist by training, I am interested in learning, memory, knowledge acquisition, and—most of all—language. One of my research areas has been how literacy develops across different languages—how it may progress differently in Spanish, Turkish, English, Hmong, etc. and whether it involves general cognitive processes that are language independent.

These experiences and interests have long influenced my work. For example, my colleagues and I collaborated on literacy projects for Mother Child Education Foundation (MOCEF) based in Turkey that have evolved and currently include a focus on women’s citizenship and empowerment. This work was based on my theoretical work on literacy development in Turkish. In the United States, I have conducted studies with adults and children on how what they know in their home languages can help them learn English (cross-language transfer). All of these experiences led me to our work as the CILIA-T team.

How are you leveraging your experiences to build CILIA-T?

In addition to my theoretical and applied experiences in adult education, this project is benefiting from the contributions of a group of dedicated adult educators. These colleagues are teaching ESL, citizenship, history, and civics classes. We are collaborating on writing a curriculum that teachers like themselves would like to use. Based on our experiences and findings from the field, we have identified the components that we feel are key for CILIA-T. Three of these main components include

1. Multimodal input:  Contrary to how I started learning English, providing linguistic input in several different modalities is helpful. Technology provides many opportunities to realize this goal. Learners can interact with and produce content in many forms. For example, they can create and share academic vocabulary sets and review them like a game. Technology can also facilitate deep conceptual understanding of academic topics. For example, learners can share and discuss not only texts but also audios and videos for a deeper analysis and application of civics and history topics.
2. Build on first languages (L1): Adults already have a well-developed language system or systems, if they know multiple languages. They use the clues from their L1 to understand how English operates. Therefore, we can provide opportunities to bring that existing linguistic knowledge to the forefront and to compare and contrast explicitly. One clear way to leverage L1 is to integrate oral language and help bridge what the adults can do orally with what they aim to do in reading and writing.
3. Academic vocabulary: Individuals with limited or interrupted schooling tend to have lower levels of academic vocabulary in their first language, and thus, likely lower levels in English. A language learner may be quite fluent in using English in their everyday interactions, but that does not mean they have a strong academic vocabulary across different domains, such as health, math, science, civics, and finance. CILIA-T covers academic and discipline-specific vocabulary in a purposeful way. Academic vocabulary is closely related to the conceptual understanding of a phenomenon. Therefore, just learning word definitions is not enough. The vocabulary has to be contextualized with a conceptual understanding. For example, executive branch does not mean much by itself unless it is situated within an understanding of an overall governmental system. Similarly, the definition of the word mortgage may be forgotten quickly if the learner is not familiar with the loan and repayment system in the United States. Luckily, adults have a lot of background knowledge to facilitate such conceptual scaffolding, but that is for another blog.

What value do you hope CILIA-T might bring to the students, teachers, and communities?

We believe that when all individuals, but especially the newcomers, understand the systems, practices, historical contexts, and the language(s) of their society, they can become more active participants in their communities and can work towards accomplishing their life goals more effectively. We hope that CILIA-T provides the adult learners and the educators and programs that support them with a tool to facilitate this growth.

This blog was produced by Dr. Meredith Larson (Meredith.Larson@ed.gov), research analyst and program officer at NCER.

This year, Inside IES Research is publishing a series of blogs showcasing a diverse group of IES-funded education researchers and fellows that are making significant contributions to education research, policy, and practice. In recognition of Asian American and Pacific Islander Heritage Month, in this interview blog we asked Ben Le, an IES Predoctoral Fellow at New York University and a team member of the IES-funded R&D Center on the Success of English Learners (CSEL), to discuss his career journey and research interests.

How have your background and experiences shaped your scholarship and career in studying diversity, equity, and inclusion in education?

My research interests center around how race/ethnicity and language intersect to create unique privileges and discrimination. I hope my research can explore different ways we can support racially and linguistically marginalized students in schools, allowing them to bring their complete selves into the classroom and to help them thrive without having to give up their familial and communal languages.

Growing up in the United States as a Vietnamese-Mexican man has motivated me to look for new ways that we can conceptualize barriers for linguistically and racially marginalized students. While English learners (ELs) are currently the primary focus of my research, I’d like to recognize that I have never been classified as an EL.

I have been fortunate enough to be part of the IES-funded NYU Predoctoral Interdisciplinary Research Training (IES-PIRT) program, which has provided me the opportunity to  further explore and better understand racialized ELs’ access and opportunity in the classroom. My hope is that my IES-PIRT training will prepare me to work closely with local communities and organizations to enact change in our school systems. Ideally, we can build systems that truly support linguistically and racially marginalized students while offering them both access and opportunity that prepares them for life after school.

Can you tell us about your current IES-funded project?

As part of the CSEL R&D Center work, I am using a quantitative intersectional lens to highlight the importance of race/ethnicity for the diverse group of ELs in New York City public schools. I am particularly interested in how patterns of high school and college outcomes for current and former ELs vary based on race/ethnicity and gender. Focusing on 6-year graduation rates, I disaggregated my sample by race/ethnicity, gender, and ever-EL status (whether the student has ever been classified as an EL) to compare the probabilities across these subgroups and look for differential probabilities of being an ever-EL and a specific race/ethnicity. I focused on the two largest racial/ethnic groups of ELs in New York City, Asian Pacific Islander (PI) and Latine. For example, I compared the probability to graduate within 4 years between never-EL Asian/ (PI) young women to ever-EL Latino young men.

Interestingly, results, which were presented at the 2022 American Educational Research Association Annual Meeting, show that student probabilities for 6-year graduation are primarily organized by race/ethnicity, with Asian/PI students outperforming Latine students. Additionally, young women tend to outperform young men of their same racial/ethnic group, and in general, ever-EL status seems to matter even more for young men than young women. But these patterns do not explain away the racial/ethnic disparities seen in this New York City data. While ever-EL status matters, on aggregate, the ever-EL and never-EL differences primarily exist within racial/ethnic and gender subgroups. For example, never-EL Asian/PI young men outperform ever-EL Asian/PI young men, but ever-EL Asian/PI young men still outperform never-EL Latina young women.

Through my research, I hope to highlight the diversity and nuance within this ever-EL population, not to argue that ever-EL status does not matter. Instead, these findings have only motivated me to continue centering race/ethnicity and gender in future analyses for ELs.

What do you see as the greatest research needs to improve the relevance of education research for diverse communities of students and families?

From my perspective, we need to center the voices and concerns of these communities, families, and students in our data collection and analysis. I think it is essential to be involved with the families and meet them where they are to find effective solutions that benefit the communities we strive to serve. We need to make sure we are uplifting underserved families’ voices instead of talking over them. Relatedly, we need data and data collection to reflect the nuances and intricacies we are trying to discuss. Hopefully, future data collection can more accurately reflect the identities of the students we study. For example, I hope we can move away from collecting data as “male/female” and have a more expansive understanding of gender identities and not reify the gender binary.

What advice would you give to graduate students from underrepresented, minoritized groups that are pursuing a career in education research?

My first piece of advice would be to remember your own lived experiences and try to remind yourself that you do deserve to be in your graduate program. It’s easy to feel imposter syndrome—I think a lot of us do. Historically, academia and these programs were not made for us, and sadly, there is still a lot of work to be done, so that we don’t need to change to fit into these spaces. Still, these institutions and research fields benefit from our voices and perspectives. Remembering that these programs need us and that our experiences matter may be easier said than done, but I find it helpful to surround myself with fellow critical scholars and peers both within and outside of academia.

Secondly, finding community and support from peers and mentors has been absolutely crucial for my research and mental health. Doctoral programs aren’t easy; you are constantly being challenged intellectually and then you have to put your ideas and work out to be judged and critiqued. Being able to lean on friends and mentors for emotional support and to challenge and refine your research ideas is key to having a good and productive experience. I am super fortunate at NYU, through my sociology of education program and the IES-PIRT program, to have found such a caring community and supportive mentors, while also being pushed and challenged to pursue better and more critical work.

Produced by Helyn Kim (Helyn.Kim@ed.gov), program officer for the English Learners portfolio, NCER.

This year, Inside IES Research is publishing a series of blogs showcasing a diverse group of IES-funded education researchers and fellows that are making significant contributions to education research, policy, and practice. In recognition of Asian American and Pacific Islander Heritage Month, in this interview blog we asked Dr. Jin Kyoung Hwang, an associate project scientist at the University of California, Irvine to discuss her career journey. Dr. Hwang’s current IES-funded study explores the language and literacy development of kindergarten through third grade English Learners.

How did you become interested in a career in education research?

I have a BA in English literature and linguistics, and as an undergraduate, I took many linguistics and applied linguistics courses. Applied linguistics was eye-opening for me, as I started to see the practical uses of a seemingly theoretical subject. I was intrigued in searching for ways to bridge the gap between the theoretical and practical fields. This eventually led me to pursue a career in education research focusing on language and literacy development. My research primarily focuses on understanding the language and literacy development of school-aged students, including dual language learners who come from non-native-English-speaking homes, and the ways in which research-based interventions could improve their academic outcomes.

My research interests stemmed naturally from my personal experience living as a language minority student in a foreign country. When I was in fifth grade, I moved with my family to Ecuador knowing only Korean. Living in a foreign country where I did not speak the language (Spanish) was socially and culturally challenging—even more so because the language spoken in the academic setting (English) was also different. The seemingly different characteristics of the three languages—Korean, English, and Spanish—often troubled me because direct translations could not always transfer meaning. Through this experience, I learned how to speak different languages and how to adjust myself in different languages and cultures. Although challenging, this learning experience had a positive influence on me and ultimately shaped my career in education research. As such, I believe I am better able to relate with the participants in my research.

What has been the biggest challenge you have encountered, and how did you overcome the challenge?

Although I am now working as an education researcher in California, I spent most of my K-12 schooling years outside of the United States. Thus, when I first moved here as a graduate student, I was not familiar with the K-12 education system and the policies around it. The questions I initially had as a graduate student were relatively basic; it took time and effort for me to really understand how education systems work. While I’m still learning, I was fortunate to have supportive friends, mentors, and colleagues who helped me find the answers to my questions.

In your area of research, what do you see as the greatest research needs or recommendations to address diversity, equity, and inclusion and to improve the relevance of education research for diverse communities of students and families?

I think it is important to understand the diversity within the dual language learner population in the United States. Although it is easy to think of dual language learners or English language learners as a single group, this population is very heterogenous. They may differ on their first language, proficiency in their first language, proficiency in their second language (which is often English), exposure to their first and second language, schooling history, and so forth. Just like monolingual English-speaking students, dual language learners come to the classroom with various constellations of skills in their first language and second language. We need to acknowledge and understand the differences in their learning potential and think of ways to better provide personalized instruction.

It is also important to rethink how we can assess language and literacy skills. Many of the standardized assessments used in education research are designed and developed for monolingual students. When these assessments are used on dual language learners, we often see that they perform below the norm. Having more valid assessments that are grounded in dual language development are needed to equitably measure and evaluate dual language learners’ language and literacy abilities.

What advice would you give to emerging scholars from underrepresented, minoritized groups that are pursuing a career in education research?

I believe one of the factors that makes the field of education research so powerful is the diversity among the scholars. Each scholar brings a unique perspective and insight based on their personal experiences and histories. It is important for emerging scholars from underrepresented, minoritized groups to have a voice and communicate their perspectives and ideas in the field. It also is important to meet and work with colleagues and mentors who can embrace such diversity and support your perspectives. I was fortunate enough to meet supportive figures in my academic career who helped me further develop a research agenda around my research interests and personal experiences, and who also mentored me to broaden and enlighten my perspectives. This collaboration and mentorship made me who I am today, and I hope I can also provide such guidance to other scholars in this field.

Dr. Jin Kyoung Hwang is an associate project scientist at the University of California, Irvine’s School of Education. Dr. Hwang’s current research centers around (1) understanding the language and literacy development of school-aged learners (including dual language learners) and how research-based interventions/educational tools can help improve their literacy outcomes and (2) developing and refining test items to accurately assess their academic skills.

Produced by NCER program officer Wai Chow (Wai-Ying.Chow@ed.gov) and Virtual Student Federal Service intern Audrey Im.

April is National Bilingual/Multilingual Learner Advocacy Month! As part of the IES 20^th Anniversary celebration, we are highlighting NCER’s investments in field-initiated research. In this guest blog, Drs. Nikki Edgecombe (Community College Research Center at Teachers College, Columbia University) and George Bunch (University of California, Santa Cruz) discuss their IES-funded study focused on identifying the policies and practices that support multilingual learners (MLs) in community colleges, the important role of adult education English as a Second Language (adult ed ESL), and some of the lessons learned. MLs in community colleges, a significantly understudied population, include students who were classified as English learners in K-12 but also more recent arrivals to the US with a wide variety of education backgrounds and adult immigrants and refugees who have lived in the US for a number of years.  

Vital Role of Adult Education ESL

The demands on and opportunities for adult education programs, specifically adult ed ESL, are growing. The programs are affordable and accessible to immigrant communities and people with lower levels of academic preparation—many of whom were hit hard by the pandemic and disproportionately experienced negative education, health, and economic consequences. Simultaneously, the pandemic highlighted the increasing, critical need for multilingual workers across fields, including education, healthcare, and government. Adult ed ESL programs can help bring those workers into the labor market.

According to the National Reporting System for Adult Education, in program year 2021-22, nationally, free or low-cost adult education programs enrolled about 900,000 students, with nearly 50 percent in English language acquisition or integrated English literacy and civics education programs. Sixteen states house adult education programs in community and technical colleges, often in addition to other community-based and educational settings (see this site for information about state grants). These programs provide a unique opportunity for students to improve “everyday” English skills and serve as a ready-made pathway to a postsecondary credential. Yet, the programs and their students face a number of challenges. 

Asking the Questions Practitioners Want Answers To

For the last 4 years, we examined policies and practices that affect the experiences and outcomes of MLs in a large midwestern community college district. The research has focused on adult ed ESL, in part at the recommendation of our district partners. The district serves thousands of ESL students annually, and institutional leaders have actively pursued improvements to program access, instruction, and progression. As we learned more about the improvement efforts underway, we were able to gain a clearer picture of the stringent federal and state policies adult education operates under, which have at times challenged district leaders' ability to make the kinds of changes necessary to enhance student outcomes. Our institutional partners are not deterred, however, and continue to seek ways to strengthen their adult education program, make it more student-centered, and make policy more effective. They consider research an important resource in this improvement process. As such, we both documented their efforts and examined how the policy context affected what they were doing.

What We Are Finding

We wanted to better understand who the MLs are, their life circumstances, their college experiences, and their goals. We reported the following trends to our community college partners.  

• Adult ed ESL students are older and less likely to be working than their peers in credit programs. As a group, they are more likely to either have not earned a high school diploma or GED or have previously earned a baccalaureate degree or higher. Adult ed ESL students in our survey sample report enrolling in adult ed ESL to improve their everyday English literacy skills, to strengthen their employment prospects and prepare themselves for the language and literacy demands of further postsecondary education.
• The multiple ESL levels required by policy may generate obstacles to progression, particularly for students who initially place in the lower levels of the sequence. MLs in our partner district place into 1 of 6 adult ed ESL courses. As research has previously established, community college students rarely persist through long sequences of courses, and our preliminary administrative data analysis shows students in our sample generally persist for less than 2 semesters. In response, our district partner developed a full-time position to help students in the transitions into, through, and out of adult education; has offered short (4- and 8-week) courses; built out dedicated academic and nonacademic supports; and created an intentional on-ramp to credit programs. Nonetheless, the length of the sequence appears to undermine retention and progression.
• The prescribed assessment and placement procedures make it difficult for community college-based adult ed ESL programs to meet the varied English language learning needs of enrollees. Language learning is a complex phenomenon that requires students to develop a range of productive (speaking and writing) and receptive (listening and reading) literacy skills for a wide range of academic, professional, and community participation goals. That learning can look quite different for different students in different education environments and proficiency measurement is equally complex. Our district partner used one of the federally mandated assessments to both place students and measure their proficiency gains. The test is relatively inexpensive and easy to administer, but it only measures reading, just one aspect of language proficiency, leaving no consistent record of proficiency levels in speaking, listening, and writing.

New Directions in Adult Ed ESL Policy Research

Early findings from the study have the potential to inform changes in policy and practice at our district partner. Our findings also raise issues that federal and state policymakers and practitioners working on the ground may need to work together to answer, including how policy systems can balance the perceived need for standards and accountability with community colleges’ need to structure and administer the programs in ways that best meet the needs of MLs.

To pursue this line of inquiry, we will explore the origin and rationale for adult ed ESL policy and how that policy translates from federal to state to institutional providers. We will also learn more about the goals and experiences of adult ed ESL students coming out of the pandemic, explore the perceptions and experiences of adult educators and program staff, and provide formative feedback on the reform efforts underway at our district partner with a particular focus on whether and how policy is helping or hindering their ability to meet their goals.

This blog was produced by Dr. Meredith Larson (Meredith.Larson@ed.gov), research analyst and program officer at NCER.

April is National Bilingual/Multilingual Learner Advocacy Month! In this guest blog, Dr. Ryan Williams, principal researcher at the American Institutes for Research, describes his IES-funded project focused on identifying factors that help explain variation in the effects programs have on English learner student outcomes using a broad systematic review and meta-analysis.  

Over the past two decades, empirical research on programs that support English language and multilingual learners has surged. Many of the programs that researchers have studied are designed to support English literacy development and are tailored to the unique needs of English learners. Other programs are more general, but researchers often study program impacts on English learners in addition to impacts on a broader population of students. Relatively few attempts have been made to identify common findings across this literature. Even fewer attempts have been made to identify meaningful sources of variation that drive program impacts for English learner students—that is, understanding what works, for whom, and under what conditions. To help provide educators and policymakers answers to those important questions, we conducted a systematic review and meta-analysis of the effectiveness of programs and strategies that may support English language learner students.

Our Systematic Review Process

We conducted a broad search that combed through electronic databases, unpublished ‘grey’ literature (for example, working papers, conference presentations, or research briefs), and sources that required hand-searching such as organizational websites. After documenting our primary decision-making factors within a review protocol, we applied a set of rigorous criteria to select studies for inclusion in the meta-analysis. We ultimately identified 83 studies that met our inclusion criteria. Each of these were randomized field studies that included English learner students in grades PK-12 and student academic learning outcomes such as English literacy, mathematics, science, and social studies. Each of the included studies was systematically coded to capture characteristics about the research methods, students and schools, settings, programs, outcome measures, and importantly, the program impacts that the studies reported. We then conducted a meta-analysis to understand the relationships between the characteristics we coded and the program impacts.

Preliminary Findings

We are still working on finalizing our analyses; however, our initial analyses revealed several interesting findings.

• Programs that included support for students to develop their first language skills tended to have larger improvements in student learning. This is consistent with prior research that suggests that supporting first language development can lead to improved learning in core content areas. However, the initial findings from this meta-analysis build on the prior research by providing empirical evidence across a large number of rigorous studies.
• There are some particularly promising practices for educators serving English learner students. These promising practices include the use of content differentiation, the use of translation in a student’s first language, and a focus on writing. Content differentiation aligns with best practices for teaching English learners, which emphasize the importance of providing instruction that is tailored to language proficiency levels and academic needs. The use of first language translation can be helpful for English learner students, as it can support their ability to access and comprehend academic content while they are still building their English proficiency. Focusing on writing can also be particularly important for English learners, as writing is often the last domain of language proficiency for students to develop. Our preliminary findings that English learner writing skills are responsive when targeted by instructional programs may hold implications for how to focus support for students who are nearing but not yet reaching English proficiency.
• The type of test used to measure program impact was related to the size of the program impact on student learning that studies found. Specifically, we found that it is reasonable to expect smaller program impacts when examining state standardized tests and larger impacts for other types of tests. This is consistent with findings from prior meta-analyses based on more general student populations, and it demonstrates the same applies when studying program impacts for English learner students. Statewide standardized tests are typically designed to cover a broad range of state content standards and thus may not reflect improvements in more specific areas of student learning targeted by a given program. On the other hand, researcher-developed tests may align too closely with a program and may not reflect broader, policy-relevant, changes in learning. Our initial evidence suggests that to understand program impacts for English learner students—or any group of students—we may want to use established, validated assessments but not only consider statewide standardized tests.

Next Steps

In terms of next steps, we will complete the meta-analysis work this summer and focus on disseminating the findings through multiple avenues, including a journal publication, review summaries on the AIR website, and future conference proceedings. In addition, we are working to deepen our understanding of the relationships identified in this study and explore promising avenues for practice and future research.

If you’d like to continue learning and see the results of this study, please continue to check back at AIR’s Methods of Synthesis and Integration Center project page, located here.

This blog was produced by Helyn Kim (Helyn.Kim@ed.gov), program officer for the English Learners portfolio, NCER.