Inside IES Research

As part of the IES 20^th Anniversary, NCER is reflecting on the past, present, and future of adult education research. In this blog, Dr. Daphne Greenberg, Distinguished University Professor at Georgia State University, reflects on her connection to adult education and gives advice to researchers interested in this field. Dr. Greenberg has served as the principal investigator (PI) on three NCER grants, including the Center for the Study of Adult Literacy, and is also co-PI on three current NCER grants (1, 2, 3). She helped found the Georgia Adult Literacy Advocacy group and the Literacy Alliance of Metro Atlanta and has tutored adult learners and engaged in public awareness about adult literacy, including giving a TedTalk: Do we care about us? Daphne Greenberg at TEDxPeachtree.

What got you interested in adult education research?

During graduate school, I was a volunteer tutor for a woman who grew up in a southern sharecropper family, did not attend school, and was reading at the first-grade level. Her stories helped me understand why learning was important to her. For example, her sister routinely stole money from her bank account because she couldn’t balance her checkbook.

I began wondering whether adults and children reading at the same level had similar strengths and weaknesses and whether the same word-reading components were equally important for them. I later published an article that became a classic in adult literacy research about this.

Over the years, I have grown to admire adult learners for their unique stories and challenges and am deeply impressed with their “grit” and determination even when faced with difficulties. When I watch a class of native-born adults reading below the 8th grade levels, I am inspired by them and yet deeply conflicted about our K-12 system and how many students aren’t getting what they need from it.

How does your personal experience influence your perspective?

I think my childhood and family planted the seeds. My grandfather ran a grocery store but had only a third-grade education. My parents were immigrants who worked hard to navigate a new culture and language, and I struggled with reading in English and English vocabulary growing up. As a result, I understand how people hide and compensate for academic weaknesses.

Also, my brother has profound autism. As a child, I insisted that I could teach him many skills, and I did. This taught me patience and the joy one feels when even the smallest gain is made.

As an adult, I mess up idioms, use Hebraic sentence structure, and need help with editing. I also have a visual condition that causes me to miss letters when I read and write. These difficulties help me relate to the struggles of adult learners. I often feel deep embarrassment when I make mistakes. But I am very fortunate that I have colleagues who celebrate my strengths and honor my weaknesses. Not all of our adult learners are as fortunate.

What should researchers new to adult education know about the system?

Adult education serves students with significant needs and numerous goals—from preparing for employment or postsecondary education to acquiring skills needed to pass the citizenship exam or helping their children with homework. But the adult education system has less public funding than K-12 or postsecondary systems.

Many of the educators are part-time or volunteers and may not have a background in teaching—or at least in teaching adults. There just aren’t the same level of professional development opportunities, technological and print instructional resources, infrastructure, or supporting evidence-based research that other education systems have. 

What should researchers know about adult learners?

As a starting point, here are three things that I think researchers should know about adult learners:

• What it means to live in poverty. For example, I once worked with a researcher who, when told that adult learners wouldn’t have access to the internet, replied “That’s not an issue. They can take their laptops to a Starbucks to access the Internet.”
• That adult learners are motivated. The fact that they have inconsistent attendance does not mean that they are not motivated. It means that they have difficult lives, and if we were in their shoes, we would also have difficulty attending on a regular basis.
• That adult learners’ oral vocabulary often matches their reading vocabulary. If you want adult learners to understand something, such as informed consents, realize that their oral vocabulary often is very similar to their reading grade equivalencies and consider simplifying complex vocabulary and syntax structure.

What specific advice do you have about conducting research with adult learners?

Testing always takes longer to complete than anticipated. I never pull students out from classes for testing because their class time is so precious. So they have to be available after or before class to participate in research, and this can be problematic. We often need to reschedule an assessment because public transportation is late, a job shift suddenly changes, or a family member is sick.

Finding enough of particular types of students is difficult because sites often attract different demographics. For example, one site may have primarily 16- and 17-year-olds, another site may have mostly non-native speakers, and another site may have either lower- or higher-skilled adult learners.

Having a “clean” comparison group at the same site is challenging because of intervention “leakage” to nonintervention teachers.  Adult education teachers are often so hungry for resources that they may try to peak into classrooms while an intervention is in process, get access to materials, or otherwise learn about the intervention. Their desire for anything that might help students makes contamination a concern.  

What areas of adult education could use more research?

I think that policymakers and practitioners would benefit from many areas of research, but two come to mind.

• How to measure outcomes and demonstrate “return”: Many funding agencies require “grade level” growth, but it can take years for skills to consolidate and manifest as grade level change. In the meantime, adults may have found a job, gotten promoted, feel more comfortable interacting with their children’s schools, voted for the first time, etc. Are we measuring the right things in the right way? Are we measuring the things that matter to students, programs, and society? Should life improvements have equal or even more weight than growth on standardized tests? After how much time should we expect to see the life improvements (months, years, decades)?
• How to create useful self-paced materials for adults who need to “stop-out”: Due to the complexities of our learners’ lives, many have to “stop-out” for a period before resuming class attendance. These adults would benefit from resources that they could use on their own, at their own pace during this time. What is the best practice for delivery of these types of resources? Does this “best practice” depend on the adult’s ability level? Does it depend on the content area? 

Any final words for researchers new to adult education?

I extend a warm welcome to anyone interested in research with adult learners. You will discover that many adult learners are eager to participate in research studies. They feel good helping researchers with their work and are hopeful that their time will help them or be of help to future learners. I highly recommend that you collaborate with researchers and/or practitioners who are familiar with the adult education context to help smooth the bumps you will inevitably experience.

This blog was produced by Dr. Meredith Larson (Meredith.Larson@ed.gov), research analyst and program officer at NCER.

As part of the IES 20^th Anniversary celebration, we are highlighting NCER’s investments in field-initiated research. In the Adult Education and Adult Foundational Skills series, NCER will be spotlighting researchers and projects and sharing information about research to improve outcomes for adult learners.

In this opening blog, program officer Dr. Meredith Larson defines NCER’s use of the terms adult education and adult foundational skills, which have specific meaning and scope for IES research. Dr. Larson also describes who the adult learners are, why research in this area is important, and the research NCER has supported.

How does NCER define Adult Education and Adult Foundational Skills?

NCER uses the term adult education to refer to a system legislatively defined in the Workforce Innovation and Opportunity Act (WIOA). The adult education system serves learners who are at least 16 years old and not enrolled in K-12 through programs such as adult basic education, adult secondary education, integrated education training, family literacy, and integrated English language and civics.

By adult foundational skills, NCER means the common academic skills—such as literacy (reading, writing, listening), English language proficiency, and numeracy—that are necessary for participating in college or career. Nowadays, digital literacy and digital skills are emerging as foundational skills.

As researchers and practitioners in this field discuss how to define their work and purpose, NCER’s use of the terms may evolve

How many U.S. adults have low foundational skills?

Data from the 2017 Program for the International Assessment of Adult Competencies (PIAAC) indicate that roughly 114 to 135 million U.S. adults may have significant or moderate skill gaps in reading or numeracy, with approximately 48 million (23 percent) of adults having significantly low literacy and 69 million (33 percent) having significant low numeracy skill. Having low foundational skills may impede adults’ ability to pursue education or training, participate fully in the workforce, or engage civically.

What is the adult education system like?

Although millions of U.S. adults may benefit from building foundational skills, the adult education system and programs focus on adults with significant skill gaps and those who lack a high school diploma or equivalent.

Adult learners who enter into this system vary widely. They can include people from all regions, races, ethnicities, age groups, and levels of academic attainment, including those with no formal education to those with advanced degrees from other countries. They may be parents, workers, or retirees. They may seek out programs to learn how to read, earn a high school diploma, prepare for employment or college, or pass a citizenship test. The educators who teach adult learners are also diverse. Some have teaching certification, but many do not. The majority of them are part-time. There is also a wide variety of program providers (community colleges, community-based organizations, LEAs, etc.), relevant policies (federal, state, local), and funding sources. The National Reporting System for Adult Education includes descriptive data on students and programs reported to the US Department of Education as part of annual reporting requirements for grantees.

Why is research on this area important? What types of work has NCER supported?

Because of the diversity of learners in the system and the complexity of the system itself, the way forward maybe be unclear without a solid research base to inform policy and practice. Research can provide the knowledge, innovations, and evidence that can help learners, educators, and policymakers make informed choices and decision.

The adult education and foundational skills research portfolio at NCER is small but expanding. Between 2004 and 2021, NCER has invested approximately $51.8 million across 27 awards (grants and contracts) relevant to adults with low foundational skills who are in or eligible for adult education services. Please see a list of the NCER adult education and foundational skills projects funded since 2004: Word file or PDF file).

In the early years of NCER, research addressing adult education and foundational skills tended to focus only on reading, and adults were not the primary or sole focus of the study. Over time, this research has grown to encompass additional skills and education policy, and more studies focused primarily on adults served by the adult education system. The earliest NCER study in this set was funded in 2004 and is a direct ancestor to a 2016 grant to validate a reading assessment specifically for adult struggling readers. Other adult education projects have also built off of early NCER work and have inspired other projects. For example, NCER’s first adult education research and development center, the Center for the Study of Adult Skills (CSAL), incorporated work from one of NCER’s first grants in 2002 and led subsequent development research. Multiple awards in the adult education portfolio also use the PIAAC, as a resource for both research (see here, here, and here) and training grants.

What is on the horizon for NCER research?

One significant recent trend in this portfolio has been the expanding role of technology and digital skills. From CSAL to the CREATE Adult Skills Network and to projects exploring adult problem solving in digital environments, NCER researchers are building knowledge and developing interventions that focus on technology and adult learners’ ability to benefit from technology.

In particular, the CREATE Adult Skills Network is bringing together multiple research teams around technology to support reading, writing, math, professional development, civics/history and English language instruction, and assessment. CREATE is also helping to disseminate information about the role of technology in adult education and the importance of developing adults’ foundational skills.

How can people learn more?

Please visit the project homepage for the CREATE Adult Skills Network and sign up for their newsletters. The network also hosts blogs and podcasts, both of which include discussions of research. People can also visit the IES-wide topic page for adult skills, which curates examples of the work happening across IES relevant to adult education or adult foundational skills.

Dr. Meredith Larson (Meredith.Larson@ed.gov) is a research analyst and program officer at NCER. Her focus areas include postsecondary teaching and learning, adult education, and postdoctoral research training. She was trained in cognitive and instructional psychology and psycholinguistics and has served as a volunteer tutor for refugee children and in adult basic and adult secondary education programs.

February is Career and Technical Education (CTE) month! As part of our 20^th anniversary celebration, we want to highlight the great work our CTE Research Network (CTERN) continues to accomplish. This guest blog was written by James Kemple, Director of the Research Alliance for New York City Schools and the principal investigator (PI) of a CTERN research project that is examining CTE in New York City.

While “college and career readiness” are familiar buzzwords in K-12 education, it has often seemed like system leaders shout “college” and whisper “career.” During the last decade, as it has become clear that a high school diploma has limited value in the 21^st century labor market, career and technical education (CTE) has become a more prominent way to explicitly prepare students for both college and career. For the CTE field to evolve productively, valid and reliable evidence should inform policy and practice, for example by identifying conditions under which CTE may be more or less effective and for whom.

CTE and College and Career Readiness in New York City

One such project is our ongoing study of New York City’s CTE programs. The current phase of the study focuses on 37 CTE-dedicated high schools, which are structured to ensure that all enrolled students participate in a CTE Program of Study from 9th through 12th grade. These programs are organized around an industry-aligned theme (for example, construction, IT, health services, etc.) and offer a sequence of career-focused courses, work-based learning opportunities, and access to aligned college-level coursework. Our study uses an especially rigorous approach to compare the experiences and outcomes of nearly 19,000 NYC students who were assigned to a CTE-dedicated high school between 2013 and 2016 with those of similar students who also applied to CTE programs but were assigned to another high school during the same period.

When our research team looked at the overall impact of 37 CTE-dedicated high schools in NYC, we found that CTE students graduated from these high schools and enrolled in college at rates that were similar to their counterparts in non-CTE high schools. On average, therefore, being in a CTE high school did not steer students away from a college pathway.

Variations in CTE Programs

A much more interesting story emerged when we took a closer look at variation in student experiences and outcomes. In fact, some of the schools produced statistically significant reductions in immediate college enrollment, while others produced increases in the rate at which students enrolled in college.  Why might this be?

The study team identified two possible reasons. First, the schools in our sample differed based on the policy context in which they were created: 21 of the schools were established after 2008 as the NYCDOE undertook a major expansion of CTE in the midst of a larger overhaul of the city’s high schools that included closing persistently low-performing schools, opening new small schools in their place, and creating a universal high school admissions system that gave students access to schools across the city. In contrast to the 16 longstanding CTE high schools—some of which dated back to the early 1900s—these new high schools were smaller, with more thematically aligned sets of CTE programs, and non-selective admission processes. Most of the longstanding CTE schools used test scores, grades, or other performance measures as part of their admissions criteria.

Second, the schools in the study differed in terms of their intended career pathways—and the extent to which these career pathways require a post-secondary credential for entry-level jobs. Notably, nine of the newer (post-2008) high schools focused on career pathways that were likely to require a bachelor’s degree (referred to “college aligned”). CTE programs in the remaining 12 newer high schools and all of the CTE programs in the 16 longstanding high schools focused on either “workforce-aligned” career pathways—allowing students to enter the labor market directly after high school—or “mixed” pathways that require additional technical training or an associate degree for entry-level jobs. Interestingly, each of these groups of schools included a mix of CTE career themes. For example, some health- or technology-focused CTE programs reflected college-aligned pathways, while other programs with these themes reflected workforce-aligned pathways.

We found that the newer, smaller, less selective CTE schools with more tightly aligned career themes had positive effects on key outcomes—particularly those that were focused on college-intended career paths. These schools produced a substantial, positive, statistically significant impact on college enrollment rates. Students in these schools were nearly 10 percentage points more likely to enroll in a four-year college than those in the non-CTE comparison group.

By contrast, the larger, more selective CTE schools, with a range of work-aligned career pathways, were associated with null or negative effects on key outcomes. Notably, these schools actually reduced four-year college enrollment rates.

Applying Lessons Learned

The extraordinary diversity of NYC’s CTE landscape and its student population provides a unique opportunity to gather information about program implementation, quality, accessibility, and costs, and about how these factors influence CTE’s impacts on college and career readiness. A recent report from the project provides new insights into strategies for learning from variation in CTE programs and contexts, as well as particular policies and programming conditions that may enhance or limit college and career readiness.

Recent efforts to enhance CTE, including those underway in NYC, wisely focus on such key elements as rigorous and relevant CTE course sequences, robust work-based learning opportunities, and articulated partnerships with employers and post-secondary education institutions. The findings from this study point to additional conditions that are likely to interact with these curricular and co-curricular elements of CTE—such as providing students with smaller, more personalized learning environments; using inclusive (less selective) admissions policies; and aligning high school requirements with post-secondary options. It will be crucial for policymakers to attend to these conditions as they work to strengthen students’ pathways into college and careers.

Finally, it is important to note that we do not yet have all the information needed to fully discern the impact of NYC’s diverse CTE options. Data on employment and earnings will be crucial to understanding whether students in these schools opted to enter the workforce instead of, or prior to, enrolling in college—and how these decisions affected their longer-term trajectories.

This blog was produced by Corinne Alfeld (Corinne.Alfeld@ed.gov), program officer, NCER.

This year, Inside IES Research is publishing a series of blogs showcasing a diverse group of IES-funded education researchers and fellows that are making significant contributions to education research, policy, and practice. In this guest blog, Dr. Tabitha Stickel, a second-year postdoctoral research fellow at the Georgia State University (GSU) Postdoctoral Training on Adult Literacy (G-PAL) program shares her experiences working with adult education programs in Native American tribal lands and how it has shaped her work and purpose.

Entering Adult Education: Connection to the Land and Peoples of the Southwest

Prior to graduate school, I found work as an adult education teacher at a rural, southwestern community college in the traditional lands of the Diné (Navajo), the Hopi, and the Ndee (Western Apache). This college, which served the indigenous communities, was set in the short-grass prairies, spotted with juniper trees in a land that seemed silent and empty to the untrained eye. But the land was full of life and opportunity, and the students I met gave me new appreciation for the opportunities adult education could provide.

As an adjunct faculty in an adult basic and developmental education program, I traveled several hours each week to teach classes on the Diné and Hopi tribal lands. I was immediately struck by the students’ dedication to their education and personal goals—to be the first in their families to earn a college degree, help their children or grandchildren with homework, find or keep employment, and/or fulfill the promise of completing high school made to themselves or others. 

Challenges in Adult Education for Rural Students

Despite this dedication, adult students face a variety of barriers to attending classes. Adult students often must contend with the challenges of caretaking, work, and transportation—a perennial problem for rural students, as there is no public transportation. Some students were able to carpool, and some of the tribes arranged vans to transport the “closer” students to the campus.

Even when faced with such challenges, students showed up each week. I had students without electricity at home who used their cell phones to access class materials, one of many such examples of the digital divide in rural areas. I had a student who made burritos each week and sold them to raise money for a desk for her schoolwork. These students drove my passion for my work. When students overcome incredible odds for their education, how can an educator do anything other than rise to meet them? Earning an education credential, such as a high school equivalency, could have far-reaching positive outcomes for the students and their families. 

What My Students Taught Me

In addition to learning about the challenges and rewards adult learners face, I also learned the importance of listening to students and checking assumptions. For instance, I had a GED student who was chronically late. One day, I called her because I was frustrated that she was over an hour late, only to learn that she was on her way. In fact, she was walking more than 20 miles to come to class. She had been unable to hitch-hike to class as she normally would. I was completely humbled in that moment and realized that my assumptions were keeping me from understanding her. She ended up earning her GED a month later.

When my students shared their stories, I learned how their lived experiences—including the very land on which they lived—shaped them. When I began to truly listen to these stories and understand their importance, I became a better teacher. And I knew that these stories deserved to be heard and answered with more than I could offer as a single teacher.

Moving Between Two Worlds: Research and Practice

My experiences in the southwest prompted me to attend graduate school and research how to understand, empower, and teach adult learners. In general, however, there is insufficient research on adult education within and for certain populations. I wanted help to address this gap, so I centered my work on identifying culturally relevant themes of belonging for Native adult education students to explore the various pathways along which student belonging might develop.

In 2020, I returned to the adult education program I had worked in to gather stories from the students for my dissertation. I found student stories became intertwined with the pandemic and revealed the extent of the devastation the COVID-19 pandemic was having on the Native American communities and students’ sense of belonging. COVID-19 was making it more difficult for students to balance attending class and providing for their families. It was also making the digital divide even more apparent—as adult education programs transitioned to remote instruction, students had to navigate the realities of participating and belonging in the digital sphere. I further explore these themes in the Coalition on Adult Basic Education’s (COABE) forthcoming special issue on COVIDs effects on adult students.

As with other challenges, these Native communities and students continued to survive and thrive despite the tragedies of COVID-19. The students and staff in the adult education programs in these tribal communities deserve all the recognition in the world for their dedication, their creativity in addressing ever-present and ever-arising challenges, and their persistence.

My own commitment to this endeavor led me to become a postdoctoral fellow in the Georgia State University (GSU) Postdoctoral Training on Adult Literacy (G-PAL) program. I hope to soon return to the land and communities that have so integrally changed my life.  

Although I may return with more knowledge of the adult education field and how to facilitate classroom learning, I will occupy not just a “teacher” role but a student one as well, as I have much to learn from the lands, the people, and the experiences they inevitably shape.

Produced by Meredith Larson (Meredith.Larson@ed.gov), a program officer for IES Postdoctoral Training grants and Postsecondary and Adult Education research at NCER.

As we return from our celebration of Independence Day, we also want to celebrate the efforts and dedication of the learners and educators who participate in adult literacy’s integrated English literacy and civics education. This important, but sometimes forgotten, aspect of adult education opens opportunities for learners and creates an engaged, informed citizenry.

What is “integrated civics” in adult education?

Under Title II of the 2014 Workforce Innovation and Opportunity Act (WIOA), integrated English literacy and civics education refers to services for adult English language learners, including professionals with degrees and credentials in their native countries, to build their English language skills—foundational and more advanced—to support their roles as parents, workers, and citizens in the United States. These courses must include English literacy instruction and “instruction on the rights and responsibilities of citizenship and civic participation and may include workforce training.”

Are there specific curricula for these programs?

Although WIOA defined what had and could be included in this form of adult education, it did not specify how to include it. Nor did WIOA mandate a particular curriculum or instructional practices. Thus, programs offering these courses may leverage resources from multiple sources and design approaches to meet their communities’ needs.

Luckily, both the Office of Career, Adult, and Technical Education (OCATE, U.S. Department of Education) and the U.S. Citizen and Immigrations Services (USCIS, Department of Homeland Security) have developed resources and standards to help educators.

• OCTAE -- English Language Proficiency Standards for Adult Education
• USCIS – Guide to the Adult Citizenship Education Content Standards and Foundation Skills

Though multiple guides, online education resources, and other teaching materials are available, the evidence base and promise of these is not always apparent.  

Is IES supporting research in this area?

In FY21, IES awarded a research grant, Content-Integrated Language Instruction for Adults with Technology Support (CILIA-T), to Dr. Aydin Durgunoglu (University of Minnesota). She and her team of researchers and educators are developing and pilot testing a curriculum that aims to strengthen English language proficiency, knowledge of U.S. history and civics, and digital literacy. This project, which is part of the CREATE Adult Skills Research Network, is the first field-initiated research project IES has funded for adult English learners or adult civics.

Why is integrating language and civics important?

A fundamental instructional practice in adult education is to link instruction to activities and goals highly relevant to the adult learner. For refugees, immigrants, and others new to the United States, becoming a citizen and being able to communicate with others are both highly relevant goals and both daunting tasks. By blending the two, these courses may help adults persist longer and gain knowledge in skills in multiple domains concurrently.

Dr. Durgunglu notes—

I don’t think conversational skills are enough for refugees or immigrants as they learn to navigate in their new communities. To be participatory citizens, they need “academic” English, especially about rights and responsibilities. To really belong to a community, individuals need to know their rights so that they are not exploited and know their responsibilities such as voting and participating in the community activities. Knowing how the system works help people contribute to different type of the decision-making processes, from selecting schoolbooks to selecting a president.

On a personal note, as a naturalized citizen who learned about U.S. history and civics and then took the citizenship exam, these topics really helped me understand the American psyche, such as the individualistic streak that goes back to the pioneers, why government’s role in social services is so controversial in this country, and why one state can be so different from another. Having experienced censorship and autocratic governments, I have a lot of respect for the principle of checks and balances and am aware how fragile democracy and individual rights can really be if not protected dearly.

Where can people learn more?

To learn more about CILIA-T, visit the ABE Teaching & Learning Advancement Systems article: Civics/History Curriculum: An Introduction to the CILIA-T Curriculum Project.

To learn more about the CREATE Adult Skills Research Network, please visit the network lead’s site.

For additional resources, visit the U.S. Department of Education’s LINCS website, which includes items about civics education, English language learners, and other topics relevant to adult education.

For additional information and resources about the citizenship test and courses, visit the USCIS Citizenship Resource Center.

Written by Meredith Larson (meredith.larson@ed.gov), adult education research analyst and program officer for the CREATE Adult Skills Research Network.