Inside IES Research

Notes from NCER & NCSER

Career Pathways Programming in Adult Education Programs: What We are Learning from Three Cities

As part of our series recognizing the IES investment in Career and Technical Education (CTE) research, we interviewed Esther Prins, Professor at Pennsylvania State University, about her NCER-funded project, Career Pathways Programming for Lower-Skilled Adults and Immigrants: A Comparative Analysis of Adult Education Providers in High-Need Cities.  This Researcher-Practitioner Partnership involves researchers at Pennsylvania State University working in collaboration with adult education providers in Chicago, Houston, and Miami to better understand how adult education programs are incorporating career pathways into their delivery models.

What is the education issue you and your partners trying to address?

Millions of U.S. adults have been left behind by the economy and rising education requirements for even minimum-wage jobs. Career pathway (CP) programs help adults prepare for employment and postsecondary education. Although recent federal policy (e.g., WIOA) has encouraged CP programming among adult education providers, there is little research to help guide practice and few opportunities for providers to learn about how their peers organize CP programs, who they serve, what outcomes they measure, and other program features.

What are career pathway programs in adult education?

CP programs develop adults’ basic math, reading, and English language skills, while concurrently preparing them to enter postsecondary education or jobs in specific fields like healthcare or manufacturing. These programs can be run through many kinds of institutions, including community colleges, workforce development organizations, and community-based organizations. The adults seeking CP classes may vary in their skill levels, but our project focused on the adults with greatest barriers to education and employment: those who did not graduate from high school or who have low math, reading, or English language scores.

What are some of the specific concerns your practitioner partners have?

Some practitioners are concerned that requirements programs must meet may unintentionally reward programs for enrolling higher-level students—the ones who are most likely to find a job or enroll in college—rather than serving students with the greatest need. They also want to know about what non-academic supports programs may need to provide, so we are exploring the role of wraparound support services. These are important because many adult learners experience poverty and related challenges such as transportation, childcare, housing, and financial instability.

What are some of the major findings thus far?

First, CP programming is widespread: more than 90% of the surveyed organizations offered or were developing CP classes in 2015. However, there are no shared program outcome measures, and this hinders comparison and documentation of programs’ collective impact. Coordination within cities primarily occurs on a small scale between a subset of organizations; citywide coordination across organizations and funding streams is less common.

Second, the majority of CP classes require students to meet minimum entry requirements such as passing a reading, math, or language test and/or possessing a high school degree. These requirements limit access for adults with the greatest barriers. To address these issues, programs are trying different options. For example, some programs offered multiple entry points (e.g., bridge classes) to enable adults with skills gaps to advance from lower-level to higher-level CP classes.

Third, agencies offer a variety of wraparound support services to meet students’ non-academic needs. Some programs bundle support services, meaning they require participation in at least two support services. These include screening for income supports and access to financial services, financial coaching and literacy, and job coaching.

The report on the survey is available online.

 

How are the findings being used?

Building on the findings from this study, the Chicago Citywide Literacy Coalition formed a group of 13 adult education providers to staff a Career Navigator at their local American Jobs Center to address issues such as forming shared program metrics, helping adults with lower skills, and connecting adults to support services available at the American Jobs Center. 

What other issues need to be studied?

Practitioners are interested in better understanding the long-term effects and trajectories of students in CP programs. For example, they’d like to know more about postsecondary and employment outcomes and whether certain individual characteristics, program supports, or instructional approaches lead to better outcomes. Additional research could help shed light on these issues.

Meredith Larson, NCER Program Officer, interviewed Esther Prins 

The figures above are from an infographic prepared by the research team and summarize the data gathered by the team.

Teaching 21st Century Skills to Community College Students: An Innovative Approach Under Development in California

As part of our series recognizing Career and Technical Education (CTE) month, we interviewed Mary Visher, Senior Associate at MDRC, about her recently funded study, Teaching and Learning 21st Century Skills in Community Colleges: A Study of the New World of Work Program (NWoW). This project is developing and testing an innovative program aimed at teaching 21st century skills to community college students in CTE courses. Researchers, policymakers, and practitioners are working closely together to improve upon NWoW, which is already in use in several community colleges in California.

What are 21st century skills, and why are they important?

There is growing consensus among researchers, practitioners, and employers that 21st century skills–e.g., adaptability, analytic mindset, collaboration, and communication–are essential for success in both school and in the modern workplace. We believe that postsecondary programs need to incorporate strategies to ensure that students graduate with these skills.

Why are you (personally) excited about this work?

About two years ago, I was interviewing community college students in California about their experiences when a young man walked into the room. The first thing I noticed were his tattoos, which covered every inch of his exposed skin. The next thing I noticed was how he strode over to me, stretched out his hand to shake mine with a firm grip, looked me in the eye, smiled warmly and introduced himself. Having interviewed hundreds of community college students for other research projects, I had rarely – if ever – encountered this level of self-assurance, respectful courtesy, and ability to immediately adapt and respond to an unfamiliar person with an unfamiliar purpose.

The young man told me that he had been incarcerated as a teen for gang involvement, and, after being discharged from prison, he couldn’t find work. With few other options, he enrolled in the diesel technology program at his local community college, but this was not an ordinary CTE program. It included NWoW.

Through NWoW, he learned 21st century skills in the context of learning diesel technology skills and had worksite experiences to practice both. He told me that this part of his education “changed his life.” He did so well in a job interview at a food processing equipment manufacturer that he was not only hired, but quickly promoted to a management position. At the time we met, he was to receive company training and another promotion, but he still planned on earning his certificate. After that, he planned on applying to a state university to pursue a BA or a master’s degree.

The young man credited his professional success to NWoW, where he learned behaviors and skills no one else had taught him. It is exciting to be a part of developing and testing a program that may affect the lives of adult students in such ways.

How did NWoW come into being?

In 2015, faculty at a community college in California noticed the deficiencies in students’ soft skills and developed a 21st century skills curriculum to use in their classes. They added a work-based learning and an assessment component a short time later. Soon thereafter, the California Community Colleges Chancellor’s Office noticed their work and gave them support to further develop the program and take it to more colleges. 

What are the core components of the NWoW program?

NWoW is designed to promote growth in 10 skills and has 3 core components, all 3 of which will undergo an iterative development process in the next 2 years:

  1. A curriculum designed to be embedded in CTE community college courses;
  2. A work-based learning component to allow students practice the skills in an authentic work setting; and
  3. An assessment/credentialing component allowing students to earn a “digital badge” in each of the 10 skills.

What is your research goal?

Our goal is to work with instructors (including the original program designers), employers, and other partners to further refine and enhance this program. Moreover, we hope to address important questions in the field about whether or how such skills can be taught and learned in the classroom, how to measure them, and how to signal competency to employers and others. 

Who else is involved?

MDRC is working with the NWoW team and its partners, including the California Community Colleges Chancellor’s Office, the Foundation for California Community Colleges, LinkedIn, and badgr. The development work is ongoing with three community colleges, and we will then test the improved version in a new set of colleges.

By Mary Visher, Senior Associate at MDR​C, interviewed by Meredith Larson, NCER

 

Career and Technical Education at IES

Welcome to Career and Technical Education (CTE) month!

Over the course of the next few weeks, we will be blogging about IES projects and resources relevant to CTE. We will be highlighting grant competitions, including our newest competition, Expanding the Evidence Base for Career and Technical Education, which aims to increase research on the impact of CTE programs and policies on student outcomes and support training of new CTE researchers. And we will showcase work conducted by IES and our grantees.

For this first blog, we wanted to share our working definition of CTE, along with links to information and resources.

CTE aims to help students enter into and succeed in specific occupational fields such as health science, information technology, and business administration. Students in secondary, postsecondary, and adult education may pursue CTE activities as part of their other education requirements (e.g., courses for high school graduation, classes to prepare for General Equivalency Development or General Equivalency Diploma (GED) test) or as a program to earn an occupational certificate at the subbaccalaureate level.

Over the past decade, interest has been growing in CTE and career pathway models across public and private arenas. For example, at the federal level, interest in CTE is reflected in the legislations that authorize these education and training activities, namely the Carl D. Perkins Career and Technical Education Act of 2006  and the Workforce Innovation and Opportunity Act of 2014.

At IES, our goal is to identify the needs of CTE students and expand our understanding of effective CTE practices. For example, the National Center for Education Statistics (NCES) assists in monitoring the status of CTE by providing national information on student participation in CTE at the secondary and postsecondary levels and on adults’ preparation for work. This information is available on the CTE Statistics website.

The National Center for Education Evaluation and Regional Assistance (NCEE) also supports work on CTE. For example, NCEE’s Regional Education Laboratory Programs work with policymakers and practitioners on career and college readiness issues, including CTE. Some regions have groups that focus on CTE directly, such as REL Appalachia's West Virginia Workforce Readiness Partnership and REL Mid-Atlantic's Readiness for Career Entry and Success Research Alliance.

The two grant-awarding centers, the National Center for Education Research (NCER) and the National Center for Special Education Research (NCSER) support field-initiated research in CTE primarily through the Career and Technical Education, Postsecondary and Adult Education, and Transition Outcomes for Secondary Students with Disabilities topic areas. In September 2017, NCER and NCSER sponsored a technical working group meeting to gain insights from CTE practitioners and researchers. On January 22, NCER released the request for applications for the new research network mentioned above, Expanding the Evidence Base for Career and Technical Education.

We look forward to sharing more information about our CTE research and statistics. Come back throughout the month to hear from IES staff and grantees about this work!

By Meredith Larson (NCER)

 

IES Funds New Research in Career and Technical Education

The Institute of Education Sciences (IES) funds research in a broad array of education topics. In fact, the Education Research Grants Program alone funds research in 11 specific topics, such as early learning, reading and writing, STEM, postsecondary and adult education, English learners, social behavioral contexts for learning and others.

In 2017, the National Center for Education Research (NCER) introduced a twelfth area, Special Topics, to address important areas in education that are of high interest to policy makers and practitioners where there is a research gap.

As we noted in a previous blog, Career and Technical Education (CTE) is one such area. Across the country, CTE programs and policies are growing, creating a greater need for high-quality, independent research in this area. The Career and Technical Education (CTE) special topic seeks to fill this research gap by funding projects that study the implementation of CTE programs and policies and how they impact student outcomes in K-12 education. In 2017, IES has funded its first three special topic research grants on CTE:

  • New York University will study the impact of New York City's Career Technical Education programs on students' career and work-related learning experiences, social and behavioral competencies, high school completion, and transitions to college and the work place;
  • The Education Development Center will lead a study that compares three different ways that CTE is delivered in California—career academies, career pathways, and elective CTE courses. The researchers will examine relationships between CTE delivery mode and student outcomes; and
  • A study of Florida’s CTE certification program will be conducted by Research Triangle Institute (RTI). The study will identify which high school certifications are associated with a higher likelihood of passing certification exams and whether obtaining a certification leads to better attendance, graduation rates, and postsecondary enrollment and persistence.

For its 2018 grant competition, IES is again accepting applications for CTE research grants, as well as two other special topics.

The Arts in Education special topic funds research to better understand how arts programs and policies are implemented and the impact they have on student outcomes. The research coming out of this program can help inform policy debates regarding the benefits of arts programming in schools. (Read a recent blog post on this topic.)

The Systemic Approaches to Educating Highly Mobile Students special topic seeks to fund research aimed at improving the education and outcomes for students who frequently move schools because of changes in residence and/or unstable living arrangements. This includes students who are homeless, in foster care, from migrant backgrounds or are a part of military families. (Read a recent blog post on this topic.)

You can learn more about these and other funding opportunities on the IES website, and on Facebook and Twitter

Written by Dana Tofig, Communications Director, IES

Career Technical Education is Growing; Research Must Follow

By Corinne Alfeld, Program Officer, NCER

February is Career Technical Education (CTE) month and there is certainly cause to celebrate for those who value CTE. After years of being marginalized in K-12 education and education research, CTE programs and offerings are growing across the country.   

Once known as “vocational-technical education,” CTE has undergone a transformation in the last decade that keeps pace with changes in workforce. High schools now offer elective CTE courses such as agricultural science, business entrepreneurship, computer graphic design, culinary arts, communications, health care, and mechatronics.  High school CTE courses have the ability to provide a context for students to explore possible careers, test their interests and abilities, apply academic knowledge and skills to real-world problems in a more project-based, hands-on way, and learn a useful skill. In other words, CTE can answer the question that many students ask: Why do I need to learn this?

Due in part to employer interest and involvement, CTE has become more of a focus for policymakers and education leaders as a way to ensure students are “college and career ready” when they graduate from high school. In 2015, the Association for Career and Technical Education documented 150 new and revised CTE laws or policies across 46 states. CTE programs are undergoing transformation with newfound vitality and momentum, with new delivery models, such as career academies, in which the entire curriculum is focused on one career area; programs of study that link high school and college courses with workplace experience; and regional CTE centers, which contain specialized equipment shared by multiple schools or districts and focus solely on CTE.

This means that CTE learning opportunities for students may range from a single introductory course in a traditional high school setting to a highly coordinated curricular experience of classroom- and work-based learning, culminating in a capstone project. 

As CTE becomes a larger part of the current education landscape, policymakers and practitioners need better evidence to guide their decision-making, especially given limited resources. For example, more research is needed on the following:

  • The relationships between specific career-focused school, program, or curricular features and student education outcomes;
  • Longitudinal pathways and outcomes for students enrolled in K-12 CTE programs (e.g., postsecondary education and employment);
  • Development of effective career-oriented programs or policies designed to support students’ career readiness outcomes;
  • Rigorous evaluation of existing career-focused schools or programs, including career technical programs of study, career academies, and other K-12 CTE delivery models;
  • Rigorous evaluation of state or district policies or reforms to support career technical education at the K-12 level, including the awarding of vocational diplomas, the use of career readiness measures, career academy models, awarding academic credit for CTE courses, and CTE teacher certification requirements; and
  • Development or improvement of measures of technical, occupational, and career readiness skills.

There are certainly challenges in studying CTE. In addition to the wide variety of CTE courses being offered, the range and quality of instructional CTE offerings can vary within and across schools. 

Researchers must struggle with questions, such as what is the treatment? How does one account for self-selection bias? Who are the counterfactuals? What are reliable and valid (and meaningful) outcome measures? How soon can effects be seen? As CTE expands in our K-12 education system, the field is in need of creativity and perseverance from researchers to overcome these challenges and build a robust body of both descriptive and causal evidence on which education leaders and policymakers can make decisions.

If you have ideas for CTE research projects, NCER would love to hear from you. Please contact Research Scientist Dr. Corinne Alfeld (corinne.alfeld@ed.gov or 202-245-8203) to share your thoughts or ideas.