Inside IES Research

Notes from NCER & NCSER

CTE Month? More like CTE Year!

In honor of CTE month, we wanted to provide more information about the recent additions to NCER’s CTE research portfolio: 7 new grants awarded across 2 grant programs in FY2021. A previous blog last summer announced these grants; this blog briefly describes each project (the hyperlinks will take you to the full online project abstract). Be sure to read to the end for links to other CTE work across IES!

 

Within the Education Research Grants program (305A), the following projects were funded in 2021:

College and Career Readiness: Investigating California's Efforts to Expand Career Technical Education Through Dual Enrollment

(PI: Michal Kurlaender, University of California, Davis)

This project is examining the result of policy changes due to California Assembly Bill 288 (AB288), enacted in 2015 to create the College and Career Access Pathways (CCAP) partnership. CCAP increased the prominence of Career and Technical Education (CTE) at the high school level by allowing high schools and community colleges to enter joint partnerships and offer dual enrollment courses that count towards both a high school diploma and an associate degree from California community colleges. 

Postsecondary and Labor Market Effects of Career and Technical Education in Baltimore City Public Schools

(PI: Marc Stein, Johns Hopkins University)

This project uses a unique selection process into CTE Centers within a large school district, linked with longitudinal state data, to provide strong evidence on the benefits and mechanisms of CTE participation on secondary education, postsecondary education, and labor market outcomes.

SREB Career and Technical Education Leadership Academy Study

(PI: James Stone, Southern Regional Education Board)

This project is developing, piloting, and studying the promise of the Southern Regional Education Board (SREB) Career and Technical Education Leadership Academy to increase the capacity of school leaders at career and technology centers to work with their teachers as instructional leaders and thereby improve CTE outcomes for their students.

An Experimental Evaluation of the Efficacy of Virtual Enterprises

(Co-PIs: Fatih Unlu, RAND Corporation and Kathy Hughes, AIR)

In this project, the research team will provide the first causal evidence on the efficacy and cost-effectiveness of Virtual Enterprises, a virtual school-based enterprise (SBE) program. SBEs are one form of work-based learning (WBL) in which students run a business that produces and sells goods or services. SBEs may offer unique benefits relative to other types of WBL by providing opportunities for more students to participate, reducing the need for transportation, and allowing students more room to make and learn from their mistakes. Note: Since this is an efficacy (causal impact) study, it has joined the CTE Research Network.

Sub-baccalaureate Career and Technical Education: A Study of Institutional Practices, Labor Market Demand, and Student Outcomes in Florida

(PI: Angela Estacion, WestEd)

The purpose of this project is to address existing policy and research gaps by, first, administering a statewide survey to catalogue the institutional practices that Florida community and technical colleges use to align CTE programming to the labor market. Second, by combining the survey data with student-level program participation and outcome data, the project team will ascertain the degree to which institutional practices and labor market conditions in students' geographical areas are correlated with students' choices and outcomes. Finally, the project team will analyze qualitative data collected from case studies of Florida community and technical colleges to describe the practices cited in the survey data and understand the process of aligning courses and programs with local labor market demand.

 

Within the “Using SLDS to Support State Education Policymaking” (305S) grant program, the following projects were funded in 2021:

The Distributional Effects of Secondary Career and Technical Educational (CTE) Programs on Postsecondary Educational and Employment Outcomes: An Evaluation of Delaware's CTE Programs of Study

(PI: Luke Rhine, Delaware Department of Education)

The Delaware Department of Education and University of Delaware is examining variability in participation rates among student subgroups in Delaware public high school CTE programs and link CTE high school participation to high school graduation, postsecondary enrollment, employment, and wages. Stay tuned to delawarepathways.org for more information as the project unfolds.

Analyzing and Understanding the Educational and Economic Impact of Regional Career Pathways

(PI: Jonathan Attridge, Tennessee)

The research team is conducting an evaluation of Tennessee Pathways (along with earlier career pathway programs), a state initiative to align K-12 education, postsecondary education, and employers so that high school students have a clear pathway to move into the workforce.

 

For a full list of CTE-related grants funded by NCER and NCSER across years, topics, and grant competitions, you can explore our “funded projects” search pages for NCER or NCSER. Here is a recent blog post about students with disabilities in CTE from NCSER. And don’t forget to visit the CTE Research Network frequently for many new CTE-related findings and resources!

NCEE and NCES have published multiple reports on CTE, including Career and Technical Education Credentials in Virginia High Schools: Trends in Attainment and College Enrollment Outcomes, as well as some great blogs such as this one on exploring the growing impact of career pathways from NCEE. You can see more on career readiness from NCEE here and from NCES here.

We are so pleased with the growth of this portfolio since our first call for more CTE research 5 years ago! However, there continues to be a need to better understand CTE. For instance, research is still needed on CTE measures and assessments, quality of programs (content, instruction, and opportunities for WBL), and variation in impacts across student subgroups and career clusters.


For more information about CTE research grants, including feedback on new project proposal ideas, please contact NCER program officer Corinne.Alfeld@ed.gov.

IES Research on Improving Career Readiness and Employment Outcomes for Students with Disabilities

Group of three students in vocational education and training for electronics

Accessibility to job opportunities has long been a challenge for individuals with disabilities. In 2020, people with disabilities had a much higher unemployment rate (12.6%) than those without a disability (7.9%). To raise awareness about disability employment issues and celebrate the contributions of workers with disabilities, National Disability Employment Awareness Month (NDEAM) is held every October. The 2021 theme for NDEAM is “America’s Recovery: Powered by Inclusion,” which underscores the importance of ensuring that people with disabilities have access to employment as the nation recovers from the pandemic.

NCSER supports research related to career readiness and employment for students with disabilities through the Transition to Postsecondary Education, Career, and/or Independent Living (Transition) research program. Since its inception in 2006, NCSER has invested over $58 million in the Transition program and the portfolio has grown to 38 research grants. To encourage additional research in the important but under-studied area, NCSER also competed the Career and Technical Education for Students with Disabilities (CTE) special topic in FY 2019 and FY 2020, awarding three research grants totaling around $3 million.

Below are examples of recently funded Transition and CTE studies that are exploring, developing, or evaluating programs, policies, and practices aimed to help improve career readiness and employment outcomes for students with disabilities.

NCSER also plans to support additional research for students with disabilities with a new grant competition, Research to Accelerate Pandemic Recovery in Special Education, funded through the American Rescue Plan. This grant competition will fund research that addresses pandemic recovery, including recovery relevant to career readiness.

For more information about NDEAM as well as ideas for celebrating this month, please see https://www.dol.gov/agencies/odep/initiatives/ndeam.

Written by Akilah Swinton Nelson, Program Officer at National Center for Special Education Research. For more information about the Transition to Postsecondary Education, Career, and/or Independent Living and Career and Technical Education for Students with Disabilities topic areas, contact Akilah at akilah.nelson@ed.gov.

CTE Research Is Flourishing at IES!

Since its inception in 2017, the CTE portfolio in the National Center for Education Research (NCER) at IES has grown to 11 research grants and a research network! Several other CTE-related grants have been funded under other topics, such as “Postsecondary/Adult Education” and “Improving Education Systems” in the education research grants program, and in other grant programs such as “Using SLDS to Support State Policymaking.” Two CTE-related grants under the latter program were awarded in FY21—

The newest grants funded in FY21 in the CTE topic of the Education Research Grants program include—

As a causal impact study, the last project (on Virtual Enterprises) has been invited to join NCER’s CTE Research Network as its sixth and final member. Funded in 2018 to expand the evidence base for CTE, the CTE Research Network (led by PI Kathy Hughes at the American Institutes for Research) includes five other CTE impact studies (one project’s interim report by MDRC was recently reviewed by the What Works Clearinghouse and was found to meet standards without reservations). You can read more about the network’s mission and each of its member projects here.  

On AIR’s CTE Research Network website, you can find several new resources and reports, such as: 

The CTE Research Network has also been conducting training, including workshops in causal design for CTE researchers and online modules on data and research for CTE practitioners, shared widely with the field by a Network Lead partner, the Association for Career and Technical Education (ACTE). 

Last but certainly not least, if you are interested in getting your CTE project funded by IES, see the new FY22 research grant opportunities on the IES funding page. To apply to the CTE topic in the Education Research Grants program specifically, click on the PDF Request for Applications (ALN 84.305A). Contact Corinne Alfeld with any questions you might have.


Written by Corinne Alfeld (Corinne.Alfeld@ed.gov), NCER Program Officer 

 

Career and Technical Education Month®: Improving Outcomes for Secondary Students with Disabilities

February marks Career and Technical Education Month®, a public awareness campaign that highlights and celebrates career and technical education (CTE). CTE programs emphasize career preparation, skill trades, applied sciences, and modern technologies. CTE coursework integrates academic knowledge with post-secondary pathways and careers by directly preparing middle and high school students with coursework related to high-demand industries.

To encourage research to improve career readiness skills and transition outcomes for students with or at risk for disabilities, the National Center for Special Education Research (NCSER) competed a special topic on Career and Technical Education for Students with Disabilities in FY 2019 and FY 2020. A previous blog post focused on the FY 2019 grant. In FY 2020, NCSER awarded two new research grants through this special topic:

CTE Teachers and Long-Term Outcomes for Students with Disabilities

The purpose of this exploratory project is to assess CTE teacher effectiveness for students with disabilities. Principal Investigator Dan Goldhaber at the University of Washington and his colleagues (co-PIs Kristian Holden and Roddy Theobold) will estimate CTE teacher effectiveness using high school attendance, GPA, persistence, and graduation probability as outcomes. They will also consider longer-term outcomes including college enrollment and employment, as well as whether CTE teacher effectiveness varies according to teacher licensure, pathway into teaching, and prior work experiences.

Supported College and Career Readiness for Secondary Students with Emotional and Behavioral Problems

In this study, Principal Investigator Lee Kern at Lehigh University and her colleagues (co-PIs Chris Liang and Jennifer Freeman) will develop and pilot test a multi-component program, Supported College and Career Readiness, that augments typical school-based college and career readiness activities (such as those associated with CTE). The research team aims to further support high school age students with or at risk for emotional and behavioral disorders (EBD), whom research suggests are insufficiently benefiting from college and career readiness activities. As a result, students with or at risk for EBD are frequently unprepared for career or postsecondary education pathways.

We asked each Principal Investigator to share the motivation for studying this research topic and what makes their study unique and impactful.

What inspired you to study this research topic?

Photo of Dan GoldhaberDr. Goldhaber: At CALDER, we have contributed to a large body of research on the impacts of math and ELA teachers on students. This body of evidence suggests that the quality of the teacher workforce is the most important schooling factor influencing students test and non-test outcomes. But we were surprised to find that, despite growing interest in CTE, there is a surprising lack of empirical research on CTE teacher contributions to student learning. We think this is a particularly important issue for students with disabilities for two reasons. First, CTE teachers have different pathways to teaching than academic teachers, and these pathways may provide less pedagogical preparation for the unique needs of students with disabilities. And second, students with disabilities are significantly more likely to be enrolled in these courses relative to students without disabilities. As such, this project lies at the intersection of our prior work on academic teachers, and our recent work on CTE participation for students with disabilities.

Photo of Lee Kern

Dr. Kern: Spending time with high school age students with emotional and behavioral problems brought me to truly understand how little they consider their futures. And, even when they have goals and dreams, they see scarce connections between what they are being asked to do in high school and realizing their goals. It occurred to me that finding ways to strengthen this connection might be an avenue not only to better prepare students for post-high school life, but also to reduce dropout. Indeed, the need to better prepare youth for life after high school has been increasingly embraced, especially in the last decade, evidenced in part by the adoption of career and college readiness (CCR) standards in almost every U.S. state. I witnessed many impressive CCR efforts and programs in high schools, yet it appeared that students with emotional and behavioral problems were failing to access these school-based CCR supports, some of which did not seem well aligned with their needs. With support from a Lehigh University faculty grant, I began to research exactly how this subset of students regarded, accessed, and benefitted from CCR activities and supports. This research underscored the need to supplement important components of CCR to better align with the needs of students with emotional and behavioral problems. Our goal in the current project is to develop and evaluate an intervention package that supplements high school CCR activities to better prepare students with emotional and behavioral problems for community, college, and/or career.

What makes your project unique and exciting? 

Dr. Goldhaber: This project will use unique data from Washington state that allows us to track students with disabilities in high school, postsecondary education, and employment. Access to long-term outcomes is both unique and important given that test scores are not likely to be a very good measure of the contributions that CTE teachers make toward student education. Our project is also closely focused on CTE workforce issues. The staffing of CTE courses is quite challenging—in Washington state, for instance, over half of all CTE teachers have not completed the state’s teacher licensure requirements and hold limited CTE licenses. Thus, we believe the work will garner a lot of attention from policymakers.

Dr. Kern: I am especially enthusiastic about this project because it targets areas in which empirical research tells us that students with emotional and behavioral problems have insufficient CCR skills, perceptions, and knowledge. I am also fortunate to work with my co-PIs, Drs. Freeman and Liang, who bring diverse and unique expertise in the areas of CCR assessment, CCR counseling, racial/ethnic identity development, and more. I am also optimistic about the feasibility of this project because it capitalizes on existing school resources in the form of school-based CCR programs. So, rather than adding programs or interventions, it adapts and expands existing CCR components.

Tell us how your research results could possibly shape CTE-related policy.

Dr. Goldhaber: In broad terms, we do not know much about the impact of CTE teacher quality, so our study has the potential to inform broadly the myriad ways we think about the heterogeneity of CTE teacher effects. But, more specifically and narrowly, we will be looking at the connections between CTE effects and CTE teacher pathways, which should inform policies and practices around CTE preparation and licensure.

Dr. Kern: We hope that our efforts will shape future CCR policy. Our aim is to build the evidence-base in the area of CCR supports that address the needs of students at risk for emotional and behavioral problems. Ultimately, we would like to see federal policies that guarantee at-risk students in all high schools in the U.S. receive comprehensive, evidence-based CCR interventions and supports that fully prepare them for life after high school.

For more information on CTE and students with disabilities, the Association for Career and Technical Education (ACTE) and the National Technical Assistance Center on Transition (NTACT) provide useful resources. In addition, ACTE, NTACT, and Penn State University’s Workforce Education program hosted a five-part webinar series in 2019 about programs, practices, and partnerships that support students with disabilities in CTE. This series can be viewed here.

This blog was authored by Alice Bravo (University of Washington), IES intern through the Virtual Student Federal Service, and Akilah Nelson, Program Officer at NCSER. For more information about the Career and Technical Education for Students with Disabilities topic area, contact Akilah Nelson.

The views expressed by the investigators do not necessarily reflect those of IES.

New Project Exploring Adult Basic Skills in STEM-Related Postsecondary CTE®

In celebration of CTE® (career and technical education) month, we would like to highlight the launch of an NCER project that aims to help us understand how to best support adults seeking additional CTE education and training.

Through their exploratory project, Literacy, Numeracy, and Problem-Solving Skills in Technology-Rich Environment in the STEM-Related Subbaccalaureate Programs in the United States, researchers will use a mixed-method design to gather information about the distribution of basic skills (literacy, numeracy, and problem solving) for adults in STEM occupations and students enrolled in STEM-related sub-baccalaureate programs at community colleges. Their goal is to help identify the needs of students and the programming practices at community colleges that may promote basic skill development in STEM programs.

The team will be leveraging data from the Program for the International Assessment of Adult Competencies (PIAAC) to survey the distribution of skills and abilities across a nationally representative sample of adults in STEM fields. They will also be collecting primary data from adults and programs in multiple locations, including Indiana, Ohio, and Washington states.

 

 

To help inform the public about their project, the researchers have created a short YouTube video for the public. This project began in July 2020 and may have initial results ready as early as late 2021.

 


Written by Meredith Larson (Meredith.Larson@ed.gov), Program Officer for Postsecondary and Adult Education, NCER.