Inside IES Research

Notes from NCER & NCSER

Learning from CTE Research Partnerships: Using Data to Address Access and Equity Barriers in Massachusetts

As part of our ongoing blog series aimed at increasing state research on career and technical education (CTE), Corinne Alfeld, Research Analyst at the Institute of Education Sciences (IES) and Austin Estes, Senior Policy Associate at Advance CTE, are conducting interviews with individuals who are part of successful CTE State Director research partnerships. The third interview was with Cliff Chuang at the Massachusetts Department of Education and Shaun Dougherty of Vanderbilt University. Note: this interview, from February 5, 2020, has been edited for length and clarity.Photograph of Cliff Chuang and Shaun Dougherty

Could you start by talking about the projects that you’ve worked on, your research questions, and how you settled on those research questions?

Shaun - It grew out of my dissertation work that was using some of the school data and then some of the statewide data from Massachusetts. It started pretty narrowly but the director of research was happy enough with what I was able to do that she talked about whether we could address some additional questions, and more data was becoming available. That more or less triggered the expansion, and then with Cliff coming into the role it became a two-way conversation that was more explicitly about what’s of academic interest and what’s of interest or of need on the practice and policy side for CVTE (career/vocational technical education).

Cliff – I would say that the particular catalyst for our most recent partnership is our desire as an agency to understand the waitlist demand issues related to chapter 74 CVTE in Massachusetts. If I recall correctly, we put out an RFR (request for responses)[1] for a research partner to help us analyze different aspects of who is and is not getting access to CVTE programs in Massachusetts. And Shaun and his partner Isabel at Harvard, a grad student there, their bid was selected. From that project there have been a lot of offshoots through the CTEx exchange collaboration that Shaun and others have established. We’ve been engaged in a lot of informal research inquiry as well as additional formal research that uses that data.

Could you talk a little bit about what the findings were from that project and what have been implications in the academic space but also on the policy front, how are you using those findings to change policy in Massachusetts?

Shaun – The basic findings were that in fact there is much more interest in these high-quality CTE programs, these chapter 74-approved programs in these standalone technical high schools, than can be met by current supply. This was more confirmatory evidence with a little more granularity and maybe confidence in the figures than was possible previously.

Cliff – Shaun’s team also helped us look at just the straight enrollment data comparisons, which is still not as ideal as looking at applicant data. It was helpful to have a more rigorous definition of what data protocols are needed around application and admissions. We have now made the decision to collect waitlist data systematically at the state level to allow researchers like Shaun to more rigorously analyze across the board the attributes of who’s interested in voc tech, who’s getting in, who’s applying, etc.

I think it also stimulated a variety of program initiatives on the part of state government in Massachusetts to increase access to CVTE programs through collaborative partnerships like After Dark, which is an initiative that seeks to utilize shop space in our technical schools after the regular school day paired with academics provided by a partner academic school to get more kids the technical training that we are unable to do in the standard day program structures.

I would also add that Shaun is continuing other aspects of the research now that we’re very excited about, based in part on some of the research they did do to look at longer term trends of students and their outcomes post high school.

Shaun – The first order concern is that lots of people want [access to CVTE programs] and there’s a limited amount of it, so should we have more?

The second order concern – but certainly not secondary question – is one about equity and whether or not the students who were applying and the students who were getting access look like a representative cross-section of the community at large.  We know that students who choose CTE or select a lot of it are maybe different than those who don’t, but we don’t know a ton about whether and how we expect students who are making those investments to look like the overall population or whether or not access concerns lead to equity concerns.

Cliff – We would like to look more closely at whether the gaps are simply due to application gaps – which is still an issue in terms of kids not applying – or whether there are actual gaps related to who is applying and getting in. That was the data gap that we haven’t quite been able to close yet. But Shaun was able to create some comparative data that is just based on enrollment that has allowed us to engage in these conversations. We’re having the conversation about trying to expand the number of seats available so there’s less of a waitlist, but also to ensure that access into the existing seats is equitable and doesn’t disadvantage certain subgroups over others.

Over the course of the partnership, what have been some of the major challenges and hurdles that you’ve faced? What are some of the speedbumps that you’ve hit getting things formalized up at the front?

Shaun – Fortunately, one thing that we didn’t face, although I know it’s an obstacle in many places, is processes related to how one gets permissions and access to the data. In fact, as the process has evolved, having those structures in place has made it really easy, so that if Cliff and I say “hey, we’d like to add this,” it’s a pretty easy amendment of the MOU (memorandum of understanding). And then the people who deliver the data get approval and then they deliver it through a secure portal.

Cliff – I would also say that researchers left on their own probably would have had much less success in getting district participation in the survey study we did together. I, on the other hand, am someone with positional authority at the state level and established relationships that I can leverage to get that participation. And then I can pass it off to the research team that actually has the expertise and bandwidth to execute on the very labor-intensive data collection, both quantitatively and qualitatively.

It seems like you have a good partnership and a good synergy between the state office and the research team. If you were talking to CTE leaders and other researchers, what are some strategies and practices to make sure that partnership runs effectively and can be as impactful as possible?

Cliff – I think it’s important to have someone in the role of a researcher director type person whose job it is to facilitate these partnerships and to do some of the nitty gritty around data sharing, MOUs, etc. The other thing I would say is to have a commitment to an evidence base in terms of policymaking, and have people in the programmatic leadership who see the value of that and have enough knowledge of how research functions to parlay whatever policy or relational capital they have to support the research agenda.

Shaun – I think sometimes overcoming the incentives related to purely academic publishing restricts some of the willingness of some academic researchers to invest or to think about important questions in practice and policy. It’s being willing to realize that strong partnerships with local and state agencies means that more and better work can be done, and the work can have impact in real time. There is something very fulfilling and useful and practical about taking that approach from a research standpoint and then, if you come from practice like I did, then it helps ground the work.

Other blog posts in this series can be viewed here.

 

[1] Cliff explained that this is a formal process by which they solicited proposals for pay. “What’s been nice is that because it’s a partnership, Shaun has secured funding from other sources so there’s not an explicit contractual arrangement always. Aspects of the research that are ongoing are follow-ons from the original study. We have an interest in continuing to mine the data long-term to inform practice and policy.”

What Are we Learning about Applied STEM CTE Course-taking by Students with Disabilities?

February was National Career and Technical Education (CTE) Month, which celebrates the importance of CTE and the achievements and accomplishments of CTE programs across the country. IES supports research in this area, including grants funded through the National Center for Education Research (NCER) and the National Center for Special Education Research (NCSER).

Dr. Michael Gottfried at the University of California Santa Barbara was awarded a 2-year grant in 2019 from NCSER to investigate whether participating in applied STEM career and technical education (AS-CTE) courses in high school is related to pursuing and persisting in STEM majors and/or careers for students with learning disabilities (SWLDs). Although a significant number of SWLDs participate in CTE courses, little is known about the types of AS-CTE courses they take and the extent to which taking these courses is related to postsecondary and employment outcomes. This project uses data from two nationally representative, longitudinal studies, the Education Longitudinal Study of 2002 (ELS:2002) and the High School Longitudinal Study of 2009 (HSLS:2009).

The descriptive evidence resulting from this project will have important implications for policymakers and educators about promoting SWLDs’ interests in CTE and STEM and facilitating their access to these courses. We take a moment to share our recent conversation with Dr. Gottfried to understand the importance of this project and what he is learning.

Tell us about your project and what you hope to accomplish (or why a focus on STEM and SWDs?)

Our project is investigating the pathway students take in the pursuit of and persistence in STEM majors and careers for SWLDs. SWLDs are currently underrepresented in STEM fields throughout the STEM pipeline from high school to college to career. This SWLD-STEM college and career gap will continue to persist and potentially worsen unless there are efforts to lessen this underrepresentation of SWLDs in STEM fields. To address this, our research team is exploring AS-CTE courses that SWLDs take in high school and the extent to which taking these courses promotes advancement towards postsecondary success and careers in STEM. Unlike traditional STEM courses, AS-CTE courses emphasize the application of math and science concepts directly to practical job experiences by offering “hands-on” logic and problem-solving skills. They are designed to reinforce traditional academic STEM learning and motivate students’ interests and long-term pursuits in STEM areas. Using two nationally representative samples of high school students, we are examining whether high school AS-CTE can help prepare SWLDs for college, STEM fields of study in college, and careers in STEM or with STEM applications. We hope that this project will provide new evidence for policymakers and educators that will help facilitate access to AS-CTE courses in schools in order to promote short- and long-term interest in STEM for SWLDs.

What are applied STEM career and technical education courses students with disabilities can take in high school?

AS-CTE courses encourage the alignment of applicable job-related skills with academically challenging coursework targeted to students at all ability levels. These courses fall into two of the sixteen broad CTE categories: engineering technology and information technology. Some examples of engineering courses offered in high schools include Biotechnical Engineering, Wind Energy, Laser/Fiber Optics, Aerospace Engineering, and Computer-Aided Design Software. Some examples of information technology courses are Database Management and Data Warehousing, Business Computer Applications, Web Page Design, Geospatial Technology, and Networking Systems. 

What have you learned so far about enrollment in CTE and applied CTE courses by students with disabilities and related outcomes for those students?

We are currently in the beginning stages of our project, but through our analyses thus far we have found that SWLDs are more likely to take CTE courses than the general student population but less likely than other students to enroll in AS-CTE courses. In other words, SWLDs are taking CTE courses, just not in STEM areas. We see this pattern becoming even more prominent in the recent years.

What are some of the challenges with your research?

Although using large national datasets such as ELS and HSLS provides extremely rich information and data about high school students across the nation, there are some limitations to the conclusions that we can draw when using extant longitudinal data. First, although we are able to examine AS-CTE course taking patterns for high school students, no data exist in either dataset on why students chose to take AS-CTE courses. Second, there is no detailed information available in these datasets about course content, including design, curriculum, rigor, and quality of an academic course, all of which affect student achievement. Third, the datasets identify SWLDs based on parent survey responses about whether a doctor, healthcare provider, teacher, or school official had ever told them that their student had a learning disability. There is no verification that the student has an official special education label of LD, so there may be some variability in the population of SWLDs in the datasets, which could impact what we find.

What other research is needed to improve CTE course-taking and outcomes for students with disabilities?

Our project is quantitative, which has many strengths such as identifying patterns and trends. Yet, we believe that a future qualitative project would be useful to complement the work we are doing. For instance, there are many lingering questions that we cannot address. For example, why are SWLDs taking fewer AS-CTE courses? What does SWLDs’ sense of STEM self-efficacy look like in these AS-CTE courses? What types of supports are teachers providing in these courses? These types of questions could be addressed with future qualitative research in which teachers and students can be interviewed and followed.

What other recommendations do you have to support research in this area?

For our work, we plan to address diversity within the SWLD group. For instance, we are going to explore differences by gender for SWLDs taking AS-CTE courses. We propose that future research could consider this type of heterogeneity.

Dr. Gottfried also has funding from NCER in a related project exploring whether and how AS-CTE course-taking can help prepare low-income students for college and for careers in STEM or with STEM applications.

If your state, district, or school is looking for resources for developing and improving the quality of your CTE program, the Association for Career and Technical Education has many high-quality CTE tools, including a Quality CTE Program of Study Framework. The National Technical Assistance Center on Transition also has many resources to increase engagement in CTE by students with disabilities, including the on-demand webinar, Toward Best Practices: Programs that Work, Models Toward Success. This webinar was recorded on December 19, 2019 with a panel of experts and practitioners in workforce education and CTE led by Dr. Michael Harvey, Professor of Education in the Workforce Education and Development academic program at the Pennsylvania State University. Advance CTE connects CTE leaders across states and has resources to support CTE at the state level.

This blog series was co-authored by Sarah Brasiel (Sarah.Brasiel@ed.gov) and Jacquelyn Buckley (Jacquelyn.Buckley@ed.gov) at IES and Michael Gottfried (mgottfried@education.ucsb.edu). IES began funding research grants in CTE in 2017 and established a CTE Research Network in 2018 through NCER. NCSER started funding research grants in special education in CTE in 2019. IES hopes to encourage more research on CTE in the coming years in order to increase the evidence base and guide program and policy decisions.

Learning from CTE Research Partnerships: Building a Collaborative Data Culture in South Dakota

As part of our ongoing blog series aimed at increasing state research on career and technical education (CTE), Austin Estes, Senior Policy Associate at Advance CTE, and Corinne Alfeld, Research Analyst at the Institute of Education Sciences (IES), are conducting interviews with individuals who are part of successful CTE State Director research partnerships. The second interview was with Laura Scheibe of the South Dakota Department of Education and Marc Brodersen of REL Central at Marzano Research. [Note: this interview has been edited for length; you can find the full interview transcript here].

Could you both talk about the project(s) that you have worked on and your research questions? How did the relationship start, and who approached whom?

Marc When we were doing needs sensing with the states in our region, particularly with South Dakota, CTE emerged as a pretty high priority area. We needed to determine what the research questions were, what questions we could actually address, and what data were available that could be used in those research projects. So, this work started off as a technical assistance project where we were working with South Dakota pretty closely and getting all of the relevant players around a table and going through and mapping their data. And it was quite a long process.

Laura–There’s huge support in South Dakota behind CTE, but there wasn’t state-level evidence behind why CTE is such a good thing for students. So, the value that Marzano provided to the project in helping us walk through “this is the data that can help you, this is the process that we are going to go through to help you get to the answer” has been incredibly helpful and not something that we, as a pretty small department of education, could ever have undertaken on our own.

Can you talk about what research questions you ultimately came to and where you are in the process of answering those?

Marc –We have three main questions: 1) What is the impact of being a CTE concentrator on high school graduation, two- and five-year postsecondary enrollment, and completion status? 2) What is the impact of being a CTE concentrator on two-year and five-year employment and quarterly wage status? 3) How do the two-year and five-year outcomes vary by the various CTE Career Clusters®?

Connecting education to workforce data is really difficult, and we’re talking about collecting data over a five to 10 year span for an individual student. Many state data systems don’t go back that far, or data systems have changed, so it’s difficult trying to identify one data system that has 10 or more years of data for an individual student. We’re making it work, but it takes some time and some finagling. We haven’t even begun to analyze the data so, unfortunately, we can’t talk about any preliminary findings.

What were some of the early roadblocks in building this relationship and starting to examine and compile some of the data?

Laura– One of the roadblocks was just getting everyone around the table and bought into the idea. We’re a fairly small state, so it wasn’t hard to reach out to my counterparts at the other agencies who would need to be involved, but this project was, and continues to be, something that is on top of the day to day work that we do. It’s not driven by any specific policy initiative but rather by everybody around the table acknowledging and recognizing that “yeah, this would be really useful for us.” But, in that sense, it’s hard to get everyone’s commitments to the time it has taken and takes to pull this off and making sure that we’ve got the right people around the room as well. We’ve involved not just the Board of Regents but the technical college system and the people with the workforce data.

Marc – Having somebody at the policy level, the data level and the leadership level in the room at the same time is almost essential, particularly when you’re at the brainstorming phase. You can have the leadership that’s going to say “yes, this is important, and I want you to devote time to this,” and then the data person is saying “well, that data just doesn’t exist,” and the policy person may not know about that piece. And having all three of those perspectives at the same time can save a lot of time and effort.

How do you plan to use this research project to further policy in South Dakota?

Laura– First and foremost, this particular project is demonstrating the value that CTE has to the secondary students. This project pre-dated Perkins V [the Strengthening Career and Technical Education for the 21st Century Act], but as we’re moving into implementation of Perkins V full force in the coming calendar year, with the new requirements that Perkins places on states -- and therefore on schools -- to be an approved program, we’re seeing school districts question if it’s really worth it. This project is really coming in at a good time where we will hopefully have some data where we can say, “yes, CTE is worth it.” Being able to message that is hugely valuable from the perspective of a CTE Director in a state where almost every single public school district runs an approved program. Now that we’ve got Perkins V and the [comprehensive local] needs assessment, it will be just one more bit of evidence for schools to be able to examine whether they’re providing the best opportunities for our kids.

What advice would you give to other researcher/ State Director partners for conducting CTE research or establishing similar partnerships?

Marc – From my perspective, as far as establishing a partnership, I think face-to-face interactions are invaluable. It takes a while to trust each other or establish a positive working relationship.

Laura– My advice to State Directors would be to really plan for it and make it a priority. And don’t make it something that isn’t part of the day-to-day because then I think the thread can get lost. I would also say getting that higher-level buy-in is really important. It’s important to make sure that you’ve got that policy-level partner to keep things moving along. The benefits will be there in the end, it just has to be woven into the day-to-day of what you’re doing in order to make it all come together.

Going through this process has helped me form partnerships with my colleagues in other agencies even more strongly than I had before. Just the exercise of having gone through all of that and understanding their work and their data and everything they do, having them understand my role and my constraints better, has just made us a more effective CTE/ workforce team in our state. As we move forward with Perkins V and WIOA [Workforce Innovation and Opportunity Act] state plans and all of this other stuff coming, it just benefits us and enables us to work more effectively and work faster now that we have those strong relationships. They were there before, but they’re definitely stronger now as a result of this project.

Marc –One of the things I thought was really neat was getting all these folks together and thinking deeply about data. It might not be the most exciting topic for a lot of folks, but going through the process gave everyone a better understanding of what they can do and how they might be able to work with others. And I think in the day-to-day, not everyone spends that much time thinking at the data and variable level. But doing that will increase everyone’s capacity to be able to do this kind of work moving forward.

One other thing to add just as a side note. Throughout this process, we also collaborated with Nancy Copa at the Common Education Data Standards (CEDS) when we were doing the data mapping piece. We did not officially map the South Dakota data to that, but we used the CEDS as kind of a template to provide us with a common dictionary to have these conversations across departments. And that was really useful. In fact, all of us – the different departments in South Dakota and the CEDS folks –co-presented at the last STATS-DC conference, which I thought was a very positive experience.

The full transcript of this interview can be accessed on Advance CTE’s website. Other blog posts in this series can be viewed here.

Learning from CTE Research Partnerships: How Michigan Built Trust with Researchers to Better Understand State Data

As part of our ongoing blog series aimed at increasing state research on career and technical education (CTE), Austin Estes, Senior Policy Associate at Advance CTE, and Corinne Alfeld, Research Analyst at the Institute of Education Sciences (IES), are conducting interviews with individuals who are part of successful CTE State Director research partnerships. The first interview was with Jill Kroll of the Michigan Department of Education and Dan Kreisman of Georgia State University (and Director of CTEx). [Note: this interview has been edited for length; you can find the full interview transcript here].

 

Jill Kroll Dan Kreisman
Michigan Department of Education Georgia State University

 

The first question we have is about the projects that you work on together: what were some of the research questions you came up with, and how did you come to settle on those research questions?

Jill – I first connected with Dan and with Brian Jacob at University of Michigan when I saw Brian present to our P-20 council about some research that he was doing connecting the wage record data for five community colleges. I was like “Gee, is there any way you can do something similar with the statewide secondary student data?” And he said it was possible. So I worked within our department procedures to find out how we could go about establishing a relationship that would allow this opportunity.

Dan – That led to a whole bunch of other discussions of things that we thought were interesting. So, to say that there is a set of research questions is not the way I view our relationship. We talk with folks in Jill’s office regularly to hear what questions are pressing for them, and then we try to help facilitate answering those and then see where those lead us. I think one of the important things is we try to think about where there are policy levers, so we want to say “If we answer this question, how can the state or the districts use that information to further their mission of providing CTE programming to students in Michigan?”

Jill – I’ve been really happy with the extent to which Dan and the research team have consistently focused on the “so what?” Rather than focusing on vague research questions of interest only to other researchers, they have emphasized their interest in doing research that has practical application, that can be used by educators in the field.

Could you share an example of how you’ve been able to use some of this evidence and research to change policy, or at least to shape your understanding on some decisions that you’re making at the state level?

Jill - When we were starting to work on our Perkins V [the Strengthening Career and Technical Education for the 21st Century Act] state plan, we had a short time to determine what we wanted to consider for our secondary indicator of program quality. Because Brian, Dan, and their students had been working with this data for so many years, they had the capacity to very quickly do the matching and

 come up with an approximation for us about what postsecondary credit attainment would look like, and what strengths and weaknesses they saw in the data. It would have been really difficult for our office, or even multiple state agencies, to have been able to work that quickly and give it the critical analysis that they did.

The other thing they did when we were making the decision for that indicator is look at the data that we had for work-based learning and tell us what could be done with it. What came out of that was that the data was not in any form that could be analyzed (text and PDFs). This was really revealing to our State Director Brian Pyles, and it led him to set a policy that we are going to build a consistent way of collecting data on work-based learning. So that is another piece where it influenced practice and policy. One of the most exciting and valuable things that I find about the partnership is that Dan and the other researchers have a lot more capacity to analyze the data in a way that we just don’t have the time to do. Sometimes we don’t have the expertise, and sometimes we just don’t look at the data in the same way.

Dan –And there’s a flip side that without their input, we often are looking at data and can’t make heads or tails of something. And we can get on the phone or write an email to someone over there and say “Hey we’re seeing this thing. Can you tell me what that means?” And they will come back with “Oh, the system changed” or “There was this one policy,” and “Here’s what you have to do to make it fit everything else.” And this happens all the time. We would be completely lost without this open channel that we have to their office.

I think it’s important not to dismiss the power of good descriptive work. Lots of times, the questions that states are grappling with can often be illuminated with some really careful and good descriptive work. You can say, “This is what we’re seeing, this is the big picture,” if you step back for a minute, and that information lots of times has been as valuable as the stuff we try to do that is more causally oriented in our research.

Jill – I agree, and I want to follow up on the whole issue of how important trust is. I cannot emphasize enough how important it is to me that Dan and the other researchers come to us with those questions, that they check in with us. That’s absolutely critical. Anyone who works with any kind of data knows that it’s just so complex. If you link tables wrong, or misunderstand a data field, you can come to a completely wrong decision. So that communication and that interaction and trust are key to accurate outcomes.

As you’re both looking ahead, what’s next on the agenda? What are some of the research questions and priorities you have for this partnership?

Dan – Number one is tracking students into the labor market. That’s our biggest and most outstanding question. And the degree to which CTE programs are preparing students for college and the labor market and careers. In terms of other projects, one of the things we’re interested in is technical assessments. We’re also part of a consortium of several states – that’s the CTEx group. We meet annually together, and that allows us to harmonize things across states to see how trends are similar, how enrollment rates work, all sorts of different questions across multiple states.

Jill – One of the things we’re talking about right now is that we don’t have, in an accessible form, data on access to a particular program. We know that career centers serve certain districts, but if someone asked, “If student A is going to Central High School, what programs do they have access to? we don’t have a good way of answering that at the moment. We’ve had a couple of discussions about how we can work together to build basically a dataset that clarifies that. That would be mutually beneficial and would take resources from both in order to do something like that.

Thinking back on this partnership, is there any advice you would give to other State Directors or CTE researchers?

Dan – Building a strong relationship is the first thing you have to do. And part of that is spending time face to face talking about questions, moving around ideas, looking at data together. We had the benefit of a long windup period. We spent at least a year just talking about questions and putting together data before we even started doing any analyses. We also had buy-in from Jill’s office up and down the line from folks who were doing the research to people who were in policymaking roles. And without all of that, none of this would even have been possible.

And the second part is to not downplay the value of just providing good information. A lot of us on the research side don’t realize how little time folks in the state offices have to take a step back and say, “What’s going on with our data? Let’s look at the big picture.” And one of the things we can provide them is just giving them that big picture and handing it to them in a digestible way. And doing that is the first step, is a really good way to start building that trust. They really see the value of what you can do early on. And then you can start to get into more difficult or longer-term questions.

Jill – The first advice I would give is: Do it! Partner with researchers. I can’t say enough positive about it. The second is: Follow department procedures and be transparent with department leadership. You know that windup might be really, really slow while you jog through the channels that you need to in your department to do things by the book, but I think it pays off in the long run.

My third one is: Be transparent and open with school districts. Share what you’re doing and invite their input. Anybody who works with state data would probably know, you’re always a little hesitant about what the public would think about this use of data. The way that Dan and the postdocs and graduate students have openly shared the work that they’ve done with our CTE administrators has really helped, in that I have not gotten any doubt from districts.

The full transcript can be accessed in Advance CTE’s Learning that Works Resource Center. Other blog posts in this series can be viewed here.

What Do State CTE Directors Want to Learn from the Research Community?

Career Technical Education (CTE) is gaining widespread interest and support from state policymakers, who see it as a strategy to expand access to opportunity and meet employer needs. Between 2014 and 2018, states enacted roughly 800 policies related to CTE, and in 2019, workforce development was one of the top education-related priorities mentioned by governors in their state-of-the-state addresses.

What’s more, in 2018 Congress passed the Strengthening Career and Technical Education for the 21st Century Act (Perkins V), which reauthorized the federal law for CTE and invests around $1.2 billion a year to strengthen and expand CTE programs. The law was enacted in July 2019 and will be in full effect in July 2020 after states submit their four-year plans for CTE to the U.S. Department of Education (see more about the Perkins V planning process here).

With CTE in the spotlight, State CTE Directors are working hard to improve quality and equity in CTE. But state CTE offices often do not have the staffing or resources to conduct rigorous program evaluations to learn what’s working and what needs improvement. By partnering with CTE researchers, State Directors can gain critical insights into the impact of CTE programs, policies, and practices.

While the design, governance and delivery of CTE varies from state to state, there are several common questions and challenges across the country that CTE researchers can help address, particularly in light of Perkins V implementation:

Improving program quality: State leaders are working to improve CTE program quality by connecting secondary and postsecondary coursework, integrating academic and technical learning, aligning programs with labor market needs and expectations, and preparing learners to earn industry-recognized credentials of value. Tennessee, for example, recently revised its secondary CTE program standards and developed model CTE programs of study that meet statewide workforce needs. Answers to the following research questions would help fuel these efforts:

  • What set of experiences at the secondary and postsecondary levels (CTE coursework, work-based learning, dual enrollment, etc.) best prepares learners for postsecondary enrollment and completion, certificate and degree attainment, and high-wage employment?
  • Do these vary by region of the country, Career Cluster® or program of study?
  • Does the delivery mechanism (comprehensive high schools, career academies, area technical centers, technical colleges) matter?

Ensuring equitable access and success in CTE: To reverse historical inequities in CTE, state leaders are using data to identify disparities and ensure each learner can access, fully participate in, and successfully complete a high-quality CTE program of study. In Rhode Island, the Department of Education repurposed $1.2 million in state funds to launch an Innovation & Equity grant initiative, which provided resources to local recipients to recruit and support underrepresented student populations in high-quality programs. CTE researchers can help these efforts by addressing the following questions:

  • What are the classroom and workplace conditions in which CTE students of color are most likely to develop the interests, knowledge, and skills that prepare them to earn postsecondary credentials of value and obtain high-wage employment in their careers of choice?
  • What interventions, accommodations, and instructional strategies best prepare learners with disabilities to transition successfully into the workforce?
  • How does gender inform the development of occupational identity, and what can educators do to limit the effects of stereotyping on the career aspirations of learners?

Improving the quality and use of CTE data: Most State Directors believe improving and enhancing their CTE data systems is a priority, but only 45 percent say they have the information they need at both the secondary and postsecondary levels to improve program quality. States like Minnesota (through the State Colleges and University System) are working to improve the validity and reliability of their data by collaborating with industry-recognized credential providers to obtain data for their students. CTE researchers can help state leaders improve data quality in two ways:

  • Identifying relevant data sources and matching student records to allow for a comprehensive examination of student pathways and outcomes
  • Developing and sharing guidance for collecting, validating, and matching student data relevant to CTE

Fostering collaboration and alignment across state agencies: Supporting learner success requires cross-agency collaboration and coordination. State leaders are working to create seamless pathways by sharing data, coordinating program design, and braiding resources to achieve economies of scale. One example is Massachusetts, where Governor Charlie Baker established a cross-agency workforce skills cabinet to coordinate education, workforce, housing, and economic development. The following research questions would help accelerate the work in Massachusetts and other states:

  • Do states with policies that foster cross-agency coordination see better education and employment outcomes for students? Can merging datasets across agencies help states better understand and respond to student needs?
  • Does credit for prior learning and/or credit transfer between institutions decrease time to credential attainment and entry into employment?
  • How does the integration of support services—such as financial aid, Medicaid, Temporary Assistance for Needy Families, and other state and federal programs—impact the likelihood of student success?

Expanding career advisement opportunities: School counselors are the most trusted source of information on CTE and career options, and states are working to bolster their career advisement systems by reducing the counselor-to-student ratio, requiring each student to complete an individualized graduation plan, and developing user-friendly platforms for career exploration. In Oklahoma, for example, it is now policy for all students to identify their career and academic goals through the state’s new Individual Career and Academic Planning program. CTE researchers can help address the following questions:  

  • Do career and academic planning programs increase the likelihood that learners will complete CTE programs of study, graduate from high school, and earn postsecondary credentials?
  • How does early career exposure through job shadowing, career fairs and career counseling inform student course taking, academic achievement, and future employment and earnings?

As states chart a vision and path for the future of CTE, they can and should use their data to inform decisions. Researchers can help them collect and analyze high quality data to understand the relationships between CTE program elements and various learner outcomes. This can help them understand what is and isn’t working with current policy and practice and identify how to focus their efforts to improve quality and equity in CTE. In addition, researchers can help state directors plan and conduct rigorous evaluations as they roll out new CTE policies and programs. Over the next few months, Advance CTE and the Institute of Education Sciences (IES) will feature a series of successful partnerships between states and CTE researchers and explore how those projects provided critical data and insights to inform state policy.

This blog series was co-authored by Corinne Alfeld at IES (corinne.alfeld@ed.gov) and Austin Estes from Advance CTE (aestes@careertech.org). IES began funding research grants in CTE in 2017 and established a CTE Research Network in 2018. IES hopes to encourage more research on CTE in the coming years in order to increase the evidence base and guide program and policy decisions. At the same time, Advance CTE has been providing resources to help states improve their CTE data quality and use data more effectively to improve CTE program quality and equity.