As part of our ongoing blog series aimed at increasing state research on career and technical education (CTE), Corinne Alfeld, Research Analyst at the Institute of Education Sciences (IES) and Austin Estes, Senior Policy Associate at Advance CTE, are conducting interviews with individuals who are part of successful CTE State Director research partnerships. The third interview was with Cliff Chuang at the Massachusetts Department of Education and Shaun Dougherty of Vanderbilt University. Note: this interview, from February 5, 2020, has been edited for length and clarity.
Could you start by talking about the projects that you’ve worked on, your research questions, and how you settled on those research questions?
Shaun - It grew out of my dissertation work that was using some of the school data and then some of the statewide data from Massachusetts. It started pretty narrowly but the director of research was happy enough with what I was able to do that she talked about whether we could address some additional questions, and more data was becoming available. That more or less triggered the expansion, and then with Cliff coming into the role it became a two-way conversation that was more explicitly about what’s of academic interest and what’s of interest or of need on the practice and policy side for CVTE (career/vocational technical education).
Cliff – I would say that the particular catalyst for our most recent partnership is our desire as an agency to understand the waitlist demand issues related to chapter 74 CVTE in Massachusetts. If I recall correctly, we put out an RFR (request for responses)[1] for a research partner to help us analyze different aspects of who is and is not getting access to CVTE programs in Massachusetts. And Shaun and his partner Isabel at Harvard, a grad student there, their bid was selected. From that project there have been a lot of offshoots through the CTEx exchange collaboration that Shaun and others have established. We’ve been engaged in a lot of informal research inquiry as well as additional formal research that uses that data.
Could you talk a little bit about what the findings were from that project and what have been implications in the academic space but also on the policy front, how are you using those findings to change policy in Massachusetts?
Shaun – The basic findings were that in fact there is much more interest in these high-quality CTE programs, these chapter 74-approved programs in these standalone technical high schools, than can be met by current supply. This was more confirmatory evidence with a little more granularity and maybe confidence in the figures than was possible previously.
Cliff – Shaun’s team also helped us look at just the straight enrollment data comparisons, which is still not as ideal as looking at applicant data. It was helpful to have a more rigorous definition of what data protocols are needed around application and admissions. We have now made the decision to collect waitlist data systematically at the state level to allow researchers like Shaun to more rigorously analyze across the board the attributes of who’s interested in voc tech, who’s getting in, who’s applying, etc.
I think it also stimulated a variety of program initiatives on the part of state government in Massachusetts to increase access to CVTE programs through collaborative partnerships like After Dark, which is an initiative that seeks to utilize shop space in our technical schools after the regular school day paired with academics provided by a partner academic school to get more kids the technical training that we are unable to do in the standard day program structures.
I would also add that Shaun is continuing other aspects of the research now that we’re very excited about, based in part on some of the research they did do to look at longer term trends of students and their outcomes post high school.
Shaun – The first order concern is that lots of people want [access to CVTE programs] and there’s a limited amount of it, so should we have more?
The second order concern – but certainly not secondary question – is one about equity and whether or not the students who were applying and the students who were getting access look like a representative cross-section of the community at large. We know that students who choose CTE or select a lot of it are maybe different than those who don’t, but we don’t know a ton about whether and how we expect students who are making those investments to look like the overall population or whether or not access concerns lead to equity concerns.
Cliff – We would like to look more closely at whether the gaps are simply due to application gaps – which is still an issue in terms of kids not applying – or whether there are actual gaps related to who is applying and getting in. That was the data gap that we haven’t quite been able to close yet. But Shaun was able to create some comparative data that is just based on enrollment that has allowed us to engage in these conversations. We’re having the conversation about trying to expand the number of seats available so there’s less of a waitlist, but also to ensure that access into the existing seats is equitable and doesn’t disadvantage certain subgroups over others.
Over the course of the partnership, what have been some of the major challenges and hurdles that you’ve faced? What are some of the speedbumps that you’ve hit getting things formalized up at the front?
Shaun – Fortunately, one thing that we didn’t face, although I know it’s an obstacle in many places, is processes related to how one gets permissions and access to the data. In fact, as the process has evolved, having those structures in place has made it really easy, so that if Cliff and I say “hey, we’d like to add this,” it’s a pretty easy amendment of the MOU (memorandum of understanding). And then the people who deliver the data get approval and then they deliver it through a secure portal.
Cliff – I would also say that researchers left on their own probably would have had much less success in getting district participation in the survey study we did together. I, on the other hand, am someone with positional authority at the state level and established relationships that I can leverage to get that participation. And then I can pass it off to the research team that actually has the expertise and bandwidth to execute on the very labor-intensive data collection, both quantitatively and qualitatively.
It seems like you have a good partnership and a good synergy between the state office and the research team. If you were talking to CTE leaders and other researchers, what are some strategies and practices to make sure that partnership runs effectively and can be as impactful as possible?
Cliff – I think it’s important to have someone in the role of a researcher director type person whose job it is to facilitate these partnerships and to do some of the nitty gritty around data sharing, MOUs, etc. The other thing I would say is to have a commitment to an evidence base in terms of policymaking, and have people in the programmatic leadership who see the value of that and have enough knowledge of how research functions to parlay whatever policy or relational capital they have to support the research agenda.
Shaun – I think sometimes overcoming the incentives related to purely academic publishing restricts some of the willingness of some academic researchers to invest or to think about important questions in practice and policy. It’s being willing to realize that strong partnerships with local and state agencies means that more and better work can be done, and the work can have impact in real time. There is something very fulfilling and useful and practical about taking that approach from a research standpoint and then, if you come from practice like I did, then it helps ground the work.
Other blog posts in this series can be viewed here.
[1] Cliff explained that this is a formal process by which they solicited proposals for pay. “What’s been nice is that because it’s a partnership, Shaun has secured funding from other sources so there’s not an explicit contractual arrangement always. Aspects of the research that are ongoing are follow-ons from the original study. We have an interest in continuing to mine the data long-term to inform practice and policy.”