Inside IES Research

Notes from NCER & NCSER

Career and Technical Education in STEM for Students with Learning Disabilities: Research Updates and Implications

Career and Technical Education (CTE) Month® is celebrated every February to raise awareness about the role that CTE has in preparing students for college and career success and the achievements of CTE programs across the country. In recognition of this year’s CTE Month®, we caught up with Dr. Michael Gottfried, University of Pennsylvania, to discuss his CTE research.

Through NCSER’s Career and Technical Education for Students with Disabilities special topic area, Dr. Gottfried was awarded a grant to examine whether participating in STEM CTE courses in high school is related to pursuing and persisting in STEM majors and/or careers for students with learning disabilities (SWLDs), a project featured initially in a March 2020 blog. During our recent conversation, he shared updates with us about his CTE project as well as the policy and practice implications of his research.

When we discussed this project in 2020, you shared your research goals and what you had learned so far. Could you provide us with an update?

Since the last time that we chatted, we have made some great progress on this project. We have had several papers accepted for publication. In some of our work, we were interested in the STEM CTE coursetaking patterns of SWLDs in high school. We found that SWLDs are more likely to participate in CTE courses compared to students without disabilities. Yet, when looking at the specific category of STEM CTE courses, there is no evidence that SWLDs are more likely to participate in high school STEM CTE courses compared to students without disabilities.

We have also looked at specific outcomes for SWLDs in STEM CTE courses. For instance, we examined computer science STEM CTE coursetaking for SWLDs. Participation was associated with growth in STEM self-efficacy and STEM utility (usefulness of what is learned for practical application) for SWLDs, whereas it related to positive development of STEM self-efficacy and STEM identity, but not STEM utility, for students without learning disabilities.

After we discovered that little was known about the association between STEM CTE coursetaking and college STEM persistence for SWLDs, we wanted to explore this area. So far, we have found that SWLDs who earned more units of STEM CTE in high school were more likely to seriously consider and ultimately declare STEM majors in college that are related to high school STEM CTE courses, such as information technology or engineering technology.

You and your colleagues recently published a paper in Education Research based on your NCSER-funded research. Could you summarize the findings in this paper and the implications for policy and practice?  

In our paper, we set out to identify whether there were any observable changes in CTE participation over time. The unique aspect of this study was that it combined national data from the Education Longitudinal Study of 2002 and the High School Longitudinal Study of 2009 with administrative data from the state of Washington. Key findings indicated that CTE participation declined nationally between the graduating class of 2004 and the graduating class of 2009 except in the area of applied science, technology, engineering, mathematics, and medical/health (STEMM) CTE, which includes courses in information technology, engineering technology, and health sciences. Data from Washington tended to be less varied in nature compared to national data, with fewer discernible trends, though in general STEM CTE did appear to have an upward trend for all students.

Our work also has direct relevance to policy. Recent changes in the Carl D. Perkins Career and Technical Education for the 21st Century Act emphasized the need to focus on increasing access and participation in STEM-related CTE coursework. While there does appear to be an upward trend in participation in these STEM fields, the tradeoff may be coming at the expense of other CTE areas of study. Combined with the increasing pressure for students to complete more and more academic coursework in a push for college readiness, this decrease in non-STEM CTE participation is particularly noteworthy. Finally, our work helps highlight the importance of examining CTE trends at the state and national levels. Different states have different needs and different graduation requirements that may or may not include CTE participation. As such, given the overall call to increase CTE participation for SWLDs, we encourage future research that explores the implications of these trends for this population.

What do you hope that school leaders, CTE teachers, and students will learn from all the research you are conducting?

The research has numerous implications for policy and practice. First, the results will be important for policymakers as they consider new or revised educational policies to support the pursuance and persistence of SWLDs into STEM fields. Education policymakers in particular need to understand the effects of STEM CTE coursetaking for SWLDs at multiple time points (transition into college, during college, and post-college). Understanding these issues more completely will make for well-informed policy decisions that promote short- and long-term success in STEM for SWLDs. This, in turn, has larger social policy implications with respect to upward mobility and lifelong success.

This project also has important implications for practice. By sharing these results, we hope to support education practitioners in making the adjustments necessary to improve the use of educational resources to ensure that SWLDs are prepared for and engaged in fields with high growth potential. For instance, many states have begun to accept STEM CTE courses for graduation requirements, which increases the likelihood students will take these courses. As STEM CTE courses prove important for SWLDs across the pipeline, then states and districts might consider how to best encourage students to take and succeed in these courses.

What additional research is needed to improve CTE policy and practice?

The current work can inform the future development of an intervention, assessment, or decision to evaluate an intervention. Evidence that STEM CTE coursetaking is associated with higher likelihood of college enrollment and the pursuit of STEM pathways for SWLDs supports the need to study interventions that encourage STEM CTE coursetaking for these students. For example, a randomly selected set of SWLDs who do not take traditional STEM could be counseled into taking STEM CTE courses or placement tests could be used to assign students to STEM CTE or traditional STEM courses. In both cases, students could then be followed into college and beyond to compare education and career outcomes using rigorous research designs. The results could provide additional, strong evidence for the value of STEM CTE coursetaking on postsecondary STEM outcomes.

This blog was authored by Akilah Nelson (akilah.nelson@ed.gov), Program Officer at NCSER, and Michael Gottfried (mgottfr2@upenn.edu), Associate Professor at the University of Pennsylvania.

A Work in Progress: Insights on Diversity, Equity, and Inclusion in Education Research

For over a year, IES has been exploring how to expand participation in the education sciences and in our grant programs through a technical working group and a series of listening sessions. In recognition of Black History Month, we asked IES grantee Dr. D. Crystal Byndloss, MDRC’s director of outreach, diversity, and inclusion and senior associate, to discuss her career experiences and share advice for the field on how to integrate diversity, equity, and inclusion into education research. 

How have your background and experiences shaped your scholarship and career?

My research interests, especially those focused on identifying ways to support moderately and high-performing students of color from low-income backgrounds, stems from my personal experience. I was raised by a single mother, an immigrant to the United States, who enrolled me in K-12 schools where I was challenged academically and exposed to new social and cultural experiences. That foundation prepared me to enroll in a college that emphasized writing, where I developed my interest in research. In college, I was also embraced by two Black professors—a sociologist whose teaching style I wanted to emulate in the classroom and a historian who mentored me through the graduate school application process. These individuals—and my kindergarten teacher, a Black female immigrant who would go on to earn her doctorate—made it possible for me to believe that pursuing a PhD was a possibility for me.

My dissertation examined how sociopolitical context influenced two education movements: a Black and Puerto Rican community’s involvement in the movement for community control of New York City schools in the 1960s and 1970s, and a Black community’s involvement in the creation of Milwaukee’s African-American immersion schools in the 1980s. Through my research, I was able to bring new voices to the literature and spotlight how these communities of color shaped the local public education landscape. I saw great value in the research endeavor and, during a postdoctoral fellowship, decided to explore a career as a researcher. I’ve been at MDRC for 15 years, where I’ve spent the last 12 working in K-12 education research. I’ve also worked as a consultant and as an assistant dean for research and associate director of a center at a college of education.

How does your research contribute to a better understanding of the importance of diversity, equity, and inclusion (DEI) in education?

Through MDRC’s Equity Collaborative, we are incorporating stronger equity-based and culturally responsive approaches into our research and technical assistance. For example, posing impact research questions to understand where inequities exist in high school course-taking and conducting qualitative and implementation research that speaks to the contextual factors that shape or reinforce inequities through school-based policies and procedures. As part of the IES-funded Career and Technical Education Research Network (CTERN) Equity in CTE Work Group, I also have an opportunity to engage other researchers on such topics as how best to deepen the field’s understanding of issues of equity and inequity in CTE research and evaluation. As a coming attraction, keep an eye on the CTERN website where we will make available an equity framework for CTE researchers.

In your area of research, what do you see as the greatest research needs or recommendations to address diversity and equity and improve the relevance of education research for diverse communities of students and families?

I think we need to expand where we invest education research funding, a significant amount of which has been devoted to understanding what works for students from low-income backgrounds who are struggling academically. This is important work that needs to continue. We also need to expand our research inquiry to include more studies of interventions that help students from low-income communities who may be on track for academic success but who, without critical supports, are also in jeopardy of not reaching their full potential. Typically, we equate low income with low performing and, in so doing, miss a group of students who can benefit greatly from a variety of educational interventions. As a society, we need to move beyond the low expectations that are often placed on students from diverse communities—whether they are of color, from low-income backgrounds, or differently abled. We won’t be able to ameliorate inequities if we don’t fully appreciate the breadth of talent and potential that exists in these diverse communities.

What has been the biggest challenge you have encountered, and how did you overcome the challenge?

My biggest challenge is not one that I have overcome. My biggest challenge in the current moment is managing demanding work and home lives and not becoming undone by both. I serve on MDRC’s executive management team, lead our DEI work, and contribute to research. I am also the primary caregiver to both my mother and younger sister who have significant health and caregiving needs. I always have a running list in my head of things that need to get done and things that did not get done. I know I must prioritize self-care and, with that in mind, recently committed to pausing for seven minutes a day to take a deep breath and be still. In the grand scheme of things, it’s a small act of self-preservation, but there are days when my seven-minute break eludes me. I am a work-in-progress.

How can the broader education research community better support the careers and scholarship of researchers from underrepresented groups?

First, I would encourage doctoral programs to offer students a more expansive view of their career options beyond the academy. Research firms, policy organizations, education agencies, and funding and nonprofit organizations need and would benefit from the voices, talents, perspectives, and skills of scholars from underrepresented groups who could help shape their education research and evaluation initiatives. While I understand the academy’s desire to train its own workforce, students are seeking careers outside of the academy. Why not help them make more informed choices?

Second, thinking of IES in particular, the first time I attended an annual IES Principal Investigators meeting, I was stunned by the lack of racial diversity among the Principal Investigators in attendance. I asked myself: Where were the people who looked like me who were designing the studies, conducting the research, learning about new funding opportunities, and determining what research is of value to the field? Training fellowships, apprenticeships, and research partnerships serve as important bridges and pathway programs for underrepresented groups, and I would encourage IES to expand its current initiatives to reach more students and emerging scholars.

Third, borrowing an idea that a colleague shared with me, IES could develop an incentive program in which, during the proposal review process, it formally rewards teams that submit proposals that feature diverse research teams. This approach could lead to a set of innovative and inspired partnerships.

Finally, I ask everyone reading this blog to think about what you can do within your own sphere of influence to support the careers and scholarship of researchers from underrepresented groups. Consider inviting a student or peer researcher to join you at a meeting or conference where they can learn more about the research enterprise, discuss their own research interests, and be introduced to others with similar interests. Think creatively about partnerships and the types of opportunities that can be created that would allow scholars from underrepresented groups to bring their expertise to bear on a project you may be involved in or conceptualizing. There are myriad ways to offer support.

What advice would you give to emerging scholars from underrepresented, minoritized groups that are pursuing a career in education research?

My advice applies to anyone in any field: find a mentor and a sponsor—a mentor who will show you how to navigate the field and push you to stretch outside your comfort zone and a sponsor who will create opportunities for you or who will advocate for you when opportunities are being discussed and you are not in the room.


Dr. D. Crystal Byndloss is a member of the IES Technical Working Group Increasing Diversity and Representation of IES-funded Education Researchers. Byndloss holds dual roles at MDRC. She is the organization’s first director of outreach, diversity, and inclusion and a senior associate in the K-12 Education policy area, where for more than a decade she has researched and directed initiatives to promote college access and success for students with low incomes. She is a senior adviser to the IES-funded evaluation of the New York City P-TECH Grades 9-14 school model and is part of the IES-funded CTE Advise evaluation research team.

 

This year, Inside IES Research is publishing a series of interviews (see here, here, and here) showcasing a diverse group of IES-funded education researchers and fellows that are making significant contributions to education research, policy, and practice. As part of our Black History Month blog series, we are focusing on African American/Black researchers and fellows as well as researchers who focus on the education of Black students.

 

Produced by Katina Stapleton (Katina.Stapleton@ed.gov), co-Chair of the IES Diversity and Inclusion Council and predoctoral training program officer.

 

Supporting Bilingual Learners in Early Childhood

The Postdoctoral Research Training Program in Special Education and Early Intervention was designed to prepare scientists to conduct rigorous, practice-relevant research to advance the fields of special education and early intervention. Xigrid Soto-Boykin recently completed an IES postdoctoral fellowship at the University of Kansas and is currently an assistant research professor and senior scientist at Arizona State University. Her research focuses on early childhood education for bilingual learners, including those with communication impairments. We recently caught up with Dr. Soto-Boykin to learn more about her career, the experiences that have shaped it, and how her work addresses equity and inclusion in early intervention. This is what she shared with us.

Photo of Xigrid Soto-Boykin

As a Puerto Rican who learned English at age 11 and who was the first person in my family to attend college, my passion for conducting research focused on high-quality early childhood education for Latinx preschoolers stems from my personal experiences.

During my postdoctoral fellowship at Juniper Gardens Children’s Project at the University of Kansas under Dr. Judith Carta, I had the opportunity to conduct community-based research in a local bilingual early childhood center in Kansas City. Initially, my goal was to expand my dissertation work, which focused on evaluating the effects of bilingual emergent literacy instruction for Latinx preschoolers. However, like all great stories go, my research agenda took some unexpected twists and turns. On the day my initial research study was approved, we were informed we needed to work remotely and that we could not go on-site to conduct our research due to the COVID-19 pandemic. What initially felt like a major setback became an opportunity to expand my research. While working remotely, I continued to collaborate with the administrators and teachers to determine their most pressing needs. We co-constructed a strategic plan for identifying the center’s strengths and areas for improvement. To address areas identified as major needs, we began initiatives to provide educators with ongoing professional development and families with engagement opportunities. Through this research-community partnership, we were awarded a Kauffman Quality Improvement Grant. This grant is funding our creation of the infrastructure necessary to apply data-based decision making to guide teacher professional development and monitor children’s school readiness and bilingual development.  

In 2020, as the nation was reeling from the COVID-19 pandemic and a reckoning of the structural racism impacting the lives of Black and Brown individuals, the work I was doing at the bilingual early childhood center became contextualized. I saw how teachers who earn minimal wages risked their lives to provide essential care for children and families. I saw how families struggled to make ends meet after losing their jobs. I began understanding how linguistic discrimination impacts the way researchers, educators, and policymakers address bilingualism. As I read outside my typical fields of speech-language therapy, bilingualism, and early childhood special education, I began to see how the interconnected systems in our society impact the lives of Latinx bilingual children.

This renewed understanding led me to where I am today. In 2020, I launched a website, habladll.org, containing free resources for parents, teachers, and therapists working with bilingual children. I am presently an assistant research professor and senior scientist of bilingual learning at The Children’s Equity Project (CEP) at Arizona State University. The CEP is a non-partisan center that seeks to inform research, policy, and practice to promote equitable access to early childhood education. In this role, I am applying what I learned during my postdoctoral fellowship to ensure young dual language learners with and without disabilities and their families receive the bilingual support they deserve.

My research and personal experiences are one and the same. I see myself as a scholar-activist with the goal of creating just educational experiences for Latinx children and their families. I am grateful for my training, mentors, colleagues, and community partners who continue to equip me with the tools to co-create a world where Latinx children receive high quality early childhood instruction centered on their unique linguistic and cultural assets.

This year, Inside IES Research is publishing a series of interviews (see here, hereand here) showcasing a diverse group of IES-funded education researchers and fellows that are making significant contributions to education research, policy, and practice.

This blog was produced by Bennett Lunn (Bennett.Lunn@ed.gov), Truman-Albright Fellow, and Katie Taylor (Katherine.Taylor@ed.gov), postdoctoral training program officer at the National Center for Special Education Research.

IES Honors Sade Bonilla as 2019 Outstanding Predoctoral Fellow

Each year, IES recognizes an Outstanding Fellow from its Predoctoral Interdisciplinary Research Training Programs in the Education Sciences for academic accomplishments and contributions to education research. Sade Bonilla, the 2019 awardee, received her doctorate in the Economics of Education from Stanford University. She is currently an assistant professor in the College of Education at the University of Massachusetts Amherst where her research focuses on K-12 education policy with a particular emphasis on high school to college transitions, career and technical education, and educational inequity. Sade recently presented her research and received her award at the 2022 IES Principal Investigators meeting in January. In this blog, we’ve asked her to share her career journey and recommendations for current and emerging education researchers.

How did you become interested in a career in education research?

My interest in educational inequity and reform efforts in public education stemmed from my personal experience as a Latina from a working-class family attending urban public schools. I was attracted to the field of education policy and research as a first-generation college student because the field seeks answers to questions that are intensely personal for me: what works for poor minoritized kids? In other words, how can policy be designed and implemented such that kids like me were not an exception. There were several key adults in my educational career that believed in me and told me about opportunities—such as opportunities for financial aid to attend private colleges—that shifted my life trajectory. When I arrived at college, I took public policy and education courses and read articles on so many different topics. I was floored that asking and pursuing the answers to questions that one finds interesting could be a career. 

What inspired you to focus your research on understanding the effects of local and state educational policies aimed at eliminating structural inequality?

My interest in investigating how contemporary educational reforms impact the trajectories of traditionally underserved youth stems from my personal experience and the knowledge of how historical and current policies—school segregation, redlining, justice system, etc.—serve to reinforce social inequality in schools. Schools are a cornerstone of our formative experience, and they are also central to communities, civic discourse, and career preparation. Given that schooling is so integral to how we learn to navigate society, I have been interested in understanding which policies and programs allow students to have agency to create their own paths. 

What do you see as the greatest research needs or recommendations to improve the relevance of education research for diverse communities of students and families?

When I started graduate school, I received the advice to read the literature extensively and think about where I could add value in terms of advancing our understanding of certain questions. As I sought to figure out which questions to ask and answer, I drew on my personal experience and those of my family members to think about how students succeed in high school and choose a career path that may involve postsecondary education. I found it helpful to think through how first-generation families like my own navigate high school and the transition to college. This also led me to realize the importance, as a quantitative researcher, of speaking with people in the field. I have really enjoyed pursuing researcher-practitioner partnership research and have been learning about examples of youth participatory research that I hope to support someday as well. 

What advice would you give to emerging scholars that are pursuing a career in education research?

I would advise them to choose questions that they are passionate about and to attend to questions and areas that tend to receive less attention. If an area of study is crowded and there are lots of people working in that space, be sure you think about how your work and thinking can provide unique insight. I would also hope that emerging scholars seek to do work that influences what happens in schools. To that end, I think it is important to pay attention to how practitioners are framing and understanding issues in the education system. Having this deeper understanding of the field will elevate your research and make it more impactful. 


Inside IES Research is publishing a series of interviews (see herehere, and here) showcasing a diverse group of IES-funded education researchers and fellows that are making significant contributions to education research, policy, and practice. As part of our research training blog series, we are featuring winners of the 2019-2021 Outstanding Predoctoral Fellow awards. The 2019 winner, Sade Bonilla, was a fellow in the Stanford University Predoctoral Training Program in Quantitative Education Policy Analysis.

Produced by Bennett Lunn (Bennett.Lunn@ed.gov), Truman-Albright Fellow for the National Center for Education Research and the National Center for Special Education Research and Katina Stapleton (Katina.Stapleton@ed.gov), co-Chair of the IES Diversity and Inclusion Council and predoctoral training program officer.

 

CTE Month? More like CTE Year!

In honor of CTE month, we wanted to provide more information about the recent additions to NCER’s CTE research portfolio: 7 new grants awarded across 2 grant programs in FY2021. A previous blog last summer announced these grants; this blog briefly describes each project (the hyperlinks will take you to the full online project abstract). Be sure to read to the end for links to other CTE work across IES!

 

Within the Education Research Grants program (305A), the following projects were funded in 2021:

College and Career Readiness: Investigating California's Efforts to Expand Career Technical Education Through Dual Enrollment

(PI: Michal Kurlaender, University of California, Davis)

This project is examining the result of policy changes due to California Assembly Bill 288 (AB288), enacted in 2015 to create the College and Career Access Pathways (CCAP) partnership. CCAP increased the prominence of Career and Technical Education (CTE) at the high school level by allowing high schools and community colleges to enter joint partnerships and offer dual enrollment courses that count towards both a high school diploma and an associate degree from California community colleges. 

Postsecondary and Labor Market Effects of Career and Technical Education in Baltimore City Public Schools

(PI: Marc Stein, Johns Hopkins University)

This project uses a unique selection process into CTE Centers within a large school district, linked with longitudinal state data, to provide strong evidence on the benefits and mechanisms of CTE participation on secondary education, postsecondary education, and labor market outcomes.

SREB Career and Technical Education Leadership Academy Study

(PI: James Stone, Southern Regional Education Board)

This project is developing, piloting, and studying the promise of the Southern Regional Education Board (SREB) Career and Technical Education Leadership Academy to increase the capacity of school leaders at career and technology centers to work with their teachers as instructional leaders and thereby improve CTE outcomes for their students.

An Experimental Evaluation of the Efficacy of Virtual Enterprises

(Co-PIs: Fatih Unlu, RAND Corporation and Kathy Hughes, AIR)

In this project, the research team will provide the first causal evidence on the efficacy and cost-effectiveness of Virtual Enterprises, a virtual school-based enterprise (SBE) program. SBEs are one form of work-based learning (WBL) in which students run a business that produces and sells goods or services. SBEs may offer unique benefits relative to other types of WBL by providing opportunities for more students to participate, reducing the need for transportation, and allowing students more room to make and learn from their mistakes. Note: Since this is an efficacy (causal impact) study, it has joined the CTE Research Network.

Sub-baccalaureate Career and Technical Education: A Study of Institutional Practices, Labor Market Demand, and Student Outcomes in Florida

(PI: Angela Estacion, WestEd)

The purpose of this project is to address existing policy and research gaps by, first, administering a statewide survey to catalogue the institutional practices that Florida community and technical colleges use to align CTE programming to the labor market. Second, by combining the survey data with student-level program participation and outcome data, the project team will ascertain the degree to which institutional practices and labor market conditions in students' geographical areas are correlated with students' choices and outcomes. Finally, the project team will analyze qualitative data collected from case studies of Florida community and technical colleges to describe the practices cited in the survey data and understand the process of aligning courses and programs with local labor market demand.

 

Within the “Using SLDS to Support State Education Policymaking” (305S) grant program, the following projects were funded in 2021:

The Distributional Effects of Secondary Career and Technical Educational (CTE) Programs on Postsecondary Educational and Employment Outcomes: An Evaluation of Delaware's CTE Programs of Study

(PI: Luke Rhine, Delaware Department of Education)

The Delaware Department of Education and University of Delaware is examining variability in participation rates among student subgroups in Delaware public high school CTE programs and link CTE high school participation to high school graduation, postsecondary enrollment, employment, and wages. Stay tuned to delawarepathways.org for more information as the project unfolds.

Analyzing and Understanding the Educational and Economic Impact of Regional Career Pathways

(PI: Jonathan Attridge, Tennessee)

The research team is conducting an evaluation of Tennessee Pathways (along with earlier career pathway programs), a state initiative to align K-12 education, postsecondary education, and employers so that high school students have a clear pathway to move into the workforce.

 

For a full list of CTE-related grants funded by NCER and NCSER across years, topics, and grant competitions, you can explore our “funded projects” search pages for NCER or NCSER. Here is a recent blog post about students with disabilities in CTE from NCSER. And don’t forget to visit the CTE Research Network frequently for many new CTE-related findings and resources!

NCEE and NCES have published multiple reports on CTE, including Career and Technical Education Credentials in Virginia High Schools: Trends in Attainment and College Enrollment Outcomes, as well as some great blogs such as this one on exploring the growing impact of career pathways from NCEE. You can see more on career readiness from NCEE here and from NCES here.

We are so pleased with the growth of this portfolio since our first call for more CTE research 5 years ago! However, there continues to be a need to better understand CTE. For instance, research is still needed on CTE measures and assessments, quality of programs (content, instruction, and opportunities for WBL), and variation in impacts across student subgroups and career clusters.


For more information about CTE research grants, including feedback on new project proposal ideas, please contact NCER program officer Corinne.Alfeld@ed.gov.