Inside IES Research

The Center for Analysis of Postsecondary Education and Employment (CAPSEE) is an IES-funded Research and Development Center that seeks to advance knowledge regarding the link between postsecondary education and the labor market. CAPSEE was funded through a 2011 grant from the National Center for Education Research (NCER) and is in the process of completing its work. CAPSEE will hold a final conference to discuss its findings on April 6 & 7 in Washington, DC.

Recently, Tom Bailey (pictured), Director of the Community College Research Center, Columbia University, Teachers College, and the Principal Investigator for CAPSEE, answered questions from James Benson, the NCER Program Officer for the R & D center.

Can you describe some of the original goals of CAPSEE?

We were especially interested in the economic benefits of a college education for community college students, including those who complete awards (Associate’s degrees or certificates) and those who do not, as well as those who transfer to four-year colleges. We were also interested in differences in earnings by field of study. When we started CAPSEE in 2012 there were a lot of studies that used survey datasets to look, in general, at the returns to completing a Bachelor’s degree. The CAPSEE approach was to use large-scale statewide databases and follow college students over time, to look in detail at their earnings before, during, and after college.

In addition, CAPSEE researchers sought to examine two key policy issues. One was how financial aid and working while enrolled affect students’ performance in college and their labor market outcomes. The other was whether for-profit colleges help students get better jobs.

You have synthesized findings from analyses in six states. What are your main findings?

We found that, in general, Associate’s degrees have good returns in the labor market; they’re a good investment for the individual and for society. However, there is quite a bit of variation in returns by program. For students in Associate degree programs primarily designed to prepare them for transfer to a four-year college, if they don’t transfer, their degrees will not be worth very much. But when they complete vocational degrees, especially in health-related fields, the earnings gains are usually strong and persistent (and robust to how we estimated them). Also, we did a lot of research on certificates, credentials that many see as the best fit for students on the margin of going to college. We found benefits to students who completed certificates, again especially in fields that directly relate to an occupation or industry. And finally, we examined outcomes for students who enrolled and took courses without attaining a degree or certificate. We found that their after-college earnings increased in proportion to the number of credits they earned.

"The fundamental policy implication is that college is a good investment."

What do you see as the key policy implications of these findings?

The fundamental policy implication is that college is a good investment. This merits emphasis because there are repeated critiques of college in terms of how much it costs and how much debt students accumulate. That said policymakers do need to think about the value of each postsecondary program. Even within the same institution, programs have very different outcomes. Yet on average, attending college for longer and attaining more credits has beneficial effects. Policymakers should see this evidence as supporting public and private investments in college.

What did you discover about the relationships between financial aid, college outcomes, and labor market outcomes?

In an era of tight public resources, the effectiveness of financial aid policy is a crucial issue. Financial aid does help students persist in college, but one way to promote greater effectiveness is through academic performance standards for students receiving federal financial aid. These have existed in the federal need-based aid programs for nearly 40 years, in the form of Satisfactory Academic Progress (SAP) requirements. These have not received much attention. Our research on SAP suggests such policies have heterogeneous effects on students in the short term: they increase the likelihood that some students will drop out, but appear to motivate higher grades for students who remain enrolled. After three years, however, the negative effects dominate. Though it has little benefit for students in the long term, SAP policy appears to increase the efficiency of aid expenditures because it discourages students who have lower-than-average course completion rates from persisting. But the policy also appears to exacerbate inequality in higher education by pushing out low-performing, low-income students faster than their equally low-performing, higher-income peers.

Many students work while in college.  Does this seem to help or hurt students in the long run?

Our research found that for Federal Work-Study (FWS) participants who would have worked even in the absence of the program, FWS reduces hours worked and improves academic outcomes but has little effect on post-college employment outcomes. For students who would not have worked, the effects are reversed: the program has little effect on graduation, but a positive effect on post-college employment.  Results are more positive for participants at public institutions, who tend to be lower income than participants at private institutions. Our findings suggest that better targeting to low-income and lower-scoring students could improve FWS outcomes. This is consistent with much of the CAPSEE research—you need more detail and specificity to really understand the relationship between education and employment and earnings.

What did you learn about credentials from for-profit institutions?

Our findings on students at for-profit colleges were quite pessimistic. Although enrollment in for-profit colleges grew significantly after 2000, the sector has been declining during the last two years, as evidence on inferior outcomes – particularly with regard to student debt – emerged. In general, our researchers found that for-profit students have worse labor market outcomes than comparable community college students although in some cases the difference is not statistically significant. Our evidence suggests that these colleges need to be monitored to ensure they are delivering a high-quality, efficient education.

You are holding the final CAPSEE conference in April. What do you hope people will get out of it?

At the conference, we will focus on several important and controversial policy questions related to higher education: 

• Have changes in tuition and the labor market created conditions in which college is not worth it for some students, contributing to an unsupportable increase in student debt? 
• Has higher education contributed to inequality rather than promoting economic mobility? 
• Is continued public funding of college a worthwhile investment? 
• Should public funding be used only for some programs of study?  
• What are the arguments for and against making community college free?
• Can changes in the operations and functioning of colleges change the return on investment from a college education for both the individual and society?
• How important should information on earnings outcomes be for accreditation decisions and/or for eligibility of students to receive financial aid? 

At the conference participants will have the opportunity to discuss and learn about these issues drawing on five years of CAPSEE research as well as input from other experts.

The special education research community has increasingly focused on how best to support students with disabilities in the transition from high school to postsecondary education or adult life. 

Transition supports provided in schools for these youth can differ and, as a result, the outcomes for these students during and after high school can vary a great deal.[1] The National Center for Special Education Research (NCSER) has funded several grants on the topic.

Some of these NCSER-funded studies have incorporated and evaluated new approaches to provide educators with concrete information about effective practices to promote positive transition outcomes during and after high school.  Here is a brief update on a few promising programs and practices.

Picture (clockwise from top left) - David Test, Mary Wagner, Erik Carter, Sarah Gennen. Photos from university websites.

David Test, Tiana Povenmire-Kirk, Claudia Flowers, and their colleagues at the University of North Carolina at Charlotte recently completed a four-year study of the effects of a transition-planning service delivery system model on transition outcomes for students with disabilities. Communicating Interagency Relationships and Collaborative Linkages for Exceptional Students (CIRCLES) is a three-tier model of interagency collaboration among community, school, and IEP teams (see graphic).[2] The effect of CIRCLES was studied using a group-randomized controlled trial, the first rigorous evaluation of such an intervention. Results indicated many positive impacts of the program including increased collaboration among teams, and increased rates of self-determination, IEP participation, and academic performance for CIRCLE students as compared to students in the control group receiving business-as-usual supports for transition.[3] One year after exiting high school, No differences in post-school outcomes were observed for those in CIRCLES as compared to those in the control group. However, these data were obtained for fewer than half of the original sample. More research is to be done to determine the true impact of CIRCLES on post-school outcomes.   

Mary Wagner and her team addressed questions about the impact of interventions for high school students with autism spectrum disorders using a quasi-experimental design and longitudinal data from several national datasets. Her team found that 2- or 4-year college enrollment rates were significantly higher among youth with autism who participated in transition planning and those who had a primary transition goal of college enrollment.[4] In addition, the results indicated that these enrollment rates were significantly higher among students with autism who were included in secondary school general education English, math, science, or social studies classes than their peers with ASDs who were not included in these classes.[5]

Erik Carter at Vanderbilt University and his research team undertook a four-year study to examine the effect of peer support and peer network strategies as alternatives to traditional paraprofessional-delivered support to assist adolescents with severe disabilities in the classroom. The research team examined the impact of these interventions and found significant increases in participating students’ progress on individual goals, peer interactions and social relationships, social and academic engagement, and community participation compared to those receiving traditional paraprofessional support.[6] Previous research on transition interventions of this kind helped to identify evidence-based practices but this study was the first to rigorously evaluate them. Peers in the classroom can play a unique and valuable role in the welfare of adolescents with severe disabilities, and paraprofessionals and special educators can serve in a different role as facilitators of the peer support provided in these interventions.

Sarah Geenen, Laurie Powers, and their team at Portland State University conducted a longitudinal, experimental study to assess the efficacy of a supplemental transition program designed for youth in high school who are in both special education and foster care. Foster care students, they note, are disproportionately more likely to receive special education services than non-foster care students. The results were compelling, with meaningful and positive effects on youth participants, with lower rates of involvement in the juvenile justice system and increased independent living preparation and skills as compared to non-participants.[7]

Learn more about NCSER-funded work in the Transition Outcomes for Secondary Students with Disabilities topics on the Institute of Education Sciences website or contact Kim Sprague at Kimberley.Sprague@ed.gov.

Written by Diane Mechner, University of Virginia, and Kim Sprague, Program Officer for Transition. Ms. Mechner, a student, was a 2016 IES summer intern.

By Meredith Larson, NCER Program Officer                                                                                     

Although more students with disabilities are pursuing postsec ondary education, completion rates for this group of students have not changed very much in recent years. In a two-year study funded through an IES grant, Lynn Newman, of SRI International, and Joseph Madaus, director of the Center on Postsecondary Education and Disability at the University of Connecticut, have examined the impact that supports and accommodations have had on the postsecondary success of students with disabilities.

             

 

At the heart of their study is the National Longitudinal Transition Study-2 , the largest and richest data set available to address the postsecondary experiences and outcomes of youth with disabilities. It is the only dataset that can address those topics for postsecondary students with disabilities nationally, independent of students’ decisions to disclose a disability to their postsecondary school.

Below are excerpts from an email interview with the researchers. 

What motivated your study, and what questions are you grappling with?

Although postsecondary enrollment rates for students with disabilities have increased dramatically for youth in all disability categories over the past two decades, postsecondary completion rates for students with disabilities have remained stagnant over time. These students continue to be less likely to graduate from postsecondary school than their general population peers.

This led us to ask

• What is the link between receipt of postsecondary supports and accommodations – both those available because of a disability and those available to the general student body – and postsecondary persistence and completion for students with disabilities?
• What factors are associated with requesting/receiving postsecondary supports and accommodations?

What are your major findings?

First and foremost, students with disabilities who received supports, particularly supports available to the full student body (such as tutoring and access to writing and study centers), are more likely to persist in and complete their postsecondary programs. This finding applies to students with disabilities enrolled at both 2-year and 4-year colleges.

However, we didn’t find a significant relationship between receipt of disability-specific supports and accommodations (such as test accommodations, readers, interpreters) and postsecondary persistence or completion for the full population of students with disabilities. We found that the link between supports/accommodations and outcomes differs by disability category. For example, students who were deaf or hard of hearing and received disability-specific accommodations and supports were more likely to persist in or complete postsecondary education than were those who had not received these types of help.  

Does your research suggest why some students seek out or use supports more than others?

Fewer than half of those with disabilities in postsecondary institutions accessed the types of supports available to the general student body, and less than one-quarter received disability-specific help during postsecondary school. Students who received transition planning education in high school and those whose transition plans specified needed postsecondary supports and accommodations were significantly more likely to access both generally-available and disability-specific supports in postsecondary school, particularly at 2-year institutions.

If you could tell each of your target audiences what your research means for them in practical terms, what would you say?

Students and families: By accessing supports and help at postsecondary institutions,  you increase your odds for postsecondary success. If you are uncomfortable sharing information about your disability, which is required to receive disability-specific supports, you should, at least, access the types of supports available to the general student body, such as tutoring and writing centers.

High school staff: Help students avail themselves of supports at the postsecondary level through transition planning. Transition planning education and transition plans that specify postsecondary accommodation needs significantly affect whether students seek postsecondary supports. Clearly, the transition education and planning you can do matters. However, as many as one third to one half of high school students with disabilities do not receive such transition planning services.

Postsecondary staff: Keep in mind that only 35% of students with disabilities who received services in high school disclosed their disability to their postsecondary institutions, so you probably have more students with disabilities on your campus than you may be aware of. Because receipt of postsecondary supports (especially general supports available to all students) are particularly beneficial to students with disabilities, we encourage active and broad outreach about these supports to the entire student body, rather than focusing on just the few students who have chosen to disclose their disability.

In addition, we encourage professional development for postsecondary staff, particularly those involved in providing generally available supports, to help them better recognize and support students with disabilities.

Researchers: Consider the representativeness of your samples of postsecondary students with disabilities. If respondents are identified through self-disclosure of a disability, your sample probably has a large amount of underreported students with disabilities overall. Your sample is also likely to be biased, in that students with more visible disabilities are much more likely to disclose their disability than are those in the higher incidence disability categories, such as learning disabilities.

What might some next research steps be?

Given our findings, we believe there are many opportunities for research related to postsecondary education for students with disabilities.  For example, researchers could study questions about the characteristics, content, extent, and timing of effective postsecondary supports and accommodations. The field would also benefit from additional knowledge about effective high school transition planning education and answers to questions about the characteristics and structures of high schools and postsecondary schools that offer effective supports and accommodations and transition planning education. 

Questions? Comments? Please send them to IESResearch@ed.gov.