Inside IES Research

IES supports rigorous research that can provide scientific evidence on how best to address our nation’s most pressing education needs. As part of the Standards for Excellence in Education Research (SEER) principles, IES-funded researchers are encouraged, and in some cases required, to conduct a cost analysis for their projects with the intended goal of supporting education agencies’ decision-making around the adoption of programs, policies, or practices. 

The Cost Analysis in Practice (CAP) Project is a 3-year initiative funded by IES to support researchers and practitioners who are planning or conducting a cost analysis of educational programs and practices. This support includes the following freely available resources.

• Resources developed by the CAP Project
  • Introductory resources on cost analysis including Standards and Guidelines 1.1, an infographic, a video lecture, and FAQs.
  • Tools for planning your cost analysis, collecting and analyzing cost data, and reporting your results.
  • A Help Desk for you to submit inquiries about conducting a cost analysis with a response from a member of the CAP Project Team within two business days.
• Other resources recommended by the CAP Project
  • Background materials on cost analysis
  • Guidance on carrying out a cost analysis
  • Standards for the Economic Evaluation of Educational and Social Programs
  • Cost analysis software

The CAP Project is also involved in longer-term collaborations with IES-funded evaluation projects to better understand their cost analysis needs. As part of this work, the CAP Project will be producing a set of three blogs to discuss practical details regarding cost studies based on its collaboration with a replication project evaluating an intervention that integrates literacy instruction into the teaching of American history. These blogs will discuss the following:

• Common cost analysis challenges that researchers encounter and recommendations to address them
• The development of a timeline resource for planning a cost study
• Data collection for a cost study

The CAP Project is interested in your feedback on any of the CAP Project resources and welcomes suggestions for additional resources to support cost analysis. If you have any feedback, please fill out a suggestion form at the bottom of the Resources web page.

In response to a call from IES for research on how to best support postsecondary teachers and students to thrive in online environment, NCER is establishing a new research and development (R&D) center. This center, led by SRI International (SRI) and the Community College Research Center (CCRC) at Teachers College (Columbia University), aims to help faculty embed support for self-directed learning skills into their online and hybrid courses.

This R&D center will support postsecondary instructors in making optimal use of technology features often available in online course tools to bolster student self-management strategies. Through its research and capacity-building programs, the center aims to strengthen teaching and learning, improve student outcomes, and ensure all students—regardless of race, ethnicity, or socioeconomic status—have equitable learning opportunities and attainment in broad-access institutions.

“Lack of self-directed learning skills can hinder a student’s success in any college course,” says SRI’s Rebecca Griffiths, a lead researcher in the new center, “but the challenge is greater in online courses, which typically place more responsibility on students to manage their own learning.”

Self-directed learning skills, also known as self-regulated learning skills, encompass three interrelated and mutually reinforcing areas:

• Affect, which includes self-efficacy and the motivation to learn
• Strategic actions, which include planning, goal setting, strategies to organize, code, and rehearse
• Metacognition, which includes self-monitoring, self-evaluating and self-correction

These three areas can form a virtuous cycle. When students believe that studying helps them learn important and useful knowledge, they are more likely to study strategically and effectively. Effective study habits in turn enhance academic performance and build positive mindsets including confidence, motivation around learning, and a sense of personal growth.

SRI and CCRC will partner with Achieving the Dream and nine broad-access, public colleges, and universities across the U.S. to conduct these research program activities.

The research goals of the R&D center are to—

• Generate new knowledge about how faculty can effectively use technology features and instructional practices in online STEM courses to create a positive feedback loop for students
• Shed light on institutional policies and practices and instructional environments needed to support a coherent, intentional, and sustainable approach to helping students build self-directed learning skills across their coursework
• Develop and pilot a technology-enabled, skills development model that will use technology features already widely available in learning management systems, adaptive courseware, and mobile apps to deliver instruction on these skills
• Using research findings to inform the development of a rich, interactive toolkit to support institutions and faculty as they implement self-directed learning skills instruction at scale in online programs.

In addition to carrying out the research activities, the center will provide national leadership and capacity-building activities for postsecondary teaching and learning. Through partnership with Achieving the Dream, technology developers, researchers, education equity advocates, and others, the center will establish the critical importance of integrating self-directed learning into instruction to improve teaching and learning and improve equity in postsecondary student outcomes. They will also engage faculty, instructional designers, and educational technology developers to share knowledge and to co-develop and disseminate capacity-building resources that support teaching these skills and strategies. 

The center is led by Dr. Deborah Jonas (PI, SRI International, top photo), Dr. Nicole Edgecombe (Co-PI, Teachers College, Columbia University), Dr. Rebecca Griffiths (Co-PI, SRI International), and Dr. Neil Seftor (Co-PI, SRI International).

This blog was written by the R&D center team. For further information about the grant, contact the program officer: Dr. Meredith Larson.

Across a set of research grant programs, IES generates knowledge of how to increase students’ access to, progress through, and completion of postsecondary credentials and degrees. Funded projects develop and test a range of interventions from state-level policies to classroom practices, with an emphasis on strategies that promote college attainment for students historically underrepresented in postsecondary education. This new blog series called Effective Postsecondary Interventions highlights interventions with evidence of effectiveness generated through IES-funded research.

The Early College High School Model

The Early College High School (ECHS) model addresses barriers to college attainment commonly experienced by students historically underrepresented in higher education. Students from low-income families and minoritized racial and ethnic groups often attend high schools that lack rigorous pre-college courses, strong support for college enrollment, and established connections to colleges and universities. For those students, cost is an additional barrier to enrollment and persistence in college. The ECHS model addresses these barriers by combining secondary and postsecondary instruction within the same school, prioritizing college-preparatory high school courses, offering opportunities to enroll in college courses while in high school, and providing comprehensive supports for academic and social-emotional development—all at little or no cost to the students. Although concurrent enrollment in high school and college courses (dual enrollment) is a core component of the model, the ECHS model is more expansive than dual enrollment because it includes a broader set of intervention components and has a clear equity objective.

All early colleges reflect these four design principles:

• Enrollment of students historically underrepresented in higher education
• Partnerships including a local education agency, a higher education institution, and the surrounding community
• An integrated program of secondary and postsecondary education with the goal of all students earning 1 to 2 years of college credit prior to high school graduation
• A comprehensive support system for students to develop academic skills as well as social and behavioral skills.

Attending Early Colleges Increases Postsecondary Attainment

Four IES-funded projects have evaluated impacts of the ECHS model. Prior studies within these projects found that significantly larger percentages of early college students completed a college preparatory course of study during high school and enrolled in postsecondary education within six years of entering high school. The two most recent projects assess postsecondary attainment:

• A follow-up efficacy study of 19 North Carolina early colleges led by Dr. Julie Edmunds (University of North Carolina) finds that 42 percent of early college students attained an associate or bachelor’s degree within 10 years of high school entry, compared with 31 percent of their peers in traditional high schools. The WWC review for this study indicates that the study meets WWC standards without reservations, and this finding meets the ESSA Tier 1 evidence standard.
• A follow-up efficacy study of 10 early colleges in five states led by Dr. Mengli Song (American Institutes for Research) finds that 45 percent of early college students attained an associate or bachelor’s degree during the same 10-year period, compared with 33 percent of their peers in traditional high schools. The WWC review for this study also indicates that the study meets WWC standards without reservations, and this finding meets the ESSA Tier 1 evidence standard.

In addition, early college students earned associate degrees at rates that exceeded their counterparts in traditional high schools by 22% and 18%, respectively, while earning bachelor’s degrees at equal or higher rates. These impacts are substantial, and especially noteworthy because both evaluations studied early colleges across a range of settings. Moreover, the impacts are similar for different student subgroups, regardless of gender, race/ethnicity, or family income.

Why have early colleges been so effective?

Early colleges set high expectations, provide high-quality interactions between staff and students, and encourage college access and success for all students. Several studies confirm that early colleges substantially improve high school experiences and outcomes. Students in North Carolina early colleges reported higher expectations, more rigorous and relevant instruction, stronger academic and social supports, and better relationships with teachers than their counterparts in other high schools. Early college students in AIR’s five-state sample reported significantly higher levels of college-going culture and instructor support than their counterparts in traditional high schools. The combination of high expectations and supportive relationships promotes better outcomes for early college students beginning in ninth grade (compared with students in other high schools). For instance, early college students are more likely to persist in college-preparatory math courses, attain a significant number of college credits during high school, and graduate from high school. Importantly, these positive results hold for students from all racial and ethnic groups, including students who enter high school at low levels of math proficiency.

For more information about the studies, the SERVE Center at the University of North Carolina at Greensboro has posted a brief of impact findings from their evaluation of North Carolina early colleges. The American Institutes of Research has posted a brief of impact findings from their five-state evaluation of early colleges.  

Written by James Benson (James.Benson@ed.gov), a Program Officer for Postsecondary Education within NCER’s Policy and Systems Division.

Ever read an article or research abstract and wish you could ask the author questions? In this new IES series, “What Does This Mean for Me,” we are doing just that. IES researchers are answering questions to help students, educators, and others use their research. In the first round of this series, NCER virtual college interns are reaching out with questions relevant to their interests, goals, and communities. We invite you to learn more about not only what education science means for real people but also what students and other community members care about. This blog was written by Shirley Liu, virtual intern at NCER.

As part of my virtual internship with IES, I wanted to learn about research that was applicable to my own experiences. I decided to ask Dr. Art Anastopoulos about the unique challenges for postsecondary students with attention deficit hyperactivity disorder (ADHD), as well as strategies and interventions that can help students with ADHD succeed in college. With funding from IES, Dr. Anastopoulos evaluated an intervention called Accessing Campus Connections and Empowering Student Success (ACCESS) for students with ADHD. ACCESS aims to help college students succeed by increasing student knowledge about and ability to manage their diagnosis and to leverage campus supports.

Why are students with ADHD more likely to struggle in college than students without ADHD? What might be particularly challenging for them?

There are many possible reasons for why students with ADHD are more likely to struggle. For one thing, many high school students with ADHD lag behind their peers without ADHD, in terms of grade point average, less well-developed study-skills, etc. And this lag persists as they make the transition into college. Students with ADHD are also at increased risk for experiencing co-occurring mental health difficulties, such as depression and anxiety disorders, which together with ADHD interfere with college functioning.

Another useful way to understand the unique challenges of students with ADHD is through the notion of a “perfect storm.” [In this video (from 2:21 – 4:28), Art describes the “perfect storm” as the interplay between a diminished capacity for self-regulation that students with ADHD may have and the high levels of self-regulation that postsecondary education requires of students.]

In addition to their attentional difficulties and impulsivity, many students with ADHD have co-occurring executive functioning deficits, affecting their organization, planning, and time management. Together, such difficulties may lead to academic problems such as having trouble sitting through a boring class, taking detailed lecture notes, attending classes and other meetings on time, waiting until the last minute to complete papers and other long-term assignments, forgetting to preregister for upcoming courses, and placing greater emphasis on speed versus accuracy when taking tests. For similar reasons, students with ADHD may experience interpersonal problems with their friends, as well as difficulties in employment situations.

ACCESS is an institution-supported intervention for students with ADHD, but how exactly does ACCESS work?

ACCESS targets multiple deficit areas that can lead to impairment in multiple domains of daily functioning. More specifically, ACCESS is designed to increase student knowledge and understanding of ADHD, their use of behavioral strategies, and their adaptive thinking skills. To the extent that these goals are achieved, improvements in academic, emotional, social, and personal functioning are expected to occur.

In your opinion, how can professors best support college students with ADHD?

The most important thing that college professors can do is to respect a student’s need for formally recommended accommodations and to facilitate their implementation. Listed below are four common accommodations for college students with ADHD:

• Taking exams in private locations where distractions are minimized
• Having extended time to take exams
• Being allowed to audio record lectures via smart pens or phone devices
• Having another person take notes for them

How can students with ADHD prepare to succeed in college?

One of the most important thing students can do is to prepare for the increased demands that college brings while still in high school. This includes, for example, increasing their knowledge of ADHD. The more developmentally appropriate their understanding of ADHD is, the more likely students will accept their diagnosis. This can also help them recognize the importance of continuing and/or seeking out necessary treatments, such as medication management and counseling. The more that a student can wean themselves from dependence on parents and others for managing academic demands while in high school, the better able that student will be to manage the increased demands for self-regulation that college brings. This goes beyond academics and includes managing money, preparing meals, doing laundry, getting to doctors’ appointments, etc.

In addition to the written responses to my questions, Dr. Anastopoulos also shared links to videos and resources he and his team created as part of the grant. These are curated below and provide general overviews of ACCESS and the research project. In addition, he and his team have two recent publications that share the findings from the evaluation.

Video Resources:

• The Treatment Needs of College Students with ADHD on Vimeo
• ACCESS Program for College Students with ADHD on Vimeo

Additional information about ACCESS:

• Program Description on webpage: What is ACCESS | Access Project (uncg.edu)
• IES Study | Access Project (uncg.edu)

Additional Reading:

• Anastopoulos, A.D., Langberg, J.M., Eddy, L.D., Silvia, P.J., & Labban, J.D. (2021).  A randomized controlled trial examining CBT for college students with ADHD.  Journal of Consulting and Clinical Psychology, 89 (1), 21–33.  – Reports significant differences for ACCESS participants, namely of improved ADHD symptoms, executive functioning, clinical change mechanisms, and use of disability accommodations.​
• Eddy, L.D., Anastopoulos, A.D., Dvorsky, M.R., Silvia, P.J., Labban, J.D., & Langberg, J.M. (2021). An RCT of a CBT intervention for emerging adults with ADHD attending college: Functional outcomes. Journal of Clinical Child and Adolescent Psychology.  – Reports findings that ACCESS may improve students’ self-reported general well-being and functioning as well as improved time management and study skills and strategies but may not show as much impact on students’ interpersonal relationships or GPA.

Dr. Art Anastopoulos is a Professor and the Director of the ADHD Clinic in the Department of Human Development and Family Studies in the School of Health and Human Sciences at UNC Greensboro.

Written by Shirley Liu, virtual intern at NCER and an English major at Lafayette College.

In celebration of CTE^® (career and technical education) month, we would like to highlight the launch of an NCER project that aims to help us understand how to best support adults seeking additional CTE education and training.

Through their exploratory project, Literacy, Numeracy, and Problem-Solving Skills in Technology-Rich Environment in the STEM-Related Subbaccalaureate Programs in the United States, researchers will use a mixed-method design to gather information about the distribution of basic skills (literacy, numeracy, and problem solving) for adults in STEM occupations and students enrolled in STEM-related sub-baccalaureate programs at community colleges. Their goal is to help identify the needs of students and the programming practices at community colleges that may promote basic skill development in STEM programs.

The team will be leveraging data from the Program for the International Assessment of Adult Competencies (PIAAC) to survey the distribution of skills and abilities across a nationally representative sample of adults in STEM fields. They will also be collecting primary data from adults and programs in multiple locations, including Indiana, Ohio, and Washington states.

To help inform the public about their project, the researchers have created a short YouTube video for the public. This project began in July 2020 and may have initial results ready as early as late 2021.

Written by Meredith Larson (Meredith.Larson@ed.gov), Program Officer for Postsecondary and Adult Education, NCER.