IES Blog

Institute of Education Sciences

Cost Analysis in Practice: Resources for Cost Analysis Studies

IES supports rigorous research that can provide scientific evidence on how best to address our nation’s most pressing education needs. As part of the Standards for Excellence in Education Research (SEER) principles, IES-funded researchers are encouraged, and in some cases required, to conduct a cost analysis for their projects with the intended goal of supporting education agencies’ decision-making around the adoption of programs, policies, or practices. 

 

The Cost Analysis in Practice (CAP) Project is a 3-year initiative funded by IES to support researchers and practitioners who are planning or conducting a cost analysis of educational programs and practices. This support includes the following freely available resources.

  • Resources developed by the CAP Project
    • Introductory resources on cost analysis including Standards and Guidelines 1.1, an infographic, a video lecture, and FAQs.
    • Tools for planning your cost analysis, collecting and analyzing cost data, and reporting your results.
    • A Help Desk for you to submit inquiries about conducting a cost analysis with a response from a member of the CAP Project Team within two business days.
  • Other resources recommended by the CAP Project
    • Background materials on cost analysis
    • Guidance on carrying out a cost analysis
    • Standards for the Economic Evaluation of Educational and Social Programs
    • Cost analysis software

 

The CAP Project is also involved in longer-term collaborations with IES-funded evaluation projects to better understand their cost analysis needs. As part of this work, the CAP Project will be producing a set of three blogs to discuss practical details regarding cost studies based on its collaboration with a replication project evaluating an intervention that integrates literacy instruction into the teaching of American history. These blogs will discuss the following:

  • Common cost analysis challenges that researchers encounter and recommendations to address them
  • The development of a timeline resource for planning a cost study
  • Data collection for a cost study

 

The CAP Project is interested in your feedback on any of the CAP Project resources and welcomes suggestions for additional resources to support cost analysis. If you have any feedback, please fill out a suggestion form at the bottom of the Resources web page.

IES Announces a New Research and Development Center for Self-Directed Learning Skills in Online College Courses

In response to a call from IES for research on how to best support postsecondary teachers and students to thrive in online environment, NCER is establishing a new research and development (R&D) center. This center, led by SRI International (SRI) and the Community College Research Center (CCRC) at Teachers College (Columbia University), aims to help faculty embed support for self-directed learning skills into their online and hybrid courses.

This R&D center will support postsecondary instructors in making optimal use of technology features often available in online course tools to bolster student self-management strategies. Through its research and capacity-building programs, the center aims to strengthen teaching and learning, improve student outcomes, and ensure all students—regardless of race, ethnicity, or socioeconomic status—have equitable learning opportunities and attainment in broad-access institutions.

“Lack of self-directed learning skills can hinder a student’s success in any college course,” says SRI’s Rebecca Griffiths, a lead researcher in the new center, “but the challenge is greater in online courses, which typically place more responsibility on students to manage their own learning.”

 

Self-directed learning skills, also known as self-regulated learning skills, encompass three interrelated and mutually reinforcing areas:

  • Affect, which includes self-efficacy and the motivation to learn
  • Strategic actions, which include planning, goal setting, strategies to organize, code, and rehearse
  • Metacognition, which includes self-monitoring, self-evaluating and self-correction

 

These three areas can form a virtuous cycle. When students believe that studying helps them learn important and useful knowledge, they are more likely to study strategically and effectively. Effective study habits in turn enhance academic performance and build positive mindsets including confidence, motivation around learning, and a sense of personal growth.

SRI and CCRC will partner with Achieving the Dream and nine broad-access, public colleges, and universities across the U.S. to conduct these research program activities.

 

The research goals of the R&D center are to—

  • Generate new knowledge about how faculty can effectively use technology features and instructional practices in online STEM courses to create a positive feedback loop for students
  • Shed light on institutional policies and practices and instructional environments needed to support a coherent, intentional, and sustainable approach to helping students build self-directed learning skills across their coursework
  • Develop and pilot a technology-enabled, skills development model that will use technology features already widely available in learning management systems, adaptive courseware, and mobile apps to deliver instruction on these skills
  • Using research findings to inform the development of a rich, interactive toolkit to support institutions and faculty as they implement self-directed learning skills instruction at scale in online programs.

 

In addition to carrying out the research activities, the center will provide national leadership and capacity-building activities for postsecondary teaching and learning. Through partnership with Achieving the Dream, technology developers, researchers, education equity advocates, and others, the center will establish the critical importance of integrating self-directed learning into instruction to improve teaching and learning and improve equity in postsecondary student outcomes. They will also engage faculty, instructional designers, and educational technology developers to share knowledge and to co-develop and disseminate capacity-building resources that support teaching these skills and strategies. 


The center is led by Dr. Deborah Jonas (PI, SRI International, top photo), Dr. Nicole Edgecombe (Co-PI, Teachers College, Columbia University), Dr. Rebecca Griffiths (Co-PI, SRI International), and Dr. Neil Seftor (Co-PI, SRI International).

This blog was written by the R&D center team. For further information about the grant, contact the program officer: Dr. Meredith Larson.

Announcing the Condition of Education 2021 Release

NCES is pleased to present the 2021 edition of the Condition of Education, an annual report mandated by the U.S. Congress that summarizes the latest data on education in the United States. This report uses data from across the center and from other sources and is designed to help policymakers and the public monitor educational progress.

Beginning in 2021, individual indicators can be accessed online on the newly redesigned Condition of Education Indicator System website. A synthesis of key findings from these indicators can be found in the Report on the Condition of Education, a more user-friendly PDF report.

A total of 86 indicators are included in this year’s Condition of Education, 55 of which were updated this year. As in prior years, these indicators present a range of topics from prekindergarten through postsecondary education, as well as labor force outcomes and international comparisons. Additionally, this year’s 55 updated indicators include 17 indicators on school crime and safety.

For the 2021 edition of the Condition of Education, most data were collected prior to 2020, either during the 2018–19 academic year or in fall 2019. Therefore, with some exceptions, this year’s report presents findings from prior to the coronavirus pandemic.

At the elementary and secondary level (prekindergarten through grade 12), the data show that 50.7 million students were enrolled in public schools fall 2018, the most recent year for which data were available at the time this report was written. Public charter school enrollment accounted for 7 percent (3.3 million students) of these public school enrollments, more than doubling from 3 percent (1.6 million students) in 2009. In 2019, U.S. 4th- and 8th-grade students scored above the scale centerpoint (500 out of 1000) on both the math and science assessments in the Trends in International Mathematics and Science Study (TIMSS).

In 2020, 95 percent of 25- to 29-year-olds had at least a high school diploma or equivalent, while 39 percent had a bachelor’s or higher degree. These levels of educational attainment are associated with economic outcomes, such as employment and earnings. For example, among those working full time, year round, annual median earnings in 2019 were 59 percent higher for 25- to 34-year-olds with a bachelor’s or higher degree than for those with a high school diploma or equivalent.

In addition to regularly updated annual indicators, this year’s two spotlight indicators highlight early findings on the educational impact of the coronavirus pandemic from the Household Pulse Survey (HPS).

  • The first spotlight examines distance learning at the elementary and secondary level at the beginning of the 2020–21 academic year. Overall, among adults with children under 18 in the home enrolled in school, two-thirds reported in September 2020 that classes had been moved to a distance learning format using online resources. In order to participate in these remote learning settings, students must have access to computers and the internet. More than 90 percent of adults with children in their household reported that one or both of these resources were always or usually available to children for educational purposes in September 2020. At the same time, 59 percent of adults reported that computers were provided by the child’s school or district, while 4 percent reported that internet access was paid for by the child’s school or district. Although higher percentages of lower income adults reported such assistance, this did not eliminate inequalities in access to these resources by household income.
  • The second spotlight examines changes in postsecondary education plans for fall 2020 in response to the coronavirus pandemic. Among adults 18 years old and over who had household members planning to take classes in fall 2020 from a postsecondary institution, 45 percent reported that the classes at least one household member planned would be in different formats in the fall (e.g., formats would change from in-person to online), 31 percent reported that all plans to take classes in the fall had been canceled for at least one household member, and 12 percent reported that at least one household member would take fewer classes in the fall. Some 28 percent reported no change in fall plans to take postsecondary classes for at least one household member. The two most frequently cited reasons for the cancellation of plans were having the coronavirus or having concerns about getting the coronavirus (46 percent), followed by not being able to pay for classes/educational expenses because of changes to income from the pandemic (42 percent).

The Condition of Education also includes an At a Glance section, a Reader’s Guide, a Glossary, and a Guide to Sources, all of which provide additional background information. Each indicator includes references to the source data tables used to produce the indicator.

As new data are released throughout the year, indicators will be updated and made available online.

In addition to publishing the Condition of Education, NCES produces a wide range of other reports and datasets designed to help inform policymakers and the public about significant trends and topics in education. More information about the latest activities and releases at NCES may be found on our website or by following us on Twitter, Facebook, and LinkedIn.

 

By James L. Woodworth, NCES Commissioner

Effective Postsecondary Interventions: Early Colleges Combine High School and College to Benefit Students

Across a set of research grant programs, IES generates knowledge of how to increase students’ access to, progress through, and completion of postsecondary credentials and degrees. Funded projects develop and test a range of interventions from state-level policies to classroom practices, with an emphasis on strategies that promote college attainment for students historically underrepresented in postsecondary education. This new blog series called Effective Postsecondary Interventions highlights interventions with evidence of effectiveness generated through IES-funded research.

 

The Early College High School Model

The Early College High School (ECHS) model addresses barriers to college attainment commonly experienced by students historically underrepresented in higher education. Students from low-income families and minoritized racial and ethnic groups often attend high schools that lack rigorous pre-college courses, strong support for college enrollment, and established connections to colleges and universities. For those students, cost is an additional barrier to enrollment and persistence in college. The ECHS model addresses these barriers by combining secondary and postsecondary instruction within the same school, prioritizing college-preparatory high school courses, offering opportunities to enroll in college courses while in high school, and providing comprehensive supports for academic and social-emotional development—all at little or no cost to the students. Although concurrent enrollment in high school and college courses (dual enrollment) is a core component of the model, the ECHS model is more expansive than dual enrollment because it includes a broader set of intervention components and has a clear equity objective.

All early colleges reflect these four design principles:

  • Enrollment of students historically underrepresented in higher education
  • Partnerships including a local education agency, a higher education institution, and the surrounding community
  • An integrated program of secondary and postsecondary education with the goal of all students earning 1 to 2 years of college credit prior to high school graduation
  • A comprehensive support system for students to develop academic skills as well as social and behavioral skills.

 

Attending Early Colleges Increases Postsecondary Attainment

Four IES-funded projects have evaluated impacts of the ECHS model. Prior studies within these projects found that significantly larger percentages of early college students completed a college preparatory course of study during high school and enrolled in postsecondary education within six years of entering high school. The two most recent projects assess postsecondary attainment:

In addition, early college students earned associate degrees at rates that exceeded their counterparts in traditional high schools by 22% and 18%, respectively, while earning bachelor’s degrees at equal or higher rates. These impacts are substantial, and especially noteworthy because both evaluations studied early colleges across a range of settings. Moreover, the impacts are similar for different student subgroups, regardless of gender, race/ethnicity, or family income.

 

Why have early colleges been so effective?

Early colleges set high expectations, provide high-quality interactions between staff and students, and encourage college access and success for all students. Several studies confirm that early colleges substantially improve high school experiences and outcomes. Students in North Carolina early colleges reported higher expectations, more rigorous and relevant instruction, stronger academic and social supports, and better relationships with teachers than their counterparts in other high schools. Early college students in AIR’s five-state sample reported significantly higher levels of college-going culture and instructor support than their counterparts in traditional high schools. The combination of high expectations and supportive relationships promotes better outcomes for early college students beginning in ninth grade (compared with students in other high schools). For instance, early college students are more likely to persist in college-preparatory math courses, attain a significant number of college credits during high school, and graduate from high school. Importantly, these positive results hold for students from all racial and ethnic groups, including students who enter high school at low levels of math proficiency.


For more information about the studies, the SERVE Center at the University of North Carolina at Greensboro has posted a brief of impact findings from their evaluation of North Carolina early colleges. The American Institutes of Research has posted a brief of impact findings from their five-state evaluation of early colleges.  

Written by James Benson (James.Benson@ed.gov), a Program Officer for Postsecondary Education within NCER’s Policy and Systems Division.

What Does This Mean for Me? A Conversation about College and ADHD

Ever read an article or research abstract and wish you could ask the author questions? In this new IES series, “What Does This Mean for Me,” we are doing just that. IES researchers are answering questions to help students, educators, and others use their research. In the first round of this series, NCER virtual college interns are reaching out with questions relevant to their interests, goals, and communities. We invite you to learn more about not only what education science means for real people but also what students and other community members care about. This blog was written by Shirley Liu, virtual intern at NCER.

 

As part of my virtual internship with IES, I wanted to learn about research that was applicable to my own experiences. I decided to ask Dr. Art Anastopoulos about the unique challenges for postsecondary students with attention deficit hyperactivity disorder (ADHD), as well as strategies and interventions that can help students with ADHD succeed in college. With funding from IES, Dr. Anastopoulos evaluated an intervention called Accessing Campus Connections and Empowering Student Success (ACCESS) for students with ADHD. ACCESS aims to help college students succeed by increasing student knowledge about and ability to manage their diagnosis and to leverage campus supports.

 

Photo of Dr. Art AnastopoulosWhy are students with ADHD more likely to struggle in college than students without ADHD? What might be particularly challenging for them?

There are many possible reasons for why students with ADHD are more likely to struggle. For one thing, many high school students with ADHD lag behind their peers without ADHD, in terms of grade point average, less well-developed study-skills, etc. And this lag persists as they make the transition into college. Students with ADHD are also at increased risk for experiencing co-occurring mental health difficulties, such as depression and anxiety disorders, which together with ADHD interfere with college functioning.

Another useful way to understand the unique challenges of students with ADHD is through the notion of a “perfect storm.” [In this video (from 2:21 – 4:28), Art describes the “perfect storm” as the interplay between a diminished capacity for self-regulation that students with ADHD may have and the high levels of self-regulation that postsecondary education requires of students.]

In addition to their attentional difficulties and impulsivity, many students with ADHD have co-occurring executive functioning deficits, affecting their organization, planning, and time management. Together, such difficulties may lead to academic problems such as having trouble sitting through a boring class, taking detailed lecture notes, attending classes and other meetings on time, waiting until the last minute to complete papers and other long-term assignments, forgetting to preregister for upcoming courses, and placing greater emphasis on speed versus accuracy when taking tests. For similar reasons, students with ADHD may experience interpersonal problems with their friends, as well as difficulties in employment situations.

 

ACCESS is an institution-supported intervention for students with ADHD, but how exactly does ACCESS work?

ACCESS targets multiple deficit areas that can lead to impairment in multiple domains of daily functioning. More specifically, ACCESS is designed to increase student knowledge and understanding of ADHD, their use of behavioral strategies, and their adaptive thinking skills. To the extent that these goals are achieved, improvements in academic, emotional, social, and personal functioning are expected to occur.

 

In your opinion, how can professors best support college students with ADHD?

The most important thing that college professors can do is to respect a student’s need for formally recommended accommodations and to facilitate their implementation. Listed below are four common accommodations for college students with ADHD:

  • Taking exams in private locations where distractions are minimized
  • Having extended time to take exams
  • Being allowed to audio record lectures via smart pens or phone devices
  • Having another person take notes for them

 

How can students with ADHD prepare to succeed in college?

One of the most important thing students can do is to prepare for the increased demands that college brings while still in high school. This includes, for example, increasing their knowledge of ADHD. The more developmentally appropriate their understanding of ADHD is, the more likely students will accept their diagnosis. This can also help them recognize the importance of continuing and/or seeking out necessary treatments, such as medication management and counseling. The more that a student can wean themselves from dependence on parents and others for managing academic demands while in high school, the better able that student will be to manage the increased demands for self-regulation that college brings. This goes beyond academics and includes managing money, preparing meals, doing laundry, getting to doctors’ appointments, etc.

 

In addition to the written responses to my questions, Dr. Anastopoulos also shared links to videos and resources he and his team created as part of the grant. These are curated below and provide general overviews of ACCESS and the research project. In addition, he and his team have two recent publications that share the findings from the evaluation.

Video Resources:

 

Additional information about ACCESS:

 

Additional Reading:

  • Anastopoulos, A.D., Langberg, J.M., Eddy, L.D., Silvia, P.J., & Labban, J.D. (2021).  A randomized controlled trial examining CBT for college students with ADHD.  Journal of Consulting and Clinical Psychology, 89 (1), 21–33.  – Reports significant differences for ACCESS participants, namely of improved ADHD symptoms, executive functioning, clinical change mechanisms, and use of disability accommodations.
  • Eddy, L.D., Anastopoulos, A.D., Dvorsky, M.R., Silvia, P.J., Labban, J.D., & Langberg, J.M. (2021). An RCT of a CBT intervention for emerging adults with ADHD attending college: Functional outcomesJournal of Clinical Child and Adolescent Psychology. Reports findings that ACCESS may improve students’ self-reported general well-being and functioning as well as improved time management and study skills and strategies but may not show as much impact on students’ interpersonal relationships or GPA.

Dr. Art Anastopoulos is a Professor and the Director of the ADHD Clinic in the Department of Human Development and Family Studies in the School of Health and Human Sciences at UNC Greensboro.

Written by Shirley Liu, virtual intern at NCER and an English major at Lafayette College.