IES Blog

Institute of Education Sciences

You’ve Been Asked to Participate in a Study

Dear reader,

You’ve been asked to participate in a study.

. . . I know what you’re thinking. Oh, great. Another request for my time. I am already so busy.

Hmm, if I participate, what is my information going to be used for? Well, the letter says that collecting data from me will help researchers study education, and it says something else about how the information I provide would “inform education policy . . .”

But what does that mean?

If you’re a parent, student, teacher, school administrator, or district leader, you may have gotten a request like this from me or a colleague at the National Center for Education Statistics (NCES). NCES is one of 13 federal agencies that conducts survey and assessment research in order to help federal, state, and local policymakers better understand public needs and challenges. It is the U.S. Department of Education’s (ED’s) statistical agency and fulfills a congressional mandate to collect, collate, analyze, and report statistics on the condition of American education. The law also directs NCES to do the same about education across the globe.

But how does my participation in a study actually support the role Congress has given NCES?

Good question. When NCES conducts a study, participants are asked to provide information about themselves, their students or child/children, teachers, households, classrooms, schools, colleges, or other education providers. What exactly you will be asked about is based on many considerations, including previous research or policy needs. For example, maybe a current policy might be based on results from an earlier study, and we need to see if the results are still relevant. Maybe the topic has not been studied before and data are needed to determine policy options. In some cases, Congress has charged NCES with collecting data for them to better understand education in general.

Data collected from participants like you are combined so that research can be conducted at the group level. Individual information is not the focus of the research. Instead, NCES is interested in the experiences of groups of people or groups of institutions—like schools—based on the collected data. To protect respondents, personally identifiable information like your name (and other information that could identify you personally) is removed before data are analyzed and is never provided to others. This means that people who participate in NCES studies are grouped in different ways, such as by age or type of school attended, and their information is studied to identify patterns of experiences that people in these different groups may have had.

Let’s take a look at specific examples that show how data from NCES studies provide valuable information for policy decisions.

When policymakers are considering how data can inform policy—either in general or for a specific law under consideration—data from NCES studies play an important role. For example, policymakers concerned that students in their state/district/city often struggle to pay for college may be interested in this question:

“What can education data tell me about how to make college more affordable?”

Or policymakers further along in the law development process might have more specific ideas about how to help low-income students access college. They may have come across research linking programs such as dual enrollment—when high school students take college courses—to college access for underrepresented college students. An example of this research is provided in the What Works Clearinghouse (WWC) dual-enrollment report produced by ED’s Institute for Education Sciences (IES), which shows that dual-enrollment programs are effective at increasing students’ access to and enrollment in college and attainment of degrees. This was found to be the case especially for students typically underrepresented in higher education.   

Then, these policymakers might need more specific questions answered about these programs, such as:

What is the benefit of high school students from low-income households also taking college courses?”

Thanks to people who participate in NCES studies, we have the data to address such policy questions. Rigorous research using data from large datasets, compiled from many participants, can be used to identify differences in outcomes between groups. In the case of dual-enrollment programs, college outcomes for dual-enrollment participants from low-income households can be compared with those of dual-enrollment participants from higher-income households, and possible causes of those differences can be investigated.

The results of these investigations may then inform enactment of laws or creation of programs to support students. In the case of dual enrollment, grant programs might be set up at the state level for districts and schools to increase students’ local access to dual-enrollment credit earning.

This was very close to what happened in 2012, when I was asked by analysts in ED’s Office of Planning, Evaluation, and Policy Development to produce statistical tables with data on students’ access to career and technical education (CTE) programs. Research, as reviewed in the WWC dual-enrollment report, was already demonstrating the benefits of dual enrollment for high school students. Around 2012, ED was considering a policy that would fund the expansion of dual enrollment specifically for CTE. The reason I was asked to provide tables on the topic was my understanding of two important NCES studies, the Education Longitudinal Study of 2002 (ELS:2002) and the High School Longitudinal Study of 2009 (HSLS:09). Data provided by participants in those studies were ideal for studying the question. The tables were used to evaluate policy options. Based on the results, ED, through the President, made a budget request to Congress to support dual-enrollment policies. Ultimately, dual-enrollment programs were included in the Strengthening Career and Technical Education for the 21st Century Act (Perkins V).  

The infographic below shows that this scenario—in which NCES data provided by participants like you were used to provide information about policy—has happened on different scales for different policies many times over the past few decades. The examples included are just some of those from the NCES high school longitudinal studies. NCES data have been used countless times in its 154-year history to improve education for American students. Check out the full infographic (PDF) with other examples.


Excerpt of full infographic showing findings and actions for NCES studies on Equity, Dropout Prevention, and College and Career Readiness


However, it’s not always the case that a direct line can be drawn between data from NCES studies and any one policy. Research often informs policy indirectly by educating policymakers and the public they serve on critical topics. Sometimes, as in the dual-enrollment and CTE programs research question I investigated, it can take time before policy gets enacted or a new program rolls out. This does not lessen the importance of the research, nor the vital importance of the data participants provide that underpin it.

The examples in the infographic represent experiences of actual individuals who took the time to tell NCES about themselves by participating in a study.  

If you are asked to participate in an NCES study, please consider doing so. People like you, schools like yours, and households in your town do matter—and by participating, you are helping to inform decisions and improve education across the country.

 

By Elise Christopher, NCES

Introducing NCES’s New Locale-Focused Resource Hub: Education Across America

NCES is excited to announce the release of a resource hub that focuses on data by geographic locale—Education Across America: Cities, Suburbs, Towns, and Rural Areas—using a three-phased approach. Released today, Phase I of this new resource hub involves the consolidation of locale-focused data across NCES surveys and programs and makes updates to the latest data available. The result of this work is 140 tables with data disaggregated by all four locales (i.e., cities, suburbs, towns, and rural areas). These tables cover a wide range of topics grouped into broad themes: family characteristics, educational experiences, school resources and staffing, and educational outcomes. Phases II and III will focus on rural areas and involve summarizing findings in text.

To make these data more relevant and useful, NCES adopted a pyramid approach1 to attend to various user segments with tiered products (exhibit 1). Source tables containing data disaggregated by locale form the base of the pyramid. These tables, which contain the most detailed statistical information about education in each locale, target data-savvy users such as researchers.


Exhibit 1. Tiered Approach to Products in Education Across America Resource Hub

Infographic showing pyramid with five levels of NCES products; from bottom to top: source tables, indicators, thematic summaries, briefs, and digital media


The next level is indicators. These indicators, comprising text and figures, will supply in-depth analyses that focus on rural areas. In order to make our data relevant and useful, literature review and focused groups were conducted to identify the topics that are important to education in rural areas. The target audience for these indicators is those who are looking for comprehensive discussions on specific topics in rural education.

The middle level of the pyramid is thematic summaries. These summaries synthesize findings across multiple indicators grouped together by a theme. In addition to thematic summaries, we will create a spotlight that focuses on distant and remote rural areas because these areas are confronted with unique challenges and are of particular policy interest. These products target education leaders in higher education and at the state and local levels.

The next level of the pyramid is briefs, which includes an executive summary on key findings about rural education and an at-a-glance resource that highlights important statistics about schools and students in rural areas. These products are designed as quick reads and target nontechnical audiences—such as state and local education leaders, associations, and policymakers—as well as individuals with an interest in education—such as educators and parents.

The final level of the pyramid is digital media, which includes blogs and social media posts that highlight key findings and resources available in the Education Across America resource hub. These products are designed to connect the media, parents, and educators with information on educational experiences across America.

Phase II involves the development of 5 to 10 indicators focused on the experience of schools and students in rural areas and is expected to be completed in June 2022. Phase III—which is expected to be completed in October 2022—consists of the development of the remaining indicators as well as the products in the thematic summaries and briefs tiers.

Check out our locale-focused research hub, Education Across America, today. Be sure to check back over the summer and fall to explore the hub as we release new products focusing on education in rural areas.

 

By Xiaolei Wang, Ph.D., NCES; and Jodi Vallaster, Ed.D., NCES


[1] Schwabish, J. (2019). “Use the Pyramid Philosophy’ to Better Communicate Your Research.” Urban Institute. https://www.urban.org/urban-wire/use-pyramid-philosophy-better-communicate-your-research; Scanlan, C. (2003). “Writing from the Top Down: Pros and Cons of the Inverted Pyramid.” Poynter. https://www.poynter.org/reporting-editing/2003/writing-from-the-top-down-pros-and-cons-of-the-inverted-pyramid/

Introducing a New Resource Page for the IPEDS Outcome Measures (OM) Survey Component

The National Center for Education Statistics (NCES) has introduced a new resource page for the Integrated Postsecondary Education Data System (IPEDS) Outcome Measures (OM) survey component. This blog post provides an overview of the webpage and is the first in a series of blog posts that will showcase OM data.

Measuring Student Success in IPEDS: Graduation Rates (GR), Graduation Rates 200% (GR200), and Outcome Measures (OM) is a new resource page designed to help data reporters and users better understand the value of OM data and how the OM survey component works, particularly when compared with the Graduation Rates (GR) and Graduation Rates 200% (GR200) survey components.

The OM survey component was added to IPEDS in 2015–16 in an effort to capture postsecondary outcomes for more than so-called “traditional” college students. From 1997–98 to 2015–16, IPEDS graduation rate data were collected only for first-time, full-time (FTFT) degree/certificate-seeking (DGCS) undergraduates through the GR and GR200 survey components. Unlike these survey components, OM collects student outcomes for all entering DGCS undergraduates, including non-first-time students (i.e., transfer-in students) and part-time students.

Outcome measures are useful as characteristics of students vary by the level of institution. In 2009, some 4.7 million students began at 2-year postsecondary institutions, and 25 percent were full-time students who were attending college for the first time. During the same period, some 4.5 million students began at 4-year institutions, and 44 percent were first-time, full-time students.1

The new resource page answers several important questions about OM, GR, and GR200, including the following:

  • Which institutions complete each survey component?
  • Does the survey form vary by institutional type?
  • What student success measures are included?
  • Which students are included in the cohort?
  • What is the timeframe for establishing student cohorts?
  • Which subgroups (disaggregates) are included?
  • What is the timing of data collection and release?

In answering these questions, the resource page highlights that OM provides a more comprehensive view of student success than do GR and GR200. Furthermore, it suggests that OM, GR, and GR200 are not directly comparable, as the survey components differ in terms of which institutions complete them, which students are captured, and how each measures cohorts. Here are some of the key differences:

  • Institutions with FTFT cohorts complete the GR and GR200 components, whereas degree-granting institutions complete the OM component.
  • GR and GR200 include only FTFT DGCS undergraduates, whereas OM includes all DGCS undergraduates.
  • GR and GR200 cohorts are based on a fall term for academic reports and a full year (September 1–August 31) for program reporters, whereas OM cohorts are based on a full year (July 1–June 30) for all degree-granting institutions.

Finally, the resource page outlines how OM works, including how cohorts and subcohorts are established, which outcomes are collected at various status points, and when the public have access to submitted data. Exhibit 1 presents the current 2021–22 data collection timeline, including the cohort year, outcome status points, data collection period, and public release of OM data.


Exhibit 1. 2021­–22 Outcome Measures (OM) data collection timeline (2013–14 entering degree/certificate-seeking cohort)

Infographic showing the 2020—21 OM data collection timeline, including the cohort year, outcome status points, data collection period, and public release of OM data


Data reporters and users are encouraged to utilize the new OM survey component resource page to better understand the scope of OM, how it works, and how it differs from GR and GR200. Stay tuned for a follow-up blog post featuring data from OM that further highlights the survey component’s usefulness in measuring student success for all DGCS undergraduate students.

 

By Tara Lawley, NCES; Roman Ruiz, AIR; Aida Ali Akreyi, AIR; and McCall Pitcher, AIR


[1] U.S. Department of Education, National Center for Education Statistics, Integrated Postsecondary Education Data System (IPEDS), Winter 2017–18, Outcome Measures component; and IPEDS Fall 2009, Institutional Characteristics component. See Digest of Education Statistics 2018, table 326.27.

NCES Activities Dedicated to Understanding the Condition of Education During the Coronavirus Pandemic

The emergence of the coronavirus pandemic 2 years ago shifted not only how students received educational services around the world but also how the National Center for Education Statistics (NCES) carried out its mission, which is to collect, analyze, and report statistics on the condition of education in the United States.

NCES has conducted several surveys to measure educational enrollment, experiences, and outcomes as part of existing data collections and created new, innovative, and timely data initiatives. NCES is currently fielding more than 15 projects with information related to the pandemic. Since early 2020, NCES has collected information about educational experiences of students from elementary through postsecondary institutions. A few of the data collections will extend beyond 2022, providing rich data resources that will document changes in the educational landscape throughout the lifecycle of the pandemic.


NCES Coronavirus Pandemic Data Collection Coverage


In order to respond to the call for information about how students learned during widespread school disruptions, NCES modified existing and created new data collection avenues to receive and report vital information in unprecedented ways. Below are summaries of some of the data products available.

Looking ahead, NCES will provide NAEP data on how student performance has changed in various subjects since the coronavirus pandemic began. NCES will also collect and report information about learning contexts, which are critical for understanding educational outcomes. NCES will also develop a new system to share pandemic-related data collected across the center.

All of these resources are currently available or will be available on the NCES website.

 

By Ebony Walton and Josh DeLaRosa, NCES

2021–22 School Pulse Panel on the Impact of the COVID-19 Pandemic

To support schools and districts as they respond to the COVID-19 pandemic, the National Center for Education Statistics (NCES) has launched the School Pulse Panel (SPP). The SPP will increase our ability to report timely information on the operating status of public schools. This effort is part of the Institute of Education Sciences (IES) response to the Executive Order on Supporting the Reopening and Continuing Operation of Schools and Early Childhood Education Providers

The SPP is a monthly survey completed by a small group of schools to help education leaders understand the impact of the COVID-19 pandemic on education across the country. NCES, within the U.S. Department of Education, is conducting this study in coordination with the U.S. Census Bureau and other federal agencies.

Accessing Survey Findings

NCES releases reports about 4 weeks after each monthly collection via an online dashboard. Results from the summer 2021September 2021, and January 2022 data collections are available now. Check back to see the latest findings. 

Survey Topics

The survey asks questions on the following topics, which focus on how COVID-19 has affected schools (note that survey content will change slightly on a monthly basis):

  • Instructional mode offered by schools
  • Strategies to address pandemic-related learning needs
  • Safe and healthy school mitigation strategies
  • Principal and staff experiences
  • Mental health and well-being of students and staff
  • Special education services
  • Use of technology
  • Information on staffing and food and nutrition programs
  • Parental/staff/student concerns

The graphic below shows the content areas for January 2022 through May 2022. The red boxes represent content areas that will repeat monthly; the yellow boxes represent content areas that will not repeat monthly.
 


More Information

To learn more, visit the School Pulse Panel website and explore the FAQs. For general questions, contact the U.S. Census Bureau at 1-844-868-3661 or via e-mail at addp.school.pulse.panel@census.gov.

 

By Josue DeLaRosa and Rachel Hansen, NCES