Inside IES Research

In 2020, as part of a wider IES investment in resources around cost, IES funded the Cost Analysis in Practice (CAP) Project, a 3-year initiative to support researchers and practitioners who are planning or conducting a cost analysis of educational programs and practices. The CAP Project Help Desk provides free on-demand tools, guidance, and technical assistance, such as support with a cost analysis plan for a grant proposal. After inquiries are submitted to the Help Desk, a member of the CAP Project Team reaches out within two business days. Below is a list of resources that you can access to get more information about cost analysis.

STAGES FOR CONDUCTING A COST ANALYSIS

CAP Project Resources

Cost Analysis Standards and Guidelines 1.0: Practical guidelines for designing and executing cost analyses of educational programs.

IES 2021 RFAs Cost Analysis Requirements: Chart summarizing the CAP Project’s interpretation of the IES 2021 RFAs cost analysis requirements.

Cost Analysis Plan Checklist: Checklist for comprehensive cost analysis plans of educational programs and interventions.

Introduction to Cost Analysis: Video (17 mins).

General Cost Analysis Resources

The Critical Importance of Costs for Education Decisions: Background on cost analysis methods and applications.

Cost Analysis: A Starter Kit: An introduction to cost analysis concepts and steps.

CostOut®: Free IES-funded software to facilitate calculation of costs once you have your ingredients list, includes database of prices.

DecisionMaker®: Free software to facilitate evidence-based decision- making using a cost-utility framework.

Cost-Effectiveness Analysis of Early Reading Programs: A Demonstration With Recommendations for Future Research: Open access journal article.

*More resources available here.

The content for this blog has been adapted from the Cost Analysis in Practice Project informational flyer (CAP Project, 2020) provided by the CAP Project Team. To contact the CAP Help Desk for assistance, please go to https://capproject.org/. You can also find them on Twitter @The_CAP_Project.

Given the many challenges that this year has brought, including the difficulties and uncertainties due to the COVID-19 pandemic, IES is providing different resources and options to assist applicants as they begin preparing their applications. To ensure that program officers can focus their time on project-specific questions, applicants should review these resources first before seeking individual feedback.

First, have a copy of the documents that are needed to submit a proposal. Download a copy of the relevant request for applications (RFA) and the IES Application Submission Guide. This page has PDFs of these documents: https://ies.ed.gov/funding/21rfas.asp. Also, download the application package (search for CFDA 84.305) from https://grants.gov/. Contact Grants.gov (1-800-518-4726; support@grants.gov) if you need help with your electronic grant submission.

Next, take advantage of our digital technical assistance options.

• On-demand webinars. These pre-recorded webinars answer questions about the grant competitions, how to apply, and how to prepare a strong application. You can access them here: https://ies.ed.gov/funding/webinars/.  

• Virtual office hours. This year, we will host a series of drop-in hours during which a program officer will answer questions and give technical assistance. These office hours will help determine which competition or project type is the best fit and also understand some of the requirements and recommendations in the RFAs. Please see the schedule below along with the call-in information. This information is also posted here.

• Cost analysis/Cost-effectiveness analysis. Many RFAs require a cost analysis plan, and some also require a cost effectiveness plan.  Please refer to our list of resources for developing these plans: https://ies.ed.gov/seer/cost_analysis.asp.

• General resources for researchers: IES has a drawn together links to various resources it has sponsored on this webpage: https://ies.ed.gov/resourcesforresearchers.asp.

Finally, please make sure that you attend to the application due dates: https://ies.ed.gov/funding/futureComp.asp because IES does not accept late applications.

Virtual Office Hours

Staff from the research centers will host hour-long drop-in virtual sessions to provide technical assistance around particular competitions or research project types or for general purposes. Applicants are encouraged to join in the discussion and ask questions. These sessions are especially helpful if you are unsure of which competition or project type is the best match for you or if you are unclear on any changes to the requirements or recommendations. Below is a list of the current sessions and their topics. Please attend as many sessions as you would like.

All office hours will use the same call-in details. The program officer will allow participants into the meeting from the “lobby” at the beginning. We recommend you do not use video so that there is sufficient bandwidth. All times are shown in Eastern Standard time.

Join Microsoft Teams Meeting

+1 202-991-0393   United States, Washington DC (Toll)

Conference ID: 915 412 787#

If you would like to request accommodations (e.g., TTY), please send an email to NCER.Commissioner@ed.gov with this request as soon as possible.

You may have to download a free mobile application to use Microsoft Teams if you want the full audio and visual experience from your phone. Clicking on the linked “Join” hyperlink below should prompt you to do this. You can also refer to this article for information: https://support.microsoft.com/en-gb/office/set-up-your-teams-mobile-apps-1ba8dce3-1122-47f4-8db6-00a4f93117e8

Whether you are a trained healthcare provider, a grocery store clerk, or a retired professor, you are probably seeking information about COVID-19 and how best to take care of yourself and others. However, your age, level of education, and other factors may influence how you seek information and how likely you are to benefit from it.

IES researchers Dr. Taka Yamashita (University of Maryland, Baltimore County) and Dr. Phyllis Cummins (Miami University) have been exploring the intersection of education, age, health, and problem solving (grant R305A170183). Program officer, Dr. Meredith Larson, spoke with them about their work and its implications during the current pandemic.

What has the COVID-19 epidemic brought to your attention?

For us, the COVID-19 epidemic has highlighted health information disparities by education and basic skills. In combination with other risk factors, like older age and lower income, some sub-populations are particularly vulnerable in the public health crisis. It is our sincere hope that our research underlines the urgent needs to promote education, literacy, and numeracy throughout the life course, not only to protect vulnerable populations but also to promote disaster preparedness and the well-being of our society.

What does your research suggest are important factors for predicting health information seeking behavior?

In general, we often seek health information only when we need it due to poor health. What is interesting is that, when we need health information, some sociodemographic characteristics and basic skills (for example, reading and numeracy skills) lead to differences. For example, in our analysis of PIAAC data, older age is related to lower usage of online health information sources while greater literacy skills are related to use of more online health information sources. Also, people with greater educational attainment and higher literacy skills are more likely to seek disease prevention and health promotion information from online sources and books. Overall, age, education, and literacy skills are closely and consistently related to what kind of health information sources people use and how much they do it.

How might these factors affect what people find or whether they benefit from it?

Age, education, and literacy skills differentiate how and where people seek health information. We believe that the Internet is one of the best information sources in terms of timeliness and amount of available information. However, some sub-populations, such as younger adults, those with higher education, and those with higher literacy skills, tend to take advantage of and benefit from the online health information more than their counterparts. As such, older adults, those with lower education, and those with lower literacy skills tend not only to miss online health information sources but also to under-utilize and/or mis-use health information.

What could information providers do to better reach different audiences?

Information providers could consider how and where they publish their information. For example, older adults, those with lower education, and those with lower literacy skills tend not to use online sources. Therefore, it is critical to provide accessible health information to offline sources such as newspapers and healthcare professionals (for example, face-to-face with a physician or nurse). Also, paying attention to the “at-risk” populations’ needs is important. There are simple things like using a large font, plain English and multiple languages (for example, English and Spanish) that can immediately enhance the quality of health communication.

Where can people go to learn more about this line of research?

More information about our studies on education and literacy can be found on our IES grant page. Also, one of our recent articles on literacy skills, language use, and online health information seeking among Hispanic adults in the United States has been featured in the CDC (Centers for Disease Control and Prevention) health communications science digest.

Written by Meredith Larson. This is the second in a series of blog posts that explores how researchers respond to various education-related issues and challenges. The first blog post can be found here.

During the COVID-19 pandemic, when people have a heightened need for information, literacy barriers can be life threatening. In the United States, roughly 20 percent of adults read at the lowest level, with another 33 percent still below proficiency¹. Thus, many may be struggling to understand written guidance on COVID-19.

IES researchers at the Center for the Study of Adult Literacy (R305C120001 and R305H180061) and their associated Adult Literacy Research Center at Georgia State University are working to address the needs of adults with literacy skill gaps. Dr. Meredith Larson spoke to Dr. Daphne Greenberg and Dr. Iris Feinberg about their work in this area.

What are your concerns for adults with low literacy during the pandemic?

We have known for a long time that the high prevalence of adults with low basic skills has consequences for both the individual and society. These consequences are heightened during this pandemic. Many adults with low literacy have “essential” jobs and must continue to work. They often interact with many different people daily. So it is crucial that they understand COVID-19 precautions for their own health and because their ability to know and practice safe behaviors has a direct impact on disease transmission to others. To be quite frank, we are concerned about the health and safety of our learners and the health and safety of others.

In the United States, we receive an overwhelming amount information about COVID-19 daily. To make matters worse, there’s no uniform national guidance, some of the information is incorrect, and other information is conflicting. It is challenging for highly literate individuals to make sense of it all. For example: When can a COVID-positive person step out of quarantine? Can someone be re-infected? How many feet constitute safe distance? The list of questions goes on and on.

For someone with low literacy, it’s even more difficult to make sense of all the COVID-19 information. For example, people with low reading skills may not be able to read or understand all of the written information. Additionally, because much of the information is on the internet, adults with low digital skills and/or poor access to the internet have the added problem of not being able to find information that could possibly be helpful to them.

How are you trying to address their needs?

We’ve created a library with a large sample of materials written for 9th grade reading levels and below available on the ALRC website. These documents provide specific information on topics like how to stop the spread or what to do if someone in your home has COVID-19. We hope that providers who work with adults with low literacy skills—like adult educators, community organizers and healthcare providers—will use our library and find the high-interest/low-literacy materials. The library is also divided into “easier” and “harder” resources, so people can quickly find material at appropriate reading levels.

What could healthcare providers, the media, or others do to help?

We all must help those who may not know where to find information. Not everyone knows how or where to look for health information or whether the information they find is valid. Our analysis of PIAAC data found that people with low literacy rely more on TV and radio for information. Simple, short public service announcements that are action oriented would be great for anyone who relies on TV or radio but particularly for those who have low reading skills.

Also, we need to be better prepared for all kinds of emergencies by creating community-wide partnership plans among trusted sources for adults with low literacy like community organizations, healthcare providers, and adult education providers. In addition, we should be following plain language guidelines in all of our written and oral communications. Writing health information in plain language helps everyone and should not be an afterthought.

Written by Meredith Larson. This is the first in a series of blog posts that explores how researchers respond to various education-related issues and challenges.

Over the past few years, staff from IES and the Office of Planning, Research, and Evaluation (OPRE) in the Administration for Children and Families (ACF), U.S. Department of Health and Human Services (HHS), have been learning from and supporting one another’s work. Our offices have a shared interest in understanding and improving outcome for adults in postsecondary career pathway programs and for creating a strong evidence base.

We have even funded projects that dovetail nicely. For example, IES funded a development project focusing on Year Up, and OPRE included Year Up programs in their Pathways for Advancing Careers and Education (PACE) Study.

For IES researchers not already aware of OPRE’s research, we would like to highlight three things that may be particularly relevant to the work IES hopes to support.

A Growing Portfolio of Career Pathway Research: For over a decade, OPRE has created a robust research portfolio longitudinal, rigorous experimental career pathways program research.  These career pathway programs provide postsecondary education and training through a series of manageable steps leading to successively higher credentials and employment opportunities. In particular, OPRE has supported the Pathways for Advancing Careers and Education (PACE) Study and the rigorous evaluation of the Health Profession Opportunity Grants (HPOG) Program. You can find reports from these and other self-sufficiency, welfare, and employment activities in the OPRE Resource Library.

Available Data and Funding Opportunity: Later this summer, OPRE will be archiving data from PACE and HPOG at the University of Michigan’s Inter-University Consortium on Political and Social Research (ICPSR) at the Institute for Social Research. These data will be available as restricted-use files for secondary data analysis. To encourage research, OPRE announced a funding opportunity Career Pathways Secondary Data Analysis Grants to support secondary analysis these data. Applications are due August 16, 2019.

Understanding Programs’ Motivations for Participating in Research: Getting education programs (schools, universities, etc.) to join multi-year, randomized controlled trials is difficult. Programs are wary of random assignment or finding null or negative effects. Yet, the programs that participated in the PACE Study were overall quite supportive. A recent report “We Get a Chance to Show Impact”, Program Staff Reflect on Participating in a Rigorous, Multi-site Evaluation documents the hurdles and benefits of participation from a program’s point of view. These programs’ insights are particularly useful for any researcher hoping to form partnerships with education settings.

To learn more about the ongoing career pathways research at OPRE and their findings, please visit https://www.acf.hhs.gov/opre/research/project/career-pathways-research-portfolio.