Inside IES Research

Until recently, limited data existed in education research focused on the LGBTQI+ community and their experiences. As this area of interest continues to grow, education researchers are learning how to effectively collect these data, interpret their implications, and use them to help improve the educational outcomes of LGBTQI+ identifying students. In this blog post, we review current federal recommendations for data collection and encourage researchers to submit FY 2024 applications focused on the educational experiences and outcomes of Lesbian, Gay, Bisexual, Transgender, Queer, and Intersex (LGBTQI+) identifying students.

Collecting Data on Sexual Orientation and Gender Identities

In January 2023, the Office of the Chief Statistician of the United States released a report with recommendations on how to effectively design federal statistics surveys to account for sexual orientation and gender identities (SOGI). While this report is for a federal audience, the recommendations are relevant and useful for education researchers who wish to measure the identities and experiences of those in the LGBTQI+ community. Some suggestions include—

• Provide multiple options for sexual orientation identification (for example, gay/lesbian, straight, bisexual, use other term)
• Provide a two-question set in order to measure gender identity—one asking for sex assigned at birth, and one for current self-identification
• Provide write-in response and multiple-response options for SOGI-related questions
• Allow respondents to proceed through the survey if they choose not to answer unless answers to any of these items are critical for data collection

Education researchers looking to incorporate SOGI data into their studies can also use existing SOGI data collected by the National Center for Education Statistics (NCES) to support their research. A new NCES blog outlines the studies that collect SOGI information and outlines some initial findings from that data.

Funding Opportunities for Research to Improve Outcomes of LGBTQI+ students

In alignment with the SEER Equity Standard, IES encourages researchers to submit applications to the FY 2024 research grant competitions that support the academic and social behavioral outcomes of students who identify as LGBTQI+. IES is especially interested in research proposals that involve—

• Describing the educational experiences and outcomes of LGBTQI+ students
• Creating safe and inclusive learning environments that support the needs of all LGBTQI+ students.
• Identifying promising practices for school-based health services and supports, especially mental health services, that are accessible to and supportive of LGBTQI+ students
• Identifying systems-level approaches that reduce barriers to accessing and participating in high quality learning environments for LGBTQI+ students

Check out our funding opportunities page for more information about our FY 2024 requests for applications. If you have specific questions about the appropriateness of your research for a specific FY 2024 research competition, please contact the relevant program officer listed in the request for applications.

This blog is part of a 3-part Inside IES Research blog series on sexual orientation and gender identity in education research in observance of Pride month. The other posts discuss the feedback from the IES LGBTQI+ Listening and Learning session and the first ever learning game featuring a canonically nonbinary character.

This blog was produced by Virtual Student Federal Service intern Audrey Im with feedback from IES program officers Katina Stapleton (NCER - Katina.Stapleton@ed.gov) and Katherine Taylor (NCSER - Katherine.Taylor@ed.gov) and NCES project officers Elise Christopher (Elise.Christopher@ed.gov) and Maura Spiegelman (Maura.Spiegelman@ed.gov).

Over the last few months, staff from the National Center for Education Research, the National Center for Special Education Research, and the Standards and Review Office have partnered to increase our awareness of diversity, equity, inclusion, and accessibility issues (DEIA) in the IES-grant making process. The goal is to broaden participation of institutions and researchers who apply for and receive IES grants, increase the diversity of IES panel reviewers, and encourage culturally responsive research across our grant competitions.

Based on feedback from our December 2020 technical working group Increasing Diversity and Representation of IES-funded Education Researchers, we are hosting a series of Listening and Learning sessions with researchers and other stakeholder groups. The first session, How Can the Institute of Education Sciences Support HBCU Applicants, was held during HBCU Week in partnership with the White House Initiative on Advancing Educational Equity, Excellence, and Economic Opportunity through Historically Black Colleges and Universities. We discussed lessons learned in our DEIA blog update and used this feedback to develop an HBCU-specific presentation of IES funding opportunities for HBCU Research and Innovation Week.

Over the next few months, IES will hold additional virtual Listening and Learning sessions, including Leveraging the Voices of Persons with Disabilities in Education Research. Unless specified, these sessions will be open to the public and will require registration. More information about the sessions and registration links will be available on the IES website. If you have questions about the events or would like to schedule one specific to your community, please contact IESVirtualTA@ed.gov.

Listening and Learning Sessions:​

• Leveraging Hispanic Voices in Education Research – December 6, 2021 at 1 pm ET. Hosted jointly with the White House Initiative on Advancing Educational Equity, Excellence and Economic Opportunity for Hispanics.
• Leveraging Black Voices in Education Research – December 9, 2021 at 2 pm ET. Hosted jointly with the White House Initiative on Advancing Educational Equity, Excellence, and Economic Opportunity for Black Americans.
• Leveraging Asian American, Native Hawaiian and Pacific Islander Voices in Education Research – January 18, 2022 at 2:30pm ET. Hosted jointly with the White House Initiative on Asian Americans, Native Hawaiians, and Pacific Islanders.
• Leveraging Native American and Alaska Native Voices in Education Research – Date to be determined. Hosted jointly with the White House Initiative on Advancing Educational Equity, Excellence, and Economic Opportunity for Native Americans and Strengthening Tribal Colleges and Universities.
• Leveraging the Voices of Persons with Disabilities in Education Research – Date to be determined.

Over the past few years, staff from IES and the Office of Planning, Research, and Evaluation (OPRE) in the Administration for Children and Families (ACF), U.S. Department of Health and Human Services (HHS), have been learning from and supporting one another’s work. Our offices have a shared interest in understanding and improving outcome for adults in postsecondary career pathway programs and for creating a strong evidence base.

We have even funded projects that dovetail nicely. For example, IES funded a development project focusing on Year Up, and OPRE included Year Up programs in their Pathways for Advancing Careers and Education (PACE) Study.

For IES researchers not already aware of OPRE’s research, we would like to highlight three things that may be particularly relevant to the work IES hopes to support.

A Growing Portfolio of Career Pathway Research: For over a decade, OPRE has created a robust research portfolio longitudinal, rigorous experimental career pathways program research.  These career pathway programs provide postsecondary education and training through a series of manageable steps leading to successively higher credentials and employment opportunities. In particular, OPRE has supported the Pathways for Advancing Careers and Education (PACE) Study and the rigorous evaluation of the Health Profession Opportunity Grants (HPOG) Program. You can find reports from these and other self-sufficiency, welfare, and employment activities in the OPRE Resource Library.

Available Data and Funding Opportunity: Later this summer, OPRE will be archiving data from PACE and HPOG at the University of Michigan’s Inter-University Consortium on Political and Social Research (ICPSR) at the Institute for Social Research. These data will be available as restricted-use files for secondary data analysis. To encourage research, OPRE announced a funding opportunity Career Pathways Secondary Data Analysis Grants to support secondary analysis these data. Applications are due August 16, 2019.

Understanding Programs’ Motivations for Participating in Research: Getting education programs (schools, universities, etc.) to join multi-year, randomized controlled trials is difficult. Programs are wary of random assignment or finding null or negative effects. Yet, the programs that participated in the PACE Study were overall quite supportive. A recent report “We Get a Chance to Show Impact”, Program Staff Reflect on Participating in a Rigorous, Multi-site Evaluation documents the hurdles and benefits of participation from a program’s point of view. These programs’ insights are particularly useful for any researcher hoping to form partnerships with education settings.

To learn more about the ongoing career pathways research at OPRE and their findings, please visit https://www.acf.hhs.gov/opre/research/project/career-pathways-research-portfolio.

Overview

On or about February 15, 2019, the Small Business Innovation Research Program at the US Department of Education’s Institute of Education Sciences (ED/IES SBIR) anticipates releasing a Special Topic Solicitation #91990019R0016 in Postsecondary Education. The solicitation will be announced through an IES Newsflash and will be posted here. It will request Phase I proposals for awards of up to $200,000 for 8 months to develop a prototype of a "ROI tool.” The tool will be designed to measure the costs versus benefits (the return on investment) of different postsecondary education and training programs to help students make well-informed choices about options to pursue after they complete high school.

Applicants must be a for-profit business 500 employees or less, and U.S. owned and operated. Applicants may partner with entities or organizations working on related initiatives in the field of postsecondary education, or may subcontract to non-profit researchers or individuals with specialized expertise as needed. The due date for submission for proposals will likely be on or about April 15, 2019, with awards in mid-June, and projects beginning shortly thereafter. All Phase I awardees will be eligible to apply for a Phase II award in 2020, for $900,000 for full scale development and research to test and validate the ROI tool.

Background

While many websites provide ways for students to explore colleges or careers and occupations of interest (e.g., such as College Scorecard and CareerOneStop), there is currently no tool that helps students understand the costs and benefits of individual postsecondary programs in an integrated, customizable, and user-friendly manner.  An ROI tool would likely combine information on individual program’s tuition and fees, time needed to complete, and expected earnings. Because these characteristics can vary significantly across programs and institutions, creating a single estimated measure of ROI would allow students to more easily compare postsecondary program options. If it helps students make better choices, it could lead to improved program completion rates, higher levels of employment and earnings, less education-related debt, and more satisfaction with their selected education and career paths. 

The ED/IES SBIR Special Topic intends to fund up to five (5) Phase I projects to (a) develop and research a prototype of an ROI tool, and (b) conduct planning and concept testing for a fully developed ROI tool that provides a user-friendly experience for students. The prototype of the ROI tool developed in Phase I shall integrate with one or more existing technology systems, data sets, data standards, or resources (such as CareerOneStop or College Scorecard), and add new data elements provided by an end-user.  After a successful Phase I project, it is anticipated that small businesses that win Phase II awards will complete the full-scale development of the ROI tool that was started in Phase I, including developing an interface to improve the experience of students using the ROI tool.

Because data for ROI at the program level may only be available from some states, regions, or sets of institutions at this time, it is expected that the scope of the ROI tool developed in Phase I & II would be limited and would not be an attempt to calculate ROI for every program and institution in the country. Applicants must propose a project scope that appropriately reflects the datasets that are to be integrated within the new ROI tool, and the amount of funding and time allotted for development and research of the SBIR awards in Phase I and II.  Small businesses that are interested in this solicitation must have expertise with related efforts in the field to enhance student choices by linking education and workforce information.

Potential applicants may submit questions to ED’s Contracting Specialist Kevin.Wade@ed.gov. All questions and responses will be posted publically on the same website where the solicitation is posted as Amendments to the Solicitation.

The IES Goal Structure was created to support a continuum of education research that divides the research process into stages for both theoretical and practical purposes. Individually, the five goals – Exploration (Goal 1), Development and Innovation (Goal 2), Efficacy and Replication (Goal 3), Effectiveness (Goal 4), and Measurement (Goal 5) – were intended to help focus the work of researchers, while collectively they were intended to cover the range of activities needed to build evidence-based solutions to the most pressing education problems in our nation. Implicit in the goal structure is the idea that over time, researchers will identify possible strategies to improve student outcomes (Goal 1), develop and pilot-test interventions (Goal 2), and evaluate the effects of interventions with increasing rigor (Goals 3 and 4).

Over the years, IES has received many applications and funded a large number of projects under Goals 1-3.  In contrast, IES has received relatively few applications and awarded only a small number of grants under Goal 4. To find out why – and to see if there were steps IES could take to move more intervention studies through the evaluation pipeline – IES hosted a Technical Working Group (TWG) meeting in 2016 to hear views from experts on what should come after an efficacy study (see the relevant summary and blog post). IES also issued a request for public comment on this question in July 2017 (see summary).

The feedback we received was wide-ranging, but there was general agreement that IES could do more to encourage high-quality replications of interventions that show prior evidence of efficacy. One recommendation was to place more emphasis on understanding “what works for whom” under various conditions.  Another comment was that IES could provide support for a continuum of replication studies.  In particular, some commenters felt that the requirements in Goal 4 to use an independent evaluator and to carry out an evaluation under routine conditions may not be practical or feasible in all cases, and may discourage some researchers from going beyond Goal 3.   

In response to this feedback, IES revised its FY 2019 RFAs for Education Research Grants (84.305A) and Special Education Research Grants (84.324A) to make clear its interest in building more and better evidence on the efficacy and effectiveness of interventions. Among the major changes are the following:

• Starting in FY 2019, Goal 3 will continue to support initial efficacy evaluations of interventions that have not been rigorously tested before, in addition to follow-up and retrospective studies.
• Goal 4 will now support all replication studies of interventions that show prior evidence of efficacy, including but not limited to effectiveness studies.
• The maximum amount of funding that may be requested under Goal 4 is higher to support more in-depth work on implementation and analysis of factors that moderate or mediate program effects.

The table below summarizes the major changes. We strongly encourage potential applicants to carefully read the RFAs (Education Research, 84.305A and Special Education Research, 84.324A) for more details and guidance, and to contact the relevant program officers with questions (contact information is in the RFA).

Applications are due August 23, 2018 by 4:30:00 pm Washington DC time.

By Thomas Brock (NCER Commissioner) and Joan McLaughlin (NCSER Commissioner)