American Association For Public Opinion Research

The National Center for Education Statistics (NCES) will staff will offer the following presentations at the American Association For Public Opinion Research Annual Conference.

May 16, 2024

8:00 AM - 9:30 AM

"Just to Confirm...?": Establishing Equitable Survey Methods for Identifying the Transgender Population;

Presenters: Harper Haynes; Elise Christopher; David Richards; Maura Spiegelman
Location: Floor: 2nd; Room: 220

Survey collection of gender identity is essential for obtaining accurate demographic information of a study’s population, and crucial for understanding the experiences of transgender and gender nonconforming individuals in particular. In recent years, the general recommendation has been to collect sex assigned at birth and gender identity separately, referred to as the two-step method. Yet this two-step method can potentially lead to false positives of the transgender population by incorrectly categorizing cisgender respondents as gender minorities, inflating population estimates. To minimize response errors, experts suggest asking respondents to confirm their answers to sex assigned at birth and gender when discordant. However, this confirmation process can invalidate accurate responses and potentially “other” transgender individuals; as such the National Academies committee on measuring SOGI recently recommended more research on the necessity of a confirmation question (NASEM, 2022). As a potential solution to this methodological problem, in a recent field test, we explored the efficacy of asking two separate confirmation questions, one after sex assigned at birth, and another after gender identity of all respondents. We present quality metrics from this field test, such as reliability estimates, timing burden, breakoffs, and nonresponse rates, and contextualize the findings with metrics from other recent studies. Following the results, we discuss the implications of this methodological approach in obtaining accurate gender identification in surveys while reducing potential stigmatization of a minority population. By ensuring accurate reporting of gender identity, surveys can play a vital role in understanding the experiences and needs of the transgender community and informing policies and programs that support their well-being.

4:30 PM - 6:00 PM

DEI in Research Organizations: DEI & Methodology

Presenter: Sheldonn Plummer-Duff, Tamara Terry, Joe Ste.Marie, Sheldonn Plummer-Duff, Rodney Terry, Neha Sahgal, Liz Hamel, Nicole Mitchell and Josue De La Rosa,
Location: Floor: 2nd; Room: 217

Technologies like AI and machine learning are transforming the research industry. But where will DEI fit into this process? Will there still be room for empathy as research becomes more automated? At last year’s AAPOR conference, the “DEI in Research Organizations” roundtable allowed researchers to spotlight how important it was to approach our work via a Diversity, Equity, and Inclusion (DEI) lens. That work continues this year as we turn to how we apply this lens as methodologies become even more modernized.

In recent years, many organizations that participate in AAPOR, including AAPOR itself, have implemented DEI initiatives at both the organization and research levels. AAPOR formed the Inclusion and Equity Committee (IEC) with the charge of establishing, implementing, and maintaining programs that promote the inclusion of diverse AAPOR members. As part of these efforts, we are proposing a continuation of this roundtable discussion that will bring together representatives from the IEC, a variety of AAPOR members, and peer organizations to discuss their experiences and strategies for applying a DEI lens when incorporating new technology and methodologies in their field. The Roundtable discussion will open with a presentation of the IEC’s Annual Report examining AAPOR’s DEI progress and goals, the methods they use to currently measure this, and what ways newer technologies can be incorporated in the future. The presentation will be followed by a moderated discussion featuring an accomplished group of panelists from a broad array of organizations. The panelists will discuss how they navigate this complex topic in their day-to-day work. We approach this always with the goal that while it is important to implement DEI initiatives and strategies, it is equally important to come together to share, learn, and inspire each other to keep moving towards a more equitable future in our work and workplaces.

Friday, May 17, 2024

9:45 AM - 11:15 AM

HISP-AAPOR Sponsored Panel on Recruitment and Research Findings of Latino Adults in the U.S.

Presenter: Josue De La Rosa
Location: Floor: 2nd; Room: 217

The recent 2020 Census highlighted the presence of the Hispanic or Latino population in the U.S., constituting approximately 18.7% of the total populace, up from 6.2% in 1980. Despite this steady growth, disparities remain evident in the educational conditions and achievements of this demographic.

To comprehensively assess and report on the educational state of Hispanic/Latino students, the National Center for Education Statistics (NCES) has harnessed an array of data sources, such as administrative records, surveys, and assessments, all while navigating the challenges of limited resources and rising costs.

By leveraging these diverse methodologies, NCES has successfully documented key indicators including academic achievements, graduation rates, postsecondary outcomes, and the characteristics of educators serving the Hispanic/Latino community. This presentation will delve into these findings, offering an up-to-date estimation of Hispanic/Latino education in the U.S., while also pinpointing areas in need of enhanced data collection and analysis.